2024-04-25T21:46:45.417 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T21:46:45.418 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi --verbose --archive /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030 --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} --owner scheduled_teuthology@teuthology -- /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030/orig.config.yaml 2024-04-25T21:46:45.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T21:46:45.540 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030 branch: squid description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7674030' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zlib bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: b22e2ebdeb24376882b7bda2a7329c8cccc2276a owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 9595 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 3/4 suite: powercycle suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: b22e2ebdeb24376882b7bda2a7329c8cccc2276a targets: smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGxFXLuB+xX6hp4MSIuccdeAzHqxg/oh5ij2//gEPWSMthYpPZOCnhr8yz8pBGbdTxlP2W+wQt0kiZAe20MNBbc= smithi057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtO9f3xc6jHnNF5q1xmbJVg1UeBREh5IbSHtuyptqQ2rHOkvnr2YOAPxv4q/5+BSXKVDafr3NVPMLdWHmMlYbo= smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJnmApPVU7+7hurmNSl7aKatvbce8bzKA1gUHUi1pTUw0pFItiAbPr0L8NxaUpI3rZTTatYfwDYPzFlHYgv0ruI= smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF4jsp+F3qhLNTuzqyLCbJuqcTGoqRZ2yFEd63zdb9M+ZVs71Fg2Jp7O/h++Pl3t3I9/j22t7WvvZ9bOx4GSl5w= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_21:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T21:46:45.540 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa; will attempt to use it 2024-04-25T21:46:45.541 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa/tasks 2024-04-25T21:46:45.541 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T21:46:45.542 INFO:teuthology.task.internal:Checking packages... 2024-04-25T21:46:45.572 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-25T21:46:45.572 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T21:46:45.572 INFO:teuthology.packaging:ref: None 2024-04-25T21:46:45.572 INFO:teuthology.packaging:tag: None 2024-04-25T21:46:45.572 INFO:teuthology.packaging:branch: squid 2024-04-25T21:46:45.573 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T21:46:45.573 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-04-25T21:46:45.766 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2447-gb22e2ebd-1jammy 2024-04-25T21:46:45.768 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T21:46:45.774 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T21:46:45.774 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T21:46:45.780 INFO:teuthology.task.internal:Saving configuration 2024-04-25T21:46:45.805 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T21:46:45.811 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T21:46:45.835 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 21:40:50.714414', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINs48HOIkLOcEs2lBD92ySxVdpluuNo7F/eQWkY35tEm'} 2024-04-25T21:46:45.859 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 21:40:50.716110', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAID01ldTHVrz1p4YgUJgjA+9wVafM+vykm0LK85CV9AT0'} 2024-04-25T21:46:45.881 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 21:40:50.710601', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPcIG4D/YjKh7O2nQqI19iytxaqJRBaCpz1044aM1l2z'} 2024-04-25T21:46:45.903 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 21:40:50.712683', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMATFOddVe+Nx83RGppXLSb+WtO2XWS2WIiwe+m3lNOJ'} 2024-04-25T21:46:45.903 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T21:46:45.909 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-25T21:46:45.909 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['osd.0'] 2024-04-25T21:46:45.910 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['osd.1'] 2024-04-25T21:46:45.910 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['osd.2'] 2024-04-25T21:46:45.910 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T21:46:46.048 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbd5bc70280>, signals=[15]) 2024-04-25T21:46:46.048 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T21:46:46.055 INFO:teuthology.task.internal:Opening connections... 2024-04-25T21:46:46.055 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2024-04-25T21:46:46.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:46:46.147 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T21:46:46.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:46:46.232 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T21:46:46.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:46:46.311 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-04-25T21:46:46.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:46:46.396 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T21:46:46.403 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-04-25T21:46:46.409 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-04-25T21:46:46.409 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-04-25T21:46:46.457 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T21:46:46.458 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="Ubuntu" 2024-04-25T21:46:46.458 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="22.04" 2024-04-25T21:46:46.458 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T21:46:46.458 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_CODENAME=jammy 2024-04-25T21:46:46.458 INFO:teuthology.orchestra.run.smithi044.stdout:ID=ubuntu 2024-04-25T21:46:46.458 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE=debian 2024-04-25T21:46:46.458 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T21:46:46.458 INFO:teuthology.orchestra.run.smithi044.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T21:46:46.458 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T21:46:46.458 INFO:teuthology.orchestra.run.smithi044.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T21:46:46.458 INFO:teuthology.orchestra.run.smithi044.stdout:UBUNTU_CODENAME=jammy 2024-04-25T21:46:46.459 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-04-25T21:46:46.483 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2024-04-25T21:46:46.489 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2024-04-25T21:46:46.489 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-04-25T21:46:46.537 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T21:46:46.537 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu" 2024-04-25T21:46:46.537 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="22.04" 2024-04-25T21:46:46.537 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T21:46:46.537 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=jammy 2024-04-25T21:46:46.538 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu 2024-04-25T21:46:46.538 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian 2024-04-25T21:46:46.538 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T21:46:46.538 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T21:46:46.538 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T21:46:46.538 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T21:46:46.538 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=jammy 2024-04-25T21:46:46.538 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-04-25T21:46:46.566 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-04-25T21:46:46.572 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-04-25T21:46:46.572 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-04-25T21:46:46.619 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T21:46:46.619 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Ubuntu" 2024-04-25T21:46:46.619 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="22.04" 2024-04-25T21:46:46.619 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T21:46:46.620 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_CODENAME=jammy 2024-04-25T21:46:46.620 INFO:teuthology.orchestra.run.smithi079.stdout:ID=ubuntu 2024-04-25T21:46:46.620 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE=debian 2024-04-25T21:46:46.620 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T21:46:46.620 INFO:teuthology.orchestra.run.smithi079.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T21:46:46.620 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T21:46:46.620 INFO:teuthology.orchestra.run.smithi079.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T21:46:46.620 INFO:teuthology.orchestra.run.smithi079.stdout:UBUNTU_CODENAME=jammy 2024-04-25T21:46:46.620 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-04-25T21:46:46.649 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-04-25T21:46:46.656 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-04-25T21:46:46.656 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-04-25T21:46:46.706 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T21:46:46.706 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Ubuntu" 2024-04-25T21:46:46.706 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="22.04" 2024-04-25T21:46:46.706 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T21:46:46.706 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_CODENAME=jammy 2024-04-25T21:46:46.706 INFO:teuthology.orchestra.run.smithi081.stdout:ID=ubuntu 2024-04-25T21:46:46.706 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE=debian 2024-04-25T21:46:46.706 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T21:46:46.706 INFO:teuthology.orchestra.run.smithi081.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T21:46:46.706 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T21:46:46.706 INFO:teuthology.orchestra.run.smithi081.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T21:46:46.707 INFO:teuthology.orchestra.run.smithi081.stdout:UBUNTU_CODENAME=jammy 2024-04-25T21:46:46.707 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-04-25T21:46:46.732 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T21:46:46.741 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T21:46:46.747 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T21:46:46.747 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2024-04-25T21:46:46.750 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2024-04-25T21:46:46.752 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2024-04-25T21:46:46.755 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-04-25T21:46:46.760 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T21:46:46.765 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T21:46:46.765 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2024-04-25T21:46:46.798 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2024-04-25T21:46:46.800 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2024-04-25T21:46:46.802 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-04-25T21:46:46.817 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T21:46:46.912 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T21:46:46.927 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-25T21:46:46.927 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-25T21:46:46.927 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T21:46:46.928 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T21:46:46.928 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T21:46:46.928 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T21:46:46.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T21:46:46.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T21:46:46.934 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-04-25T21:46:46.934 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2024-04-25T21:46:46.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T21:46:46.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T21:46:46.936 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-04-25T21:46:46.936 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-04-25T21:46:46.981 INFO:teuthology.orchestra.run.smithi081.stdout:5.15.0-56-generic 2024-04-25T21:46:46.982 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.15.0-56-generic 2024-04-25T21:46:46.982 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2024-04-25T21:46:46.984 INFO:teuthology.orchestra.run.smithi079.stdout:5.15.0-56-generic 2024-04-25T21:46:46.984 INFO:teuthology.task.kernel:Running kernel on smithi079: 5.15.0-56-generic 2024-04-25T21:46:46.984 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get clean 2024-04-25T21:46:46.986 INFO:teuthology.orchestra.run.smithi044.stdout:5.15.0-56-generic 2024-04-25T21:46:46.986 INFO:teuthology.orchestra.run.smithi057.stdout:5.15.0-56-generic 2024-04-25T21:46:46.986 INFO:teuthology.task.kernel:Running kernel on smithi044: 5.15.0-56-generic 2024-04-25T21:46:46.986 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get clean 2024-04-25T21:46:46.986 INFO:teuthology.task.kernel:Running kernel on smithi057: 5.15.0-56-generic 2024-04-25T21:46:46.987 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get clean 2024-04-25T21:46:47.107 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2024-04-25T21:46:47.119 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get update 2024-04-25T21:46:47.124 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-04-25T21:46:47.141 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get update 2024-04-25T21:46:47.282 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T21:46:47.286 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T21:46:47.286 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T21:46:47.286 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T21:46:47.286 INFO:teuthology.orchestra.run.smithi044.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T21:46:47.286 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T21:46:47.293 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T21:46:47.369 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T21:46:47.384 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T21:46:47.391 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T21:46:47.415 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T21:46:47.416 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T21:46:47.473 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T21:46:47.475 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T21:46:47.514 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T21:46:47.531 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T21:46:47.546 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T21:46:47.604 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-25T21:46:47.612 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T21:46:47.621 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-25T21:46:47.626 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T21:46:47.628 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T21:46:47.655 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T21:46:47.659 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T21:46:47.659 INFO:teuthology.orchestra.run.smithi044.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T21:46:47.680 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T21:46:47.684 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T21:46:47.686 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T21:46:47.686 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T21:46:47.688 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T21:46:47.691 INFO:teuthology.orchestra.run.smithi044.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T21:46:47.691 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T21:46:47.692 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T21:46:47.695 INFO:teuthology.orchestra.run.smithi044.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T21:46:47.696 INFO:teuthology.orchestra.run.smithi044.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T21:46:47.702 INFO:teuthology.orchestra.run.smithi044.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T21:46:47.703 INFO:teuthology.orchestra.run.smithi044.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T21:46:47.718 INFO:teuthology.orchestra.run.smithi044.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T21:46:47.730 INFO:teuthology.orchestra.run.smithi044.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T21:46:47.733 INFO:teuthology.orchestra.run.smithi044.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T21:46:47.741 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T21:46:47.745 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T21:46:47.748 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T21:46:47.748 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T21:46:47.753 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T21:46:47.754 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T21:46:47.762 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T21:46:47.763 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T21:46:47.771 INFO:teuthology.orchestra.run.smithi044.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T21:46:47.771 INFO:teuthology.orchestra.run.smithi044.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T21:46:47.776 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T21:46:47.776 INFO:teuthology.orchestra.run.smithi044.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T21:46:47.778 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T21:46:47.786 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T21:46:47.793 INFO:teuthology.orchestra.run.smithi044.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T21:46:47.793 INFO:teuthology.orchestra.run.smithi044.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T21:46:47.794 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T21:46:47.798 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T21:46:47.800 INFO:teuthology.orchestra.run.smithi044.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T21:46:47.801 INFO:teuthology.orchestra.run.smithi044.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T21:46:47.803 INFO:teuthology.orchestra.run.smithi044.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T21:46:47.806 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T21:46:47.806 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T21:46:47.807 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T21:46:47.807 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T21:46:47.809 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T21:46:47.823 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T21:46:47.823 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T21:46:47.824 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T21:46:47.824 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T21:46:47.825 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T21:46:47.828 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T21:46:47.829 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T21:46:47.830 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T21:46:47.832 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T21:46:47.835 INFO:teuthology.orchestra.run.smithi044.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T21:46:47.840 INFO:teuthology.orchestra.run.smithi044.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T21:46:47.840 INFO:teuthology.orchestra.run.smithi044.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T21:46:47.842 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T21:46:47.849 INFO:teuthology.orchestra.run.smithi044.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-25T21:46:47.853 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T21:46:47.861 INFO:teuthology.orchestra.run.smithi044.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T21:46:47.864 INFO:teuthology.orchestra.run.smithi044.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T21:46:47.864 INFO:teuthology.orchestra.run.smithi044.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T21:46:47.865 INFO:teuthology.orchestra.run.smithi044.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T21:46:47.866 INFO:teuthology.orchestra.run.smithi044.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T21:46:47.866 INFO:teuthology.orchestra.run.smithi044.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T21:46:47.868 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T21:46:47.873 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T21:46:47.873 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-25T21:46:47.887 INFO:teuthology.orchestra.run.smithi044.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T21:46:47.888 INFO:teuthology.orchestra.run.smithi044.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T21:46:47.888 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T21:46:47.889 INFO:teuthology.orchestra.run.smithi044.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T21:46:47.889 INFO:teuthology.orchestra.run.smithi044.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T21:46:47.895 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T21:46:47.898 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T21:46:47.898 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T21:46:47.899 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T21:46:47.899 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T21:46:47.899 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T21:46:47.906 INFO:teuthology.orchestra.run.smithi044.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T21:46:47.907 INFO:teuthology.orchestra.run.smithi044.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T21:46:47.907 INFO:teuthology.orchestra.run.smithi044.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T21:46:47.908 INFO:teuthology.orchestra.run.smithi044.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T21:46:47.917 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T21:46:47.918 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T21:46:47.918 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T21:46:47.938 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T21:46:47.938 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T21:46:47.939 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T21:46:47.939 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T21:46:47.939 INFO:teuthology.orchestra.run.smithi081.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T21:46:47.974 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-25T21:46:48.015 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T21:46:48.134 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T21:46:48.177 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T21:46:48.304 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T21:46:48.316 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T21:46:48.317 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T21:46:48.335 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T21:46:48.349 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T21:46:48.350 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T21:46:48.399 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T21:46:48.400 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T21:46:48.408 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T21:46:48.409 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T21:46:48.434 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T21:46:48.434 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T21:46:48.435 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T21:46:48.441 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T21:46:48.606 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-25T21:46:48.609 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T21:46:49.048 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T21:46:49.057 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T21:46:49.057 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T21:46:49.094 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T21:46:49.099 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T21:46:49.242 INFO:teuthology.orchestra.run.smithi057.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T21:46:49.279 INFO:teuthology.orchestra.run.smithi057.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T21:46:49.293 INFO:teuthology.orchestra.run.smithi057.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T21:46:49.294 INFO:teuthology.orchestra.run.smithi057.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T21:46:49.294 INFO:teuthology.orchestra.run.smithi057.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T21:46:49.296 INFO:teuthology.orchestra.run.smithi057.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T21:46:49.297 INFO:teuthology.orchestra.run.smithi057.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T21:46:49.297 INFO:teuthology.orchestra.run.smithi057.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T21:46:49.324 INFO:teuthology.orchestra.run.smithi057.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T21:46:49.327 INFO:teuthology.orchestra.run.smithi057.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T21:46:49.495 INFO:teuthology.orchestra.run.smithi057.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T21:46:49.577 INFO:teuthology.orchestra.run.smithi057.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T21:46:49.687 INFO:teuthology.orchestra.run.smithi057.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T21:46:49.750 INFO:teuthology.orchestra.run.smithi057.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T21:46:49.781 INFO:teuthology.orchestra.run.smithi057.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T21:46:50.152 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-25T21:46:51.038 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T21:46:51.491 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T21:46:51.506 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T21:46:51.581 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T21:46:53.475 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 13.2 MB in 2s (7,147 kB/s) 2024-04-25T21:46:53.566 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 13.2 MB in 2s (6,836 kB/s) 2024-04-25T21:46:54.301 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 13.2 MB in 3s (5,152 kB/s) 2024-04-25T21:46:54.359 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T21:46:54.795 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T21:46:54.946 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-04-25T21:46:54.958 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-04-25T21:46:54.962 INFO:teuthology.orchestra.run.smithi079.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T21:46:54.963 DEBUG:teuthology.orchestra.run.smithi044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T21:46:54.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T21:46:55.027 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-04-25T21:46:55.037 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-04-25T21:46:55.230 INFO:teuthology.orchestra.run.smithi044.stdout:Building dependency tree... 2024-04-25T21:46:55.231 INFO:teuthology.orchestra.run.smithi044.stdout:Reading state information... 2024-04-25T21:46:55.239 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-04-25T21:46:55.239 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-04-25T21:46:55.407 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T21:46:55.407 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T21:46:55.407 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T21:46:55.407 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T21:46:55.407 INFO:teuthology.orchestra.run.smithi081.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T21:46:55.408 INFO:teuthology.orchestra.run.smithi081.stdout: python2.7-minimal 2024-04-25T21:46:55.408 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T21:46:55.409 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2024-04-25T21:46:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T21:46:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T21:46:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T21:46:55.410 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2024-04-25T21:46:55.410 INFO:teuthology.orchestra.run.smithi081.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T21:46:55.411 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2024-04-25T21:46:55.411 INFO:teuthology.orchestra.run.smithi081.stdout: thermald 2024-04-25T21:46:55.414 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T21:46:55.414 INFO:teuthology.orchestra.run.smithi044.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T21:46:55.414 INFO:teuthology.orchestra.run.smithi044.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T21:46:55.414 INFO:teuthology.orchestra.run.smithi044.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T21:46:55.414 INFO:teuthology.orchestra.run.smithi044.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T21:46:55.415 INFO:teuthology.orchestra.run.smithi044.stdout: python2.7-minimal 2024-04-25T21:46:55.415 INFO:teuthology.orchestra.run.smithi044.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T21:46:55.416 INFO:teuthology.orchestra.run.smithi044.stdout:The following additional packages will be installed: 2024-04-25T21:46:55.416 INFO:teuthology.orchestra.run.smithi044.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T21:46:55.416 INFO:teuthology.orchestra.run.smithi044.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T21:46:55.417 INFO:teuthology.orchestra.run.smithi044.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T21:46:55.418 INFO:teuthology.orchestra.run.smithi044.stdout:Suggested packages: 2024-04-25T21:46:55.418 INFO:teuthology.orchestra.run.smithi044.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T21:46:55.418 INFO:teuthology.orchestra.run.smithi044.stdout:Recommended packages: 2024-04-25T21:46:55.418 INFO:teuthology.orchestra.run.smithi044.stdout: thermald 2024-04-25T21:46:55.466 INFO:teuthology.orchestra.run.smithi044.stdout:The following NEW packages will be installed: 2024-04-25T21:46:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T21:46:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T21:46:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T21:46:55.468 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages will be upgraded: 2024-04-25T21:46:55.468 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2024-04-25T21:46:55.468 INFO:teuthology.orchestra.run.smithi081.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T21:46:55.468 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T21:46:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T21:46:55.469 INFO:teuthology.orchestra.run.smithi081.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T21:46:55.470 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2024-04-25T21:46:55.471 INFO:teuthology.orchestra.run.smithi081.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T21:46:55.526 INFO:teuthology.orchestra.run.smithi081.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T21:46:55.526 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 113 MB of archives. 2024-04-25T21:46:55.526 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T21:46:55.526 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T21:46:55.527 INFO:teuthology.orchestra.run.smithi044.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T21:46:55.527 INFO:teuthology.orchestra.run.smithi044.stdout:Need to get 113 MB of archives. 2024-04-25T21:46:55.527 INFO:teuthology.orchestra.run.smithi044.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T21:46:55.527 INFO:teuthology.orchestra.run.smithi044.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T21:46:55.550 INFO:teuthology.orchestra.run.smithi079.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-25T21:46:55.663 INFO:teuthology.orchestra.run.smithi079.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T21:46:55.681 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-25T21:46:55.684 INFO:teuthology.orchestra.run.smithi079.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T21:46:55.685 INFO:teuthology.orchestra.run.smithi079.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T21:46:55.686 INFO:teuthology.orchestra.run.smithi079.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T21:46:55.689 INFO:teuthology.orchestra.run.smithi079.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T21:46:55.690 INFO:teuthology.orchestra.run.smithi079.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T21:46:55.690 INFO:teuthology.orchestra.run.smithi079.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T21:46:55.693 INFO:teuthology.orchestra.run.smithi079.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T21:46:55.699 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T21:46:55.699 INFO:teuthology.orchestra.run.smithi079.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T21:46:55.753 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-25T21:46:55.935 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2024-04-25T21:46:55.936 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2024-04-25T21:46:55.937 INFO:teuthology.orchestra.run.smithi079.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T21:46:56.057 INFO:teuthology.orchestra.run.smithi079.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T21:46:56.100 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T21:46:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T21:46:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T21:46:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T21:46:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T21:46:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: python2.7-minimal 2024-04-25T21:46:56.101 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T21:46:56.102 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2024-04-25T21:46:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T21:46:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T21:46:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T21:46:56.103 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2024-04-25T21:46:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T21:46:56.103 INFO:teuthology.orchestra.run.smithi057.stdout:Recommended packages: 2024-04-25T21:46:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: thermald 2024-04-25T21:46:56.150 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2024-04-25T21:46:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T21:46:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T21:46:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T21:46:56.151 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2024-04-25T21:46:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T21:46:56.212 INFO:teuthology.orchestra.run.smithi079.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T21:46:56.254 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T21:46:56.288 INFO:teuthology.orchestra.run.smithi044.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T21:46:56.296 INFO:teuthology.orchestra.run.smithi079.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T21:46:56.345 INFO:teuthology.orchestra.run.smithi079.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T21:46:56.516 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T21:46:56.548 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T21:46:56.553 INFO:teuthology.orchestra.run.smithi057.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T21:46:56.553 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 113 MB of archives. 2024-04-25T21:46:56.553 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T21:46:56.553 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T21:46:58.061 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T21:46:58.061 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T21:46:58.061 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T21:46:58.173 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T21:46:58.173 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T21:46:58.174 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T21:46:58.224 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T21:46:58.263 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T21:46:58.324 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T21:46:58.346 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T21:46:58.698 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 113 MB in 3s (40.7 MB/s) 2024-04-25T21:46:58.756 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 113 MB in 3s (39.5 MB/s) 2024-04-25T21:46:58.897 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T21:46:58.941 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T21:47:00.667 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 13.2 MB in 9s (1,444 kB/s) 2024-04-25T21:47:00.910 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T21:47:00.914 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T21:47:00.996 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:01.010 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T21:47:01.015 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T21:47:01.286 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:01.990 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-04-25T21:47:02.005 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T21:47:02.066 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-04-25T21:47:02.276 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-04-25T21:47:02.276 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-04-25T21:47:02.441 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T21:47:02.441 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T21:47:02.441 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T21:47:02.442 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T21:47:02.442 INFO:teuthology.orchestra.run.smithi079.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T21:47:02.442 INFO:teuthology.orchestra.run.smithi079.stdout: python2.7-minimal 2024-04-25T21:47:02.442 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T21:47:02.443 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2024-04-25T21:47:02.443 INFO:teuthology.orchestra.run.smithi079.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T21:47:02.443 INFO:teuthology.orchestra.run.smithi079.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T21:47:02.443 INFO:teuthology.orchestra.run.smithi079.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T21:47:02.444 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2024-04-25T21:47:02.444 INFO:teuthology.orchestra.run.smithi079.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T21:47:02.445 INFO:teuthology.orchestra.run.smithi079.stdout:Recommended packages: 2024-04-25T21:47:02.445 INFO:teuthology.orchestra.run.smithi079.stdout: thermald 2024-04-25T21:47:02.506 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2024-04-25T21:47:02.506 INFO:teuthology.orchestra.run.smithi079.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T21:47:02.506 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T21:47:02.506 INFO:teuthology.orchestra.run.smithi079.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T21:47:02.507 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages will be upgraded: 2024-04-25T21:47:02.508 INFO:teuthology.orchestra.run.smithi079.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T21:47:02.564 INFO:teuthology.orchestra.run.smithi079.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T21:47:02.564 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 113 MB of archives. 2024-04-25T21:47:02.564 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T21:47:02.564 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T21:47:03.035 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T21:47:03.047 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T21:47:03.070 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T21:47:03.141 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T21:47:03.157 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:03.642 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T21:47:03.646 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T21:47:03.663 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T21:47:03.667 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T21:47:03.701 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:03.764 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:04.073 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T21:47:04.074 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T21:47:04.074 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T21:47:04.197 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T21:47:04.216 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T21:47:04.219 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T21:47:04.236 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T21:47:04.274 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:04.706 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 113 MB in 2s (64.0 MB/s) 2024-04-25T21:47:04.897 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T21:47:06.944 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T21:47:06.949 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T21:47:07.011 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:09.154 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T21:47:09.176 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T21:47:09.268 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:09.496 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T21:47:09.757 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T21:47:09.778 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T21:47:09.816 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:10.310 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T21:47:10.435 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T21:47:10.750 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T21:47:10.863 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T21:47:11.149 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T21:47:11.160 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T21:47:11.171 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T21:47:11.215 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T21:47:11.262 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T21:47:11.620 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T21:47:11.774 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T21:47:12.102 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T21:47:12.125 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T21:47:12.160 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T21:47:16.032 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T21:47:16.626 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T21:47:16.742 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T21:47:17.058 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T21:47:17.132 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T21:47:17.169 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T21:47:17.182 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T21:47:17.207 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:17.499 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T21:47:17.521 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T21:47:17.565 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T21:47:18.326 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T21:47:18.364 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T21:47:18.410 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:19.322 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T21:47:19.323 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T21:47:19.323 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T21:47:19.768 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T21:47:19.897 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T21:47:19.927 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T21:47:20.054 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T21:47:20.311 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 113 MB in 24s (4,773 kB/s) 2024-04-25T21:47:20.385 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T21:47:20.488 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T21:47:20.489 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:20.590 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T21:47:20.693 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:21.172 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T21:47:21.297 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T21:47:21.656 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T21:47:21.777 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:21.953 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T21:47:22.025 INFO:teuthology.orchestra.run.smithi044.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T21:47:22.025 INFO:teuthology.orchestra.run.smithi044.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T21:47:22.025 INFO:teuthology.orchestra.run.smithi044.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T21:47:22.025 INFO:teuthology.orchestra.run.smithi044.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T21:47:22.082 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:22.187 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:22.428 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T21:47:22.432 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T21:47:22.492 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:23.450 INFO:teuthology.orchestra.run.smithi081.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T21:47:23.451 INFO:teuthology.orchestra.run.smithi081.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T21:47:23.451 INFO:teuthology.orchestra.run.smithi081.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T21:47:23.451 INFO:teuthology.orchestra.run.smithi081.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T21:47:23.584 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:23.966 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T21:47:24.003 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T21:47:24.023 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:24.041 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:25.045 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:25.276 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T21:47:25.297 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T21:47:25.388 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:25.415 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T21:47:25.516 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T21:47:25.617 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:25.678 INFO:teuthology.orchestra.run.smithi044.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T21:47:25.678 INFO:teuthology.orchestra.run.smithi044.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T21:47:25.812 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T21:47:25.833 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T21:47:25.862 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:26.437 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T21:47:26.579 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T21:47:26.686 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T21:47:26.706 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:26.781 INFO:teuthology.orchestra.run.smithi081.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T21:47:26.781 INFO:teuthology.orchestra.run.smithi081.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T21:47:26.785 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T21:47:27.101 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T21:47:27.224 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:27.349 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T21:47:27.477 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:28.793 INFO:teuthology.orchestra.run.smithi079.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T21:47:28.793 INFO:teuthology.orchestra.run.smithi079.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T21:47:28.793 INFO:teuthology.orchestra.run.smithi079.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T21:47:28.793 INFO:teuthology.orchestra.run.smithi079.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T21:47:28.937 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:30.356 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:31.757 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T21:47:31.883 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T21:47:32.009 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:32.064 INFO:teuthology.orchestra.run.smithi079.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T21:47:32.065 INFO:teuthology.orchestra.run.smithi079.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T21:47:33.252 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T21:47:33.360 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T21:47:33.686 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T21:47:33.814 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T21:47:34.117 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T21:47:34.139 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T21:47:34.183 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T21:47:39.991 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T21:47:40.029 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T21:47:40.065 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:40.582 INFO:teuthology.orchestra.run.smithi044.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T21:47:40.582 INFO:teuthology.orchestra.run.smithi044.stdout:Sourcing file `/etc/default/grub' 2024-04-25T21:47:40.608 INFO:teuthology.orchestra.run.smithi044.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T21:47:40.639 INFO:teuthology.orchestra.run.smithi044.stdout:Generating grub configuration file ... 2024-04-25T21:47:40.902 INFO:teuthology.orchestra.run.smithi044.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T21:47:40.919 INFO:teuthology.orchestra.run.smithi044.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T21:47:41.204 INFO:teuthology.orchestra.run.smithi044.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T21:47:41.210 INFO:teuthology.orchestra.run.smithi044.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T21:47:41.252 INFO:teuthology.orchestra.run.smithi081.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T21:47:41.252 INFO:teuthology.orchestra.run.smithi081.stdout:Sourcing file `/etc/default/grub' 2024-04-25T21:47:41.275 INFO:teuthology.orchestra.run.smithi081.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T21:47:41.280 INFO:teuthology.orchestra.run.smithi044.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T21:47:41.285 INFO:teuthology.orchestra.run.smithi044.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T21:47:41.297 INFO:teuthology.orchestra.run.smithi081.stdout:Generating grub configuration file ... 2024-04-25T21:47:41.427 INFO:teuthology.orchestra.run.smithi044.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T21:47:41.428 INFO:teuthology.orchestra.run.smithi044.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T21:47:41.428 INFO:teuthology.orchestra.run.smithi044.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T21:47:41.476 INFO:teuthology.orchestra.run.smithi044.stdout:done 2024-04-25T21:47:41.657 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T21:47:41.678 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T21:47:41.923 DEBUG:teuthology.orchestra.run.smithi044:> dpkg -s linux-image-generic 2024-04-25T21:47:41.939 INFO:teuthology.orchestra.run.smithi044.stdout:Package: linux-image-generic 2024-04-25T21:47:41.940 INFO:teuthology.orchestra.run.smithi044.stdout:Status: install ok installed 2024-04-25T21:47:41.940 INFO:teuthology.orchestra.run.smithi044.stdout:Priority: optional 2024-04-25T21:47:41.940 INFO:teuthology.orchestra.run.smithi044.stdout:Section: kernel 2024-04-25T21:47:41.940 INFO:teuthology.orchestra.run.smithi044.stdout:Installed-Size: 21 2024-04-25T21:47:41.940 INFO:teuthology.orchestra.run.smithi044.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T21:47:41.940 INFO:teuthology.orchestra.run.smithi044.stdout:Architecture: amd64 2024-04-25T21:47:41.940 INFO:teuthology.orchestra.run.smithi044.stdout:Source: linux-meta 2024-04-25T21:47:41.940 INFO:teuthology.orchestra.run.smithi044.stdout:Version: 5.15.0.105.102 2024-04-25T21:47:41.940 INFO:teuthology.orchestra.run.smithi044.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T21:47:41.940 INFO:teuthology.orchestra.run.smithi044.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T21:47:41.940 INFO:teuthology.orchestra.run.smithi044.stdout:Recommends: thermald 2024-04-25T21:47:41.940 INFO:teuthology.orchestra.run.smithi044.stdout:Description: Generic Linux kernel image 2024-04-25T21:47:41.940 INFO:teuthology.orchestra.run.smithi044.stdout: This package will always depend on the latest generic kernel image 2024-04-25T21:47:41.941 INFO:teuthology.orchestra.run.smithi044.stdout: available. 2024-04-25T21:47:41.941 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T21:47:41.941 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T21:47:41.941 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T21:47:41.941 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-25T21:47:41.941 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi044.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T21:47:41.941 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get clean 2024-04-25T21:47:42.048 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T21:47:42.054 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T21:47:42.117 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T21:47:42.122 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T21:47:42.158 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get update 2024-04-25T21:47:42.295 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T21:47:42.308 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T21:47:42.312 INFO:teuthology.orchestra.run.smithi081.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T21:47:42.312 INFO:teuthology.orchestra.run.smithi081.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T21:47:42.312 INFO:teuthology.orchestra.run.smithi081.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T21:47:42.329 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T21:47:42.363 INFO:teuthology.orchestra.run.smithi081.stdout:done 2024-04-25T21:47:42.722 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T21:47:42.775 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T21:47:42.828 DEBUG:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2024-04-25T21:47:42.848 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2024-04-25T21:47:42.848 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2024-04-25T21:47:42.848 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2024-04-25T21:47:42.848 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2024-04-25T21:47:42.848 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 21 2024-04-25T21:47:42.848 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T21:47:42.848 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2024-04-25T21:47:42.848 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2024-04-25T21:47:42.848 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 5.15.0.105.102 2024-04-25T21:47:42.849 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T21:47:42.849 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T21:47:42.849 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2024-04-25T21:47:42.849 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2024-04-25T21:47:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2024-04-25T21:47:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2024-04-25T21:47:42.849 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T21:47:42.849 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T21:47:42.849 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T21:47:42.849 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-04-25T21:47:42.849 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T21:47:42.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2024-04-25T21:47:42.900 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T21:47:43.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-04-25T21:47:43.192 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T21:47:43.192 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T21:47:43.206 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T21:47:43.226 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T21:47:43.233 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T21:47:43.338 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:43.455 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T21:47:43.584 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:43.871 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-04-25T21:47:43.890 DEBUG:teuthology.orchestra.run.smithi044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T21:47:43.951 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-04-25T21:47:44.155 INFO:teuthology.orchestra.run.smithi044.stdout:Building dependency tree... 2024-04-25T21:47:44.155 INFO:teuthology.orchestra.run.smithi044.stdout:Reading state information... 2024-04-25T21:47:44.341 INFO:teuthology.orchestra.run.smithi044.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T21:47:44.342 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T21:47:44.342 INFO:teuthology.orchestra.run.smithi044.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T21:47:44.342 INFO:teuthology.orchestra.run.smithi044.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T21:47:44.342 INFO:teuthology.orchestra.run.smithi044.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T21:47:44.342 INFO:teuthology.orchestra.run.smithi044.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T21:47:44.342 INFO:teuthology.orchestra.run.smithi044.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T21:47:44.342 INFO:teuthology.orchestra.run.smithi044.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T21:47:44.386 INFO:teuthology.orchestra.run.smithi044.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T21:47:44.388 DEBUG:teuthology.orchestra.run.smithi044:> dpkg -s linux-image-generic 2024-04-25T21:47:44.401 INFO:teuthology.orchestra.run.smithi044.stdout:Package: linux-image-generic 2024-04-25T21:47:44.401 INFO:teuthology.orchestra.run.smithi044.stdout:Status: install ok installed 2024-04-25T21:47:44.401 INFO:teuthology.orchestra.run.smithi044.stdout:Priority: optional 2024-04-25T21:47:44.401 INFO:teuthology.orchestra.run.smithi044.stdout:Section: kernel 2024-04-25T21:47:44.401 INFO:teuthology.orchestra.run.smithi044.stdout:Installed-Size: 21 2024-04-25T21:47:44.401 INFO:teuthology.orchestra.run.smithi044.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T21:47:44.401 INFO:teuthology.orchestra.run.smithi044.stdout:Architecture: amd64 2024-04-25T21:47:44.401 INFO:teuthology.orchestra.run.smithi044.stdout:Source: linux-meta 2024-04-25T21:47:44.402 INFO:teuthology.orchestra.run.smithi044.stdout:Version: 5.15.0.105.102 2024-04-25T21:47:44.402 INFO:teuthology.orchestra.run.smithi044.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T21:47:44.402 INFO:teuthology.orchestra.run.smithi044.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T21:47:44.402 INFO:teuthology.orchestra.run.smithi044.stdout:Recommends: thermald 2024-04-25T21:47:44.402 INFO:teuthology.orchestra.run.smithi044.stdout:Description: Generic Linux kernel image 2024-04-25T21:47:44.402 INFO:teuthology.orchestra.run.smithi044.stdout: This package will always depend on the latest generic kernel image 2024-04-25T21:47:44.402 INFO:teuthology.orchestra.run.smithi044.stdout: available. 2024-04-25T21:47:44.402 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-04-25T21:47:44.447 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.cOTvAYfvQK 2024-04-25T21:47:44.448 DEBUG:teuthology.orchestra.run.smithi044:> sudo cp /boot/grub/grub.cfg /tmp/tmp.cOTvAYfvQK 2024-04-25T21:47:44.480 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-04-25T21:47:44.498 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T21:47:44.504 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.cOTvAYfvQK 2024-04-25T21:47:44.559 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-04-25T21:47:44.617 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.cOTvAYfvQK is 10KB 2024-04-25T21:47:44.630 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.cOTvAYfvQK 2024-04-25T21:47:44.635 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T21:47:44.687 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T21:47:44.687 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T21:47:44.688 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T21:47:44.763 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T21:47:44.763 DEBUG:teuthology.orchestra.run.smithi044:> sudo update-grub 2024-04-25T21:47:44.766 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-04-25T21:47:44.767 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-04-25T21:47:44.938 INFO:teuthology.orchestra.run.smithi057.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T21:47:44.938 INFO:teuthology.orchestra.run.smithi057.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T21:47:44.938 INFO:teuthology.orchestra.run.smithi057.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T21:47:44.938 INFO:teuthology.orchestra.run.smithi057.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T21:47:44.939 INFO:teuthology.orchestra.run.smithi081.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T21:47:44.939 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T21:47:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T21:47:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T21:47:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T21:47:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T21:47:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T21:47:44.940 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T21:47:44.978 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T21:47:44.980 DEBUG:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2024-04-25T21:47:44.995 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2024-04-25T21:47:44.996 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2024-04-25T21:47:44.996 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2024-04-25T21:47:44.996 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2024-04-25T21:47:44.996 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 21 2024-04-25T21:47:44.996 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T21:47:44.996 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2024-04-25T21:47:44.996 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2024-04-25T21:47:44.996 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 5.15.0.105.102 2024-04-25T21:47:44.996 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T21:47:44.996 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T21:47:44.996 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2024-04-25T21:47:44.996 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2024-04-25T21:47:44.996 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2024-04-25T21:47:44.997 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2024-04-25T21:47:44.997 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-04-25T21:47:45.043 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.vUjaFbivkR 2024-04-25T21:47:45.043 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub/grub.cfg /tmp/tmp.vUjaFbivkR 2024-04-25T21:47:45.093 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:45.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.vUjaFbivkR 2024-04-25T21:47:45.210 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.vUjaFbivkR is 10KB 2024-04-25T21:47:45.222 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.vUjaFbivkR 2024-04-25T21:47:45.227 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T21:47:45.279 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-25T21:47:45.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T21:47:45.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T21:47:45.357 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T21:47:45.358 DEBUG:teuthology.orchestra.run.smithi081:> sudo update-grub 2024-04-25T21:47:45.968 INFO:teuthology.orchestra.run.smithi079.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T21:47:45.968 INFO:teuthology.orchestra.run.smithi079.stdout:Sourcing file `/etc/default/grub' 2024-04-25T21:47:45.992 INFO:teuthology.orchestra.run.smithi079.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T21:47:46.014 INFO:teuthology.orchestra.run.smithi079.stdout:Generating grub configuration file ... 2024-04-25T21:47:46.047 INFO:teuthology.orchestra.run.smithi044.stderr:Sourcing file `/etc/default/grub' 2024-04-25T21:47:46.048 INFO:teuthology.orchestra.run.smithi044.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T21:47:46.051 INFO:teuthology.orchestra.run.smithi044.stderr:Generating grub configuration file ... 2024-04-25T21:47:46.221 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T21:47:46.227 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T21:47:46.287 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T21:47:46.314 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T21:47:46.458 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T21:47:46.464 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T21:47:46.506 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T21:47:46.511 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T21:47:46.546 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:46.605 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T21:47:46.610 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub' 2024-04-25T21:47:46.611 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T21:47:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T21:47:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-04-25T21:47:46.645 INFO:teuthology.orchestra.run.smithi044.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T21:47:46.645 INFO:teuthology.orchestra.run.smithi044.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T21:47:46.645 INFO:teuthology.orchestra.run.smithi044.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T21:47:46.656 INFO:teuthology.orchestra.run.smithi044.stderr:done 2024-04-25T21:47:46.668 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T21:47:46.673 DEBUG:teuthology.orchestra.run.smithi044:> sudo shutdown -r now 2024-04-25T21:47:46.673 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T21:47:46.823 INFO:teuthology.orchestra.run.smithi079.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T21:47:46.823 INFO:teuthology.orchestra.run.smithi079.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T21:47:46.823 INFO:teuthology.orchestra.run.smithi079.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T21:47:46.872 INFO:teuthology.orchestra.run.smithi079.stdout:done 2024-04-25T21:47:46.879 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T21:47:46.886 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T21:47:47.202 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T21:47:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T21:47:47.251 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T21:47:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T21:47:47.365 DEBUG:teuthology.orchestra.run.smithi079:> dpkg -s linux-image-generic 2024-04-25T21:47:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T21:47:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T21:47:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T21:47:47.389 INFO:teuthology.orchestra.run.smithi079.stdout:Package: linux-image-generic 2024-04-25T21:47:47.389 INFO:teuthology.orchestra.run.smithi079.stdout:Status: install ok installed 2024-04-25T21:47:47.389 INFO:teuthology.orchestra.run.smithi079.stdout:Priority: optional 2024-04-25T21:47:47.389 INFO:teuthology.orchestra.run.smithi079.stdout:Section: kernel 2024-04-25T21:47:47.389 INFO:teuthology.orchestra.run.smithi079.stdout:Installed-Size: 21 2024-04-25T21:47:47.389 INFO:teuthology.orchestra.run.smithi079.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T21:47:47.389 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: amd64 2024-04-25T21:47:47.389 INFO:teuthology.orchestra.run.smithi079.stdout:Source: linux-meta 2024-04-25T21:47:47.390 INFO:teuthology.orchestra.run.smithi079.stdout:Version: 5.15.0.105.102 2024-04-25T21:47:47.390 INFO:teuthology.orchestra.run.smithi079.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T21:47:47.390 INFO:teuthology.orchestra.run.smithi079.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T21:47:47.390 INFO:teuthology.orchestra.run.smithi079.stdout:Recommends: thermald 2024-04-25T21:47:47.390 INFO:teuthology.orchestra.run.smithi079.stdout:Description: Generic Linux kernel image 2024-04-25T21:47:47.390 INFO:teuthology.orchestra.run.smithi079.stdout: This package will always depend on the latest generic kernel image 2024-04-25T21:47:47.390 INFO:teuthology.orchestra.run.smithi079.stdout: available. 2024-04-25T21:47:47.390 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T21:47:47.390 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T21:47:47.391 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T21:47:47.391 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-04-25T21:47:47.391 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi079.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T21:47:47.391 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get clean 2024-04-25T21:47:47.398 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-04-25T21:47:47.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-04-25T21:47:47.547 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2024-04-25T21:47:47.810 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T21:47:47.810 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T21:47:47.882 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T21:47:47.963 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T21:47:47.964 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T21:47:48.072 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T21:47:48.198 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T21:47:48.257 INFO:teuthology.orchestra.run.smithi057.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T21:47:48.257 INFO:teuthology.orchestra.run.smithi057.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T21:47:49.225 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-04-25T21:47:49.243 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T21:47:49.303 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-04-25T21:47:49.504 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-04-25T21:47:49.505 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-04-25T21:47:49.685 INFO:teuthology.orchestra.run.smithi079.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T21:47:49.685 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T21:47:49.685 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T21:47:49.685 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T21:47:49.685 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T21:47:49.685 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T21:47:49.686 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T21:47:49.686 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T21:47:49.725 INFO:teuthology.orchestra.run.smithi079.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T21:47:49.727 DEBUG:teuthology.orchestra.run.smithi079:> dpkg -s linux-image-generic 2024-04-25T21:47:49.743 INFO:teuthology.orchestra.run.smithi079.stdout:Package: linux-image-generic 2024-04-25T21:47:49.743 INFO:teuthology.orchestra.run.smithi079.stdout:Status: install ok installed 2024-04-25T21:47:49.743 INFO:teuthology.orchestra.run.smithi079.stdout:Priority: optional 2024-04-25T21:47:49.743 INFO:teuthology.orchestra.run.smithi079.stdout:Section: kernel 2024-04-25T21:47:49.743 INFO:teuthology.orchestra.run.smithi079.stdout:Installed-Size: 21 2024-04-25T21:47:49.743 INFO:teuthology.orchestra.run.smithi079.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T21:47:49.743 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: amd64 2024-04-25T21:47:49.743 INFO:teuthology.orchestra.run.smithi079.stdout:Source: linux-meta 2024-04-25T21:47:49.743 INFO:teuthology.orchestra.run.smithi079.stdout:Version: 5.15.0.105.102 2024-04-25T21:47:49.744 INFO:teuthology.orchestra.run.smithi079.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T21:47:49.744 INFO:teuthology.orchestra.run.smithi079.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T21:47:49.744 INFO:teuthology.orchestra.run.smithi079.stdout:Recommends: thermald 2024-04-25T21:47:49.744 INFO:teuthology.orchestra.run.smithi079.stdout:Description: Generic Linux kernel image 2024-04-25T21:47:49.744 INFO:teuthology.orchestra.run.smithi079.stdout: This package will always depend on the latest generic kernel image 2024-04-25T21:47:49.744 INFO:teuthology.orchestra.run.smithi079.stdout: available. 2024-04-25T21:47:49.744 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-04-25T21:47:49.790 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.lv7uH8t0Jk 2024-04-25T21:47:49.790 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /boot/grub/grub.cfg /tmp/tmp.lv7uH8t0Jk 2024-04-25T21:47:49.846 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.lv7uH8t0Jk 2024-04-25T21:47:49.965 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.lv7uH8t0Jk is 10KB 2024-04-25T21:47:49.978 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.lv7uH8t0Jk 2024-04-25T21:47:49.983 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T21:47:50.037 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T21:47:50.038 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T21:47:50.038 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T21:47:50.105 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T21:47:50.105 DEBUG:teuthology.orchestra.run.smithi079:> sudo update-grub 2024-04-25T21:47:51.343 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub' 2024-04-25T21:47:51.344 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T21:47:51.346 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2024-04-25T21:47:51.513 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T21:47:51.519 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T21:47:51.757 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T21:47:51.762 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T21:47:51.800 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T21:47:51.805 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T21:47:51.917 INFO:teuthology.orchestra.run.smithi079.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T21:47:51.917 INFO:teuthology.orchestra.run.smithi079.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T21:47:51.917 INFO:teuthology.orchestra.run.smithi079.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T21:47:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:done 2024-04-25T21:47:51.941 DEBUG:teuthology.orchestra.run.smithi079:> sudo shutdown -r now 2024-04-25T21:48:02.611 INFO:teuthology.orchestra.run.smithi057.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T21:48:02.611 INFO:teuthology.orchestra.run.smithi057.stdout:Sourcing file `/etc/default/grub' 2024-04-25T21:48:02.630 INFO:teuthology.orchestra.run.smithi057.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T21:48:02.647 INFO:teuthology.orchestra.run.smithi057.stdout:Generating grub configuration file ... 2024-04-25T21:48:02.896 INFO:teuthology.orchestra.run.smithi057.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T21:48:02.914 INFO:teuthology.orchestra.run.smithi057.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T21:48:03.189 INFO:teuthology.orchestra.run.smithi057.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T21:48:03.195 INFO:teuthology.orchestra.run.smithi057.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T21:48:03.260 INFO:teuthology.orchestra.run.smithi057.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T21:48:03.266 INFO:teuthology.orchestra.run.smithi057.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T21:48:03.435 INFO:teuthology.orchestra.run.smithi057.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T21:48:03.435 INFO:teuthology.orchestra.run.smithi057.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T21:48:03.435 INFO:teuthology.orchestra.run.smithi057.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T21:48:03.467 INFO:teuthology.orchestra.run.smithi057.stdout:done 2024-04-25T21:48:03.881 DEBUG:teuthology.orchestra.run.smithi057:> dpkg -s linux-image-generic 2024-04-25T21:48:03.907 INFO:teuthology.orchestra.run.smithi057.stdout:Package: linux-image-generic 2024-04-25T21:48:03.907 INFO:teuthology.orchestra.run.smithi057.stdout:Status: install ok installed 2024-04-25T21:48:03.907 INFO:teuthology.orchestra.run.smithi057.stdout:Priority: optional 2024-04-25T21:48:03.907 INFO:teuthology.orchestra.run.smithi057.stdout:Section: kernel 2024-04-25T21:48:03.908 INFO:teuthology.orchestra.run.smithi057.stdout:Installed-Size: 21 2024-04-25T21:48:03.908 INFO:teuthology.orchestra.run.smithi057.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T21:48:03.908 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: amd64 2024-04-25T21:48:03.908 INFO:teuthology.orchestra.run.smithi057.stdout:Source: linux-meta 2024-04-25T21:48:03.908 INFO:teuthology.orchestra.run.smithi057.stdout:Version: 5.15.0.105.102 2024-04-25T21:48:03.908 INFO:teuthology.orchestra.run.smithi057.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T21:48:03.908 INFO:teuthology.orchestra.run.smithi057.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T21:48:03.908 INFO:teuthology.orchestra.run.smithi057.stdout:Recommends: thermald 2024-04-25T21:48:03.908 INFO:teuthology.orchestra.run.smithi057.stdout:Description: Generic Linux kernel image 2024-04-25T21:48:03.908 INFO:teuthology.orchestra.run.smithi057.stdout: This package will always depend on the latest generic kernel image 2024-04-25T21:48:03.908 INFO:teuthology.orchestra.run.smithi057.stdout: available. 2024-04-25T21:48:03.908 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T21:48:03.909 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T21:48:03.909 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T21:48:03.909 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-04-25T21:48:03.909 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi057.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T21:48:03.909 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get clean 2024-04-25T21:48:04.067 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get update 2024-04-25T21:48:04.197 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T21:48:04.197 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T21:48:04.209 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T21:48:04.231 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T21:48:05.634 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-25T21:48:05.652 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T21:48:05.707 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-25T21:48:05.888 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2024-04-25T21:48:05.889 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2024-04-25T21:48:06.053 INFO:teuthology.orchestra.run.smithi057.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T21:48:06.053 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T21:48:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T21:48:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T21:48:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T21:48:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T21:48:06.054 INFO:teuthology.orchestra.run.smithi057.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T21:48:06.054 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T21:48:06.093 INFO:teuthology.orchestra.run.smithi057.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T21:48:06.095 DEBUG:teuthology.orchestra.run.smithi057:> dpkg -s linux-image-generic 2024-04-25T21:48:06.151 INFO:teuthology.orchestra.run.smithi057.stdout:Package: linux-image-generic 2024-04-25T21:48:06.151 INFO:teuthology.orchestra.run.smithi057.stdout:Status: install ok installed 2024-04-25T21:48:06.151 INFO:teuthology.orchestra.run.smithi057.stdout:Priority: optional 2024-04-25T21:48:06.151 INFO:teuthology.orchestra.run.smithi057.stdout:Section: kernel 2024-04-25T21:48:06.151 INFO:teuthology.orchestra.run.smithi057.stdout:Installed-Size: 21 2024-04-25T21:48:06.151 INFO:teuthology.orchestra.run.smithi057.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T21:48:06.151 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: amd64 2024-04-25T21:48:06.151 INFO:teuthology.orchestra.run.smithi057.stdout:Source: linux-meta 2024-04-25T21:48:06.151 INFO:teuthology.orchestra.run.smithi057.stdout:Version: 5.15.0.105.102 2024-04-25T21:48:06.151 INFO:teuthology.orchestra.run.smithi057.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T21:48:06.152 INFO:teuthology.orchestra.run.smithi057.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T21:48:06.152 INFO:teuthology.orchestra.run.smithi057.stdout:Recommends: thermald 2024-04-25T21:48:06.152 INFO:teuthology.orchestra.run.smithi057.stdout:Description: Generic Linux kernel image 2024-04-25T21:48:06.152 INFO:teuthology.orchestra.run.smithi057.stdout: This package will always depend on the latest generic kernel image 2024-04-25T21:48:06.152 INFO:teuthology.orchestra.run.smithi057.stdout: available. 2024-04-25T21:48:06.152 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-04-25T21:48:06.196 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.bY1rILeONl 2024-04-25T21:48:06.196 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /boot/grub/grub.cfg /tmp/tmp.bY1rILeONl 2024-04-25T21:48:06.252 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.bY1rILeONl 2024-04-25T21:48:06.372 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.bY1rILeONl is 10KB 2024-04-25T21:48:06.386 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.bY1rILeONl 2024-04-25T21:48:06.391 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T21:48:06.444 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T21:48:06.444 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T21:48:06.445 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T21:48:06.518 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T21:48:06.518 DEBUG:teuthology.orchestra.run.smithi057:> sudo update-grub 2024-04-25T21:48:07.717 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub' 2024-04-25T21:48:07.718 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T21:48:07.727 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2024-04-25T21:48:07.901 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T21:48:07.907 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T21:48:08.125 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T21:48:08.131 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T21:48:08.179 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T21:48:08.185 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T21:48:08.320 INFO:teuthology.orchestra.run.smithi057.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T21:48:08.320 INFO:teuthology.orchestra.run.smithi057.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T21:48:08.320 INFO:teuthology.orchestra.run.smithi057.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T21:48:08.333 INFO:teuthology.orchestra.run.smithi057.stderr:done 2024-04-25T21:48:08.352 DEBUG:teuthology.orchestra.run.smithi057:> sudo shutdown -r now 2024-04-25T21:48:16.682 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-25T21:48:16.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-25T21:48:16.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:48:17.402 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-04-25T21:48:17.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-04-25T21:48:17.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:48:21.946 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-04-25T21:48:21.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-04-25T21:48:21.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:48:38.370 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-04-25T21:48:38.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-25T21:48:38.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:48:51.870 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-04-25T21:49:00.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-04-25T21:49:00.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:49:12.862 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-04-25T21:49:16.690 DEBUG:teuthology.orchestra.remote:timed out 2024-04-25T21:49:19.262 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-04-25T21:49:21.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-25T21:49:21.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:49:21.952 DEBUG:teuthology.orchestra.remote:timed out 2024-04-25T21:49:25.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-25T21:49:25.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:49:30.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-04-25T21:49:30.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:49:31.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-04-25T21:49:31.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:49:32.071 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-04-25T21:49:32.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-04-25T21:49:32.980 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.15.0-105-generic"... 2024-04-25T21:49:32.981 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-04-25T21:49:33.027 INFO:teuthology.orchestra.run.smithi081.stdout:5.15.0-105-generic 2024-04-25T21:49:33.027 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T21:49:33.027 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T21:49:33.027 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T21:49:33.982 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-04-25T21:49:34.028 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-25T21:49:34.028 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T21:49:34.173 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2024-04-25T21:49:34.204 DEBUG:teuthology.parallel:result is None 2024-04-25T21:49:41.271 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-04-25T21:49:41.848 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-25T21:49:41.849 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-25T21:49:41.849 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-04-25T21:49:41.896 INFO:teuthology.orchestra.run.smithi044.stdout:5.15.0-105-generic 2024-04-25T21:49:41.897 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T21:49:41.897 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T21:49:41.897 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T21:49:42.897 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T21:49:42.898 DEBUG:teuthology.orchestra.run.smithi044:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T21:49:42.971 INFO:teuthology.orchestra.run.smithi044.stdout:ttyS1 2024-04-25T21:49:42.998 DEBUG:teuthology.parallel:result is None 2024-04-25T21:49:45.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-04-25T21:49:45.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:49:46.249 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-04-25T21:49:46.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-04-25T21:49:46.804 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.15.0-105-generic"... 2024-04-25T21:49:46.804 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-04-25T21:49:46.851 INFO:teuthology.orchestra.run.smithi079.stdout:5.15.0-105-generic 2024-04-25T21:49:46.851 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T21:49:46.851 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T21:49:46.851 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T21:49:47.851 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-25T21:49:47.852 DEBUG:teuthology.orchestra.run.smithi079:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T21:49:48.213 INFO:teuthology.orchestra.run.smithi079.stdout:ttyS1 2024-04-25T21:49:48.241 DEBUG:teuthology.parallel:result is None 2024-04-25T21:50:21.870 DEBUG:teuthology.orchestra.remote:timed out 2024-04-25T21:50:33.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-25T21:50:33.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:50:34.125 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-04-25T21:50:34.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-25T21:50:34.732 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.15.0-105-generic"... 2024-04-25T21:50:34.733 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2024-04-25T21:50:34.779 INFO:teuthology.orchestra.run.smithi057.stdout:5.15.0-105-generic 2024-04-25T21:50:34.779 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T21:50:34.779 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T21:50:34.780 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T21:50:35.781 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-25T21:50:35.781 DEBUG:teuthology.orchestra.run.smithi057:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T21:50:35.852 INFO:teuthology.orchestra.run.smithi057.stdout:ttyS1 2024-04-25T21:50:35.880 DEBUG:teuthology.parallel:result is None 2024-04-25T21:50:35.881 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T21:50:35.899 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T21:50:35.899 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T21:50:35.903 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T21:50:35.905 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T21:50:35.909 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T21:50:35.918 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T21:50:35.942 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T21:50:35.959 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T21:50:35.960 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T21:50:35.965 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T21:50:35.968 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T21:50:35.971 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T21:50:36.084 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T21:50:36.090 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T21:50:36.090 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T21:50:36.093 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T21:50:36.096 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T21:50:36.099 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T21:50:36.110 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T21:50:36.116 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T21:50:36.119 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T21:50:36.119 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T21:50:36.124 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T21:50:36.127 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T21:50:36.132 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T21:50:36.140 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T21:50:36.142 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T21:50:36.150 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T21:50:36.150 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T21:50:36.165 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T21:50:36.172 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T21:50:36.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T21:50:36.201 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T21:50:36.211 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T21:50:36.211 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T21:50:36.222 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T21:50:36.232 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T21:50:36.243 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T21:50:36.248 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T21:50:36.272 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T21:50:36.322 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T21:50:36.322 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T21:50:36.383 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T21:50:36.389 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T21:50:36.435 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T21:50:36.435 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T21:50:36.503 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T21:50:36.508 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T21:50:36.556 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T21:50:36.556 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T21:50:36.613 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T21:50:36.619 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T21:50:36.667 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-25T21:50:36.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T21:50:36.734 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2024-04-25T21:50:36.736 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2024-04-25T21:50:36.739 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2024-04-25T21:50:36.741 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-04-25T21:50:36.809 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T21:50:36.817 INFO:teuthology.task.internal:Starting timer... 2024-04-25T21:50:36.817 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T21:50:36.828 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T21:50:36.837 DEBUG:teuthology.task.selinux:Excluding smithi044: OS 'ubuntu' does not support SELinux 2024-04-25T21:50:36.837 DEBUG:teuthology.task.selinux:Excluding smithi057: OS 'ubuntu' does not support SELinux 2024-04-25T21:50:36.838 DEBUG:teuthology.task.selinux:Excluding smithi079: OS 'ubuntu' does not support SELinux 2024-04-25T21:50:36.838 DEBUG:teuthology.task.selinux:Excluding smithi081: OS 'ubuntu' does not support SELinux 2024-04-25T21:50:36.838 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T21:50:36.838 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-25T21:50:36.838 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T21:50:36.838 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T21:50:36.847 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T21:50:36.864 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T21:50:36.865 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi044.front.sepia.ceph.com,smithi057.front.sepia.ceph.com,smithi079.front.sepia.ceph.com,smithi081.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T21:57:54.295 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi081.front.sepia.ceph.com')] 2024-04-25T21:57:54.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-25T21:57:54.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:57:54.385 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-04-25T21:57:54.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-25T21:57:54.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-25T21:57:54.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:57:54.555 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-04-25T21:57:54.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-25T21:57:54.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-04-25T21:57:54.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:57:54.718 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-04-25T21:57:54.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-04-25T21:57:54.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-04-25T21:57:54.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T21:57:54.873 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-04-25T21:57:54.950 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-04-25T21:57:54.951 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T21:57:54.965 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T21:57:54.965 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T21:57:54.966 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T21:57:54.968 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T21:57:54.968 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T21:57:54.971 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T21:57:54.971 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T21:57:54.973 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T21:57:54.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T21:57:54.996 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T21:57:54.996 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: Command line: ntpd -gq 2024-04-25T21:57:54.996 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: ---------------------------------------------------- 2024-04-25T21:57:54.996 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T21:57:54.996 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T21:57:54.996 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: corporation. Support and training for ntp-4 are 2024-04-25T21:57:54.997 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: available at https://www.nwtime.org/support 2024-04-25T21:57:54.997 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: ---------------------------------------------------- 2024-04-25T21:57:54.997 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: proto: precision = 0.049 usec (-24) 2024-04-25T21:57:54.997 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: basedate set to 2022-02-04 2024-04-25T21:57:54.997 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: gps base set to 2022-02-06 (week 2196) 2024-04-25T21:57:54.998 INFO:teuthology.orchestra.run.smithi044.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T21:57:54.998 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T21:57:54.998 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T21:57:54.998 INFO:teuthology.orchestra.run.smithi044.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T21:57:54.999 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T21:57:54.999 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T21:57:54.999 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T21:57:54.999 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: Listen normally on 3 ens1f0 172.21.15.44:123 2024-04-25T21:57:54.999 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: Listen normally on 4 lo [::1]:123 2024-04-25T21:57:55.000 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1572%4]:123 2024-04-25T21:57:55.000 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:57:54 ntpd[17105]: Listening on routing socket on fd #22 for interface updates 2024-04-25T21:57:55.000 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T21:57:55.000 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: Command line: ntpd -gq 2024-04-25T21:57:55.001 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: ---------------------------------------------------- 2024-04-25T21:57:55.001 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T21:57:55.001 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T21:57:55.001 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: corporation. Support and training for ntp-4 are 2024-04-25T21:57:55.001 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: available at https://www.nwtime.org/support 2024-04-25T21:57:55.001 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: ---------------------------------------------------- 2024-04-25T21:57:55.001 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: proto: precision = 0.048 usec (-24) 2024-04-25T21:57:55.001 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: basedate set to 2022-02-04 2024-04-25T21:57:55.001 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: gps base set to 2022-02-06 (week 2196) 2024-04-25T21:57:55.001 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T21:57:55.001 INFO:teuthology.orchestra.run.smithi057.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T21:57:55.002 INFO:teuthology.orchestra.run.smithi057.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T21:57:55.002 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T21:57:55.003 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T21:57:55.003 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T21:57:55.003 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T21:57:55.003 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: Listen normally on 3 ens1f0 172.21.15.57:123 2024-04-25T21:57:55.003 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: Listen normally on 4 lo [::1]:123 2024-04-25T21:57:55.003 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1562%4]:123 2024-04-25T21:57:55.003 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:57:54 ntpd[17101]: Listening on routing socket on fd #22 for interface updates 2024-04-25T21:57:55.004 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:54 ntpd[17193]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T21:57:55.004 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: Command line: ntpd -gq 2024-04-25T21:57:55.004 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: ---------------------------------------------------- 2024-04-25T21:57:55.004 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T21:57:55.004 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T21:57:55.004 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: corporation. Support and training for ntp-4 are 2024-04-25T21:57:55.004 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: available at https://www.nwtime.org/support 2024-04-25T21:57:55.004 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: ---------------------------------------------------- 2024-04-25T21:57:55.004 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: proto: precision = 0.044 usec (-24) 2024-04-25T21:57:55.005 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: basedate set to 2022-02-04 2024-04-25T21:57:55.005 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: gps base set to 2022-02-06 (week 2196) 2024-04-25T21:57:55.005 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T21:57:55.005 INFO:teuthology.orchestra.run.smithi079.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T21:57:55.005 INFO:teuthology.orchestra.run.smithi079.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T21:57:55.006 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T21:57:55.006 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T21:57:55.006 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T21:57:55.006 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T21:57:55.006 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: Listen normally on 3 enp3s0f1 172.21.15.79:123 2024-04-25T21:57:55.006 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: Listen normally on 4 lo [::1]:123 2024-04-25T21:57:55.006 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce87%5]:123 2024-04-25T21:57:55.006 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:57:55 ntpd[17193]: Listening on routing socket on fd #22 for interface updates 2024-04-25T21:57:55.019 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T21:57:55.019 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: Command line: ntpd -gq 2024-04-25T21:57:55.019 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: ---------------------------------------------------- 2024-04-25T21:57:55.019 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T21:57:55.019 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T21:57:55.019 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: corporation. Support and training for ntp-4 are 2024-04-25T21:57:55.020 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: available at https://www.nwtime.org/support 2024-04-25T21:57:55.020 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: ---------------------------------------------------- 2024-04-25T21:57:55.020 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: proto: precision = 0.045 usec (-24) 2024-04-25T21:57:55.020 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: basedate set to 2022-02-04 2024-04-25T21:57:55.020 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: gps base set to 2022-02-06 (week 2196) 2024-04-25T21:57:55.021 INFO:teuthology.orchestra.run.smithi081.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T21:57:55.021 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T21:57:55.021 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T21:57:55.021 INFO:teuthology.orchestra.run.smithi081.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T21:57:55.022 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T21:57:55.022 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T21:57:55.022 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T21:57:55.022 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: Listen normally on 3 enp3s0f1 172.21.15.81:123 2024-04-25T21:57:55.022 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: Listen normally on 4 lo [::1]:123 2024-04-25T21:57:55.023 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d753%5]:123 2024-04-25T21:57:55.023 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:57:55 ntpd[17231]: Listening on routing socket on fd #22 for interface updates 2024-04-25T21:57:55.996 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:55 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:55.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:55 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:55 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:55 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:55 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:55 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:55 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:55 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:55 ntpd[17101]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:57:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:55 ntpd[17101]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:57:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:55 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:55 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:55 ntpd[17101]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:57:56.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:55 ntpd[17101]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:57:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:57:56 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:57:56 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:57:56 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:57:56 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:57:56 ntpd[17231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:57:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:57:56 ntpd[17231]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:57:56.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:56 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:56.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:56 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:56.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:56 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:56.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:56 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:56.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:56 ntpd[17105]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:57:56.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:56 ntpd[17105]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:57:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:57 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:57 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:57 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:57 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:57 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:58.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:57 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:58.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:57 ntpd[17101]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:57:58.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:57 ntpd[17101]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:57:58.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:57 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:58.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:57 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:58.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:57 ntpd[17101]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:57:58.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:57 ntpd[17101]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:57:58.003 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:57:58 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:58.003 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:57:58 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:58.003 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:57:58 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:58.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:57:58 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:58.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:57:58 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:57:58.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:57:58 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:57:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:57:58 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:57:58 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:57:58 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:57:58 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:57:58 ntpd[17231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:57:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:57:58 ntpd[17231]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:57:58.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:58 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:58.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:58 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:58.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:58 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:58.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:58 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:58.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:58 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:58.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:58 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:58.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:58 ntpd[17105]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:57:58.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:58 ntpd[17105]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:57:58.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:58 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:58.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:58 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:58.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:58 ntpd[17105]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:57:58.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:58 ntpd[17105]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:57:59.003 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:57:59 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:59.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:57:59 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:59.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:57:59 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:59.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:57:59 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:59.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:57:59 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:59.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:57:59 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:59.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:57:59 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:57:59.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:57:59 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:57:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:57:59 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:57:59 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:57:59 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:57:59 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:57:59 ntpd[17231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:57:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:57:59 ntpd[17231]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:57:59.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:59 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:59.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:59 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:59.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:59 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:57:59.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:59 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:57:59.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:59 ntpd[17105]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:57:59.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:57:59 ntpd[17105]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:00.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:00.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:00.002 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.002 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.002 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:00.002 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:00.002 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.002 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.002 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:00.002 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:57:59 ntpd[17101]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:00.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:00 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:00 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:00 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:00 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:00 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:00 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:00 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:00.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:00 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:00.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:00 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:00 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:00 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:00.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:00 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:00.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:00 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:00 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:00 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:00 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:00 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:00 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:00 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:00 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:00 ntpd[17231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:00 ntpd[17231]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:00 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:00 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:00 ntpd[17231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:00.021 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:00 ntpd[17231]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:00 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:00 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:00 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:00 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:00 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:00 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:00 ntpd[17105]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:00 ntpd[17105]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:00 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:00 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:00 ntpd[17105]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:00 ntpd[17105]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:01.003 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:01 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:01.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:01 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:01.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:01 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:01.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:01 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:01.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:01 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:01.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:01 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:01.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:01 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:01.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:01 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:01.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:01 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:01.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:01 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:01.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:01 ntpd[17231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:01.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:01 ntpd[17231]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:01.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:01 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:01.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:01 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:01.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:01 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:01.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:01 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:01.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:01 ntpd[17105]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:01.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:01 ntpd[17105]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:02.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:58:01 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:02.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:58:01 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:02.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:58:01 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:02.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:58:01 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:02.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:58:01 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:02.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:58:01 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:02.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:58:01 ntpd[17101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:02.000 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:58:01 ntpd[17101]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:02.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:58:01 ntpd[17101]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:02.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:58:01 ntpd[17101]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:02.001 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 21:58:01 ntpd[17101]: ntpd: time slew -0.000574 s 2024-04-25T21:58:02.001 INFO:teuthology.orchestra.run.smithi057.stdout:ntpd: time slew -0.000574s 2024-04-25T21:58:02.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:58:01 ntpd[17101]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T21:58:02.001 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 21:58:01 ntpd[17101]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T21:58:02.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:02 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:02.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:02 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:02.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:02 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:02.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:02 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:02.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:02 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:02.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:02 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:02.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:02 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:02.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:02 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:02.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:02 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:02.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:02 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:02.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:02 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:02.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:02 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:02.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:02 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:02.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:02 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:02.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:02 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:02.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:02 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:02.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:02 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:02.020 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:02 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:02.021 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:02 ntpd[17231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:02.021 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:02 ntpd[17231]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:02.021 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:02 ntpd[17231]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:02.021 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:02 ntpd[17231]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:02.021 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:02 ntpd[17231]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:02.021 INFO:teuthology.orchestra.run.smithi081.stdout:25 Apr 21:58:02 ntpd[17231]: ntpd: time slew +0.000492 s 2024-04-25T21:58:02.021 INFO:teuthology.orchestra.run.smithi081.stdout:ntpd: time slew +0.000492s 2024-04-25T21:58:02.021 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:02 ntpd[17231]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:02.022 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:02 ntpd[17231]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T21:58:02.022 INFO:teuthology.orchestra.run.smithi081.stderr:25 Apr 21:58:02 ntpd[17231]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T21:58:02.046 INFO:teuthology.orchestra.run.smithi057.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T21:58:02.046 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================== 2024-04-25T21:58:02.046 INFO:teuthology.orchestra.run.smithi057.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T21:58:02.046 INFO:teuthology.orchestra.run.smithi057.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T21:58:02.046 INFO:teuthology.orchestra.run.smithi057.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T21:58:02.047 INFO:teuthology.orchestra.run.smithi057.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T21:58:02.154 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T21:58:02.154 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2024-04-25T21:58:02.154 INFO:teuthology.orchestra.run.smithi081.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T21:58:02.154 INFO:teuthology.orchestra.run.smithi081.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T21:58:02.154 INFO:teuthology.orchestra.run.smithi081.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T21:58:02.154 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T21:58:02.997 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:02 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:02.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:02 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:02.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:02 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:02.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:02 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:02.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:02 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:02.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:02 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:02.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:02 ntpd[17105]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:02.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:02 ntpd[17105]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:02.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:02 ntpd[17105]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:02.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:02 ntpd[17105]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:02.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:02 ntpd[17105]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:02.998 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:02 ntpd[17105]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:02.999 INFO:teuthology.orchestra.run.smithi044.stdout:25 Apr 21:58:02 ntpd[17105]: ntpd: time slew -0.001333 s 2024-04-25T21:58:02.999 INFO:teuthology.orchestra.run.smithi044.stdout:ntpd: time slew -0.001333s 2024-04-25T21:58:02.999 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:02 ntpd[17105]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T21:58:02.999 INFO:teuthology.orchestra.run.smithi044.stderr:25 Apr 21:58:02 ntpd[17105]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T21:58:03.003 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:03 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:03.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:03 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:03.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:03 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:03.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:03 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:03.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:03 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:03.004 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:03 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:03.057 INFO:teuthology.orchestra.run.smithi044.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T21:58:03.057 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================== 2024-04-25T21:58:03.057 INFO:teuthology.orchestra.run.smithi044.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T21:58:03.057 INFO:teuthology.orchestra.run.smithi044.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T21:58:03.057 INFO:teuthology.orchestra.run.smithi044.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T21:58:03.057 INFO:teuthology.orchestra.run.smithi044.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T21:58:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:04 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:04 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:04 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:04 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:04 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:04 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:04 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:04 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:04 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T21:58:04.005 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:04 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T21:58:04.006 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:04 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T21:58:04.006 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:04 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T21:58:04.006 INFO:teuthology.orchestra.run.smithi079.stdout:25 Apr 21:58:04 ntpd[17193]: ntpd: time slew -0.001727 s 2024-04-25T21:58:04.006 INFO:teuthology.orchestra.run.smithi079.stdout:ntpd: time slew -0.001727s 2024-04-25T21:58:04.007 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:04 ntpd[17193]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T21:58:04.007 INFO:teuthology.orchestra.run.smithi079.stderr:25 Apr 21:58:04 ntpd[17193]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T21:58:04.058 INFO:teuthology.orchestra.run.smithi079.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T21:58:04.059 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================== 2024-04-25T21:58:04.059 INFO:teuthology.orchestra.run.smithi079.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T21:58:04.059 INFO:teuthology.orchestra.run.smithi079.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T21:58:04.059 INFO:teuthology.orchestra.run.smithi079.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T21:58:04.059 INFO:teuthology.orchestra.run.smithi079.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T21:58:04.060 INFO:teuthology.run_tasks:Running task install... 2024-04-25T21:58:04.068 DEBUG:teuthology.task.install:project ceph 2024-04-25T21:58:04.069 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-25T21:58:04.069 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-25T21:58:04.069 INFO:teuthology.task.install:Using flavor: default 2024-04-25T21:58:04.078 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T21:58:04.078 INFO:teuthology.task.install:extra packages: [] 2024-04-25T21:58:04.078 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-key list | grep Ceph 2024-04-25T21:58:04.079 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-key list | grep Ceph 2024-04-25T21:58:04.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-key list | grep Ceph 2024-04-25T21:58:04.079 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-key list | grep Ceph 2024-04-25T21:58:04.144 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T21:58:04.145 INFO:teuthology.orchestra.run.smithi057.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T21:58:04.148 INFO:teuthology.orchestra.run.smithi044.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T21:58:04.158 INFO:teuthology.orchestra.run.smithi079.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T21:58:04.177 INFO:teuthology.orchestra.run.smithi057.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T21:58:04.177 INFO:teuthology.orchestra.run.smithi057.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T21:58:04.178 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-25T21:58:04.178 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-25T21:58:04.179 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T21:58:04.184 INFO:teuthology.orchestra.run.smithi044.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T21:58:04.184 INFO:teuthology.orchestra.run.smithi044.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T21:58:04.184 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-25T21:58:04.184 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-25T21:58:04.184 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T21:58:04.188 INFO:teuthology.orchestra.run.smithi079.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T21:58:04.188 INFO:teuthology.orchestra.run.smithi079.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T21:58:04.188 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-25T21:58:04.189 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-25T21:58:04.189 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T21:58:04.198 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T21:58:04.198 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T21:58:04.199 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-25T21:58:04.199 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-25T21:58:04.199 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T21:58:04.333 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-25T21:58:04.333 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T21:58:04.337 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-25T21:58:04.337 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T21:58:04.341 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-25T21:58:04.341 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T21:58:04.415 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-25T21:58:04.415 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T21:58:04.453 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T21:58:04.453 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T21:58:04.468 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get update 2024-04-25T21:58:04.517 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T21:58:04.517 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T21:58:04.526 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-25T21:58:04.526 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T21:58:04.531 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2024-04-25T21:58:04.540 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-04-25T21:58:04.695 INFO:teuthology.orchestra.run.smithi044.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T21:58:04.703 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T21:58:04.708 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T21:58:04.716 INFO:teuthology.orchestra.run.smithi044.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T21:58:04.717 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T21:58:04.720 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T21:58:04.738 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T21:58:04.739 INFO:teuthology.orchestra.run.smithi044.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T21:58:04.743 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T21:58:04.752 INFO:teuthology.orchestra.run.smithi079.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T21:58:04.757 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T21:58:04.761 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,416 B] 2024-04-25T21:58:04.773 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T21:58:04.777 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T21:58:04.778 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T21:58:04.778 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T21:58:04.795 INFO:teuthology.orchestra.run.smithi079.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T21:58:04.799 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T21:58:04.800 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-25T21:58:04.816 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-25T21:58:04.820 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,416 B] 2024-04-25T21:58:04.823 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T21:58:04.825 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T21:58:04.844 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,416 B] 2024-04-25T21:58:04.845 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T21:58:04.846 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-25T21:58:04.927 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T21:58:05.045 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 28.9 kB in 0s (85.9 kB/s) 2024-04-25T21:58:05.071 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 28.9 kB in 0s (82.6 kB/s) 2024-04-25T21:58:05.173 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 28.9 kB in 1s (56.1 kB/s) 2024-04-25T21:58:06.024 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-04-25T21:58:06.041 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy 2024-04-25T21:58:06.070 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-04-25T21:58:06.087 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy 2024-04-25T21:58:06.103 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-04-25T21:58:06.139 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-04-25T21:58:06.148 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-04-25T21:58:06.156 DEBUG:teuthology.orchestra.run.smithi044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy 2024-04-25T21:58:06.219 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-04-25T21:58:06.299 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-04-25T21:58:06.300 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-04-25T21:58:06.348 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-04-25T21:58:06.349 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-04-25T21:58:06.423 INFO:teuthology.orchestra.run.smithi044.stdout:Building dependency tree... 2024-04-25T21:58:06.423 INFO:teuthology.orchestra.run.smithi044.stdout:Reading state information... 2024-04-25T21:58:06.495 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T21:58:06.495 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T21:58:06.496 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T21:58:06.496 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T21:58:06.496 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T21:58:06.496 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T21:58:06.496 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T21:58:06.498 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2024-04-25T21:58:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T21:58:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T21:58:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T21:58:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T21:58:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T21:58:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T21:58:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T21:58:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T21:58:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T21:58:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T21:58:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T21:58:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T21:58:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T21:58:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T21:58:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T21:58:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T21:58:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-25T21:58:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-25T21:58:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T21:58:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T21:58:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T21:58:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T21:58:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-25T21:58:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet zip 2024-04-25T21:58:06.500 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2024-04-25T21:58:06.500 INFO:teuthology.orchestra.run.smithi079.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T21:58:06.500 INFO:teuthology.orchestra.run.smithi079.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T21:58:06.500 INFO:teuthology.orchestra.run.smithi079.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T21:58:06.500 INFO:teuthology.orchestra.run.smithi079.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T21:58:06.500 INFO:teuthology.orchestra.run.smithi079.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T21:58:06.500 INFO:teuthology.orchestra.run.smithi079.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T21:58:06.500 INFO:teuthology.orchestra.run.smithi079.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T21:58:06.500 INFO:teuthology.orchestra.run.smithi079.stdout:Recommended packages: 2024-04-25T21:58:06.501 INFO:teuthology.orchestra.run.smithi079.stdout: btrfs-tools 2024-04-25T21:58:06.524 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T21:58:06.524 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T21:58:06.524 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T21:58:06.524 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T21:58:06.525 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T21:58:06.525 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T21:58:06.525 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T21:58:06.525 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2024-04-25T21:58:06.525 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T21:58:06.525 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T21:58:06.527 INFO:teuthology.orchestra.run.smithi081.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T21:58:06.527 INFO:teuthology.orchestra.run.smithi081.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T21:58:06.527 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T21:58:06.527 INFO:teuthology.orchestra.run.smithi081.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T21:58:06.527 INFO:teuthology.orchestra.run.smithi081.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T21:58:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T21:58:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T21:58:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T21:58:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T21:58:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T21:58:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T21:58:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T21:58:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T21:58:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T21:58:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-25T21:58:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-25T21:58:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T21:58:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T21:58:06.528 INFO:teuthology.orchestra.run.smithi081.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T21:58:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T21:58:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-25T21:58:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet zip 2024-04-25T21:58:06.529 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2024-04-25T21:58:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T21:58:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T21:58:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T21:58:06.529 INFO:teuthology.orchestra.run.smithi081.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T21:58:06.530 INFO:teuthology.orchestra.run.smithi081.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T21:58:06.530 INFO:teuthology.orchestra.run.smithi081.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T21:58:06.530 INFO:teuthology.orchestra.run.smithi081.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T21:58:06.530 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2024-04-25T21:58:06.530 INFO:teuthology.orchestra.run.smithi081.stdout: btrfs-tools 2024-04-25T21:58:06.602 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2024-04-25T21:58:06.602 INFO:teuthology.orchestra.run.smithi079.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T21:58:06.602 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T21:58:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-25T21:58:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-25T21:58:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-25T21:58:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-25T21:58:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-25T21:58:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-25T21:58:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-25T21:58:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-25T21:58:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-25T21:58:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T21:58:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T21:58:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T21:58:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T21:58:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T21:58:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T21:58:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T21:58:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-25T21:58:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-25T21:58:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-25T21:58:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-25T21:58:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-25T21:58:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-25T21:58:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-25T21:58:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-25T21:58:06.627 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T21:58:06.628 INFO:teuthology.orchestra.run.smithi044.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T21:58:06.628 INFO:teuthology.orchestra.run.smithi044.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T21:58:06.628 INFO:teuthology.orchestra.run.smithi044.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T21:58:06.633 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2024-04-25T21:58:06.633 INFO:teuthology.orchestra.run.smithi081.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T21:58:06.633 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T21:58:06.633 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-25T21:58:06.633 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-25T21:58:06.633 INFO:teuthology.orchestra.run.smithi081.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-25T21:58:06.633 INFO:teuthology.orchestra.run.smithi081.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-25T21:58:06.633 INFO:teuthology.orchestra.run.smithi081.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-25T21:58:06.633 INFO:teuthology.orchestra.run.smithi081.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-25T21:58:06.633 INFO:teuthology.orchestra.run.smithi081.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-25T21:58:06.633 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-25T21:58:06.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-25T21:58:06.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T21:58:06.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T21:58:06.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T21:58:06.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T21:58:06.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T21:58:06.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T21:58:06.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T21:58:06.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-25T21:58:06.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-25T21:58:06.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-25T21:58:06.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-25T21:58:06.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-25T21:58:06.635 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-25T21:58:06.635 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-25T21:58:06.635 INFO:teuthology.orchestra.run.smithi081.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-25T21:58:06.636 INFO:teuthology.orchestra.run.smithi044.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T21:58:06.636 INFO:teuthology.orchestra.run.smithi044.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T21:58:06.636 INFO:teuthology.orchestra.run.smithi044.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T21:58:06.636 INFO:teuthology.orchestra.run.smithi044.stdout:The following additional packages will be installed: 2024-04-25T21:58:06.636 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T21:58:06.636 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T21:58:06.637 INFO:teuthology.orchestra.run.smithi044.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T21:58:06.637 INFO:teuthology.orchestra.run.smithi044.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T21:58:06.637 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T21:58:06.637 INFO:teuthology.orchestra.run.smithi044.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T21:58:06.637 INFO:teuthology.orchestra.run.smithi044.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T21:58:06.637 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T21:58:06.637 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T21:58:06.637 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T21:58:06.637 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T21:58:06.637 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T21:58:06.637 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T21:58:06.638 INFO:teuthology.orchestra.run.smithi044.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T21:58:06.638 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T21:58:06.638 INFO:teuthology.orchestra.run.smithi044.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T21:58:06.638 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-25T21:58:06.638 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-25T21:58:06.638 INFO:teuthology.orchestra.run.smithi044.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T21:58:06.638 INFO:teuthology.orchestra.run.smithi044.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T21:58:06.638 INFO:teuthology.orchestra.run.smithi044.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T21:58:06.638 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T21:58:06.638 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-25T21:58:06.639 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet zip 2024-04-25T21:58:06.639 INFO:teuthology.orchestra.run.smithi044.stdout:Suggested packages: 2024-04-25T21:58:06.639 INFO:teuthology.orchestra.run.smithi044.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T21:58:06.639 INFO:teuthology.orchestra.run.smithi044.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T21:58:06.639 INFO:teuthology.orchestra.run.smithi044.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T21:58:06.640 INFO:teuthology.orchestra.run.smithi044.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T21:58:06.640 INFO:teuthology.orchestra.run.smithi044.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T21:58:06.640 INFO:teuthology.orchestra.run.smithi044.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T21:58:06.640 INFO:teuthology.orchestra.run.smithi044.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T21:58:06.640 INFO:teuthology.orchestra.run.smithi044.stdout:Recommended packages: 2024-04-25T21:58:06.640 INFO:teuthology.orchestra.run.smithi044.stdout: btrfs-tools 2024-04-25T21:58:06.670 INFO:teuthology.orchestra.run.smithi079.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T21:58:06.670 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 179 MB of archives. 2024-04-25T21:58:06.671 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-25T21:58:06.671 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T21:58:06.740 INFO:teuthology.orchestra.run.smithi044.stdout:The following NEW packages will be installed: 2024-04-25T21:58:06.740 INFO:teuthology.orchestra.run.smithi044.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T21:58:06.740 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T21:58:06.740 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-25T21:58:06.740 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-25T21:58:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-25T21:58:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-25T21:58:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-25T21:58:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-25T21:58:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-25T21:58:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-25T21:58:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-25T21:58:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T21:58:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T21:58:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T21:58:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T21:58:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T21:58:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T21:58:06.742 INFO:teuthology.orchestra.run.smithi044.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T21:58:06.742 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-25T21:58:06.742 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-25T21:58:06.742 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-25T21:58:06.742 INFO:teuthology.orchestra.run.smithi044.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-25T21:58:06.742 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-25T21:58:06.742 INFO:teuthology.orchestra.run.smithi044.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-25T21:58:06.742 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-25T21:58:06.742 INFO:teuthology.orchestra.run.smithi044.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-25T21:58:06.744 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,541 kB] 2024-04-25T21:58:06.777 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T21:58:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T21:58:06.800 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T21:58:06.807 INFO:teuthology.orchestra.run.smithi044.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T21:58:06.807 INFO:teuthology.orchestra.run.smithi044.stdout:Need to get 179 MB of archives. 2024-04-25T21:58:06.807 INFO:teuthology.orchestra.run.smithi044.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-25T21:58:06.807 INFO:teuthology.orchestra.run.smithi044.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T21:58:06.846 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T21:58:06.846 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 179 MB of archives. 2024-04-25T21:58:06.846 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-25T21:58:06.846 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,541 kB] 2024-04-25T21:58:06.871 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T21:58:06.876 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T21:58:06.888 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T21:58:06.892 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T21:58:06.892 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T21:58:06.893 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T21:58:06.895 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T21:58:06.901 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T21:58:06.903 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T21:58:06.905 INFO:teuthology.orchestra.run.smithi044.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,541 kB] 2024-04-25T21:58:06.905 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T21:58:06.906 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T21:58:06.914 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T21:58:06.916 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T21:58:06.917 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T21:58:06.920 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T21:58:06.922 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T21:58:06.924 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T21:58:06.924 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T21:58:06.937 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T21:58:06.938 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T21:58:06.942 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T21:58:06.942 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T21:58:06.942 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T21:58:06.942 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T21:58:06.959 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T21:58:06.959 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T21:58:06.959 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T21:58:06.961 INFO:teuthology.orchestra.run.smithi079.stdout:Get:29 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-25T21:58:06.962 INFO:teuthology.orchestra.run.smithi079.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T21:58:06.963 INFO:teuthology.orchestra.run.smithi079.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T21:58:06.979 INFO:teuthology.orchestra.run.smithi079.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T21:58:06.980 INFO:teuthology.orchestra.run.smithi079.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T21:58:06.981 INFO:teuthology.orchestra.run.smithi079.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T21:58:06.981 INFO:teuthology.orchestra.run.smithi079.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T21:58:06.981 INFO:teuthology.orchestra.run.smithi079.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T21:58:07.000 INFO:teuthology.orchestra.run.smithi079.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T21:58:07.001 INFO:teuthology.orchestra.run.smithi079.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T21:58:07.002 INFO:teuthology.orchestra.run.smithi079.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T21:58:07.008 INFO:teuthology.orchestra.run.smithi079.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T21:58:07.008 INFO:teuthology.orchestra.run.smithi079.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T21:58:07.009 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T21:58:07.015 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T21:58:07.028 INFO:teuthology.orchestra.run.smithi079.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T21:58:07.028 INFO:teuthology.orchestra.run.smithi079.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T21:58:07.029 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T21:58:07.030 INFO:teuthology.orchestra.run.smithi079.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T21:58:07.032 INFO:teuthology.orchestra.run.smithi079.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T21:58:07.032 INFO:teuthology.orchestra.run.smithi079.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T21:58:07.034 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T21:58:07.034 INFO:teuthology.orchestra.run.smithi044.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T21:58:07.035 INFO:teuthology.orchestra.run.smithi044.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T21:58:07.043 INFO:teuthology.orchestra.run.smithi044.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T21:58:07.045 INFO:teuthology.orchestra.run.smithi044.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T21:58:07.048 INFO:teuthology.orchestra.run.smithi044.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T21:58:07.048 INFO:teuthology.orchestra.run.smithi079.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T21:58:07.049 INFO:teuthology.orchestra.run.smithi044.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T21:58:07.049 INFO:teuthology.orchestra.run.smithi079.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T21:58:07.054 INFO:teuthology.orchestra.run.smithi079.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T21:58:07.054 INFO:teuthology.orchestra.run.smithi079.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T21:58:07.055 INFO:teuthology.orchestra.run.smithi044.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T21:58:07.056 INFO:teuthology.orchestra.run.smithi079.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T21:58:07.058 INFO:teuthology.orchestra.run.smithi044.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T21:58:07.061 INFO:teuthology.orchestra.run.smithi044.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T21:58:07.069 INFO:teuthology.orchestra.run.smithi079.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T21:58:07.072 INFO:teuthology.orchestra.run.smithi079.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-25T21:58:07.087 INFO:teuthology.orchestra.run.smithi044.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T21:58:07.088 INFO:teuthology.orchestra.run.smithi044.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T21:58:07.088 INFO:teuthology.orchestra.run.smithi044.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T21:58:07.090 INFO:teuthology.orchestra.run.smithi044.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T21:58:07.090 INFO:teuthology.orchestra.run.smithi044.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T21:58:07.090 INFO:teuthology.orchestra.run.smithi044.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T21:58:07.091 INFO:teuthology.orchestra.run.smithi044.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T21:58:07.096 INFO:teuthology.orchestra.run.smithi079.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-25T21:58:07.107 INFO:teuthology.orchestra.run.smithi079.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-25T21:58:07.109 INFO:teuthology.orchestra.run.smithi079.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-25T21:58:07.115 INFO:teuthology.orchestra.run.smithi044.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T21:58:07.115 INFO:teuthology.orchestra.run.smithi044.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T21:58:07.116 INFO:teuthology.orchestra.run.smithi044.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T21:58:07.117 INFO:teuthology.orchestra.run.smithi079.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.8 kB] 2024-04-25T21:58:07.119 INFO:teuthology.orchestra.run.smithi079.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-25T21:58:07.131 INFO:teuthology.orchestra.run.smithi079.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-25T21:58:07.135 INFO:teuthology.orchestra.run.smithi044.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T21:58:07.136 INFO:teuthology.orchestra.run.smithi044.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T21:58:07.137 INFO:teuthology.orchestra.run.smithi044.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T21:58:07.137 INFO:teuthology.orchestra.run.smithi044.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T21:58:07.138 INFO:teuthology.orchestra.run.smithi044.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T21:58:07.139 INFO:teuthology.orchestra.run.smithi044.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T21:58:07.139 INFO:teuthology.orchestra.run.smithi044.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T21:58:07.141 INFO:teuthology.orchestra.run.smithi079.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T21:58:07.142 INFO:teuthology.orchestra.run.smithi079.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T21:58:07.146 INFO:teuthology.orchestra.run.smithi079.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T21:58:07.146 INFO:teuthology.orchestra.run.smithi079.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T21:58:07.146 INFO:teuthology.orchestra.run.smithi079.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T21:58:07.156 INFO:teuthology.orchestra.run.smithi044.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T21:58:07.157 INFO:teuthology.orchestra.run.smithi044.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T21:58:07.158 INFO:teuthology.orchestra.run.smithi044.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T21:58:07.163 INFO:teuthology.orchestra.run.smithi079.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T21:58:07.164 INFO:teuthology.orchestra.run.smithi079.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T21:58:07.165 INFO:teuthology.orchestra.run.smithi079.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T21:58:07.177 INFO:teuthology.orchestra.run.smithi044.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T21:58:07.177 INFO:teuthology.orchestra.run.smithi044.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T21:58:07.178 INFO:teuthology.orchestra.run.smithi044.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T21:58:07.178 INFO:teuthology.orchestra.run.smithi044.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T21:58:07.180 INFO:teuthology.orchestra.run.smithi079.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T21:58:07.180 INFO:teuthology.orchestra.run.smithi079.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T21:58:07.181 INFO:teuthology.orchestra.run.smithi044.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T21:58:07.182 INFO:teuthology.orchestra.run.smithi044.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T21:58:07.183 INFO:teuthology.orchestra.run.smithi044.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T21:58:07.187 INFO:teuthology.orchestra.run.smithi079.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T21:58:07.188 INFO:teuthology.orchestra.run.smithi079.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T21:58:07.188 INFO:teuthology.orchestra.run.smithi079.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T21:58:07.188 INFO:teuthology.orchestra.run.smithi079.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T21:58:07.189 INFO:teuthology.orchestra.run.smithi079.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T21:58:07.189 INFO:teuthology.orchestra.run.smithi079.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T21:58:07.197 INFO:teuthology.orchestra.run.smithi044.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T21:58:07.198 INFO:teuthology.orchestra.run.smithi044.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T21:58:07.201 INFO:teuthology.orchestra.run.smithi044.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T21:58:07.208 INFO:teuthology.orchestra.run.smithi079.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T21:58:07.210 INFO:teuthology.orchestra.run.smithi079.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T21:58:07.212 INFO:teuthology.orchestra.run.smithi079.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T21:58:07.213 INFO:teuthology.orchestra.run.smithi079.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T21:58:07.222 INFO:teuthology.orchestra.run.smithi044.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T21:58:07.223 INFO:teuthology.orchestra.run.smithi044.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T21:58:07.226 INFO:teuthology.orchestra.run.smithi044.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T21:58:07.245 INFO:teuthology.orchestra.run.smithi079.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T21:58:07.251 INFO:teuthology.orchestra.run.smithi079.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T21:58:07.253 INFO:teuthology.orchestra.run.smithi079.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T21:58:07.254 INFO:teuthology.orchestra.run.smithi079.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T21:58:07.264 INFO:teuthology.orchestra.run.smithi079.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T21:58:07.265 INFO:teuthology.orchestra.run.smithi079.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T21:58:07.286 INFO:teuthology.orchestra.run.smithi079.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T21:58:07.286 INFO:teuthology.orchestra.run.smithi079.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T21:58:07.287 INFO:teuthology.orchestra.run.smithi079.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T21:58:07.288 INFO:teuthology.orchestra.run.smithi079.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T21:58:07.294 INFO:teuthology.orchestra.run.smithi044.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T21:58:07.296 INFO:teuthology.orchestra.run.smithi044.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T21:58:07.298 INFO:teuthology.orchestra.run.smithi044.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T21:58:07.298 INFO:teuthology.orchestra.run.smithi044.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T21:58:07.299 INFO:teuthology.orchestra.run.smithi044.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T21:58:07.312 INFO:teuthology.orchestra.run.smithi079.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T21:58:07.313 INFO:teuthology.orchestra.run.smithi079.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T21:58:07.321 INFO:teuthology.orchestra.run.smithi044.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T21:58:07.323 INFO:teuthology.orchestra.run.smithi044.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T21:58:07.323 INFO:teuthology.orchestra.run.smithi044.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T21:58:07.325 INFO:teuthology.orchestra.run.smithi079.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T21:58:07.326 INFO:teuthology.orchestra.run.smithi079.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T21:58:07.326 INFO:teuthology.orchestra.run.smithi079.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T21:58:07.330 INFO:teuthology.orchestra.run.smithi079.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T21:58:07.340 INFO:teuthology.orchestra.run.smithi044.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T21:58:07.340 INFO:teuthology.orchestra.run.smithi044.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T21:58:07.340 INFO:teuthology.orchestra.run.smithi079.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T21:58:07.353 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T21:58:07.361 INFO:teuthology.orchestra.run.smithi044.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T21:58:07.361 INFO:teuthology.orchestra.run.smithi044.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T21:58:07.362 INFO:teuthology.orchestra.run.smithi044.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T21:58:07.362 INFO:teuthology.orchestra.run.smithi044.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T21:58:07.363 INFO:teuthology.orchestra.run.smithi044.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T21:58:07.363 INFO:teuthology.orchestra.run.smithi044.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T21:58:07.367 INFO:teuthology.orchestra.run.smithi044.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T21:58:07.368 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T21:58:07.381 INFO:teuthology.orchestra.run.smithi044.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T21:58:07.383 INFO:teuthology.orchestra.run.smithi044.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T21:58:07.383 INFO:teuthology.orchestra.run.smithi044.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T21:58:07.384 INFO:teuthology.orchestra.run.smithi079.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-25T21:58:07.386 INFO:teuthology.orchestra.run.smithi079.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [467 kB] 2024-04-25T21:58:07.401 INFO:teuthology.orchestra.run.smithi079.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-25T21:58:07.402 INFO:teuthology.orchestra.run.smithi044.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T21:58:07.404 INFO:teuthology.orchestra.run.smithi044.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T21:58:07.405 INFO:teuthology.orchestra.run.smithi044.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T21:58:07.406 INFO:teuthology.orchestra.run.smithi044.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T21:58:07.410 INFO:teuthology.orchestra.run.smithi044.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T21:58:07.411 INFO:teuthology.orchestra.run.smithi044.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T21:58:07.413 INFO:teuthology.orchestra.run.smithi044.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T21:58:07.422 INFO:teuthology.orchestra.run.smithi044.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T21:58:07.423 INFO:teuthology.orchestra.run.smithi044.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T21:58:07.423 INFO:teuthology.orchestra.run.smithi044.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T21:58:07.443 INFO:teuthology.orchestra.run.smithi044.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T21:58:07.444 INFO:teuthology.orchestra.run.smithi044.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T21:58:07.451 INFO:teuthology.orchestra.run.smithi044.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T21:58:07.452 INFO:teuthology.orchestra.run.smithi044.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T21:58:07.452 INFO:teuthology.orchestra.run.smithi044.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T21:58:07.454 INFO:teuthology.orchestra.run.smithi044.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T21:58:07.455 INFO:teuthology.orchestra.run.smithi044.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T21:58:07.499 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T21:58:07.676 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T21:58:07.677 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T21:58:07.691 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get update 2024-04-25T21:58:07.867 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T21:58:07.881 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T21:58:07.902 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T21:58:08.002 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T21:58:08.093 INFO:teuthology.orchestra.run.smithi057.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T21:58:08.160 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T21:58:08.224 INFO:teuthology.orchestra.run.smithi057.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T21:58:08.294 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,416 B] 2024-04-25T21:58:08.377 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-25T21:58:08.469 INFO:teuthology.orchestra.run.smithi044.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-25T21:58:08.479 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 28.9 kB in 1s (49.7 kB/s) 2024-04-25T21:58:08.501 INFO:teuthology.orchestra.run.smithi079.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-25T21:58:08.611 INFO:teuthology.orchestra.run.smithi079.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-25T21:58:08.618 INFO:teuthology.orchestra.run.smithi079.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-25T21:58:08.622 INFO:teuthology.orchestra.run.smithi079.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,526 kB] 2024-04-25T21:58:08.642 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-25T21:58:08.691 INFO:teuthology.orchestra.run.smithi079.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-25T21:58:09.050 INFO:teuthology.orchestra.run.smithi079.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-25T21:58:09.197 INFO:teuthology.orchestra.run.smithi044.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-25T21:58:09.329 INFO:teuthology.orchestra.run.smithi044.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-25T21:58:09.344 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-25T21:58:09.446 INFO:teuthology.orchestra.run.smithi044.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-25T21:58:09.448 INFO:teuthology.orchestra.run.smithi044.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-25T21:58:09.461 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-25T21:58:09.472 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-25T21:58:09.489 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy 2024-04-25T21:58:09.492 INFO:teuthology.orchestra.run.smithi044.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.8 kB] 2024-04-25T21:58:09.510 INFO:teuthology.orchestra.run.smithi044.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-25T21:58:09.524 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-25T21:58:09.527 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-25T21:58:09.553 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.8 kB] 2024-04-25T21:58:09.554 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-25T21:58:09.563 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-25T21:58:09.574 INFO:teuthology.orchestra.run.smithi044.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-25T21:58:09.614 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-25T21:58:09.758 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2024-04-25T21:58:09.758 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2024-04-25T21:58:09.962 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T21:58:09.962 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T21:58:09.963 INFO:teuthology.orchestra.run.smithi057.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T21:58:09.963 INFO:teuthology.orchestra.run.smithi057.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T21:58:09.965 INFO:teuthology.orchestra.run.smithi057.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T21:58:09.965 INFO:teuthology.orchestra.run.smithi057.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T21:58:09.965 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T21:58:09.965 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2024-04-25T21:58:09.965 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T21:58:09.965 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T21:58:09.965 INFO:teuthology.orchestra.run.smithi057.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T21:58:09.966 INFO:teuthology.orchestra.run.smithi057.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T21:58:09.966 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T21:58:09.966 INFO:teuthology.orchestra.run.smithi057.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T21:58:09.966 INFO:teuthology.orchestra.run.smithi057.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T21:58:09.966 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T21:58:09.966 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T21:58:09.966 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T21:58:09.966 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T21:58:09.966 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T21:58:09.966 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T21:58:09.966 INFO:teuthology.orchestra.run.smithi057.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T21:58:09.966 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T21:58:09.966 INFO:teuthology.orchestra.run.smithi057.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T21:58:09.966 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-25T21:58:09.967 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-25T21:58:09.967 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T21:58:09.967 INFO:teuthology.orchestra.run.smithi057.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T21:58:09.967 INFO:teuthology.orchestra.run.smithi057.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T21:58:09.967 INFO:teuthology.orchestra.run.smithi057.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T21:58:09.967 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-25T21:58:09.967 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet zip 2024-04-25T21:58:09.967 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2024-04-25T21:58:09.967 INFO:teuthology.orchestra.run.smithi057.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T21:58:09.967 INFO:teuthology.orchestra.run.smithi057.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T21:58:09.968 INFO:teuthology.orchestra.run.smithi057.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T21:58:09.968 INFO:teuthology.orchestra.run.smithi057.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T21:58:09.968 INFO:teuthology.orchestra.run.smithi057.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T21:58:09.968 INFO:teuthology.orchestra.run.smithi057.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T21:58:09.968 INFO:teuthology.orchestra.run.smithi057.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T21:58:09.968 INFO:teuthology.orchestra.run.smithi057.stdout:Recommended packages: 2024-04-25T21:58:09.968 INFO:teuthology.orchestra.run.smithi057.stdout: btrfs-tools 2024-04-25T21:58:10.072 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2024-04-25T21:58:10.072 INFO:teuthology.orchestra.run.smithi057.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T21:58:10.072 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T21:58:10.073 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-25T21:58:10.073 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-25T21:58:10.073 INFO:teuthology.orchestra.run.smithi057.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-25T21:58:10.073 INFO:teuthology.orchestra.run.smithi057.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-25T21:58:10.074 INFO:teuthology.orchestra.run.smithi057.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-25T21:58:10.074 INFO:teuthology.orchestra.run.smithi057.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-25T21:58:10.074 INFO:teuthology.orchestra.run.smithi057.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-25T21:58:10.074 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-25T21:58:10.074 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-25T21:58:10.074 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T21:58:10.074 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T21:58:10.074 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T21:58:10.075 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T21:58:10.075 INFO:teuthology.orchestra.run.smithi057.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T21:58:10.075 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T21:58:10.075 INFO:teuthology.orchestra.run.smithi057.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T21:58:10.075 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-25T21:58:10.075 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-25T21:58:10.075 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-25T21:58:10.075 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-25T21:58:10.075 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-25T21:58:10.075 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-25T21:58:10.075 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-25T21:58:10.075 INFO:teuthology.orchestra.run.smithi057.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-25T21:58:10.142 INFO:teuthology.orchestra.run.smithi057.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T21:58:10.142 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 179 MB of archives. 2024-04-25T21:58:10.143 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-25T21:58:10.143 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T21:58:10.217 INFO:teuthology.orchestra.run.smithi079.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-25T21:58:10.218 INFO:teuthology.orchestra.run.smithi079.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-25T21:58:10.234 INFO:teuthology.orchestra.run.smithi079.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-25T21:58:10.303 INFO:teuthology.orchestra.run.smithi079.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [791 kB] 2024-04-25T21:58:10.308 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T21:58:10.312 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T21:58:10.347 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T21:58:10.349 INFO:teuthology.orchestra.run.smithi079.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-25T21:58:10.354 INFO:teuthology.orchestra.run.smithi079.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-25T21:58:10.440 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T21:58:10.445 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T21:58:10.459 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T21:58:10.464 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T21:58:10.464 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T21:58:10.465 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T21:58:10.474 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T21:58:10.477 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T21:58:10.478 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,541 kB] 2024-04-25T21:58:10.479 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T21:58:10.481 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T21:58:10.486 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T21:58:10.488 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T21:58:10.491 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T21:58:10.520 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T21:58:10.521 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T21:58:10.522 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T21:58:10.522 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T21:58:10.523 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T21:58:10.523 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T21:58:10.524 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T21:58:10.538 INFO:teuthology.orchestra.run.smithi079.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-25T21:58:10.571 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T21:58:10.571 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T21:58:10.572 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T21:58:10.603 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-25T21:58:10.606 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [467 kB] 2024-04-25T21:58:10.611 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T21:58:10.612 INFO:teuthology.orchestra.run.smithi057.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T21:58:10.613 INFO:teuthology.orchestra.run.smithi057.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T21:58:10.614 INFO:teuthology.orchestra.run.smithi057.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T21:58:10.618 INFO:teuthology.orchestra.run.smithi057.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T21:58:10.618 INFO:teuthology.orchestra.run.smithi057.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T21:58:10.618 INFO:teuthology.orchestra.run.smithi057.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T21:58:10.618 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-25T21:58:10.631 INFO:teuthology.orchestra.run.smithi057.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T21:58:10.633 INFO:teuthology.orchestra.run.smithi057.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T21:58:10.634 INFO:teuthology.orchestra.run.smithi057.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T21:58:10.653 INFO:teuthology.orchestra.run.smithi057.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T21:58:10.653 INFO:teuthology.orchestra.run.smithi057.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T21:58:10.654 INFO:teuthology.orchestra.run.smithi057.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T21:58:10.655 INFO:teuthology.orchestra.run.smithi057.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T21:58:10.657 INFO:teuthology.orchestra.run.smithi057.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T21:58:10.661 INFO:teuthology.orchestra.run.smithi057.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T21:58:10.663 INFO:teuthology.orchestra.run.smithi057.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T21:58:10.673 INFO:teuthology.orchestra.run.smithi057.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T21:58:10.674 INFO:teuthology.orchestra.run.smithi057.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T21:58:10.679 INFO:teuthology.orchestra.run.smithi057.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T21:58:10.693 INFO:teuthology.orchestra.run.smithi057.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T21:58:10.695 INFO:teuthology.orchestra.run.smithi057.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T21:58:10.699 INFO:teuthology.orchestra.run.smithi057.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T21:58:10.778 INFO:teuthology.orchestra.run.smithi057.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T21:58:10.779 INFO:teuthology.orchestra.run.smithi057.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T21:58:10.780 INFO:teuthology.orchestra.run.smithi057.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T21:58:10.780 INFO:teuthology.orchestra.run.smithi057.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T21:58:10.781 INFO:teuthology.orchestra.run.smithi057.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T21:58:10.800 INFO:teuthology.orchestra.run.smithi057.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T21:58:10.802 INFO:teuthology.orchestra.run.smithi057.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T21:58:10.803 INFO:teuthology.orchestra.run.smithi057.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T21:58:10.817 INFO:teuthology.orchestra.run.smithi057.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T21:58:10.817 INFO:teuthology.orchestra.run.smithi057.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T21:58:10.823 INFO:teuthology.orchestra.run.smithi057.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T21:58:10.823 INFO:teuthology.orchestra.run.smithi057.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T21:58:10.824 INFO:teuthology.orchestra.run.smithi057.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T21:58:10.824 INFO:teuthology.orchestra.run.smithi057.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T21:58:10.843 INFO:teuthology.orchestra.run.smithi057.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T21:58:10.844 INFO:teuthology.orchestra.run.smithi057.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T21:58:10.848 INFO:teuthology.orchestra.run.smithi057.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T21:58:10.850 INFO:teuthology.orchestra.run.smithi057.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T21:58:10.851 INFO:teuthology.orchestra.run.smithi057.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T21:58:10.852 INFO:teuthology.orchestra.run.smithi057.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T21:58:10.864 INFO:teuthology.orchestra.run.smithi057.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T21:58:10.867 INFO:teuthology.orchestra.run.smithi057.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T21:58:10.868 INFO:teuthology.orchestra.run.smithi057.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T21:58:10.869 INFO:teuthology.orchestra.run.smithi057.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T21:58:10.886 INFO:teuthology.orchestra.run.smithi057.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T21:58:10.887 INFO:teuthology.orchestra.run.smithi057.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T21:58:10.894 INFO:teuthology.orchestra.run.smithi057.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T21:58:10.894 INFO:teuthology.orchestra.run.smithi057.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T21:58:10.894 INFO:teuthology.orchestra.run.smithi057.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T21:58:10.895 INFO:teuthology.orchestra.run.smithi057.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T21:58:10.914 INFO:teuthology.orchestra.run.smithi057.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T21:58:10.916 INFO:teuthology.orchestra.run.smithi057.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T21:58:10.931 INFO:teuthology.orchestra.run.smithi057.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T21:58:10.932 INFO:teuthology.orchestra.run.smithi057.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T21:58:10.954 INFO:teuthology.orchestra.run.smithi057.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T21:58:10.958 INFO:teuthology.orchestra.run.smithi057.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T21:58:10.959 INFO:teuthology.orchestra.run.smithi057.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T21:58:11.068 INFO:teuthology.orchestra.run.smithi079.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-25T21:58:11.068 INFO:teuthology.orchestra.run.smithi079.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-25T21:58:11.132 INFO:teuthology.orchestra.run.smithi057.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-25T21:58:11.456 INFO:teuthology.orchestra.run.smithi044.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-25T21:58:11.462 INFO:teuthology.orchestra.run.smithi044.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [467 kB] 2024-04-25T21:58:11.539 INFO:teuthology.orchestra.run.smithi057.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-25T21:58:11.615 INFO:teuthology.orchestra.run.smithi057.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-25T21:58:11.664 INFO:teuthology.orchestra.run.smithi044.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-25T21:58:11.675 INFO:teuthology.orchestra.run.smithi057.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-25T21:58:11.676 INFO:teuthology.orchestra.run.smithi057.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-25T21:58:11.684 INFO:teuthology.orchestra.run.smithi057.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.8 kB] 2024-04-25T21:58:11.688 INFO:teuthology.orchestra.run.smithi057.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-25T21:58:11.747 INFO:teuthology.orchestra.run.smithi057.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-25T21:58:12.618 INFO:teuthology.orchestra.run.smithi057.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-25T21:58:12.618 INFO:teuthology.orchestra.run.smithi057.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [467 kB] 2024-04-25T21:58:12.686 INFO:teuthology.orchestra.run.smithi057.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-25T21:58:14.845 INFO:teuthology.orchestra.run.smithi079.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-25T21:58:14.847 INFO:teuthology.orchestra.run.smithi079.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-25T21:58:14.848 INFO:teuthology.orchestra.run.smithi079.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-25T21:58:15.158 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T21:58:15.161 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-25T21:58:15.572 INFO:teuthology.orchestra.run.smithi079.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.4 kB] 2024-04-25T21:58:15.717 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-25T21:58:15.739 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-25T21:58:15.752 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,526 kB] 2024-04-25T21:58:15.884 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-25T21:58:15.886 INFO:teuthology.orchestra.run.smithi057.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-25T21:58:16.029 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T21:58:16.132 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 179 MB in 9s (20.0 MB/s) 2024-04-25T21:58:16.146 INFO:teuthology.orchestra.run.smithi057.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-25T21:58:16.169 INFO:teuthology.orchestra.run.smithi057.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-25T21:58:16.174 INFO:teuthology.orchestra.run.smithi057.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,526 kB] 2024-04-25T21:58:16.282 INFO:teuthology.orchestra.run.smithi057.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-25T21:58:16.300 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T21:58:16.401 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T21:58:16.407 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T21:58:16.500 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-25T21:58:16.516 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T21:58:16.722 INFO:teuthology.orchestra.run.smithi057.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-25T21:58:16.869 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T21:58:16.895 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T21:58:16.936 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T21:58:17.280 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T21:58:17.306 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T21:58:17.347 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T21:58:17.734 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T21:58:17.760 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T21:58:17.809 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:58:18.196 INFO:teuthology.orchestra.run.smithi044.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-25T21:58:18.212 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T21:58:18.238 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T21:58:18.278 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:58:18.387 INFO:teuthology.orchestra.run.smithi057.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-25T21:58:18.387 INFO:teuthology.orchestra.run.smithi057.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-25T21:58:18.404 INFO:teuthology.orchestra.run.smithi057.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-25T21:58:18.522 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T21:58:18.542 INFO:teuthology.orchestra.run.smithi057.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [791 kB] 2024-04-25T21:58:18.602 INFO:teuthology.orchestra.run.smithi057.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-25T21:58:18.613 INFO:teuthology.orchestra.run.smithi057.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-25T21:58:18.768 INFO:teuthology.orchestra.run.smithi057.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-25T21:58:18.790 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T21:58:18.817 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T21:58:18.856 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:58:18.863 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-25T21:58:18.864 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-25T21:58:18.871 INFO:teuthology.orchestra.run.smithi044.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-25T21:58:18.905 INFO:teuthology.orchestra.run.smithi044.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-25T21:58:18.908 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-25T21:58:18.938 INFO:teuthology.orchestra.run.smithi044.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,526 kB] 2024-04-25T21:58:19.143 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [791 kB] 2024-04-25T21:58:19.149 INFO:teuthology.orchestra.run.smithi044.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-25T21:58:19.168 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T21:58:19.194 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T21:58:19.232 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-25T21:58:19.234 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T21:58:19.259 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-25T21:58:19.349 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T21:58:19.361 INFO:teuthology.orchestra.run.smithi057.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-25T21:58:19.362 INFO:teuthology.orchestra.run.smithi057.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-25T21:58:19.426 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T21:58:19.500 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T21:58:19.571 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librados2. 2024-04-25T21:58:19.596 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-25T21:58:19.597 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../007-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:19.637 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:20.004 INFO:teuthology.orchestra.run.smithi044.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-25T21:58:20.115 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librbd1. 2024-04-25T21:58:20.141 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../008-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:20.182 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:20.498 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-25T21:58:20.498 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-25T21:58:20.626 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T21:58:20.652 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:20.692 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:20.962 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rados. 2024-04-25T21:58:20.988 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:21.028 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:21.298 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T21:58:21.324 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:58:21.356 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:21.625 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T21:58:21.651 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:21.692 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:21.995 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T21:58:22.021 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:58:22.061 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:22.353 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T21:58:22.389 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T21:58:22.415 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T21:58:22.456 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T21:58:22.783 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T21:58:22.809 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T21:58:22.850 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T21:58:23.055 INFO:teuthology.orchestra.run.smithi044.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-25T21:58:23.056 INFO:teuthology.orchestra.run.smithi044.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-25T21:58:23.084 INFO:teuthology.orchestra.run.smithi044.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-25T21:58:23.136 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T21:58:23.162 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:23.203 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:23.331 INFO:teuthology.orchestra.run.smithi044.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [791 kB] 2024-04-25T21:58:23.401 INFO:teuthology.orchestra.run.smithi044.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-25T21:58:23.415 INFO:teuthology.orchestra.run.smithi044.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-25T21:58:23.443 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T21:58:23.477 INFO:teuthology.orchestra.run.smithi057.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-25T21:58:23.480 INFO:teuthology.orchestra.run.smithi057.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-25T21:58:23.481 INFO:teuthology.orchestra.run.smithi057.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-25T21:58:23.522 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T21:58:23.549 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T21:58:23.589 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T21:58:23.651 INFO:teuthology.orchestra.run.smithi044.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-25T21:58:23.852 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T21:58:23.885 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T21:58:23.888 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T21:58:23.975 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T21:58:23.996 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T21:58:24.001 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T21:58:24.042 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T21:58:24.091 INFO:teuthology.orchestra.run.smithi081.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T21:58:24.177 INFO:teuthology.orchestra.run.smithi081.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T21:58:24.183 INFO:teuthology.orchestra.run.smithi081.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T21:58:24.184 INFO:teuthology.orchestra.run.smithi081.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T21:58:24.222 INFO:teuthology.orchestra.run.smithi081.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T21:58:24.223 INFO:teuthology.orchestra.run.smithi081.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T21:58:24.336 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T21:58:24.362 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T21:58:24.402 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T21:58:24.508 INFO:teuthology.orchestra.run.smithi044.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-25T21:58:24.508 INFO:teuthology.orchestra.run.smithi044.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-25T21:58:24.617 INFO:teuthology.orchestra.run.smithi057.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.4 kB] 2024-04-25T21:58:24.706 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua5.1. 2024-04-25T21:58:24.732 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T21:58:24.764 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T21:58:24.935 INFO:teuthology.orchestra.run.smithi081.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T21:58:25.018 INFO:teuthology.orchestra.run.smithi081.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T21:58:25.046 INFO:teuthology.orchestra.run.smithi081.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T21:58:25.064 INFO:teuthology.orchestra.run.smithi081.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T21:58:25.092 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua-any. 2024-04-25T21:58:25.108 INFO:teuthology.orchestra.run.smithi081.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T21:58:25.118 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-25T21:58:25.158 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T21:58:25.210 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 179 MB in 15s (12.3 MB/s) 2024-04-25T21:58:25.347 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T21:58:25.351 INFO:teuthology.orchestra.run.smithi081.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T21:58:25.352 INFO:teuthology.orchestra.run.smithi081.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T21:58:25.386 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package zip. 2024-04-25T21:58:25.401 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-25T21:58:25.416 INFO:teuthology.orchestra.run.smithi081.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T21:58:25.417 INFO:teuthology.orchestra.run.smithi081.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T21:58:25.444 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T21:58:25.445 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T21:58:25.451 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T21:58:25.487 INFO:teuthology.orchestra.run.smithi081.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T21:58:25.489 INFO:teuthology.orchestra.run.smithi081.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-25T21:58:25.491 INFO:teuthology.orchestra.run.smithi081.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-25T21:58:25.492 INFO:teuthology.orchestra.run.smithi081.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-25T21:58:25.537 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T21:58:25.773 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package unzip. 2024-04-25T21:58:25.799 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T21:58:25.839 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T21:58:25.907 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T21:58:25.934 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T21:58:25.974 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T21:58:26.226 INFO:teuthology.orchestra.run.smithi081.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T21:58:26.226 INFO:teuthology.orchestra.run.smithi081.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T21:58:26.318 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package luarocks. 2024-04-25T21:58:26.319 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T21:58:26.327 INFO:teuthology.orchestra.run.smithi081.stdout:Get:65 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.4 kB] 2024-04-25T21:58:26.344 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T21:58:26.394 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T21:58:26.394 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T21:58:26.394 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T21:58:26.486 INFO:teuthology.orchestra.run.smithi081.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T21:58:26.530 INFO:teuthology.orchestra.run.smithi081.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T21:58:26.543 INFO:teuthology.orchestra.run.smithi081.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T21:58:26.772 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T21:58:26.798 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T21:58:26.815 INFO:teuthology.orchestra.run.smithi081.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T21:58:26.815 INFO:teuthology.orchestra.run.smithi081.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T21:58:26.834 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librgw2. 2024-04-25T21:58:26.838 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:58:26.855 INFO:teuthology.orchestra.run.smithi081.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T21:58:26.860 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../025-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:26.861 INFO:teuthology.orchestra.run.smithi081.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T21:58:26.903 INFO:teuthology.orchestra.run.smithi081.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T21:58:26.909 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:26.992 INFO:teuthology.orchestra.run.smithi081.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T21:58:27.238 INFO:teuthology.orchestra.run.smithi044.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-25T21:58:27.241 INFO:teuthology.orchestra.run.smithi044.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-25T21:58:27.242 INFO:teuthology.orchestra.run.smithi044.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-25T21:58:27.258 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T21:58:27.285 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T21:58:27.325 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:58:27.470 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T21:58:27.487 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:27.528 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:27.570 INFO:teuthology.orchestra.run.smithi044.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.4 kB] 2024-04-25T21:58:27.797 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T21:58:27.812 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T21:58:27.838 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T21:58:27.847 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T21:58:27.863 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T21:58:27.902 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:58:27.904 INFO:teuthology.orchestra.run.smithi081.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T21:58:28.162 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 179 MB in 21s (8,619 kB/s) 2024-04-25T21:58:28.162 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T21:58:28.185 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:28.222 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T21:58:28.225 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:28.249 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T21:58:28.278 INFO:teuthology.orchestra.run.smithi081.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T21:58:28.280 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T21:58:28.314 INFO:teuthology.orchestra.run.smithi081.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T21:58:28.319 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T21:58:28.401 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T21:58:28.406 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T21:58:28.471 INFO:teuthology.orchestra.run.smithi081.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T21:58:28.493 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T21:58:28.513 INFO:teuthology.orchestra.run.smithi081.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T21:58:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T21:58:28.612 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-common. 2024-04-25T21:58:28.616 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librados2. 2024-04-25T21:58:28.638 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:28.643 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../007-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:28.648 INFO:teuthology.orchestra.run.smithi081.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T21:58:28.678 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:28.683 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:28.821 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T21:58:28.848 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T21:58:28.888 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T21:58:29.119 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librbd1. 2024-04-25T21:58:29.146 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../008-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:29.182 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T21:58:29.185 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:29.209 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T21:58:29.249 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T21:58:29.638 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T21:58:29.665 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:29.705 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:29.719 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T21:58:29.746 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T21:58:29.794 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:58:30.017 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-base. 2024-04-25T21:58:30.043 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:30.091 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rados. 2024-04-25T21:58:30.093 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:30.107 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:30.141 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:30.339 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T21:58:30.366 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T21:58:30.447 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:58:30.452 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T21:58:30.478 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:58:30.518 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:30.529 INFO:teuthology.orchestra.run.smithi081.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T21:58:30.532 INFO:teuthology.orchestra.run.smithi081.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T21:58:30.538 INFO:teuthology.orchestra.run.smithi081.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T21:58:30.539 INFO:teuthology.orchestra.run.smithi081.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T21:58:30.721 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T21:58:30.748 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T21:58:30.771 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T21:58:30.779 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T21:58:30.787 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:30.809 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T21:58:30.829 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:30.836 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T21:58:30.875 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:58:31.074 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T21:58:31.101 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T21:58:31.140 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T21:58:31.140 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T21:58:31.166 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:58:31.170 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T21:58:31.198 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T21:58:31.206 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:31.237 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T21:58:31.377 INFO:teuthology.orchestra.run.smithi081.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T21:58:31.468 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T21:58:31.495 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T21:58:31.534 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T21:58:31.535 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T21:58:31.556 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librados2. 2024-04-25T21:58:31.561 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T21:58:31.583 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../007-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:31.601 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T21:58:31.623 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:31.846 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T21:58:31.873 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T21:58:31.887 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T21:58:31.913 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T21:58:31.914 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T21:58:31.945 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T21:58:32.101 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librbd1. 2024-04-25T21:58:32.128 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../008-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:32.157 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T21:58:32.167 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:32.184 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T21:58:32.214 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T21:58:32.224 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T21:58:32.231 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:32.273 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:32.510 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T21:58:32.536 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T21:58:32.576 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T21:58:32.579 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T21:58:32.606 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:32.626 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T21:58:32.637 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:32.652 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T21:58:32.692 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T21:58:32.861 INFO:teuthology.orchestra.run.smithi081.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T21:58:32.879 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-portend. 2024-04-25T21:58:32.895 INFO:teuthology.orchestra.run.smithi081.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T21:58:32.898 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rados. 2024-04-25T21:58:32.906 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-25T21:58:32.925 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:32.946 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T21:58:32.961 INFO:teuthology.orchestra.run.smithi081.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T21:58:32.964 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:33.078 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T21:58:33.094 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T21:58:33.136 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T21:58:33.301 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T21:58:33.328 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:58:33.367 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:33.439 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T21:58:33.455 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T21:58:33.497 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T21:58:33.507 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T21:58:33.533 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T21:58:33.565 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T21:58:33.620 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T21:58:33.636 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:33.678 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:33.793 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package lua5.1. 2024-04-25T21:58:33.820 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T21:58:33.835 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T21:58:33.850 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T21:58:33.861 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T21:58:33.881 INFO:teuthology.orchestra.run.smithi081.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T21:58:33.882 INFO:teuthology.orchestra.run.smithi081.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T21:58:33.901 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T21:58:33.939 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T21:58:33.953 INFO:teuthology.orchestra.run.smithi081.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T21:58:33.955 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:58:33.957 INFO:teuthology.orchestra.run.smithi081.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T21:58:33.962 INFO:teuthology.orchestra.run.smithi081.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T21:58:33.968 INFO:teuthology.orchestra.run.smithi081.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T21:58:33.972 INFO:teuthology.orchestra.run.smithi081.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T21:58:33.989 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:34.145 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package lua-any. 2024-04-25T21:58:34.162 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-25T21:58:34.203 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T21:58:34.247 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T21:58:34.273 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T21:58:34.305 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T21:58:34.317 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T21:58:34.345 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T21:58:34.384 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T21:58:34.447 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package zip. 2024-04-25T21:58:34.474 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-25T21:58:34.514 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T21:58:34.591 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T21:58:34.617 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T21:58:34.658 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T21:58:34.703 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T21:58:34.730 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T21:58:34.770 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T21:58:34.799 INFO:teuthology.orchestra.run.smithi081.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T21:58:34.826 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package unzip. 2024-04-25T21:58:34.853 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T21:58:34.892 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T21:58:34.977 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T21:58:35.004 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T21:58:35.005 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T21:58:35.022 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:35.044 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T21:58:35.056 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:35.237 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package luarocks. 2024-04-25T21:58:35.250 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T21:58:35.279 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T21:58:35.334 INFO:teuthology.orchestra.run.smithi081.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T21:58:35.355 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-mako. 2024-04-25T21:58:35.370 INFO:teuthology.orchestra.run.smithi081.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T21:58:35.382 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T21:58:35.422 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T21:58:35.456 INFO:teuthology.orchestra.run.smithi081.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T21:58:35.467 INFO:teuthology.orchestra.run.smithi081.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T21:58:35.534 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T21:58:35.561 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T21:58:35.592 INFO:teuthology.orchestra.run.smithi081.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T21:58:35.600 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T21:58:35.612 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librgw2. 2024-04-25T21:58:35.638 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../025-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:35.640 INFO:teuthology.orchestra.run.smithi081.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T21:58:35.654 INFO:teuthology.orchestra.run.smithi081.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T21:58:35.660 INFO:teuthology.orchestra.run.smithi081.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T21:58:35.678 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:35.714 INFO:teuthology.orchestra.run.smithi081.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T21:58:35.717 INFO:teuthology.orchestra.run.smithi081.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T21:58:35.742 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T21:58:35.768 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T21:58:35.808 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T21:58:35.912 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T21:58:35.939 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T21:58:35.978 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T21:58:36.069 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T21:58:36.095 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T21:58:36.136 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T21:58:36.230 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T21:58:36.246 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:36.260 INFO:teuthology.orchestra.run.smithi081.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T21:58:36.281 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T21:58:36.288 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:36.308 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T21:58:36.345 INFO:teuthology.orchestra.run.smithi081.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T21:58:36.347 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T21:58:36.422 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-webob. 2024-04-25T21:58:36.448 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T21:58:36.488 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T21:58:36.519 INFO:teuthology.orchestra.run.smithi081.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T21:58:36.551 INFO:teuthology.orchestra.run.smithi081.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T21:58:36.633 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T21:58:36.660 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua5.1. 2024-04-25T21:58:36.660 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T21:58:36.687 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T21:58:36.700 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T21:58:36.708 INFO:teuthology.orchestra.run.smithi081.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T21:58:36.726 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T21:58:36.762 INFO:teuthology.orchestra.run.smithi081.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T21:58:36.841 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T21:58:36.868 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T21:58:36.912 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T21:58:36.994 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T21:58:37.021 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:37.046 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua-any. 2024-04-25T21:58:37.052 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:37.073 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-25T21:58:37.112 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T21:58:37.219 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T21:58:37.246 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T21:58:37.286 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T21:58:37.365 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package zip. 2024-04-25T21:58:37.381 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-25T21:58:37.423 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T21:58:37.439 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-common. 2024-04-25T21:58:37.466 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:37.497 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:37.597 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-paste. 2024-04-25T21:58:37.623 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T21:58:37.664 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T21:58:37.710 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package unzip. 2024-04-25T21:58:37.737 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T21:58:37.768 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T21:58:37.994 INFO:teuthology.orchestra.run.smithi081.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T21:58:38.000 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T21:58:38.027 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T21:58:38.053 INFO:teuthology.orchestra.run.smithi081.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T21:58:38.067 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T21:58:38.069 INFO:teuthology.orchestra.run.smithi081.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T21:58:38.164 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package luarocks. 2024-04-25T21:58:38.191 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T21:58:38.230 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T21:58:38.395 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T21:58:38.421 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T21:58:38.461 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T21:58:38.466 INFO:teuthology.orchestra.run.smithi081.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T21:58:38.566 INFO:teuthology.orchestra.run.smithi081.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T21:58:38.571 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librgw2. 2024-04-25T21:58:38.589 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../025-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:38.621 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:38.722 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T21:58:38.738 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T21:58:38.772 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T21:58:39.075 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T21:58:39.102 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T21:58:39.142 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T21:58:39.169 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-base. 2024-04-25T21:58:39.185 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:39.236 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:39.472 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T21:58:39.487 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T21:58:39.522 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T21:58:39.823 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T21:58:39.833 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-idna. 2024-04-25T21:58:39.849 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T21:58:39.860 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-25T21:58:39.889 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T21:58:39.899 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T21:58:39.999 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T21:58:40.015 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:40.049 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:40.192 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T21:58:40.219 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T21:58:40.259 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T21:58:40.386 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T21:58:40.413 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T21:58:40.452 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T21:58:40.595 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T21:58:40.622 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T21:58:40.661 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T21:58:40.939 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T21:58:40.966 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T21:58:40.980 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T21:58:40.997 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T21:58:41.004 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:41.039 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:41.103 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T21:58:41.130 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T21:58:41.169 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T21:58:41.309 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T21:58:41.336 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T21:58:41.375 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T21:58:41.442 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 179 MB in 34s (5,241 kB/s) 2024-04-25T21:58:41.467 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-common. 2024-04-25T21:58:41.494 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:41.506 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-requests. 2024-04-25T21:58:41.533 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T21:58:41.533 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:41.564 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T21:58:41.572 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T21:58:41.653 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T21:58:41.661 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T21:58:41.667 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T21:58:41.679 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T21:58:41.711 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T21:58:41.762 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T21:58:41.900 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T21:58:41.927 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T21:58:41.967 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T21:58:41.989 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-portend. 2024-04-25T21:58:42.016 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-25T21:58:42.055 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T21:58:42.074 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T21:58:42.101 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T21:58:42.140 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T21:58:42.253 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T21:58:42.280 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:58:42.320 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:42.358 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T21:58:42.385 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T21:58:42.425 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T21:58:42.485 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T21:58:42.512 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T21:58:42.552 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T21:58:42.711 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T21:58:42.711 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T21:58:42.738 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:42.738 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T21:58:42.777 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:42.777 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T21:58:42.914 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T21:58:42.922 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-base. 2024-04-25T21:58:42.941 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T21:58:42.949 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:42.980 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:58:42.998 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:43.088 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T21:58:43.115 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T21:58:43.155 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T21:58:43.342 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T21:58:43.369 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T21:58:43.408 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:58:43.442 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T21:58:43.468 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T21:58:43.500 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T21:58:43.577 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T21:58:43.604 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T21:58:43.643 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T21:58:43.745 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T21:58:43.772 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T21:58:43.811 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:58:43.828 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T21:58:43.840 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T21:58:43.855 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:43.867 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T21:58:43.894 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:43.906 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T21:58:43.946 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T21:58:43.974 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T21:58:44.013 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T21:58:44.131 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T21:58:44.147 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T21:58:44.181 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T21:58:44.193 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T21:58:44.220 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T21:58:44.259 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T21:58:44.298 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T21:58:44.325 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:44.341 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T21:58:44.365 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:44.368 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T21:58:44.407 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T21:58:44.484 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librados2. 2024-04-25T21:58:44.511 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../007-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:44.550 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:44.562 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T21:58:44.589 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T21:58:44.628 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T21:58:44.685 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T21:58:44.702 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T21:58:44.735 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T21:58:44.931 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-mako. 2024-04-25T21:58:44.952 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T21:58:44.958 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T21:58:44.978 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:44.997 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T21:58:45.010 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:45.013 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T21:58:45.028 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librbd1. 2024-04-25T21:58:45.040 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T21:58:45.055 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../008-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:45.079 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T21:58:45.095 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:45.334 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T21:58:45.361 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T21:58:45.382 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T21:58:45.401 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T21:58:45.409 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T21:58:45.449 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T21:58:45.565 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T21:58:45.591 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:45.631 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:45.662 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T21:58:45.689 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T21:58:45.720 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T21:58:45.752 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-portend. 2024-04-25T21:58:45.779 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-25T21:58:45.819 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T21:58:45.867 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rados. 2024-04-25T21:58:45.880 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:45.908 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:46.022 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webob. 2024-04-25T21:58:46.049 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T21:58:46.065 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T21:58:46.066 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph. 2024-04-25T21:58:46.089 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T21:58:46.090 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../066-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:46.093 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T21:58:46.139 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:46.228 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T21:58:46.255 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:58:46.272 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T21:58:46.295 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:46.459 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T21:58:46.467 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T21:58:46.486 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T21:58:46.493 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:46.529 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T21:58:46.533 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:46.547 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T21:58:46.574 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:46.575 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T21:58:46.602 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T21:58:46.614 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:46.641 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T21:58:46.837 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T21:58:46.863 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T21:58:46.903 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T21:58:46.903 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T21:58:46.908 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T21:58:46.930 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:46.935 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:58:46.970 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:46.978 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T21:58:46.983 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:47.006 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T21:58:47.044 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T21:58:47.206 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-paste. 2024-04-25T21:58:47.233 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T21:58:47.270 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T21:58:47.272 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T21:58:47.296 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T21:58:47.328 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T21:58:47.340 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package cephadm. 2024-04-25T21:58:47.366 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../069-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:47.381 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T21:58:47.406 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:47.408 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T21:58:47.448 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T21:58:47.601 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T21:58:47.622 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T21:58:47.627 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T21:58:47.649 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T21:58:47.667 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T21:58:47.689 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T21:58:47.726 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T21:58:47.752 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T21:58:47.792 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T21:58:47.867 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T21:58:47.894 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T21:58:47.934 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T21:58:47.950 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T21:58:47.969 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T21:58:47.976 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:47.997 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T21:58:48.016 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:48.036 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T21:58:48.103 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T21:58:48.119 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T21:58:48.162 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T21:58:48.187 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-mako. 2024-04-25T21:58:48.214 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T21:58:48.245 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T21:58:48.328 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T21:58:48.331 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T21:58:48.343 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T21:58:48.358 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T21:58:48.378 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T21:58:48.557 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T21:58:48.564 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T21:58:48.584 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T21:58:48.613 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T21:58:48.623 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T21:58:48.629 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T21:58:48.663 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T21:58:48.825 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T21:58:48.852 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T21:58:48.892 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T21:58:48.909 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T21:58:48.937 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T21:58:48.975 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T21:58:48.975 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T21:58:48.990 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T21:58:49.033 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T21:58:49.221 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T21:58:49.237 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T21:58:49.271 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T21:58:49.295 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-webob. 2024-04-25T21:58:49.323 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T21:58:49.362 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package lua5.1. 2024-04-25T21:58:49.363 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T21:58:49.368 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-babel. 2024-04-25T21:58:49.388 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T21:58:49.394 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T21:58:49.425 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T21:58:49.428 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T21:58:49.599 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-idna. 2024-04-25T21:58:49.626 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-25T21:58:49.665 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T21:58:49.682 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T21:58:49.709 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T21:58:49.739 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package lua-any. 2024-04-25T21:58:49.751 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T21:58:49.754 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T21:58:49.757 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-25T21:58:49.781 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T21:58:49.798 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T21:58:49.820 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T21:58:49.977 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T21:58:49.991 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package zip. 2024-04-25T21:58:50.005 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T21:58:50.007 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-25T21:58:50.009 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T21:58:50.026 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T21:58:50.042 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T21:58:50.043 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T21:58:50.059 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T21:58:50.165 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T21:58:50.193 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:58:50.232 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:50.337 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package unzip. 2024-04-25T21:58:50.362 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-paste. 2024-04-25T21:58:50.363 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-requests. 2024-04-25T21:58:50.363 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T21:58:50.390 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T21:58:50.390 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T21:58:50.403 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T21:58:50.429 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T21:58:50.430 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T21:58:50.578 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T21:58:50.604 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T21:58:50.644 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T21:58:50.716 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T21:58:50.724 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T21:58:50.743 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T21:58:50.748 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T21:58:50.774 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package luarocks. 2024-04-25T21:58:50.782 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T21:58:50.783 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T21:58:50.800 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T21:58:50.840 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T21:58:50.947 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-routes. 2024-04-25T21:58:50.974 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T21:58:51.021 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T21:58:51.060 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T21:58:51.077 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:58:51.077 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T21:58:51.104 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T21:58:51.110 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:51.143 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T21:58:51.206 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librgw2. 2024-04-25T21:58:51.233 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../025-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:51.273 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:51.342 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T21:58:51.369 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:58:51.417 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:51.480 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T21:58:51.490 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T21:58:51.507 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T21:58:51.517 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:51.546 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T21:58:51.556 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:51.800 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T21:58:51.815 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:51.857 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T21:58:51.858 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:51.876 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T21:58:51.885 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T21:58:51.903 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T21:58:51.924 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T21:58:51.942 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T21:58:52.189 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T21:58:52.213 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T21:58:52.215 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T21:58:52.228 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T21:58:52.231 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T21:58:52.255 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T21:58:52.258 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T21:58:52.261 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T21:58:52.289 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T21:58:52.564 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T21:58:52.583 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T21:58:52.592 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:52.609 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:52.617 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-idna. 2024-04-25T21:58:52.631 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:52.644 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-25T21:58:52.650 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:52.683 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T21:58:52.722 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T21:58:52.749 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T21:58:52.814 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T21:58:52.995 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T21:58:53.022 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T21:58:53.053 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-common. 2024-04-25T21:58:53.059 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T21:58:53.061 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T21:58:53.078 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:53.086 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:53.119 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:53.125 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:53.318 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T21:58:53.345 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T21:58:53.384 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T21:58:53.390 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-requests. 2024-04-25T21:58:53.417 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T21:58:53.456 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T21:58:53.737 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T21:58:53.738 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T21:58:53.765 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:53.765 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T21:58:53.767 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T21:58:53.791 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T21:58:53.803 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:53.804 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T21:58:53.825 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T21:58:54.074 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T21:58:54.101 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T21:58:54.120 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T21:58:54.132 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T21:58:54.136 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:58:54.179 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:54.451 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-base. 2024-04-25T21:58:54.477 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:54.526 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:54.600 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T21:58:54.628 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:54.667 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:54.783 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T21:58:54.811 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:58:54.883 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph. 2024-04-25T21:58:54.898 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../066-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:54.936 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:54.940 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:54.987 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T21:58:55.014 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T21:58:55.095 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T21:58:55.122 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T21:58:55.148 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T21:58:55.188 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T21:58:55.268 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T21:58:55.296 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:55.334 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:55.398 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T21:58:55.425 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T21:58:55.464 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T21:58:55.482 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T21:58:55.509 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T21:58:55.541 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T21:58:55.704 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T21:58:55.731 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:55.770 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:55.818 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T21:58:55.845 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:55.884 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:55.923 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T21:58:55.951 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T21:58:55.990 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T21:58:56.119 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T21:58:56.145 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T21:58:56.148 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephadm. 2024-04-25T21:58:56.176 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../069-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:56.177 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T21:58:56.207 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:56.246 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T21:58:56.273 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:56.293 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T21:58:56.320 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T21:58:56.359 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T21:58:56.452 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:56.472 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T21:58:56.498 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T21:58:56.501 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T21:58:56.528 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T21:58:56.538 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T21:58:56.567 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T21:58:56.713 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T21:58:56.740 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T21:58:56.780 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T21:58:56.825 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T21:58:56.851 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T21:58:56.878 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T21:58:56.891 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T21:58:56.894 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T21:58:56.936 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T21:58:56.982 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T21:58:57.010 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:57.033 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T21:58:57.040 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:57.060 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-25T21:58:57.091 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T21:58:57.194 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T21:58:57.220 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T21:58:57.260 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T21:58:57.412 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T21:58:57.439 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T21:58:57.478 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T21:58:57.522 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-portend. 2024-04-25T21:58:57.548 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-25T21:58:57.580 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T21:58:57.790 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T21:58:57.817 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T21:58:57.857 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T21:58:57.883 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T21:58:57.909 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T21:58:57.950 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T21:58:57.957 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-babel. 2024-04-25T21:58:57.974 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T21:58:58.007 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T21:58:58.127 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph. 2024-04-25T21:58:58.143 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../066-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:58.168 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T21:58:58.185 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:58.195 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T21:58:58.227 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T21:58:58.235 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T21:58:58.243 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T21:58:58.278 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T21:58:58.278 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T21:58:58.305 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T21:58:58.344 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T21:58:58.513 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T21:58:58.514 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T21:58:58.541 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T21:58:58.541 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:58.572 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T21:58:58.580 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:58.615 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T21:58:58.641 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T21:58:58.681 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T21:58:58.872 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T21:58:58.899 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:58:58.938 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:58.966 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T21:58:58.993 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T21:58:58.994 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:59.019 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T21:58:59.024 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:59.059 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T21:58:59.228 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T21:58:59.256 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:58:59.361 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:59.491 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T21:58:59.519 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T21:58:59.520 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T21:58:59.544 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package cephadm. 2024-04-25T21:58:59.547 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T21:58:59.557 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T21:58:59.572 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../069-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:58:59.587 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T21:58:59.610 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:58:59.681 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T21:58:59.708 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T21:58:59.747 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T21:58:59.854 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-routes. 2024-04-25T21:58:59.863 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T21:58:59.882 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T21:58:59.891 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T21:58:59.907 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-mako. 2024-04-25T21:58:59.921 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T21:58:59.921 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T21:58:59.933 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T21:58:59.973 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T21:59:00.168 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T21:59:00.195 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T21:59:00.242 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T21:59:00.249 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T21:59:00.249 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T21:59:00.276 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:59:00.277 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T21:59:00.277 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T21:59:00.303 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T21:59:00.307 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T21:59:00.315 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:00.343 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T21:59:00.562 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package jq. 2024-04-25T21:59:00.589 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T21:59:00.612 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T21:59:00.628 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T21:59:00.639 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T21:59:00.671 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T21:59:00.881 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package socat. 2024-04-25T21:59:00.897 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T21:59:00.940 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T21:59:00.957 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webob. 2024-04-25T21:59:00.983 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T21:59:01.023 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T21:59:01.252 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T21:59:01.279 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T21:59:01.318 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T21:59:01.362 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-babel. 2024-04-25T21:59:01.391 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T21:59:01.429 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T21:59:01.510 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T21:59:01.536 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T21:59:01.545 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T21:59:01.561 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T21:59:01.579 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T21:59:01.595 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T21:59:01.649 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-test. 2024-04-25T21:59:01.663 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:01.706 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:01.757 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T21:59:01.785 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T21:59:01.824 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T21:59:01.888 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T21:59:01.914 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T21:59:01.954 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T21:59:02.057 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T21:59:02.084 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T21:59:02.115 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T21:59:02.177 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T21:59:02.205 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:59:02.233 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-paste. 2024-04-25T21:59:02.243 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:02.259 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T21:59:02.299 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T21:59:02.476 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T21:59:02.493 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T21:59:02.534 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T21:59:02.597 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T21:59:02.611 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T21:59:02.625 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T21:59:02.637 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T21:59:02.663 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T21:59:02.677 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T21:59:02.821 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T21:59:02.848 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T21:59:02.880 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T21:59:02.955 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T21:59:02.982 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T21:59:02.991 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-routes. 2024-04-25T21:59:03.019 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T21:59:03.030 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T21:59:03.057 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T21:59:03.358 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T21:59:03.385 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T21:59:03.394 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T21:59:03.422 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:59:03.441 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T21:59:03.461 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:03.537 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T21:59:03.554 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:59:03.680 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:03.753 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T21:59:03.780 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T21:59:03.819 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T21:59:04.027 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T21:59:04.055 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:59:04.094 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:04.183 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T21:59:04.209 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T21:59:04.249 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T21:59:04.552 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-idna. 2024-04-25T21:59:04.579 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-25T21:59:04.610 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T21:59:04.651 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T21:59:04.678 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T21:59:04.690 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T21:59:04.717 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T21:59:04.717 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:04.741 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T21:59:04.756 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:04.769 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T21:59:04.807 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T21:59:04.897 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T21:59:04.923 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T21:59:04.963 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T21:59:04.995 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T21:59:05.023 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T21:59:05.051 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T21:59:05.053 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T21:59:05.067 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T21:59:05.101 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T21:59:05.275 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests. 2024-04-25T21:59:05.302 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T21:59:05.302 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T21:59:05.318 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T21:59:05.341 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T21:59:05.352 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T21:59:05.414 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T21:59:05.415 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T21:59:05.429 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T21:59:05.442 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T21:59:05.481 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T21:59:05.481 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T21:59:05.653 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T21:59:05.679 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T21:59:05.698 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T21:59:05.719 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T21:59:05.725 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T21:59:05.764 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T21:59:05.784 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T21:59:05.812 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-25T21:59:05.850 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T21:59:05.861 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T21:59:05.887 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T21:59:05.926 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T21:59:06.014 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T21:59:06.041 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:59:06.075 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T21:59:06.081 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:06.103 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T21:59:06.142 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T21:59:06.174 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T21:59:06.199 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T21:59:06.237 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T21:59:06.357 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package pkg-config. 2024-04-25T21:59:06.385 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T21:59:06.424 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T21:59:06.436 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T21:59:06.463 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:06.502 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:06.557 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T21:59:06.586 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T21:59:06.623 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T21:59:06.635 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T21:59:06.651 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T21:59:06.693 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T21:59:06.806 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T21:59:06.832 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T21:59:06.842 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T21:59:06.871 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:59:06.872 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T21:59:06.910 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T21:59:06.937 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T21:59:06.976 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T21:59:07.002 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:07.088 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T21:59:07.116 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T21:59:07.146 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T21:59:07.175 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T21:59:07.202 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T21:59:07.241 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T21:59:07.263 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T21:59:07.291 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T21:59:07.321 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T21:59:07.475 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T21:59:07.502 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T21:59:07.541 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T21:59:07.578 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T21:59:07.605 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:07.644 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:07.862 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T21:59:07.889 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T21:59:07.928 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T21:59:07.976 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T21:59:07.989 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T21:59:07.990 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:59:08.016 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:08.034 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:08.047 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:08.048 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T21:59:08.076 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T21:59:08.114 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T21:59:08.248 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T21:59:08.276 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T21:59:08.315 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T21:59:08.359 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T21:59:08.371 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T21:59:08.387 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T21:59:08.398 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T21:59:08.417 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T21:59:08.437 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T21:59:08.618 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-py. 2024-04-25T21:59:08.645 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-25T21:59:08.659 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T21:59:08.684 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T21:59:08.686 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:08.720 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T21:59:08.726 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:08.749 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T21:59:08.787 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T21:59:08.790 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T21:59:08.819 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T21:59:09.004 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T21:59:09.032 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T21:59:09.040 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T21:59:09.071 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T21:59:09.073 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T21:59:09.102 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-25T21:59:09.131 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T21:59:09.276 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package jq. 2024-04-25T21:59:09.292 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T21:59:09.325 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T21:59:09.427 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T21:59:09.455 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T21:59:09.484 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T21:59:09.493 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T21:59:09.512 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T21:59:09.542 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T21:59:09.553 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package socat. 2024-04-25T21:59:09.581 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T21:59:09.637 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T21:59:09.762 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph. 2024-04-25T21:59:09.778 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../066-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:09.796 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T21:59:09.821 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:09.824 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T21:59:09.863 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T21:59:09.870 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-toml. 2024-04-25T21:59:09.898 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-25T21:59:09.937 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T21:59:09.948 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T21:59:09.976 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T21:59:10.014 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T21:59:10.107 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T21:59:10.123 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:10.157 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:10.191 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T21:59:10.219 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T21:59:10.248 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T21:59:10.258 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T21:59:10.276 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T21:59:10.315 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T21:59:10.377 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-test. 2024-04-25T21:59:10.393 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:10.443 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:10.535 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T21:59:10.562 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:10.595 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T21:59:10.601 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:10.622 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T21:59:10.652 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T21:59:10.661 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T21:59:10.681 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T21:59:10.718 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T21:59:10.996 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephadm. 2024-04-25T21:59:11.013 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T21:59:11.023 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../069-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:11.041 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T21:59:11.062 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:11.079 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T21:59:11.357 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T21:59:11.384 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T21:59:11.417 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T21:59:11.424 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T21:59:11.434 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:59:11.475 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:11.735 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T21:59:11.750 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T21:59:11.793 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T21:59:11.811 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T21:59:11.839 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T21:59:11.850 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package radosgw. 2024-04-25T21:59:11.877 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T21:59:11.878 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../116-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:11.917 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:12.473 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T21:59:12.500 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T21:59:12.539 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T21:59:12.695 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T21:59:12.711 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:12.753 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:12.800 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package jq. 2024-04-25T21:59:12.828 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T21:59:12.839 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T21:59:12.849 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-babel. 2024-04-25T21:59:12.866 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T21:59:12.867 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:59:12.875 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T21:59:12.914 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:12.915 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T21:59:13.050 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T21:59:13.094 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package socat. 2024-04-25T21:59:13.112 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T21:59:13.152 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T21:59:13.243 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T21:59:13.268 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T21:59:13.270 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T21:59:13.296 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:13.309 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T21:59:13.309 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T21:59:13.342 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:13.435 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T21:59:13.455 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T21:59:13.472 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T21:59:13.514 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T21:59:13.654 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T21:59:13.682 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:59:13.698 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T21:59:13.712 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T21:59:13.720 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:13.740 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T21:59:13.787 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T21:59:13.876 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-test. 2024-04-25T21:59:13.893 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:13.926 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:14.055 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T21:59:14.091 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T21:59:14.118 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T21:59:14.133 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T21:59:14.157 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T21:59:14.161 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T21:59:14.207 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T21:59:14.460 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-routes. 2024-04-25T21:59:14.488 INFO:teuthology.orchestra.run.smithi079.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T21:59:14.488 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T21:59:14.527 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T21:59:14.578 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:14.604 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T21:59:14.632 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T21:59:14.678 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T21:59:14.880 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T21:59:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:59:14.946 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:15.046 INFO:teuthology.orchestra.run.smithi079.stdout:Adding system user cephadm....done 2024-04-25T21:59:15.108 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package pkg-config. 2024-04-25T21:59:15.136 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T21:59:15.174 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T21:59:15.202 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T21:59:15.427 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T21:59:15.455 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T21:59:15.494 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T21:59:15.495 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T21:59:15.788 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T21:59:15.914 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T21:59:15.939 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T21:59:15.967 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T21:59:16.005 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T21:59:16.102 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T21:59:16.118 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T21:59:16.152 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T21:59:16.166 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T21:59:16.181 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T21:59:16.209 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:59:16.239 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:16.324 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T21:59:16.352 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T21:59:16.399 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T21:59:16.417 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T21:59:16.493 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T21:59:16.521 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:16.543 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T21:59:16.551 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:16.786 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T21:59:16.789 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T21:59:16.814 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T21:59:16.816 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T21:59:16.847 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T21:59:16.853 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T21:59:16.862 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T21:59:16.869 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T21:59:16.890 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T21:59:16.929 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T21:59:17.172 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T21:59:17.200 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T21:59:17.226 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T21:59:17.238 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T21:59:17.253 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T21:59:17.264 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T21:59:17.267 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T21:59:17.292 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T21:59:17.295 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T21:59:17.350 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T21:59:17.541 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T21:59:17.553 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T21:59:17.566 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-py. 2024-04-25T21:59:17.581 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T21:59:17.594 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-25T21:59:17.620 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T21:59:17.632 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T21:59:17.679 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T21:59:17.707 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T21:59:17.737 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T21:59:17.808 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T21:59:17.978 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T21:59:18.006 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T21:59:18.044 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T21:59:18.060 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T21:59:18.159 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package pkg-config. 2024-04-25T21:59:18.188 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T21:59:18.217 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T21:59:18.295 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T21:59:18.323 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:59:18.336 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T21:59:18.447 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:18.470 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T21:59:18.487 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T21:59:18.506 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T21:59:18.523 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T21:59:18.528 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T21:59:18.556 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T21:59:18.587 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T21:59:18.825 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-toml. 2024-04-25T21:59:18.854 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-25T21:59:18.855 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:18.892 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T21:59:18.923 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T21:59:18.952 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T21:59:18.990 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T21:59:19.195 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T21:59:19.223 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T21:59:19.240 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T21:59:19.251 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T21:59:19.261 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T21:59:19.279 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T21:59:19.310 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T21:59:19.366 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T21:59:19.426 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T21:59:19.454 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T21:59:19.492 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T21:59:19.493 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T21:59:19.612 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T21:59:19.618 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T21:59:19.641 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T21:59:19.679 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T21:59:19.795 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T21:59:19.823 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T21:59:19.856 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T21:59:19.861 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T21:59:19.884 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T21:59:19.886 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T21:59:19.922 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T21:59:19.990 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T21:59:20.019 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T21:59:20.057 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T21:59:20.191 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T21:59:20.199 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T21:59:20.208 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T21:59:20.226 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T21:59:20.250 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T21:59:20.265 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T21:59:20.385 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-py. 2024-04-25T21:59:20.413 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-25T21:59:20.451 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T21:59:20.465 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T21:59:20.560 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T21:59:20.577 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T21:59:20.604 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-25T21:59:20.615 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T21:59:20.643 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T21:59:20.741 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T21:59:20.746 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T21:59:20.775 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T21:59:20.804 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T21:59:20.914 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T21:59:20.941 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T21:59:20.980 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T21:59:20.995 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package radosgw. 2024-04-25T21:59:21.024 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../116-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:21.062 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:21.117 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T21:59:21.243 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T21:59:21.267 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T21:59:21.296 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T21:59:21.317 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T21:59:21.333 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T21:59:21.344 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T21:59:21.383 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T21:59:21.528 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T21:59:21.636 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-toml. 2024-04-25T21:59:21.665 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-25T21:59:21.702 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T21:59:21.711 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T21:59:21.739 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T21:59:21.778 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T21:59:21.823 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T21:59:21.973 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T21:59:21.990 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:22.014 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T21:59:22.023 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:22.042 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T21:59:22.080 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T21:59:22.098 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T21:59:22.126 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T21:59:22.147 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T21:59:22.165 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T21:59:22.273 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T21:59:22.295 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T21:59:22.528 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T21:59:22.531 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T21:59:22.560 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T21:59:22.654 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T21:59:22.692 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T21:59:22.787 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T21:59:22.802 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:59:22.837 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:22.917 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T21:59:22.941 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T21:59:22.961 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T21:59:22.991 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T21:59:23.028 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T21:59:23.123 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T21:59:23.150 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T21:59:23.177 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T21:59:23.189 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T21:59:23.295 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T21:59:23.311 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T21:59:23.462 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T21:59:23.526 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T21:59:23.554 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T21:59:23.592 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T21:59:23.705 INFO:teuthology.orchestra.run.smithi057.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T21:59:23.732 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package radosgw. 2024-04-25T21:59:23.761 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../116-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:23.772 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T21:59:23.789 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:23.798 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:23.829 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package jq. 2024-04-25T21:59:23.856 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T21:59:23.895 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T21:59:24.123 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package socat. 2024-04-25T21:59:24.150 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T21:59:24.165 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T21:59:24.181 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T21:59:24.313 INFO:teuthology.orchestra.run.smithi057.stdout:Adding system user cephadm....done 2024-04-25T21:59:24.416 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T21:59:24.453 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T21:59:24.476 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T21:59:24.492 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T21:59:24.534 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T21:59:24.643 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T21:59:24.660 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:24.701 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:24.810 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T21:59:24.854 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T21:59:24.905 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-test. 2024-04-25T21:59:24.921 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:24.955 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:25.048 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T21:59:25.103 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T21:59:25.122 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T21:59:25.248 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T21:59:25.365 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T21:59:25.463 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T21:59:25.491 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T21:59:25.516 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T21:59:25.723 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T21:59:25.737 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T21:59:25.784 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T21:59:25.857 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:25.885 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T21:59:26.066 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T21:59:26.158 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T21:59:26.195 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T21:59:26.484 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T21:59:26.496 INFO:teuthology.orchestra.run.smithi044.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T21:59:26.560 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:26.580 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T21:59:26.840 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T21:59:27.068 INFO:teuthology.orchestra.run.smithi044.stdout:Adding system user cephadm....done 2024-04-25T21:59:27.124 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T21:59:27.224 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T21:59:27.360 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T21:59:27.384 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T21:59:27.387 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T21:59:27.426 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:27.501 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T21:59:27.635 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T21:59:27.659 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T21:59:27.706 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T21:59:27.733 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:27.743 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T21:59:27.772 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:27.894 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:59:27.911 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T21:59:28.004 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T21:59:28.091 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T21:59:28.094 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T21:59:28.119 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T21:59:28.158 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T21:59:28.178 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:28.272 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T21:59:28.354 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T21:59:28.415 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T21:59:28.455 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T21:59:28.504 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T21:59:28.532 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T21:59:28.549 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T21:59:28.570 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T21:59:28.580 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T21:59:28.614 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T21:59:28.707 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T21:59:28.740 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T21:59:28.833 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T21:59:28.842 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T21:59:28.917 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T21:59:28.945 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T21:59:28.983 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T21:59:29.041 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T21:59:29.092 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T21:59:29.127 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T21:59:29.363 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package pkg-config. 2024-04-25T21:59:29.388 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T21:59:29.395 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:59:29.402 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T21:59:29.430 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T21:59:29.452 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T21:59:29.496 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T21:59:29.498 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T21:59:29.554 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T21:59:29.658 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T21:59:29.661 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T21:59:29.674 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T21:59:29.679 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T21:59:29.716 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T21:59:29.798 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T21:59:29.929 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T21:59:30.047 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T21:59:30.057 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T21:59:30.111 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T21:59:30.139 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T21:59:30.169 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T21:59:30.173 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T21:59:30.206 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T21:59:30.317 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T21:59:30.430 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T21:59:30.440 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T21:59:30.458 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T21:59:30.482 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T21:59:30.488 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T21:59:30.593 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T21:59:30.708 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T21:59:30.750 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T21:59:30.794 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T21:59:30.821 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T21:59:30.860 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T21:59:30.861 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T21:59:31.042 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:31.043 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T21:59:31.137 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T21:59:31.144 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T21:59:31.172 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T21:59:31.199 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T21:59:31.238 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T21:59:31.255 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T21:59:31.293 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T21:59:31.411 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T21:59:31.531 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T21:59:31.537 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T21:59:31.574 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-py. 2024-04-25T21:59:31.602 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-25T21:59:31.641 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T21:59:31.657 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T21:59:31.663 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T21:59:31.829 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T21:59:31.922 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T21:59:31.950 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T21:59:32.003 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T21:59:32.030 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T21:59:32.069 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T21:59:32.088 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T21:59:32.214 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T21:59:32.252 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T21:59:32.300 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T21:59:32.329 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T21:59:32.340 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T21:59:32.393 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T21:59:32.519 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T21:59:32.519 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T21:59:32.641 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T21:59:32.674 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T21:59:32.707 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T21:59:32.735 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T21:59:32.773 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T21:59:32.822 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T21:59:32.903 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T21:59:32.928 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T21:59:33.001 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-toml. 2024-04-25T21:59:33.029 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-25T21:59:33.029 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T21:59:33.059 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T21:59:33.059 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T21:59:33.182 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T21:59:33.305 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T21:59:33.308 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T21:59:33.310 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T21:59:33.337 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T21:59:33.365 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T21:59:33.403 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T21:59:33.575 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T21:59:33.678 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T21:59:33.702 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T21:59:33.715 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T21:59:33.743 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T21:59:33.773 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T21:59:33.893 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T21:59:33.953 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T21:59:33.963 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T21:59:33.994 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T21:59:34.001 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T21:59:34.017 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T21:59:34.051 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T21:59:34.104 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T21:59:34.331 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T21:59:34.397 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:59:34.523 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T21:59:34.599 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T21:59:34.721 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T21:59:34.725 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:34.797 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package radosgw. 2024-04-25T21:59:34.825 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../116-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:34.849 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T21:59:34.855 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:34.989 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T21:59:35.115 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T21:59:35.159 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T21:59:35.241 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T21:59:35.251 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T21:59:35.435 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T21:59:35.542 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T21:59:35.560 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T21:59:35.666 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T21:59:35.682 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T21:59:35.725 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:35.813 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T21:59:35.927 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T21:59:36.029 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T21:59:36.105 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T21:59:36.170 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T21:59:36.288 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T21:59:36.380 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T21:59:36.398 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T21:59:36.563 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T21:59:36.631 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T21:59:36.743 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T21:59:36.757 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T21:59:36.856 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T21:59:36.936 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T21:59:37.017 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:59:37.120 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T21:59:37.151 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T21:59:37.208 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T21:59:37.356 INFO:teuthology.orchestra.run.smithi081.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T21:59:37.411 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T21:59:37.412 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T21:59:37.425 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:37.492 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T21:59:37.536 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T21:59:37.618 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:37.663 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T21:59:37.766 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T21:59:37.892 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:37.928 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T21:59:37.958 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user cephadm....done 2024-04-25T21:59:37.964 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T21:59:38.010 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:38.111 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T21:59:38.243 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T21:59:38.243 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T21:59:38.246 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T21:59:38.382 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T21:59:38.431 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:38.491 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:59:38.557 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:38.609 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T21:59:38.642 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T21:59:38.683 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T21:59:38.777 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T21:59:38.893 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T21:59:38.969 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:39.061 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T21:59:39.120 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:39.136 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T21:59:39.271 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:39.321 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T21:59:39.379 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T21:59:39.438 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T21:59:39.498 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T21:59:39.498 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T21:59:39.510 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T21:59:39.638 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T21:59:39.745 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:59:39.748 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T21:59:39.871 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T21:59:39.897 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T21:59:39.998 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:40.148 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T21:59:40.158 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:40.165 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T21:59:40.226 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T21:59:40.273 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T21:59:40.291 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T21:59:40.310 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:40.399 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T21:59:40.469 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T21:59:40.485 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T21:59:40.592 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T21:59:40.693 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T21:59:40.709 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T21:59:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T21:59:40.969 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T21:59:40.969 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T21:59:41.021 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T21:59:41.203 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:59:41.248 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T21:59:41.270 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T21:59:41.329 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T21:59:41.482 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T21:59:41.538 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T21:59:41.656 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T21:59:41.664 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T21:59:41.724 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:41.725 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:41.790 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T21:59:41.879 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T21:59:41.915 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T21:59:41.984 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T21:59:42.053 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:42.110 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T21:59:42.166 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T21:59:42.183 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T21:59:42.236 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T21:59:42.247 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:42.292 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T21:59:42.362 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T21:59:42.454 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T21:59:42.466 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:42.593 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:42.646 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T21:59:42.702 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T21:59:42.703 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T21:59:42.962 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T21:59:42.962 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T21:59:43.013 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T21:59:43.044 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T21:59:43.079 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T21:59:43.088 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T21:59:43.100 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T21:59:43.211 INFO:teuthology.orchestra.run.smithi079.stdout:Adding group ceph....done 2024-04-25T21:59:43.226 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T21:59:43.347 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:59:43.414 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T21:59:43.473 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T21:59:43.540 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T21:59:43.602 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T21:59:43.605 INFO:teuthology.orchestra.run.smithi079.stdout:Adding system user ceph....done 2024-04-25T21:59:43.714 INFO:teuthology.orchestra.run.smithi079.stdout:Setting system user ceph properties....done 2024-04-25T21:59:43.726 INFO:teuthology.orchestra.run.smithi079.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T21:59:43.728 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T21:59:43.799 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T21:59:43.833 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T21:59:43.867 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T21:59:44.004 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T21:59:44.108 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T21:59:44.151 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T21:59:44.171 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T21:59:44.255 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T21:59:44.376 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T21:59:44.411 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T21:59:44.477 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T21:59:44.512 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T21:59:44.557 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T21:59:44.613 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T21:59:44.654 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:44.682 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T21:59:44.701 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T21:59:44.753 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T21:59:44.780 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:44.931 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T21:59:45.029 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T21:59:45.082 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T21:59:45.243 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T21:59:45.243 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T21:59:45.351 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T21:59:45.382 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T21:59:45.484 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T21:59:45.636 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T21:59:45.690 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:45.743 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T21:59:45.762 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T21:59:45.775 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T21:59:45.861 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T21:59:45.879 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T21:59:46.052 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T21:59:46.061 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T21:59:46.121 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:59:46.164 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T21:59:46.238 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T21:59:46.390 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T21:59:46.533 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:46.556 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T21:59:46.565 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T21:59:46.581 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:46.634 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:46.735 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T21:59:46.790 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T21:59:46.790 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T21:59:46.799 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T21:59:46.874 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T21:59:47.089 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:47.159 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T21:59:47.184 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T21:59:47.240 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:47.266 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:47.285 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T21:59:47.391 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T21:59:47.477 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T21:59:47.489 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T21:59:47.489 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T21:59:47.561 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T21:59:47.675 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:47.794 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:47.820 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T21:59:47.821 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T21:59:47.903 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:47.951 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:48.105 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T21:59:48.106 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T21:59:48.157 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T21:59:48.261 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T21:59:48.261 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T21:59:48.280 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T21:59:48.381 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:48.572 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:48.584 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T21:59:48.666 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T21:59:48.697 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:48.736 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:48.824 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:48.871 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:48.877 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T21:59:48.950 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T21:59:48.967 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T21:59:49.022 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:49.205 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T21:59:49.232 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T21:59:49.233 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T21:59:49.331 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:49.457 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:49.600 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T21:59:49.698 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:49.850 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:49.944 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:49.976 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:50.062 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:50.081 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T21:59:50.110 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:50.163 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T21:59:50.195 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:50.291 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:59:50.388 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:50.425 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T21:59:50.438 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T21:59:50.448 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:50.539 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:50.547 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T21:59:50.574 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:50.684 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T21:59:50.690 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:50.691 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:50.693 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T21:59:50.817 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:50.822 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T21:59:50.901 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T21:59:50.901 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T21:59:50.945 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T21:59:51.222 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T21:59:51.310 INFO:teuthology.orchestra.run.smithi057.stdout:Adding group ceph....done 2024-04-25T21:59:51.343 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:51.448 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T21:59:51.461 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:51.476 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T21:59:51.587 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:51.674 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:59:51.703 INFO:teuthology.orchestra.run.smithi057.stdout:Adding system user ceph....done 2024-04-25T21:59:51.713 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T21:59:51.791 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T21:59:51.863 INFO:teuthology.orchestra.run.smithi057.stdout:Setting system user ceph properties....done 2024-04-25T21:59:51.878 INFO:teuthology.orchestra.run.smithi057.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T21:59:52.026 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T21:59:52.093 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T21:59:52.101 INFO:teuthology.orchestra.run.smithi079.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T21:59:52.103 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-25T21:59:52.157 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-04-25T21:59:52.352 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T21:59:52.360 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-04-25T21:59:52.360 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-04-25T21:59:52.372 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T21:59:52.542 INFO:teuthology.orchestra.run.smithi079.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T21:59:52.542 INFO:teuthology.orchestra.run.smithi079.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T21:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T21:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T21:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T21:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T21:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T21:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T21:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T21:59:52.544 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2024-04-25T21:59:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-25T21:59:52.546 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2024-04-25T21:59:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: bison-doc flex-doc libssl-doc 2024-04-25T21:59:52.575 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2024-04-25T21:59:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-25T21:59:52.577 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages will be upgraded: 2024-04-25T21:59:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: libssl3 libuuid1 uuid-dev 2024-04-25T21:59:52.612 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T21:59:52.650 INFO:teuthology.orchestra.run.smithi079.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-25T21:59:52.650 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 5,495 kB of archives. 2024-04-25T21:59:52.651 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-25T21:59:52.651 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T21:59:52.819 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:52.859 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T21:59:52.863 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T21:59:52.920 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:52.992 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:53.101 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:53.106 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T21:59:53.165 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T21:59:53.166 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T21:59:53.167 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T21:59:53.183 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T21:59:53.184 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T21:59:53.187 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T21:59:53.189 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T21:59:53.189 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T21:59:53.203 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:53.328 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:53.340 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T21:59:53.392 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T21:59:53.392 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T21:59:53.454 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:53.499 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T21:59:53.784 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T21:59:53.837 INFO:teuthology.orchestra.run.smithi079.stdout:Preconfiguring packages ... 2024-04-25T21:59:53.881 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:53.926 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T21:59:53.930 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 5,495 kB in 1s (6,017 kB/s) 2024-04-25T21:59:54.014 INFO:teuthology.orchestra.run.smithi044.stdout:Adding group ceph....done 2024-04-25T21:59:54.083 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package flex. 2024-04-25T21:59:54.186 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173891 files and directories currently installed.) 2024-04-25T21:59:54.192 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T21:59:54.211 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T21:59:54.243 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T21:59:54.247 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T21:59:54.391 INFO:teuthology.orchestra.run.smithi044.stdout:Adding system user ceph....done 2024-04-25T21:59:54.521 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T21:59:54.559 INFO:teuthology.orchestra.run.smithi044.stdout:Setting system user ceph properties....done 2024-04-25T21:59:54.578 INFO:teuthology.orchestra.run.smithi044.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T21:59:54.699 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:54.722 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T21:59:54.763 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T21:59:54.773 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T21:59:54.864 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T21:59:54.928 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T21:59:54.928 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T21:59:54.937 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T21:59:54.965 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T21:59:55.039 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T21:59:55.056 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T21:59:55.275 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T21:59:55.349 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T21:59:55.402 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T21:59:55.422 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:55.531 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:55.646 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T21:59:55.646 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T21:59:55.657 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:55.798 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T21:59:55.876 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T21:59:55.881 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T21:59:55.987 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T21:59:56.046 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T21:59:56.086 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:56.121 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T21:59:56.122 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T21:59:56.172 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T21:59:56.366 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T21:59:56.367 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T21:59:56.398 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T21:59:56.413 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T21:59:56.524 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T21:59:56.544 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T21:59:56.576 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:56.833 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T21:59:56.871 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:56.889 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T21:59:56.914 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T21:59:56.997 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:57.134 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T21:59:57.148 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:57.263 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package bison. 2024-04-25T21:59:57.352 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:57.355 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T21:59:57.355 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T21:59:57.364 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T21:59:57.369 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T21:59:57.415 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T21:59:57.419 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T21:59:57.545 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T21:59:57.586 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T21:59:57.586 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T21:59:57.765 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T21:59:57.782 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T21:59:57.808 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:57.813 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T21:59:57.824 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T21:59:57.959 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:58.046 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:58.060 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:58.065 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T21:59:58.078 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T21:59:58.094 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T21:59:58.136 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T21:59:58.211 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:58.274 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T21:59:58.274 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T21:59:58.375 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T21:59:58.432 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T21:59:58.460 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T21:59:58.490 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T21:59:58.631 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T21:59:58.734 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T21:59:58.756 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:58.761 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T21:59:58.762 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T21:59:58.763 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T21:59:58.801 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T21:59:58.918 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T21:59:59.046 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T21:59:59.054 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T21:59:59.082 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T21:59:59.120 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T21:59:59.381 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T21:59:59.412 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T21:59:59.412 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T21:59:59.508 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:59.615 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T21:59:59.650 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T21:59:59.767 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T21:59:59.776 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T21:59:59.902 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T21:59:59.904 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:00.028 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:00:00.112 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:00.121 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:00.154 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:00:00.203 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:00:00.222 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:00.280 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:00:00.323 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T22:00:00.390 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:00.423 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:00:00.529 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T22:00:00.592 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:00:00.600 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:00.689 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:00:00.690 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:00:00.726 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:00.744 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:00:00.852 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:00.880 INFO:teuthology.orchestra.run.smithi057.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:00:00.883 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-25T22:00:00.903 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:00:00.935 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-25T22:00:01.072 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T22:00:01.073 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T22:00:01.105 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:01.136 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2024-04-25T22:00:01.137 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2024-04-25T22:00:01.256 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:01.317 INFO:teuthology.orchestra.run.smithi057.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T22:00:01.317 INFO:teuthology.orchestra.run.smithi057.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T22:00:01.317 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:00:01.317 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:00:01.317 INFO:teuthology.orchestra.run.smithi057.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:00:01.317 INFO:teuthology.orchestra.run.smithi057.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:00:01.317 INFO:teuthology.orchestra.run.smithi057.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:00:01.318 INFO:teuthology.orchestra.run.smithi057.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:00:01.318 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:00:01.318 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2024-04-25T22:00:01.318 INFO:teuthology.orchestra.run.smithi057.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-25T22:00:01.319 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2024-04-25T22:00:01.319 INFO:teuthology.orchestra.run.smithi057.stdout: bison-doc flex-doc libssl-doc 2024-04-25T22:00:01.350 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2024-04-25T22:00:01.351 INFO:teuthology.orchestra.run.smithi057.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-25T22:00:01.352 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2024-04-25T22:00:01.352 INFO:teuthology.orchestra.run.smithi057.stdout: libssl3 libuuid1 uuid-dev 2024-04-25T22:00:01.382 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:01.533 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:01.570 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:01.696 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:01.822 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:01.895 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T22:00:01.923 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T22:00:01.996 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:00:02.034 INFO:teuthology.orchestra.run.smithi057.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-25T22:00:02.034 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 5,495 kB of archives. 2024-04-25T22:00:02.035 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-25T22:00:02.035 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T22:00:02.097 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:00:02.140 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:00:02.524 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T22:00:02.593 INFO:teuthology.orchestra.run.smithi079.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:00:02.598 DEBUG:teuthology.parallel:result is None 2024-04-25T22:00:02.792 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T22:00:02.793 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T22:00:02.794 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T22:00:02.830 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T22:00:02.831 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T22:00:02.834 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T22:00:02.834 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T22:00:02.835 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T22:00:02.840 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:00:03.127 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:03.253 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:03.261 INFO:teuthology.orchestra.run.smithi057.stdout:Preconfiguring packages ... 2024-04-25T22:00:03.375 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 5,495 kB in 2s (3,547 kB/s) 2024-04-25T22:00:03.379 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:03.480 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:03.485 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package flex. 2024-04-25T22:00:03.491 INFO:teuthology.orchestra.run.smithi044.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:00:03.494 DEBUG:teuthology.orchestra.run.smithi044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-25T22:00:03.553 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-04-25T22:00:03.576 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173891 files and directories currently installed.) 2024-04-25T22:00:03.581 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:03.582 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T22:00:03.625 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T22:00:03.757 INFO:teuthology.orchestra.run.smithi044.stdout:Building dependency tree... 2024-04-25T22:00:03.757 INFO:teuthology.orchestra.run.smithi044.stdout:Reading state information... 2024-04-25T22:00:03.954 INFO:teuthology.orchestra.run.smithi044.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T22:00:03.955 INFO:teuthology.orchestra.run.smithi044.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T22:00:03.955 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:00:03.955 INFO:teuthology.orchestra.run.smithi044.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:00:03.955 INFO:teuthology.orchestra.run.smithi044.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:00:03.955 INFO:teuthology.orchestra.run.smithi044.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:00:03.955 INFO:teuthology.orchestra.run.smithi044.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:00:03.955 INFO:teuthology.orchestra.run.smithi044.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:00:03.956 INFO:teuthology.orchestra.run.smithi044.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:00:03.956 INFO:teuthology.orchestra.run.smithi044.stdout:The following additional packages will be installed: 2024-04-25T22:00:03.957 INFO:teuthology.orchestra.run.smithi044.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-25T22:00:03.958 INFO:teuthology.orchestra.run.smithi044.stdout:Suggested packages: 2024-04-25T22:00:03.959 INFO:teuthology.orchestra.run.smithi044.stdout: bison-doc flex-doc libssl-doc 2024-04-25T22:00:03.991 INFO:teuthology.orchestra.run.smithi044.stdout:The following NEW packages will be installed: 2024-04-25T22:00:03.992 INFO:teuthology.orchestra.run.smithi044.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-25T22:00:03.993 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages will be upgraded: 2024-04-25T22:00:03.994 INFO:teuthology.orchestra.run.smithi044.stdout: libssl3 libuuid1 uuid-dev 2024-04-25T22:00:04.108 INFO:teuthology.orchestra.run.smithi081.stdout:Adding group ceph....done 2024-04-25T22:00:04.251 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:00:04.432 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T22:00:04.459 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user ceph....done 2024-04-25T22:00:04.594 INFO:teuthology.orchestra.run.smithi081.stdout:Setting system user ceph properties....done 2024-04-25T22:00:04.611 INFO:teuthology.orchestra.run.smithi081.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T22:00:04.745 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T22:00:04.860 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:00:05.063 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T22:00:05.405 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:00:05.410 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:00:05.515 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:00:05.541 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:05.667 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:05.780 INFO:teuthology.orchestra.run.smithi044.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-25T22:00:05.780 INFO:teuthology.orchestra.run.smithi044.stdout:Need to get 5,495 kB of archives. 2024-04-25T22:00:05.780 INFO:teuthology.orchestra.run.smithi044.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-25T22:00:05.780 INFO:teuthology.orchestra.run.smithi044.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T22:00:05.906 INFO:teuthology.orchestra.run.smithi044.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T22:00:05.978 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T22:00:05.979 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T22:00:05.980 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T22:00:05.995 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T22:00:05.997 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T22:00:05.998 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T22:00:05.998 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T22:00:05.998 INFO:teuthology.orchestra.run.smithi044.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T22:00:06.137 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:00:06.137 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:00:06.381 INFO:teuthology.orchestra.run.smithi044.stdout:Preconfiguring packages ... 2024-04-25T22:00:06.435 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:00:06.490 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 5,495 kB in 2s (2,708 kB/s) 2024-04-25T22:00:06.540 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:00:06.589 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package flex. 2024-04-25T22:00:06.602 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:06.681 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173891 files and directories currently installed.) 2024-04-25T22:00:06.687 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T22:00:06.745 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T22:00:06.860 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:00:06.961 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T22:00:07.242 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package bison. 2024-04-25T22:00:07.321 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:00:07.348 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:00:07.353 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T22:00:07.402 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:00:07.462 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:07.552 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T22:00:07.686 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T22:00:07.686 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T22:00:07.736 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T22:00:07.753 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T22:00:07.794 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:00:07.980 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:00:08.015 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T22:00:08.031 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T22:00:08.065 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:00:08.139 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:08.353 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T22:00:08.353 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T22:00:08.410 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T22:00:08.438 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T22:00:08.477 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:00:08.540 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:00:08.546 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:00:08.685 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:00:08.729 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T22:00:08.757 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T22:00:08.862 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:00:09.001 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:09.007 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T22:00:09.024 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:00:09.057 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:00:09.086 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:00:09.224 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:00:09.435 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T22:00:09.435 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T22:00:09.560 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T22:00:09.687 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:00:09.706 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:00:09.838 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:00:09.887 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:09.989 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:00:10.013 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:10.069 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package bison. 2024-04-25T22:00:10.140 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:00:10.147 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:10.176 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:00:10.182 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T22:00:10.239 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:00:10.283 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:00:10.345 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:00:10.345 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:00:10.409 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:00:10.499 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T22:00:10.561 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:00:10.605 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T22:00:10.634 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T22:00:10.680 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:00:10.688 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:00:10.782 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:10.840 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:00:10.916 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:10.951 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T22:00:10.967 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T22:00:11.009 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:00:11.042 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:11.193 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:00:11.388 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T22:00:11.416 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T22:00:11.463 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:00:11.604 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T22:00:11.791 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T22:00:11.819 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T22:00:11.822 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:00:11.882 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:00:11.950 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:00:12.051 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:00:12.168 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T22:00:12.185 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:00:12.227 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:00:12.558 INFO:teuthology.orchestra.run.smithi057.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:00:12.565 DEBUG:teuthology.parallel:result is None 2024-04-25T22:00:12.705 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T22:00:12.815 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:00:12.941 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:00:13.067 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:00:13.068 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:00:13.193 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:00:13.319 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:00:13.437 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:00:13.509 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T22:00:13.572 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:00:13.673 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:00:13.683 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:00:13.686 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-25T22:00:13.741 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-04-25T22:00:13.833 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:00:13.941 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-04-25T22:00:13.942 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-04-25T22:00:14.123 INFO:teuthology.orchestra.run.smithi081.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T22:00:14.124 INFO:teuthology.orchestra.run.smithi081.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T22:00:14.124 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:00:14.124 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:00:14.124 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:00:14.124 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:00:14.124 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:00:14.124 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:00:14.124 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:00:14.125 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2024-04-25T22:00:14.125 INFO:teuthology.orchestra.run.smithi081.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-25T22:00:14.127 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2024-04-25T22:00:14.127 INFO:teuthology.orchestra.run.smithi081.stdout: bison-doc flex-doc libssl-doc 2024-04-25T22:00:14.155 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2024-04-25T22:00:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-25T22:00:14.157 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2024-04-25T22:00:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: libssl3 libuuid1 uuid-dev 2024-04-25T22:00:14.337 INFO:teuthology.orchestra.run.smithi081.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-25T22:00:14.338 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 5,495 kB of archives. 2024-04-25T22:00:14.338 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-25T22:00:14.338 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T22:00:14.970 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T22:00:15.077 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:00:15.613 INFO:teuthology.orchestra.run.smithi044.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:00:15.618 DEBUG:teuthology.parallel:result is None 2024-04-25T22:00:16.668 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T22:00:16.688 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T22:00:16.704 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T22:00:17.288 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T22:00:17.298 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T22:00:17.334 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T22:00:17.343 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T22:00:17.345 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T22:00:19.613 INFO:teuthology.orchestra.run.smithi081.stdout:Preconfiguring packages ... 2024-04-25T22:00:19.708 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 5,495 kB in 5s (1,074 kB/s) 2024-04-25T22:00:19.844 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package flex. 2024-04-25T22:00:19.946 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173891 files and directories currently installed.) 2024-04-25T22:00:19.952 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T22:00:19.992 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T22:00:20.542 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:00:20.723 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T22:00:21.118 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:00:21.622 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:00:21.628 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:00:21.739 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:00:22.181 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:00:22.321 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:00:22.640 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:00:22.997 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package bison. 2024-04-25T22:00:23.100 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:00:23.106 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T22:00:23.157 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:00:23.433 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T22:00:23.448 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T22:00:23.491 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:00:23.745 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T22:00:23.772 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T22:00:23.811 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:00:24.140 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T22:00:24.168 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T22:00:24.207 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:00:24.417 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T22:00:24.433 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T22:00:24.475 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:00:24.713 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T22:00:24.729 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:00:24.772 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:00:25.308 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T22:00:25.435 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:00:25.561 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:00:25.712 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:00:25.813 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:00:25.947 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:00:26.065 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:00:26.138 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T22:00:26.200 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:00:26.301 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:00:26.436 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:00:27.587 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:00:28.054 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:00:28.059 DEBUG:teuthology.parallel:result is None 2024-04-25T22:00:28.059 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:00:28.302 DEBUG:teuthology.orchestra.run.smithi044:> dpkg-query -W -f '${Version}' ceph 2024-04-25T22:00:28.322 INFO:teuthology.orchestra.run.smithi044.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:00:28.323 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:00:28.323 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-25T22:00:28.325 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:00:28.473 DEBUG:teuthology.orchestra.run.smithi057:> dpkg-query -W -f '${Version}' ceph 2024-04-25T22:00:28.494 INFO:teuthology.orchestra.run.smithi057.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:00:28.494 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:00:28.494 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-25T22:00:28.496 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:00:28.644 DEBUG:teuthology.orchestra.run.smithi079:> dpkg-query -W -f '${Version}' ceph 2024-04-25T22:00:28.663 INFO:teuthology.orchestra.run.smithi079.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:00:28.663 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:00:28.664 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-25T22:00:28.665 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:00:28.812 DEBUG:teuthology.orchestra.run.smithi081:> dpkg-query -W -f '${Version}' ceph 2024-04-25T22:00:28.831 INFO:teuthology.orchestra.run.smithi081.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:00:28.831 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:00:28.832 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-25T22:00:28.833 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T22:00:28.834 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T22:00:28.834 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T22:00:28.848 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:00:28.848 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T22:00:28.862 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T22:00:28.863 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T22:00:28.876 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-25T22:00:28.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T22:00:28.890 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T22:00:28.891 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T22:00:28.891 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T22:00:28.903 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T22:00:28.957 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:00:28.958 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T22:00:28.971 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T22:00:29.025 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T22:00:29.026 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T22:00:29.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T22:00:29.093 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-25T22:00:29.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T22:00:29.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T22:00:29.161 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T22:00:29.161 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T22:00:29.161 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T22:00:29.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T22:00:29.230 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:00:29.230 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T22:00:29.245 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T22:00:29.303 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T22:00:29.303 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T22:00:29.360 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T22:00:29.415 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-25T22:00:29.416 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T22:00:29.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T22:00:29.486 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T22:00:29.487 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T22:00:29.487 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T22:00:29.501 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T22:00:29.555 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:00:29.555 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T22:00:29.569 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T22:00:29.625 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T22:00:29.626 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T22:00:29.639 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T22:00:29.694 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-25T22:00:29.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T22:00:29.707 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T22:00:29.761 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T22:00:29.870 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T22:00:29.870 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /var/log/ceph 2024-04-25T22:00:29.872 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /var/log/ceph 2024-04-25T22:00:29.874 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /var/log/ceph 2024-04-25T22:00:29.877 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2024-04-25T22:00:29.890 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T22:00:29.890 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T22:00:29.928 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T22:00:29.930 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T22:00:29.932 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T22:00:29.946 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T22:00:29.946 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T22:00:29.988 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T22:00:29.990 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T22:00:29.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T22:00:30.016 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T22:00:30.016 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T22:00:30.017 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030', 'branch': 'squid', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7674030', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 9595, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'sleep_before_teardown': 0, 'subset': '3/4', 'suite': 'powercycle', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a', 'targets': {'smithi044.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGxFXLuB+xX6hp4MSIuccdeAzHqxg/oh5ij2//gEPWSMthYpPZOCnhr8yz8pBGbdTxlP2W+wQt0kiZAe20MNBbc=', 'smithi057.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtO9f3xc6jHnNF5q1xmbJVg1UeBREh5IbSHtuyptqQ2rHOkvnr2YOAPxv4q/5+BSXKVDafr3NVPMLdWHmMlYbo=', 'smithi079.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJnmApPVU7+7hurmNSl7aKatvbce8bzKA1gUHUi1pTUw0pFItiAbPr0L8NxaUpI3rZTTatYfwDYPzFlHYgv0ruI=', 'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF4jsp+F3qhLNTuzqyLCbJuqcTGoqRZ2yFEd63zdb9M+ZVs71Fg2Jp7O/h++Pl3t3I9/j22t7WvvZ9bOx4GSl5w='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_21:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T22:00:30.017 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T22:00:30.044 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T22:00:30.047 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T22:00:30.050 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T22:00:30.056 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:00:30.092 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:00:30.094 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:00:30.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:00:30.110 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:00:30.110 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T22:00:30.153 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T22:00:30.153 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2024-04-25T22:00:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T22:00:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:00:30.202 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 860 Links: 1 2024-04-25T22:00:30.202 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:00:30.202 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-25 21:54:27.720157594 +0000 2024-04-25T22:00:30.202 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-25 21:54:27.716157629 +0000 2024-04-25T22:00:30.202 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-25 21:54:27.716157629 +0000 2024-04-25T22:00:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-04-25T22:00:30.202 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T22:00:30.256 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-25T22:00:30.256 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-25T22:00:30.256 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000386201 s, 1.3 MB/s 2024-04-25T22:00:30.257 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T22:00:30.307 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2024-04-25T22:00:30.353 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T22:00:30.353 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:00:30.354 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 885 Links: 1 2024-04-25T22:00:30.354 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:00:30.354 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-25 21:54:28.508150564 +0000 2024-04-25T22:00:30.354 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-25 21:54:28.244152919 +0000 2024-04-25T22:00:30.354 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-25 21:54:28.244152919 +0000 2024-04-25T22:00:30.354 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-04-25T22:00:30.354 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T22:00:30.408 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-25T22:00:30.408 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-25T22:00:30.408 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000461928 s, 1.1 MB/s 2024-04-25T22:00:30.409 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T22:00:30.458 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2024-04-25T22:00:30.505 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T22:00:30.505 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:00:30.505 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 899 Links: 1 2024-04-25T22:00:30.505 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:00:30.505 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-25 21:54:29.004146139 +0000 2024-04-25T22:00:30.506 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-25 21:54:28.744148459 +0000 2024-04-25T22:00:30.506 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-25 21:54:28.744148459 +0000 2024-04-25T22:00:30.506 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-04-25T22:00:30.506 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T22:00:30.559 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-25T22:00:30.560 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-25T22:00:30.560 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000470074 s, 1.1 MB/s 2024-04-25T22:00:30.561 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T22:00:30.611 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2024-04-25T22:00:30.657 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T22:00:30.658 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:00:30.658 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-04-25T22:00:30.658 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:00:30.658 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-25 21:54:29.532141429 +0000 2024-04-25T22:00:30.658 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-25 21:54:29.260143855 +0000 2024-04-25T22:00:30.658 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-25 21:54:29.260143855 +0000 2024-04-25T22:00:30.658 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-04-25T22:00:30.658 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T22:00:30.713 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-25T22:00:30.713 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-25T22:00:30.713 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000490763 s, 1.0 MB/s 2024-04-25T22:00:30.715 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T22:00:30.763 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-25T22:00:30.763 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T22:00:30.763 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T22:00:30.769 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T22:00:30.769 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2024-04-25T22:00:30.815 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T22:00:30.816 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:00:30.816 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 870 Links: 1 2024-04-25T22:00:30.816 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:00:30.816 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-04-25 21:54:22.129588680 +0000 2024-04-25T22:00:30.816 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-04-25 21:54:22.125588714 +0000 2024-04-25T22:00:30.816 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-04-25 21:54:22.125588714 +0000 2024-04-25T22:00:30.816 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-04-25T22:00:30.816 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T22:00:30.870 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-04-25T22:00:30.870 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-04-25T22:00:30.870 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.0003846 s, 1.3 MB/s 2024-04-25T22:00:30.871 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T22:00:30.925 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2024-04-25T22:00:30.971 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T22:00:30.971 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:00:30.971 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-04-25T22:00:30.971 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:00:30.972 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-04-25 21:54:22.645584070 +0000 2024-04-25T22:00:30.972 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-04-25 21:54:22.641584106 +0000 2024-04-25T22:00:30.972 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-04-25 21:54:22.641584106 +0000 2024-04-25T22:00:30.972 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-04-25T22:00:30.972 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T22:00:31.025 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-04-25T22:00:31.025 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-04-25T22:00:31.025 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000353409 s, 1.4 MB/s 2024-04-25T22:00:31.027 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T22:00:31.076 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2024-04-25T22:00:31.123 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T22:00:31.123 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:00:31.123 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-04-25T22:00:31.123 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:00:31.123 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-04-25 21:54:23.137579676 +0000 2024-04-25T22:00:31.123 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-04-25 21:54:23.133579712 +0000 2024-04-25T22:00:31.124 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-04-25 21:54:23.133579712 +0000 2024-04-25T22:00:31.124 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-04-25T22:00:31.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T22:00:31.177 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-04-25T22:00:31.177 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-04-25T22:00:31.178 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000432306 s, 1.2 MB/s 2024-04-25T22:00:31.179 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T22:00:31.228 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2024-04-25T22:00:31.279 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T22:00:31.279 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:00:31.279 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-04-25T22:00:31.279 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:00:31.279 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-04-25 21:54:23.877573065 +0000 2024-04-25T22:00:31.279 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-04-25 21:54:23.629575280 +0000 2024-04-25T22:00:31.279 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-04-25 21:54:23.629575280 +0000 2024-04-25T22:00:31.279 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-04-25T22:00:31.280 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T22:00:31.333 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-04-25T22:00:31.333 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-04-25T22:00:31.333 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000388437 s, 1.3 MB/s 2024-04-25T22:00:31.335 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T22:00:31.384 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-25T22:00:31.384 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-25T22:00:31.384 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T22:00:31.390 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T22:00:31.390 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-04-25T22:00:31.439 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T22:00:31.439 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:00:31.439 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 869 Links: 1 2024-04-25T22:00:31.439 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:00:31.439 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-04-25 21:54:23.607196809 +0000 2024-04-25T22:00:31.439 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-04-25 21:54:23.315199418 +0000 2024-04-25T22:00:31.439 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-04-25 21:54:23.315199418 +0000 2024-04-25T22:00:31.439 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-04-25T22:00:31.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T22:00:31.493 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-04-25T22:00:31.493 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-04-25T22:00:31.493 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.00039928 s, 1.3 MB/s 2024-04-25T22:00:31.495 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T22:00:31.543 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-04-25T22:00:31.590 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T22:00:31.591 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:00:31.591 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-04-25T22:00:31.591 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:00:31.591 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-04-25 21:54:24.119192237 +0000 2024-04-25T22:00:31.591 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-04-25 21:54:23.847194666 +0000 2024-04-25T22:00:31.591 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-04-25 21:54:23.847194666 +0000 2024-04-25T22:00:31.591 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-04-25T22:00:31.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T22:00:31.645 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-04-25T22:00:31.645 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-04-25T22:00:31.645 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000394023 s, 1.3 MB/s 2024-04-25T22:00:31.646 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T22:00:31.695 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-04-25T22:00:31.742 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T22:00:31.742 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:00:31.742 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-04-25T22:00:31.743 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:00:31.743 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-04-25 21:54:24.615187807 +0000 2024-04-25T22:00:31.743 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-04-25 21:54:24.367190022 +0000 2024-04-25T22:00:31.743 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-04-25 21:54:24.367190022 +0000 2024-04-25T22:00:31.743 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-04-25T22:00:31.743 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T22:00:31.796 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-04-25T22:00:31.796 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-04-25T22:00:31.796 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000335115 s, 1.5 MB/s 2024-04-25T22:00:31.797 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T22:00:31.848 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-04-25T22:00:31.898 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T22:00:31.899 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:00:31.899 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-04-25T22:00:31.899 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:00:31.899 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-04-25 21:54:25.087183590 +0000 2024-04-25T22:00:31.899 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-04-25 21:54:24.831185876 +0000 2024-04-25T22:00:31.899 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-04-25 21:54:24.831185876 +0000 2024-04-25T22:00:31.899 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-04-25T22:00:31.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T22:00:31.953 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-04-25T22:00:31.953 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-04-25T22:00:31.953 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000383401 s, 1.3 MB/s 2024-04-25T22:00:31.954 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T22:00:32.003 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-25T22:00:32.003 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-25T22:00:32.004 INFO:tasks.ceph:Generating config... 2024-04-25T22:00:32.005 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T22:00:32.005 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T22:00:32.005 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T22:00:32.005 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T22:00:32.005 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T22:00:32.005 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T22:00:32.005 INFO:tasks.ceph:[osd] bluestore compression algorithm = zlib 2024-04-25T22:00:32.005 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-25T22:00:32.005 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T22:00:32.006 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T22:00:32.006 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T22:00:32.006 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T22:00:32.006 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T22:00:32.006 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T22:00:32.006 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T22:00:32.006 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T22:00:32.006 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T22:00:32.006 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-25T22:00:32.006 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T22:00:32.006 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-25T22:00:32.006 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T22:00:32.007 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T22:00:32.007 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T22:00:32.042 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T22:00:32.049 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T22:00:32.126 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:00:32.186 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.44'), ('mon.b', '[v2:172.21.15.44:3301,v1:172.21.15.44:6790]'), ('mon.c', '[v2:172.21.15.44:3302,v1:172.21.15.44:6791]')] 2024-04-25T22:00:32.186 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.44,[v2:172.21.15.44:3301,v1:172.21.15.44:6790],[v2:172.21.15.44:3302,v1:172.21.15.44:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-04-25T22:00:32.187 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T22:00:32.187 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T22:00:32.236 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.44 --addv b '[v2:172.21.15.44:3301,v1:172.21.15.44:6790]' --addv c '[v2:172.21.15.44:3302,v1:172.21.15.44:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:00:32.322 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:00:32.322 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: generated fsid 1ced109c-704f-44b1-9811-a2da74898889 2024-04-25T22:00:32.322 INFO:teuthology.orchestra.run.smithi044.stdout:setting min_mon_release = quincy 2024-04-25T22:00:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:epoch 0 2024-04-25T22:00:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:fsid 1ced109c-704f-44b1-9811-a2da74898889 2024-04-25T22:00:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:last_changed 2024-04-25T22:00:32.322700+0000 2024-04-25T22:00:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:created 2024-04-25T22:00:32.322700+0000 2024-04-25T22:00:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:min_mon_release 17 (quincy) 2024-04-25T22:00:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:election_strategy: 1 2024-04-25T22:00:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-04-25T22:00:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:1: [v2:172.21.15.44:3301/0,v1:172.21.15.44:6790/0] mon.b 2024-04-25T22:00:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:2: [v2:172.21.15.44:3302/0,v1:172.21.15.44:6791/0] mon.c 2024-04-25T22:00:32.323 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T22:00:32.324 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T22:00:32.329 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1ced109c-704f-44b1-9811-a2da74898889... 2024-04-25T22:00:32.330 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T22:00:32.375 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T22:00:32.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T22:00:32.380 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T22:00:32.405 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2024-04-25T22:00:32.405 INFO:teuthology.orchestra.run.smithi044.stdout: chdir = "" 2024-04-25T22:00:32.405 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T22:00:32.405 INFO:teuthology.orchestra.run.smithi044.stdout: auth supported = cephx 2024-04-25T22:00:32.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.405 INFO:teuthology.orchestra.run.smithi044.stdout: filestore xattr use omap = true 2024-04-25T22:00:32.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.405 INFO:teuthology.orchestra.run.smithi044.stdout: mon clock drift allowed = 1.000 2024-04-25T22:00:32.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.405 INFO:teuthology.orchestra.run.smithi044.stdout: osd crush chooseleaf type = 0 2024-04-25T22:00:32.405 INFO:teuthology.orchestra.run.smithi044.stdout: auth debug = true 2024-04-25T22:00:32.406 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.406 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on old message = true 2024-04-25T22:00:32.406 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on bug = true 2024-04-25T22:00:32.406 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.406 INFO:teuthology.orchestra.run.smithi044.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T22:00:32.406 INFO:teuthology.orchestra.run.smithi044.stdout: mon pg warn max object skew = 0 2024-04-25T22:00:32.406 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.406 INFO:teuthology.orchestra.run.smithi044.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T22:00:32.406 INFO:teuthology.orchestra.run.smithi044.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T22:00:32.406 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.406 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default size = 2 2024-04-25T22:00:32.406 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.406 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow primary affinity = true 2024-04-25T22:00:32.406 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow pg remap = true 2024-04-25T22:00:32.407 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on legacy crush tunables = false 2024-04-25T22:00:32.407 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on crush straw calc version zero = false 2024-04-25T22:00:32.407 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on no sortbitwise = false 2024-04-25T22:00:32.407 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on osd down out interval zero = false 2024-04-25T22:00:32.407 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on too few osds = false 2024-04-25T22:00:32.407 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T22:00:32.407 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T22:00:32.407 INFO:teuthology.orchestra.run.smithi044.stdout: mon_allow_pool_size_one = true 2024-04-25T22:00:32.407 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.407 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T22:00:32.407 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.407 INFO:teuthology.orchestra.run.smithi044.stdout: osd default data pool replay window = 5 2024-04-25T22:00:32.407 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.407 INFO:teuthology.orchestra.run.smithi044.stdout: mon allow pool delete = true 2024-04-25T22:00:32.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.408 INFO:teuthology.orchestra.run.smithi044.stdout: mon cluster log file level = debug 2024-04-25T22:00:32.408 INFO:teuthology.orchestra.run.smithi044.stdout: debug asserts on shutdown = true 2024-04-25T22:00:32.408 INFO:teuthology.orchestra.run.smithi044.stdout: mon health detail to clog = false 2024-04-25T22:00:32.408 INFO:teuthology.orchestra.run.smithi044.stdout: mon host = "172.21.15.44,[v2:172.21.15.44:3301,v1:172.21.15.44:6790],[v2:172.21.15.44:3302,v1:172.21.15.44:6791]" 2024-04-25T22:00:32.408 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = 1ced109c-704f-44b1-9811-a2da74898889 2024-04-25T22:00:32.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.408 INFO:teuthology.orchestra.run.smithi044.stdout:[osd] 2024-04-25T22:00:32.408 INFO:teuthology.orchestra.run.smithi044.stdout: osd journal size = 100 2024-04-25T22:00:32.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.408 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub load threshold = 5.0 2024-04-25T22:00:32.408 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub max interval = 600 2024-04-25T22:00:32.408 INFO:teuthology.orchestra.run.smithi044.stdout: osd mclock profile = high_recovery_ops 2024-04-25T22:00:32.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.409 INFO:teuthology.orchestra.run.smithi044.stdout: osd recover clone overlap = true 2024-04-25T22:00:32.409 INFO:teuthology.orchestra.run.smithi044.stdout: osd recovery max chunk = 1048576 2024-04-25T22:00:32.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.409 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug shutdown = true 2024-04-25T22:00:32.409 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug op order = true 2024-04-25T22:00:32.409 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug verify stray on activate = true 2024-04-25T22:00:32.409 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug trim objects = true 2024-04-25T22:00:32.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.409 INFO:teuthology.orchestra.run.smithi044.stdout: osd open classes on start = true 2024-04-25T22:00:32.409 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug pg log writeout = true 2024-04-25T22:00:32.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.409 INFO:teuthology.orchestra.run.smithi044.stdout: osd deep scrub update digest min age = 30 2024-04-25T22:00:32.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.409 INFO:teuthology.orchestra.run.smithi044.stdout: osd map max advance = 10 2024-04-25T22:00:32.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.410 INFO:teuthology.orchestra.run.smithi044.stdout: journal zero on create = true 2024-04-25T22:00:32.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.410 INFO:teuthology.orchestra.run.smithi044.stdout: filestore ondisk finisher threads = 3 2024-04-25T22:00:32.410 INFO:teuthology.orchestra.run.smithi044.stdout: filestore apply finisher threads = 3 2024-04-25T22:00:32.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.410 INFO:teuthology.orchestra.run.smithi044.stdout: bdev debug aio = true 2024-04-25T22:00:32.410 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug misdirected ops = true 2024-04-25T22:00:32.410 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore block size = 96636764160 2024-04-25T22:00:32.410 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore compression algorithm = zlib 2024-04-25T22:00:32.410 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore compression mode = aggressive 2024-04-25T22:00:32.410 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore fsck on mount = True 2024-04-25T22:00:32.410 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluefs = 1/20 2024-04-25T22:00:32.410 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluestore = 1/20 2024-04-25T22:00:32.411 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-04-25T22:00:32.411 INFO:teuthology.orchestra.run.smithi044.stdout: debug osd = 20 2024-04-25T22:00:32.411 INFO:teuthology.orchestra.run.smithi044.stdout: debug rocksdb = 4/10 2024-04-25T22:00:32.411 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T22:00:32.411 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd full ratio = 0.9 2024-04-25T22:00:32.411 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd nearfull ratio = 0.8 2024-04-25T22:00:32.411 INFO:teuthology.orchestra.run.smithi044.stdout: osd blocked scrub grace period = 3600 2024-04-25T22:00:32.411 INFO:teuthology.orchestra.run.smithi044.stdout: osd failsafe full ratio = 0.95 2024-04-25T22:00:32.411 INFO:teuthology.orchestra.run.smithi044.stdout: osd max markdown count = 1000 2024-04-25T22:00:32.411 INFO:teuthology.orchestra.run.smithi044.stdout: osd objectstore = bluestore 2024-04-25T22:00:32.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.411 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr] 2024-04-25T22:00:32.411 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-04-25T22:00:32.411 INFO:teuthology.orchestra.run.smithi044.stdout: debug mgr = 20 2024-04-25T22:00:32.411 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-04-25T22:00:32.412 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-04-25T22:00:32.412 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:00:32.412 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:00:32.412 INFO:teuthology.orchestra.run.smithi044.stdout: mgr/telemetry/nag = false 2024-04-25T22:00:32.412 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.412 INFO:teuthology.orchestra.run.smithi044.stdout:[mon] 2024-04-25T22:00:32.412 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-04-25T22:00:32.412 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-04-25T22:00:32.412 INFO:teuthology.orchestra.run.smithi044.stdout: debug paxos = 20 2024-04-25T22:00:32.412 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-04-25T22:00:32.412 INFO:teuthology.orchestra.run.smithi044.stdout: mon data avail warn = 5 2024-04-25T22:00:32.412 INFO:teuthology.orchestra.run.smithi044.stdout: mon mgr mkfs grace = 240 2024-04-25T22:00:32.412 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:00:32.412 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd reporter subtree level = osd 2024-04-25T22:00:32.412 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd prime pg temp = true 2024-04-25T22:00:32.413 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:00:32.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.413 INFO:teuthology.orchestra.run.smithi044.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T22:00:32.413 INFO:teuthology.orchestra.run.smithi044.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T22:00:32.413 INFO:teuthology.orchestra.run.smithi044.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T22:00:32.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.413 INFO:teuthology.orchestra.run.smithi044.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T22:00:32.413 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T22:00:32.413 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T22:00:32.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.413 INFO:teuthology.orchestra.run.smithi044.stdout: # 1m isn't quite enough 2024-04-25T22:00:32.413 INFO:teuthology.orchestra.run.smithi044.stdout: mon_down_mkfs_grace = 2m 2024-04-25T22:00:32.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.413 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_filestore_osds = false 2024-04-25T22:00:32.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:[client] 2024-04-25T22:00:32.414 INFO:teuthology.orchestra.run.smithi044.stdout: rgw cache enabled = true 2024-04-25T22:00:32.414 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable ops log = true 2024-04-25T22:00:32.414 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable usage log = true 2024-04-25T22:00:32.414 INFO:teuthology.orchestra.run.smithi044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T22:00:32.414 INFO:teuthology.orchestra.run.smithi044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T22:00:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.a] 2024-04-25T22:00:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.b] 2024-04-25T22:00:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.c] 2024-04-25T22:00:32.414 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2024-04-25T22:00:32.415 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-04-25T22:00:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2024-04-25T22:00:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T22:00:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2024-04-25T22:00:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2024-04-25T22:00:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2024-04-25T22:00:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2024-04-25T22:00:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2024-04-25T22:00:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2024-04-25T22:00:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2024-04-25T22:00:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T22:00:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2024-04-25T22:00:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T22:00:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T22:00:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2024-04-25T22:00:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2024-04-25T22:00:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2024-04-25T22:00:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2024-04-25T22:00:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2024-04-25T22:00:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2024-04-25T22:00:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2024-04-25T22:00:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2024-04-25T22:00:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T22:00:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T22:00:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2024-04-25T22:00:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T22:00:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2024-04-25T22:00:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2024-04-25T22:00:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2024-04-25T22:00:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2024-04-25T22:00:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2024-04-25T22:00:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.44,[v2:172.21.15.44:3301,v1:172.21.15.44:6790],[v2:172.21.15.44:3302,v1:172.21.15.44:6791]" 2024-04-25T22:00:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 1ced109c-704f-44b1-9811-a2da74898889 2024-04-25T22:00:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.418 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2024-04-25T22:00:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2024-04-25T22:00:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2024-04-25T22:00:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2024-04-25T22:00:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2024-04-25T22:00:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2024-04-25T22:00:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2024-04-25T22:00:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2024-04-25T22:00:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2024-04-25T22:00:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2024-04-25T22:00:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug trim objects = true 2024-04-25T22:00:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2024-04-25T22:00:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2024-04-25T22:00:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2024-04-25T22:00:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2024-04-25T22:00:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2024-04-25T22:00:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2024-04-25T22:00:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2024-04-25T22:00:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2024-04-25T22:00:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2024-04-25T22:00:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2024-04-25T22:00:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore compression algorithm = zlib 2024-04-25T22:00:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore compression mode = aggressive 2024-04-25T22:00:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2024-04-25T22:00:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 1/20 2024-04-25T22:00:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 1/20 2024-04-25T22:00:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T22:00:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2024-04-25T22:00:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 4/10 2024-04-25T22:00:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T22:00:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2024-04-25T22:00:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2024-04-25T22:00:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: osd blocked scrub grace period = 3600 2024-04-25T22:00:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2024-04-25T22:00:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: osd max markdown count = 1000 2024-04-25T22:00:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2024-04-25T22:00:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.422 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2024-04-25T22:00:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T22:00:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2024-04-25T22:00:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-04-25T22:00:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-04-25T22:00:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:00:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:00:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2024-04-25T22:00:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.422 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2024-04-25T22:00:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-04-25T22:00:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-04-25T22:00:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2024-04-25T22:00:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-04-25T22:00:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2024-04-25T22:00:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2024-04-25T22:00:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:00:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2024-04-25T22:00:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2024-04-25T22:00:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:00:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T22:00:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T22:00:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T22:00:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T22:00:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T22:00:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T22:00:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2024-04-25T22:00:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2024-04-25T22:00:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2024-04-25T22:00:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-25T22:00:32.424 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2024-04-25T22:00:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2024-04-25T22:00:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2024-04-25T22:00:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2024-04-25T22:00:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T22:00:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T22:00:32.424 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2024-04-25T22:00:32.424 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2024-04-25T22:00:32.424 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2024-04-25T22:00:32.425 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2024-04-25T22:00:32.425 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2024-04-25T22:00:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2024-04-25T22:00:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T22:00:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2024-04-25T22:00:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2024-04-25T22:00:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2024-04-25T22:00:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2024-04-25T22:00:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2024-04-25T22:00:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2024-04-25T22:00:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2024-04-25T22:00:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T22:00:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2024-04-25T22:00:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T22:00:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T22:00:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2024-04-25T22:00:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2024-04-25T22:00:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2024-04-25T22:00:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2024-04-25T22:00:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2024-04-25T22:00:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2024-04-25T22:00:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2024-04-25T22:00:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2024-04-25T22:00:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T22:00:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T22:00:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2024-04-25T22:00:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T22:00:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2024-04-25T22:00:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2024-04-25T22:00:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2024-04-25T22:00:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2024-04-25T22:00:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2024-04-25T22:00:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.44,[v2:172.21.15.44:3301,v1:172.21.15.44:6790],[v2:172.21.15.44:3302,v1:172.21.15.44:6791]" 2024-04-25T22:00:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = 1ced109c-704f-44b1-9811-a2da74898889 2024-04-25T22:00:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.428 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2024-04-25T22:00:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2024-04-25T22:00:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2024-04-25T22:00:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2024-04-25T22:00:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2024-04-25T22:00:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2024-04-25T22:00:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2024-04-25T22:00:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2024-04-25T22:00:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2024-04-25T22:00:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2024-04-25T22:00:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug trim objects = true 2024-04-25T22:00:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2024-04-25T22:00:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2024-04-25T22:00:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2024-04-25T22:00:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2024-04-25T22:00:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2024-04-25T22:00:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2024-04-25T22:00:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2024-04-25T22:00:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2024-04-25T22:00:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2024-04-25T22:00:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2024-04-25T22:00:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore compression algorithm = zlib 2024-04-25T22:00:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore compression mode = aggressive 2024-04-25T22:00:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2024-04-25T22:00:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 1/20 2024-04-25T22:00:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 1/20 2024-04-25T22:00:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-25T22:00:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2024-04-25T22:00:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 4/10 2024-04-25T22:00:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T22:00:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2024-04-25T22:00:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2024-04-25T22:00:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: osd blocked scrub grace period = 3600 2024-04-25T22:00:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2024-04-25T22:00:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: osd max markdown count = 1000 2024-04-25T22:00:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2024-04-25T22:00:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.431 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2024-04-25T22:00:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-25T22:00:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2024-04-25T22:00:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-04-25T22:00:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-04-25T22:00:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:00:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:00:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2024-04-25T22:00:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.432 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2024-04-25T22:00:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-25T22:00:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-04-25T22:00:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2024-04-25T22:00:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-04-25T22:00:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2024-04-25T22:00:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2024-04-25T22:00:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:00:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2024-04-25T22:00:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2024-04-25T22:00:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:00:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T22:00:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T22:00:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T22:00:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T22:00:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T22:00:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T22:00:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2024-04-25T22:00:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2024-04-25T22:00:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2024-04-25T22:00:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:00:32.433 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2024-04-25T22:00:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2024-04-25T22:00:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2024-04-25T22:00:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2024-04-25T22:00:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T22:00:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T22:00:32.434 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2024-04-25T22:00:32.434 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2024-04-25T22:00:32.434 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2024-04-25T22:00:32.434 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2024-04-25T22:00:32.436 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-04-25T22:00:32.437 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2024-04-25T22:00:32.437 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T22:00:32.437 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2024-04-25T22:00:32.437 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.437 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2024-04-25T22:00:32.437 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.437 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2024-04-25T22:00:32.437 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.437 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2024-04-25T22:00:32.437 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2024-04-25T22:00:32.437 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.437 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2024-04-25T22:00:32.437 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2024-04-25T22:00:32.437 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T22:00:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2024-04-25T22:00:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T22:00:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T22:00:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2024-04-25T22:00:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2024-04-25T22:00:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2024-04-25T22:00:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2024-04-25T22:00:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2024-04-25T22:00:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2024-04-25T22:00:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2024-04-25T22:00:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2024-04-25T22:00:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T22:00:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T22:00:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2024-04-25T22:00:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T22:00:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2024-04-25T22:00:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2024-04-25T22:00:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2024-04-25T22:00:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2024-04-25T22:00:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2024-04-25T22:00:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.44,[v2:172.21.15.44:3301,v1:172.21.15.44:6790],[v2:172.21.15.44:3302,v1:172.21.15.44:6791]" 2024-04-25T22:00:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 1ced109c-704f-44b1-9811-a2da74898889 2024-04-25T22:00:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.440 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2024-04-25T22:00:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2024-04-25T22:00:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2024-04-25T22:00:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2024-04-25T22:00:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2024-04-25T22:00:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2024-04-25T22:00:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2024-04-25T22:00:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2024-04-25T22:00:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2024-04-25T22:00:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2024-04-25T22:00:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug trim objects = true 2024-04-25T22:00:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2024-04-25T22:00:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2024-04-25T22:00:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2024-04-25T22:00:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2024-04-25T22:00:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2024-04-25T22:00:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2024-04-25T22:00:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2024-04-25T22:00:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2024-04-25T22:00:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2024-04-25T22:00:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2024-04-25T22:00:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore compression algorithm = zlib 2024-04-25T22:00:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore compression mode = aggressive 2024-04-25T22:00:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2024-04-25T22:00:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 1/20 2024-04-25T22:00:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 1/20 2024-04-25T22:00:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-04-25T22:00:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2024-04-25T22:00:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 4/10 2024-04-25T22:00:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T22:00:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2024-04-25T22:00:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2024-04-25T22:00:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: osd blocked scrub grace period = 3600 2024-04-25T22:00:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2024-04-25T22:00:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: osd max markdown count = 1000 2024-04-25T22:00:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2024-04-25T22:00:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.443 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2024-04-25T22:00:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-04-25T22:00:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2024-04-25T22:00:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-04-25T22:00:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-04-25T22:00:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:00:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:00:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2024-04-25T22:00:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.443 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2024-04-25T22:00:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-04-25T22:00:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-04-25T22:00:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2024-04-25T22:00:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-04-25T22:00:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2024-04-25T22:00:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2024-04-25T22:00:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:00:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2024-04-25T22:00:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2024-04-25T22:00:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:00:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T22:00:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T22:00:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T22:00:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T22:00:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T22:00:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T22:00:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2024-04-25T22:00:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2024-04-25T22:00:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2024-04-25T22:00:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-25T22:00:32.445 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2024-04-25T22:00:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2024-04-25T22:00:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2024-04-25T22:00:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2024-04-25T22:00:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T22:00:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T22:00:32.446 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2024-04-25T22:00:32.446 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2024-04-25T22:00:32.446 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2024-04-25T22:00:32.446 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-04-25T22:00:32.446 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T22:00:32.446 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T22:00:32.523 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T22:00:32.523 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T22:00:32.523 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T22:00:32.528 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T22:00:32.528 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T22:00:32.574 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi044.front.sepia.ceph.com 2024-04-25T22:00:32.574 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T22:00:32.574 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T22:00:32.574 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:00:32.643 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T22:00:32.643 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:00:32.691 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T22:00:32.691 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:00:32.691 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T22:00:32.691 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:00:32.715 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:00:32.715 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:00:32.762 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T22:00:32.762 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T22:00:32.762 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T22:00:32.762 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:00:32.785 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T22:00:32.785 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:00:32.832 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2024-04-25T22:00:32.832 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-25T22:00:32.832 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T22:00:32.832 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:00:32.855 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-25T22:00:32.855 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:00:32.903 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T22:00:32.904 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T22:00:32.904 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T22:00:32.950 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T22:00:32.953 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T22:00:32.994 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T22:00:32.997 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T22:00:32.997 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T22:00:33.079 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T22:00:33.082 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T22:00:33.139 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T22:00:33.140 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T22:00:33.216 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T22:00:33.227 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T22:00:33.227 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-25T22:00:33.227 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T22:00:33.241 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-25T22:00:33.241 INFO:tasks.ceph:role: osd.0 2024-04-25T22:00:33.241 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T22:00:33.242 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T22:00:33.327 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T22:00:33.327 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T22:00:33.327 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T22:00:33.327 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T22:00:33.327 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T22:00:33.327 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-04-25T22:00:33.327 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T22:00:33.327 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T22:00:33.327 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T22:00:33.328 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T22:00:34.662 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-04-25T22:00:34.664 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-04-25T22:00:34.664 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T22:00:34.728 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T22:00:34.782 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T22:00:34.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:00:34.783 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:00:34.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:00:34.887+0000 7f2104d207c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T22:00:34.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:00:34.887+0000 7f2104d207c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T22:00:34.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:00:34.887+0000 7f2104d207c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T22:00:34.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:00:34.887+0000 7f2104d207c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T22:00:34.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:00:34.887+0000 7f2104d207c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T22:00:34.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:00:34.887+0000 7f2104d207c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T22:00:37.893 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T22:00:37.907 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T22:00:37.922 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-25T22:00:37.922 INFO:tasks.ceph:role: osd.1 2024-04-25T22:00:37.922 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T22:00:37.922 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T22:00:37.986 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T22:00:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T22:00:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T22:00:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T22:00:37.986 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T22:00:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-04-25T22:00:37.987 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T22:00:37.987 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T22:00:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T22:00:37.987 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T22:00:38.435 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-04-25T22:00:38.436 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-04-25T22:00:38.436 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-25T22:00:38.530 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T22:00:38.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:00:38.540 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T22:00:38.540 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:00:38.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T22:00:38.641+0000 7fa5ef8977c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T22:00:38.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T22:00:38.641+0000 7fa5ef8977c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T22:00:38.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T22:00:38.641+0000 7fa5ef8977c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T22:00:38.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T22:00:38.641+0000 7fa5ef8977c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T22:00:38.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T22:00:38.641+0000 7fa5ef8977c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T22:00:38.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-04-25T22:00:38.645+0000 7fa5ef8977c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T22:00:41.638 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T22:00:41.652 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T22:00:41.667 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-25T22:00:41.667 INFO:tasks.ceph:role: osd.2 2024-04-25T22:00:41.667 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2024-04-25T22:00:41.667 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T22:00:41.729 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T22:00:41.730 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T22:00:41.730 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T22:00:41.730 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T22:00:41.730 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T22:00:41.730 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-04-25T22:00:41.730 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T22:00:41.730 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T22:00:41.730 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T22:00:41.730 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T22:00:42.182 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-04-25T22:00:42.184 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-04-25T22:00:42.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-25T22:00:42.281 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T22:00:42.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:00:42.293 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T22:00:42.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:00:42.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-25T22:00:42.402+0000 7f3b35c777c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T22:00:42.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-25T22:00:42.406+0000 7f3b35c777c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T22:00:42.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-25T22:00:42.406+0000 7f3b35c777c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T22:00:42.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-25T22:00:42.406+0000 7f3b35c777c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T22:00:42.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-25T22:00:42.406+0000 7f3b35c777c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T22:00:42.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-25T22:00:42.406+0000 7f3b35c777c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T22:00:45.397 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T22:00:45.411 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T22:00:45.411 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T22:00:45.411 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T22:00:45.426 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T22:00:45.426 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T22:00:45.483 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T22:00:45.483 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T22:00:45.538 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:00:45.538 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T22:00:45.552 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T22:00:45.553 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T22:00:45.566 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-25T22:00:45.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T22:00:45.579 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T22:00:45.579 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T22:00:45.586 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T22:00:45.587 DEBUG:teuthology.orchestra.run.smithi044:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T22:00:45.641 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.x] 2024-04-25T22:00:45.641 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCA0ipmecqnOBAAhdyfjg2nb0x4fZC+bLlOug== 2024-04-25T22:00:45.641 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.y] 2024-04-25T22:00:45.641 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCA0ipmzqlCOxAAnXKaODkNBpmZVCUSLT6tsg== 2024-04-25T22:00:45.641 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2024-04-25T22:00:45.641 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCB0ipmkvu5BBAAufvO2KTyMdSL7AAxMOneKg== 2024-04-25T22:00:45.641 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.0] 2024-04-25T22:00:45.642 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCC0ipmvjgjNRAAle8YGtUbMXCa7gmn/Wej8A== 2024-04-25T22:00:45.642 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.1] 2024-04-25T22:00:45.642 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCG0ipmh+1xJhAA8CXWQzkQNlx+xxsqbtlsDQ== 2024-04-25T22:00:45.642 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.2] 2024-04-25T22:00:45.642 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCK0ipmk6JOGBAAIDp92ODUfHn9vJmWAaH8sg== 2024-04-25T22:00:45.642 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-04-25T22:00:45.642 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCB0ipm/D3mDBAAMD/qLMwILyS+xlRYnt1E3Q== 2024-04-25T22:00:45.643 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T22:00:45.732 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T22:00:45.774 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T22:00:45.866 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T22:00:45.909 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T22:00:45.997 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T22:00:46.039 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T22:00:46.127 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T22:00:46.127 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T22:00:46.138 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T22:00:46.241 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T22:00:46.251 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T22:00:46.303 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T22:00:46.395 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T22:00:46.406 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T22:00:46.460 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T22:00:46.547 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T22:00:46.557 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:00:46.601 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T22:00:46.602 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T22:00:46.602 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T22:00:46.647 INFO:tasks.ceph.mon.a:Started 2024-04-25T22:00:46.647 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T22:00:46.647 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T22:00:46.649 INFO:tasks.ceph.mon.b:Started 2024-04-25T22:00:46.649 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T22:00:46.650 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T22:00:46.651 INFO:tasks.ceph.mon.c:Started 2024-04-25T22:00:46.651 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T22:00:46.651 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T22:00:46.652 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T22:00:46.653 INFO:tasks.ceph.mgr.x:Started 2024-04-25T22:00:46.653 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T22:00:46.654 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T22:00:46.656 INFO:tasks.ceph.mgr.y:Started 2024-04-25T22:00:46.656 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T22:00:46.656 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T22:00:52.882 INFO:teuthology.orchestra.run.smithi044.stderr:adjusted tunables profile to default 2024-04-25T22:00:52.901 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T22:00:52.901 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T22:00:52.901 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:00:52.901 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T22:00:52.917 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-04-25T22:00:52.917 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T22:00:52.932 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-25T22:00:52.932 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T22:00:52.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 098ec92c-0fd2-4231-8beb-09fccca634d9 0 2024-04-25T22:00:53.022 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:53.021+0000 7f43c008d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T22:00:53.023 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:53.021+0000 7ffbae4f1180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T22:00:53.201 INFO:teuthology.orchestra.run.smithi081.stdout:0 2024-04-25T22:00:53.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef 1 2024-04-25T22:00:53.429 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-04-25T22:00:53.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 290ee5c1-81af-400c-b15a-f63c4794a3b0 2 2024-04-25T22:00:53.536 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:53.533+0000 7ffbae4f1180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T22:00:53.537 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:53.533+0000 7f43c008d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T22:00:53.647 INFO:teuthology.orchestra.run.smithi081.stdout:2 2024-04-25T22:00:53.662 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T22:00:53.662 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T22:00:53.665 INFO:tasks.ceph.osd.0:Started 2024-04-25T22:00:53.665 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T22:00:53.665 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T22:00:53.667 INFO:tasks.ceph.osd.1:Started 2024-04-25T22:00:53.668 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T22:00:53.668 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T22:00:53.670 INFO:tasks.ceph.osd.2:Started 2024-04-25T22:00:53.670 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:00:53.748 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:53.745+0000 7ffbae4f1180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T22:00:53.750 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:53.749+0000 7f43c008d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T22:00:53.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:00:53.869 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":5,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:00:53.642701+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:00:53.885 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T22:00:53.885 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T22:00:54.187 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T22:00:54.282 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:00:54.279+0000 7f5834bb97c0 -1 Falling back to public interface 2024-04-25T22:00:54.283 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:00:54.282+0000 7fe8671007c0 -1 Falling back to public interface 2024-04-25T22:00:54.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:00:54.289+0000 7fd61c6a77c0 -1 Falling back to public interface 2024-04-25T22:00:54.337 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:54.333+0000 7ffbae4f1180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T22:00:54.337 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:54.333+0000 7f43c008d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T22:00:54.380 INFO:teuthology.misc.health.smithi044.stdout: 2024-04-25T22:00:54.380 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":5,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:00:53.642701+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:00:54.398 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:54.397+0000 7f43c008d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T22:00:54.399 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:54.397+0000 7ffbae4f1180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T22:00:54.402 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-25T22:00:54.455 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:54.453+0000 7f43c008d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T22:00:54.456 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:54.453+0000 7ffbae4f1180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T22:00:54.537 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:54.533+0000 7f43c008d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T22:00:54.537 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:54.533+0000 7ffbae4f1180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T22:00:54.592 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:54.589+0000 7f43c008d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T22:00:54.592 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:54.589+0000 7ffbae4f1180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T22:00:54.674 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:54.673+0000 7f43c008d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T22:00:54.674 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:54.673+0000 7ffbae4f1180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T22:00:54.731 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:54.729+0000 7f43c008d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T22:00:54.731 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:54.729+0000 7ffbae4f1180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T22:00:54.889 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:54.885+0000 7f43c008d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T22:00:54.889 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:54.885+0000 7ffbae4f1180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T22:00:54.954 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:54.953+0000 7ffbae4f1180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T22:00:54.955 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:54.953+0000 7f43c008d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T22:00:55.598 INFO:tasks.ceph.mgr.x.smithi044.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T22:00:55.598 INFO:tasks.ceph.mgr.x.smithi044.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T22:00:55.599 INFO:tasks.ceph.mgr.x.smithi044.stderr: from numpy import show_config as show_numpy_config 2024-04-25T22:00:55.599 INFO:tasks.ceph.mgr.y.smithi044.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T22:00:55.599 INFO:tasks.ceph.mgr.y.smithi044.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T22:00:55.599 INFO:tasks.ceph.mgr.y.smithi044.stderr: from numpy import show_config as show_numpy_config 2024-04-25T22:00:55.648 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:55.645+0000 7ffbae4f1180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T22:00:55.650 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:55.649+0000 7f43c008d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T22:00:55.793 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:55.789+0000 7ffbae4f1180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T22:00:55.832 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:55.829+0000 7f43c008d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T22:00:55.971 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:55.969+0000 7ffbae4f1180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T22:00:55.971 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:55.969+0000 7f43c008d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T22:00:56.038 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:56.037+0000 7ffbae4f1180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T22:00:56.039 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:56.037+0000 7f43c008d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T22:00:56.181 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:56.177+0000 7ffbae4f1180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T22:00:56.184 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:56.181+0000 7f43c008d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T22:00:56.821 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:56.817+0000 7ffbae4f1180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T22:00:56.821 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:56.817+0000 7f43c008d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T22:00:56.901 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:56.897+0000 7f43c008d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T22:00:56.901 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:56.897+0000 7ffbae4f1180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T22:00:57.093 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:57.089+0000 7ffbae4f1180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T22:00:57.093 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:57.089+0000 7f43c008d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T22:00:57.171 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:57.169+0000 7ffbae4f1180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T22:00:57.171 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:57.169+0000 7f43c008d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T22:00:57.476 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:57.473+0000 7f43c008d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T22:00:57.476 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:57.473+0000 7ffbae4f1180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T22:00:57.541 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-04-25T22:00:57.537+0000 7ffbae4f1180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T22:00:57.541 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:57.537+0000 7f43c008d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T22:00:57.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:00:57.933+0000 7fd61c6a77c0 -1 osd.1 0 log_to_monitors true 2024-04-25T22:00:57.947 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:00:57.946+0000 7fe8671007c0 -1 osd.2 0 log_to_monitors true 2024-04-25T22:00:57.999 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:00:57.995+0000 7f5834bb97c0 -1 osd.0 0 log_to_monitors true 2024-04-25T22:00:58.577 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:58.573+0000 7f43675d9640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T22:00:58.578 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:00:58.577+0000 7f43675d9640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T22:01:00.704 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T22:01:01.005 INFO:teuthology.misc.health.smithi044.stdout: 2024-04-25T22:01:01.006 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":7,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:00:59.622094+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:01:01.023 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-25T22:01:02.394 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:02.394+0000 7fe8630a9640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T22:01:02.415 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:02.414+0000 7fe85aede640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T22:01:02.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:02.425+0000 7fd618e62640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T22:01:02.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:02.445+0000 7fd610485640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T22:01:02.504 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:02.499+0000 7f5830b62640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T22:01:02.525 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:02.523+0000 7f5828997640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T22:01:07.326 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T22:01:07.633 INFO:teuthology.misc.health.smithi044.stdout: 2024-04-25T22:01:07.633 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":11,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:01:06.439927+0000","last_up_change":"2024-04-25T22:01:03.432353+0000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:01:03.632568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6801","nonce":2385981072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6803","nonce":2385981072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6807","nonce":2385981072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6805","nonce":2385981072}]},"public_addr":"172.21.15.57:6801/2385981072","cluster_addr":"172.21.15.57:6803/2385981072","heartbeat_back_addr":"172.21.15.57:6807/2385981072","heartbeat_front_addr":"172.21.15.57:6805/2385981072","state":["exists","up"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6801","nonce":29975895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6803","nonce":29975895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6807","nonce":29975895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6805","nonce":29975895}]},"public_addr":"172.21.15.79:6801/29975895","cluster_addr":"172.21.15.79:6803/29975895","heartbeat_back_addr":"172.21.15.79:6807/29975895","heartbeat_front_addr":"172.21.15.79:6805/29975895","state":["exists","up"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6801","nonce":3918111900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6803","nonce":3918111900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6807","nonce":3918111900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6805","nonce":3918111900}]},"public_addr":"172.21.15.81:6801/3918111900","cluster_addr":"172.21.15.81:6803/3918111900","heartbeat_back_addr":"172.21.15.81:6807/3918111900","heartbeat_front_addr":"172.21.15.81:6805/3918111900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:59.025944+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.986080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.971238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:01:07.651 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-25T22:01:07.651 INFO:tasks.ceph:Creating RBD pool 2024-04-25T22:01:07.651 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-25T22:01:08.562 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'rbd' created 2024-04-25T22:01:08.589 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-25T22:01:09.569 INFO:teuthology.orchestra.run.smithi044.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-25T22:01:09.593 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T22:01:09.594 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T22:01:09.594 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T22:01:09.596 INFO:tasks.ceph.mds.a:Started 2024-04-25T22:01:09.596 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T22:01:09.596 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:01:09.671 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-04-25T22:01:09.892 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:09.892 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":13,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:01:09.562025+0000","last_up_change":"2024-04-25T22:01:03.432353+0000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:01:03.632568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:01:07.995071+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6801","nonce":2385981072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6803","nonce":2385981072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6807","nonce":2385981072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6805","nonce":2385981072}]},"public_addr":"172.21.15.57:6801/2385981072","cluster_addr":"172.21.15.57:6803/2385981072","heartbeat_back_addr":"172.21.15.57:6807/2385981072","heartbeat_front_addr":"172.21.15.57:6805/2385981072","state":["exists","up"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6801","nonce":29975895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6803","nonce":29975895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6807","nonce":29975895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6805","nonce":29975895}]},"public_addr":"172.21.15.79:6801/29975895","cluster_addr":"172.21.15.79:6803/29975895","heartbeat_back_addr":"172.21.15.79:6807/29975895","heartbeat_front_addr":"172.21.15.79:6805/29975895","state":["exists","up"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6801","nonce":3918111900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6803","nonce":3918111900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6807","nonce":3918111900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6805","nonce":3918111900}]},"public_addr":"172.21.15.81:6801/3918111900","cluster_addr":"172.21.15.81:6803/3918111900","heartbeat_back_addr":"172.21.15.81:6807/3918111900","heartbeat_front_addr":"172.21.15.81:6805/3918111900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:59.025944+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.986080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.971238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:01:09.911 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:01:03.632568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:01:07.995071+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T22:01:09.911 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:01:10.219 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-04-25T22:01:10.239 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:01:10.538 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 8 2024-04-25T22:01:10.557 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:01:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:10.895 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4205,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6803/3701507543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3701507543},{"type":"v1","addr":"172.21.15.44:6803","nonce":3701507543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T22:01:10.895 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 2 2024-04-25T22:01:10.914 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:01:11.217 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:11.218 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":14,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:01:10.573138+0000","last_up_change":"2024-04-25T22:01:03.432353+0000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:01:03.632568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:01:07.995071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6801","nonce":2385981072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6803","nonce":2385981072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6807","nonce":2385981072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6805","nonce":2385981072}]},"public_addr":"172.21.15.57:6801/2385981072","cluster_addr":"172.21.15.57:6803/2385981072","heartbeat_back_addr":"172.21.15.57:6807/2385981072","heartbeat_front_addr":"172.21.15.57:6805/2385981072","state":["exists","up"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6801","nonce":29975895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6803","nonce":29975895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6807","nonce":29975895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6805","nonce":29975895}]},"public_addr":"172.21.15.79:6801/29975895","cluster_addr":"172.21.15.79:6803/29975895","heartbeat_back_addr":"172.21.15.79:6807/29975895","heartbeat_front_addr":"172.21.15.79:6805/29975895","state":["exists","up"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6801","nonce":3918111900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6803","nonce":3918111900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6807","nonce":3918111900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6805","nonce":3918111900}]},"public_addr":"172.21.15.81:6801/3918111900","cluster_addr":"172.21.15.81:6803/3918111900","heartbeat_back_addr":"172.21.15.81:6807/3918111900","heartbeat_front_addr":"172.21.15.81:6805/3918111900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:59.025944+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.986080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.971238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:01:11.235 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:01:03.632568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:01:07.995071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T22:01:11.236 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:01:11.542 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-04-25T22:01:11.560 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:01:11.849 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 8 2024-04-25T22:01:11.868 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T22:01:12.165 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:12.166 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-04-25T22:01:12.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:12.166 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-04-25T22:01:12.166 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-04-25T22:01:12.166 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:12.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:12.166 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 2, 2024-04-25T22:01:12.166 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": "rbd" 2024-04-25T22:01:12.166 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:12.166 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-04-25T22:01:12.185 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T22:01:12.185 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T22:01:12.595 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-04-25T22:01:12.615 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T22:01:13.594 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-04-25T22:01:13.622 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T22:01:14.618 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 3 and data pool 4 2024-04-25T22:01:14.643 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:01:14.931 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:14.932 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:01:13.962292+0000","last_up_change":"2024-04-25T22:01:03.432353+0000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:01:03.632568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:01:07.995071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:01:12.514055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:01:12.963831+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6801","nonce":2385981072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6803","nonce":2385981072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6807","nonce":2385981072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6805","nonce":2385981072}]},"public_addr":"172.21.15.57:6801/2385981072","cluster_addr":"172.21.15.57:6803/2385981072","heartbeat_back_addr":"172.21.15.57:6807/2385981072","heartbeat_front_addr":"172.21.15.57:6805/2385981072","state":["exists","up"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6801","nonce":29975895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6803","nonce":29975895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6807","nonce":29975895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6805","nonce":29975895}]},"public_addr":"172.21.15.79:6801/29975895","cluster_addr":"172.21.15.79:6803/29975895","heartbeat_back_addr":"172.21.15.79:6807/29975895","heartbeat_front_addr":"172.21.15.79:6805/29975895","state":["exists","up"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6801","nonce":3918111900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6803","nonce":3918111900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6807","nonce":3918111900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6805","nonce":3918111900}]},"public_addr":"172.21.15.81:6801/3918111900","cluster_addr":"172.21.15.81:6803/3918111900","heartbeat_back_addr":"172.21.15.81:6807/3918111900","heartbeat_front_addr":"172.21.15.81:6805/3918111900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:59.025944+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.986080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.971238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:01:14.949 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:01:15.241 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:15.241 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:01:13.962292+0000","last_up_change":"2024-04-25T22:01:03.432353+0000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:01:03.632568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:01:07.995071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:01:12.514055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:01:12.963831+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6801","nonce":2385981072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6803","nonce":2385981072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6807","nonce":2385981072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6805","nonce":2385981072}]},"public_addr":"172.21.15.57:6801/2385981072","cluster_addr":"172.21.15.57:6803/2385981072","heartbeat_back_addr":"172.21.15.57:6807/2385981072","heartbeat_front_addr":"172.21.15.57:6805/2385981072","state":["exists","up"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6801","nonce":29975895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6803","nonce":29975895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6807","nonce":29975895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6805","nonce":29975895}]},"public_addr":"172.21.15.79:6801/29975895","cluster_addr":"172.21.15.79:6803/29975895","heartbeat_back_addr":"172.21.15.79:6807/29975895","heartbeat_front_addr":"172.21.15.79:6805/29975895","state":["exists","up"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6801","nonce":3918111900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6803","nonce":3918111900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6807","nonce":3918111900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6805","nonce":3918111900}]},"public_addr":"172.21.15.81:6801/3918111900","cluster_addr":"172.21.15.81:6803/3918111900","heartbeat_back_addr":"172.21.15.81:6807/3918111900","heartbeat_front_addr":"172.21.15.81:6805/3918111900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:59.025944+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.986080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.971238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:01:15.260 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T22:01:15.650 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T22:01:15.651 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T22:01:16.659 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T22:01:16.659 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:01:16.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:16.995 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:01:13.963044+0000","modified":"2024-04-25T22:01:15.981330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4205},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4205":{"gid":4205,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6803/3701507543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3701507543},{"type":"v1","addr":"172.21.15.44:6803","nonce":3701507543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4205,"qdb_cluster":[4205]},"id":1}]} 2024-04-25T22:01:16.995 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 5 2024-04-25T22:01:17.012 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:01:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:17.302 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":18,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:01:15.618998+0000","last_up_change":"2024-04-25T22:01:03.432353+0000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:01:03.632568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:01:07.995071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:01:12.514055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:01:12.963831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6801","nonce":2385981072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6803","nonce":2385981072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6807","nonce":2385981072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6805","nonce":2385981072}]},"public_addr":"172.21.15.57:6801/2385981072","cluster_addr":"172.21.15.57:6803/2385981072","heartbeat_back_addr":"172.21.15.57:6807/2385981072","heartbeat_front_addr":"172.21.15.57:6805/2385981072","state":["exists","up"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6801","nonce":29975895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6803","nonce":29975895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6807","nonce":29975895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6805","nonce":29975895}]},"public_addr":"172.21.15.79:6801/29975895","cluster_addr":"172.21.15.79:6803/29975895","heartbeat_back_addr":"172.21.15.79:6807/29975895","heartbeat_front_addr":"172.21.15.79:6805/29975895","state":["exists","up"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6801","nonce":3918111900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6803","nonce":3918111900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6807","nonce":3918111900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6805","nonce":3918111900}]},"public_addr":"172.21.15.81:6801/3918111900","cluster_addr":"172.21.15.81:6803/3918111900","heartbeat_back_addr":"172.21.15.81:6807/3918111900","heartbeat_front_addr":"172.21.15.81:6805/3918111900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:59.025944+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.986080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.971238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:01:17.319 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T22:01:17.319 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:01:17.621 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:17.623 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:01:17.639 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-25T22:01:17.562326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89888,"kb_used_data":496,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025632,"statfs":{"total":289910292480,"available":289818247168,"internally_reserved":0,"allocated":507904,"data_stored":1303535,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.970405"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608829+0000","last_change":"2024-04-25T22:01:13.608829+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608829+0000","last_undegraded":"2024-04-25T22:01:13.608829+0000","last_fullsized":"2024-04-25T22:01:13.608829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609806+0000","last_change":"2024-04-25T22:01:13.609806+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609806+0000","last_undegraded":"2024-04-25T22:01:13.609806+0000","last_fullsized":"2024-04-25T22:01:13.609806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.614839+0000","last_change":"2024-04-25T22:01:13.614839+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.614839+0000","last_undegraded":"2024-04-25T22:01:13.614839+0000","last_fullsized":"2024-04-25T22:01:13.614839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611565+0000","last_change":"2024-04-25T22:01:13.611565+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611565+0000","last_undegraded":"2024-04-25T22:01:13.611565+0000","last_fullsized":"2024-04-25T22:01:13.611565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602834+0000","last_change":"2024-04-25T22:01:13.602834+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602834+0000","last_undegraded":"2024-04-25T22:01:13.602834+0000","last_fullsized":"2024-04-25T22:01:13.602834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.613472+0000","last_change":"2024-04-25T22:01:13.613472+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.613472+0000","last_undegraded":"2024-04-25T22:01:13.613472+0000","last_fullsized":"2024-04-25T22:01:13.613472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607761+0000","last_change":"2024-04-25T22:01:13.607761+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607761+0000","last_undegraded":"2024-04-25T22:01:13.607761+0000","last_fullsized":"2024-04-25T22:01:13.607761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.614023+0000","last_change":"2024-04-25T22:01:13.614023+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.614023+0000","last_undegraded":"2024-04-25T22:01:13.614023+0000","last_fullsized":"2024-04-25T22:01:13.614023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611219+0000","last_change":"2024-04-25T22:01:13.611219+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611219+0000","last_undegraded":"2024-04-25T22:01:13.611219+0000","last_fullsized":"2024-04-25T22:01:13.611219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608723+0000","last_change":"2024-04-25T22:01:13.608723+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608723+0000","last_undegraded":"2024-04-25T22:01:13.608723+0000","last_fullsized":"2024-04-25T22:01:13.608723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.613395+0000","last_change":"2024-04-25T22:01:13.613395+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.613395+0000","last_undegraded":"2024-04-25T22:01:13.613395+0000","last_fullsized":"2024-04-25T22:01:13.613395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609616+0000","last_change":"2024-04-25T22:01:13.609616+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609616+0000","last_undegraded":"2024-04-25T22:01:13.609616+0000","last_fullsized":"2024-04-25T22:01:13.609616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608470+0000","last_change":"2024-04-25T22:01:13.608470+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608470+0000","last_undegraded":"2024-04-25T22:01:13.608470+0000","last_fullsized":"2024-04-25T22:01:13.608470+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611405+0000","last_change":"2024-04-25T22:01:13.611405+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611405+0000","last_undegraded":"2024-04-25T22:01:13.611405+0000","last_fullsized":"2024-04-25T22:01:13.611405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605009+0000","last_change":"2024-04-25T22:01:13.605009+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605009+0000","last_undegraded":"2024-04-25T22:01:13.605009+0000","last_fullsized":"2024-04-25T22:01:13.605009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611454+0000","last_change":"2024-04-25T22:01:13.611454+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611454+0000","last_undegraded":"2024-04-25T22:01:13.611454+0000","last_fullsized":"2024-04-25T22:01:13.611454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.610237+0000","last_change":"2024-04-25T22:01:13.610237+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.610237+0000","last_undegraded":"2024-04-25T22:01:13.610237+0000","last_fullsized":"2024-04-25T22:01:13.610237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603451+0000","last_change":"2024-04-25T22:01:13.603451+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603451+0000","last_undegraded":"2024-04-25T22:01:13.603451+0000","last_fullsized":"2024-04-25T22:01:13.603451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608424+0000","last_change":"2024-04-25T22:01:13.608424+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608424+0000","last_undegraded":"2024-04-25T22:01:13.608424+0000","last_fullsized":"2024-04-25T22:01:13.608424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609597+0000","last_change":"2024-04-25T22:01:13.609597+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609597+0000","last_undegraded":"2024-04-25T22:01:13.609597+0000","last_fullsized":"2024-04-25T22:01:13.609597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608254+0000","last_change":"2024-04-25T22:01:13.608254+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608254+0000","last_undegraded":"2024-04-25T22:01:13.608254+0000","last_fullsized":"2024-04-25T22:01:13.608254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607798+0000","last_change":"2024-04-25T22:01:13.607798+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607798+0000","last_undegraded":"2024-04-25T22:01:13.607798+0000","last_fullsized":"2024-04-25T22:01:13.607798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608388+0000","last_change":"2024-04-25T22:01:13.608388+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608388+0000","last_undegraded":"2024-04-25T22:01:13.608388+0000","last_fullsized":"2024-04-25T22:01:13.608388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.606067+0000","last_change":"2024-04-25T22:01:13.606067+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.606067+0000","last_undegraded":"2024-04-25T22:01:13.606067+0000","last_fullsized":"2024-04-25T22:01:13.606067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.606119+0000","last_change":"2024-04-25T22:01:13.606119+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.606119+0000","last_undegraded":"2024-04-25T22:01:13.606119+0000","last_fullsized":"2024-04-25T22:01:13.606119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608232+0000","last_change":"2024-04-25T22:01:13.608232+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608232+0000","last_undegraded":"2024-04-25T22:01:13.608232+0000","last_fullsized":"2024-04-25T22:01:13.608232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611441+0000","last_change":"2024-04-25T22:01:13.611441+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611441+0000","last_undegraded":"2024-04-25T22:01:13.611441+0000","last_fullsized":"2024-04-25T22:01:13.611441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603185+0000","last_change":"2024-04-25T22:01:13.603185+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603185+0000","last_undegraded":"2024-04-25T22:01:13.603185+0000","last_fullsized":"2024-04-25T22:01:13.603185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605500+0000","last_change":"2024-04-25T22:01:13.605500+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605500+0000","last_undegraded":"2024-04-25T22:01:13.605500+0000","last_fullsized":"2024-04-25T22:01:13.605500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602983+0000","last_change":"2024-04-25T22:01:13.602983+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602983+0000","last_undegraded":"2024-04-25T22:01:13.602983+0000","last_fullsized":"2024-04-25T22:01:13.602983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605902+0000","last_change":"2024-04-25T22:01:13.605902+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605902+0000","last_undegraded":"2024-04-25T22:01:13.605902+0000","last_fullsized":"2024-04-25T22:01:13.605902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608773+0000","last_change":"2024-04-25T22:01:13.608773+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608773+0000","last_undegraded":"2024-04-25T22:01:13.608773+0000","last_fullsized":"2024-04-25T22:01:13.608773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605777+0000","last_change":"2024-04-25T22:01:13.605777+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605777+0000","last_undegraded":"2024-04-25T22:01:13.605777+0000","last_fullsized":"2024-04-25T22:01:13.605777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.631249+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:01:13.631249+0000","last_peered":"2024-04-25T22:01:13.631249+0000","last_clean":"2024-04-25T22:01:13.631249+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:01:13.631249+0000","last_undegraded":"2024-04-25T22:01:13.631249+0000","last_fullsized":"2024-04-25T22:01:13.631249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603599+0000","last_change":"2024-04-25T22:01:13.603599+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603599+0000","last_undegraded":"2024-04-25T22:01:13.603599+0000","last_fullsized":"2024-04-25T22:01:13.603599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.633159+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:01:13.633159+0000","last_peered":"2024-04-25T22:01:13.633159+0000","last_clean":"2024-04-25T22:01:13.633159+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:01:13.633159+0000","last_undegraded":"2024-04-25T22:01:13.633159+0000","last_fullsized":"2024-04-25T22:01:13.633159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605377+0000","last_change":"2024-04-25T22:01:13.605377+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605377+0000","last_undegraded":"2024-04-25T22:01:13.605377+0000","last_fullsized":"2024-04-25T22:01:13.605377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634474+0000","last_change":"2024-04-25T22:01:13.630817+0000","last_active":"2024-04-25T22:01:13.634474+0000","last_peered":"2024-04-25T22:01:13.634474+0000","last_clean":"2024-04-25T22:01:13.634474+0000","last_became_active":"2024-04-25T22:01:13.629994+0000","last_became_peered":"2024-04-25T22:01:13.629994+0000","last_unstale":"2024-04-25T22:01:13.634474+0000","last_undegraded":"2024-04-25T22:01:13.634474+0000","last_fullsized":"2024-04-25T22:01:13.634474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:35.589006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608618+0000","last_change":"2024-04-25T22:01:13.608618+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608618+0000","last_undegraded":"2024-04-25T22:01:13.608618+0000","last_fullsized":"2024-04-25T22:01:13.608618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635814+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:01:13.635814+0000","last_peered":"2024-04-25T22:01:13.635814+0000","last_clean":"2024-04-25T22:01:13.635814+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:01:13.635814+0000","last_undegraded":"2024-04-25T22:01:13.635814+0000","last_fullsized":"2024-04-25T22:01:13.635814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634187+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:01:13.634187+0000","last_peered":"2024-04-25T22:01:13.634187+0000","last_clean":"2024-04-25T22:01:13.634187+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:01:13.634187+0000","last_undegraded":"2024-04-25T22:01:13.634187+0000","last_fullsized":"2024-04-25T22:01:13.634187+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603204+0000","last_change":"2024-04-25T22:01:13.603204+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603204+0000","last_undegraded":"2024-04-25T22:01:13.603204+0000","last_fullsized":"2024-04-25T22:01:13.603204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634535+0000","last_change":"2024-04-25T22:01:13.631135+0000","last_active":"2024-04-25T22:01:13.634535+0000","last_peered":"2024-04-25T22:01:13.634535+0000","last_clean":"2024-04-25T22:01:13.634535+0000","last_became_active":"2024-04-25T22:01:13.630257+0000","last_became_peered":"2024-04-25T22:01:13.630257+0000","last_unstale":"2024-04-25T22:01:13.634535+0000","last_undegraded":"2024-04-25T22:01:13.634535+0000","last_fullsized":"2024-04-25T22:01:13.634535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:21.030688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608429+0000","last_change":"2024-04-25T22:01:13.608429+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608429+0000","last_undegraded":"2024-04-25T22:01:13.608429+0000","last_fullsized":"2024-04-25T22:01:13.608429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.636211+0000","last_change":"2024-04-25T22:01:13.633106+0000","last_active":"2024-04-25T22:01:13.636211+0000","last_peered":"2024-04-25T22:01:13.636211+0000","last_clean":"2024-04-25T22:01:13.636211+0000","last_became_active":"2024-04-25T22:01:13.631466+0000","last_became_peered":"2024-04-25T22:01:13.631466+0000","last_unstale":"2024-04-25T22:01:13.636211+0000","last_undegraded":"2024-04-25T22:01:13.636211+0000","last_fullsized":"2024-04-25T22:01:13.636211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609053+0000","last_change":"2024-04-25T22:01:13.609053+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609053+0000","last_undegraded":"2024-04-25T22:01:13.609053+0000","last_fullsized":"2024-04-25T22:01:13.609053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.633248+0000","last_change":"2024-04-25T22:01:13.626767+0000","last_active":"2024-04-25T22:01:13.633248+0000","last_peered":"2024-04-25T22:01:13.633248+0000","last_clean":"2024-04-25T22:01:13.633248+0000","last_became_active":"2024-04-25T22:01:13.625984+0000","last_became_peered":"2024-04-25T22:01:13.625984+0000","last_unstale":"2024-04-25T22:01:13.633248+0000","last_undegraded":"2024-04-25T22:01:13.633248+0000","last_fullsized":"2024-04-25T22:01:13.633248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.601099+0000","last_change":"2024-04-25T22:01:13.601099+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.601099+0000","last_undegraded":"2024-04-25T22:01:13.601099+0000","last_fullsized":"2024-04-25T22:01:13.601099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635066+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:01:13.635066+0000","last_peered":"2024-04-25T22:01:13.635066+0000","last_clean":"2024-04-25T22:01:13.635066+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:01:13.635066+0000","last_undegraded":"2024-04-25T22:01:13.635066+0000","last_fullsized":"2024-04-25T22:01:13.635066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608005+0000","last_change":"2024-04-25T22:01:13.608005+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608005+0000","last_undegraded":"2024-04-25T22:01:13.608005+0000","last_fullsized":"2024-04-25T22:01:13.608005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.630969+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:01:13.630969+0000","last_peered":"2024-04-25T22:01:13.630969+0000","last_clean":"2024-04-25T22:01:13.630969+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:01:13.630969+0000","last_undegraded":"2024-04-25T22:01:13.630969+0000","last_fullsized":"2024-04-25T22:01:13.630969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609483+0000","last_change":"2024-04-25T22:01:13.609483+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609483+0000","last_undegraded":"2024-04-25T22:01:13.609483+0000","last_fullsized":"2024-04-25T22:01:13.609483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634560+0000","last_change":"2024-04-25T22:01:13.631439+0000","last_active":"2024-04-25T22:01:13.634560+0000","last_peered":"2024-04-25T22:01:13.634560+0000","last_clean":"2024-04-25T22:01:13.634560+0000","last_became_active":"2024-04-25T22:01:13.630812+0000","last_became_peered":"2024-04-25T22:01:13.630812+0000","last_unstale":"2024-04-25T22:01:13.634560+0000","last_undegraded":"2024-04-25T22:01:13.634560+0000","last_fullsized":"2024-04-25T22:01:13.634560+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:33.145066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.606313+0000","last_change":"2024-04-25T22:01:13.606313+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.606313+0000","last_undegraded":"2024-04-25T22:01:13.606313+0000","last_fullsized":"2024-04-25T22:01:13.606313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.624956+0000","last_change":"2024-04-25T22:01:13.623342+0000","last_active":"2024-04-25T22:01:13.624956+0000","last_peered":"2024-04-25T22:01:13.624956+0000","last_clean":"2024-04-25T22:01:13.624956+0000","last_became_active":"2024-04-25T22:01:13.621460+0000","last_became_peered":"2024-04-25T22:01:13.621460+0000","last_unstale":"2024-04-25T22:01:13.624956+0000","last_undegraded":"2024-04-25T22:01:13.624956+0000","last_fullsized":"2024-04-25T22:01:13.624956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:08.736609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607841+0000","last_change":"2024-04-25T22:01:13.607841+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607841+0000","last_undegraded":"2024-04-25T22:01:13.607841+0000","last_fullsized":"2024-04-25T22:01:13.607841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":218,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.615898+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:01:13.615898+0000","last_peered":"2024-04-25T22:01:13.615898+0000","last_clean":"2024-04-25T22:01:13.615898+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:01:13.615898+0000","last_undegraded":"2024-04-25T22:01:13.615898+0000","last_fullsized":"2024-04-25T22:01:13.615898+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.619094+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:01:13.619094+0000","last_peered":"2024-04-25T22:01:13.619094+0000","last_clean":"2024-04-25T22:01:13.619094+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:01:13.619094+0000","last_undegraded":"2024-04-25T22:01:13.619094+0000","last_fullsized":"2024-04-25T22:01:13.619094+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.621721+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:01:13.621721+0000","last_peered":"2024-04-25T22:01:13.621721+0000","last_clean":"2024-04-25T22:01:13.621721+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:01:13.621721+0000","last_undegraded":"2024-04-25T22:01:13.621721+0000","last_fullsized":"2024-04-25T22:01:13.621721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:33.145066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608134+0000","last_change":"2024-04-25T22:01:13.608134+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608134+0000","last_undegraded":"2024-04-25T22:01:13.608134+0000","last_fullsized":"2024-04-25T22:01:13.608134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.616087+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:01:13.616087+0000","last_peered":"2024-04-25T22:01:13.616087+0000","last_clean":"2024-04-25T22:01:13.616087+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:01:13.616087+0000","last_undegraded":"2024-04-25T22:01:13.616087+0000","last_fullsized":"2024-04-25T22:01:13.616087+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.633181+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:01:13.633181+0000","last_peered":"2024-04-25T22:01:13.633181+0000","last_clean":"2024-04-25T22:01:13.633181+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:01:13.633181+0000","last_undegraded":"2024-04-25T22:01:13.633181+0000","last_fullsized":"2024-04-25T22:01:13.633181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:24.090744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607336+0000","last_change":"2024-04-25T22:01:13.607336+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607336+0000","last_undegraded":"2024-04-25T22:01:13.607336+0000","last_fullsized":"2024-04-25T22:01:13.607336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.610038+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:01:13.610038+0000","last_peered":"2024-04-25T22:01:13.610038+0000","last_clean":"2024-04-25T22:01:13.610038+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:01:13.610038+0000","last_undegraded":"2024-04-25T22:01:13.610038+0000","last_fullsized":"2024-04-25T22:01:13.610038+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.637479+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:01:13.637479+0000","last_peered":"2024-04-25T22:01:13.637479+0000","last_clean":"2024-04-25T22:01:13.637479+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:01:13.637479+0000","last_undegraded":"2024-04-25T22:01:13.637479+0000","last_fullsized":"2024-04-25T22:01:13.637479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:54.536138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605986+0000","last_change":"2024-04-25T22:01:13.605986+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605986+0000","last_undegraded":"2024-04-25T22:01:13.605986+0000","last_fullsized":"2024-04-25T22:01:13.605986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.616901+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:01:13.616901+0000","last_peered":"2024-04-25T22:01:13.616901+0000","last_clean":"2024-04-25T22:01:13.616901+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:01:13.616901+0000","last_undegraded":"2024-04-25T22:01:13.616901+0000","last_fullsized":"2024-04-25T22:01:13.616901+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.631211+0000","last_change":"2024-04-25T22:01:13.627274+0000","last_active":"2024-04-25T22:01:13.631211+0000","last_peered":"2024-04-25T22:01:13.631211+0000","last_clean":"2024-04-25T22:01:13.631211+0000","last_became_active":"2024-04-25T22:01:13.626015+0000","last_became_peered":"2024-04-25T22:01:13.626015+0000","last_unstale":"2024-04-25T22:01:13.631211+0000","last_undegraded":"2024-04-25T22:01:13.631211+0000","last_fullsized":"2024-04-25T22:01:13.631211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602890+0000","last_change":"2024-04-25T22:01:13.602890+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602890+0000","last_undegraded":"2024-04-25T22:01:13.602890+0000","last_fullsized":"2024-04-25T22:01:13.602890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.632246+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:01:13.632246+0000","last_peered":"2024-04-25T22:01:13.632246+0000","last_clean":"2024-04-25T22:01:13.632246+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:01:13.632246+0000","last_undegraded":"2024-04-25T22:01:13.632246+0000","last_fullsized":"2024-04-25T22:01:13.632246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.610509+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:01:13.610509+0000","last_peered":"2024-04-25T22:01:13.610509+0000","last_clean":"2024-04-25T22:01:13.610509+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:01:13.610509+0000","last_undegraded":"2024-04-25T22:01:13.610509+0000","last_fullsized":"2024-04-25T22:01:13.610509+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605712+0000","last_change":"2024-04-25T22:01:13.605712+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605712+0000","last_undegraded":"2024-04-25T22:01:13.605712+0000","last_fullsized":"2024-04-25T22:01:13.605712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.621905+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:01:13.621905+0000","last_peered":"2024-04-25T22:01:13.621905+0000","last_clean":"2024-04-25T22:01:13.621905+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:01:13.621905+0000","last_undegraded":"2024-04-25T22:01:13.621905+0000","last_fullsized":"2024-04-25T22:01:13.621905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:21.030688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.614917+0000","last_change":"2024-04-25T22:01:09.582204+0000","last_active":"2024-04-25T22:01:13.614917+0000","last_peered":"2024-04-25T22:01:13.614917+0000","last_clean":"2024-04-25T22:01:13.614917+0000","last_became_active":"2024-04-25T22:01:09.581494+0000","last_became_peered":"2024-04-25T22:01:09.581494+0000","last_unstale":"2024-04-25T22:01:13.614917+0000","last_undegraded":"2024-04-25T22:01:13.614917+0000","last_fullsized":"2024-04-25T22:01:13.614917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:13.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605487+0000","last_change":"2024-04-25T22:01:13.605487+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605487+0000","last_undegraded":"2024-04-25T22:01:13.605487+0000","last_fullsized":"2024-04-25T22:01:13.605487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.622413+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:01:13.622413+0000","last_peered":"2024-04-25T22:01:13.622413+0000","last_clean":"2024-04-25T22:01:13.622413+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:01:13.622413+0000","last_undegraded":"2024-04-25T22:01:13.622413+0000","last_fullsized":"2024-04-25T22:01:13.622413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:00.088977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.610801+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:01:13.610801+0000","last_peered":"2024-04-25T22:01:13.610801+0000","last_clean":"2024-04-25T22:01:13.610801+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:01:13.610801+0000","last_undegraded":"2024-04-25T22:01:13.610801+0000","last_fullsized":"2024-04-25T22:01:13.610801+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.600883+0000","last_change":"2024-04-25T22:01:13.600883+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.600883+0000","last_undegraded":"2024-04-25T22:01:13.600883+0000","last_fullsized":"2024-04-25T22:01:13.600883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635210+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:01:13.635210+0000","last_peered":"2024-04-25T22:01:13.635210+0000","last_clean":"2024-04-25T22:01:13.635210+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:01:13.635210+0000","last_undegraded":"2024-04-25T22:01:13.635210+0000","last_fullsized":"2024-04-25T22:01:13.635210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.619699+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:01:13.619699+0000","last_peered":"2024-04-25T22:01:13.619699+0000","last_clean":"2024-04-25T22:01:13.619699+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:01:13.619699+0000","last_undegraded":"2024-04-25T22:01:13.619699+0000","last_fullsized":"2024-04-25T22:01:13.619699+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.606151+0000","last_change":"2024-04-25T22:01:13.606151+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.606151+0000","last_undegraded":"2024-04-25T22:01:13.606151+0000","last_fullsized":"2024-04-25T22:01:13.606151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609691+0000","last_change":"2024-04-25T22:01:13.609691+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609691+0000","last_undegraded":"2024-04-25T22:01:13.609691+0000","last_fullsized":"2024-04-25T22:01:13.609691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.636141+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:01:13.636141+0000","last_peered":"2024-04-25T22:01:13.636141+0000","last_clean":"2024-04-25T22:01:13.636141+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:01:13.636141+0000","last_undegraded":"2024-04-25T22:01:13.636141+0000","last_fullsized":"2024-04-25T22:01:13.636141+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602940+0000","last_change":"2024-04-25T22:01:13.602940+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602940+0000","last_undegraded":"2024-04-25T22:01:13.602940+0000","last_fullsized":"2024-04-25T22:01:13.602940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.637506+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:01:13.637506+0000","last_peered":"2024-04-25T22:01:13.637506+0000","last_clean":"2024-04-25T22:01:13.637506+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:01:13.637506+0000","last_undegraded":"2024-04-25T22:01:13.637506+0000","last_fullsized":"2024-04-25T22:01:13.637506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:57.523272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.630640+0000","last_change":"2024-04-25T22:01:13.626710+0000","last_active":"2024-04-25T22:01:13.630640+0000","last_peered":"2024-04-25T22:01:13.630640+0000","last_clean":"2024-04-25T22:01:13.630640+0000","last_became_active":"2024-04-25T22:01:13.625898+0000","last_became_peered":"2024-04-25T22:01:13.625898+0000","last_unstale":"2024-04-25T22:01:13.630640+0000","last_undegraded":"2024-04-25T22:01:13.630640+0000","last_fullsized":"2024-04-25T22:01:13.630640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:24.090744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603111+0000","last_change":"2024-04-25T22:01:13.603111+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603111+0000","last_undegraded":"2024-04-25T22:01:13.603111+0000","last_fullsized":"2024-04-25T22:01:13.603111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635068+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:01:13.635068+0000","last_peered":"2024-04-25T22:01:13.635068+0000","last_clean":"2024-04-25T22:01:13.635068+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:01:13.635068+0000","last_undegraded":"2024-04-25T22:01:13.635068+0000","last_fullsized":"2024-04-25T22:01:13.635068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603720+0000","last_change":"2024-04-25T22:01:13.603720+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603720+0000","last_undegraded":"2024-04-25T22:01:13.603720+0000","last_fullsized":"2024-04-25T22:01:13.603720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603464+0000","last_change":"2024-04-25T22:01:13.603464+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603464+0000","last_undegraded":"2024-04-25T22:01:13.603464+0000","last_fullsized":"2024-04-25T22:01:13.603464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.624075+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:01:13.624075+0000","last_peered":"2024-04-25T22:01:13.624075+0000","last_clean":"2024-04-25T22:01:13.624075+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:01:13.624075+0000","last_undegraded":"2024-04-25T22:01:13.624075+0000","last_fullsized":"2024-04-25T22:01:13.624075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:57.523272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607287+0000","last_change":"2024-04-25T22:01:13.607287+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607287+0000","last_undegraded":"2024-04-25T22:01:13.607287+0000","last_fullsized":"2024-04-25T22:01:13.607287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634026+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:01:13.634026+0000","last_peered":"2024-04-25T22:01:13.634026+0000","last_clean":"2024-04-25T22:01:13.634026+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:01:13.634026+0000","last_undegraded":"2024-04-25T22:01:13.634026+0000","last_fullsized":"2024-04-25T22:01:13.634026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607500+0000","last_change":"2024-04-25T22:01:13.607500+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607500+0000","last_undegraded":"2024-04-25T22:01:13.607500+0000","last_fullsized":"2024-04-25T22:01:13.607500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.624192+0000","last_change":"2024-04-25T22:01:13.621997+0000","last_active":"2024-04-25T22:01:13.624192+0000","last_peered":"2024-04-25T22:01:13.624192+0000","last_clean":"2024-04-25T22:01:13.624192+0000","last_became_active":"2024-04-25T22:01:13.620987+0000","last_became_peered":"2024-04-25T22:01:13.620987+0000","last_unstale":"2024-04-25T22:01:13.624192+0000","last_undegraded":"2024-04-25T22:01:13.624192+0000","last_fullsized":"2024-04-25T22:01:13.624192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:28.906539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607919+0000","last_change":"2024-04-25T22:01:13.607919+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607919+0000","last_undegraded":"2024-04-25T22:01:13.607919+0000","last_fullsized":"2024-04-25T22:01:13.607919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.637455+0000","last_change":"2024-04-25T22:01:13.631562+0000","last_active":"2024-04-25T22:01:13.637455+0000","last_peered":"2024-04-25T22:01:13.637455+0000","last_clean":"2024-04-25T22:01:13.637455+0000","last_became_active":"2024-04-25T22:01:13.630731+0000","last_became_peered":"2024-04-25T22:01:13.630731+0000","last_unstale":"2024-04-25T22:01:13.637455+0000","last_undegraded":"2024-04-25T22:01:13.637455+0000","last_fullsized":"2024-04-25T22:01:13.637455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:00.088977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611663+0000","last_change":"2024-04-25T22:01:13.611663+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611663+0000","last_undegraded":"2024-04-25T22:01:13.611663+0000","last_fullsized":"2024-04-25T22:01:13.611663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.633307+0000","last_change":"2024-04-25T22:01:13.628356+0000","last_active":"2024-04-25T22:01:13.633307+0000","last_peered":"2024-04-25T22:01:13.633307+0000","last_clean":"2024-04-25T22:01:13.633307+0000","last_became_active":"2024-04-25T22:01:13.626608+0000","last_became_peered":"2024-04-25T22:01:13.626608+0000","last_unstale":"2024-04-25T22:01:13.633307+0000","last_undegraded":"2024-04-25T22:01:13.633307+0000","last_fullsized":"2024-04-25T22:01:13.633307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605771+0000","last_change":"2024-04-25T22:01:13.605771+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605771+0000","last_undegraded":"2024-04-25T22:01:13.605771+0000","last_fullsized":"2024-04-25T22:01:13.605771+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.632017+0000","last_change":"2024-04-25T22:01:13.630502+0000","last_active":"2024-04-25T22:01:13.632017+0000","last_peered":"2024-04-25T22:01:13.632017+0000","last_clean":"2024-04-25T22:01:13.632017+0000","last_became_active":"2024-04-25T22:01:13.629854+0000","last_became_peered":"2024-04-25T22:01:13.629854+0000","last_unstale":"2024-04-25T22:01:13.632017+0000","last_undegraded":"2024-04-25T22:01:13.632017+0000","last_fullsized":"2024-04-25T22:01:13.632017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:50.391570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602887+0000","last_change":"2024-04-25T22:01:13.602887+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602887+0000","last_undegraded":"2024-04-25T22:01:13.602887+0000","last_fullsized":"2024-04-25T22:01:13.602887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.622486+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:01:13.622486+0000","last_peered":"2024-04-25T22:01:13.622486+0000","last_clean":"2024-04-25T22:01:13.622486+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:01:13.622486+0000","last_undegraded":"2024-04-25T22:01:13.622486+0000","last_fullsized":"2024-04-25T22:01:13.622486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:54.536138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.604554+0000","last_change":"2024-04-25T22:01:13.604554+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.604554+0000","last_undegraded":"2024-04-25T22:01:13.604554+0000","last_fullsized":"2024-04-25T22:01:13.604554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635142+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:01:13.635142+0000","last_peered":"2024-04-25T22:01:13.635142+0000","last_clean":"2024-04-25T22:01:13.635142+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:01:13.635142+0000","last_undegraded":"2024-04-25T22:01:13.635142+0000","last_fullsized":"2024-04-25T22:01:13.635142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":188416,"data_stored":631301,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":131072,"data_stored":40933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":188416,"data_stored":631301,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:01:17.643 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:01:17.987 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:17.989 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:01:18.006 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-25T22:01:17.562326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89888,"kb_used_data":496,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025632,"statfs":{"total":289910292480,"available":289818247168,"internally_reserved":0,"allocated":507904,"data_stored":1303535,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.970405"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608829+0000","last_change":"2024-04-25T22:01:13.608829+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608829+0000","last_undegraded":"2024-04-25T22:01:13.608829+0000","last_fullsized":"2024-04-25T22:01:13.608829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609806+0000","last_change":"2024-04-25T22:01:13.609806+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609806+0000","last_undegraded":"2024-04-25T22:01:13.609806+0000","last_fullsized":"2024-04-25T22:01:13.609806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.614839+0000","last_change":"2024-04-25T22:01:13.614839+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.614839+0000","last_undegraded":"2024-04-25T22:01:13.614839+0000","last_fullsized":"2024-04-25T22:01:13.614839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611565+0000","last_change":"2024-04-25T22:01:13.611565+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611565+0000","last_undegraded":"2024-04-25T22:01:13.611565+0000","last_fullsized":"2024-04-25T22:01:13.611565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602834+0000","last_change":"2024-04-25T22:01:13.602834+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602834+0000","last_undegraded":"2024-04-25T22:01:13.602834+0000","last_fullsized":"2024-04-25T22:01:13.602834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.613472+0000","last_change":"2024-04-25T22:01:13.613472+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.613472+0000","last_undegraded":"2024-04-25T22:01:13.613472+0000","last_fullsized":"2024-04-25T22:01:13.613472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607761+0000","last_change":"2024-04-25T22:01:13.607761+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607761+0000","last_undegraded":"2024-04-25T22:01:13.607761+0000","last_fullsized":"2024-04-25T22:01:13.607761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.614023+0000","last_change":"2024-04-25T22:01:13.614023+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.614023+0000","last_undegraded":"2024-04-25T22:01:13.614023+0000","last_fullsized":"2024-04-25T22:01:13.614023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611219+0000","last_change":"2024-04-25T22:01:13.611219+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611219+0000","last_undegraded":"2024-04-25T22:01:13.611219+0000","last_fullsized":"2024-04-25T22:01:13.611219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608723+0000","last_change":"2024-04-25T22:01:13.608723+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608723+0000","last_undegraded":"2024-04-25T22:01:13.608723+0000","last_fullsized":"2024-04-25T22:01:13.608723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.613395+0000","last_change":"2024-04-25T22:01:13.613395+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.613395+0000","last_undegraded":"2024-04-25T22:01:13.613395+0000","last_fullsized":"2024-04-25T22:01:13.613395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609616+0000","last_change":"2024-04-25T22:01:13.609616+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609616+0000","last_undegraded":"2024-04-25T22:01:13.609616+0000","last_fullsized":"2024-04-25T22:01:13.609616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608470+0000","last_change":"2024-04-25T22:01:13.608470+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608470+0000","last_undegraded":"2024-04-25T22:01:13.608470+0000","last_fullsized":"2024-04-25T22:01:13.608470+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611405+0000","last_change":"2024-04-25T22:01:13.611405+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611405+0000","last_undegraded":"2024-04-25T22:01:13.611405+0000","last_fullsized":"2024-04-25T22:01:13.611405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605009+0000","last_change":"2024-04-25T22:01:13.605009+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605009+0000","last_undegraded":"2024-04-25T22:01:13.605009+0000","last_fullsized":"2024-04-25T22:01:13.605009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611454+0000","last_change":"2024-04-25T22:01:13.611454+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611454+0000","last_undegraded":"2024-04-25T22:01:13.611454+0000","last_fullsized":"2024-04-25T22:01:13.611454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.610237+0000","last_change":"2024-04-25T22:01:13.610237+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.610237+0000","last_undegraded":"2024-04-25T22:01:13.610237+0000","last_fullsized":"2024-04-25T22:01:13.610237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603451+0000","last_change":"2024-04-25T22:01:13.603451+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603451+0000","last_undegraded":"2024-04-25T22:01:13.603451+0000","last_fullsized":"2024-04-25T22:01:13.603451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608424+0000","last_change":"2024-04-25T22:01:13.608424+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608424+0000","last_undegraded":"2024-04-25T22:01:13.608424+0000","last_fullsized":"2024-04-25T22:01:13.608424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609597+0000","last_change":"2024-04-25T22:01:13.609597+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609597+0000","last_undegraded":"2024-04-25T22:01:13.609597+0000","last_fullsized":"2024-04-25T22:01:13.609597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608254+0000","last_change":"2024-04-25T22:01:13.608254+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608254+0000","last_undegraded":"2024-04-25T22:01:13.608254+0000","last_fullsized":"2024-04-25T22:01:13.608254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607798+0000","last_change":"2024-04-25T22:01:13.607798+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607798+0000","last_undegraded":"2024-04-25T22:01:13.607798+0000","last_fullsized":"2024-04-25T22:01:13.607798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608388+0000","last_change":"2024-04-25T22:01:13.608388+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608388+0000","last_undegraded":"2024-04-25T22:01:13.608388+0000","last_fullsized":"2024-04-25T22:01:13.608388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.606067+0000","last_change":"2024-04-25T22:01:13.606067+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.606067+0000","last_undegraded":"2024-04-25T22:01:13.606067+0000","last_fullsized":"2024-04-25T22:01:13.606067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.606119+0000","last_change":"2024-04-25T22:01:13.606119+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.606119+0000","last_undegraded":"2024-04-25T22:01:13.606119+0000","last_fullsized":"2024-04-25T22:01:13.606119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608232+0000","last_change":"2024-04-25T22:01:13.608232+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608232+0000","last_undegraded":"2024-04-25T22:01:13.608232+0000","last_fullsized":"2024-04-25T22:01:13.608232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611441+0000","last_change":"2024-04-25T22:01:13.611441+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611441+0000","last_undegraded":"2024-04-25T22:01:13.611441+0000","last_fullsized":"2024-04-25T22:01:13.611441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603185+0000","last_change":"2024-04-25T22:01:13.603185+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603185+0000","last_undegraded":"2024-04-25T22:01:13.603185+0000","last_fullsized":"2024-04-25T22:01:13.603185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605500+0000","last_change":"2024-04-25T22:01:13.605500+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605500+0000","last_undegraded":"2024-04-25T22:01:13.605500+0000","last_fullsized":"2024-04-25T22:01:13.605500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602983+0000","last_change":"2024-04-25T22:01:13.602983+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602983+0000","last_undegraded":"2024-04-25T22:01:13.602983+0000","last_fullsized":"2024-04-25T22:01:13.602983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605902+0000","last_change":"2024-04-25T22:01:13.605902+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605902+0000","last_undegraded":"2024-04-25T22:01:13.605902+0000","last_fullsized":"2024-04-25T22:01:13.605902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608773+0000","last_change":"2024-04-25T22:01:13.608773+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608773+0000","last_undegraded":"2024-04-25T22:01:13.608773+0000","last_fullsized":"2024-04-25T22:01:13.608773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605777+0000","last_change":"2024-04-25T22:01:13.605777+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605777+0000","last_undegraded":"2024-04-25T22:01:13.605777+0000","last_fullsized":"2024-04-25T22:01:13.605777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.631249+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:01:13.631249+0000","last_peered":"2024-04-25T22:01:13.631249+0000","last_clean":"2024-04-25T22:01:13.631249+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:01:13.631249+0000","last_undegraded":"2024-04-25T22:01:13.631249+0000","last_fullsized":"2024-04-25T22:01:13.631249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603599+0000","last_change":"2024-04-25T22:01:13.603599+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603599+0000","last_undegraded":"2024-04-25T22:01:13.603599+0000","last_fullsized":"2024-04-25T22:01:13.603599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.633159+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:01:13.633159+0000","last_peered":"2024-04-25T22:01:13.633159+0000","last_clean":"2024-04-25T22:01:13.633159+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:01:13.633159+0000","last_undegraded":"2024-04-25T22:01:13.633159+0000","last_fullsized":"2024-04-25T22:01:13.633159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605377+0000","last_change":"2024-04-25T22:01:13.605377+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605377+0000","last_undegraded":"2024-04-25T22:01:13.605377+0000","last_fullsized":"2024-04-25T22:01:13.605377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634474+0000","last_change":"2024-04-25T22:01:13.630817+0000","last_active":"2024-04-25T22:01:13.634474+0000","last_peered":"2024-04-25T22:01:13.634474+0000","last_clean":"2024-04-25T22:01:13.634474+0000","last_became_active":"2024-04-25T22:01:13.629994+0000","last_became_peered":"2024-04-25T22:01:13.629994+0000","last_unstale":"2024-04-25T22:01:13.634474+0000","last_undegraded":"2024-04-25T22:01:13.634474+0000","last_fullsized":"2024-04-25T22:01:13.634474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:35.589006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608618+0000","last_change":"2024-04-25T22:01:13.608618+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608618+0000","last_undegraded":"2024-04-25T22:01:13.608618+0000","last_fullsized":"2024-04-25T22:01:13.608618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635814+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:01:13.635814+0000","last_peered":"2024-04-25T22:01:13.635814+0000","last_clean":"2024-04-25T22:01:13.635814+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:01:13.635814+0000","last_undegraded":"2024-04-25T22:01:13.635814+0000","last_fullsized":"2024-04-25T22:01:13.635814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634187+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:01:13.634187+0000","last_peered":"2024-04-25T22:01:13.634187+0000","last_clean":"2024-04-25T22:01:13.634187+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:01:13.634187+0000","last_undegraded":"2024-04-25T22:01:13.634187+0000","last_fullsized":"2024-04-25T22:01:13.634187+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603204+0000","last_change":"2024-04-25T22:01:13.603204+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603204+0000","last_undegraded":"2024-04-25T22:01:13.603204+0000","last_fullsized":"2024-04-25T22:01:13.603204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634535+0000","last_change":"2024-04-25T22:01:13.631135+0000","last_active":"2024-04-25T22:01:13.634535+0000","last_peered":"2024-04-25T22:01:13.634535+0000","last_clean":"2024-04-25T22:01:13.634535+0000","last_became_active":"2024-04-25T22:01:13.630257+0000","last_became_peered":"2024-04-25T22:01:13.630257+0000","last_unstale":"2024-04-25T22:01:13.634535+0000","last_undegraded":"2024-04-25T22:01:13.634535+0000","last_fullsized":"2024-04-25T22:01:13.634535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:21.030688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608429+0000","last_change":"2024-04-25T22:01:13.608429+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608429+0000","last_undegraded":"2024-04-25T22:01:13.608429+0000","last_fullsized":"2024-04-25T22:01:13.608429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.636211+0000","last_change":"2024-04-25T22:01:13.633106+0000","last_active":"2024-04-25T22:01:13.636211+0000","last_peered":"2024-04-25T22:01:13.636211+0000","last_clean":"2024-04-25T22:01:13.636211+0000","last_became_active":"2024-04-25T22:01:13.631466+0000","last_became_peered":"2024-04-25T22:01:13.631466+0000","last_unstale":"2024-04-25T22:01:13.636211+0000","last_undegraded":"2024-04-25T22:01:13.636211+0000","last_fullsized":"2024-04-25T22:01:13.636211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609053+0000","last_change":"2024-04-25T22:01:13.609053+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609053+0000","last_undegraded":"2024-04-25T22:01:13.609053+0000","last_fullsized":"2024-04-25T22:01:13.609053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.633248+0000","last_change":"2024-04-25T22:01:13.626767+0000","last_active":"2024-04-25T22:01:13.633248+0000","last_peered":"2024-04-25T22:01:13.633248+0000","last_clean":"2024-04-25T22:01:13.633248+0000","last_became_active":"2024-04-25T22:01:13.625984+0000","last_became_peered":"2024-04-25T22:01:13.625984+0000","last_unstale":"2024-04-25T22:01:13.633248+0000","last_undegraded":"2024-04-25T22:01:13.633248+0000","last_fullsized":"2024-04-25T22:01:13.633248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.601099+0000","last_change":"2024-04-25T22:01:13.601099+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.601099+0000","last_undegraded":"2024-04-25T22:01:13.601099+0000","last_fullsized":"2024-04-25T22:01:13.601099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635066+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:01:13.635066+0000","last_peered":"2024-04-25T22:01:13.635066+0000","last_clean":"2024-04-25T22:01:13.635066+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:01:13.635066+0000","last_undegraded":"2024-04-25T22:01:13.635066+0000","last_fullsized":"2024-04-25T22:01:13.635066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608005+0000","last_change":"2024-04-25T22:01:13.608005+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608005+0000","last_undegraded":"2024-04-25T22:01:13.608005+0000","last_fullsized":"2024-04-25T22:01:13.608005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.630969+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:01:13.630969+0000","last_peered":"2024-04-25T22:01:13.630969+0000","last_clean":"2024-04-25T22:01:13.630969+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:01:13.630969+0000","last_undegraded":"2024-04-25T22:01:13.630969+0000","last_fullsized":"2024-04-25T22:01:13.630969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609483+0000","last_change":"2024-04-25T22:01:13.609483+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609483+0000","last_undegraded":"2024-04-25T22:01:13.609483+0000","last_fullsized":"2024-04-25T22:01:13.609483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634560+0000","last_change":"2024-04-25T22:01:13.631439+0000","last_active":"2024-04-25T22:01:13.634560+0000","last_peered":"2024-04-25T22:01:13.634560+0000","last_clean":"2024-04-25T22:01:13.634560+0000","last_became_active":"2024-04-25T22:01:13.630812+0000","last_became_peered":"2024-04-25T22:01:13.630812+0000","last_unstale":"2024-04-25T22:01:13.634560+0000","last_undegraded":"2024-04-25T22:01:13.634560+0000","last_fullsized":"2024-04-25T22:01:13.634560+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:33.145066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.606313+0000","last_change":"2024-04-25T22:01:13.606313+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.606313+0000","last_undegraded":"2024-04-25T22:01:13.606313+0000","last_fullsized":"2024-04-25T22:01:13.606313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.624956+0000","last_change":"2024-04-25T22:01:13.623342+0000","last_active":"2024-04-25T22:01:13.624956+0000","last_peered":"2024-04-25T22:01:13.624956+0000","last_clean":"2024-04-25T22:01:13.624956+0000","last_became_active":"2024-04-25T22:01:13.621460+0000","last_became_peered":"2024-04-25T22:01:13.621460+0000","last_unstale":"2024-04-25T22:01:13.624956+0000","last_undegraded":"2024-04-25T22:01:13.624956+0000","last_fullsized":"2024-04-25T22:01:13.624956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:08.736609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607841+0000","last_change":"2024-04-25T22:01:13.607841+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607841+0000","last_undegraded":"2024-04-25T22:01:13.607841+0000","last_fullsized":"2024-04-25T22:01:13.607841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":218,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.615898+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:01:13.615898+0000","last_peered":"2024-04-25T22:01:13.615898+0000","last_clean":"2024-04-25T22:01:13.615898+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:01:13.615898+0000","last_undegraded":"2024-04-25T22:01:13.615898+0000","last_fullsized":"2024-04-25T22:01:13.615898+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.619094+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:01:13.619094+0000","last_peered":"2024-04-25T22:01:13.619094+0000","last_clean":"2024-04-25T22:01:13.619094+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:01:13.619094+0000","last_undegraded":"2024-04-25T22:01:13.619094+0000","last_fullsized":"2024-04-25T22:01:13.619094+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.621721+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:01:13.621721+0000","last_peered":"2024-04-25T22:01:13.621721+0000","last_clean":"2024-04-25T22:01:13.621721+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:01:13.621721+0000","last_undegraded":"2024-04-25T22:01:13.621721+0000","last_fullsized":"2024-04-25T22:01:13.621721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:33.145066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608134+0000","last_change":"2024-04-25T22:01:13.608134+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608134+0000","last_undegraded":"2024-04-25T22:01:13.608134+0000","last_fullsized":"2024-04-25T22:01:13.608134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.616087+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:01:13.616087+0000","last_peered":"2024-04-25T22:01:13.616087+0000","last_clean":"2024-04-25T22:01:13.616087+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:01:13.616087+0000","last_undegraded":"2024-04-25T22:01:13.616087+0000","last_fullsized":"2024-04-25T22:01:13.616087+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.633181+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:01:13.633181+0000","last_peered":"2024-04-25T22:01:13.633181+0000","last_clean":"2024-04-25T22:01:13.633181+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:01:13.633181+0000","last_undegraded":"2024-04-25T22:01:13.633181+0000","last_fullsized":"2024-04-25T22:01:13.633181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:24.090744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607336+0000","last_change":"2024-04-25T22:01:13.607336+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607336+0000","last_undegraded":"2024-04-25T22:01:13.607336+0000","last_fullsized":"2024-04-25T22:01:13.607336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.610038+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:01:13.610038+0000","last_peered":"2024-04-25T22:01:13.610038+0000","last_clean":"2024-04-25T22:01:13.610038+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:01:13.610038+0000","last_undegraded":"2024-04-25T22:01:13.610038+0000","last_fullsized":"2024-04-25T22:01:13.610038+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.637479+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:01:13.637479+0000","last_peered":"2024-04-25T22:01:13.637479+0000","last_clean":"2024-04-25T22:01:13.637479+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:01:13.637479+0000","last_undegraded":"2024-04-25T22:01:13.637479+0000","last_fullsized":"2024-04-25T22:01:13.637479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:54.536138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605986+0000","last_change":"2024-04-25T22:01:13.605986+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605986+0000","last_undegraded":"2024-04-25T22:01:13.605986+0000","last_fullsized":"2024-04-25T22:01:13.605986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.616901+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:01:13.616901+0000","last_peered":"2024-04-25T22:01:13.616901+0000","last_clean":"2024-04-25T22:01:13.616901+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:01:13.616901+0000","last_undegraded":"2024-04-25T22:01:13.616901+0000","last_fullsized":"2024-04-25T22:01:13.616901+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.631211+0000","last_change":"2024-04-25T22:01:13.627274+0000","last_active":"2024-04-25T22:01:13.631211+0000","last_peered":"2024-04-25T22:01:13.631211+0000","last_clean":"2024-04-25T22:01:13.631211+0000","last_became_active":"2024-04-25T22:01:13.626015+0000","last_became_peered":"2024-04-25T22:01:13.626015+0000","last_unstale":"2024-04-25T22:01:13.631211+0000","last_undegraded":"2024-04-25T22:01:13.631211+0000","last_fullsized":"2024-04-25T22:01:13.631211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602890+0000","last_change":"2024-04-25T22:01:13.602890+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602890+0000","last_undegraded":"2024-04-25T22:01:13.602890+0000","last_fullsized":"2024-04-25T22:01:13.602890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.632246+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:01:13.632246+0000","last_peered":"2024-04-25T22:01:13.632246+0000","last_clean":"2024-04-25T22:01:13.632246+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:01:13.632246+0000","last_undegraded":"2024-04-25T22:01:13.632246+0000","last_fullsized":"2024-04-25T22:01:13.632246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.610509+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:01:13.610509+0000","last_peered":"2024-04-25T22:01:13.610509+0000","last_clean":"2024-04-25T22:01:13.610509+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:01:13.610509+0000","last_undegraded":"2024-04-25T22:01:13.610509+0000","last_fullsized":"2024-04-25T22:01:13.610509+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605712+0000","last_change":"2024-04-25T22:01:13.605712+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605712+0000","last_undegraded":"2024-04-25T22:01:13.605712+0000","last_fullsized":"2024-04-25T22:01:13.605712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.621905+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:01:13.621905+0000","last_peered":"2024-04-25T22:01:13.621905+0000","last_clean":"2024-04-25T22:01:13.621905+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:01:13.621905+0000","last_undegraded":"2024-04-25T22:01:13.621905+0000","last_fullsized":"2024-04-25T22:01:13.621905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:21.030688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.614917+0000","last_change":"2024-04-25T22:01:09.582204+0000","last_active":"2024-04-25T22:01:13.614917+0000","last_peered":"2024-04-25T22:01:13.614917+0000","last_clean":"2024-04-25T22:01:13.614917+0000","last_became_active":"2024-04-25T22:01:09.581494+0000","last_became_peered":"2024-04-25T22:01:09.581494+0000","last_unstale":"2024-04-25T22:01:13.614917+0000","last_undegraded":"2024-04-25T22:01:13.614917+0000","last_fullsized":"2024-04-25T22:01:13.614917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:13.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605487+0000","last_change":"2024-04-25T22:01:13.605487+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605487+0000","last_undegraded":"2024-04-25T22:01:13.605487+0000","last_fullsized":"2024-04-25T22:01:13.605487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.622413+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:01:13.622413+0000","last_peered":"2024-04-25T22:01:13.622413+0000","last_clean":"2024-04-25T22:01:13.622413+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:01:13.622413+0000","last_undegraded":"2024-04-25T22:01:13.622413+0000","last_fullsized":"2024-04-25T22:01:13.622413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:00.088977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.610801+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:01:13.610801+0000","last_peered":"2024-04-25T22:01:13.610801+0000","last_clean":"2024-04-25T22:01:13.610801+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:01:13.610801+0000","last_undegraded":"2024-04-25T22:01:13.610801+0000","last_fullsized":"2024-04-25T22:01:13.610801+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.600883+0000","last_change":"2024-04-25T22:01:13.600883+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.600883+0000","last_undegraded":"2024-04-25T22:01:13.600883+0000","last_fullsized":"2024-04-25T22:01:13.600883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635210+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:01:13.635210+0000","last_peered":"2024-04-25T22:01:13.635210+0000","last_clean":"2024-04-25T22:01:13.635210+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:01:13.635210+0000","last_undegraded":"2024-04-25T22:01:13.635210+0000","last_fullsized":"2024-04-25T22:01:13.635210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.619699+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:01:13.619699+0000","last_peered":"2024-04-25T22:01:13.619699+0000","last_clean":"2024-04-25T22:01:13.619699+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:01:13.619699+0000","last_undegraded":"2024-04-25T22:01:13.619699+0000","last_fullsized":"2024-04-25T22:01:13.619699+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.606151+0000","last_change":"2024-04-25T22:01:13.606151+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.606151+0000","last_undegraded":"2024-04-25T22:01:13.606151+0000","last_fullsized":"2024-04-25T22:01:13.606151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609691+0000","last_change":"2024-04-25T22:01:13.609691+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609691+0000","last_undegraded":"2024-04-25T22:01:13.609691+0000","last_fullsized":"2024-04-25T22:01:13.609691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.636141+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:01:13.636141+0000","last_peered":"2024-04-25T22:01:13.636141+0000","last_clean":"2024-04-25T22:01:13.636141+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:01:13.636141+0000","last_undegraded":"2024-04-25T22:01:13.636141+0000","last_fullsized":"2024-04-25T22:01:13.636141+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602940+0000","last_change":"2024-04-25T22:01:13.602940+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602940+0000","last_undegraded":"2024-04-25T22:01:13.602940+0000","last_fullsized":"2024-04-25T22:01:13.602940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.637506+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:01:13.637506+0000","last_peered":"2024-04-25T22:01:13.637506+0000","last_clean":"2024-04-25T22:01:13.637506+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:01:13.637506+0000","last_undegraded":"2024-04-25T22:01:13.637506+0000","last_fullsized":"2024-04-25T22:01:13.637506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:57.523272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.630640+0000","last_change":"2024-04-25T22:01:13.626710+0000","last_active":"2024-04-25T22:01:13.630640+0000","last_peered":"2024-04-25T22:01:13.630640+0000","last_clean":"2024-04-25T22:01:13.630640+0000","last_became_active":"2024-04-25T22:01:13.625898+0000","last_became_peered":"2024-04-25T22:01:13.625898+0000","last_unstale":"2024-04-25T22:01:13.630640+0000","last_undegraded":"2024-04-25T22:01:13.630640+0000","last_fullsized":"2024-04-25T22:01:13.630640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:24.090744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603111+0000","last_change":"2024-04-25T22:01:13.603111+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603111+0000","last_undegraded":"2024-04-25T22:01:13.603111+0000","last_fullsized":"2024-04-25T22:01:13.603111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635068+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:01:13.635068+0000","last_peered":"2024-04-25T22:01:13.635068+0000","last_clean":"2024-04-25T22:01:13.635068+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:01:13.635068+0000","last_undegraded":"2024-04-25T22:01:13.635068+0000","last_fullsized":"2024-04-25T22:01:13.635068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603720+0000","last_change":"2024-04-25T22:01:13.603720+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603720+0000","last_undegraded":"2024-04-25T22:01:13.603720+0000","last_fullsized":"2024-04-25T22:01:13.603720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603464+0000","last_change":"2024-04-25T22:01:13.603464+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603464+0000","last_undegraded":"2024-04-25T22:01:13.603464+0000","last_fullsized":"2024-04-25T22:01:13.603464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.624075+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:01:13.624075+0000","last_peered":"2024-04-25T22:01:13.624075+0000","last_clean":"2024-04-25T22:01:13.624075+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:01:13.624075+0000","last_undegraded":"2024-04-25T22:01:13.624075+0000","last_fullsized":"2024-04-25T22:01:13.624075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:57.523272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607287+0000","last_change":"2024-04-25T22:01:13.607287+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607287+0000","last_undegraded":"2024-04-25T22:01:13.607287+0000","last_fullsized":"2024-04-25T22:01:13.607287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634026+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:01:13.634026+0000","last_peered":"2024-04-25T22:01:13.634026+0000","last_clean":"2024-04-25T22:01:13.634026+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:01:13.634026+0000","last_undegraded":"2024-04-25T22:01:13.634026+0000","last_fullsized":"2024-04-25T22:01:13.634026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607500+0000","last_change":"2024-04-25T22:01:13.607500+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607500+0000","last_undegraded":"2024-04-25T22:01:13.607500+0000","last_fullsized":"2024-04-25T22:01:13.607500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.624192+0000","last_change":"2024-04-25T22:01:13.621997+0000","last_active":"2024-04-25T22:01:13.624192+0000","last_peered":"2024-04-25T22:01:13.624192+0000","last_clean":"2024-04-25T22:01:13.624192+0000","last_became_active":"2024-04-25T22:01:13.620987+0000","last_became_peered":"2024-04-25T22:01:13.620987+0000","last_unstale":"2024-04-25T22:01:13.624192+0000","last_undegraded":"2024-04-25T22:01:13.624192+0000","last_fullsized":"2024-04-25T22:01:13.624192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:28.906539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607919+0000","last_change":"2024-04-25T22:01:13.607919+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607919+0000","last_undegraded":"2024-04-25T22:01:13.607919+0000","last_fullsized":"2024-04-25T22:01:13.607919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.637455+0000","last_change":"2024-04-25T22:01:13.631562+0000","last_active":"2024-04-25T22:01:13.637455+0000","last_peered":"2024-04-25T22:01:13.637455+0000","last_clean":"2024-04-25T22:01:13.637455+0000","last_became_active":"2024-04-25T22:01:13.630731+0000","last_became_peered":"2024-04-25T22:01:13.630731+0000","last_unstale":"2024-04-25T22:01:13.637455+0000","last_undegraded":"2024-04-25T22:01:13.637455+0000","last_fullsized":"2024-04-25T22:01:13.637455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:00.088977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611663+0000","last_change":"2024-04-25T22:01:13.611663+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611663+0000","last_undegraded":"2024-04-25T22:01:13.611663+0000","last_fullsized":"2024-04-25T22:01:13.611663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.633307+0000","last_change":"2024-04-25T22:01:13.628356+0000","last_active":"2024-04-25T22:01:13.633307+0000","last_peered":"2024-04-25T22:01:13.633307+0000","last_clean":"2024-04-25T22:01:13.633307+0000","last_became_active":"2024-04-25T22:01:13.626608+0000","last_became_peered":"2024-04-25T22:01:13.626608+0000","last_unstale":"2024-04-25T22:01:13.633307+0000","last_undegraded":"2024-04-25T22:01:13.633307+0000","last_fullsized":"2024-04-25T22:01:13.633307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605771+0000","last_change":"2024-04-25T22:01:13.605771+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605771+0000","last_undegraded":"2024-04-25T22:01:13.605771+0000","last_fullsized":"2024-04-25T22:01:13.605771+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.632017+0000","last_change":"2024-04-25T22:01:13.630502+0000","last_active":"2024-04-25T22:01:13.632017+0000","last_peered":"2024-04-25T22:01:13.632017+0000","last_clean":"2024-04-25T22:01:13.632017+0000","last_became_active":"2024-04-25T22:01:13.629854+0000","last_became_peered":"2024-04-25T22:01:13.629854+0000","last_unstale":"2024-04-25T22:01:13.632017+0000","last_undegraded":"2024-04-25T22:01:13.632017+0000","last_fullsized":"2024-04-25T22:01:13.632017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:50.391570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602887+0000","last_change":"2024-04-25T22:01:13.602887+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602887+0000","last_undegraded":"2024-04-25T22:01:13.602887+0000","last_fullsized":"2024-04-25T22:01:13.602887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.622486+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:01:13.622486+0000","last_peered":"2024-04-25T22:01:13.622486+0000","last_clean":"2024-04-25T22:01:13.622486+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:01:13.622486+0000","last_undegraded":"2024-04-25T22:01:13.622486+0000","last_fullsized":"2024-04-25T22:01:13.622486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:54.536138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.604554+0000","last_change":"2024-04-25T22:01:13.604554+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.604554+0000","last_undegraded":"2024-04-25T22:01:13.604554+0000","last_fullsized":"2024-04-25T22:01:13.604554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635142+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:01:13.635142+0000","last_peered":"2024-04-25T22:01:13.635142+0000","last_clean":"2024-04-25T22:01:13.635142+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:01:13.635142+0000","last_undegraded":"2024-04-25T22:01:13.635142+0000","last_fullsized":"2024-04-25T22:01:13.635142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":188416,"data_stored":631301,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":131072,"data_stored":40933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":188416,"data_stored":631301,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:01:18.009 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:01:18.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:18.355 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:01:18.373 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-25T22:01:17.562326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89888,"kb_used_data":496,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025632,"statfs":{"total":289910292480,"available":289818247168,"internally_reserved":0,"allocated":507904,"data_stored":1303535,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.970405"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608829+0000","last_change":"2024-04-25T22:01:13.608829+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608829+0000","last_undegraded":"2024-04-25T22:01:13.608829+0000","last_fullsized":"2024-04-25T22:01:13.608829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609806+0000","last_change":"2024-04-25T22:01:13.609806+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609806+0000","last_undegraded":"2024-04-25T22:01:13.609806+0000","last_fullsized":"2024-04-25T22:01:13.609806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.614839+0000","last_change":"2024-04-25T22:01:13.614839+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.614839+0000","last_undegraded":"2024-04-25T22:01:13.614839+0000","last_fullsized":"2024-04-25T22:01:13.614839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611565+0000","last_change":"2024-04-25T22:01:13.611565+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611565+0000","last_undegraded":"2024-04-25T22:01:13.611565+0000","last_fullsized":"2024-04-25T22:01:13.611565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602834+0000","last_change":"2024-04-25T22:01:13.602834+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602834+0000","last_undegraded":"2024-04-25T22:01:13.602834+0000","last_fullsized":"2024-04-25T22:01:13.602834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.613472+0000","last_change":"2024-04-25T22:01:13.613472+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.613472+0000","last_undegraded":"2024-04-25T22:01:13.613472+0000","last_fullsized":"2024-04-25T22:01:13.613472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607761+0000","last_change":"2024-04-25T22:01:13.607761+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607761+0000","last_undegraded":"2024-04-25T22:01:13.607761+0000","last_fullsized":"2024-04-25T22:01:13.607761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.614023+0000","last_change":"2024-04-25T22:01:13.614023+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.614023+0000","last_undegraded":"2024-04-25T22:01:13.614023+0000","last_fullsized":"2024-04-25T22:01:13.614023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611219+0000","last_change":"2024-04-25T22:01:13.611219+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611219+0000","last_undegraded":"2024-04-25T22:01:13.611219+0000","last_fullsized":"2024-04-25T22:01:13.611219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608723+0000","last_change":"2024-04-25T22:01:13.608723+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608723+0000","last_undegraded":"2024-04-25T22:01:13.608723+0000","last_fullsized":"2024-04-25T22:01:13.608723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.613395+0000","last_change":"2024-04-25T22:01:13.613395+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.613395+0000","last_undegraded":"2024-04-25T22:01:13.613395+0000","last_fullsized":"2024-04-25T22:01:13.613395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609616+0000","last_change":"2024-04-25T22:01:13.609616+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609616+0000","last_undegraded":"2024-04-25T22:01:13.609616+0000","last_fullsized":"2024-04-25T22:01:13.609616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608470+0000","last_change":"2024-04-25T22:01:13.608470+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608470+0000","last_undegraded":"2024-04-25T22:01:13.608470+0000","last_fullsized":"2024-04-25T22:01:13.608470+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611405+0000","last_change":"2024-04-25T22:01:13.611405+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611405+0000","last_undegraded":"2024-04-25T22:01:13.611405+0000","last_fullsized":"2024-04-25T22:01:13.611405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605009+0000","last_change":"2024-04-25T22:01:13.605009+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605009+0000","last_undegraded":"2024-04-25T22:01:13.605009+0000","last_fullsized":"2024-04-25T22:01:13.605009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611454+0000","last_change":"2024-04-25T22:01:13.611454+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611454+0000","last_undegraded":"2024-04-25T22:01:13.611454+0000","last_fullsized":"2024-04-25T22:01:13.611454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.610237+0000","last_change":"2024-04-25T22:01:13.610237+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.610237+0000","last_undegraded":"2024-04-25T22:01:13.610237+0000","last_fullsized":"2024-04-25T22:01:13.610237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603451+0000","last_change":"2024-04-25T22:01:13.603451+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603451+0000","last_undegraded":"2024-04-25T22:01:13.603451+0000","last_fullsized":"2024-04-25T22:01:13.603451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608424+0000","last_change":"2024-04-25T22:01:13.608424+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608424+0000","last_undegraded":"2024-04-25T22:01:13.608424+0000","last_fullsized":"2024-04-25T22:01:13.608424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609597+0000","last_change":"2024-04-25T22:01:13.609597+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609597+0000","last_undegraded":"2024-04-25T22:01:13.609597+0000","last_fullsized":"2024-04-25T22:01:13.609597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608254+0000","last_change":"2024-04-25T22:01:13.608254+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608254+0000","last_undegraded":"2024-04-25T22:01:13.608254+0000","last_fullsized":"2024-04-25T22:01:13.608254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607798+0000","last_change":"2024-04-25T22:01:13.607798+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607798+0000","last_undegraded":"2024-04-25T22:01:13.607798+0000","last_fullsized":"2024-04-25T22:01:13.607798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608388+0000","last_change":"2024-04-25T22:01:13.608388+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608388+0000","last_undegraded":"2024-04-25T22:01:13.608388+0000","last_fullsized":"2024-04-25T22:01:13.608388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.606067+0000","last_change":"2024-04-25T22:01:13.606067+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.606067+0000","last_undegraded":"2024-04-25T22:01:13.606067+0000","last_fullsized":"2024-04-25T22:01:13.606067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.606119+0000","last_change":"2024-04-25T22:01:13.606119+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.606119+0000","last_undegraded":"2024-04-25T22:01:13.606119+0000","last_fullsized":"2024-04-25T22:01:13.606119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608232+0000","last_change":"2024-04-25T22:01:13.608232+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608232+0000","last_undegraded":"2024-04-25T22:01:13.608232+0000","last_fullsized":"2024-04-25T22:01:13.608232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611441+0000","last_change":"2024-04-25T22:01:13.611441+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611441+0000","last_undegraded":"2024-04-25T22:01:13.611441+0000","last_fullsized":"2024-04-25T22:01:13.611441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603185+0000","last_change":"2024-04-25T22:01:13.603185+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603185+0000","last_undegraded":"2024-04-25T22:01:13.603185+0000","last_fullsized":"2024-04-25T22:01:13.603185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605500+0000","last_change":"2024-04-25T22:01:13.605500+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605500+0000","last_undegraded":"2024-04-25T22:01:13.605500+0000","last_fullsized":"2024-04-25T22:01:13.605500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602983+0000","last_change":"2024-04-25T22:01:13.602983+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602983+0000","last_undegraded":"2024-04-25T22:01:13.602983+0000","last_fullsized":"2024-04-25T22:01:13.602983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605902+0000","last_change":"2024-04-25T22:01:13.605902+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605902+0000","last_undegraded":"2024-04-25T22:01:13.605902+0000","last_fullsized":"2024-04-25T22:01:13.605902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608773+0000","last_change":"2024-04-25T22:01:13.608773+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608773+0000","last_undegraded":"2024-04-25T22:01:13.608773+0000","last_fullsized":"2024-04-25T22:01:13.608773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605777+0000","last_change":"2024-04-25T22:01:13.605777+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605777+0000","last_undegraded":"2024-04-25T22:01:13.605777+0000","last_fullsized":"2024-04-25T22:01:13.605777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.631249+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:01:13.631249+0000","last_peered":"2024-04-25T22:01:13.631249+0000","last_clean":"2024-04-25T22:01:13.631249+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:01:13.631249+0000","last_undegraded":"2024-04-25T22:01:13.631249+0000","last_fullsized":"2024-04-25T22:01:13.631249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603599+0000","last_change":"2024-04-25T22:01:13.603599+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603599+0000","last_undegraded":"2024-04-25T22:01:13.603599+0000","last_fullsized":"2024-04-25T22:01:13.603599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.633159+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:01:13.633159+0000","last_peered":"2024-04-25T22:01:13.633159+0000","last_clean":"2024-04-25T22:01:13.633159+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:01:13.633159+0000","last_undegraded":"2024-04-25T22:01:13.633159+0000","last_fullsized":"2024-04-25T22:01:13.633159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605377+0000","last_change":"2024-04-25T22:01:13.605377+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605377+0000","last_undegraded":"2024-04-25T22:01:13.605377+0000","last_fullsized":"2024-04-25T22:01:13.605377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634474+0000","last_change":"2024-04-25T22:01:13.630817+0000","last_active":"2024-04-25T22:01:13.634474+0000","last_peered":"2024-04-25T22:01:13.634474+0000","last_clean":"2024-04-25T22:01:13.634474+0000","last_became_active":"2024-04-25T22:01:13.629994+0000","last_became_peered":"2024-04-25T22:01:13.629994+0000","last_unstale":"2024-04-25T22:01:13.634474+0000","last_undegraded":"2024-04-25T22:01:13.634474+0000","last_fullsized":"2024-04-25T22:01:13.634474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:35.589006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608618+0000","last_change":"2024-04-25T22:01:13.608618+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608618+0000","last_undegraded":"2024-04-25T22:01:13.608618+0000","last_fullsized":"2024-04-25T22:01:13.608618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635814+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:01:13.635814+0000","last_peered":"2024-04-25T22:01:13.635814+0000","last_clean":"2024-04-25T22:01:13.635814+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:01:13.635814+0000","last_undegraded":"2024-04-25T22:01:13.635814+0000","last_fullsized":"2024-04-25T22:01:13.635814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634187+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:01:13.634187+0000","last_peered":"2024-04-25T22:01:13.634187+0000","last_clean":"2024-04-25T22:01:13.634187+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:01:13.634187+0000","last_undegraded":"2024-04-25T22:01:13.634187+0000","last_fullsized":"2024-04-25T22:01:13.634187+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603204+0000","last_change":"2024-04-25T22:01:13.603204+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603204+0000","last_undegraded":"2024-04-25T22:01:13.603204+0000","last_fullsized":"2024-04-25T22:01:13.603204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634535+0000","last_change":"2024-04-25T22:01:13.631135+0000","last_active":"2024-04-25T22:01:13.634535+0000","last_peered":"2024-04-25T22:01:13.634535+0000","last_clean":"2024-04-25T22:01:13.634535+0000","last_became_active":"2024-04-25T22:01:13.630257+0000","last_became_peered":"2024-04-25T22:01:13.630257+0000","last_unstale":"2024-04-25T22:01:13.634535+0000","last_undegraded":"2024-04-25T22:01:13.634535+0000","last_fullsized":"2024-04-25T22:01:13.634535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:21.030688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608429+0000","last_change":"2024-04-25T22:01:13.608429+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608429+0000","last_undegraded":"2024-04-25T22:01:13.608429+0000","last_fullsized":"2024-04-25T22:01:13.608429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.636211+0000","last_change":"2024-04-25T22:01:13.633106+0000","last_active":"2024-04-25T22:01:13.636211+0000","last_peered":"2024-04-25T22:01:13.636211+0000","last_clean":"2024-04-25T22:01:13.636211+0000","last_became_active":"2024-04-25T22:01:13.631466+0000","last_became_peered":"2024-04-25T22:01:13.631466+0000","last_unstale":"2024-04-25T22:01:13.636211+0000","last_undegraded":"2024-04-25T22:01:13.636211+0000","last_fullsized":"2024-04-25T22:01:13.636211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609053+0000","last_change":"2024-04-25T22:01:13.609053+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609053+0000","last_undegraded":"2024-04-25T22:01:13.609053+0000","last_fullsized":"2024-04-25T22:01:13.609053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.633248+0000","last_change":"2024-04-25T22:01:13.626767+0000","last_active":"2024-04-25T22:01:13.633248+0000","last_peered":"2024-04-25T22:01:13.633248+0000","last_clean":"2024-04-25T22:01:13.633248+0000","last_became_active":"2024-04-25T22:01:13.625984+0000","last_became_peered":"2024-04-25T22:01:13.625984+0000","last_unstale":"2024-04-25T22:01:13.633248+0000","last_undegraded":"2024-04-25T22:01:13.633248+0000","last_fullsized":"2024-04-25T22:01:13.633248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.601099+0000","last_change":"2024-04-25T22:01:13.601099+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.601099+0000","last_undegraded":"2024-04-25T22:01:13.601099+0000","last_fullsized":"2024-04-25T22:01:13.601099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635066+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:01:13.635066+0000","last_peered":"2024-04-25T22:01:13.635066+0000","last_clean":"2024-04-25T22:01:13.635066+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:01:13.635066+0000","last_undegraded":"2024-04-25T22:01:13.635066+0000","last_fullsized":"2024-04-25T22:01:13.635066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608005+0000","last_change":"2024-04-25T22:01:13.608005+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608005+0000","last_undegraded":"2024-04-25T22:01:13.608005+0000","last_fullsized":"2024-04-25T22:01:13.608005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.630969+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:01:13.630969+0000","last_peered":"2024-04-25T22:01:13.630969+0000","last_clean":"2024-04-25T22:01:13.630969+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:01:13.630969+0000","last_undegraded":"2024-04-25T22:01:13.630969+0000","last_fullsized":"2024-04-25T22:01:13.630969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609483+0000","last_change":"2024-04-25T22:01:13.609483+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609483+0000","last_undegraded":"2024-04-25T22:01:13.609483+0000","last_fullsized":"2024-04-25T22:01:13.609483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634560+0000","last_change":"2024-04-25T22:01:13.631439+0000","last_active":"2024-04-25T22:01:13.634560+0000","last_peered":"2024-04-25T22:01:13.634560+0000","last_clean":"2024-04-25T22:01:13.634560+0000","last_became_active":"2024-04-25T22:01:13.630812+0000","last_became_peered":"2024-04-25T22:01:13.630812+0000","last_unstale":"2024-04-25T22:01:13.634560+0000","last_undegraded":"2024-04-25T22:01:13.634560+0000","last_fullsized":"2024-04-25T22:01:13.634560+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:33.145066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.606313+0000","last_change":"2024-04-25T22:01:13.606313+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.606313+0000","last_undegraded":"2024-04-25T22:01:13.606313+0000","last_fullsized":"2024-04-25T22:01:13.606313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.624956+0000","last_change":"2024-04-25T22:01:13.623342+0000","last_active":"2024-04-25T22:01:13.624956+0000","last_peered":"2024-04-25T22:01:13.624956+0000","last_clean":"2024-04-25T22:01:13.624956+0000","last_became_active":"2024-04-25T22:01:13.621460+0000","last_became_peered":"2024-04-25T22:01:13.621460+0000","last_unstale":"2024-04-25T22:01:13.624956+0000","last_undegraded":"2024-04-25T22:01:13.624956+0000","last_fullsized":"2024-04-25T22:01:13.624956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:08.736609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607841+0000","last_change":"2024-04-25T22:01:13.607841+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607841+0000","last_undegraded":"2024-04-25T22:01:13.607841+0000","last_fullsized":"2024-04-25T22:01:13.607841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":218,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.615898+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:01:13.615898+0000","last_peered":"2024-04-25T22:01:13.615898+0000","last_clean":"2024-04-25T22:01:13.615898+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:01:13.615898+0000","last_undegraded":"2024-04-25T22:01:13.615898+0000","last_fullsized":"2024-04-25T22:01:13.615898+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.619094+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:01:13.619094+0000","last_peered":"2024-04-25T22:01:13.619094+0000","last_clean":"2024-04-25T22:01:13.619094+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:01:13.619094+0000","last_undegraded":"2024-04-25T22:01:13.619094+0000","last_fullsized":"2024-04-25T22:01:13.619094+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.621721+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:01:13.621721+0000","last_peered":"2024-04-25T22:01:13.621721+0000","last_clean":"2024-04-25T22:01:13.621721+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:01:13.621721+0000","last_undegraded":"2024-04-25T22:01:13.621721+0000","last_fullsized":"2024-04-25T22:01:13.621721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:33.145066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608134+0000","last_change":"2024-04-25T22:01:13.608134+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608134+0000","last_undegraded":"2024-04-25T22:01:13.608134+0000","last_fullsized":"2024-04-25T22:01:13.608134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.616087+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:01:13.616087+0000","last_peered":"2024-04-25T22:01:13.616087+0000","last_clean":"2024-04-25T22:01:13.616087+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:01:13.616087+0000","last_undegraded":"2024-04-25T22:01:13.616087+0000","last_fullsized":"2024-04-25T22:01:13.616087+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.633181+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:01:13.633181+0000","last_peered":"2024-04-25T22:01:13.633181+0000","last_clean":"2024-04-25T22:01:13.633181+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:01:13.633181+0000","last_undegraded":"2024-04-25T22:01:13.633181+0000","last_fullsized":"2024-04-25T22:01:13.633181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:24.090744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607336+0000","last_change":"2024-04-25T22:01:13.607336+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607336+0000","last_undegraded":"2024-04-25T22:01:13.607336+0000","last_fullsized":"2024-04-25T22:01:13.607336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.610038+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:01:13.610038+0000","last_peered":"2024-04-25T22:01:13.610038+0000","last_clean":"2024-04-25T22:01:13.610038+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:01:13.610038+0000","last_undegraded":"2024-04-25T22:01:13.610038+0000","last_fullsized":"2024-04-25T22:01:13.610038+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.637479+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:01:13.637479+0000","last_peered":"2024-04-25T22:01:13.637479+0000","last_clean":"2024-04-25T22:01:13.637479+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:01:13.637479+0000","last_undegraded":"2024-04-25T22:01:13.637479+0000","last_fullsized":"2024-04-25T22:01:13.637479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:54.536138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605986+0000","last_change":"2024-04-25T22:01:13.605986+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605986+0000","last_undegraded":"2024-04-25T22:01:13.605986+0000","last_fullsized":"2024-04-25T22:01:13.605986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.616901+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:01:13.616901+0000","last_peered":"2024-04-25T22:01:13.616901+0000","last_clean":"2024-04-25T22:01:13.616901+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:01:13.616901+0000","last_undegraded":"2024-04-25T22:01:13.616901+0000","last_fullsized":"2024-04-25T22:01:13.616901+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.631211+0000","last_change":"2024-04-25T22:01:13.627274+0000","last_active":"2024-04-25T22:01:13.631211+0000","last_peered":"2024-04-25T22:01:13.631211+0000","last_clean":"2024-04-25T22:01:13.631211+0000","last_became_active":"2024-04-25T22:01:13.626015+0000","last_became_peered":"2024-04-25T22:01:13.626015+0000","last_unstale":"2024-04-25T22:01:13.631211+0000","last_undegraded":"2024-04-25T22:01:13.631211+0000","last_fullsized":"2024-04-25T22:01:13.631211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602890+0000","last_change":"2024-04-25T22:01:13.602890+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602890+0000","last_undegraded":"2024-04-25T22:01:13.602890+0000","last_fullsized":"2024-04-25T22:01:13.602890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.632246+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:01:13.632246+0000","last_peered":"2024-04-25T22:01:13.632246+0000","last_clean":"2024-04-25T22:01:13.632246+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:01:13.632246+0000","last_undegraded":"2024-04-25T22:01:13.632246+0000","last_fullsized":"2024-04-25T22:01:13.632246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.610509+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:01:13.610509+0000","last_peered":"2024-04-25T22:01:13.610509+0000","last_clean":"2024-04-25T22:01:13.610509+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:01:13.610509+0000","last_undegraded":"2024-04-25T22:01:13.610509+0000","last_fullsized":"2024-04-25T22:01:13.610509+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605712+0000","last_change":"2024-04-25T22:01:13.605712+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605712+0000","last_undegraded":"2024-04-25T22:01:13.605712+0000","last_fullsized":"2024-04-25T22:01:13.605712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.621905+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:01:13.621905+0000","last_peered":"2024-04-25T22:01:13.621905+0000","last_clean":"2024-04-25T22:01:13.621905+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:01:13.621905+0000","last_undegraded":"2024-04-25T22:01:13.621905+0000","last_fullsized":"2024-04-25T22:01:13.621905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:21.030688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.614917+0000","last_change":"2024-04-25T22:01:09.582204+0000","last_active":"2024-04-25T22:01:13.614917+0000","last_peered":"2024-04-25T22:01:13.614917+0000","last_clean":"2024-04-25T22:01:13.614917+0000","last_became_active":"2024-04-25T22:01:09.581494+0000","last_became_peered":"2024-04-25T22:01:09.581494+0000","last_unstale":"2024-04-25T22:01:13.614917+0000","last_undegraded":"2024-04-25T22:01:13.614917+0000","last_fullsized":"2024-04-25T22:01:13.614917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:13.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605487+0000","last_change":"2024-04-25T22:01:13.605487+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605487+0000","last_undegraded":"2024-04-25T22:01:13.605487+0000","last_fullsized":"2024-04-25T22:01:13.605487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.622413+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:01:13.622413+0000","last_peered":"2024-04-25T22:01:13.622413+0000","last_clean":"2024-04-25T22:01:13.622413+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:01:13.622413+0000","last_undegraded":"2024-04-25T22:01:13.622413+0000","last_fullsized":"2024-04-25T22:01:13.622413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:00.088977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.610801+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:01:13.610801+0000","last_peered":"2024-04-25T22:01:13.610801+0000","last_clean":"2024-04-25T22:01:13.610801+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:01:13.610801+0000","last_undegraded":"2024-04-25T22:01:13.610801+0000","last_fullsized":"2024-04-25T22:01:13.610801+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.600883+0000","last_change":"2024-04-25T22:01:13.600883+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.600883+0000","last_undegraded":"2024-04-25T22:01:13.600883+0000","last_fullsized":"2024-04-25T22:01:13.600883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635210+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:01:13.635210+0000","last_peered":"2024-04-25T22:01:13.635210+0000","last_clean":"2024-04-25T22:01:13.635210+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:01:13.635210+0000","last_undegraded":"2024-04-25T22:01:13.635210+0000","last_fullsized":"2024-04-25T22:01:13.635210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.619699+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:01:13.619699+0000","last_peered":"2024-04-25T22:01:13.619699+0000","last_clean":"2024-04-25T22:01:13.619699+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:01:13.619699+0000","last_undegraded":"2024-04-25T22:01:13.619699+0000","last_fullsized":"2024-04-25T22:01:13.619699+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.606151+0000","last_change":"2024-04-25T22:01:13.606151+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.606151+0000","last_undegraded":"2024-04-25T22:01:13.606151+0000","last_fullsized":"2024-04-25T22:01:13.606151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609691+0000","last_change":"2024-04-25T22:01:13.609691+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609691+0000","last_undegraded":"2024-04-25T22:01:13.609691+0000","last_fullsized":"2024-04-25T22:01:13.609691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.636141+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:01:13.636141+0000","last_peered":"2024-04-25T22:01:13.636141+0000","last_clean":"2024-04-25T22:01:13.636141+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:01:13.636141+0000","last_undegraded":"2024-04-25T22:01:13.636141+0000","last_fullsized":"2024-04-25T22:01:13.636141+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602940+0000","last_change":"2024-04-25T22:01:13.602940+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602940+0000","last_undegraded":"2024-04-25T22:01:13.602940+0000","last_fullsized":"2024-04-25T22:01:13.602940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.637506+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:01:13.637506+0000","last_peered":"2024-04-25T22:01:13.637506+0000","last_clean":"2024-04-25T22:01:13.637506+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:01:13.637506+0000","last_undegraded":"2024-04-25T22:01:13.637506+0000","last_fullsized":"2024-04-25T22:01:13.637506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:57.523272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.630640+0000","last_change":"2024-04-25T22:01:13.626710+0000","last_active":"2024-04-25T22:01:13.630640+0000","last_peered":"2024-04-25T22:01:13.630640+0000","last_clean":"2024-04-25T22:01:13.630640+0000","last_became_active":"2024-04-25T22:01:13.625898+0000","last_became_peered":"2024-04-25T22:01:13.625898+0000","last_unstale":"2024-04-25T22:01:13.630640+0000","last_undegraded":"2024-04-25T22:01:13.630640+0000","last_fullsized":"2024-04-25T22:01:13.630640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:24.090744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603111+0000","last_change":"2024-04-25T22:01:13.603111+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603111+0000","last_undegraded":"2024-04-25T22:01:13.603111+0000","last_fullsized":"2024-04-25T22:01:13.603111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635068+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:01:13.635068+0000","last_peered":"2024-04-25T22:01:13.635068+0000","last_clean":"2024-04-25T22:01:13.635068+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:01:13.635068+0000","last_undegraded":"2024-04-25T22:01:13.635068+0000","last_fullsized":"2024-04-25T22:01:13.635068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603720+0000","last_change":"2024-04-25T22:01:13.603720+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603720+0000","last_undegraded":"2024-04-25T22:01:13.603720+0000","last_fullsized":"2024-04-25T22:01:13.603720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603464+0000","last_change":"2024-04-25T22:01:13.603464+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603464+0000","last_undegraded":"2024-04-25T22:01:13.603464+0000","last_fullsized":"2024-04-25T22:01:13.603464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.624075+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:01:13.624075+0000","last_peered":"2024-04-25T22:01:13.624075+0000","last_clean":"2024-04-25T22:01:13.624075+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:01:13.624075+0000","last_undegraded":"2024-04-25T22:01:13.624075+0000","last_fullsized":"2024-04-25T22:01:13.624075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:57.523272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607287+0000","last_change":"2024-04-25T22:01:13.607287+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607287+0000","last_undegraded":"2024-04-25T22:01:13.607287+0000","last_fullsized":"2024-04-25T22:01:13.607287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634026+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:01:13.634026+0000","last_peered":"2024-04-25T22:01:13.634026+0000","last_clean":"2024-04-25T22:01:13.634026+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:01:13.634026+0000","last_undegraded":"2024-04-25T22:01:13.634026+0000","last_fullsized":"2024-04-25T22:01:13.634026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607500+0000","last_change":"2024-04-25T22:01:13.607500+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607500+0000","last_undegraded":"2024-04-25T22:01:13.607500+0000","last_fullsized":"2024-04-25T22:01:13.607500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.624192+0000","last_change":"2024-04-25T22:01:13.621997+0000","last_active":"2024-04-25T22:01:13.624192+0000","last_peered":"2024-04-25T22:01:13.624192+0000","last_clean":"2024-04-25T22:01:13.624192+0000","last_became_active":"2024-04-25T22:01:13.620987+0000","last_became_peered":"2024-04-25T22:01:13.620987+0000","last_unstale":"2024-04-25T22:01:13.624192+0000","last_undegraded":"2024-04-25T22:01:13.624192+0000","last_fullsized":"2024-04-25T22:01:13.624192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:28.906539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607919+0000","last_change":"2024-04-25T22:01:13.607919+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607919+0000","last_undegraded":"2024-04-25T22:01:13.607919+0000","last_fullsized":"2024-04-25T22:01:13.607919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.637455+0000","last_change":"2024-04-25T22:01:13.631562+0000","last_active":"2024-04-25T22:01:13.637455+0000","last_peered":"2024-04-25T22:01:13.637455+0000","last_clean":"2024-04-25T22:01:13.637455+0000","last_became_active":"2024-04-25T22:01:13.630731+0000","last_became_peered":"2024-04-25T22:01:13.630731+0000","last_unstale":"2024-04-25T22:01:13.637455+0000","last_undegraded":"2024-04-25T22:01:13.637455+0000","last_fullsized":"2024-04-25T22:01:13.637455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:00.088977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611663+0000","last_change":"2024-04-25T22:01:13.611663+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611663+0000","last_undegraded":"2024-04-25T22:01:13.611663+0000","last_fullsized":"2024-04-25T22:01:13.611663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.633307+0000","last_change":"2024-04-25T22:01:13.628356+0000","last_active":"2024-04-25T22:01:13.633307+0000","last_peered":"2024-04-25T22:01:13.633307+0000","last_clean":"2024-04-25T22:01:13.633307+0000","last_became_active":"2024-04-25T22:01:13.626608+0000","last_became_peered":"2024-04-25T22:01:13.626608+0000","last_unstale":"2024-04-25T22:01:13.633307+0000","last_undegraded":"2024-04-25T22:01:13.633307+0000","last_fullsized":"2024-04-25T22:01:13.633307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605771+0000","last_change":"2024-04-25T22:01:13.605771+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605771+0000","last_undegraded":"2024-04-25T22:01:13.605771+0000","last_fullsized":"2024-04-25T22:01:13.605771+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.632017+0000","last_change":"2024-04-25T22:01:13.630502+0000","last_active":"2024-04-25T22:01:13.632017+0000","last_peered":"2024-04-25T22:01:13.632017+0000","last_clean":"2024-04-25T22:01:13.632017+0000","last_became_active":"2024-04-25T22:01:13.629854+0000","last_became_peered":"2024-04-25T22:01:13.629854+0000","last_unstale":"2024-04-25T22:01:13.632017+0000","last_undegraded":"2024-04-25T22:01:13.632017+0000","last_fullsized":"2024-04-25T22:01:13.632017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:50.391570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602887+0000","last_change":"2024-04-25T22:01:13.602887+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602887+0000","last_undegraded":"2024-04-25T22:01:13.602887+0000","last_fullsized":"2024-04-25T22:01:13.602887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.622486+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:01:13.622486+0000","last_peered":"2024-04-25T22:01:13.622486+0000","last_clean":"2024-04-25T22:01:13.622486+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:01:13.622486+0000","last_undegraded":"2024-04-25T22:01:13.622486+0000","last_fullsized":"2024-04-25T22:01:13.622486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:54.536138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.604554+0000","last_change":"2024-04-25T22:01:13.604554+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.604554+0000","last_undegraded":"2024-04-25T22:01:13.604554+0000","last_fullsized":"2024-04-25T22:01:13.604554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635142+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:01:13.635142+0000","last_peered":"2024-04-25T22:01:13.635142+0000","last_clean":"2024-04-25T22:01:13.635142+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:01:13.635142+0000","last_undegraded":"2024-04-25T22:01:13.635142+0000","last_fullsized":"2024-04-25T22:01:13.635142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":188416,"data_stored":631301,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":131072,"data_stored":40933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":188416,"data_stored":631301,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:01:18.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-04-25T22:01:18.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.608829+0000', 'last_change': '2024-04-25T22:01:13.608829+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.608829+0000', 'last_undegraded': '2024-04-25T22:01:13.608829+0000', 'last_fullsized': '2024-04-25T22:01:13.608829+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-04-25T22:01:18.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.609806+0000', 'last_change': '2024-04-25T22:01:13.609806+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.609806+0000', 'last_undegraded': '2024-04-25T22:01:13.609806+0000', 'last_fullsized': '2024-04-25T22:01:13.609806+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-04-25T22:01:18.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.614839+0000', 'last_change': '2024-04-25T22:01:13.614839+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.614839+0000', 'last_undegraded': '2024-04-25T22:01:13.614839+0000', 'last_fullsized': '2024-04-25T22:01:13.614839+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-04-25T22:01:18.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.611565+0000', 'last_change': '2024-04-25T22:01:13.611565+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.611565+0000', 'last_undegraded': '2024-04-25T22:01:13.611565+0000', 'last_fullsized': '2024-04-25T22:01:13.611565+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-04-25T22:01:18.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.602834+0000', 'last_change': '2024-04-25T22:01:13.602834+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.602834+0000', 'last_undegraded': '2024-04-25T22:01:13.602834+0000', 'last_fullsized': '2024-04-25T22:01:13.602834+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-04-25T22:01:18.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.613472+0000', 'last_change': '2024-04-25T22:01:13.613472+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.613472+0000', 'last_undegraded': '2024-04-25T22:01:13.613472+0000', 'last_fullsized': '2024-04-25T22:01:13.613472+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-04-25T22:01:18.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.607761+0000', 'last_change': '2024-04-25T22:01:13.607761+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.607761+0000', 'last_undegraded': '2024-04-25T22:01:13.607761+0000', 'last_fullsized': '2024-04-25T22:01:13.607761+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-04-25T22:01:18.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.614023+0000', 'last_change': '2024-04-25T22:01:13.614023+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.614023+0000', 'last_undegraded': '2024-04-25T22:01:13.614023+0000', 'last_fullsized': '2024-04-25T22:01:13.614023+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-04-25T22:01:18.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.611219+0000', 'last_change': '2024-04-25T22:01:13.611219+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.611219+0000', 'last_undegraded': '2024-04-25T22:01:13.611219+0000', 'last_fullsized': '2024-04-25T22:01:13.611219+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:01:18.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-04-25T22:01:18.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.608723+0000', 'last_change': '2024-04-25T22:01:13.608723+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.608723+0000', 'last_undegraded': '2024-04-25T22:01:13.608723+0000', 'last_fullsized': '2024-04-25T22:01:13.608723+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-04-25T22:01:18.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.613395+0000', 'last_change': '2024-04-25T22:01:13.613395+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.613395+0000', 'last_undegraded': '2024-04-25T22:01:13.613395+0000', 'last_fullsized': '2024-04-25T22:01:13.613395+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-04-25T22:01:18.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.609616+0000', 'last_change': '2024-04-25T22:01:13.609616+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.609616+0000', 'last_undegraded': '2024-04-25T22:01:13.609616+0000', 'last_fullsized': '2024-04-25T22:01:13.609616+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-04-25T22:01:18.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.608470+0000', 'last_change': '2024-04-25T22:01:13.608470+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.608470+0000', 'last_undegraded': '2024-04-25T22:01:13.608470+0000', 'last_fullsized': '2024-04-25T22:01:13.608470+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-04-25T22:01:18.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.611405+0000', 'last_change': '2024-04-25T22:01:13.611405+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.611405+0000', 'last_undegraded': '2024-04-25T22:01:13.611405+0000', 'last_fullsized': '2024-04-25T22:01:13.611405+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-04-25T22:01:18.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.605009+0000', 'last_change': '2024-04-25T22:01:13.605009+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.605009+0000', 'last_undegraded': '2024-04-25T22:01:13.605009+0000', 'last_fullsized': '2024-04-25T22:01:13.605009+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-04-25T22:01:18.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.611454+0000', 'last_change': '2024-04-25T22:01:13.611454+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.611454+0000', 'last_undegraded': '2024-04-25T22:01:13.611454+0000', 'last_fullsized': '2024-04-25T22:01:13.611454+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-04-25T22:01:18.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.610237+0000', 'last_change': '2024-04-25T22:01:13.610237+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.610237+0000', 'last_undegraded': '2024-04-25T22:01:13.610237+0000', 'last_fullsized': '2024-04-25T22:01:13.610237+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:01:18.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-04-25T22:01:18.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.603451+0000', 'last_change': '2024-04-25T22:01:13.603451+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.603451+0000', 'last_undegraded': '2024-04-25T22:01:13.603451+0000', 'last_fullsized': '2024-04-25T22:01:13.603451+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-04-25T22:01:18.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.608424+0000', 'last_change': '2024-04-25T22:01:13.608424+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.608424+0000', 'last_undegraded': '2024-04-25T22:01:13.608424+0000', 'last_fullsized': '2024-04-25T22:01:13.608424+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:01:18.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-04-25T22:01:18.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.609597+0000', 'last_change': '2024-04-25T22:01:13.609597+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.609597+0000', 'last_undegraded': '2024-04-25T22:01:13.609597+0000', 'last_fullsized': '2024-04-25T22:01:13.609597+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-04-25T22:01:18.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.608254+0000', 'last_change': '2024-04-25T22:01:13.608254+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.608254+0000', 'last_undegraded': '2024-04-25T22:01:13.608254+0000', 'last_fullsized': '2024-04-25T22:01:13.608254+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-04-25T22:01:18.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.607798+0000', 'last_change': '2024-04-25T22:01:13.607798+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.607798+0000', 'last_undegraded': '2024-04-25T22:01:13.607798+0000', 'last_fullsized': '2024-04-25T22:01:13.607798+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-04-25T22:01:18.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.608388+0000', 'last_change': '2024-04-25T22:01:13.608388+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.608388+0000', 'last_undegraded': '2024-04-25T22:01:13.608388+0000', 'last_fullsized': '2024-04-25T22:01:13.608388+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:01:18.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-04-25T22:01:18.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.606067+0000', 'last_change': '2024-04-25T22:01:13.606067+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.606067+0000', 'last_undegraded': '2024-04-25T22:01:13.606067+0000', 'last_fullsized': '2024-04-25T22:01:13.606067+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-04-25T22:01:18.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.606119+0000', 'last_change': '2024-04-25T22:01:13.606119+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.606119+0000', 'last_undegraded': '2024-04-25T22:01:13.606119+0000', 'last_fullsized': '2024-04-25T22:01:13.606119+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-04-25T22:01:18.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.608232+0000', 'last_change': '2024-04-25T22:01:13.608232+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.608232+0000', 'last_undegraded': '2024-04-25T22:01:13.608232+0000', 'last_fullsized': '2024-04-25T22:01:13.608232+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:01:18.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-04-25T22:01:18.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.611441+0000', 'last_change': '2024-04-25T22:01:13.611441+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.611441+0000', 'last_undegraded': '2024-04-25T22:01:13.611441+0000', 'last_fullsized': '2024-04-25T22:01:13.611441+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-04-25T22:01:18.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.603185+0000', 'last_change': '2024-04-25T22:01:13.603185+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.603185+0000', 'last_undegraded': '2024-04-25T22:01:13.603185+0000', 'last_fullsized': '2024-04-25T22:01:13.603185+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-04-25T22:01:18.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.605500+0000', 'last_change': '2024-04-25T22:01:13.605500+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.605500+0000', 'last_undegraded': '2024-04-25T22:01:13.605500+0000', 'last_fullsized': '2024-04-25T22:01:13.605500+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:01:18.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-04-25T22:01:18.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.602983+0000', 'last_change': '2024-04-25T22:01:13.602983+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.602983+0000', 'last_undegraded': '2024-04-25T22:01:13.602983+0000', 'last_fullsized': '2024-04-25T22:01:13.602983+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-04-25T22:01:18.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.605902+0000', 'last_change': '2024-04-25T22:01:13.605902+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.605902+0000', 'last_undegraded': '2024-04-25T22:01:13.605902+0000', 'last_fullsized': '2024-04-25T22:01:13.605902+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:01:18.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-04-25T22:01:18.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.608773+0000', 'last_change': '2024-04-25T22:01:13.608773+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.608773+0000', 'last_undegraded': '2024-04-25T22:01:13.608773+0000', 'last_fullsized': '2024-04-25T22:01:13.608773+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-25T22:01:18.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.605777+0000', 'last_change': '2024-04-25T22:01:13.605777+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.605777+0000', 'last_undegraded': '2024-04-25T22:01:13.605777+0000', 'last_fullsized': '2024-04-25T22:01:13.605777+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-25T22:01:18.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.603599+0000', 'last_change': '2024-04-25T22:01:13.603599+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.603599+0000', 'last_undegraded': '2024-04-25T22:01:13.603599+0000', 'last_fullsized': '2024-04-25T22:01:13.603599+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-25T22:01:18.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.605377+0000', 'last_change': '2024-04-25T22:01:13.605377+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.605377+0000', 'last_undegraded': '2024-04-25T22:01:13.605377+0000', 'last_fullsized': '2024-04-25T22:01:13.605377+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:01:18.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-25T22:01:18.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.608618+0000', 'last_change': '2024-04-25T22:01:13.608618+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.608618+0000', 'last_undegraded': '2024-04-25T22:01:13.608618+0000', 'last_fullsized': '2024-04-25T22:01:13.608618+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:01:18.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-25T22:01:18.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.603204+0000', 'last_change': '2024-04-25T22:01:13.603204+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.603204+0000', 'last_undegraded': '2024-04-25T22:01:13.603204+0000', 'last_fullsized': '2024-04-25T22:01:13.603204+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-25T22:01:18.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.608429+0000', 'last_change': '2024-04-25T22:01:13.608429+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.608429+0000', 'last_undegraded': '2024-04-25T22:01:13.608429+0000', 'last_fullsized': '2024-04-25T22:01:13.608429+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-25T22:01:18.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.609053+0000', 'last_change': '2024-04-25T22:01:13.609053+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.609053+0000', 'last_undegraded': '2024-04-25T22:01:13.609053+0000', 'last_fullsized': '2024-04-25T22:01:13.609053+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-25T22:01:18.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.601099+0000', 'last_change': '2024-04-25T22:01:13.601099+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.601099+0000', 'last_undegraded': '2024-04-25T22:01:13.601099+0000', 'last_fullsized': '2024-04-25T22:01:13.601099+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:01:18.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-25T22:01:18.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.608005+0000', 'last_change': '2024-04-25T22:01:13.608005+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.608005+0000', 'last_undegraded': '2024-04-25T22:01:13.608005+0000', 'last_fullsized': '2024-04-25T22:01:13.608005+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-25T22:01:18.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.609483+0000', 'last_change': '2024-04-25T22:01:13.609483+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.609483+0000', 'last_undegraded': '2024-04-25T22:01:13.609483+0000', 'last_fullsized': '2024-04-25T22:01:13.609483+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-25T22:01:18.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.606313+0000', 'last_change': '2024-04-25T22:01:13.606313+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.606313+0000', 'last_undegraded': '2024-04-25T22:01:13.606313+0000', 'last_fullsized': '2024-04-25T22:01:13.606313+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-25T22:01:18.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.607841+0000', 'last_change': '2024-04-25T22:01:13.607841+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.607841+0000', 'last_undegraded': '2024-04-25T22:01:13.607841+0000', 'last_fullsized': '2024-04-25T22:01:13.607841+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:01:18.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-25T22:01:18.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.608134+0000', 'last_change': '2024-04-25T22:01:13.608134+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.608134+0000', 'last_undegraded': '2024-04-25T22:01:13.608134+0000', 'last_fullsized': '2024-04-25T22:01:13.608134+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-25T22:01:18.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.607336+0000', 'last_change': '2024-04-25T22:01:13.607336+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.607336+0000', 'last_undegraded': '2024-04-25T22:01:13.607336+0000', 'last_fullsized': '2024-04-25T22:01:13.607336+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-25T22:01:18.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.605986+0000', 'last_change': '2024-04-25T22:01:13.605986+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.605986+0000', 'last_undegraded': '2024-04-25T22:01:13.605986+0000', 'last_fullsized': '2024-04-25T22:01:13.605986+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:01:18.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-25T22:01:18.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.602890+0000', 'last_change': '2024-04-25T22:01:13.602890+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.602890+0000', 'last_undegraded': '2024-04-25T22:01:13.602890+0000', 'last_fullsized': '2024-04-25T22:01:13.602890+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:01:18.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-25T22:01:18.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.605712+0000', 'last_change': '2024-04-25T22:01:13.605712+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.605712+0000', 'last_undegraded': '2024-04-25T22:01:13.605712+0000', 'last_fullsized': '2024-04-25T22:01:13.605712+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-25T22:01:18.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.605487+0000', 'last_change': '2024-04-25T22:01:13.605487+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.605487+0000', 'last_undegraded': '2024-04-25T22:01:13.605487+0000', 'last_fullsized': '2024-04-25T22:01:13.605487+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-25T22:01:18.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.600883+0000', 'last_change': '2024-04-25T22:01:13.600883+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.600883+0000', 'last_undegraded': '2024-04-25T22:01:13.600883+0000', 'last_fullsized': '2024-04-25T22:01:13.600883+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:01:18.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-25T22:01:18.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.606151+0000', 'last_change': '2024-04-25T22:01:13.606151+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.606151+0000', 'last_undegraded': '2024-04-25T22:01:13.606151+0000', 'last_fullsized': '2024-04-25T22:01:13.606151+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-25T22:01:18.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.609691+0000', 'last_change': '2024-04-25T22:01:13.609691+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.609691+0000', 'last_undegraded': '2024-04-25T22:01:13.609691+0000', 'last_fullsized': '2024-04-25T22:01:13.609691+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-25T22:01:18.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.602940+0000', 'last_change': '2024-04-25T22:01:13.602940+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.602940+0000', 'last_undegraded': '2024-04-25T22:01:13.602940+0000', 'last_fullsized': '2024-04-25T22:01:13.602940+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:01:18.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-25T22:01:18.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.603111+0000', 'last_change': '2024-04-25T22:01:13.603111+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.603111+0000', 'last_undegraded': '2024-04-25T22:01:13.603111+0000', 'last_fullsized': '2024-04-25T22:01:13.603111+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:01:18.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-25T22:01:18.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.603720+0000', 'last_change': '2024-04-25T22:01:13.603720+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.603720+0000', 'last_undegraded': '2024-04-25T22:01:13.603720+0000', 'last_fullsized': '2024-04-25T22:01:13.603720+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:01:18.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-25T22:01:18.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.603464+0000', 'last_change': '2024-04-25T22:01:13.603464+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.603464+0000', 'last_undegraded': '2024-04-25T22:01:13.603464+0000', 'last_fullsized': '2024-04-25T22:01:13.603464+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-25T22:01:18.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.607287+0000', 'last_change': '2024-04-25T22:01:13.607287+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.607287+0000', 'last_undegraded': '2024-04-25T22:01:13.607287+0000', 'last_fullsized': '2024-04-25T22:01:13.607287+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T22:01:18.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-25T22:01:18.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.607500+0000', 'last_change': '2024-04-25T22:01:13.607500+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.607500+0000', 'last_undegraded': '2024-04-25T22:01:13.607500+0000', 'last_fullsized': '2024-04-25T22:01:13.607500+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-25T22:01:18.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.607919+0000', 'last_change': '2024-04-25T22:01:13.607919+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.607919+0000', 'last_undegraded': '2024-04-25T22:01:13.607919+0000', 'last_fullsized': '2024-04-25T22:01:13.607919+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-25T22:01:18.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.611663+0000', 'last_change': '2024-04-25T22:01:13.611663+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.611663+0000', 'last_undegraded': '2024-04-25T22:01:13.611663+0000', 'last_fullsized': '2024-04-25T22:01:13.611663+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-25T22:01:18.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.605771+0000', 'last_change': '2024-04-25T22:01:13.605771+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.605771+0000', 'last_undegraded': '2024-04-25T22:01:13.605771+0000', 'last_fullsized': '2024-04-25T22:01:13.605771+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-25T22:01:18.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.602887+0000', 'last_change': '2024-04-25T22:01:13.602887+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.602887+0000', 'last_undegraded': '2024-04-25T22:01:13.602887+0000', 'last_fullsized': '2024-04-25T22:01:13.602887+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T22:01:18.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-25T22:01:18.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-04-25T22:01:13.604554+0000', 'last_change': '2024-04-25T22:01:13.604554+0000', 'last_active': '2024-04-25T22:01:13.590422+0000', 'last_peered': '2024-04-25T22:01:13.590422+0000', 'last_clean': '2024-04-25T22:01:13.590422+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:01:13.604554+0000', 'last_undegraded': '2024-04-25T22:01:13.604554+0000', 'last_fullsized': '2024-04-25T22:01:13.604554+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'last_clean_scrub_stamp': '2024-04-25T22:01:13.590422+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T22:01:18.388 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T22:01:18.769 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:18.769 INFO:teuthology.orchestra.run.smithi044.stdout:{"fsid":"1ced109c-704f-44b1-9811-a2da74898889","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":26,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":18,"num_osds":3,"num_up_osds":3,"osd_up_since":1714082463,"num_in_osds":3,"osd_in_since":1714082453,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":92045312,"bytes_avail":289818247168,"bytes_total":289910292480,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4205}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-25T22:00:52.028817+0000","services":{}},"progress_events":{}} 2024-04-25T22:01:18.786 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T22:01:18.786 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:01:19.100 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:19.101 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:01:19.115 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-25T22:01:17.562326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89888,"kb_used_data":496,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025632,"statfs":{"total":289910292480,"available":289818247168,"internally_reserved":0,"allocated":507904,"data_stored":1303535,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.970405"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608829+0000","last_change":"2024-04-25T22:01:13.608829+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608829+0000","last_undegraded":"2024-04-25T22:01:13.608829+0000","last_fullsized":"2024-04-25T22:01:13.608829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609806+0000","last_change":"2024-04-25T22:01:13.609806+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609806+0000","last_undegraded":"2024-04-25T22:01:13.609806+0000","last_fullsized":"2024-04-25T22:01:13.609806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.614839+0000","last_change":"2024-04-25T22:01:13.614839+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.614839+0000","last_undegraded":"2024-04-25T22:01:13.614839+0000","last_fullsized":"2024-04-25T22:01:13.614839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611565+0000","last_change":"2024-04-25T22:01:13.611565+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611565+0000","last_undegraded":"2024-04-25T22:01:13.611565+0000","last_fullsized":"2024-04-25T22:01:13.611565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602834+0000","last_change":"2024-04-25T22:01:13.602834+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602834+0000","last_undegraded":"2024-04-25T22:01:13.602834+0000","last_fullsized":"2024-04-25T22:01:13.602834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.613472+0000","last_change":"2024-04-25T22:01:13.613472+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.613472+0000","last_undegraded":"2024-04-25T22:01:13.613472+0000","last_fullsized":"2024-04-25T22:01:13.613472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607761+0000","last_change":"2024-04-25T22:01:13.607761+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607761+0000","last_undegraded":"2024-04-25T22:01:13.607761+0000","last_fullsized":"2024-04-25T22:01:13.607761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.614023+0000","last_change":"2024-04-25T22:01:13.614023+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.614023+0000","last_undegraded":"2024-04-25T22:01:13.614023+0000","last_fullsized":"2024-04-25T22:01:13.614023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611219+0000","last_change":"2024-04-25T22:01:13.611219+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611219+0000","last_undegraded":"2024-04-25T22:01:13.611219+0000","last_fullsized":"2024-04-25T22:01:13.611219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608723+0000","last_change":"2024-04-25T22:01:13.608723+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608723+0000","last_undegraded":"2024-04-25T22:01:13.608723+0000","last_fullsized":"2024-04-25T22:01:13.608723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.613395+0000","last_change":"2024-04-25T22:01:13.613395+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.613395+0000","last_undegraded":"2024-04-25T22:01:13.613395+0000","last_fullsized":"2024-04-25T22:01:13.613395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609616+0000","last_change":"2024-04-25T22:01:13.609616+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609616+0000","last_undegraded":"2024-04-25T22:01:13.609616+0000","last_fullsized":"2024-04-25T22:01:13.609616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608470+0000","last_change":"2024-04-25T22:01:13.608470+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608470+0000","last_undegraded":"2024-04-25T22:01:13.608470+0000","last_fullsized":"2024-04-25T22:01:13.608470+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611405+0000","last_change":"2024-04-25T22:01:13.611405+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611405+0000","last_undegraded":"2024-04-25T22:01:13.611405+0000","last_fullsized":"2024-04-25T22:01:13.611405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605009+0000","last_change":"2024-04-25T22:01:13.605009+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605009+0000","last_undegraded":"2024-04-25T22:01:13.605009+0000","last_fullsized":"2024-04-25T22:01:13.605009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611454+0000","last_change":"2024-04-25T22:01:13.611454+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611454+0000","last_undegraded":"2024-04-25T22:01:13.611454+0000","last_fullsized":"2024-04-25T22:01:13.611454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.610237+0000","last_change":"2024-04-25T22:01:13.610237+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.610237+0000","last_undegraded":"2024-04-25T22:01:13.610237+0000","last_fullsized":"2024-04-25T22:01:13.610237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603451+0000","last_change":"2024-04-25T22:01:13.603451+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603451+0000","last_undegraded":"2024-04-25T22:01:13.603451+0000","last_fullsized":"2024-04-25T22:01:13.603451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608424+0000","last_change":"2024-04-25T22:01:13.608424+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608424+0000","last_undegraded":"2024-04-25T22:01:13.608424+0000","last_fullsized":"2024-04-25T22:01:13.608424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609597+0000","last_change":"2024-04-25T22:01:13.609597+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609597+0000","last_undegraded":"2024-04-25T22:01:13.609597+0000","last_fullsized":"2024-04-25T22:01:13.609597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608254+0000","last_change":"2024-04-25T22:01:13.608254+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608254+0000","last_undegraded":"2024-04-25T22:01:13.608254+0000","last_fullsized":"2024-04-25T22:01:13.608254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607798+0000","last_change":"2024-04-25T22:01:13.607798+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607798+0000","last_undegraded":"2024-04-25T22:01:13.607798+0000","last_fullsized":"2024-04-25T22:01:13.607798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608388+0000","last_change":"2024-04-25T22:01:13.608388+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608388+0000","last_undegraded":"2024-04-25T22:01:13.608388+0000","last_fullsized":"2024-04-25T22:01:13.608388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.606067+0000","last_change":"2024-04-25T22:01:13.606067+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.606067+0000","last_undegraded":"2024-04-25T22:01:13.606067+0000","last_fullsized":"2024-04-25T22:01:13.606067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.606119+0000","last_change":"2024-04-25T22:01:13.606119+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.606119+0000","last_undegraded":"2024-04-25T22:01:13.606119+0000","last_fullsized":"2024-04-25T22:01:13.606119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608232+0000","last_change":"2024-04-25T22:01:13.608232+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608232+0000","last_undegraded":"2024-04-25T22:01:13.608232+0000","last_fullsized":"2024-04-25T22:01:13.608232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611441+0000","last_change":"2024-04-25T22:01:13.611441+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611441+0000","last_undegraded":"2024-04-25T22:01:13.611441+0000","last_fullsized":"2024-04-25T22:01:13.611441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603185+0000","last_change":"2024-04-25T22:01:13.603185+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603185+0000","last_undegraded":"2024-04-25T22:01:13.603185+0000","last_fullsized":"2024-04-25T22:01:13.603185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605500+0000","last_change":"2024-04-25T22:01:13.605500+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605500+0000","last_undegraded":"2024-04-25T22:01:13.605500+0000","last_fullsized":"2024-04-25T22:01:13.605500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602983+0000","last_change":"2024-04-25T22:01:13.602983+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602983+0000","last_undegraded":"2024-04-25T22:01:13.602983+0000","last_fullsized":"2024-04-25T22:01:13.602983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605902+0000","last_change":"2024-04-25T22:01:13.605902+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605902+0000","last_undegraded":"2024-04-25T22:01:13.605902+0000","last_fullsized":"2024-04-25T22:01:13.605902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608773+0000","last_change":"2024-04-25T22:01:13.608773+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608773+0000","last_undegraded":"2024-04-25T22:01:13.608773+0000","last_fullsized":"2024-04-25T22:01:13.608773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605777+0000","last_change":"2024-04-25T22:01:13.605777+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605777+0000","last_undegraded":"2024-04-25T22:01:13.605777+0000","last_fullsized":"2024-04-25T22:01:13.605777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.631249+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:01:13.631249+0000","last_peered":"2024-04-25T22:01:13.631249+0000","last_clean":"2024-04-25T22:01:13.631249+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:01:13.631249+0000","last_undegraded":"2024-04-25T22:01:13.631249+0000","last_fullsized":"2024-04-25T22:01:13.631249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603599+0000","last_change":"2024-04-25T22:01:13.603599+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603599+0000","last_undegraded":"2024-04-25T22:01:13.603599+0000","last_fullsized":"2024-04-25T22:01:13.603599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.633159+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:01:13.633159+0000","last_peered":"2024-04-25T22:01:13.633159+0000","last_clean":"2024-04-25T22:01:13.633159+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:01:13.633159+0000","last_undegraded":"2024-04-25T22:01:13.633159+0000","last_fullsized":"2024-04-25T22:01:13.633159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605377+0000","last_change":"2024-04-25T22:01:13.605377+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605377+0000","last_undegraded":"2024-04-25T22:01:13.605377+0000","last_fullsized":"2024-04-25T22:01:13.605377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634474+0000","last_change":"2024-04-25T22:01:13.630817+0000","last_active":"2024-04-25T22:01:13.634474+0000","last_peered":"2024-04-25T22:01:13.634474+0000","last_clean":"2024-04-25T22:01:13.634474+0000","last_became_active":"2024-04-25T22:01:13.629994+0000","last_became_peered":"2024-04-25T22:01:13.629994+0000","last_unstale":"2024-04-25T22:01:13.634474+0000","last_undegraded":"2024-04-25T22:01:13.634474+0000","last_fullsized":"2024-04-25T22:01:13.634474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:35.589006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608618+0000","last_change":"2024-04-25T22:01:13.608618+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608618+0000","last_undegraded":"2024-04-25T22:01:13.608618+0000","last_fullsized":"2024-04-25T22:01:13.608618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635814+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:01:13.635814+0000","last_peered":"2024-04-25T22:01:13.635814+0000","last_clean":"2024-04-25T22:01:13.635814+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:01:13.635814+0000","last_undegraded":"2024-04-25T22:01:13.635814+0000","last_fullsized":"2024-04-25T22:01:13.635814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634187+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:01:13.634187+0000","last_peered":"2024-04-25T22:01:13.634187+0000","last_clean":"2024-04-25T22:01:13.634187+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:01:13.634187+0000","last_undegraded":"2024-04-25T22:01:13.634187+0000","last_fullsized":"2024-04-25T22:01:13.634187+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603204+0000","last_change":"2024-04-25T22:01:13.603204+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603204+0000","last_undegraded":"2024-04-25T22:01:13.603204+0000","last_fullsized":"2024-04-25T22:01:13.603204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634535+0000","last_change":"2024-04-25T22:01:13.631135+0000","last_active":"2024-04-25T22:01:13.634535+0000","last_peered":"2024-04-25T22:01:13.634535+0000","last_clean":"2024-04-25T22:01:13.634535+0000","last_became_active":"2024-04-25T22:01:13.630257+0000","last_became_peered":"2024-04-25T22:01:13.630257+0000","last_unstale":"2024-04-25T22:01:13.634535+0000","last_undegraded":"2024-04-25T22:01:13.634535+0000","last_fullsized":"2024-04-25T22:01:13.634535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:21.030688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608429+0000","last_change":"2024-04-25T22:01:13.608429+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608429+0000","last_undegraded":"2024-04-25T22:01:13.608429+0000","last_fullsized":"2024-04-25T22:01:13.608429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.636211+0000","last_change":"2024-04-25T22:01:13.633106+0000","last_active":"2024-04-25T22:01:13.636211+0000","last_peered":"2024-04-25T22:01:13.636211+0000","last_clean":"2024-04-25T22:01:13.636211+0000","last_became_active":"2024-04-25T22:01:13.631466+0000","last_became_peered":"2024-04-25T22:01:13.631466+0000","last_unstale":"2024-04-25T22:01:13.636211+0000","last_undegraded":"2024-04-25T22:01:13.636211+0000","last_fullsized":"2024-04-25T22:01:13.636211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609053+0000","last_change":"2024-04-25T22:01:13.609053+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609053+0000","last_undegraded":"2024-04-25T22:01:13.609053+0000","last_fullsized":"2024-04-25T22:01:13.609053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.633248+0000","last_change":"2024-04-25T22:01:13.626767+0000","last_active":"2024-04-25T22:01:13.633248+0000","last_peered":"2024-04-25T22:01:13.633248+0000","last_clean":"2024-04-25T22:01:13.633248+0000","last_became_active":"2024-04-25T22:01:13.625984+0000","last_became_peered":"2024-04-25T22:01:13.625984+0000","last_unstale":"2024-04-25T22:01:13.633248+0000","last_undegraded":"2024-04-25T22:01:13.633248+0000","last_fullsized":"2024-04-25T22:01:13.633248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.601099+0000","last_change":"2024-04-25T22:01:13.601099+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.601099+0000","last_undegraded":"2024-04-25T22:01:13.601099+0000","last_fullsized":"2024-04-25T22:01:13.601099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635066+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:01:13.635066+0000","last_peered":"2024-04-25T22:01:13.635066+0000","last_clean":"2024-04-25T22:01:13.635066+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:01:13.635066+0000","last_undegraded":"2024-04-25T22:01:13.635066+0000","last_fullsized":"2024-04-25T22:01:13.635066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608005+0000","last_change":"2024-04-25T22:01:13.608005+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608005+0000","last_undegraded":"2024-04-25T22:01:13.608005+0000","last_fullsized":"2024-04-25T22:01:13.608005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.630969+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:01:13.630969+0000","last_peered":"2024-04-25T22:01:13.630969+0000","last_clean":"2024-04-25T22:01:13.630969+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:01:13.630969+0000","last_undegraded":"2024-04-25T22:01:13.630969+0000","last_fullsized":"2024-04-25T22:01:13.630969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609483+0000","last_change":"2024-04-25T22:01:13.609483+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609483+0000","last_undegraded":"2024-04-25T22:01:13.609483+0000","last_fullsized":"2024-04-25T22:01:13.609483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634560+0000","last_change":"2024-04-25T22:01:13.631439+0000","last_active":"2024-04-25T22:01:13.634560+0000","last_peered":"2024-04-25T22:01:13.634560+0000","last_clean":"2024-04-25T22:01:13.634560+0000","last_became_active":"2024-04-25T22:01:13.630812+0000","last_became_peered":"2024-04-25T22:01:13.630812+0000","last_unstale":"2024-04-25T22:01:13.634560+0000","last_undegraded":"2024-04-25T22:01:13.634560+0000","last_fullsized":"2024-04-25T22:01:13.634560+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:33.145066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.606313+0000","last_change":"2024-04-25T22:01:13.606313+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.606313+0000","last_undegraded":"2024-04-25T22:01:13.606313+0000","last_fullsized":"2024-04-25T22:01:13.606313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.624956+0000","last_change":"2024-04-25T22:01:13.623342+0000","last_active":"2024-04-25T22:01:13.624956+0000","last_peered":"2024-04-25T22:01:13.624956+0000","last_clean":"2024-04-25T22:01:13.624956+0000","last_became_active":"2024-04-25T22:01:13.621460+0000","last_became_peered":"2024-04-25T22:01:13.621460+0000","last_unstale":"2024-04-25T22:01:13.624956+0000","last_undegraded":"2024-04-25T22:01:13.624956+0000","last_fullsized":"2024-04-25T22:01:13.624956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:08.736609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607841+0000","last_change":"2024-04-25T22:01:13.607841+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607841+0000","last_undegraded":"2024-04-25T22:01:13.607841+0000","last_fullsized":"2024-04-25T22:01:13.607841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":218,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.615898+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:01:13.615898+0000","last_peered":"2024-04-25T22:01:13.615898+0000","last_clean":"2024-04-25T22:01:13.615898+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:01:13.615898+0000","last_undegraded":"2024-04-25T22:01:13.615898+0000","last_fullsized":"2024-04-25T22:01:13.615898+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.619094+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:01:13.619094+0000","last_peered":"2024-04-25T22:01:13.619094+0000","last_clean":"2024-04-25T22:01:13.619094+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:01:13.619094+0000","last_undegraded":"2024-04-25T22:01:13.619094+0000","last_fullsized":"2024-04-25T22:01:13.619094+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.621721+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:01:13.621721+0000","last_peered":"2024-04-25T22:01:13.621721+0000","last_clean":"2024-04-25T22:01:13.621721+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:01:13.621721+0000","last_undegraded":"2024-04-25T22:01:13.621721+0000","last_fullsized":"2024-04-25T22:01:13.621721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:33.145066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.608134+0000","last_change":"2024-04-25T22:01:13.608134+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.608134+0000","last_undegraded":"2024-04-25T22:01:13.608134+0000","last_fullsized":"2024-04-25T22:01:13.608134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.616087+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:01:13.616087+0000","last_peered":"2024-04-25T22:01:13.616087+0000","last_clean":"2024-04-25T22:01:13.616087+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:01:13.616087+0000","last_undegraded":"2024-04-25T22:01:13.616087+0000","last_fullsized":"2024-04-25T22:01:13.616087+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.633181+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:01:13.633181+0000","last_peered":"2024-04-25T22:01:13.633181+0000","last_clean":"2024-04-25T22:01:13.633181+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:01:13.633181+0000","last_undegraded":"2024-04-25T22:01:13.633181+0000","last_fullsized":"2024-04-25T22:01:13.633181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:24.090744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607336+0000","last_change":"2024-04-25T22:01:13.607336+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607336+0000","last_undegraded":"2024-04-25T22:01:13.607336+0000","last_fullsized":"2024-04-25T22:01:13.607336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.610038+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:01:13.610038+0000","last_peered":"2024-04-25T22:01:13.610038+0000","last_clean":"2024-04-25T22:01:13.610038+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:01:13.610038+0000","last_undegraded":"2024-04-25T22:01:13.610038+0000","last_fullsized":"2024-04-25T22:01:13.610038+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.637479+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:01:13.637479+0000","last_peered":"2024-04-25T22:01:13.637479+0000","last_clean":"2024-04-25T22:01:13.637479+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:01:13.637479+0000","last_undegraded":"2024-04-25T22:01:13.637479+0000","last_fullsized":"2024-04-25T22:01:13.637479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:54.536138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605986+0000","last_change":"2024-04-25T22:01:13.605986+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605986+0000","last_undegraded":"2024-04-25T22:01:13.605986+0000","last_fullsized":"2024-04-25T22:01:13.605986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.616901+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:01:13.616901+0000","last_peered":"2024-04-25T22:01:13.616901+0000","last_clean":"2024-04-25T22:01:13.616901+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:01:13.616901+0000","last_undegraded":"2024-04-25T22:01:13.616901+0000","last_fullsized":"2024-04-25T22:01:13.616901+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.631211+0000","last_change":"2024-04-25T22:01:13.627274+0000","last_active":"2024-04-25T22:01:13.631211+0000","last_peered":"2024-04-25T22:01:13.631211+0000","last_clean":"2024-04-25T22:01:13.631211+0000","last_became_active":"2024-04-25T22:01:13.626015+0000","last_became_peered":"2024-04-25T22:01:13.626015+0000","last_unstale":"2024-04-25T22:01:13.631211+0000","last_undegraded":"2024-04-25T22:01:13.631211+0000","last_fullsized":"2024-04-25T22:01:13.631211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602890+0000","last_change":"2024-04-25T22:01:13.602890+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602890+0000","last_undegraded":"2024-04-25T22:01:13.602890+0000","last_fullsized":"2024-04-25T22:01:13.602890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.632246+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:01:13.632246+0000","last_peered":"2024-04-25T22:01:13.632246+0000","last_clean":"2024-04-25T22:01:13.632246+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:01:13.632246+0000","last_undegraded":"2024-04-25T22:01:13.632246+0000","last_fullsized":"2024-04-25T22:01:13.632246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.610509+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:01:13.610509+0000","last_peered":"2024-04-25T22:01:13.610509+0000","last_clean":"2024-04-25T22:01:13.610509+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:01:13.610509+0000","last_undegraded":"2024-04-25T22:01:13.610509+0000","last_fullsized":"2024-04-25T22:01:13.610509+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605712+0000","last_change":"2024-04-25T22:01:13.605712+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605712+0000","last_undegraded":"2024-04-25T22:01:13.605712+0000","last_fullsized":"2024-04-25T22:01:13.605712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.621905+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:01:13.621905+0000","last_peered":"2024-04-25T22:01:13.621905+0000","last_clean":"2024-04-25T22:01:13.621905+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:01:13.621905+0000","last_undegraded":"2024-04-25T22:01:13.621905+0000","last_fullsized":"2024-04-25T22:01:13.621905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:21.030688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.614917+0000","last_change":"2024-04-25T22:01:09.582204+0000","last_active":"2024-04-25T22:01:13.614917+0000","last_peered":"2024-04-25T22:01:13.614917+0000","last_clean":"2024-04-25T22:01:13.614917+0000","last_became_active":"2024-04-25T22:01:09.581494+0000","last_became_peered":"2024-04-25T22:01:09.581494+0000","last_unstale":"2024-04-25T22:01:13.614917+0000","last_undegraded":"2024-04-25T22:01:13.614917+0000","last_fullsized":"2024-04-25T22:01:13.614917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:13.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605487+0000","last_change":"2024-04-25T22:01:13.605487+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605487+0000","last_undegraded":"2024-04-25T22:01:13.605487+0000","last_fullsized":"2024-04-25T22:01:13.605487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.622413+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:01:13.622413+0000","last_peered":"2024-04-25T22:01:13.622413+0000","last_clean":"2024-04-25T22:01:13.622413+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:01:13.622413+0000","last_undegraded":"2024-04-25T22:01:13.622413+0000","last_fullsized":"2024-04-25T22:01:13.622413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:00.088977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.610801+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:01:13.610801+0000","last_peered":"2024-04-25T22:01:13.610801+0000","last_clean":"2024-04-25T22:01:13.610801+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:01:13.610801+0000","last_undegraded":"2024-04-25T22:01:13.610801+0000","last_fullsized":"2024-04-25T22:01:13.610801+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.600883+0000","last_change":"2024-04-25T22:01:13.600883+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.600883+0000","last_undegraded":"2024-04-25T22:01:13.600883+0000","last_fullsized":"2024-04-25T22:01:13.600883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635210+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:01:13.635210+0000","last_peered":"2024-04-25T22:01:13.635210+0000","last_clean":"2024-04-25T22:01:13.635210+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:01:13.635210+0000","last_undegraded":"2024-04-25T22:01:13.635210+0000","last_fullsized":"2024-04-25T22:01:13.635210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.619699+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:01:13.619699+0000","last_peered":"2024-04-25T22:01:13.619699+0000","last_clean":"2024-04-25T22:01:13.619699+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:01:13.619699+0000","last_undegraded":"2024-04-25T22:01:13.619699+0000","last_fullsized":"2024-04-25T22:01:13.619699+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.606151+0000","last_change":"2024-04-25T22:01:13.606151+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.606151+0000","last_undegraded":"2024-04-25T22:01:13.606151+0000","last_fullsized":"2024-04-25T22:01:13.606151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.609691+0000","last_change":"2024-04-25T22:01:13.609691+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.609691+0000","last_undegraded":"2024-04-25T22:01:13.609691+0000","last_fullsized":"2024-04-25T22:01:13.609691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.636141+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:01:13.636141+0000","last_peered":"2024-04-25T22:01:13.636141+0000","last_clean":"2024-04-25T22:01:13.636141+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:01:13.636141+0000","last_undegraded":"2024-04-25T22:01:13.636141+0000","last_fullsized":"2024-04-25T22:01:13.636141+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602940+0000","last_change":"2024-04-25T22:01:13.602940+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602940+0000","last_undegraded":"2024-04-25T22:01:13.602940+0000","last_fullsized":"2024-04-25T22:01:13.602940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.637506+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:01:13.637506+0000","last_peered":"2024-04-25T22:01:13.637506+0000","last_clean":"2024-04-25T22:01:13.637506+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:01:13.637506+0000","last_undegraded":"2024-04-25T22:01:13.637506+0000","last_fullsized":"2024-04-25T22:01:13.637506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:57.523272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.630640+0000","last_change":"2024-04-25T22:01:13.626710+0000","last_active":"2024-04-25T22:01:13.630640+0000","last_peered":"2024-04-25T22:01:13.630640+0000","last_clean":"2024-04-25T22:01:13.630640+0000","last_became_active":"2024-04-25T22:01:13.625898+0000","last_became_peered":"2024-04-25T22:01:13.625898+0000","last_unstale":"2024-04-25T22:01:13.630640+0000","last_undegraded":"2024-04-25T22:01:13.630640+0000","last_fullsized":"2024-04-25T22:01:13.630640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:24.090744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603111+0000","last_change":"2024-04-25T22:01:13.603111+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603111+0000","last_undegraded":"2024-04-25T22:01:13.603111+0000","last_fullsized":"2024-04-25T22:01:13.603111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635068+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:01:13.635068+0000","last_peered":"2024-04-25T22:01:13.635068+0000","last_clean":"2024-04-25T22:01:13.635068+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:01:13.635068+0000","last_undegraded":"2024-04-25T22:01:13.635068+0000","last_fullsized":"2024-04-25T22:01:13.635068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603720+0000","last_change":"2024-04-25T22:01:13.603720+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603720+0000","last_undegraded":"2024-04-25T22:01:13.603720+0000","last_fullsized":"2024-04-25T22:01:13.603720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.603464+0000","last_change":"2024-04-25T22:01:13.603464+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.603464+0000","last_undegraded":"2024-04-25T22:01:13.603464+0000","last_fullsized":"2024-04-25T22:01:13.603464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.624075+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:01:13.624075+0000","last_peered":"2024-04-25T22:01:13.624075+0000","last_clean":"2024-04-25T22:01:13.624075+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:01:13.624075+0000","last_undegraded":"2024-04-25T22:01:13.624075+0000","last_fullsized":"2024-04-25T22:01:13.624075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:57.523272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607287+0000","last_change":"2024-04-25T22:01:13.607287+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607287+0000","last_undegraded":"2024-04-25T22:01:13.607287+0000","last_fullsized":"2024-04-25T22:01:13.607287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.634026+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:01:13.634026+0000","last_peered":"2024-04-25T22:01:13.634026+0000","last_clean":"2024-04-25T22:01:13.634026+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:01:13.634026+0000","last_undegraded":"2024-04-25T22:01:13.634026+0000","last_fullsized":"2024-04-25T22:01:13.634026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607500+0000","last_change":"2024-04-25T22:01:13.607500+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607500+0000","last_undegraded":"2024-04-25T22:01:13.607500+0000","last_fullsized":"2024-04-25T22:01:13.607500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.624192+0000","last_change":"2024-04-25T22:01:13.621997+0000","last_active":"2024-04-25T22:01:13.624192+0000","last_peered":"2024-04-25T22:01:13.624192+0000","last_clean":"2024-04-25T22:01:13.624192+0000","last_became_active":"2024-04-25T22:01:13.620987+0000","last_became_peered":"2024-04-25T22:01:13.620987+0000","last_unstale":"2024-04-25T22:01:13.624192+0000","last_undegraded":"2024-04-25T22:01:13.624192+0000","last_fullsized":"2024-04-25T22:01:13.624192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:36:28.906539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.607919+0000","last_change":"2024-04-25T22:01:13.607919+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.607919+0000","last_undegraded":"2024-04-25T22:01:13.607919+0000","last_fullsized":"2024-04-25T22:01:13.607919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.637455+0000","last_change":"2024-04-25T22:01:13.631562+0000","last_active":"2024-04-25T22:01:13.637455+0000","last_peered":"2024-04-25T22:01:13.637455+0000","last_clean":"2024-04-25T22:01:13.637455+0000","last_became_active":"2024-04-25T22:01:13.630731+0000","last_became_peered":"2024-04-25T22:01:13.630731+0000","last_unstale":"2024-04-25T22:01:13.637455+0000","last_undegraded":"2024-04-25T22:01:13.637455+0000","last_fullsized":"2024-04-25T22:01:13.637455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:00.088977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.611663+0000","last_change":"2024-04-25T22:01:13.611663+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.611663+0000","last_undegraded":"2024-04-25T22:01:13.611663+0000","last_fullsized":"2024-04-25T22:01:13.611663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.633307+0000","last_change":"2024-04-25T22:01:13.628356+0000","last_active":"2024-04-25T22:01:13.633307+0000","last_peered":"2024-04-25T22:01:13.633307+0000","last_clean":"2024-04-25T22:01:13.633307+0000","last_became_active":"2024-04-25T22:01:13.626608+0000","last_became_peered":"2024-04-25T22:01:13.626608+0000","last_unstale":"2024-04-25T22:01:13.633307+0000","last_undegraded":"2024-04-25T22:01:13.633307+0000","last_fullsized":"2024-04-25T22:01:13.633307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.605771+0000","last_change":"2024-04-25T22:01:13.605771+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.605771+0000","last_undegraded":"2024-04-25T22:01:13.605771+0000","last_fullsized":"2024-04-25T22:01:13.605771+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.632017+0000","last_change":"2024-04-25T22:01:13.630502+0000","last_active":"2024-04-25T22:01:13.632017+0000","last_peered":"2024-04-25T22:01:13.632017+0000","last_clean":"2024-04-25T22:01:13.632017+0000","last_became_active":"2024-04-25T22:01:13.629854+0000","last_became_peered":"2024-04-25T22:01:13.629854+0000","last_unstale":"2024-04-25T22:01:13.632017+0000","last_undegraded":"2024-04-25T22:01:13.632017+0000","last_fullsized":"2024-04-25T22:01:13.632017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:50.391570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.602887+0000","last_change":"2024-04-25T22:01:13.602887+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.602887+0000","last_undegraded":"2024-04-25T22:01:13.602887+0000","last_fullsized":"2024-04-25T22:01:13.602887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.622486+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:01:13.622486+0000","last_peered":"2024-04-25T22:01:13.622486+0000","last_clean":"2024-04-25T22:01:13.622486+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:01:13.622486+0000","last_undegraded":"2024-04-25T22:01:13.622486+0000","last_fullsized":"2024-04-25T22:01:13.622486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:54.536138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-04-25T22:01:13.604554+0000","last_change":"2024-04-25T22:01:13.604554+0000","last_active":"2024-04-25T22:01:13.590422+0000","last_peered":"2024-04-25T22:01:13.590422+0000","last_clean":"2024-04-25T22:01:13.590422+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:01:13.604554+0000","last_undegraded":"2024-04-25T22:01:13.604554+0000","last_fullsized":"2024-04-25T22:01:13.604554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T22:01:13.635142+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:01:13.635142+0000","last_peered":"2024-04-25T22:01:13.635142+0000","last_clean":"2024-04-25T22:01:13.635142+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:01:13.635142+0000","last_undegraded":"2024-04-25T22:01:13.635142+0000","last_fullsized":"2024-04-25T22:01:13.635142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":188416,"data_stored":631301,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":131072,"data_stored":40933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":188416,"data_stored":631301,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:01:19.698 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-04-25T22:01:19.697+0000 7f668c8e9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T22:01:22.120 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:01:22.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:22.438 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:01:22.455 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-25T22:01:21.563922+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90028,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025492,"statfs":{"total":289910292480,"available":289818103808,"internally_reserved":0,"allocated":647168,"data_stored":1350892,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.967552"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643883+0000","last_change":"2024-04-25T22:01:14.641678+0000","last_active":"2024-04-25T22:01:15.643883+0000","last_peered":"2024-04-25T22:01:15.643883+0000","last_clean":"2024-04-25T22:01:15.643883+0000","last_became_active":"2024-04-25T22:01:14.640808+0000","last_became_peered":"2024-04-25T22:01:14.640808+0000","last_unstale":"2024-04-25T22:01:15.643883+0000","last_undegraded":"2024-04-25T22:01:15.643883+0000","last_fullsized":"2024-04-25T22:01:15.643883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643649+0000","last_change":"2024-04-25T22:01:14.648935+0000","last_active":"2024-04-25T22:01:15.643649+0000","last_peered":"2024-04-25T22:01:15.643649+0000","last_clean":"2024-04-25T22:01:15.643649+0000","last_became_active":"2024-04-25T22:01:14.647871+0000","last_became_peered":"2024-04-25T22:01:14.647871+0000","last_unstale":"2024-04-25T22:01:15.643649+0000","last_undegraded":"2024-04-25T22:01:15.643649+0000","last_fullsized":"2024-04-25T22:01:15.643649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629685+0000","last_change":"2024-04-25T22:01:14.647262+0000","last_active":"2024-04-25T22:01:16.629685+0000","last_peered":"2024-04-25T22:01:16.629685+0000","last_clean":"2024-04-25T22:01:16.629685+0000","last_became_active":"2024-04-25T22:01:14.645878+0000","last_became_peered":"2024-04-25T22:01:14.645878+0000","last_unstale":"2024-04-25T22:01:16.629685+0000","last_undegraded":"2024-04-25T22:01:16.629685+0000","last_fullsized":"2024-04-25T22:01:16.629685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630225+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:01:16.630225+0000","last_peered":"2024-04-25T22:01:16.630225+0000","last_clean":"2024-04-25T22:01:16.630225+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:01:16.630225+0000","last_undegraded":"2024-04-25T22:01:16.630225+0000","last_fullsized":"2024-04-25T22:01:16.630225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643155+0000","last_change":"2024-04-25T22:01:14.642505+0000","last_active":"2024-04-25T22:01:15.643155+0000","last_peered":"2024-04-25T22:01:15.643155+0000","last_clean":"2024-04-25T22:01:15.643155+0000","last_became_active":"2024-04-25T22:01:14.641574+0000","last_became_peered":"2024-04-25T22:01:14.641574+0000","last_unstale":"2024-04-25T22:01:15.643155+0000","last_undegraded":"2024-04-25T22:01:15.643155+0000","last_fullsized":"2024-04-25T22:01:15.643155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630343+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:01:16.630343+0000","last_peered":"2024-04-25T22:01:16.630343+0000","last_clean":"2024-04-25T22:01:16.630343+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:01:16.630343+0000","last_undegraded":"2024-04-25T22:01:16.630343+0000","last_fullsized":"2024-04-25T22:01:16.630343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628889+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:01:16.628889+0000","last_peered":"2024-04-25T22:01:16.628889+0000","last_clean":"2024-04-25T22:01:16.628889+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:01:16.628889+0000","last_undegraded":"2024-04-25T22:01:16.628889+0000","last_fullsized":"2024-04-25T22:01:16.628889+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628140+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:01:16.628140+0000","last_peered":"2024-04-25T22:01:16.628140+0000","last_clean":"2024-04-25T22:01:16.628140+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:01:16.628140+0000","last_undegraded":"2024-04-25T22:01:16.628140+0000","last_fullsized":"2024-04-25T22:01:16.628140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642568+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:01:15.642568+0000","last_peered":"2024-04-25T22:01:15.642568+0000","last_clean":"2024-04-25T22:01:15.642568+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:01:15.642568+0000","last_undegraded":"2024-04-25T22:01:15.642568+0000","last_fullsized":"2024-04-25T22:01:15.642568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643687+0000","last_change":"2024-04-25T22:01:14.647968+0000","last_active":"2024-04-25T22:01:15.643687+0000","last_peered":"2024-04-25T22:01:15.643687+0000","last_clean":"2024-04-25T22:01:15.643687+0000","last_became_active":"2024-04-25T22:01:14.646872+0000","last_became_peered":"2024-04-25T22:01:14.646872+0000","last_unstale":"2024-04-25T22:01:15.643687+0000","last_undegraded":"2024-04-25T22:01:15.643687+0000","last_fullsized":"2024-04-25T22:01:15.643687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629818+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:01:16.629818+0000","last_peered":"2024-04-25T22:01:16.629818+0000","last_clean":"2024-04-25T22:01:16.629818+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:01:16.629818+0000","last_undegraded":"2024-04-25T22:01:16.629818+0000","last_fullsized":"2024-04-25T22:01:16.629818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643509+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:01:15.643509+0000","last_peered":"2024-04-25T22:01:15.643509+0000","last_clean":"2024-04-25T22:01:15.643509+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:01:15.643509+0000","last_undegraded":"2024-04-25T22:01:15.643509+0000","last_fullsized":"2024-04-25T22:01:15.643509+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642423+0000","last_change":"2024-04-25T22:01:14.643909+0000","last_active":"2024-04-25T22:01:15.642423+0000","last_peered":"2024-04-25T22:01:15.642423+0000","last_clean":"2024-04-25T22:01:15.642423+0000","last_became_active":"2024-04-25T22:01:14.642421+0000","last_became_peered":"2024-04-25T22:01:14.642421+0000","last_unstale":"2024-04-25T22:01:15.642423+0000","last_undegraded":"2024-04-25T22:01:15.642423+0000","last_fullsized":"2024-04-25T22:01:15.642423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630801+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:01:16.630801+0000","last_peered":"2024-04-25T22:01:16.630801+0000","last_clean":"2024-04-25T22:01:16.630801+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:01:16.630801+0000","last_undegraded":"2024-04-25T22:01:16.630801+0000","last_fullsized":"2024-04-25T22:01:16.630801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628926+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:01:16.628926+0000","last_peered":"2024-04-25T22:01:16.628926+0000","last_clean":"2024-04-25T22:01:16.628926+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:01:16.628926+0000","last_undegraded":"2024-04-25T22:01:16.628926+0000","last_fullsized":"2024-04-25T22:01:16.628926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628179+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:01:16.628179+0000","last_peered":"2024-04-25T22:01:16.628179+0000","last_clean":"2024-04-25T22:01:16.628179+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:01:16.628179+0000","last_undegraded":"2024-04-25T22:01:16.628179+0000","last_fullsized":"2024-04-25T22:01:16.628179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644180+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:01:15.644180+0000","last_peered":"2024-04-25T22:01:15.644180+0000","last_clean":"2024-04-25T22:01:15.644180+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:01:15.644180+0000","last_undegraded":"2024-04-25T22:01:15.644180+0000","last_fullsized":"2024-04-25T22:01:15.644180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644577+0000","last_change":"2024-04-25T22:01:14.647317+0000","last_active":"2024-04-25T22:01:15.644577+0000","last_peered":"2024-04-25T22:01:15.644577+0000","last_clean":"2024-04-25T22:01:15.644577+0000","last_became_active":"2024-04-25T22:01:14.644027+0000","last_became_peered":"2024-04-25T22:01:14.644027+0000","last_unstale":"2024-04-25T22:01:15.644577+0000","last_undegraded":"2024-04-25T22:01:15.644577+0000","last_fullsized":"2024-04-25T22:01:15.644577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642752+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:01:15.642752+0000","last_peered":"2024-04-25T22:01:15.642752+0000","last_clean":"2024-04-25T22:01:15.642752+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:01:15.642752+0000","last_undegraded":"2024-04-25T22:01:15.642752+0000","last_fullsized":"2024-04-25T22:01:15.642752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630673+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:01:16.630673+0000","last_peered":"2024-04-25T22:01:16.630673+0000","last_clean":"2024-04-25T22:01:16.630673+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:01:16.630673+0000","last_undegraded":"2024-04-25T22:01:16.630673+0000","last_fullsized":"2024-04-25T22:01:16.630673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630420+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:01:16.630420+0000","last_peered":"2024-04-25T22:01:16.630420+0000","last_clean":"2024-04-25T22:01:16.630420+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:01:16.630420+0000","last_undegraded":"2024-04-25T22:01:16.630420+0000","last_fullsized":"2024-04-25T22:01:16.630420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642311+0000","last_change":"2024-04-25T22:01:14.633477+0000","last_active":"2024-04-25T22:01:15.642311+0000","last_peered":"2024-04-25T22:01:15.642311+0000","last_clean":"2024-04-25T22:01:15.642311+0000","last_became_active":"2024-04-25T22:01:14.632678+0000","last_became_peered":"2024-04-25T22:01:14.632678+0000","last_unstale":"2024-04-25T22:01:15.642311+0000","last_undegraded":"2024-04-25T22:01:15.642311+0000","last_fullsized":"2024-04-25T22:01:15.642311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641145+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:01:15.641145+0000","last_peered":"2024-04-25T22:01:15.641145+0000","last_clean":"2024-04-25T22:01:15.641145+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:01:15.641145+0000","last_undegraded":"2024-04-25T22:01:15.641145+0000","last_fullsized":"2024-04-25T22:01:15.641145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641815+0000","last_change":"2024-04-25T22:01:14.641991+0000","last_active":"2024-04-25T22:01:15.641815+0000","last_peered":"2024-04-25T22:01:15.641815+0000","last_clean":"2024-04-25T22:01:15.641815+0000","last_became_active":"2024-04-25T22:01:14.641244+0000","last_became_peered":"2024-04-25T22:01:14.641244+0000","last_unstale":"2024-04-25T22:01:15.641815+0000","last_undegraded":"2024-04-25T22:01:15.641815+0000","last_fullsized":"2024-04-25T22:01:15.641815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:03.098700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644044+0000","last_change":"2024-04-25T22:01:14.638103+0000","last_active":"2024-04-25T22:01:15.644044+0000","last_peered":"2024-04-25T22:01:15.644044+0000","last_clean":"2024-04-25T22:01:15.644044+0000","last_became_active":"2024-04-25T22:01:14.636488+0000","last_became_peered":"2024-04-25T22:01:14.636488+0000","last_unstale":"2024-04-25T22:01:15.644044+0000","last_undegraded":"2024-04-25T22:01:15.644044+0000","last_fullsized":"2024-04-25T22:01:15.644044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643468+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:01:15.643468+0000","last_peered":"2024-04-25T22:01:15.643468+0000","last_clean":"2024-04-25T22:01:15.643468+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:01:15.643468+0000","last_undegraded":"2024-04-25T22:01:15.643468+0000","last_fullsized":"2024-04-25T22:01:15.643468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630101+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:01:16.630101+0000","last_peered":"2024-04-25T22:01:16.630101+0000","last_clean":"2024-04-25T22:01:16.630101+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:01:16.630101+0000","last_undegraded":"2024-04-25T22:01:16.630101+0000","last_fullsized":"2024-04-25T22:01:16.630101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644402+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:01:15.644402+0000","last_peered":"2024-04-25T22:01:15.644402+0000","last_clean":"2024-04-25T22:01:15.644402+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:01:15.644402+0000","last_undegraded":"2024-04-25T22:01:15.644402+0000","last_fullsized":"2024-04-25T22:01:15.644402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642402+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:01:15.642402+0000","last_peered":"2024-04-25T22:01:15.642402+0000","last_clean":"2024-04-25T22:01:15.642402+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:01:15.642402+0000","last_undegraded":"2024-04-25T22:01:15.642402+0000","last_fullsized":"2024-04-25T22:01:15.642402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642766+0000","last_change":"2024-04-25T22:01:14.638343+0000","last_active":"2024-04-25T22:01:15.642766+0000","last_peered":"2024-04-25T22:01:15.642766+0000","last_clean":"2024-04-25T22:01:15.642766+0000","last_became_active":"2024-04-25T22:01:14.637694+0000","last_became_peered":"2024-04-25T22:01:14.637694+0000","last_unstale":"2024-04-25T22:01:15.642766+0000","last_undegraded":"2024-04-25T22:01:15.642766+0000","last_fullsized":"2024-04-25T22:01:15.642766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641265+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:01:15.641265+0000","last_peered":"2024-04-25T22:01:15.641265+0000","last_clean":"2024-04-25T22:01:15.641265+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:01:15.641265+0000","last_undegraded":"2024-04-25T22:01:15.641265+0000","last_fullsized":"2024-04-25T22:01:15.641265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628586+0000","last_change":"2024-04-25T22:01:14.648196+0000","last_active":"2024-04-25T22:01:16.628586+0000","last_peered":"2024-04-25T22:01:16.628586+0000","last_clean":"2024-04-25T22:01:16.628586+0000","last_became_active":"2024-04-25T22:01:14.647509+0000","last_became_peered":"2024-04-25T22:01:14.647509+0000","last_unstale":"2024-04-25T22:01:16.628586+0000","last_undegraded":"2024-04-25T22:01:16.628586+0000","last_fullsized":"2024-04-25T22:01:16.628586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643932+0000","last_change":"2024-04-25T22:01:14.641706+0000","last_active":"2024-04-25T22:01:15.643932+0000","last_peered":"2024-04-25T22:01:15.643932+0000","last_clean":"2024-04-25T22:01:15.643932+0000","last_became_active":"2024-04-25T22:01:14.641043+0000","last_became_peered":"2024-04-25T22:01:14.641043+0000","last_unstale":"2024-04-25T22:01:15.643932+0000","last_undegraded":"2024-04-25T22:01:15.643932+0000","last_fullsized":"2024-04-25T22:01:15.643932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630432+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:01:16.630432+0000","last_peered":"2024-04-25T22:01:16.630432+0000","last_clean":"2024-04-25T22:01:16.630432+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:01:16.630432+0000","last_undegraded":"2024-04-25T22:01:16.630432+0000","last_fullsized":"2024-04-25T22:01:16.630432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644159+0000","last_change":"2024-04-25T22:01:14.635075+0000","last_active":"2024-04-25T22:01:15.644159+0000","last_peered":"2024-04-25T22:01:15.644159+0000","last_clean":"2024-04-25T22:01:15.644159+0000","last_became_active":"2024-04-25T22:01:14.630677+0000","last_became_peered":"2024-04-25T22:01:14.630677+0000","last_unstale":"2024-04-25T22:01:15.644159+0000","last_undegraded":"2024-04-25T22:01:15.644159+0000","last_fullsized":"2024-04-25T22:01:15.644159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641776+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:01:15.641776+0000","last_peered":"2024-04-25T22:01:15.641776+0000","last_clean":"2024-04-25T22:01:15.641776+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:01:15.641776+0000","last_undegraded":"2024-04-25T22:01:15.641776+0000","last_fullsized":"2024-04-25T22:01:15.641776+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644033+0000","last_change":"2024-04-25T22:01:14.648527+0000","last_active":"2024-04-25T22:01:15.644033+0000","last_peered":"2024-04-25T22:01:15.644033+0000","last_clean":"2024-04-25T22:01:15.644033+0000","last_became_active":"2024-04-25T22:01:14.645040+0000","last_became_peered":"2024-04-25T22:01:14.645040+0000","last_unstale":"2024-04-25T22:01:15.644033+0000","last_undegraded":"2024-04-25T22:01:15.644033+0000","last_fullsized":"2024-04-25T22:01:15.644033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642322+0000","last_change":"2024-04-25T22:01:13.630817+0000","last_active":"2024-04-25T22:01:15.642322+0000","last_peered":"2024-04-25T22:01:15.642322+0000","last_clean":"2024-04-25T22:01:15.642322+0000","last_became_active":"2024-04-25T22:01:13.629994+0000","last_became_peered":"2024-04-25T22:01:13.629994+0000","last_unstale":"2024-04-25T22:01:15.642322+0000","last_undegraded":"2024-04-25T22:01:15.642322+0000","last_fullsized":"2024-04-25T22:01:15.642322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643109+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:01:15.643109+0000","last_peered":"2024-04-25T22:01:15.643109+0000","last_clean":"2024-04-25T22:01:15.643109+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:01:15.643109+0000","last_undegraded":"2024-04-25T22:01:15.643109+0000","last_fullsized":"2024-04-25T22:01:15.643109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628481+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:01:16.628481+0000","last_peered":"2024-04-25T22:01:16.628481+0000","last_clean":"2024-04-25T22:01:16.628481+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:01:16.628481+0000","last_undegraded":"2024-04-25T22:01:16.628481+0000","last_fullsized":"2024-04-25T22:01:16.628481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630098+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:01:16.630098+0000","last_peered":"2024-04-25T22:01:16.630098+0000","last_clean":"2024-04-25T22:01:16.630098+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:01:16.630098+0000","last_undegraded":"2024-04-25T22:01:16.630098+0000","last_fullsized":"2024-04-25T22:01:16.630098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641940+0000","last_change":"2024-04-25T22:01:14.633805+0000","last_active":"2024-04-25T22:01:15.641940+0000","last_peered":"2024-04-25T22:01:15.641940+0000","last_clean":"2024-04-25T22:01:15.641940+0000","last_became_active":"2024-04-25T22:01:14.633045+0000","last_became_peered":"2024-04-25T22:01:14.633045+0000","last_unstale":"2024-04-25T22:01:15.641940+0000","last_undegraded":"2024-04-25T22:01:15.641940+0000","last_fullsized":"2024-04-25T22:01:15.641940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:43.718628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644703+0000","last_change":"2024-04-25T22:01:13.631135+0000","last_active":"2024-04-25T22:01:15.644703+0000","last_peered":"2024-04-25T22:01:15.644703+0000","last_clean":"2024-04-25T22:01:15.644703+0000","last_became_active":"2024-04-25T22:01:13.630257+0000","last_became_peered":"2024-04-25T22:01:13.630257+0000","last_unstale":"2024-04-25T22:01:15.644703+0000","last_undegraded":"2024-04-25T22:01:15.644703+0000","last_fullsized":"2024-04-25T22:01:15.644703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641989+0000","last_change":"2024-04-25T22:01:14.630233+0000","last_active":"2024-04-25T22:01:15.641989+0000","last_peered":"2024-04-25T22:01:15.641989+0000","last_clean":"2024-04-25T22:01:15.641989+0000","last_became_active":"2024-04-25T22:01:14.629415+0000","last_became_peered":"2024-04-25T22:01:14.629415+0000","last_unstale":"2024-04-25T22:01:15.641989+0000","last_undegraded":"2024-04-25T22:01:15.641989+0000","last_fullsized":"2024-04-25T22:01:15.641989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:02:28.593163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630847+0000","last_change":"2024-04-25T22:01:13.633106+0000","last_active":"2024-04-25T22:01:16.630847+0000","last_peered":"2024-04-25T22:01:16.630847+0000","last_clean":"2024-04-25T22:01:16.630847+0000","last_became_active":"2024-04-25T22:01:13.631466+0000","last_became_peered":"2024-04-25T22:01:13.631466+0000","last_unstale":"2024-04-25T22:01:16.630847+0000","last_undegraded":"2024-04-25T22:01:16.630847+0000","last_fullsized":"2024-04-25T22:01:16.630847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:23.095422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630867+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:01:16.630867+0000","last_peered":"2024-04-25T22:01:16.630867+0000","last_clean":"2024-04-25T22:01:16.630867+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:01:16.630867+0000","last_undegraded":"2024-04-25T22:01:16.630867+0000","last_fullsized":"2024-04-25T22:01:16.630867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631516+0000","last_change":"2024-04-25T22:01:13.626767+0000","last_active":"2024-04-25T22:01:16.631516+0000","last_peered":"2024-04-25T22:01:16.631516+0000","last_clean":"2024-04-25T22:01:16.631516+0000","last_became_active":"2024-04-25T22:01:13.625984+0000","last_became_peered":"2024-04-25T22:01:13.625984+0000","last_unstale":"2024-04-25T22:01:16.631516+0000","last_undegraded":"2024-04-25T22:01:16.631516+0000","last_fullsized":"2024-04-25T22:01:16.631516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642637+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:01:15.642637+0000","last_peered":"2024-04-25T22:01:15.642637+0000","last_clean":"2024-04-25T22:01:15.642637+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:01:15.642637+0000","last_undegraded":"2024-04-25T22:01:15.642637+0000","last_fullsized":"2024-04-25T22:01:15.642637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643352+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:01:15.643352+0000","last_peered":"2024-04-25T22:01:15.643352+0000","last_clean":"2024-04-25T22:01:15.643352+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:01:15.643352+0000","last_undegraded":"2024-04-25T22:01:15.643352+0000","last_fullsized":"2024-04-25T22:01:15.643352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631293+0000","last_change":"2024-04-25T22:01:14.650077+0000","last_active":"2024-04-25T22:01:16.631293+0000","last_peered":"2024-04-25T22:01:16.631293+0000","last_clean":"2024-04-25T22:01:16.631293+0000","last_became_active":"2024-04-25T22:01:14.649315+0000","last_became_peered":"2024-04-25T22:01:14.649315+0000","last_unstale":"2024-04-25T22:01:16.631293+0000","last_undegraded":"2024-04-25T22:01:16.631293+0000","last_fullsized":"2024-04-25T22:01:16.631293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.976715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631205+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:01:16.631205+0000","last_peered":"2024-04-25T22:01:16.631205+0000","last_clean":"2024-04-25T22:01:16.631205+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:01:16.631205+0000","last_undegraded":"2024-04-25T22:01:16.631205+0000","last_fullsized":"2024-04-25T22:01:16.631205+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630528+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:01:16.630528+0000","last_peered":"2024-04-25T22:01:16.630528+0000","last_clean":"2024-04-25T22:01:16.630528+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:01:16.630528+0000","last_undegraded":"2024-04-25T22:01:16.630528+0000","last_fullsized":"2024-04-25T22:01:16.630528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642713+0000","last_change":"2024-04-25T22:01:13.631439+0000","last_active":"2024-04-25T22:01:15.642713+0000","last_peered":"2024-04-25T22:01:15.642713+0000","last_clean":"2024-04-25T22:01:15.642713+0000","last_became_active":"2024-04-25T22:01:13.630812+0000","last_became_peered":"2024-04-25T22:01:13.630812+0000","last_unstale":"2024-04-25T22:01:15.642713+0000","last_undegraded":"2024-04-25T22:01:15.642713+0000","last_fullsized":"2024-04-25T22:01:15.642713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629606+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:01:16.629606+0000","last_peered":"2024-04-25T22:01:16.629606+0000","last_clean":"2024-04-25T22:01:16.629606+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:01:16.629606+0000","last_undegraded":"2024-04-25T22:01:16.629606+0000","last_fullsized":"2024-04-25T22:01:16.629606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642135+0000","last_change":"2024-04-25T22:01:13.623342+0000","last_active":"2024-04-25T22:01:15.642135+0000","last_peered":"2024-04-25T22:01:15.642135+0000","last_clean":"2024-04-25T22:01:15.642135+0000","last_became_active":"2024-04-25T22:01:13.621460+0000","last_became_peered":"2024-04-25T22:01:13.621460+0000","last_unstale":"2024-04-25T22:01:15.642135+0000","last_undegraded":"2024-04-25T22:01:15.642135+0000","last_fullsized":"2024-04-25T22:01:15.642135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643302+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:01:15.643302+0000","last_peered":"2024-04-25T22:01:15.643302+0000","last_clean":"2024-04-25T22:01:15.643302+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:01:15.643302+0000","last_undegraded":"2024-04-25T22:01:15.643302+0000","last_fullsized":"2024-04-25T22:01:15.643302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629372+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:01:16.629372+0000","last_peered":"2024-04-25T22:01:16.629372+0000","last_clean":"2024-04-25T22:01:16.629372+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:01:16.629372+0000","last_undegraded":"2024-04-25T22:01:16.629372+0000","last_fullsized":"2024-04-25T22:01:16.629372+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630769+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:01:16.630769+0000","last_peered":"2024-04-25T22:01:16.630769+0000","last_clean":"2024-04-25T22:01:16.630769+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:01:16.630769+0000","last_undegraded":"2024-04-25T22:01:16.630769+0000","last_fullsized":"2024-04-25T22:01:16.630769+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642365+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:01:15.642365+0000","last_peered":"2024-04-25T22:01:15.642365+0000","last_clean":"2024-04-25T22:01:15.642365+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:01:15.642365+0000","last_undegraded":"2024-04-25T22:01:15.642365+0000","last_fullsized":"2024-04-25T22:01:15.642365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630930+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:01:16.630930+0000","last_peered":"2024-04-25T22:01:16.630930+0000","last_clean":"2024-04-25T22:01:16.630930+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:01:16.630930+0000","last_undegraded":"2024-04-25T22:01:16.630930+0000","last_fullsized":"2024-04-25T22:01:16.630930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629358+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:01:16.629358+0000","last_peered":"2024-04-25T22:01:16.629358+0000","last_clean":"2024-04-25T22:01:16.629358+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:01:16.629358+0000","last_undegraded":"2024-04-25T22:01:16.629358+0000","last_fullsized":"2024-04-25T22:01:16.629358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641937+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:01:15.641937+0000","last_peered":"2024-04-25T22:01:15.641937+0000","last_clean":"2024-04-25T22:01:15.641937+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:01:15.641937+0000","last_undegraded":"2024-04-25T22:01:15.641937+0000","last_fullsized":"2024-04-25T22:01:15.641937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644200+0000","last_change":"2024-04-25T22:01:14.645176+0000","last_active":"2024-04-25T22:01:15.644200+0000","last_peered":"2024-04-25T22:01:15.644200+0000","last_clean":"2024-04-25T22:01:15.644200+0000","last_became_active":"2024-04-25T22:01:14.642395+0000","last_became_peered":"2024-04-25T22:01:14.642395+0000","last_unstale":"2024-04-25T22:01:15.644200+0000","last_undegraded":"2024-04-25T22:01:15.644200+0000","last_fullsized":"2024-04-25T22:01:15.644200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642690+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:01:15.642690+0000","last_peered":"2024-04-25T22:01:15.642690+0000","last_clean":"2024-04-25T22:01:15.642690+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:01:15.642690+0000","last_undegraded":"2024-04-25T22:01:15.642690+0000","last_fullsized":"2024-04-25T22:01:15.642690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643904+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:01:15.643904+0000","last_peered":"2024-04-25T22:01:15.643904+0000","last_clean":"2024-04-25T22:01:15.643904+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:01:15.643904+0000","last_undegraded":"2024-04-25T22:01:15.643904+0000","last_fullsized":"2024-04-25T22:01:15.643904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643553+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:01:15.643553+0000","last_peered":"2024-04-25T22:01:15.643553+0000","last_clean":"2024-04-25T22:01:15.643553+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:01:15.643553+0000","last_undegraded":"2024-04-25T22:01:15.643553+0000","last_fullsized":"2024-04-25T22:01:15.643553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631460+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:01:16.631460+0000","last_peered":"2024-04-25T22:01:16.631460+0000","last_clean":"2024-04-25T22:01:16.631460+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:01:16.631460+0000","last_undegraded":"2024-04-25T22:01:16.631460+0000","last_fullsized":"2024-04-25T22:01:16.631460+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630582+0000","last_change":"2024-04-25T22:01:13.627274+0000","last_active":"2024-04-25T22:01:16.630582+0000","last_peered":"2024-04-25T22:01:16.630582+0000","last_clean":"2024-04-25T22:01:16.630582+0000","last_became_active":"2024-04-25T22:01:13.626015+0000","last_became_peered":"2024-04-25T22:01:13.626015+0000","last_unstale":"2024-04-25T22:01:16.630582+0000","last_undegraded":"2024-04-25T22:01:16.630582+0000","last_fullsized":"2024-04-25T22:01:16.630582+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643225+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:01:15.643225+0000","last_peered":"2024-04-25T22:01:15.643225+0000","last_clean":"2024-04-25T22:01:15.643225+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:01:15.643225+0000","last_undegraded":"2024-04-25T22:01:15.643225+0000","last_fullsized":"2024-04-25T22:01:15.643225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631136+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:01:16.631136+0000","last_peered":"2024-04-25T22:01:16.631136+0000","last_clean":"2024-04-25T22:01:16.631136+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:01:16.631136+0000","last_undegraded":"2024-04-25T22:01:16.631136+0000","last_fullsized":"2024-04-25T22:01:16.631136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643456+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:01:15.643456+0000","last_peered":"2024-04-25T22:01:15.643456+0000","last_clean":"2024-04-25T22:01:15.643456+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:01:15.643456+0000","last_undegraded":"2024-04-25T22:01:15.643456+0000","last_fullsized":"2024-04-25T22:01:15.643456+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643426+0000","last_change":"2024-04-25T22:01:14.637520+0000","last_active":"2024-04-25T22:01:15.643426+0000","last_peered":"2024-04-25T22:01:15.643426+0000","last_clean":"2024-04-25T22:01:15.643426+0000","last_became_active":"2024-04-25T22:01:14.636765+0000","last_became_peered":"2024-04-25T22:01:14.636765+0000","last_unstale":"2024-04-25T22:01:15.643426+0000","last_undegraded":"2024-04-25T22:01:15.643426+0000","last_fullsized":"2024-04-25T22:01:15.643426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643206+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:01:15.643206+0000","last_peered":"2024-04-25T22:01:15.643206+0000","last_clean":"2024-04-25T22:01:15.643206+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:01:15.643206+0000","last_undegraded":"2024-04-25T22:01:15.643206+0000","last_fullsized":"2024-04-25T22:01:15.643206+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.645129+0000","last_change":"2024-04-25T22:01:09.582204+0000","last_active":"2024-04-25T22:01:15.645129+0000","last_peered":"2024-04-25T22:01:15.645129+0000","last_clean":"2024-04-25T22:01:15.645129+0000","last_became_active":"2024-04-25T22:01:09.581494+0000","last_became_peered":"2024-04-25T22:01:09.581494+0000","last_unstale":"2024-04-25T22:01:15.645129+0000","last_undegraded":"2024-04-25T22:01:15.645129+0000","last_fullsized":"2024-04-25T22:01:15.645129+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:13.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642878+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:01:15.642878+0000","last_peered":"2024-04-25T22:01:15.642878+0000","last_clean":"2024-04-25T22:01:15.642878+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:01:15.642878+0000","last_undegraded":"2024-04-25T22:01:15.642878+0000","last_fullsized":"2024-04-25T22:01:15.642878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644141+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:01:15.644141+0000","last_peered":"2024-04-25T22:01:15.644141+0000","last_clean":"2024-04-25T22:01:15.644141+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:01:15.644141+0000","last_undegraded":"2024-04-25T22:01:15.644141+0000","last_fullsized":"2024-04-25T22:01:15.644141+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644123+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:01:15.644123+0000","last_peered":"2024-04-25T22:01:15.644123+0000","last_clean":"2024-04-25T22:01:15.644123+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:01:15.644123+0000","last_undegraded":"2024-04-25T22:01:15.644123+0000","last_fullsized":"2024-04-25T22:01:15.644123+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641739+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:01:15.641739+0000","last_peered":"2024-04-25T22:01:15.641739+0000","last_clean":"2024-04-25T22:01:15.641739+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:01:15.641739+0000","last_undegraded":"2024-04-25T22:01:15.641739+0000","last_fullsized":"2024-04-25T22:01:15.641739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644055+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:01:15.644055+0000","last_peered":"2024-04-25T22:01:15.644055+0000","last_clean":"2024-04-25T22:01:15.644055+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:01:15.644055+0000","last_undegraded":"2024-04-25T22:01:15.644055+0000","last_fullsized":"2024-04-25T22:01:15.644055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630203+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:01:16.630203+0000","last_peered":"2024-04-25T22:01:16.630203+0000","last_clean":"2024-04-25T22:01:16.630203+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:01:16.630203+0000","last_undegraded":"2024-04-25T22:01:16.630203+0000","last_fullsized":"2024-04-25T22:01:16.630203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642445+0000","last_change":"2024-04-25T22:01:14.632306+0000","last_active":"2024-04-25T22:01:15.642445+0000","last_peered":"2024-04-25T22:01:15.642445+0000","last_clean":"2024-04-25T22:01:15.642445+0000","last_became_active":"2024-04-25T22:01:14.631179+0000","last_became_peered":"2024-04-25T22:01:14.631179+0000","last_unstale":"2024-04-25T22:01:15.642445+0000","last_undegraded":"2024-04-25T22:01:15.642445+0000","last_fullsized":"2024-04-25T22:01:15.642445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630101+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:01:16.630101+0000","last_peered":"2024-04-25T22:01:16.630101+0000","last_clean":"2024-04-25T22:01:16.630101+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:01:16.630101+0000","last_undegraded":"2024-04-25T22:01:16.630101+0000","last_fullsized":"2024-04-25T22:01:16.630101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631516+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:01:16.631516+0000","last_peered":"2024-04-25T22:01:16.631516+0000","last_clean":"2024-04-25T22:01:16.631516+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:01:16.631516+0000","last_undegraded":"2024-04-25T22:01:16.631516+0000","last_fullsized":"2024-04-25T22:01:16.631516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641760+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:01:15.641760+0000","last_peered":"2024-04-25T22:01:15.641760+0000","last_clean":"2024-04-25T22:01:15.641760+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:01:15.641760+0000","last_undegraded":"2024-04-25T22:01:15.641760+0000","last_fullsized":"2024-04-25T22:01:15.641760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644879+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:01:15.644879+0000","last_peered":"2024-04-25T22:01:15.644879+0000","last_clean":"2024-04-25T22:01:15.644879+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:01:15.644879+0000","last_undegraded":"2024-04-25T22:01:15.644879+0000","last_fullsized":"2024-04-25T22:01:15.644879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629767+0000","last_change":"2024-04-25T22:01:13.626710+0000","last_active":"2024-04-25T22:01:16.629767+0000","last_peered":"2024-04-25T22:01:16.629767+0000","last_clean":"2024-04-25T22:01:16.629767+0000","last_became_active":"2024-04-25T22:01:13.625898+0000","last_became_peered":"2024-04-25T22:01:13.625898+0000","last_unstale":"2024-04-25T22:01:16.629767+0000","last_undegraded":"2024-04-25T22:01:16.629767+0000","last_fullsized":"2024-04-25T22:01:16.629767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641621+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:01:15.641621+0000","last_peered":"2024-04-25T22:01:15.641621+0000","last_clean":"2024-04-25T22:01:15.641621+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:01:15.641621+0000","last_undegraded":"2024-04-25T22:01:15.641621+0000","last_fullsized":"2024-04-25T22:01:15.641621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643856+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:01:15.643856+0000","last_peered":"2024-04-25T22:01:15.643856+0000","last_clean":"2024-04-25T22:01:15.643856+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:01:15.643856+0000","last_undegraded":"2024-04-25T22:01:15.643856+0000","last_fullsized":"2024-04-25T22:01:15.643856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641332+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:01:15.641332+0000","last_peered":"2024-04-25T22:01:15.641332+0000","last_clean":"2024-04-25T22:01:15.641332+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:01:15.641332+0000","last_undegraded":"2024-04-25T22:01:15.641332+0000","last_fullsized":"2024-04-25T22:01:15.641332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644225+0000","last_change":"2024-04-25T22:01:14.639447+0000","last_active":"2024-04-25T22:01:15.644225+0000","last_peered":"2024-04-25T22:01:15.644225+0000","last_clean":"2024-04-25T22:01:15.644225+0000","last_became_active":"2024-04-25T22:01:14.638864+0000","last_became_peered":"2024-04-25T22:01:14.638864+0000","last_unstale":"2024-04-25T22:01:15.644225+0000","last_undegraded":"2024-04-25T22:01:15.644225+0000","last_fullsized":"2024-04-25T22:01:15.644225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642023+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:01:15.642023+0000","last_peered":"2024-04-25T22:01:15.642023+0000","last_clean":"2024-04-25T22:01:15.642023+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:01:15.642023+0000","last_undegraded":"2024-04-25T22:01:15.642023+0000","last_fullsized":"2024-04-25T22:01:15.642023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643570+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:01:15.643570+0000","last_peered":"2024-04-25T22:01:15.643570+0000","last_clean":"2024-04-25T22:01:15.643570+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:01:15.643570+0000","last_undegraded":"2024-04-25T22:01:15.643570+0000","last_fullsized":"2024-04-25T22:01:15.643570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641814+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:01:15.641814+0000","last_peered":"2024-04-25T22:01:15.641814+0000","last_clean":"2024-04-25T22:01:15.641814+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:01:15.641814+0000","last_undegraded":"2024-04-25T22:01:15.641814+0000","last_fullsized":"2024-04-25T22:01:15.641814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644642+0000","last_change":"2024-04-25T22:01:14.637452+0000","last_active":"2024-04-25T22:01:15.644642+0000","last_peered":"2024-04-25T22:01:15.644642+0000","last_clean":"2024-04-25T22:01:15.644642+0000","last_became_active":"2024-04-25T22:01:14.636407+0000","last_became_peered":"2024-04-25T22:01:14.636407+0000","last_unstale":"2024-04-25T22:01:15.644642+0000","last_undegraded":"2024-04-25T22:01:15.644642+0000","last_fullsized":"2024-04-25T22:01:15.644642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643041+0000","last_change":"2024-04-25T22:01:13.621997+0000","last_active":"2024-04-25T22:01:15.643041+0000","last_peered":"2024-04-25T22:01:15.643041+0000","last_clean":"2024-04-25T22:01:15.643041+0000","last_became_active":"2024-04-25T22:01:13.620987+0000","last_became_peered":"2024-04-25T22:01:13.620987+0000","last_unstale":"2024-04-25T22:01:15.643041+0000","last_undegraded":"2024-04-25T22:01:15.643041+0000","last_fullsized":"2024-04-25T22:01:15.643041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643601+0000","last_change":"2024-04-25T22:01:14.650437+0000","last_active":"2024-04-25T22:01:15.643601+0000","last_peered":"2024-04-25T22:01:15.643601+0000","last_clean":"2024-04-25T22:01:15.643601+0000","last_became_active":"2024-04-25T22:01:14.648116+0000","last_became_peered":"2024-04-25T22:01:14.648116+0000","last_unstale":"2024-04-25T22:01:15.643601+0000","last_undegraded":"2024-04-25T22:01:15.643601+0000","last_fullsized":"2024-04-25T22:01:15.643601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643173+0000","last_change":"2024-04-25T22:01:13.631562+0000","last_active":"2024-04-25T22:01:15.643173+0000","last_peered":"2024-04-25T22:01:15.643173+0000","last_clean":"2024-04-25T22:01:15.643173+0000","last_became_active":"2024-04-25T22:01:13.630731+0000","last_became_peered":"2024-04-25T22:01:13.630731+0000","last_unstale":"2024-04-25T22:01:15.643173+0000","last_undegraded":"2024-04-25T22:01:15.643173+0000","last_fullsized":"2024-04-25T22:01:15.643173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629517+0000","last_change":"2024-04-25T22:01:14.654909+0000","last_active":"2024-04-25T22:01:16.629517+0000","last_peered":"2024-04-25T22:01:16.629517+0000","last_clean":"2024-04-25T22:01:16.629517+0000","last_became_active":"2024-04-25T22:01:14.653503+0000","last_became_peered":"2024-04-25T22:01:14.653503+0000","last_unstale":"2024-04-25T22:01:16.629517+0000","last_undegraded":"2024-04-25T22:01:16.629517+0000","last_fullsized":"2024-04-25T22:01:16.629517+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631196+0000","last_change":"2024-04-25T22:01:13.628356+0000","last_active":"2024-04-25T22:01:16.631196+0000","last_peered":"2024-04-25T22:01:16.631196+0000","last_clean":"2024-04-25T22:01:16.631196+0000","last_became_active":"2024-04-25T22:01:13.626608+0000","last_became_peered":"2024-04-25T22:01:13.626608+0000","last_unstale":"2024-04-25T22:01:16.631196+0000","last_undegraded":"2024-04-25T22:01:16.631196+0000","last_fullsized":"2024-04-25T22:01:16.631196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631268+0000","last_change":"2024-04-25T22:01:14.648752+0000","last_active":"2024-04-25T22:01:16.631268+0000","last_peered":"2024-04-25T22:01:16.631268+0000","last_clean":"2024-04-25T22:01:16.631268+0000","last_became_active":"2024-04-25T22:01:14.647463+0000","last_became_peered":"2024-04-25T22:01:14.647463+0000","last_unstale":"2024-04-25T22:01:16.631268+0000","last_undegraded":"2024-04-25T22:01:16.631268+0000","last_fullsized":"2024-04-25T22:01:16.631268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:22.946881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644469+0000","last_change":"2024-04-25T22:01:13.630502+0000","last_active":"2024-04-25T22:01:15.644469+0000","last_peered":"2024-04-25T22:01:15.644469+0000","last_clean":"2024-04-25T22:01:15.644469+0000","last_became_active":"2024-04-25T22:01:13.629854+0000","last_became_peered":"2024-04-25T22:01:13.629854+0000","last_unstale":"2024-04-25T22:01:15.644469+0000","last_undegraded":"2024-04-25T22:01:15.644469+0000","last_fullsized":"2024-04-25T22:01:15.644469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643115+0000","last_change":"2024-04-25T22:01:14.642104+0000","last_active":"2024-04-25T22:01:15.643115+0000","last_peered":"2024-04-25T22:01:15.643115+0000","last_clean":"2024-04-25T22:01:15.643115+0000","last_became_active":"2024-04-25T22:01:14.641323+0000","last_became_peered":"2024-04-25T22:01:14.641323+0000","last_unstale":"2024-04-25T22:01:15.643115+0000","last_undegraded":"2024-04-25T22:01:15.643115+0000","last_fullsized":"2024-04-25T22:01:15.643115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643826+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:01:15.643826+0000","last_peered":"2024-04-25T22:01:15.643826+0000","last_clean":"2024-04-25T22:01:15.643826+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:01:15.643826+0000","last_undegraded":"2024-04-25T22:01:15.643826+0000","last_fullsized":"2024-04-25T22:01:15.643826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629024+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:01:16.629024+0000","last_peered":"2024-04-25T22:01:16.629024+0000","last_clean":"2024-04-25T22:01:16.629024+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:01:16.629024+0000","last_undegraded":"2024-04-25T22:01:16.629024+0000","last_fullsized":"2024-04-25T22:01:16.629024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643575+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:01:15.643575+0000","last_peered":"2024-04-25T22:01:15.643575+0000","last_clean":"2024-04-25T22:01:15.643575+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:01:15.643575+0000","last_undegraded":"2024-04-25T22:01:15.643575+0000","last_fullsized":"2024-04-25T22:01:15.643575+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":237568,"data_stored":647274,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":55728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":245760,"data_stored":647890,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:01:22.459 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T22:01:22.459 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T22:01:22.459 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T22:01:22.459 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T22:01:22.460 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T22:01:22.846 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:22.864 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":4123187652},{"type":"v1","addr":"172.21.15.44:6801","nonce":4123187652}]},"active_addr":"172.21.15.44:6801/4123187652","active_change":"2024-04-25T22:00:57.543984+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4102,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":2613225339}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":3305001130}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":2048337248}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":1263639184}]}]} 2024-04-25T22:01:22.868 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T22:01:22.868 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T22:01:22.868 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:01:23.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:23.171 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":18,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:01:15.618998+0000","last_up_change":"2024-04-25T22:01:03.432353+0000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:01:03.632568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:01:07.995071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:01:12.514055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:01:12.963831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6801","nonce":2385981072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6803","nonce":2385981072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6807","nonce":2385981072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6805","nonce":2385981072}]},"public_addr":"172.21.15.57:6801/2385981072","cluster_addr":"172.21.15.57:6803/2385981072","heartbeat_back_addr":"172.21.15.57:6807/2385981072","heartbeat_front_addr":"172.21.15.57:6805/2385981072","state":["exists","up"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6801","nonce":29975895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6803","nonce":29975895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6807","nonce":29975895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6805","nonce":29975895}]},"public_addr":"172.21.15.79:6801/29975895","cluster_addr":"172.21.15.79:6803/29975895","heartbeat_back_addr":"172.21.15.79:6807/29975895","heartbeat_front_addr":"172.21.15.79:6805/29975895","state":["exists","up"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6801","nonce":3918111900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6803","nonce":3918111900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6807","nonce":3918111900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6805","nonce":3918111900}]},"public_addr":"172.21.15.81:6801/3918111900","cluster_addr":"172.21.15.81:6803/3918111900","heartbeat_back_addr":"172.21.15.81:6807/3918111900","heartbeat_front_addr":"172.21.15.81:6805/3918111900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:59.025944+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.986080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.971238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:01:23.191 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T22:01:23.191 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:01:23.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:23.493 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":18,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:01:15.618998+0000","last_up_change":"2024-04-25T22:01:03.432353+0000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:01:03.632568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:01:07.995071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:01:12.514055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:01:12.963831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6801","nonce":2385981072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6803","nonce":2385981072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6807","nonce":2385981072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6805","nonce":2385981072}]},"public_addr":"172.21.15.57:6801/2385981072","cluster_addr":"172.21.15.57:6803/2385981072","heartbeat_back_addr":"172.21.15.57:6807/2385981072","heartbeat_front_addr":"172.21.15.57:6805/2385981072","state":["exists","up"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6801","nonce":29975895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6803","nonce":29975895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6807","nonce":29975895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6805","nonce":29975895}]},"public_addr":"172.21.15.79:6801/29975895","cluster_addr":"172.21.15.79:6803/29975895","heartbeat_back_addr":"172.21.15.79:6807/29975895","heartbeat_front_addr":"172.21.15.79:6805/29975895","state":["exists","up"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6801","nonce":3918111900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6803","nonce":3918111900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6807","nonce":3918111900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6805","nonce":3918111900}]},"public_addr":"172.21.15.81:6801/3918111900","cluster_addr":"172.21.15.81:6803/3918111900","heartbeat_back_addr":"172.21.15.81:6807/3918111900","heartbeat_front_addr":"172.21.15.81:6805/3918111900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:59.025944+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.986080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.971238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:01:23.513 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T22:01:23.513 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T22:01:23.513 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T22:01:23.682 INFO:teuthology.orchestra.run.smithi044.stdout:34359738377 2024-04-25T22:01:23.683 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T22:01:23.683 INFO:teuthology.orchestra.run.smithi044.stdout:34359738378 2024-04-25T22:01:23.684 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T22:01:23.684 INFO:teuthology.orchestra.run.smithi044.stdout:34359738378 2024-04-25T22:01:23.685 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T22:01:24.012 INFO:teuthology.orchestra.run.smithi044.stdout:34359738376 2024-04-25T22:01:24.016 INFO:teuthology.orchestra.run.smithi044.stdout:34359738375 2024-04-25T22:01:24.021 INFO:teuthology.orchestra.run.smithi044.stdout:34359738376 2024-04-25T22:01:24.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738378 got 34359738376 for osd.2 2024-04-25T22:01:24.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738378 got 34359738376 for osd.0 2024-04-25T22:01:24.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738375 for osd.1 2024-04-25T22:01:25.041 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T22:01:25.042 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T22:01:25.044 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T22:01:25.344 INFO:teuthology.orchestra.run.smithi044.stdout:34359738376 2024-04-25T22:01:25.352 INFO:teuthology.orchestra.run.smithi044.stdout:34359738376 2024-04-25T22:01:25.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738378 got 34359738376 for osd.0 2024-04-25T22:01:25.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738378 got 34359738376 for osd.2 2024-04-25T22:01:25.388 INFO:teuthology.orchestra.run.smithi044.stdout:34359738375 2024-04-25T22:01:25.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738375 for osd.1 2024-04-25T22:01:26.363 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T22:01:26.371 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T22:01:26.405 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T22:01:26.692 INFO:teuthology.orchestra.run.smithi044.stdout:34359738378 2024-04-25T22:01:26.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738378 got 34359738378 for osd.0 2024-04-25T22:01:26.709 DEBUG:teuthology.parallel:result is None 2024-04-25T22:01:26.710 INFO:teuthology.orchestra.run.smithi044.stdout:34359738378 2024-04-25T22:01:26.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738378 got 34359738378 for osd.2 2024-04-25T22:01:26.728 DEBUG:teuthology.parallel:result is None 2024-04-25T22:01:26.732 INFO:teuthology.orchestra.run.smithi044.stdout:34359738377 2024-04-25T22:01:26.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738377 for osd.1 2024-04-25T22:01:26.749 DEBUG:teuthology.parallel:result is None 2024-04-25T22:01:26.749 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T22:01:26.749 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:01:27.090 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:27.094 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:01:27.105 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-04-25T22:01:25.565025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90028,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025492,"statfs":{"total":289910292480,"available":289818103808,"internally_reserved":0,"allocated":647168,"data_stored":1350892,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003209"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643883+0000","last_change":"2024-04-25T22:01:14.641678+0000","last_active":"2024-04-25T22:01:15.643883+0000","last_peered":"2024-04-25T22:01:15.643883+0000","last_clean":"2024-04-25T22:01:15.643883+0000","last_became_active":"2024-04-25T22:01:14.640808+0000","last_became_peered":"2024-04-25T22:01:14.640808+0000","last_unstale":"2024-04-25T22:01:15.643883+0000","last_undegraded":"2024-04-25T22:01:15.643883+0000","last_fullsized":"2024-04-25T22:01:15.643883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643649+0000","last_change":"2024-04-25T22:01:14.648935+0000","last_active":"2024-04-25T22:01:15.643649+0000","last_peered":"2024-04-25T22:01:15.643649+0000","last_clean":"2024-04-25T22:01:15.643649+0000","last_became_active":"2024-04-25T22:01:14.647871+0000","last_became_peered":"2024-04-25T22:01:14.647871+0000","last_unstale":"2024-04-25T22:01:15.643649+0000","last_undegraded":"2024-04-25T22:01:15.643649+0000","last_fullsized":"2024-04-25T22:01:15.643649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629685+0000","last_change":"2024-04-25T22:01:14.647262+0000","last_active":"2024-04-25T22:01:16.629685+0000","last_peered":"2024-04-25T22:01:16.629685+0000","last_clean":"2024-04-25T22:01:16.629685+0000","last_became_active":"2024-04-25T22:01:14.645878+0000","last_became_peered":"2024-04-25T22:01:14.645878+0000","last_unstale":"2024-04-25T22:01:16.629685+0000","last_undegraded":"2024-04-25T22:01:16.629685+0000","last_fullsized":"2024-04-25T22:01:16.629685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630225+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:01:16.630225+0000","last_peered":"2024-04-25T22:01:16.630225+0000","last_clean":"2024-04-25T22:01:16.630225+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:01:16.630225+0000","last_undegraded":"2024-04-25T22:01:16.630225+0000","last_fullsized":"2024-04-25T22:01:16.630225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643155+0000","last_change":"2024-04-25T22:01:14.642505+0000","last_active":"2024-04-25T22:01:15.643155+0000","last_peered":"2024-04-25T22:01:15.643155+0000","last_clean":"2024-04-25T22:01:15.643155+0000","last_became_active":"2024-04-25T22:01:14.641574+0000","last_became_peered":"2024-04-25T22:01:14.641574+0000","last_unstale":"2024-04-25T22:01:15.643155+0000","last_undegraded":"2024-04-25T22:01:15.643155+0000","last_fullsized":"2024-04-25T22:01:15.643155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630343+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:01:16.630343+0000","last_peered":"2024-04-25T22:01:16.630343+0000","last_clean":"2024-04-25T22:01:16.630343+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:01:16.630343+0000","last_undegraded":"2024-04-25T22:01:16.630343+0000","last_fullsized":"2024-04-25T22:01:16.630343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628889+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:01:16.628889+0000","last_peered":"2024-04-25T22:01:16.628889+0000","last_clean":"2024-04-25T22:01:16.628889+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:01:16.628889+0000","last_undegraded":"2024-04-25T22:01:16.628889+0000","last_fullsized":"2024-04-25T22:01:16.628889+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628140+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:01:16.628140+0000","last_peered":"2024-04-25T22:01:16.628140+0000","last_clean":"2024-04-25T22:01:16.628140+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:01:16.628140+0000","last_undegraded":"2024-04-25T22:01:16.628140+0000","last_fullsized":"2024-04-25T22:01:16.628140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642568+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:01:15.642568+0000","last_peered":"2024-04-25T22:01:15.642568+0000","last_clean":"2024-04-25T22:01:15.642568+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:01:15.642568+0000","last_undegraded":"2024-04-25T22:01:15.642568+0000","last_fullsized":"2024-04-25T22:01:15.642568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643687+0000","last_change":"2024-04-25T22:01:14.647968+0000","last_active":"2024-04-25T22:01:15.643687+0000","last_peered":"2024-04-25T22:01:15.643687+0000","last_clean":"2024-04-25T22:01:15.643687+0000","last_became_active":"2024-04-25T22:01:14.646872+0000","last_became_peered":"2024-04-25T22:01:14.646872+0000","last_unstale":"2024-04-25T22:01:15.643687+0000","last_undegraded":"2024-04-25T22:01:15.643687+0000","last_fullsized":"2024-04-25T22:01:15.643687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629818+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:01:16.629818+0000","last_peered":"2024-04-25T22:01:16.629818+0000","last_clean":"2024-04-25T22:01:16.629818+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:01:16.629818+0000","last_undegraded":"2024-04-25T22:01:16.629818+0000","last_fullsized":"2024-04-25T22:01:16.629818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643509+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:01:15.643509+0000","last_peered":"2024-04-25T22:01:15.643509+0000","last_clean":"2024-04-25T22:01:15.643509+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:01:15.643509+0000","last_undegraded":"2024-04-25T22:01:15.643509+0000","last_fullsized":"2024-04-25T22:01:15.643509+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642423+0000","last_change":"2024-04-25T22:01:14.643909+0000","last_active":"2024-04-25T22:01:15.642423+0000","last_peered":"2024-04-25T22:01:15.642423+0000","last_clean":"2024-04-25T22:01:15.642423+0000","last_became_active":"2024-04-25T22:01:14.642421+0000","last_became_peered":"2024-04-25T22:01:14.642421+0000","last_unstale":"2024-04-25T22:01:15.642423+0000","last_undegraded":"2024-04-25T22:01:15.642423+0000","last_fullsized":"2024-04-25T22:01:15.642423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630801+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:01:16.630801+0000","last_peered":"2024-04-25T22:01:16.630801+0000","last_clean":"2024-04-25T22:01:16.630801+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:01:16.630801+0000","last_undegraded":"2024-04-25T22:01:16.630801+0000","last_fullsized":"2024-04-25T22:01:16.630801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628926+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:01:16.628926+0000","last_peered":"2024-04-25T22:01:16.628926+0000","last_clean":"2024-04-25T22:01:16.628926+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:01:16.628926+0000","last_undegraded":"2024-04-25T22:01:16.628926+0000","last_fullsized":"2024-04-25T22:01:16.628926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628179+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:01:16.628179+0000","last_peered":"2024-04-25T22:01:16.628179+0000","last_clean":"2024-04-25T22:01:16.628179+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:01:16.628179+0000","last_undegraded":"2024-04-25T22:01:16.628179+0000","last_fullsized":"2024-04-25T22:01:16.628179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644180+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:01:15.644180+0000","last_peered":"2024-04-25T22:01:15.644180+0000","last_clean":"2024-04-25T22:01:15.644180+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:01:15.644180+0000","last_undegraded":"2024-04-25T22:01:15.644180+0000","last_fullsized":"2024-04-25T22:01:15.644180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644577+0000","last_change":"2024-04-25T22:01:14.647317+0000","last_active":"2024-04-25T22:01:15.644577+0000","last_peered":"2024-04-25T22:01:15.644577+0000","last_clean":"2024-04-25T22:01:15.644577+0000","last_became_active":"2024-04-25T22:01:14.644027+0000","last_became_peered":"2024-04-25T22:01:14.644027+0000","last_unstale":"2024-04-25T22:01:15.644577+0000","last_undegraded":"2024-04-25T22:01:15.644577+0000","last_fullsized":"2024-04-25T22:01:15.644577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642752+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:01:15.642752+0000","last_peered":"2024-04-25T22:01:15.642752+0000","last_clean":"2024-04-25T22:01:15.642752+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:01:15.642752+0000","last_undegraded":"2024-04-25T22:01:15.642752+0000","last_fullsized":"2024-04-25T22:01:15.642752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630673+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:01:16.630673+0000","last_peered":"2024-04-25T22:01:16.630673+0000","last_clean":"2024-04-25T22:01:16.630673+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:01:16.630673+0000","last_undegraded":"2024-04-25T22:01:16.630673+0000","last_fullsized":"2024-04-25T22:01:16.630673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630420+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:01:16.630420+0000","last_peered":"2024-04-25T22:01:16.630420+0000","last_clean":"2024-04-25T22:01:16.630420+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:01:16.630420+0000","last_undegraded":"2024-04-25T22:01:16.630420+0000","last_fullsized":"2024-04-25T22:01:16.630420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642311+0000","last_change":"2024-04-25T22:01:14.633477+0000","last_active":"2024-04-25T22:01:15.642311+0000","last_peered":"2024-04-25T22:01:15.642311+0000","last_clean":"2024-04-25T22:01:15.642311+0000","last_became_active":"2024-04-25T22:01:14.632678+0000","last_became_peered":"2024-04-25T22:01:14.632678+0000","last_unstale":"2024-04-25T22:01:15.642311+0000","last_undegraded":"2024-04-25T22:01:15.642311+0000","last_fullsized":"2024-04-25T22:01:15.642311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641145+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:01:15.641145+0000","last_peered":"2024-04-25T22:01:15.641145+0000","last_clean":"2024-04-25T22:01:15.641145+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:01:15.641145+0000","last_undegraded":"2024-04-25T22:01:15.641145+0000","last_fullsized":"2024-04-25T22:01:15.641145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641815+0000","last_change":"2024-04-25T22:01:14.641991+0000","last_active":"2024-04-25T22:01:15.641815+0000","last_peered":"2024-04-25T22:01:15.641815+0000","last_clean":"2024-04-25T22:01:15.641815+0000","last_became_active":"2024-04-25T22:01:14.641244+0000","last_became_peered":"2024-04-25T22:01:14.641244+0000","last_unstale":"2024-04-25T22:01:15.641815+0000","last_undegraded":"2024-04-25T22:01:15.641815+0000","last_fullsized":"2024-04-25T22:01:15.641815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:03.098700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644044+0000","last_change":"2024-04-25T22:01:14.638103+0000","last_active":"2024-04-25T22:01:15.644044+0000","last_peered":"2024-04-25T22:01:15.644044+0000","last_clean":"2024-04-25T22:01:15.644044+0000","last_became_active":"2024-04-25T22:01:14.636488+0000","last_became_peered":"2024-04-25T22:01:14.636488+0000","last_unstale":"2024-04-25T22:01:15.644044+0000","last_undegraded":"2024-04-25T22:01:15.644044+0000","last_fullsized":"2024-04-25T22:01:15.644044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643468+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:01:15.643468+0000","last_peered":"2024-04-25T22:01:15.643468+0000","last_clean":"2024-04-25T22:01:15.643468+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:01:15.643468+0000","last_undegraded":"2024-04-25T22:01:15.643468+0000","last_fullsized":"2024-04-25T22:01:15.643468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630101+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:01:16.630101+0000","last_peered":"2024-04-25T22:01:16.630101+0000","last_clean":"2024-04-25T22:01:16.630101+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:01:16.630101+0000","last_undegraded":"2024-04-25T22:01:16.630101+0000","last_fullsized":"2024-04-25T22:01:16.630101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644402+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:01:15.644402+0000","last_peered":"2024-04-25T22:01:15.644402+0000","last_clean":"2024-04-25T22:01:15.644402+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:01:15.644402+0000","last_undegraded":"2024-04-25T22:01:15.644402+0000","last_fullsized":"2024-04-25T22:01:15.644402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642402+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:01:15.642402+0000","last_peered":"2024-04-25T22:01:15.642402+0000","last_clean":"2024-04-25T22:01:15.642402+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:01:15.642402+0000","last_undegraded":"2024-04-25T22:01:15.642402+0000","last_fullsized":"2024-04-25T22:01:15.642402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642766+0000","last_change":"2024-04-25T22:01:14.638343+0000","last_active":"2024-04-25T22:01:15.642766+0000","last_peered":"2024-04-25T22:01:15.642766+0000","last_clean":"2024-04-25T22:01:15.642766+0000","last_became_active":"2024-04-25T22:01:14.637694+0000","last_became_peered":"2024-04-25T22:01:14.637694+0000","last_unstale":"2024-04-25T22:01:15.642766+0000","last_undegraded":"2024-04-25T22:01:15.642766+0000","last_fullsized":"2024-04-25T22:01:15.642766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641265+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:01:15.641265+0000","last_peered":"2024-04-25T22:01:15.641265+0000","last_clean":"2024-04-25T22:01:15.641265+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:01:15.641265+0000","last_undegraded":"2024-04-25T22:01:15.641265+0000","last_fullsized":"2024-04-25T22:01:15.641265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628586+0000","last_change":"2024-04-25T22:01:14.648196+0000","last_active":"2024-04-25T22:01:16.628586+0000","last_peered":"2024-04-25T22:01:16.628586+0000","last_clean":"2024-04-25T22:01:16.628586+0000","last_became_active":"2024-04-25T22:01:14.647509+0000","last_became_peered":"2024-04-25T22:01:14.647509+0000","last_unstale":"2024-04-25T22:01:16.628586+0000","last_undegraded":"2024-04-25T22:01:16.628586+0000","last_fullsized":"2024-04-25T22:01:16.628586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643932+0000","last_change":"2024-04-25T22:01:14.641706+0000","last_active":"2024-04-25T22:01:15.643932+0000","last_peered":"2024-04-25T22:01:15.643932+0000","last_clean":"2024-04-25T22:01:15.643932+0000","last_became_active":"2024-04-25T22:01:14.641043+0000","last_became_peered":"2024-04-25T22:01:14.641043+0000","last_unstale":"2024-04-25T22:01:15.643932+0000","last_undegraded":"2024-04-25T22:01:15.643932+0000","last_fullsized":"2024-04-25T22:01:15.643932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630432+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:01:16.630432+0000","last_peered":"2024-04-25T22:01:16.630432+0000","last_clean":"2024-04-25T22:01:16.630432+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:01:16.630432+0000","last_undegraded":"2024-04-25T22:01:16.630432+0000","last_fullsized":"2024-04-25T22:01:16.630432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644159+0000","last_change":"2024-04-25T22:01:14.635075+0000","last_active":"2024-04-25T22:01:15.644159+0000","last_peered":"2024-04-25T22:01:15.644159+0000","last_clean":"2024-04-25T22:01:15.644159+0000","last_became_active":"2024-04-25T22:01:14.630677+0000","last_became_peered":"2024-04-25T22:01:14.630677+0000","last_unstale":"2024-04-25T22:01:15.644159+0000","last_undegraded":"2024-04-25T22:01:15.644159+0000","last_fullsized":"2024-04-25T22:01:15.644159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641776+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:01:15.641776+0000","last_peered":"2024-04-25T22:01:15.641776+0000","last_clean":"2024-04-25T22:01:15.641776+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:01:15.641776+0000","last_undegraded":"2024-04-25T22:01:15.641776+0000","last_fullsized":"2024-04-25T22:01:15.641776+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644033+0000","last_change":"2024-04-25T22:01:14.648527+0000","last_active":"2024-04-25T22:01:15.644033+0000","last_peered":"2024-04-25T22:01:15.644033+0000","last_clean":"2024-04-25T22:01:15.644033+0000","last_became_active":"2024-04-25T22:01:14.645040+0000","last_became_peered":"2024-04-25T22:01:14.645040+0000","last_unstale":"2024-04-25T22:01:15.644033+0000","last_undegraded":"2024-04-25T22:01:15.644033+0000","last_fullsized":"2024-04-25T22:01:15.644033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642322+0000","last_change":"2024-04-25T22:01:13.630817+0000","last_active":"2024-04-25T22:01:15.642322+0000","last_peered":"2024-04-25T22:01:15.642322+0000","last_clean":"2024-04-25T22:01:15.642322+0000","last_became_active":"2024-04-25T22:01:13.629994+0000","last_became_peered":"2024-04-25T22:01:13.629994+0000","last_unstale":"2024-04-25T22:01:15.642322+0000","last_undegraded":"2024-04-25T22:01:15.642322+0000","last_fullsized":"2024-04-25T22:01:15.642322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643109+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:01:15.643109+0000","last_peered":"2024-04-25T22:01:15.643109+0000","last_clean":"2024-04-25T22:01:15.643109+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:01:15.643109+0000","last_undegraded":"2024-04-25T22:01:15.643109+0000","last_fullsized":"2024-04-25T22:01:15.643109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628481+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:01:16.628481+0000","last_peered":"2024-04-25T22:01:16.628481+0000","last_clean":"2024-04-25T22:01:16.628481+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:01:16.628481+0000","last_undegraded":"2024-04-25T22:01:16.628481+0000","last_fullsized":"2024-04-25T22:01:16.628481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630098+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:01:16.630098+0000","last_peered":"2024-04-25T22:01:16.630098+0000","last_clean":"2024-04-25T22:01:16.630098+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:01:16.630098+0000","last_undegraded":"2024-04-25T22:01:16.630098+0000","last_fullsized":"2024-04-25T22:01:16.630098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641940+0000","last_change":"2024-04-25T22:01:14.633805+0000","last_active":"2024-04-25T22:01:15.641940+0000","last_peered":"2024-04-25T22:01:15.641940+0000","last_clean":"2024-04-25T22:01:15.641940+0000","last_became_active":"2024-04-25T22:01:14.633045+0000","last_became_peered":"2024-04-25T22:01:14.633045+0000","last_unstale":"2024-04-25T22:01:15.641940+0000","last_undegraded":"2024-04-25T22:01:15.641940+0000","last_fullsized":"2024-04-25T22:01:15.641940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:43.718628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644703+0000","last_change":"2024-04-25T22:01:13.631135+0000","last_active":"2024-04-25T22:01:15.644703+0000","last_peered":"2024-04-25T22:01:15.644703+0000","last_clean":"2024-04-25T22:01:15.644703+0000","last_became_active":"2024-04-25T22:01:13.630257+0000","last_became_peered":"2024-04-25T22:01:13.630257+0000","last_unstale":"2024-04-25T22:01:15.644703+0000","last_undegraded":"2024-04-25T22:01:15.644703+0000","last_fullsized":"2024-04-25T22:01:15.644703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641989+0000","last_change":"2024-04-25T22:01:14.630233+0000","last_active":"2024-04-25T22:01:15.641989+0000","last_peered":"2024-04-25T22:01:15.641989+0000","last_clean":"2024-04-25T22:01:15.641989+0000","last_became_active":"2024-04-25T22:01:14.629415+0000","last_became_peered":"2024-04-25T22:01:14.629415+0000","last_unstale":"2024-04-25T22:01:15.641989+0000","last_undegraded":"2024-04-25T22:01:15.641989+0000","last_fullsized":"2024-04-25T22:01:15.641989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:02:28.593163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630847+0000","last_change":"2024-04-25T22:01:13.633106+0000","last_active":"2024-04-25T22:01:16.630847+0000","last_peered":"2024-04-25T22:01:16.630847+0000","last_clean":"2024-04-25T22:01:16.630847+0000","last_became_active":"2024-04-25T22:01:13.631466+0000","last_became_peered":"2024-04-25T22:01:13.631466+0000","last_unstale":"2024-04-25T22:01:16.630847+0000","last_undegraded":"2024-04-25T22:01:16.630847+0000","last_fullsized":"2024-04-25T22:01:16.630847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:23.095422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630867+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:01:16.630867+0000","last_peered":"2024-04-25T22:01:16.630867+0000","last_clean":"2024-04-25T22:01:16.630867+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:01:16.630867+0000","last_undegraded":"2024-04-25T22:01:16.630867+0000","last_fullsized":"2024-04-25T22:01:16.630867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631516+0000","last_change":"2024-04-25T22:01:13.626767+0000","last_active":"2024-04-25T22:01:16.631516+0000","last_peered":"2024-04-25T22:01:16.631516+0000","last_clean":"2024-04-25T22:01:16.631516+0000","last_became_active":"2024-04-25T22:01:13.625984+0000","last_became_peered":"2024-04-25T22:01:13.625984+0000","last_unstale":"2024-04-25T22:01:16.631516+0000","last_undegraded":"2024-04-25T22:01:16.631516+0000","last_fullsized":"2024-04-25T22:01:16.631516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642637+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:01:15.642637+0000","last_peered":"2024-04-25T22:01:15.642637+0000","last_clean":"2024-04-25T22:01:15.642637+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:01:15.642637+0000","last_undegraded":"2024-04-25T22:01:15.642637+0000","last_fullsized":"2024-04-25T22:01:15.642637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643352+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:01:15.643352+0000","last_peered":"2024-04-25T22:01:15.643352+0000","last_clean":"2024-04-25T22:01:15.643352+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:01:15.643352+0000","last_undegraded":"2024-04-25T22:01:15.643352+0000","last_fullsized":"2024-04-25T22:01:15.643352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631293+0000","last_change":"2024-04-25T22:01:14.650077+0000","last_active":"2024-04-25T22:01:16.631293+0000","last_peered":"2024-04-25T22:01:16.631293+0000","last_clean":"2024-04-25T22:01:16.631293+0000","last_became_active":"2024-04-25T22:01:14.649315+0000","last_became_peered":"2024-04-25T22:01:14.649315+0000","last_unstale":"2024-04-25T22:01:16.631293+0000","last_undegraded":"2024-04-25T22:01:16.631293+0000","last_fullsized":"2024-04-25T22:01:16.631293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.976715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631205+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:01:16.631205+0000","last_peered":"2024-04-25T22:01:16.631205+0000","last_clean":"2024-04-25T22:01:16.631205+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:01:16.631205+0000","last_undegraded":"2024-04-25T22:01:16.631205+0000","last_fullsized":"2024-04-25T22:01:16.631205+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630528+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:01:16.630528+0000","last_peered":"2024-04-25T22:01:16.630528+0000","last_clean":"2024-04-25T22:01:16.630528+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:01:16.630528+0000","last_undegraded":"2024-04-25T22:01:16.630528+0000","last_fullsized":"2024-04-25T22:01:16.630528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642713+0000","last_change":"2024-04-25T22:01:13.631439+0000","last_active":"2024-04-25T22:01:15.642713+0000","last_peered":"2024-04-25T22:01:15.642713+0000","last_clean":"2024-04-25T22:01:15.642713+0000","last_became_active":"2024-04-25T22:01:13.630812+0000","last_became_peered":"2024-04-25T22:01:13.630812+0000","last_unstale":"2024-04-25T22:01:15.642713+0000","last_undegraded":"2024-04-25T22:01:15.642713+0000","last_fullsized":"2024-04-25T22:01:15.642713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629606+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:01:16.629606+0000","last_peered":"2024-04-25T22:01:16.629606+0000","last_clean":"2024-04-25T22:01:16.629606+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:01:16.629606+0000","last_undegraded":"2024-04-25T22:01:16.629606+0000","last_fullsized":"2024-04-25T22:01:16.629606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642135+0000","last_change":"2024-04-25T22:01:13.623342+0000","last_active":"2024-04-25T22:01:15.642135+0000","last_peered":"2024-04-25T22:01:15.642135+0000","last_clean":"2024-04-25T22:01:15.642135+0000","last_became_active":"2024-04-25T22:01:13.621460+0000","last_became_peered":"2024-04-25T22:01:13.621460+0000","last_unstale":"2024-04-25T22:01:15.642135+0000","last_undegraded":"2024-04-25T22:01:15.642135+0000","last_fullsized":"2024-04-25T22:01:15.642135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643302+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:01:15.643302+0000","last_peered":"2024-04-25T22:01:15.643302+0000","last_clean":"2024-04-25T22:01:15.643302+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:01:15.643302+0000","last_undegraded":"2024-04-25T22:01:15.643302+0000","last_fullsized":"2024-04-25T22:01:15.643302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629372+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:01:16.629372+0000","last_peered":"2024-04-25T22:01:16.629372+0000","last_clean":"2024-04-25T22:01:16.629372+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:01:16.629372+0000","last_undegraded":"2024-04-25T22:01:16.629372+0000","last_fullsized":"2024-04-25T22:01:16.629372+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630769+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:01:16.630769+0000","last_peered":"2024-04-25T22:01:16.630769+0000","last_clean":"2024-04-25T22:01:16.630769+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:01:16.630769+0000","last_undegraded":"2024-04-25T22:01:16.630769+0000","last_fullsized":"2024-04-25T22:01:16.630769+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642365+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:01:15.642365+0000","last_peered":"2024-04-25T22:01:15.642365+0000","last_clean":"2024-04-25T22:01:15.642365+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:01:15.642365+0000","last_undegraded":"2024-04-25T22:01:15.642365+0000","last_fullsized":"2024-04-25T22:01:15.642365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630930+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:01:16.630930+0000","last_peered":"2024-04-25T22:01:16.630930+0000","last_clean":"2024-04-25T22:01:16.630930+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:01:16.630930+0000","last_undegraded":"2024-04-25T22:01:16.630930+0000","last_fullsized":"2024-04-25T22:01:16.630930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629358+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:01:16.629358+0000","last_peered":"2024-04-25T22:01:16.629358+0000","last_clean":"2024-04-25T22:01:16.629358+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:01:16.629358+0000","last_undegraded":"2024-04-25T22:01:16.629358+0000","last_fullsized":"2024-04-25T22:01:16.629358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641937+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:01:15.641937+0000","last_peered":"2024-04-25T22:01:15.641937+0000","last_clean":"2024-04-25T22:01:15.641937+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:01:15.641937+0000","last_undegraded":"2024-04-25T22:01:15.641937+0000","last_fullsized":"2024-04-25T22:01:15.641937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644200+0000","last_change":"2024-04-25T22:01:14.645176+0000","last_active":"2024-04-25T22:01:15.644200+0000","last_peered":"2024-04-25T22:01:15.644200+0000","last_clean":"2024-04-25T22:01:15.644200+0000","last_became_active":"2024-04-25T22:01:14.642395+0000","last_became_peered":"2024-04-25T22:01:14.642395+0000","last_unstale":"2024-04-25T22:01:15.644200+0000","last_undegraded":"2024-04-25T22:01:15.644200+0000","last_fullsized":"2024-04-25T22:01:15.644200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642690+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:01:15.642690+0000","last_peered":"2024-04-25T22:01:15.642690+0000","last_clean":"2024-04-25T22:01:15.642690+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:01:15.642690+0000","last_undegraded":"2024-04-25T22:01:15.642690+0000","last_fullsized":"2024-04-25T22:01:15.642690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643904+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:01:15.643904+0000","last_peered":"2024-04-25T22:01:15.643904+0000","last_clean":"2024-04-25T22:01:15.643904+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:01:15.643904+0000","last_undegraded":"2024-04-25T22:01:15.643904+0000","last_fullsized":"2024-04-25T22:01:15.643904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643553+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:01:15.643553+0000","last_peered":"2024-04-25T22:01:15.643553+0000","last_clean":"2024-04-25T22:01:15.643553+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:01:15.643553+0000","last_undegraded":"2024-04-25T22:01:15.643553+0000","last_fullsized":"2024-04-25T22:01:15.643553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631460+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:01:16.631460+0000","last_peered":"2024-04-25T22:01:16.631460+0000","last_clean":"2024-04-25T22:01:16.631460+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:01:16.631460+0000","last_undegraded":"2024-04-25T22:01:16.631460+0000","last_fullsized":"2024-04-25T22:01:16.631460+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630582+0000","last_change":"2024-04-25T22:01:13.627274+0000","last_active":"2024-04-25T22:01:16.630582+0000","last_peered":"2024-04-25T22:01:16.630582+0000","last_clean":"2024-04-25T22:01:16.630582+0000","last_became_active":"2024-04-25T22:01:13.626015+0000","last_became_peered":"2024-04-25T22:01:13.626015+0000","last_unstale":"2024-04-25T22:01:16.630582+0000","last_undegraded":"2024-04-25T22:01:16.630582+0000","last_fullsized":"2024-04-25T22:01:16.630582+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643225+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:01:15.643225+0000","last_peered":"2024-04-25T22:01:15.643225+0000","last_clean":"2024-04-25T22:01:15.643225+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:01:15.643225+0000","last_undegraded":"2024-04-25T22:01:15.643225+0000","last_fullsized":"2024-04-25T22:01:15.643225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631136+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:01:16.631136+0000","last_peered":"2024-04-25T22:01:16.631136+0000","last_clean":"2024-04-25T22:01:16.631136+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:01:16.631136+0000","last_undegraded":"2024-04-25T22:01:16.631136+0000","last_fullsized":"2024-04-25T22:01:16.631136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643456+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:01:15.643456+0000","last_peered":"2024-04-25T22:01:15.643456+0000","last_clean":"2024-04-25T22:01:15.643456+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:01:15.643456+0000","last_undegraded":"2024-04-25T22:01:15.643456+0000","last_fullsized":"2024-04-25T22:01:15.643456+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643426+0000","last_change":"2024-04-25T22:01:14.637520+0000","last_active":"2024-04-25T22:01:15.643426+0000","last_peered":"2024-04-25T22:01:15.643426+0000","last_clean":"2024-04-25T22:01:15.643426+0000","last_became_active":"2024-04-25T22:01:14.636765+0000","last_became_peered":"2024-04-25T22:01:14.636765+0000","last_unstale":"2024-04-25T22:01:15.643426+0000","last_undegraded":"2024-04-25T22:01:15.643426+0000","last_fullsized":"2024-04-25T22:01:15.643426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643206+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:01:15.643206+0000","last_peered":"2024-04-25T22:01:15.643206+0000","last_clean":"2024-04-25T22:01:15.643206+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:01:15.643206+0000","last_undegraded":"2024-04-25T22:01:15.643206+0000","last_fullsized":"2024-04-25T22:01:15.643206+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.645129+0000","last_change":"2024-04-25T22:01:09.582204+0000","last_active":"2024-04-25T22:01:15.645129+0000","last_peered":"2024-04-25T22:01:15.645129+0000","last_clean":"2024-04-25T22:01:15.645129+0000","last_became_active":"2024-04-25T22:01:09.581494+0000","last_became_peered":"2024-04-25T22:01:09.581494+0000","last_unstale":"2024-04-25T22:01:15.645129+0000","last_undegraded":"2024-04-25T22:01:15.645129+0000","last_fullsized":"2024-04-25T22:01:15.645129+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:13.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642878+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:01:15.642878+0000","last_peered":"2024-04-25T22:01:15.642878+0000","last_clean":"2024-04-25T22:01:15.642878+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:01:15.642878+0000","last_undegraded":"2024-04-25T22:01:15.642878+0000","last_fullsized":"2024-04-25T22:01:15.642878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644141+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:01:15.644141+0000","last_peered":"2024-04-25T22:01:15.644141+0000","last_clean":"2024-04-25T22:01:15.644141+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:01:15.644141+0000","last_undegraded":"2024-04-25T22:01:15.644141+0000","last_fullsized":"2024-04-25T22:01:15.644141+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644123+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:01:15.644123+0000","last_peered":"2024-04-25T22:01:15.644123+0000","last_clean":"2024-04-25T22:01:15.644123+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:01:15.644123+0000","last_undegraded":"2024-04-25T22:01:15.644123+0000","last_fullsized":"2024-04-25T22:01:15.644123+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641739+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:01:15.641739+0000","last_peered":"2024-04-25T22:01:15.641739+0000","last_clean":"2024-04-25T22:01:15.641739+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:01:15.641739+0000","last_undegraded":"2024-04-25T22:01:15.641739+0000","last_fullsized":"2024-04-25T22:01:15.641739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644055+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:01:15.644055+0000","last_peered":"2024-04-25T22:01:15.644055+0000","last_clean":"2024-04-25T22:01:15.644055+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:01:15.644055+0000","last_undegraded":"2024-04-25T22:01:15.644055+0000","last_fullsized":"2024-04-25T22:01:15.644055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630203+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:01:16.630203+0000","last_peered":"2024-04-25T22:01:16.630203+0000","last_clean":"2024-04-25T22:01:16.630203+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:01:16.630203+0000","last_undegraded":"2024-04-25T22:01:16.630203+0000","last_fullsized":"2024-04-25T22:01:16.630203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642445+0000","last_change":"2024-04-25T22:01:14.632306+0000","last_active":"2024-04-25T22:01:15.642445+0000","last_peered":"2024-04-25T22:01:15.642445+0000","last_clean":"2024-04-25T22:01:15.642445+0000","last_became_active":"2024-04-25T22:01:14.631179+0000","last_became_peered":"2024-04-25T22:01:14.631179+0000","last_unstale":"2024-04-25T22:01:15.642445+0000","last_undegraded":"2024-04-25T22:01:15.642445+0000","last_fullsized":"2024-04-25T22:01:15.642445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630101+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:01:16.630101+0000","last_peered":"2024-04-25T22:01:16.630101+0000","last_clean":"2024-04-25T22:01:16.630101+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:01:16.630101+0000","last_undegraded":"2024-04-25T22:01:16.630101+0000","last_fullsized":"2024-04-25T22:01:16.630101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631516+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:01:16.631516+0000","last_peered":"2024-04-25T22:01:16.631516+0000","last_clean":"2024-04-25T22:01:16.631516+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:01:16.631516+0000","last_undegraded":"2024-04-25T22:01:16.631516+0000","last_fullsized":"2024-04-25T22:01:16.631516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641760+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:01:15.641760+0000","last_peered":"2024-04-25T22:01:15.641760+0000","last_clean":"2024-04-25T22:01:15.641760+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:01:15.641760+0000","last_undegraded":"2024-04-25T22:01:15.641760+0000","last_fullsized":"2024-04-25T22:01:15.641760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644879+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:01:15.644879+0000","last_peered":"2024-04-25T22:01:15.644879+0000","last_clean":"2024-04-25T22:01:15.644879+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:01:15.644879+0000","last_undegraded":"2024-04-25T22:01:15.644879+0000","last_fullsized":"2024-04-25T22:01:15.644879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629767+0000","last_change":"2024-04-25T22:01:13.626710+0000","last_active":"2024-04-25T22:01:16.629767+0000","last_peered":"2024-04-25T22:01:16.629767+0000","last_clean":"2024-04-25T22:01:16.629767+0000","last_became_active":"2024-04-25T22:01:13.625898+0000","last_became_peered":"2024-04-25T22:01:13.625898+0000","last_unstale":"2024-04-25T22:01:16.629767+0000","last_undegraded":"2024-04-25T22:01:16.629767+0000","last_fullsized":"2024-04-25T22:01:16.629767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641621+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:01:15.641621+0000","last_peered":"2024-04-25T22:01:15.641621+0000","last_clean":"2024-04-25T22:01:15.641621+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:01:15.641621+0000","last_undegraded":"2024-04-25T22:01:15.641621+0000","last_fullsized":"2024-04-25T22:01:15.641621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643856+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:01:15.643856+0000","last_peered":"2024-04-25T22:01:15.643856+0000","last_clean":"2024-04-25T22:01:15.643856+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:01:15.643856+0000","last_undegraded":"2024-04-25T22:01:15.643856+0000","last_fullsized":"2024-04-25T22:01:15.643856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641332+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:01:15.641332+0000","last_peered":"2024-04-25T22:01:15.641332+0000","last_clean":"2024-04-25T22:01:15.641332+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:01:15.641332+0000","last_undegraded":"2024-04-25T22:01:15.641332+0000","last_fullsized":"2024-04-25T22:01:15.641332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644225+0000","last_change":"2024-04-25T22:01:14.639447+0000","last_active":"2024-04-25T22:01:15.644225+0000","last_peered":"2024-04-25T22:01:15.644225+0000","last_clean":"2024-04-25T22:01:15.644225+0000","last_became_active":"2024-04-25T22:01:14.638864+0000","last_became_peered":"2024-04-25T22:01:14.638864+0000","last_unstale":"2024-04-25T22:01:15.644225+0000","last_undegraded":"2024-04-25T22:01:15.644225+0000","last_fullsized":"2024-04-25T22:01:15.644225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642023+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:01:15.642023+0000","last_peered":"2024-04-25T22:01:15.642023+0000","last_clean":"2024-04-25T22:01:15.642023+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:01:15.642023+0000","last_undegraded":"2024-04-25T22:01:15.642023+0000","last_fullsized":"2024-04-25T22:01:15.642023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643570+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:01:15.643570+0000","last_peered":"2024-04-25T22:01:15.643570+0000","last_clean":"2024-04-25T22:01:15.643570+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:01:15.643570+0000","last_undegraded":"2024-04-25T22:01:15.643570+0000","last_fullsized":"2024-04-25T22:01:15.643570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641814+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:01:15.641814+0000","last_peered":"2024-04-25T22:01:15.641814+0000","last_clean":"2024-04-25T22:01:15.641814+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:01:15.641814+0000","last_undegraded":"2024-04-25T22:01:15.641814+0000","last_fullsized":"2024-04-25T22:01:15.641814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644642+0000","last_change":"2024-04-25T22:01:14.637452+0000","last_active":"2024-04-25T22:01:15.644642+0000","last_peered":"2024-04-25T22:01:15.644642+0000","last_clean":"2024-04-25T22:01:15.644642+0000","last_became_active":"2024-04-25T22:01:14.636407+0000","last_became_peered":"2024-04-25T22:01:14.636407+0000","last_unstale":"2024-04-25T22:01:15.644642+0000","last_undegraded":"2024-04-25T22:01:15.644642+0000","last_fullsized":"2024-04-25T22:01:15.644642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643041+0000","last_change":"2024-04-25T22:01:13.621997+0000","last_active":"2024-04-25T22:01:15.643041+0000","last_peered":"2024-04-25T22:01:15.643041+0000","last_clean":"2024-04-25T22:01:15.643041+0000","last_became_active":"2024-04-25T22:01:13.620987+0000","last_became_peered":"2024-04-25T22:01:13.620987+0000","last_unstale":"2024-04-25T22:01:15.643041+0000","last_undegraded":"2024-04-25T22:01:15.643041+0000","last_fullsized":"2024-04-25T22:01:15.643041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643601+0000","last_change":"2024-04-25T22:01:14.650437+0000","last_active":"2024-04-25T22:01:15.643601+0000","last_peered":"2024-04-25T22:01:15.643601+0000","last_clean":"2024-04-25T22:01:15.643601+0000","last_became_active":"2024-04-25T22:01:14.648116+0000","last_became_peered":"2024-04-25T22:01:14.648116+0000","last_unstale":"2024-04-25T22:01:15.643601+0000","last_undegraded":"2024-04-25T22:01:15.643601+0000","last_fullsized":"2024-04-25T22:01:15.643601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643173+0000","last_change":"2024-04-25T22:01:13.631562+0000","last_active":"2024-04-25T22:01:15.643173+0000","last_peered":"2024-04-25T22:01:15.643173+0000","last_clean":"2024-04-25T22:01:15.643173+0000","last_became_active":"2024-04-25T22:01:13.630731+0000","last_became_peered":"2024-04-25T22:01:13.630731+0000","last_unstale":"2024-04-25T22:01:15.643173+0000","last_undegraded":"2024-04-25T22:01:15.643173+0000","last_fullsized":"2024-04-25T22:01:15.643173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629517+0000","last_change":"2024-04-25T22:01:14.654909+0000","last_active":"2024-04-25T22:01:16.629517+0000","last_peered":"2024-04-25T22:01:16.629517+0000","last_clean":"2024-04-25T22:01:16.629517+0000","last_became_active":"2024-04-25T22:01:14.653503+0000","last_became_peered":"2024-04-25T22:01:14.653503+0000","last_unstale":"2024-04-25T22:01:16.629517+0000","last_undegraded":"2024-04-25T22:01:16.629517+0000","last_fullsized":"2024-04-25T22:01:16.629517+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631196+0000","last_change":"2024-04-25T22:01:13.628356+0000","last_active":"2024-04-25T22:01:16.631196+0000","last_peered":"2024-04-25T22:01:16.631196+0000","last_clean":"2024-04-25T22:01:16.631196+0000","last_became_active":"2024-04-25T22:01:13.626608+0000","last_became_peered":"2024-04-25T22:01:13.626608+0000","last_unstale":"2024-04-25T22:01:16.631196+0000","last_undegraded":"2024-04-25T22:01:16.631196+0000","last_fullsized":"2024-04-25T22:01:16.631196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631268+0000","last_change":"2024-04-25T22:01:14.648752+0000","last_active":"2024-04-25T22:01:16.631268+0000","last_peered":"2024-04-25T22:01:16.631268+0000","last_clean":"2024-04-25T22:01:16.631268+0000","last_became_active":"2024-04-25T22:01:14.647463+0000","last_became_peered":"2024-04-25T22:01:14.647463+0000","last_unstale":"2024-04-25T22:01:16.631268+0000","last_undegraded":"2024-04-25T22:01:16.631268+0000","last_fullsized":"2024-04-25T22:01:16.631268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:22.946881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644469+0000","last_change":"2024-04-25T22:01:13.630502+0000","last_active":"2024-04-25T22:01:15.644469+0000","last_peered":"2024-04-25T22:01:15.644469+0000","last_clean":"2024-04-25T22:01:15.644469+0000","last_became_active":"2024-04-25T22:01:13.629854+0000","last_became_peered":"2024-04-25T22:01:13.629854+0000","last_unstale":"2024-04-25T22:01:15.644469+0000","last_undegraded":"2024-04-25T22:01:15.644469+0000","last_fullsized":"2024-04-25T22:01:15.644469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643115+0000","last_change":"2024-04-25T22:01:14.642104+0000","last_active":"2024-04-25T22:01:15.643115+0000","last_peered":"2024-04-25T22:01:15.643115+0000","last_clean":"2024-04-25T22:01:15.643115+0000","last_became_active":"2024-04-25T22:01:14.641323+0000","last_became_peered":"2024-04-25T22:01:14.641323+0000","last_unstale":"2024-04-25T22:01:15.643115+0000","last_undegraded":"2024-04-25T22:01:15.643115+0000","last_fullsized":"2024-04-25T22:01:15.643115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643826+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:01:15.643826+0000","last_peered":"2024-04-25T22:01:15.643826+0000","last_clean":"2024-04-25T22:01:15.643826+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:01:15.643826+0000","last_undegraded":"2024-04-25T22:01:15.643826+0000","last_fullsized":"2024-04-25T22:01:15.643826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629024+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:01:16.629024+0000","last_peered":"2024-04-25T22:01:16.629024+0000","last_clean":"2024-04-25T22:01:16.629024+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:01:16.629024+0000","last_undegraded":"2024-04-25T22:01:16.629024+0000","last_fullsized":"2024-04-25T22:01:16.629024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643575+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:01:15.643575+0000","last_peered":"2024-04-25T22:01:15.643575+0000","last_clean":"2024-04-25T22:01:15.643575+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:01:15.643575+0000","last_undegraded":"2024-04-25T22:01:15.643575+0000","last_fullsized":"2024-04-25T22:01:15.643575+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":237568,"data_stored":647274,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":55728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":245760,"data_stored":647890,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:01:27.109 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:01:27.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:27.467 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:01:27.483 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-04-25T22:01:25.565025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90028,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025492,"statfs":{"total":289910292480,"available":289818103808,"internally_reserved":0,"allocated":647168,"data_stored":1350892,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003209"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643883+0000","last_change":"2024-04-25T22:01:14.641678+0000","last_active":"2024-04-25T22:01:15.643883+0000","last_peered":"2024-04-25T22:01:15.643883+0000","last_clean":"2024-04-25T22:01:15.643883+0000","last_became_active":"2024-04-25T22:01:14.640808+0000","last_became_peered":"2024-04-25T22:01:14.640808+0000","last_unstale":"2024-04-25T22:01:15.643883+0000","last_undegraded":"2024-04-25T22:01:15.643883+0000","last_fullsized":"2024-04-25T22:01:15.643883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643649+0000","last_change":"2024-04-25T22:01:14.648935+0000","last_active":"2024-04-25T22:01:15.643649+0000","last_peered":"2024-04-25T22:01:15.643649+0000","last_clean":"2024-04-25T22:01:15.643649+0000","last_became_active":"2024-04-25T22:01:14.647871+0000","last_became_peered":"2024-04-25T22:01:14.647871+0000","last_unstale":"2024-04-25T22:01:15.643649+0000","last_undegraded":"2024-04-25T22:01:15.643649+0000","last_fullsized":"2024-04-25T22:01:15.643649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629685+0000","last_change":"2024-04-25T22:01:14.647262+0000","last_active":"2024-04-25T22:01:16.629685+0000","last_peered":"2024-04-25T22:01:16.629685+0000","last_clean":"2024-04-25T22:01:16.629685+0000","last_became_active":"2024-04-25T22:01:14.645878+0000","last_became_peered":"2024-04-25T22:01:14.645878+0000","last_unstale":"2024-04-25T22:01:16.629685+0000","last_undegraded":"2024-04-25T22:01:16.629685+0000","last_fullsized":"2024-04-25T22:01:16.629685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630225+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:01:16.630225+0000","last_peered":"2024-04-25T22:01:16.630225+0000","last_clean":"2024-04-25T22:01:16.630225+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:01:16.630225+0000","last_undegraded":"2024-04-25T22:01:16.630225+0000","last_fullsized":"2024-04-25T22:01:16.630225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643155+0000","last_change":"2024-04-25T22:01:14.642505+0000","last_active":"2024-04-25T22:01:15.643155+0000","last_peered":"2024-04-25T22:01:15.643155+0000","last_clean":"2024-04-25T22:01:15.643155+0000","last_became_active":"2024-04-25T22:01:14.641574+0000","last_became_peered":"2024-04-25T22:01:14.641574+0000","last_unstale":"2024-04-25T22:01:15.643155+0000","last_undegraded":"2024-04-25T22:01:15.643155+0000","last_fullsized":"2024-04-25T22:01:15.643155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630343+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:01:16.630343+0000","last_peered":"2024-04-25T22:01:16.630343+0000","last_clean":"2024-04-25T22:01:16.630343+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:01:16.630343+0000","last_undegraded":"2024-04-25T22:01:16.630343+0000","last_fullsized":"2024-04-25T22:01:16.630343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628889+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:01:16.628889+0000","last_peered":"2024-04-25T22:01:16.628889+0000","last_clean":"2024-04-25T22:01:16.628889+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:01:16.628889+0000","last_undegraded":"2024-04-25T22:01:16.628889+0000","last_fullsized":"2024-04-25T22:01:16.628889+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628140+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:01:16.628140+0000","last_peered":"2024-04-25T22:01:16.628140+0000","last_clean":"2024-04-25T22:01:16.628140+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:01:16.628140+0000","last_undegraded":"2024-04-25T22:01:16.628140+0000","last_fullsized":"2024-04-25T22:01:16.628140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642568+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:01:15.642568+0000","last_peered":"2024-04-25T22:01:15.642568+0000","last_clean":"2024-04-25T22:01:15.642568+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:01:15.642568+0000","last_undegraded":"2024-04-25T22:01:15.642568+0000","last_fullsized":"2024-04-25T22:01:15.642568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643687+0000","last_change":"2024-04-25T22:01:14.647968+0000","last_active":"2024-04-25T22:01:15.643687+0000","last_peered":"2024-04-25T22:01:15.643687+0000","last_clean":"2024-04-25T22:01:15.643687+0000","last_became_active":"2024-04-25T22:01:14.646872+0000","last_became_peered":"2024-04-25T22:01:14.646872+0000","last_unstale":"2024-04-25T22:01:15.643687+0000","last_undegraded":"2024-04-25T22:01:15.643687+0000","last_fullsized":"2024-04-25T22:01:15.643687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629818+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:01:16.629818+0000","last_peered":"2024-04-25T22:01:16.629818+0000","last_clean":"2024-04-25T22:01:16.629818+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:01:16.629818+0000","last_undegraded":"2024-04-25T22:01:16.629818+0000","last_fullsized":"2024-04-25T22:01:16.629818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643509+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:01:15.643509+0000","last_peered":"2024-04-25T22:01:15.643509+0000","last_clean":"2024-04-25T22:01:15.643509+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:01:15.643509+0000","last_undegraded":"2024-04-25T22:01:15.643509+0000","last_fullsized":"2024-04-25T22:01:15.643509+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642423+0000","last_change":"2024-04-25T22:01:14.643909+0000","last_active":"2024-04-25T22:01:15.642423+0000","last_peered":"2024-04-25T22:01:15.642423+0000","last_clean":"2024-04-25T22:01:15.642423+0000","last_became_active":"2024-04-25T22:01:14.642421+0000","last_became_peered":"2024-04-25T22:01:14.642421+0000","last_unstale":"2024-04-25T22:01:15.642423+0000","last_undegraded":"2024-04-25T22:01:15.642423+0000","last_fullsized":"2024-04-25T22:01:15.642423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630801+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:01:16.630801+0000","last_peered":"2024-04-25T22:01:16.630801+0000","last_clean":"2024-04-25T22:01:16.630801+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:01:16.630801+0000","last_undegraded":"2024-04-25T22:01:16.630801+0000","last_fullsized":"2024-04-25T22:01:16.630801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628926+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:01:16.628926+0000","last_peered":"2024-04-25T22:01:16.628926+0000","last_clean":"2024-04-25T22:01:16.628926+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:01:16.628926+0000","last_undegraded":"2024-04-25T22:01:16.628926+0000","last_fullsized":"2024-04-25T22:01:16.628926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628179+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:01:16.628179+0000","last_peered":"2024-04-25T22:01:16.628179+0000","last_clean":"2024-04-25T22:01:16.628179+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:01:16.628179+0000","last_undegraded":"2024-04-25T22:01:16.628179+0000","last_fullsized":"2024-04-25T22:01:16.628179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644180+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:01:15.644180+0000","last_peered":"2024-04-25T22:01:15.644180+0000","last_clean":"2024-04-25T22:01:15.644180+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:01:15.644180+0000","last_undegraded":"2024-04-25T22:01:15.644180+0000","last_fullsized":"2024-04-25T22:01:15.644180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644577+0000","last_change":"2024-04-25T22:01:14.647317+0000","last_active":"2024-04-25T22:01:15.644577+0000","last_peered":"2024-04-25T22:01:15.644577+0000","last_clean":"2024-04-25T22:01:15.644577+0000","last_became_active":"2024-04-25T22:01:14.644027+0000","last_became_peered":"2024-04-25T22:01:14.644027+0000","last_unstale":"2024-04-25T22:01:15.644577+0000","last_undegraded":"2024-04-25T22:01:15.644577+0000","last_fullsized":"2024-04-25T22:01:15.644577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642752+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:01:15.642752+0000","last_peered":"2024-04-25T22:01:15.642752+0000","last_clean":"2024-04-25T22:01:15.642752+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:01:15.642752+0000","last_undegraded":"2024-04-25T22:01:15.642752+0000","last_fullsized":"2024-04-25T22:01:15.642752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630673+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:01:16.630673+0000","last_peered":"2024-04-25T22:01:16.630673+0000","last_clean":"2024-04-25T22:01:16.630673+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:01:16.630673+0000","last_undegraded":"2024-04-25T22:01:16.630673+0000","last_fullsized":"2024-04-25T22:01:16.630673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630420+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:01:16.630420+0000","last_peered":"2024-04-25T22:01:16.630420+0000","last_clean":"2024-04-25T22:01:16.630420+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:01:16.630420+0000","last_undegraded":"2024-04-25T22:01:16.630420+0000","last_fullsized":"2024-04-25T22:01:16.630420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642311+0000","last_change":"2024-04-25T22:01:14.633477+0000","last_active":"2024-04-25T22:01:15.642311+0000","last_peered":"2024-04-25T22:01:15.642311+0000","last_clean":"2024-04-25T22:01:15.642311+0000","last_became_active":"2024-04-25T22:01:14.632678+0000","last_became_peered":"2024-04-25T22:01:14.632678+0000","last_unstale":"2024-04-25T22:01:15.642311+0000","last_undegraded":"2024-04-25T22:01:15.642311+0000","last_fullsized":"2024-04-25T22:01:15.642311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641145+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:01:15.641145+0000","last_peered":"2024-04-25T22:01:15.641145+0000","last_clean":"2024-04-25T22:01:15.641145+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:01:15.641145+0000","last_undegraded":"2024-04-25T22:01:15.641145+0000","last_fullsized":"2024-04-25T22:01:15.641145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641815+0000","last_change":"2024-04-25T22:01:14.641991+0000","last_active":"2024-04-25T22:01:15.641815+0000","last_peered":"2024-04-25T22:01:15.641815+0000","last_clean":"2024-04-25T22:01:15.641815+0000","last_became_active":"2024-04-25T22:01:14.641244+0000","last_became_peered":"2024-04-25T22:01:14.641244+0000","last_unstale":"2024-04-25T22:01:15.641815+0000","last_undegraded":"2024-04-25T22:01:15.641815+0000","last_fullsized":"2024-04-25T22:01:15.641815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:03.098700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644044+0000","last_change":"2024-04-25T22:01:14.638103+0000","last_active":"2024-04-25T22:01:15.644044+0000","last_peered":"2024-04-25T22:01:15.644044+0000","last_clean":"2024-04-25T22:01:15.644044+0000","last_became_active":"2024-04-25T22:01:14.636488+0000","last_became_peered":"2024-04-25T22:01:14.636488+0000","last_unstale":"2024-04-25T22:01:15.644044+0000","last_undegraded":"2024-04-25T22:01:15.644044+0000","last_fullsized":"2024-04-25T22:01:15.644044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643468+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:01:15.643468+0000","last_peered":"2024-04-25T22:01:15.643468+0000","last_clean":"2024-04-25T22:01:15.643468+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:01:15.643468+0000","last_undegraded":"2024-04-25T22:01:15.643468+0000","last_fullsized":"2024-04-25T22:01:15.643468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630101+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:01:16.630101+0000","last_peered":"2024-04-25T22:01:16.630101+0000","last_clean":"2024-04-25T22:01:16.630101+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:01:16.630101+0000","last_undegraded":"2024-04-25T22:01:16.630101+0000","last_fullsized":"2024-04-25T22:01:16.630101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644402+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:01:15.644402+0000","last_peered":"2024-04-25T22:01:15.644402+0000","last_clean":"2024-04-25T22:01:15.644402+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:01:15.644402+0000","last_undegraded":"2024-04-25T22:01:15.644402+0000","last_fullsized":"2024-04-25T22:01:15.644402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642402+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:01:15.642402+0000","last_peered":"2024-04-25T22:01:15.642402+0000","last_clean":"2024-04-25T22:01:15.642402+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:01:15.642402+0000","last_undegraded":"2024-04-25T22:01:15.642402+0000","last_fullsized":"2024-04-25T22:01:15.642402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642766+0000","last_change":"2024-04-25T22:01:14.638343+0000","last_active":"2024-04-25T22:01:15.642766+0000","last_peered":"2024-04-25T22:01:15.642766+0000","last_clean":"2024-04-25T22:01:15.642766+0000","last_became_active":"2024-04-25T22:01:14.637694+0000","last_became_peered":"2024-04-25T22:01:14.637694+0000","last_unstale":"2024-04-25T22:01:15.642766+0000","last_undegraded":"2024-04-25T22:01:15.642766+0000","last_fullsized":"2024-04-25T22:01:15.642766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641265+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:01:15.641265+0000","last_peered":"2024-04-25T22:01:15.641265+0000","last_clean":"2024-04-25T22:01:15.641265+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:01:15.641265+0000","last_undegraded":"2024-04-25T22:01:15.641265+0000","last_fullsized":"2024-04-25T22:01:15.641265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628586+0000","last_change":"2024-04-25T22:01:14.648196+0000","last_active":"2024-04-25T22:01:16.628586+0000","last_peered":"2024-04-25T22:01:16.628586+0000","last_clean":"2024-04-25T22:01:16.628586+0000","last_became_active":"2024-04-25T22:01:14.647509+0000","last_became_peered":"2024-04-25T22:01:14.647509+0000","last_unstale":"2024-04-25T22:01:16.628586+0000","last_undegraded":"2024-04-25T22:01:16.628586+0000","last_fullsized":"2024-04-25T22:01:16.628586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643932+0000","last_change":"2024-04-25T22:01:14.641706+0000","last_active":"2024-04-25T22:01:15.643932+0000","last_peered":"2024-04-25T22:01:15.643932+0000","last_clean":"2024-04-25T22:01:15.643932+0000","last_became_active":"2024-04-25T22:01:14.641043+0000","last_became_peered":"2024-04-25T22:01:14.641043+0000","last_unstale":"2024-04-25T22:01:15.643932+0000","last_undegraded":"2024-04-25T22:01:15.643932+0000","last_fullsized":"2024-04-25T22:01:15.643932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630432+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:01:16.630432+0000","last_peered":"2024-04-25T22:01:16.630432+0000","last_clean":"2024-04-25T22:01:16.630432+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:01:16.630432+0000","last_undegraded":"2024-04-25T22:01:16.630432+0000","last_fullsized":"2024-04-25T22:01:16.630432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644159+0000","last_change":"2024-04-25T22:01:14.635075+0000","last_active":"2024-04-25T22:01:15.644159+0000","last_peered":"2024-04-25T22:01:15.644159+0000","last_clean":"2024-04-25T22:01:15.644159+0000","last_became_active":"2024-04-25T22:01:14.630677+0000","last_became_peered":"2024-04-25T22:01:14.630677+0000","last_unstale":"2024-04-25T22:01:15.644159+0000","last_undegraded":"2024-04-25T22:01:15.644159+0000","last_fullsized":"2024-04-25T22:01:15.644159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641776+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:01:15.641776+0000","last_peered":"2024-04-25T22:01:15.641776+0000","last_clean":"2024-04-25T22:01:15.641776+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:01:15.641776+0000","last_undegraded":"2024-04-25T22:01:15.641776+0000","last_fullsized":"2024-04-25T22:01:15.641776+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644033+0000","last_change":"2024-04-25T22:01:14.648527+0000","last_active":"2024-04-25T22:01:15.644033+0000","last_peered":"2024-04-25T22:01:15.644033+0000","last_clean":"2024-04-25T22:01:15.644033+0000","last_became_active":"2024-04-25T22:01:14.645040+0000","last_became_peered":"2024-04-25T22:01:14.645040+0000","last_unstale":"2024-04-25T22:01:15.644033+0000","last_undegraded":"2024-04-25T22:01:15.644033+0000","last_fullsized":"2024-04-25T22:01:15.644033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642322+0000","last_change":"2024-04-25T22:01:13.630817+0000","last_active":"2024-04-25T22:01:15.642322+0000","last_peered":"2024-04-25T22:01:15.642322+0000","last_clean":"2024-04-25T22:01:15.642322+0000","last_became_active":"2024-04-25T22:01:13.629994+0000","last_became_peered":"2024-04-25T22:01:13.629994+0000","last_unstale":"2024-04-25T22:01:15.642322+0000","last_undegraded":"2024-04-25T22:01:15.642322+0000","last_fullsized":"2024-04-25T22:01:15.642322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643109+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:01:15.643109+0000","last_peered":"2024-04-25T22:01:15.643109+0000","last_clean":"2024-04-25T22:01:15.643109+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:01:15.643109+0000","last_undegraded":"2024-04-25T22:01:15.643109+0000","last_fullsized":"2024-04-25T22:01:15.643109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628481+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:01:16.628481+0000","last_peered":"2024-04-25T22:01:16.628481+0000","last_clean":"2024-04-25T22:01:16.628481+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:01:16.628481+0000","last_undegraded":"2024-04-25T22:01:16.628481+0000","last_fullsized":"2024-04-25T22:01:16.628481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630098+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:01:16.630098+0000","last_peered":"2024-04-25T22:01:16.630098+0000","last_clean":"2024-04-25T22:01:16.630098+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:01:16.630098+0000","last_undegraded":"2024-04-25T22:01:16.630098+0000","last_fullsized":"2024-04-25T22:01:16.630098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641940+0000","last_change":"2024-04-25T22:01:14.633805+0000","last_active":"2024-04-25T22:01:15.641940+0000","last_peered":"2024-04-25T22:01:15.641940+0000","last_clean":"2024-04-25T22:01:15.641940+0000","last_became_active":"2024-04-25T22:01:14.633045+0000","last_became_peered":"2024-04-25T22:01:14.633045+0000","last_unstale":"2024-04-25T22:01:15.641940+0000","last_undegraded":"2024-04-25T22:01:15.641940+0000","last_fullsized":"2024-04-25T22:01:15.641940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:43.718628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644703+0000","last_change":"2024-04-25T22:01:13.631135+0000","last_active":"2024-04-25T22:01:15.644703+0000","last_peered":"2024-04-25T22:01:15.644703+0000","last_clean":"2024-04-25T22:01:15.644703+0000","last_became_active":"2024-04-25T22:01:13.630257+0000","last_became_peered":"2024-04-25T22:01:13.630257+0000","last_unstale":"2024-04-25T22:01:15.644703+0000","last_undegraded":"2024-04-25T22:01:15.644703+0000","last_fullsized":"2024-04-25T22:01:15.644703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641989+0000","last_change":"2024-04-25T22:01:14.630233+0000","last_active":"2024-04-25T22:01:15.641989+0000","last_peered":"2024-04-25T22:01:15.641989+0000","last_clean":"2024-04-25T22:01:15.641989+0000","last_became_active":"2024-04-25T22:01:14.629415+0000","last_became_peered":"2024-04-25T22:01:14.629415+0000","last_unstale":"2024-04-25T22:01:15.641989+0000","last_undegraded":"2024-04-25T22:01:15.641989+0000","last_fullsized":"2024-04-25T22:01:15.641989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:02:28.593163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630847+0000","last_change":"2024-04-25T22:01:13.633106+0000","last_active":"2024-04-25T22:01:16.630847+0000","last_peered":"2024-04-25T22:01:16.630847+0000","last_clean":"2024-04-25T22:01:16.630847+0000","last_became_active":"2024-04-25T22:01:13.631466+0000","last_became_peered":"2024-04-25T22:01:13.631466+0000","last_unstale":"2024-04-25T22:01:16.630847+0000","last_undegraded":"2024-04-25T22:01:16.630847+0000","last_fullsized":"2024-04-25T22:01:16.630847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:23.095422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630867+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:01:16.630867+0000","last_peered":"2024-04-25T22:01:16.630867+0000","last_clean":"2024-04-25T22:01:16.630867+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:01:16.630867+0000","last_undegraded":"2024-04-25T22:01:16.630867+0000","last_fullsized":"2024-04-25T22:01:16.630867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631516+0000","last_change":"2024-04-25T22:01:13.626767+0000","last_active":"2024-04-25T22:01:16.631516+0000","last_peered":"2024-04-25T22:01:16.631516+0000","last_clean":"2024-04-25T22:01:16.631516+0000","last_became_active":"2024-04-25T22:01:13.625984+0000","last_became_peered":"2024-04-25T22:01:13.625984+0000","last_unstale":"2024-04-25T22:01:16.631516+0000","last_undegraded":"2024-04-25T22:01:16.631516+0000","last_fullsized":"2024-04-25T22:01:16.631516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642637+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:01:15.642637+0000","last_peered":"2024-04-25T22:01:15.642637+0000","last_clean":"2024-04-25T22:01:15.642637+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:01:15.642637+0000","last_undegraded":"2024-04-25T22:01:15.642637+0000","last_fullsized":"2024-04-25T22:01:15.642637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643352+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:01:15.643352+0000","last_peered":"2024-04-25T22:01:15.643352+0000","last_clean":"2024-04-25T22:01:15.643352+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:01:15.643352+0000","last_undegraded":"2024-04-25T22:01:15.643352+0000","last_fullsized":"2024-04-25T22:01:15.643352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631293+0000","last_change":"2024-04-25T22:01:14.650077+0000","last_active":"2024-04-25T22:01:16.631293+0000","last_peered":"2024-04-25T22:01:16.631293+0000","last_clean":"2024-04-25T22:01:16.631293+0000","last_became_active":"2024-04-25T22:01:14.649315+0000","last_became_peered":"2024-04-25T22:01:14.649315+0000","last_unstale":"2024-04-25T22:01:16.631293+0000","last_undegraded":"2024-04-25T22:01:16.631293+0000","last_fullsized":"2024-04-25T22:01:16.631293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.976715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631205+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:01:16.631205+0000","last_peered":"2024-04-25T22:01:16.631205+0000","last_clean":"2024-04-25T22:01:16.631205+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:01:16.631205+0000","last_undegraded":"2024-04-25T22:01:16.631205+0000","last_fullsized":"2024-04-25T22:01:16.631205+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630528+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:01:16.630528+0000","last_peered":"2024-04-25T22:01:16.630528+0000","last_clean":"2024-04-25T22:01:16.630528+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:01:16.630528+0000","last_undegraded":"2024-04-25T22:01:16.630528+0000","last_fullsized":"2024-04-25T22:01:16.630528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642713+0000","last_change":"2024-04-25T22:01:13.631439+0000","last_active":"2024-04-25T22:01:15.642713+0000","last_peered":"2024-04-25T22:01:15.642713+0000","last_clean":"2024-04-25T22:01:15.642713+0000","last_became_active":"2024-04-25T22:01:13.630812+0000","last_became_peered":"2024-04-25T22:01:13.630812+0000","last_unstale":"2024-04-25T22:01:15.642713+0000","last_undegraded":"2024-04-25T22:01:15.642713+0000","last_fullsized":"2024-04-25T22:01:15.642713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629606+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:01:16.629606+0000","last_peered":"2024-04-25T22:01:16.629606+0000","last_clean":"2024-04-25T22:01:16.629606+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:01:16.629606+0000","last_undegraded":"2024-04-25T22:01:16.629606+0000","last_fullsized":"2024-04-25T22:01:16.629606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642135+0000","last_change":"2024-04-25T22:01:13.623342+0000","last_active":"2024-04-25T22:01:15.642135+0000","last_peered":"2024-04-25T22:01:15.642135+0000","last_clean":"2024-04-25T22:01:15.642135+0000","last_became_active":"2024-04-25T22:01:13.621460+0000","last_became_peered":"2024-04-25T22:01:13.621460+0000","last_unstale":"2024-04-25T22:01:15.642135+0000","last_undegraded":"2024-04-25T22:01:15.642135+0000","last_fullsized":"2024-04-25T22:01:15.642135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643302+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:01:15.643302+0000","last_peered":"2024-04-25T22:01:15.643302+0000","last_clean":"2024-04-25T22:01:15.643302+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:01:15.643302+0000","last_undegraded":"2024-04-25T22:01:15.643302+0000","last_fullsized":"2024-04-25T22:01:15.643302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629372+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:01:16.629372+0000","last_peered":"2024-04-25T22:01:16.629372+0000","last_clean":"2024-04-25T22:01:16.629372+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:01:16.629372+0000","last_undegraded":"2024-04-25T22:01:16.629372+0000","last_fullsized":"2024-04-25T22:01:16.629372+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630769+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:01:16.630769+0000","last_peered":"2024-04-25T22:01:16.630769+0000","last_clean":"2024-04-25T22:01:16.630769+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:01:16.630769+0000","last_undegraded":"2024-04-25T22:01:16.630769+0000","last_fullsized":"2024-04-25T22:01:16.630769+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642365+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:01:15.642365+0000","last_peered":"2024-04-25T22:01:15.642365+0000","last_clean":"2024-04-25T22:01:15.642365+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:01:15.642365+0000","last_undegraded":"2024-04-25T22:01:15.642365+0000","last_fullsized":"2024-04-25T22:01:15.642365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630930+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:01:16.630930+0000","last_peered":"2024-04-25T22:01:16.630930+0000","last_clean":"2024-04-25T22:01:16.630930+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:01:16.630930+0000","last_undegraded":"2024-04-25T22:01:16.630930+0000","last_fullsized":"2024-04-25T22:01:16.630930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629358+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:01:16.629358+0000","last_peered":"2024-04-25T22:01:16.629358+0000","last_clean":"2024-04-25T22:01:16.629358+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:01:16.629358+0000","last_undegraded":"2024-04-25T22:01:16.629358+0000","last_fullsized":"2024-04-25T22:01:16.629358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641937+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:01:15.641937+0000","last_peered":"2024-04-25T22:01:15.641937+0000","last_clean":"2024-04-25T22:01:15.641937+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:01:15.641937+0000","last_undegraded":"2024-04-25T22:01:15.641937+0000","last_fullsized":"2024-04-25T22:01:15.641937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644200+0000","last_change":"2024-04-25T22:01:14.645176+0000","last_active":"2024-04-25T22:01:15.644200+0000","last_peered":"2024-04-25T22:01:15.644200+0000","last_clean":"2024-04-25T22:01:15.644200+0000","last_became_active":"2024-04-25T22:01:14.642395+0000","last_became_peered":"2024-04-25T22:01:14.642395+0000","last_unstale":"2024-04-25T22:01:15.644200+0000","last_undegraded":"2024-04-25T22:01:15.644200+0000","last_fullsized":"2024-04-25T22:01:15.644200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642690+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:01:15.642690+0000","last_peered":"2024-04-25T22:01:15.642690+0000","last_clean":"2024-04-25T22:01:15.642690+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:01:15.642690+0000","last_undegraded":"2024-04-25T22:01:15.642690+0000","last_fullsized":"2024-04-25T22:01:15.642690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643904+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:01:15.643904+0000","last_peered":"2024-04-25T22:01:15.643904+0000","last_clean":"2024-04-25T22:01:15.643904+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:01:15.643904+0000","last_undegraded":"2024-04-25T22:01:15.643904+0000","last_fullsized":"2024-04-25T22:01:15.643904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643553+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:01:15.643553+0000","last_peered":"2024-04-25T22:01:15.643553+0000","last_clean":"2024-04-25T22:01:15.643553+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:01:15.643553+0000","last_undegraded":"2024-04-25T22:01:15.643553+0000","last_fullsized":"2024-04-25T22:01:15.643553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631460+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:01:16.631460+0000","last_peered":"2024-04-25T22:01:16.631460+0000","last_clean":"2024-04-25T22:01:16.631460+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:01:16.631460+0000","last_undegraded":"2024-04-25T22:01:16.631460+0000","last_fullsized":"2024-04-25T22:01:16.631460+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630582+0000","last_change":"2024-04-25T22:01:13.627274+0000","last_active":"2024-04-25T22:01:16.630582+0000","last_peered":"2024-04-25T22:01:16.630582+0000","last_clean":"2024-04-25T22:01:16.630582+0000","last_became_active":"2024-04-25T22:01:13.626015+0000","last_became_peered":"2024-04-25T22:01:13.626015+0000","last_unstale":"2024-04-25T22:01:16.630582+0000","last_undegraded":"2024-04-25T22:01:16.630582+0000","last_fullsized":"2024-04-25T22:01:16.630582+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643225+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:01:15.643225+0000","last_peered":"2024-04-25T22:01:15.643225+0000","last_clean":"2024-04-25T22:01:15.643225+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:01:15.643225+0000","last_undegraded":"2024-04-25T22:01:15.643225+0000","last_fullsized":"2024-04-25T22:01:15.643225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631136+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:01:16.631136+0000","last_peered":"2024-04-25T22:01:16.631136+0000","last_clean":"2024-04-25T22:01:16.631136+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:01:16.631136+0000","last_undegraded":"2024-04-25T22:01:16.631136+0000","last_fullsized":"2024-04-25T22:01:16.631136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643456+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:01:15.643456+0000","last_peered":"2024-04-25T22:01:15.643456+0000","last_clean":"2024-04-25T22:01:15.643456+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:01:15.643456+0000","last_undegraded":"2024-04-25T22:01:15.643456+0000","last_fullsized":"2024-04-25T22:01:15.643456+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643426+0000","last_change":"2024-04-25T22:01:14.637520+0000","last_active":"2024-04-25T22:01:15.643426+0000","last_peered":"2024-04-25T22:01:15.643426+0000","last_clean":"2024-04-25T22:01:15.643426+0000","last_became_active":"2024-04-25T22:01:14.636765+0000","last_became_peered":"2024-04-25T22:01:14.636765+0000","last_unstale":"2024-04-25T22:01:15.643426+0000","last_undegraded":"2024-04-25T22:01:15.643426+0000","last_fullsized":"2024-04-25T22:01:15.643426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643206+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:01:15.643206+0000","last_peered":"2024-04-25T22:01:15.643206+0000","last_clean":"2024-04-25T22:01:15.643206+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:01:15.643206+0000","last_undegraded":"2024-04-25T22:01:15.643206+0000","last_fullsized":"2024-04-25T22:01:15.643206+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.645129+0000","last_change":"2024-04-25T22:01:09.582204+0000","last_active":"2024-04-25T22:01:15.645129+0000","last_peered":"2024-04-25T22:01:15.645129+0000","last_clean":"2024-04-25T22:01:15.645129+0000","last_became_active":"2024-04-25T22:01:09.581494+0000","last_became_peered":"2024-04-25T22:01:09.581494+0000","last_unstale":"2024-04-25T22:01:15.645129+0000","last_undegraded":"2024-04-25T22:01:15.645129+0000","last_fullsized":"2024-04-25T22:01:15.645129+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:13.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642878+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:01:15.642878+0000","last_peered":"2024-04-25T22:01:15.642878+0000","last_clean":"2024-04-25T22:01:15.642878+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:01:15.642878+0000","last_undegraded":"2024-04-25T22:01:15.642878+0000","last_fullsized":"2024-04-25T22:01:15.642878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644141+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:01:15.644141+0000","last_peered":"2024-04-25T22:01:15.644141+0000","last_clean":"2024-04-25T22:01:15.644141+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:01:15.644141+0000","last_undegraded":"2024-04-25T22:01:15.644141+0000","last_fullsized":"2024-04-25T22:01:15.644141+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644123+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:01:15.644123+0000","last_peered":"2024-04-25T22:01:15.644123+0000","last_clean":"2024-04-25T22:01:15.644123+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:01:15.644123+0000","last_undegraded":"2024-04-25T22:01:15.644123+0000","last_fullsized":"2024-04-25T22:01:15.644123+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641739+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:01:15.641739+0000","last_peered":"2024-04-25T22:01:15.641739+0000","last_clean":"2024-04-25T22:01:15.641739+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:01:15.641739+0000","last_undegraded":"2024-04-25T22:01:15.641739+0000","last_fullsized":"2024-04-25T22:01:15.641739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644055+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:01:15.644055+0000","last_peered":"2024-04-25T22:01:15.644055+0000","last_clean":"2024-04-25T22:01:15.644055+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:01:15.644055+0000","last_undegraded":"2024-04-25T22:01:15.644055+0000","last_fullsized":"2024-04-25T22:01:15.644055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630203+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:01:16.630203+0000","last_peered":"2024-04-25T22:01:16.630203+0000","last_clean":"2024-04-25T22:01:16.630203+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:01:16.630203+0000","last_undegraded":"2024-04-25T22:01:16.630203+0000","last_fullsized":"2024-04-25T22:01:16.630203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642445+0000","last_change":"2024-04-25T22:01:14.632306+0000","last_active":"2024-04-25T22:01:15.642445+0000","last_peered":"2024-04-25T22:01:15.642445+0000","last_clean":"2024-04-25T22:01:15.642445+0000","last_became_active":"2024-04-25T22:01:14.631179+0000","last_became_peered":"2024-04-25T22:01:14.631179+0000","last_unstale":"2024-04-25T22:01:15.642445+0000","last_undegraded":"2024-04-25T22:01:15.642445+0000","last_fullsized":"2024-04-25T22:01:15.642445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630101+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:01:16.630101+0000","last_peered":"2024-04-25T22:01:16.630101+0000","last_clean":"2024-04-25T22:01:16.630101+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:01:16.630101+0000","last_undegraded":"2024-04-25T22:01:16.630101+0000","last_fullsized":"2024-04-25T22:01:16.630101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631516+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:01:16.631516+0000","last_peered":"2024-04-25T22:01:16.631516+0000","last_clean":"2024-04-25T22:01:16.631516+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:01:16.631516+0000","last_undegraded":"2024-04-25T22:01:16.631516+0000","last_fullsized":"2024-04-25T22:01:16.631516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641760+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:01:15.641760+0000","last_peered":"2024-04-25T22:01:15.641760+0000","last_clean":"2024-04-25T22:01:15.641760+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:01:15.641760+0000","last_undegraded":"2024-04-25T22:01:15.641760+0000","last_fullsized":"2024-04-25T22:01:15.641760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644879+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:01:15.644879+0000","last_peered":"2024-04-25T22:01:15.644879+0000","last_clean":"2024-04-25T22:01:15.644879+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:01:15.644879+0000","last_undegraded":"2024-04-25T22:01:15.644879+0000","last_fullsized":"2024-04-25T22:01:15.644879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629767+0000","last_change":"2024-04-25T22:01:13.626710+0000","last_active":"2024-04-25T22:01:16.629767+0000","last_peered":"2024-04-25T22:01:16.629767+0000","last_clean":"2024-04-25T22:01:16.629767+0000","last_became_active":"2024-04-25T22:01:13.625898+0000","last_became_peered":"2024-04-25T22:01:13.625898+0000","last_unstale":"2024-04-25T22:01:16.629767+0000","last_undegraded":"2024-04-25T22:01:16.629767+0000","last_fullsized":"2024-04-25T22:01:16.629767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641621+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:01:15.641621+0000","last_peered":"2024-04-25T22:01:15.641621+0000","last_clean":"2024-04-25T22:01:15.641621+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:01:15.641621+0000","last_undegraded":"2024-04-25T22:01:15.641621+0000","last_fullsized":"2024-04-25T22:01:15.641621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643856+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:01:15.643856+0000","last_peered":"2024-04-25T22:01:15.643856+0000","last_clean":"2024-04-25T22:01:15.643856+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:01:15.643856+0000","last_undegraded":"2024-04-25T22:01:15.643856+0000","last_fullsized":"2024-04-25T22:01:15.643856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641332+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:01:15.641332+0000","last_peered":"2024-04-25T22:01:15.641332+0000","last_clean":"2024-04-25T22:01:15.641332+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:01:15.641332+0000","last_undegraded":"2024-04-25T22:01:15.641332+0000","last_fullsized":"2024-04-25T22:01:15.641332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644225+0000","last_change":"2024-04-25T22:01:14.639447+0000","last_active":"2024-04-25T22:01:15.644225+0000","last_peered":"2024-04-25T22:01:15.644225+0000","last_clean":"2024-04-25T22:01:15.644225+0000","last_became_active":"2024-04-25T22:01:14.638864+0000","last_became_peered":"2024-04-25T22:01:14.638864+0000","last_unstale":"2024-04-25T22:01:15.644225+0000","last_undegraded":"2024-04-25T22:01:15.644225+0000","last_fullsized":"2024-04-25T22:01:15.644225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642023+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:01:15.642023+0000","last_peered":"2024-04-25T22:01:15.642023+0000","last_clean":"2024-04-25T22:01:15.642023+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:01:15.642023+0000","last_undegraded":"2024-04-25T22:01:15.642023+0000","last_fullsized":"2024-04-25T22:01:15.642023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643570+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:01:15.643570+0000","last_peered":"2024-04-25T22:01:15.643570+0000","last_clean":"2024-04-25T22:01:15.643570+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:01:15.643570+0000","last_undegraded":"2024-04-25T22:01:15.643570+0000","last_fullsized":"2024-04-25T22:01:15.643570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641814+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:01:15.641814+0000","last_peered":"2024-04-25T22:01:15.641814+0000","last_clean":"2024-04-25T22:01:15.641814+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:01:15.641814+0000","last_undegraded":"2024-04-25T22:01:15.641814+0000","last_fullsized":"2024-04-25T22:01:15.641814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644642+0000","last_change":"2024-04-25T22:01:14.637452+0000","last_active":"2024-04-25T22:01:15.644642+0000","last_peered":"2024-04-25T22:01:15.644642+0000","last_clean":"2024-04-25T22:01:15.644642+0000","last_became_active":"2024-04-25T22:01:14.636407+0000","last_became_peered":"2024-04-25T22:01:14.636407+0000","last_unstale":"2024-04-25T22:01:15.644642+0000","last_undegraded":"2024-04-25T22:01:15.644642+0000","last_fullsized":"2024-04-25T22:01:15.644642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643041+0000","last_change":"2024-04-25T22:01:13.621997+0000","last_active":"2024-04-25T22:01:15.643041+0000","last_peered":"2024-04-25T22:01:15.643041+0000","last_clean":"2024-04-25T22:01:15.643041+0000","last_became_active":"2024-04-25T22:01:13.620987+0000","last_became_peered":"2024-04-25T22:01:13.620987+0000","last_unstale":"2024-04-25T22:01:15.643041+0000","last_undegraded":"2024-04-25T22:01:15.643041+0000","last_fullsized":"2024-04-25T22:01:15.643041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643601+0000","last_change":"2024-04-25T22:01:14.650437+0000","last_active":"2024-04-25T22:01:15.643601+0000","last_peered":"2024-04-25T22:01:15.643601+0000","last_clean":"2024-04-25T22:01:15.643601+0000","last_became_active":"2024-04-25T22:01:14.648116+0000","last_became_peered":"2024-04-25T22:01:14.648116+0000","last_unstale":"2024-04-25T22:01:15.643601+0000","last_undegraded":"2024-04-25T22:01:15.643601+0000","last_fullsized":"2024-04-25T22:01:15.643601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643173+0000","last_change":"2024-04-25T22:01:13.631562+0000","last_active":"2024-04-25T22:01:15.643173+0000","last_peered":"2024-04-25T22:01:15.643173+0000","last_clean":"2024-04-25T22:01:15.643173+0000","last_became_active":"2024-04-25T22:01:13.630731+0000","last_became_peered":"2024-04-25T22:01:13.630731+0000","last_unstale":"2024-04-25T22:01:15.643173+0000","last_undegraded":"2024-04-25T22:01:15.643173+0000","last_fullsized":"2024-04-25T22:01:15.643173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629517+0000","last_change":"2024-04-25T22:01:14.654909+0000","last_active":"2024-04-25T22:01:16.629517+0000","last_peered":"2024-04-25T22:01:16.629517+0000","last_clean":"2024-04-25T22:01:16.629517+0000","last_became_active":"2024-04-25T22:01:14.653503+0000","last_became_peered":"2024-04-25T22:01:14.653503+0000","last_unstale":"2024-04-25T22:01:16.629517+0000","last_undegraded":"2024-04-25T22:01:16.629517+0000","last_fullsized":"2024-04-25T22:01:16.629517+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631196+0000","last_change":"2024-04-25T22:01:13.628356+0000","last_active":"2024-04-25T22:01:16.631196+0000","last_peered":"2024-04-25T22:01:16.631196+0000","last_clean":"2024-04-25T22:01:16.631196+0000","last_became_active":"2024-04-25T22:01:13.626608+0000","last_became_peered":"2024-04-25T22:01:13.626608+0000","last_unstale":"2024-04-25T22:01:16.631196+0000","last_undegraded":"2024-04-25T22:01:16.631196+0000","last_fullsized":"2024-04-25T22:01:16.631196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631268+0000","last_change":"2024-04-25T22:01:14.648752+0000","last_active":"2024-04-25T22:01:16.631268+0000","last_peered":"2024-04-25T22:01:16.631268+0000","last_clean":"2024-04-25T22:01:16.631268+0000","last_became_active":"2024-04-25T22:01:14.647463+0000","last_became_peered":"2024-04-25T22:01:14.647463+0000","last_unstale":"2024-04-25T22:01:16.631268+0000","last_undegraded":"2024-04-25T22:01:16.631268+0000","last_fullsized":"2024-04-25T22:01:16.631268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:22.946881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644469+0000","last_change":"2024-04-25T22:01:13.630502+0000","last_active":"2024-04-25T22:01:15.644469+0000","last_peered":"2024-04-25T22:01:15.644469+0000","last_clean":"2024-04-25T22:01:15.644469+0000","last_became_active":"2024-04-25T22:01:13.629854+0000","last_became_peered":"2024-04-25T22:01:13.629854+0000","last_unstale":"2024-04-25T22:01:15.644469+0000","last_undegraded":"2024-04-25T22:01:15.644469+0000","last_fullsized":"2024-04-25T22:01:15.644469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643115+0000","last_change":"2024-04-25T22:01:14.642104+0000","last_active":"2024-04-25T22:01:15.643115+0000","last_peered":"2024-04-25T22:01:15.643115+0000","last_clean":"2024-04-25T22:01:15.643115+0000","last_became_active":"2024-04-25T22:01:14.641323+0000","last_became_peered":"2024-04-25T22:01:14.641323+0000","last_unstale":"2024-04-25T22:01:15.643115+0000","last_undegraded":"2024-04-25T22:01:15.643115+0000","last_fullsized":"2024-04-25T22:01:15.643115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643826+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:01:15.643826+0000","last_peered":"2024-04-25T22:01:15.643826+0000","last_clean":"2024-04-25T22:01:15.643826+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:01:15.643826+0000","last_undegraded":"2024-04-25T22:01:15.643826+0000","last_fullsized":"2024-04-25T22:01:15.643826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629024+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:01:16.629024+0000","last_peered":"2024-04-25T22:01:16.629024+0000","last_clean":"2024-04-25T22:01:16.629024+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:01:16.629024+0000","last_undegraded":"2024-04-25T22:01:16.629024+0000","last_fullsized":"2024-04-25T22:01:16.629024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643575+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:01:15.643575+0000","last_peered":"2024-04-25T22:01:15.643575+0000","last_clean":"2024-04-25T22:01:15.643575+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:01:15.643575+0000","last_undegraded":"2024-04-25T22:01:15.643575+0000","last_fullsized":"2024-04-25T22:01:15.643575+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":237568,"data_stored":647274,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":55728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":245760,"data_stored":647890,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:01:27.487 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T22:01:27.487 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T22:01:27.487 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T22:01:27.488 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T22:01:27.851 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:27.852 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T22:01:27.869 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T22:01:27.869 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:01:28.155 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:28.155 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":18,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:01:15.618998+0000","last_up_change":"2024-04-25T22:01:03.432353+0000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:01:03.632568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:01:07.995071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:01:12.514055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:01:12.963831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6801","nonce":2385981072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6803","nonce":2385981072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6807","nonce":2385981072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6805","nonce":2385981072}]},"public_addr":"172.21.15.57:6801/2385981072","cluster_addr":"172.21.15.57:6803/2385981072","heartbeat_back_addr":"172.21.15.57:6807/2385981072","heartbeat_front_addr":"172.21.15.57:6805/2385981072","state":["exists","up"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6801","nonce":29975895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6803","nonce":29975895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6807","nonce":29975895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6805","nonce":29975895}]},"public_addr":"172.21.15.79:6801/29975895","cluster_addr":"172.21.15.79:6803/29975895","heartbeat_back_addr":"172.21.15.79:6807/29975895","heartbeat_front_addr":"172.21.15.79:6805/29975895","state":["exists","up"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6801","nonce":3918111900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6803","nonce":3918111900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6807","nonce":3918111900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6805","nonce":3918111900}]},"public_addr":"172.21.15.81:6801/3918111900","cluster_addr":"172.21.15.81:6803/3918111900","heartbeat_back_addr":"172.21.15.81:6807/3918111900","heartbeat_front_addr":"172.21.15.81:6805/3918111900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:59.025944+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.986080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.971238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:01:28.172 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:01:03.632568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:01:07.995071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:01:12.514055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:01:12.963831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T22:01:28.173 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:01:28.465 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-04-25T22:01:28.483 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:01:28.782 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 8 2024-04-25T22:01:28.799 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T22:01:29.091 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-04-25T22:01:29.109 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T22:01:29.407 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-04-25T22:01:29.427 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:01:29.751 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:29.751 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:01:13.963044+0000","modified":"2024-04-25T22:01:15.981330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4205},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4205":{"gid":4205,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6803/3701507543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3701507543},{"type":"v1","addr":"172.21.15.44:6803","nonce":3701507543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4205,"qdb_cluster":[4205]},"id":1}]} 2024-04-25T22:01:29.751 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 5 2024-04-25T22:01:29.768 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:01:30.067 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:30.067 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":18,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:01:15.618998+0000","last_up_change":"2024-04-25T22:01:03.432353+0000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:01:03.632568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:01:07.995071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:01:12.514055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:01:12.963831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6801","nonce":2385981072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6803","nonce":2385981072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6807","nonce":2385981072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6805","nonce":2385981072}]},"public_addr":"172.21.15.57:6801/2385981072","cluster_addr":"172.21.15.57:6803/2385981072","heartbeat_back_addr":"172.21.15.57:6807/2385981072","heartbeat_front_addr":"172.21.15.57:6805/2385981072","state":["exists","up"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6801","nonce":29975895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6803","nonce":29975895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6807","nonce":29975895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6805","nonce":29975895}]},"public_addr":"172.21.15.79:6801/29975895","cluster_addr":"172.21.15.79:6803/29975895","heartbeat_back_addr":"172.21.15.79:6807/29975895","heartbeat_front_addr":"172.21.15.79:6805/29975895","state":["exists","up"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6801","nonce":3918111900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6803","nonce":3918111900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6807","nonce":3918111900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6805","nonce":3918111900}]},"public_addr":"172.21.15.81:6801/3918111900","cluster_addr":"172.21.15.81:6803/3918111900","heartbeat_back_addr":"172.21.15.81:6807/3918111900","heartbeat_front_addr":"172.21.15.81:6805/3918111900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:59.025944+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.986080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.971238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:01:30.087 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:01:03.632568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:01:07.995071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:01:12.514055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:01:12.963831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T22:01:30.087 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:01:30.381 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-04-25T22:01:30.399 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:01:30.691 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 8 2024-04-25T22:01:30.711 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T22:01:30.999 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-04-25T22:01:31.018 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T22:01:31.322 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-04-25T22:01:31.341 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:01:31.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:31.674 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:01:13.963044+0000","modified":"2024-04-25T22:01:15.981330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4205},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4205":{"gid":4205,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6803/3701507543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3701507543},{"type":"v1","addr":"172.21.15.44:6803","nonce":3701507543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4205,"qdb_cluster":[4205]},"id":1}]} 2024-04-25T22:01:31.675 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 5 2024-04-25T22:01:31.693 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:01:31.981 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:31.981 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":18,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:01:15.618998+0000","last_up_change":"2024-04-25T22:01:03.432353+0000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:01:03.632568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:01:07.995071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:01:12.514055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:01:12.963831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6801","nonce":2385981072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6803","nonce":2385981072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6807","nonce":2385981072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6805","nonce":2385981072}]},"public_addr":"172.21.15.57:6801/2385981072","cluster_addr":"172.21.15.57:6803/2385981072","heartbeat_back_addr":"172.21.15.57:6807/2385981072","heartbeat_front_addr":"172.21.15.57:6805/2385981072","state":["exists","up"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6801","nonce":29975895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6803","nonce":29975895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6807","nonce":29975895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6805","nonce":29975895}]},"public_addr":"172.21.15.79:6801/29975895","cluster_addr":"172.21.15.79:6803/29975895","heartbeat_back_addr":"172.21.15.79:6807/29975895","heartbeat_front_addr":"172.21.15.79:6805/29975895","state":["exists","up"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6801","nonce":3918111900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6803","nonce":3918111900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6807","nonce":3918111900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6805","nonce":3918111900}]},"public_addr":"172.21.15.81:6801/3918111900","cluster_addr":"172.21.15.81:6803/3918111900","heartbeat_back_addr":"172.21.15.81:6807/3918111900","heartbeat_front_addr":"172.21.15.81:6805/3918111900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:59.025944+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.986080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.971238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:01:31.998 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:01:32.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:32.312 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:01:13.963044+0000","modified":"2024-04-25T22:01:15.981330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4205},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4205":{"gid":4205,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6803/3701507543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3701507543},{"type":"v1","addr":"172.21.15.44:6803","nonce":3701507543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4205,"qdb_cluster":[4205]},"id":1}]} 2024-04-25T22:01:32.312 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 5 2024-04-25T22:01:32.429 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T22:01:13.963044+0000', 'modified': '2024-04-25T22:01:15.981330+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4205}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4205': {'gid': 4205, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6803/3701507543', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6802', 'nonce': 3701507543}, {'type': 'v1', 'addr': '172.21.15.44:6803', 'nonce': 3701507543}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4205, 'qdb_cluster': [4205]} 2024-04-25T22:01:32.429 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T22:01:32.430 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T22:01:32.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-25T22:01:32.568+0000 7f5caf7fe640 0 client.4674 ms_handle_reset on v2:172.21.15.44:6802/3701507543 2024-04-25T22:01:32.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-25T22:01:32.588+0000 7f5caf7fe640 0 client.4516 ms_handle_reset on v2:172.21.15.44:6802/3701507543 2024-04-25T22:01:32.593 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-25T22:01:32.593 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "1ced109c-704f-44b1-9811-a2da74898889", 2024-04-25T22:01:32.593 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-04-25T22:01:32.593 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4205, 2024-04-25T22:01:32.593 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-04-25T22:01:32.593 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-04-25T22:01:32.593 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-04-25T22:01:32.593 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 17.972605077000001, 2024-04-25T22:01:32.593 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 5, 2024-04-25T22:01:32.594 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 18, 2024-04-25T22:01:32.594 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 18, 2024-04-25T22:01:32.594 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 22.920910959 2024-04-25T22:01:32.594 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-25T22:01:32.608 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-25T22:01:32.623 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-25T22:01:32.623 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a'}} 2024-04-25T22:01:32.623 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-25T22:01:32.623 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-25T22:01:32.623 DEBUG:teuthology.orchestra.run.smithi044:> sync 2024-04-25T22:01:32.827 DEBUG:teuthology.orchestra.run.smithi057:> sync 2024-04-25T22:01:32.907 DEBUG:teuthology.orchestra.run.smithi079:> sync 2024-04-25T22:01:33.032 DEBUG:teuthology.orchestra.run.smithi081:> sync 2024-04-25T22:01:33.128 DEBUG:tasks.thrashosds:checking console status of smithi044 2024-04-25T22:01:33.129 DEBUG:teuthology.orchestra.console.smithi044:Waiting for login prompt 2024-04-25T22:01:33.129 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi044 2024-04-25T22:01:33.238 DEBUG:teuthology.orchestra.console.smithi044:expect before: [Enter `^Ec?' for help] 2024-04-25T22:01:33.238 DEBUG:teuthology.orchestra.console.smithi044:expect after: smithi044 login: 2024-04-25T22:01:33.290 DEBUG:teuthology.orchestra.console.smithi044:console disconnect output: [Enter `^Ec?' for help] smithi044 login: [disconnect] 2024-04-25T22:01:33.391 DEBUG:tasks.thrashosds:checking console status of smithi057 2024-04-25T22:01:33.392 DEBUG:teuthology.orchestra.console.smithi057:Waiting for login prompt 2024-04-25T22:01:33.392 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi057 2024-04-25T22:01:33.470 DEBUG:teuthology.orchestra.console.smithi057:expect before: [Enter `^Ec?' for help] 2024-04-25T22:01:33.470 DEBUG:teuthology.orchestra.console.smithi057:expect after: smithi057 login: 2024-04-25T22:01:33.522 DEBUG:teuthology.orchestra.console.smithi057:console disconnect output: [Enter `^Ec?' for help] smithi057 login: [disconnect] 2024-04-25T22:01:33.623 DEBUG:tasks.thrashosds:checking console status of smithi079 2024-04-25T22:01:33.624 DEBUG:teuthology.orchestra.console.smithi079:Waiting for login prompt 2024-04-25T22:01:33.624 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi079 2024-04-25T22:01:33.735 DEBUG:teuthology.orchestra.console.smithi079:expect before: [Enter `^Ec?' for help] 2024-04-25T22:01:33.735 DEBUG:teuthology.orchestra.console.smithi079:expect after: smithi079 login: 2024-04-25T22:01:33.787 DEBUG:teuthology.orchestra.console.smithi079:console disconnect output: [Enter `^Ec?' for help] smithi079 login: [disconnect] 2024-04-25T22:01:33.888 DEBUG:tasks.thrashosds:checking console status of smithi081 2024-04-25T22:01:33.888 DEBUG:teuthology.orchestra.console.smithi081:Waiting for login prompt 2024-04-25T22:01:33.889 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi081 2024-04-25T22:01:34.029 DEBUG:teuthology.orchestra.console.smithi081:expect before: [Enter `^Ec?' for help] 2024-04-25T22:01:34.030 DEBUG:teuthology.orchestra.console.smithi081:expect after: smithi081 login: 2024-04-25T22:01:34.082 DEBUG:teuthology.orchestra.console.smithi081:console disconnect output: [Enter `^Ec?' for help] smithi081 login: [disconnect] 2024-04-25T22:01:34.184 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-25T22:01:34.514 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-25T22:01:34.515 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T22:01:34.515 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:01:34.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:34.814 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:01:34.830 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-04-25T22:01:33.567505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90028,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025492,"statfs":{"total":289910292480,"available":289818103808,"internally_reserved":0,"allocated":647168,"data_stored":1350892,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003582"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643883+0000","last_change":"2024-04-25T22:01:14.641678+0000","last_active":"2024-04-25T22:01:15.643883+0000","last_peered":"2024-04-25T22:01:15.643883+0000","last_clean":"2024-04-25T22:01:15.643883+0000","last_became_active":"2024-04-25T22:01:14.640808+0000","last_became_peered":"2024-04-25T22:01:14.640808+0000","last_unstale":"2024-04-25T22:01:15.643883+0000","last_undegraded":"2024-04-25T22:01:15.643883+0000","last_fullsized":"2024-04-25T22:01:15.643883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643649+0000","last_change":"2024-04-25T22:01:14.648935+0000","last_active":"2024-04-25T22:01:15.643649+0000","last_peered":"2024-04-25T22:01:15.643649+0000","last_clean":"2024-04-25T22:01:15.643649+0000","last_became_active":"2024-04-25T22:01:14.647871+0000","last_became_peered":"2024-04-25T22:01:14.647871+0000","last_unstale":"2024-04-25T22:01:15.643649+0000","last_undegraded":"2024-04-25T22:01:15.643649+0000","last_fullsized":"2024-04-25T22:01:15.643649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629685+0000","last_change":"2024-04-25T22:01:14.647262+0000","last_active":"2024-04-25T22:01:16.629685+0000","last_peered":"2024-04-25T22:01:16.629685+0000","last_clean":"2024-04-25T22:01:16.629685+0000","last_became_active":"2024-04-25T22:01:14.645878+0000","last_became_peered":"2024-04-25T22:01:14.645878+0000","last_unstale":"2024-04-25T22:01:16.629685+0000","last_undegraded":"2024-04-25T22:01:16.629685+0000","last_fullsized":"2024-04-25T22:01:16.629685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630225+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:01:16.630225+0000","last_peered":"2024-04-25T22:01:16.630225+0000","last_clean":"2024-04-25T22:01:16.630225+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:01:16.630225+0000","last_undegraded":"2024-04-25T22:01:16.630225+0000","last_fullsized":"2024-04-25T22:01:16.630225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643155+0000","last_change":"2024-04-25T22:01:14.642505+0000","last_active":"2024-04-25T22:01:15.643155+0000","last_peered":"2024-04-25T22:01:15.643155+0000","last_clean":"2024-04-25T22:01:15.643155+0000","last_became_active":"2024-04-25T22:01:14.641574+0000","last_became_peered":"2024-04-25T22:01:14.641574+0000","last_unstale":"2024-04-25T22:01:15.643155+0000","last_undegraded":"2024-04-25T22:01:15.643155+0000","last_fullsized":"2024-04-25T22:01:15.643155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630343+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:01:16.630343+0000","last_peered":"2024-04-25T22:01:16.630343+0000","last_clean":"2024-04-25T22:01:16.630343+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:01:16.630343+0000","last_undegraded":"2024-04-25T22:01:16.630343+0000","last_fullsized":"2024-04-25T22:01:16.630343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628889+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:01:16.628889+0000","last_peered":"2024-04-25T22:01:16.628889+0000","last_clean":"2024-04-25T22:01:16.628889+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:01:16.628889+0000","last_undegraded":"2024-04-25T22:01:16.628889+0000","last_fullsized":"2024-04-25T22:01:16.628889+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628140+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:01:16.628140+0000","last_peered":"2024-04-25T22:01:16.628140+0000","last_clean":"2024-04-25T22:01:16.628140+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:01:16.628140+0000","last_undegraded":"2024-04-25T22:01:16.628140+0000","last_fullsized":"2024-04-25T22:01:16.628140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642568+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:01:15.642568+0000","last_peered":"2024-04-25T22:01:15.642568+0000","last_clean":"2024-04-25T22:01:15.642568+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:01:15.642568+0000","last_undegraded":"2024-04-25T22:01:15.642568+0000","last_fullsized":"2024-04-25T22:01:15.642568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643687+0000","last_change":"2024-04-25T22:01:14.647968+0000","last_active":"2024-04-25T22:01:15.643687+0000","last_peered":"2024-04-25T22:01:15.643687+0000","last_clean":"2024-04-25T22:01:15.643687+0000","last_became_active":"2024-04-25T22:01:14.646872+0000","last_became_peered":"2024-04-25T22:01:14.646872+0000","last_unstale":"2024-04-25T22:01:15.643687+0000","last_undegraded":"2024-04-25T22:01:15.643687+0000","last_fullsized":"2024-04-25T22:01:15.643687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629818+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:01:16.629818+0000","last_peered":"2024-04-25T22:01:16.629818+0000","last_clean":"2024-04-25T22:01:16.629818+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:01:16.629818+0000","last_undegraded":"2024-04-25T22:01:16.629818+0000","last_fullsized":"2024-04-25T22:01:16.629818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643509+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:01:15.643509+0000","last_peered":"2024-04-25T22:01:15.643509+0000","last_clean":"2024-04-25T22:01:15.643509+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:01:15.643509+0000","last_undegraded":"2024-04-25T22:01:15.643509+0000","last_fullsized":"2024-04-25T22:01:15.643509+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642423+0000","last_change":"2024-04-25T22:01:14.643909+0000","last_active":"2024-04-25T22:01:15.642423+0000","last_peered":"2024-04-25T22:01:15.642423+0000","last_clean":"2024-04-25T22:01:15.642423+0000","last_became_active":"2024-04-25T22:01:14.642421+0000","last_became_peered":"2024-04-25T22:01:14.642421+0000","last_unstale":"2024-04-25T22:01:15.642423+0000","last_undegraded":"2024-04-25T22:01:15.642423+0000","last_fullsized":"2024-04-25T22:01:15.642423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630801+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:01:16.630801+0000","last_peered":"2024-04-25T22:01:16.630801+0000","last_clean":"2024-04-25T22:01:16.630801+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:01:16.630801+0000","last_undegraded":"2024-04-25T22:01:16.630801+0000","last_fullsized":"2024-04-25T22:01:16.630801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628926+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:01:16.628926+0000","last_peered":"2024-04-25T22:01:16.628926+0000","last_clean":"2024-04-25T22:01:16.628926+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:01:16.628926+0000","last_undegraded":"2024-04-25T22:01:16.628926+0000","last_fullsized":"2024-04-25T22:01:16.628926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628179+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:01:16.628179+0000","last_peered":"2024-04-25T22:01:16.628179+0000","last_clean":"2024-04-25T22:01:16.628179+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:01:16.628179+0000","last_undegraded":"2024-04-25T22:01:16.628179+0000","last_fullsized":"2024-04-25T22:01:16.628179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644180+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:01:15.644180+0000","last_peered":"2024-04-25T22:01:15.644180+0000","last_clean":"2024-04-25T22:01:15.644180+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:01:15.644180+0000","last_undegraded":"2024-04-25T22:01:15.644180+0000","last_fullsized":"2024-04-25T22:01:15.644180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644577+0000","last_change":"2024-04-25T22:01:14.647317+0000","last_active":"2024-04-25T22:01:15.644577+0000","last_peered":"2024-04-25T22:01:15.644577+0000","last_clean":"2024-04-25T22:01:15.644577+0000","last_became_active":"2024-04-25T22:01:14.644027+0000","last_became_peered":"2024-04-25T22:01:14.644027+0000","last_unstale":"2024-04-25T22:01:15.644577+0000","last_undegraded":"2024-04-25T22:01:15.644577+0000","last_fullsized":"2024-04-25T22:01:15.644577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642752+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:01:15.642752+0000","last_peered":"2024-04-25T22:01:15.642752+0000","last_clean":"2024-04-25T22:01:15.642752+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:01:15.642752+0000","last_undegraded":"2024-04-25T22:01:15.642752+0000","last_fullsized":"2024-04-25T22:01:15.642752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630673+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:01:16.630673+0000","last_peered":"2024-04-25T22:01:16.630673+0000","last_clean":"2024-04-25T22:01:16.630673+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:01:16.630673+0000","last_undegraded":"2024-04-25T22:01:16.630673+0000","last_fullsized":"2024-04-25T22:01:16.630673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630420+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:01:16.630420+0000","last_peered":"2024-04-25T22:01:16.630420+0000","last_clean":"2024-04-25T22:01:16.630420+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:01:16.630420+0000","last_undegraded":"2024-04-25T22:01:16.630420+0000","last_fullsized":"2024-04-25T22:01:16.630420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642311+0000","last_change":"2024-04-25T22:01:14.633477+0000","last_active":"2024-04-25T22:01:15.642311+0000","last_peered":"2024-04-25T22:01:15.642311+0000","last_clean":"2024-04-25T22:01:15.642311+0000","last_became_active":"2024-04-25T22:01:14.632678+0000","last_became_peered":"2024-04-25T22:01:14.632678+0000","last_unstale":"2024-04-25T22:01:15.642311+0000","last_undegraded":"2024-04-25T22:01:15.642311+0000","last_fullsized":"2024-04-25T22:01:15.642311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641145+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:01:15.641145+0000","last_peered":"2024-04-25T22:01:15.641145+0000","last_clean":"2024-04-25T22:01:15.641145+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:01:15.641145+0000","last_undegraded":"2024-04-25T22:01:15.641145+0000","last_fullsized":"2024-04-25T22:01:15.641145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641815+0000","last_change":"2024-04-25T22:01:14.641991+0000","last_active":"2024-04-25T22:01:15.641815+0000","last_peered":"2024-04-25T22:01:15.641815+0000","last_clean":"2024-04-25T22:01:15.641815+0000","last_became_active":"2024-04-25T22:01:14.641244+0000","last_became_peered":"2024-04-25T22:01:14.641244+0000","last_unstale":"2024-04-25T22:01:15.641815+0000","last_undegraded":"2024-04-25T22:01:15.641815+0000","last_fullsized":"2024-04-25T22:01:15.641815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:03.098700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644044+0000","last_change":"2024-04-25T22:01:14.638103+0000","last_active":"2024-04-25T22:01:15.644044+0000","last_peered":"2024-04-25T22:01:15.644044+0000","last_clean":"2024-04-25T22:01:15.644044+0000","last_became_active":"2024-04-25T22:01:14.636488+0000","last_became_peered":"2024-04-25T22:01:14.636488+0000","last_unstale":"2024-04-25T22:01:15.644044+0000","last_undegraded":"2024-04-25T22:01:15.644044+0000","last_fullsized":"2024-04-25T22:01:15.644044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643468+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:01:15.643468+0000","last_peered":"2024-04-25T22:01:15.643468+0000","last_clean":"2024-04-25T22:01:15.643468+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:01:15.643468+0000","last_undegraded":"2024-04-25T22:01:15.643468+0000","last_fullsized":"2024-04-25T22:01:15.643468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630101+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:01:16.630101+0000","last_peered":"2024-04-25T22:01:16.630101+0000","last_clean":"2024-04-25T22:01:16.630101+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:01:16.630101+0000","last_undegraded":"2024-04-25T22:01:16.630101+0000","last_fullsized":"2024-04-25T22:01:16.630101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644402+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:01:15.644402+0000","last_peered":"2024-04-25T22:01:15.644402+0000","last_clean":"2024-04-25T22:01:15.644402+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:01:15.644402+0000","last_undegraded":"2024-04-25T22:01:15.644402+0000","last_fullsized":"2024-04-25T22:01:15.644402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642402+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:01:15.642402+0000","last_peered":"2024-04-25T22:01:15.642402+0000","last_clean":"2024-04-25T22:01:15.642402+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:01:15.642402+0000","last_undegraded":"2024-04-25T22:01:15.642402+0000","last_fullsized":"2024-04-25T22:01:15.642402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642766+0000","last_change":"2024-04-25T22:01:14.638343+0000","last_active":"2024-04-25T22:01:15.642766+0000","last_peered":"2024-04-25T22:01:15.642766+0000","last_clean":"2024-04-25T22:01:15.642766+0000","last_became_active":"2024-04-25T22:01:14.637694+0000","last_became_peered":"2024-04-25T22:01:14.637694+0000","last_unstale":"2024-04-25T22:01:15.642766+0000","last_undegraded":"2024-04-25T22:01:15.642766+0000","last_fullsized":"2024-04-25T22:01:15.642766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641265+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:01:15.641265+0000","last_peered":"2024-04-25T22:01:15.641265+0000","last_clean":"2024-04-25T22:01:15.641265+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:01:15.641265+0000","last_undegraded":"2024-04-25T22:01:15.641265+0000","last_fullsized":"2024-04-25T22:01:15.641265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628586+0000","last_change":"2024-04-25T22:01:14.648196+0000","last_active":"2024-04-25T22:01:16.628586+0000","last_peered":"2024-04-25T22:01:16.628586+0000","last_clean":"2024-04-25T22:01:16.628586+0000","last_became_active":"2024-04-25T22:01:14.647509+0000","last_became_peered":"2024-04-25T22:01:14.647509+0000","last_unstale":"2024-04-25T22:01:16.628586+0000","last_undegraded":"2024-04-25T22:01:16.628586+0000","last_fullsized":"2024-04-25T22:01:16.628586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643932+0000","last_change":"2024-04-25T22:01:14.641706+0000","last_active":"2024-04-25T22:01:15.643932+0000","last_peered":"2024-04-25T22:01:15.643932+0000","last_clean":"2024-04-25T22:01:15.643932+0000","last_became_active":"2024-04-25T22:01:14.641043+0000","last_became_peered":"2024-04-25T22:01:14.641043+0000","last_unstale":"2024-04-25T22:01:15.643932+0000","last_undegraded":"2024-04-25T22:01:15.643932+0000","last_fullsized":"2024-04-25T22:01:15.643932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630432+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:01:16.630432+0000","last_peered":"2024-04-25T22:01:16.630432+0000","last_clean":"2024-04-25T22:01:16.630432+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:01:16.630432+0000","last_undegraded":"2024-04-25T22:01:16.630432+0000","last_fullsized":"2024-04-25T22:01:16.630432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644159+0000","last_change":"2024-04-25T22:01:14.635075+0000","last_active":"2024-04-25T22:01:15.644159+0000","last_peered":"2024-04-25T22:01:15.644159+0000","last_clean":"2024-04-25T22:01:15.644159+0000","last_became_active":"2024-04-25T22:01:14.630677+0000","last_became_peered":"2024-04-25T22:01:14.630677+0000","last_unstale":"2024-04-25T22:01:15.644159+0000","last_undegraded":"2024-04-25T22:01:15.644159+0000","last_fullsized":"2024-04-25T22:01:15.644159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641776+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:01:15.641776+0000","last_peered":"2024-04-25T22:01:15.641776+0000","last_clean":"2024-04-25T22:01:15.641776+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:01:15.641776+0000","last_undegraded":"2024-04-25T22:01:15.641776+0000","last_fullsized":"2024-04-25T22:01:15.641776+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644033+0000","last_change":"2024-04-25T22:01:14.648527+0000","last_active":"2024-04-25T22:01:15.644033+0000","last_peered":"2024-04-25T22:01:15.644033+0000","last_clean":"2024-04-25T22:01:15.644033+0000","last_became_active":"2024-04-25T22:01:14.645040+0000","last_became_peered":"2024-04-25T22:01:14.645040+0000","last_unstale":"2024-04-25T22:01:15.644033+0000","last_undegraded":"2024-04-25T22:01:15.644033+0000","last_fullsized":"2024-04-25T22:01:15.644033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642322+0000","last_change":"2024-04-25T22:01:13.630817+0000","last_active":"2024-04-25T22:01:15.642322+0000","last_peered":"2024-04-25T22:01:15.642322+0000","last_clean":"2024-04-25T22:01:15.642322+0000","last_became_active":"2024-04-25T22:01:13.629994+0000","last_became_peered":"2024-04-25T22:01:13.629994+0000","last_unstale":"2024-04-25T22:01:15.642322+0000","last_undegraded":"2024-04-25T22:01:15.642322+0000","last_fullsized":"2024-04-25T22:01:15.642322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643109+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:01:15.643109+0000","last_peered":"2024-04-25T22:01:15.643109+0000","last_clean":"2024-04-25T22:01:15.643109+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:01:15.643109+0000","last_undegraded":"2024-04-25T22:01:15.643109+0000","last_fullsized":"2024-04-25T22:01:15.643109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628481+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:01:16.628481+0000","last_peered":"2024-04-25T22:01:16.628481+0000","last_clean":"2024-04-25T22:01:16.628481+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:01:16.628481+0000","last_undegraded":"2024-04-25T22:01:16.628481+0000","last_fullsized":"2024-04-25T22:01:16.628481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630098+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:01:16.630098+0000","last_peered":"2024-04-25T22:01:16.630098+0000","last_clean":"2024-04-25T22:01:16.630098+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:01:16.630098+0000","last_undegraded":"2024-04-25T22:01:16.630098+0000","last_fullsized":"2024-04-25T22:01:16.630098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641940+0000","last_change":"2024-04-25T22:01:14.633805+0000","last_active":"2024-04-25T22:01:15.641940+0000","last_peered":"2024-04-25T22:01:15.641940+0000","last_clean":"2024-04-25T22:01:15.641940+0000","last_became_active":"2024-04-25T22:01:14.633045+0000","last_became_peered":"2024-04-25T22:01:14.633045+0000","last_unstale":"2024-04-25T22:01:15.641940+0000","last_undegraded":"2024-04-25T22:01:15.641940+0000","last_fullsized":"2024-04-25T22:01:15.641940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:43.718628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644703+0000","last_change":"2024-04-25T22:01:13.631135+0000","last_active":"2024-04-25T22:01:15.644703+0000","last_peered":"2024-04-25T22:01:15.644703+0000","last_clean":"2024-04-25T22:01:15.644703+0000","last_became_active":"2024-04-25T22:01:13.630257+0000","last_became_peered":"2024-04-25T22:01:13.630257+0000","last_unstale":"2024-04-25T22:01:15.644703+0000","last_undegraded":"2024-04-25T22:01:15.644703+0000","last_fullsized":"2024-04-25T22:01:15.644703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641989+0000","last_change":"2024-04-25T22:01:14.630233+0000","last_active":"2024-04-25T22:01:15.641989+0000","last_peered":"2024-04-25T22:01:15.641989+0000","last_clean":"2024-04-25T22:01:15.641989+0000","last_became_active":"2024-04-25T22:01:14.629415+0000","last_became_peered":"2024-04-25T22:01:14.629415+0000","last_unstale":"2024-04-25T22:01:15.641989+0000","last_undegraded":"2024-04-25T22:01:15.641989+0000","last_fullsized":"2024-04-25T22:01:15.641989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:02:28.593163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630847+0000","last_change":"2024-04-25T22:01:13.633106+0000","last_active":"2024-04-25T22:01:16.630847+0000","last_peered":"2024-04-25T22:01:16.630847+0000","last_clean":"2024-04-25T22:01:16.630847+0000","last_became_active":"2024-04-25T22:01:13.631466+0000","last_became_peered":"2024-04-25T22:01:13.631466+0000","last_unstale":"2024-04-25T22:01:16.630847+0000","last_undegraded":"2024-04-25T22:01:16.630847+0000","last_fullsized":"2024-04-25T22:01:16.630847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:23.095422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630867+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:01:16.630867+0000","last_peered":"2024-04-25T22:01:16.630867+0000","last_clean":"2024-04-25T22:01:16.630867+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:01:16.630867+0000","last_undegraded":"2024-04-25T22:01:16.630867+0000","last_fullsized":"2024-04-25T22:01:16.630867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631516+0000","last_change":"2024-04-25T22:01:13.626767+0000","last_active":"2024-04-25T22:01:16.631516+0000","last_peered":"2024-04-25T22:01:16.631516+0000","last_clean":"2024-04-25T22:01:16.631516+0000","last_became_active":"2024-04-25T22:01:13.625984+0000","last_became_peered":"2024-04-25T22:01:13.625984+0000","last_unstale":"2024-04-25T22:01:16.631516+0000","last_undegraded":"2024-04-25T22:01:16.631516+0000","last_fullsized":"2024-04-25T22:01:16.631516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642637+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:01:15.642637+0000","last_peered":"2024-04-25T22:01:15.642637+0000","last_clean":"2024-04-25T22:01:15.642637+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:01:15.642637+0000","last_undegraded":"2024-04-25T22:01:15.642637+0000","last_fullsized":"2024-04-25T22:01:15.642637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643352+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:01:15.643352+0000","last_peered":"2024-04-25T22:01:15.643352+0000","last_clean":"2024-04-25T22:01:15.643352+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:01:15.643352+0000","last_undegraded":"2024-04-25T22:01:15.643352+0000","last_fullsized":"2024-04-25T22:01:15.643352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631293+0000","last_change":"2024-04-25T22:01:14.650077+0000","last_active":"2024-04-25T22:01:16.631293+0000","last_peered":"2024-04-25T22:01:16.631293+0000","last_clean":"2024-04-25T22:01:16.631293+0000","last_became_active":"2024-04-25T22:01:14.649315+0000","last_became_peered":"2024-04-25T22:01:14.649315+0000","last_unstale":"2024-04-25T22:01:16.631293+0000","last_undegraded":"2024-04-25T22:01:16.631293+0000","last_fullsized":"2024-04-25T22:01:16.631293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.976715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631205+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:01:16.631205+0000","last_peered":"2024-04-25T22:01:16.631205+0000","last_clean":"2024-04-25T22:01:16.631205+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:01:16.631205+0000","last_undegraded":"2024-04-25T22:01:16.631205+0000","last_fullsized":"2024-04-25T22:01:16.631205+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630528+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:01:16.630528+0000","last_peered":"2024-04-25T22:01:16.630528+0000","last_clean":"2024-04-25T22:01:16.630528+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:01:16.630528+0000","last_undegraded":"2024-04-25T22:01:16.630528+0000","last_fullsized":"2024-04-25T22:01:16.630528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642713+0000","last_change":"2024-04-25T22:01:13.631439+0000","last_active":"2024-04-25T22:01:15.642713+0000","last_peered":"2024-04-25T22:01:15.642713+0000","last_clean":"2024-04-25T22:01:15.642713+0000","last_became_active":"2024-04-25T22:01:13.630812+0000","last_became_peered":"2024-04-25T22:01:13.630812+0000","last_unstale":"2024-04-25T22:01:15.642713+0000","last_undegraded":"2024-04-25T22:01:15.642713+0000","last_fullsized":"2024-04-25T22:01:15.642713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629606+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:01:16.629606+0000","last_peered":"2024-04-25T22:01:16.629606+0000","last_clean":"2024-04-25T22:01:16.629606+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:01:16.629606+0000","last_undegraded":"2024-04-25T22:01:16.629606+0000","last_fullsized":"2024-04-25T22:01:16.629606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642135+0000","last_change":"2024-04-25T22:01:13.623342+0000","last_active":"2024-04-25T22:01:15.642135+0000","last_peered":"2024-04-25T22:01:15.642135+0000","last_clean":"2024-04-25T22:01:15.642135+0000","last_became_active":"2024-04-25T22:01:13.621460+0000","last_became_peered":"2024-04-25T22:01:13.621460+0000","last_unstale":"2024-04-25T22:01:15.642135+0000","last_undegraded":"2024-04-25T22:01:15.642135+0000","last_fullsized":"2024-04-25T22:01:15.642135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643302+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:01:15.643302+0000","last_peered":"2024-04-25T22:01:15.643302+0000","last_clean":"2024-04-25T22:01:15.643302+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:01:15.643302+0000","last_undegraded":"2024-04-25T22:01:15.643302+0000","last_fullsized":"2024-04-25T22:01:15.643302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629372+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:01:16.629372+0000","last_peered":"2024-04-25T22:01:16.629372+0000","last_clean":"2024-04-25T22:01:16.629372+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:01:16.629372+0000","last_undegraded":"2024-04-25T22:01:16.629372+0000","last_fullsized":"2024-04-25T22:01:16.629372+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630769+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:01:16.630769+0000","last_peered":"2024-04-25T22:01:16.630769+0000","last_clean":"2024-04-25T22:01:16.630769+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:01:16.630769+0000","last_undegraded":"2024-04-25T22:01:16.630769+0000","last_fullsized":"2024-04-25T22:01:16.630769+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642365+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:01:15.642365+0000","last_peered":"2024-04-25T22:01:15.642365+0000","last_clean":"2024-04-25T22:01:15.642365+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:01:15.642365+0000","last_undegraded":"2024-04-25T22:01:15.642365+0000","last_fullsized":"2024-04-25T22:01:15.642365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630930+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:01:16.630930+0000","last_peered":"2024-04-25T22:01:16.630930+0000","last_clean":"2024-04-25T22:01:16.630930+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:01:16.630930+0000","last_undegraded":"2024-04-25T22:01:16.630930+0000","last_fullsized":"2024-04-25T22:01:16.630930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629358+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:01:16.629358+0000","last_peered":"2024-04-25T22:01:16.629358+0000","last_clean":"2024-04-25T22:01:16.629358+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:01:16.629358+0000","last_undegraded":"2024-04-25T22:01:16.629358+0000","last_fullsized":"2024-04-25T22:01:16.629358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641937+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:01:15.641937+0000","last_peered":"2024-04-25T22:01:15.641937+0000","last_clean":"2024-04-25T22:01:15.641937+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:01:15.641937+0000","last_undegraded":"2024-04-25T22:01:15.641937+0000","last_fullsized":"2024-04-25T22:01:15.641937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644200+0000","last_change":"2024-04-25T22:01:14.645176+0000","last_active":"2024-04-25T22:01:15.644200+0000","last_peered":"2024-04-25T22:01:15.644200+0000","last_clean":"2024-04-25T22:01:15.644200+0000","last_became_active":"2024-04-25T22:01:14.642395+0000","last_became_peered":"2024-04-25T22:01:14.642395+0000","last_unstale":"2024-04-25T22:01:15.644200+0000","last_undegraded":"2024-04-25T22:01:15.644200+0000","last_fullsized":"2024-04-25T22:01:15.644200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642690+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:01:15.642690+0000","last_peered":"2024-04-25T22:01:15.642690+0000","last_clean":"2024-04-25T22:01:15.642690+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:01:15.642690+0000","last_undegraded":"2024-04-25T22:01:15.642690+0000","last_fullsized":"2024-04-25T22:01:15.642690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643904+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:01:15.643904+0000","last_peered":"2024-04-25T22:01:15.643904+0000","last_clean":"2024-04-25T22:01:15.643904+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:01:15.643904+0000","last_undegraded":"2024-04-25T22:01:15.643904+0000","last_fullsized":"2024-04-25T22:01:15.643904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643553+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:01:15.643553+0000","last_peered":"2024-04-25T22:01:15.643553+0000","last_clean":"2024-04-25T22:01:15.643553+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:01:15.643553+0000","last_undegraded":"2024-04-25T22:01:15.643553+0000","last_fullsized":"2024-04-25T22:01:15.643553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631460+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:01:16.631460+0000","last_peered":"2024-04-25T22:01:16.631460+0000","last_clean":"2024-04-25T22:01:16.631460+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:01:16.631460+0000","last_undegraded":"2024-04-25T22:01:16.631460+0000","last_fullsized":"2024-04-25T22:01:16.631460+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630582+0000","last_change":"2024-04-25T22:01:13.627274+0000","last_active":"2024-04-25T22:01:16.630582+0000","last_peered":"2024-04-25T22:01:16.630582+0000","last_clean":"2024-04-25T22:01:16.630582+0000","last_became_active":"2024-04-25T22:01:13.626015+0000","last_became_peered":"2024-04-25T22:01:13.626015+0000","last_unstale":"2024-04-25T22:01:16.630582+0000","last_undegraded":"2024-04-25T22:01:16.630582+0000","last_fullsized":"2024-04-25T22:01:16.630582+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643225+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:01:15.643225+0000","last_peered":"2024-04-25T22:01:15.643225+0000","last_clean":"2024-04-25T22:01:15.643225+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:01:15.643225+0000","last_undegraded":"2024-04-25T22:01:15.643225+0000","last_fullsized":"2024-04-25T22:01:15.643225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631136+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:01:16.631136+0000","last_peered":"2024-04-25T22:01:16.631136+0000","last_clean":"2024-04-25T22:01:16.631136+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:01:16.631136+0000","last_undegraded":"2024-04-25T22:01:16.631136+0000","last_fullsized":"2024-04-25T22:01:16.631136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643456+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:01:15.643456+0000","last_peered":"2024-04-25T22:01:15.643456+0000","last_clean":"2024-04-25T22:01:15.643456+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:01:15.643456+0000","last_undegraded":"2024-04-25T22:01:15.643456+0000","last_fullsized":"2024-04-25T22:01:15.643456+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643426+0000","last_change":"2024-04-25T22:01:14.637520+0000","last_active":"2024-04-25T22:01:15.643426+0000","last_peered":"2024-04-25T22:01:15.643426+0000","last_clean":"2024-04-25T22:01:15.643426+0000","last_became_active":"2024-04-25T22:01:14.636765+0000","last_became_peered":"2024-04-25T22:01:14.636765+0000","last_unstale":"2024-04-25T22:01:15.643426+0000","last_undegraded":"2024-04-25T22:01:15.643426+0000","last_fullsized":"2024-04-25T22:01:15.643426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643206+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:01:15.643206+0000","last_peered":"2024-04-25T22:01:15.643206+0000","last_clean":"2024-04-25T22:01:15.643206+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:01:15.643206+0000","last_undegraded":"2024-04-25T22:01:15.643206+0000","last_fullsized":"2024-04-25T22:01:15.643206+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.645129+0000","last_change":"2024-04-25T22:01:09.582204+0000","last_active":"2024-04-25T22:01:15.645129+0000","last_peered":"2024-04-25T22:01:15.645129+0000","last_clean":"2024-04-25T22:01:15.645129+0000","last_became_active":"2024-04-25T22:01:09.581494+0000","last_became_peered":"2024-04-25T22:01:09.581494+0000","last_unstale":"2024-04-25T22:01:15.645129+0000","last_undegraded":"2024-04-25T22:01:15.645129+0000","last_fullsized":"2024-04-25T22:01:15.645129+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:13.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642878+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:01:15.642878+0000","last_peered":"2024-04-25T22:01:15.642878+0000","last_clean":"2024-04-25T22:01:15.642878+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:01:15.642878+0000","last_undegraded":"2024-04-25T22:01:15.642878+0000","last_fullsized":"2024-04-25T22:01:15.642878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644141+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:01:15.644141+0000","last_peered":"2024-04-25T22:01:15.644141+0000","last_clean":"2024-04-25T22:01:15.644141+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:01:15.644141+0000","last_undegraded":"2024-04-25T22:01:15.644141+0000","last_fullsized":"2024-04-25T22:01:15.644141+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644123+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:01:15.644123+0000","last_peered":"2024-04-25T22:01:15.644123+0000","last_clean":"2024-04-25T22:01:15.644123+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:01:15.644123+0000","last_undegraded":"2024-04-25T22:01:15.644123+0000","last_fullsized":"2024-04-25T22:01:15.644123+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641739+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:01:15.641739+0000","last_peered":"2024-04-25T22:01:15.641739+0000","last_clean":"2024-04-25T22:01:15.641739+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:01:15.641739+0000","last_undegraded":"2024-04-25T22:01:15.641739+0000","last_fullsized":"2024-04-25T22:01:15.641739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644055+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:01:15.644055+0000","last_peered":"2024-04-25T22:01:15.644055+0000","last_clean":"2024-04-25T22:01:15.644055+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:01:15.644055+0000","last_undegraded":"2024-04-25T22:01:15.644055+0000","last_fullsized":"2024-04-25T22:01:15.644055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630203+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:01:16.630203+0000","last_peered":"2024-04-25T22:01:16.630203+0000","last_clean":"2024-04-25T22:01:16.630203+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:01:16.630203+0000","last_undegraded":"2024-04-25T22:01:16.630203+0000","last_fullsized":"2024-04-25T22:01:16.630203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642445+0000","last_change":"2024-04-25T22:01:14.632306+0000","last_active":"2024-04-25T22:01:15.642445+0000","last_peered":"2024-04-25T22:01:15.642445+0000","last_clean":"2024-04-25T22:01:15.642445+0000","last_became_active":"2024-04-25T22:01:14.631179+0000","last_became_peered":"2024-04-25T22:01:14.631179+0000","last_unstale":"2024-04-25T22:01:15.642445+0000","last_undegraded":"2024-04-25T22:01:15.642445+0000","last_fullsized":"2024-04-25T22:01:15.642445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630101+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:01:16.630101+0000","last_peered":"2024-04-25T22:01:16.630101+0000","last_clean":"2024-04-25T22:01:16.630101+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:01:16.630101+0000","last_undegraded":"2024-04-25T22:01:16.630101+0000","last_fullsized":"2024-04-25T22:01:16.630101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631516+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:01:16.631516+0000","last_peered":"2024-04-25T22:01:16.631516+0000","last_clean":"2024-04-25T22:01:16.631516+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:01:16.631516+0000","last_undegraded":"2024-04-25T22:01:16.631516+0000","last_fullsized":"2024-04-25T22:01:16.631516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641760+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:01:15.641760+0000","last_peered":"2024-04-25T22:01:15.641760+0000","last_clean":"2024-04-25T22:01:15.641760+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:01:15.641760+0000","last_undegraded":"2024-04-25T22:01:15.641760+0000","last_fullsized":"2024-04-25T22:01:15.641760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644879+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:01:15.644879+0000","last_peered":"2024-04-25T22:01:15.644879+0000","last_clean":"2024-04-25T22:01:15.644879+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:01:15.644879+0000","last_undegraded":"2024-04-25T22:01:15.644879+0000","last_fullsized":"2024-04-25T22:01:15.644879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629767+0000","last_change":"2024-04-25T22:01:13.626710+0000","last_active":"2024-04-25T22:01:16.629767+0000","last_peered":"2024-04-25T22:01:16.629767+0000","last_clean":"2024-04-25T22:01:16.629767+0000","last_became_active":"2024-04-25T22:01:13.625898+0000","last_became_peered":"2024-04-25T22:01:13.625898+0000","last_unstale":"2024-04-25T22:01:16.629767+0000","last_undegraded":"2024-04-25T22:01:16.629767+0000","last_fullsized":"2024-04-25T22:01:16.629767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641621+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:01:15.641621+0000","last_peered":"2024-04-25T22:01:15.641621+0000","last_clean":"2024-04-25T22:01:15.641621+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:01:15.641621+0000","last_undegraded":"2024-04-25T22:01:15.641621+0000","last_fullsized":"2024-04-25T22:01:15.641621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643856+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:01:15.643856+0000","last_peered":"2024-04-25T22:01:15.643856+0000","last_clean":"2024-04-25T22:01:15.643856+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:01:15.643856+0000","last_undegraded":"2024-04-25T22:01:15.643856+0000","last_fullsized":"2024-04-25T22:01:15.643856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641332+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:01:15.641332+0000","last_peered":"2024-04-25T22:01:15.641332+0000","last_clean":"2024-04-25T22:01:15.641332+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:01:15.641332+0000","last_undegraded":"2024-04-25T22:01:15.641332+0000","last_fullsized":"2024-04-25T22:01:15.641332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644225+0000","last_change":"2024-04-25T22:01:14.639447+0000","last_active":"2024-04-25T22:01:15.644225+0000","last_peered":"2024-04-25T22:01:15.644225+0000","last_clean":"2024-04-25T22:01:15.644225+0000","last_became_active":"2024-04-25T22:01:14.638864+0000","last_became_peered":"2024-04-25T22:01:14.638864+0000","last_unstale":"2024-04-25T22:01:15.644225+0000","last_undegraded":"2024-04-25T22:01:15.644225+0000","last_fullsized":"2024-04-25T22:01:15.644225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642023+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:01:15.642023+0000","last_peered":"2024-04-25T22:01:15.642023+0000","last_clean":"2024-04-25T22:01:15.642023+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:01:15.642023+0000","last_undegraded":"2024-04-25T22:01:15.642023+0000","last_fullsized":"2024-04-25T22:01:15.642023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643570+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:01:15.643570+0000","last_peered":"2024-04-25T22:01:15.643570+0000","last_clean":"2024-04-25T22:01:15.643570+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:01:15.643570+0000","last_undegraded":"2024-04-25T22:01:15.643570+0000","last_fullsized":"2024-04-25T22:01:15.643570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641814+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:01:15.641814+0000","last_peered":"2024-04-25T22:01:15.641814+0000","last_clean":"2024-04-25T22:01:15.641814+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:01:15.641814+0000","last_undegraded":"2024-04-25T22:01:15.641814+0000","last_fullsized":"2024-04-25T22:01:15.641814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644642+0000","last_change":"2024-04-25T22:01:14.637452+0000","last_active":"2024-04-25T22:01:15.644642+0000","last_peered":"2024-04-25T22:01:15.644642+0000","last_clean":"2024-04-25T22:01:15.644642+0000","last_became_active":"2024-04-25T22:01:14.636407+0000","last_became_peered":"2024-04-25T22:01:14.636407+0000","last_unstale":"2024-04-25T22:01:15.644642+0000","last_undegraded":"2024-04-25T22:01:15.644642+0000","last_fullsized":"2024-04-25T22:01:15.644642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643041+0000","last_change":"2024-04-25T22:01:13.621997+0000","last_active":"2024-04-25T22:01:15.643041+0000","last_peered":"2024-04-25T22:01:15.643041+0000","last_clean":"2024-04-25T22:01:15.643041+0000","last_became_active":"2024-04-25T22:01:13.620987+0000","last_became_peered":"2024-04-25T22:01:13.620987+0000","last_unstale":"2024-04-25T22:01:15.643041+0000","last_undegraded":"2024-04-25T22:01:15.643041+0000","last_fullsized":"2024-04-25T22:01:15.643041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643601+0000","last_change":"2024-04-25T22:01:14.650437+0000","last_active":"2024-04-25T22:01:15.643601+0000","last_peered":"2024-04-25T22:01:15.643601+0000","last_clean":"2024-04-25T22:01:15.643601+0000","last_became_active":"2024-04-25T22:01:14.648116+0000","last_became_peered":"2024-04-25T22:01:14.648116+0000","last_unstale":"2024-04-25T22:01:15.643601+0000","last_undegraded":"2024-04-25T22:01:15.643601+0000","last_fullsized":"2024-04-25T22:01:15.643601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643173+0000","last_change":"2024-04-25T22:01:13.631562+0000","last_active":"2024-04-25T22:01:15.643173+0000","last_peered":"2024-04-25T22:01:15.643173+0000","last_clean":"2024-04-25T22:01:15.643173+0000","last_became_active":"2024-04-25T22:01:13.630731+0000","last_became_peered":"2024-04-25T22:01:13.630731+0000","last_unstale":"2024-04-25T22:01:15.643173+0000","last_undegraded":"2024-04-25T22:01:15.643173+0000","last_fullsized":"2024-04-25T22:01:15.643173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629517+0000","last_change":"2024-04-25T22:01:14.654909+0000","last_active":"2024-04-25T22:01:16.629517+0000","last_peered":"2024-04-25T22:01:16.629517+0000","last_clean":"2024-04-25T22:01:16.629517+0000","last_became_active":"2024-04-25T22:01:14.653503+0000","last_became_peered":"2024-04-25T22:01:14.653503+0000","last_unstale":"2024-04-25T22:01:16.629517+0000","last_undegraded":"2024-04-25T22:01:16.629517+0000","last_fullsized":"2024-04-25T22:01:16.629517+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631196+0000","last_change":"2024-04-25T22:01:13.628356+0000","last_active":"2024-04-25T22:01:16.631196+0000","last_peered":"2024-04-25T22:01:16.631196+0000","last_clean":"2024-04-25T22:01:16.631196+0000","last_became_active":"2024-04-25T22:01:13.626608+0000","last_became_peered":"2024-04-25T22:01:13.626608+0000","last_unstale":"2024-04-25T22:01:16.631196+0000","last_undegraded":"2024-04-25T22:01:16.631196+0000","last_fullsized":"2024-04-25T22:01:16.631196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631268+0000","last_change":"2024-04-25T22:01:14.648752+0000","last_active":"2024-04-25T22:01:16.631268+0000","last_peered":"2024-04-25T22:01:16.631268+0000","last_clean":"2024-04-25T22:01:16.631268+0000","last_became_active":"2024-04-25T22:01:14.647463+0000","last_became_peered":"2024-04-25T22:01:14.647463+0000","last_unstale":"2024-04-25T22:01:16.631268+0000","last_undegraded":"2024-04-25T22:01:16.631268+0000","last_fullsized":"2024-04-25T22:01:16.631268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:22.946881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644469+0000","last_change":"2024-04-25T22:01:13.630502+0000","last_active":"2024-04-25T22:01:15.644469+0000","last_peered":"2024-04-25T22:01:15.644469+0000","last_clean":"2024-04-25T22:01:15.644469+0000","last_became_active":"2024-04-25T22:01:13.629854+0000","last_became_peered":"2024-04-25T22:01:13.629854+0000","last_unstale":"2024-04-25T22:01:15.644469+0000","last_undegraded":"2024-04-25T22:01:15.644469+0000","last_fullsized":"2024-04-25T22:01:15.644469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643115+0000","last_change":"2024-04-25T22:01:14.642104+0000","last_active":"2024-04-25T22:01:15.643115+0000","last_peered":"2024-04-25T22:01:15.643115+0000","last_clean":"2024-04-25T22:01:15.643115+0000","last_became_active":"2024-04-25T22:01:14.641323+0000","last_became_peered":"2024-04-25T22:01:14.641323+0000","last_unstale":"2024-04-25T22:01:15.643115+0000","last_undegraded":"2024-04-25T22:01:15.643115+0000","last_fullsized":"2024-04-25T22:01:15.643115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643826+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:01:15.643826+0000","last_peered":"2024-04-25T22:01:15.643826+0000","last_clean":"2024-04-25T22:01:15.643826+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:01:15.643826+0000","last_undegraded":"2024-04-25T22:01:15.643826+0000","last_fullsized":"2024-04-25T22:01:15.643826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629024+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:01:16.629024+0000","last_peered":"2024-04-25T22:01:16.629024+0000","last_clean":"2024-04-25T22:01:16.629024+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:01:16.629024+0000","last_undegraded":"2024-04-25T22:01:16.629024+0000","last_fullsized":"2024-04-25T22:01:16.629024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643575+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:01:15.643575+0000","last_peered":"2024-04-25T22:01:15.643575+0000","last_clean":"2024-04-25T22:01:15.643575+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:01:15.643575+0000","last_undegraded":"2024-04-25T22:01:15.643575+0000","last_fullsized":"2024-04-25T22:01:15.643575+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":237568,"data_stored":647274,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":55728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":245760,"data_stored":647890,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:01:34.835 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:01:35.187 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:35.189 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:01:35.207 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-04-25T22:01:33.567505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90028,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025492,"statfs":{"total":289910292480,"available":289818103808,"internally_reserved":0,"allocated":647168,"data_stored":1350892,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003582"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643883+0000","last_change":"2024-04-25T22:01:14.641678+0000","last_active":"2024-04-25T22:01:15.643883+0000","last_peered":"2024-04-25T22:01:15.643883+0000","last_clean":"2024-04-25T22:01:15.643883+0000","last_became_active":"2024-04-25T22:01:14.640808+0000","last_became_peered":"2024-04-25T22:01:14.640808+0000","last_unstale":"2024-04-25T22:01:15.643883+0000","last_undegraded":"2024-04-25T22:01:15.643883+0000","last_fullsized":"2024-04-25T22:01:15.643883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643649+0000","last_change":"2024-04-25T22:01:14.648935+0000","last_active":"2024-04-25T22:01:15.643649+0000","last_peered":"2024-04-25T22:01:15.643649+0000","last_clean":"2024-04-25T22:01:15.643649+0000","last_became_active":"2024-04-25T22:01:14.647871+0000","last_became_peered":"2024-04-25T22:01:14.647871+0000","last_unstale":"2024-04-25T22:01:15.643649+0000","last_undegraded":"2024-04-25T22:01:15.643649+0000","last_fullsized":"2024-04-25T22:01:15.643649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629685+0000","last_change":"2024-04-25T22:01:14.647262+0000","last_active":"2024-04-25T22:01:16.629685+0000","last_peered":"2024-04-25T22:01:16.629685+0000","last_clean":"2024-04-25T22:01:16.629685+0000","last_became_active":"2024-04-25T22:01:14.645878+0000","last_became_peered":"2024-04-25T22:01:14.645878+0000","last_unstale":"2024-04-25T22:01:16.629685+0000","last_undegraded":"2024-04-25T22:01:16.629685+0000","last_fullsized":"2024-04-25T22:01:16.629685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630225+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:01:16.630225+0000","last_peered":"2024-04-25T22:01:16.630225+0000","last_clean":"2024-04-25T22:01:16.630225+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:01:16.630225+0000","last_undegraded":"2024-04-25T22:01:16.630225+0000","last_fullsized":"2024-04-25T22:01:16.630225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643155+0000","last_change":"2024-04-25T22:01:14.642505+0000","last_active":"2024-04-25T22:01:15.643155+0000","last_peered":"2024-04-25T22:01:15.643155+0000","last_clean":"2024-04-25T22:01:15.643155+0000","last_became_active":"2024-04-25T22:01:14.641574+0000","last_became_peered":"2024-04-25T22:01:14.641574+0000","last_unstale":"2024-04-25T22:01:15.643155+0000","last_undegraded":"2024-04-25T22:01:15.643155+0000","last_fullsized":"2024-04-25T22:01:15.643155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630343+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:01:16.630343+0000","last_peered":"2024-04-25T22:01:16.630343+0000","last_clean":"2024-04-25T22:01:16.630343+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:01:16.630343+0000","last_undegraded":"2024-04-25T22:01:16.630343+0000","last_fullsized":"2024-04-25T22:01:16.630343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628889+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:01:16.628889+0000","last_peered":"2024-04-25T22:01:16.628889+0000","last_clean":"2024-04-25T22:01:16.628889+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:01:16.628889+0000","last_undegraded":"2024-04-25T22:01:16.628889+0000","last_fullsized":"2024-04-25T22:01:16.628889+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628140+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:01:16.628140+0000","last_peered":"2024-04-25T22:01:16.628140+0000","last_clean":"2024-04-25T22:01:16.628140+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:01:16.628140+0000","last_undegraded":"2024-04-25T22:01:16.628140+0000","last_fullsized":"2024-04-25T22:01:16.628140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642568+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:01:15.642568+0000","last_peered":"2024-04-25T22:01:15.642568+0000","last_clean":"2024-04-25T22:01:15.642568+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:01:15.642568+0000","last_undegraded":"2024-04-25T22:01:15.642568+0000","last_fullsized":"2024-04-25T22:01:15.642568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643687+0000","last_change":"2024-04-25T22:01:14.647968+0000","last_active":"2024-04-25T22:01:15.643687+0000","last_peered":"2024-04-25T22:01:15.643687+0000","last_clean":"2024-04-25T22:01:15.643687+0000","last_became_active":"2024-04-25T22:01:14.646872+0000","last_became_peered":"2024-04-25T22:01:14.646872+0000","last_unstale":"2024-04-25T22:01:15.643687+0000","last_undegraded":"2024-04-25T22:01:15.643687+0000","last_fullsized":"2024-04-25T22:01:15.643687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629818+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:01:16.629818+0000","last_peered":"2024-04-25T22:01:16.629818+0000","last_clean":"2024-04-25T22:01:16.629818+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:01:16.629818+0000","last_undegraded":"2024-04-25T22:01:16.629818+0000","last_fullsized":"2024-04-25T22:01:16.629818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643509+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:01:15.643509+0000","last_peered":"2024-04-25T22:01:15.643509+0000","last_clean":"2024-04-25T22:01:15.643509+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:01:15.643509+0000","last_undegraded":"2024-04-25T22:01:15.643509+0000","last_fullsized":"2024-04-25T22:01:15.643509+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642423+0000","last_change":"2024-04-25T22:01:14.643909+0000","last_active":"2024-04-25T22:01:15.642423+0000","last_peered":"2024-04-25T22:01:15.642423+0000","last_clean":"2024-04-25T22:01:15.642423+0000","last_became_active":"2024-04-25T22:01:14.642421+0000","last_became_peered":"2024-04-25T22:01:14.642421+0000","last_unstale":"2024-04-25T22:01:15.642423+0000","last_undegraded":"2024-04-25T22:01:15.642423+0000","last_fullsized":"2024-04-25T22:01:15.642423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630801+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:01:16.630801+0000","last_peered":"2024-04-25T22:01:16.630801+0000","last_clean":"2024-04-25T22:01:16.630801+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:01:16.630801+0000","last_undegraded":"2024-04-25T22:01:16.630801+0000","last_fullsized":"2024-04-25T22:01:16.630801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628926+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:01:16.628926+0000","last_peered":"2024-04-25T22:01:16.628926+0000","last_clean":"2024-04-25T22:01:16.628926+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:01:16.628926+0000","last_undegraded":"2024-04-25T22:01:16.628926+0000","last_fullsized":"2024-04-25T22:01:16.628926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628179+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:01:16.628179+0000","last_peered":"2024-04-25T22:01:16.628179+0000","last_clean":"2024-04-25T22:01:16.628179+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:01:16.628179+0000","last_undegraded":"2024-04-25T22:01:16.628179+0000","last_fullsized":"2024-04-25T22:01:16.628179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644180+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:01:15.644180+0000","last_peered":"2024-04-25T22:01:15.644180+0000","last_clean":"2024-04-25T22:01:15.644180+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:01:15.644180+0000","last_undegraded":"2024-04-25T22:01:15.644180+0000","last_fullsized":"2024-04-25T22:01:15.644180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644577+0000","last_change":"2024-04-25T22:01:14.647317+0000","last_active":"2024-04-25T22:01:15.644577+0000","last_peered":"2024-04-25T22:01:15.644577+0000","last_clean":"2024-04-25T22:01:15.644577+0000","last_became_active":"2024-04-25T22:01:14.644027+0000","last_became_peered":"2024-04-25T22:01:14.644027+0000","last_unstale":"2024-04-25T22:01:15.644577+0000","last_undegraded":"2024-04-25T22:01:15.644577+0000","last_fullsized":"2024-04-25T22:01:15.644577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642752+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:01:15.642752+0000","last_peered":"2024-04-25T22:01:15.642752+0000","last_clean":"2024-04-25T22:01:15.642752+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:01:15.642752+0000","last_undegraded":"2024-04-25T22:01:15.642752+0000","last_fullsized":"2024-04-25T22:01:15.642752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630673+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:01:16.630673+0000","last_peered":"2024-04-25T22:01:16.630673+0000","last_clean":"2024-04-25T22:01:16.630673+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:01:16.630673+0000","last_undegraded":"2024-04-25T22:01:16.630673+0000","last_fullsized":"2024-04-25T22:01:16.630673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630420+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:01:16.630420+0000","last_peered":"2024-04-25T22:01:16.630420+0000","last_clean":"2024-04-25T22:01:16.630420+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:01:16.630420+0000","last_undegraded":"2024-04-25T22:01:16.630420+0000","last_fullsized":"2024-04-25T22:01:16.630420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642311+0000","last_change":"2024-04-25T22:01:14.633477+0000","last_active":"2024-04-25T22:01:15.642311+0000","last_peered":"2024-04-25T22:01:15.642311+0000","last_clean":"2024-04-25T22:01:15.642311+0000","last_became_active":"2024-04-25T22:01:14.632678+0000","last_became_peered":"2024-04-25T22:01:14.632678+0000","last_unstale":"2024-04-25T22:01:15.642311+0000","last_undegraded":"2024-04-25T22:01:15.642311+0000","last_fullsized":"2024-04-25T22:01:15.642311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641145+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:01:15.641145+0000","last_peered":"2024-04-25T22:01:15.641145+0000","last_clean":"2024-04-25T22:01:15.641145+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:01:15.641145+0000","last_undegraded":"2024-04-25T22:01:15.641145+0000","last_fullsized":"2024-04-25T22:01:15.641145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641815+0000","last_change":"2024-04-25T22:01:14.641991+0000","last_active":"2024-04-25T22:01:15.641815+0000","last_peered":"2024-04-25T22:01:15.641815+0000","last_clean":"2024-04-25T22:01:15.641815+0000","last_became_active":"2024-04-25T22:01:14.641244+0000","last_became_peered":"2024-04-25T22:01:14.641244+0000","last_unstale":"2024-04-25T22:01:15.641815+0000","last_undegraded":"2024-04-25T22:01:15.641815+0000","last_fullsized":"2024-04-25T22:01:15.641815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:03.098700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644044+0000","last_change":"2024-04-25T22:01:14.638103+0000","last_active":"2024-04-25T22:01:15.644044+0000","last_peered":"2024-04-25T22:01:15.644044+0000","last_clean":"2024-04-25T22:01:15.644044+0000","last_became_active":"2024-04-25T22:01:14.636488+0000","last_became_peered":"2024-04-25T22:01:14.636488+0000","last_unstale":"2024-04-25T22:01:15.644044+0000","last_undegraded":"2024-04-25T22:01:15.644044+0000","last_fullsized":"2024-04-25T22:01:15.644044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643468+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:01:15.643468+0000","last_peered":"2024-04-25T22:01:15.643468+0000","last_clean":"2024-04-25T22:01:15.643468+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:01:15.643468+0000","last_undegraded":"2024-04-25T22:01:15.643468+0000","last_fullsized":"2024-04-25T22:01:15.643468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630101+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:01:16.630101+0000","last_peered":"2024-04-25T22:01:16.630101+0000","last_clean":"2024-04-25T22:01:16.630101+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:01:16.630101+0000","last_undegraded":"2024-04-25T22:01:16.630101+0000","last_fullsized":"2024-04-25T22:01:16.630101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644402+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:01:15.644402+0000","last_peered":"2024-04-25T22:01:15.644402+0000","last_clean":"2024-04-25T22:01:15.644402+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:01:15.644402+0000","last_undegraded":"2024-04-25T22:01:15.644402+0000","last_fullsized":"2024-04-25T22:01:15.644402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642402+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:01:15.642402+0000","last_peered":"2024-04-25T22:01:15.642402+0000","last_clean":"2024-04-25T22:01:15.642402+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:01:15.642402+0000","last_undegraded":"2024-04-25T22:01:15.642402+0000","last_fullsized":"2024-04-25T22:01:15.642402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642766+0000","last_change":"2024-04-25T22:01:14.638343+0000","last_active":"2024-04-25T22:01:15.642766+0000","last_peered":"2024-04-25T22:01:15.642766+0000","last_clean":"2024-04-25T22:01:15.642766+0000","last_became_active":"2024-04-25T22:01:14.637694+0000","last_became_peered":"2024-04-25T22:01:14.637694+0000","last_unstale":"2024-04-25T22:01:15.642766+0000","last_undegraded":"2024-04-25T22:01:15.642766+0000","last_fullsized":"2024-04-25T22:01:15.642766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641265+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:01:15.641265+0000","last_peered":"2024-04-25T22:01:15.641265+0000","last_clean":"2024-04-25T22:01:15.641265+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:01:15.641265+0000","last_undegraded":"2024-04-25T22:01:15.641265+0000","last_fullsized":"2024-04-25T22:01:15.641265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628586+0000","last_change":"2024-04-25T22:01:14.648196+0000","last_active":"2024-04-25T22:01:16.628586+0000","last_peered":"2024-04-25T22:01:16.628586+0000","last_clean":"2024-04-25T22:01:16.628586+0000","last_became_active":"2024-04-25T22:01:14.647509+0000","last_became_peered":"2024-04-25T22:01:14.647509+0000","last_unstale":"2024-04-25T22:01:16.628586+0000","last_undegraded":"2024-04-25T22:01:16.628586+0000","last_fullsized":"2024-04-25T22:01:16.628586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643932+0000","last_change":"2024-04-25T22:01:14.641706+0000","last_active":"2024-04-25T22:01:15.643932+0000","last_peered":"2024-04-25T22:01:15.643932+0000","last_clean":"2024-04-25T22:01:15.643932+0000","last_became_active":"2024-04-25T22:01:14.641043+0000","last_became_peered":"2024-04-25T22:01:14.641043+0000","last_unstale":"2024-04-25T22:01:15.643932+0000","last_undegraded":"2024-04-25T22:01:15.643932+0000","last_fullsized":"2024-04-25T22:01:15.643932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630432+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:01:16.630432+0000","last_peered":"2024-04-25T22:01:16.630432+0000","last_clean":"2024-04-25T22:01:16.630432+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:01:16.630432+0000","last_undegraded":"2024-04-25T22:01:16.630432+0000","last_fullsized":"2024-04-25T22:01:16.630432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644159+0000","last_change":"2024-04-25T22:01:14.635075+0000","last_active":"2024-04-25T22:01:15.644159+0000","last_peered":"2024-04-25T22:01:15.644159+0000","last_clean":"2024-04-25T22:01:15.644159+0000","last_became_active":"2024-04-25T22:01:14.630677+0000","last_became_peered":"2024-04-25T22:01:14.630677+0000","last_unstale":"2024-04-25T22:01:15.644159+0000","last_undegraded":"2024-04-25T22:01:15.644159+0000","last_fullsized":"2024-04-25T22:01:15.644159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641776+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:01:15.641776+0000","last_peered":"2024-04-25T22:01:15.641776+0000","last_clean":"2024-04-25T22:01:15.641776+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:01:15.641776+0000","last_undegraded":"2024-04-25T22:01:15.641776+0000","last_fullsized":"2024-04-25T22:01:15.641776+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644033+0000","last_change":"2024-04-25T22:01:14.648527+0000","last_active":"2024-04-25T22:01:15.644033+0000","last_peered":"2024-04-25T22:01:15.644033+0000","last_clean":"2024-04-25T22:01:15.644033+0000","last_became_active":"2024-04-25T22:01:14.645040+0000","last_became_peered":"2024-04-25T22:01:14.645040+0000","last_unstale":"2024-04-25T22:01:15.644033+0000","last_undegraded":"2024-04-25T22:01:15.644033+0000","last_fullsized":"2024-04-25T22:01:15.644033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642322+0000","last_change":"2024-04-25T22:01:13.630817+0000","last_active":"2024-04-25T22:01:15.642322+0000","last_peered":"2024-04-25T22:01:15.642322+0000","last_clean":"2024-04-25T22:01:15.642322+0000","last_became_active":"2024-04-25T22:01:13.629994+0000","last_became_peered":"2024-04-25T22:01:13.629994+0000","last_unstale":"2024-04-25T22:01:15.642322+0000","last_undegraded":"2024-04-25T22:01:15.642322+0000","last_fullsized":"2024-04-25T22:01:15.642322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643109+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:01:15.643109+0000","last_peered":"2024-04-25T22:01:15.643109+0000","last_clean":"2024-04-25T22:01:15.643109+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:01:15.643109+0000","last_undegraded":"2024-04-25T22:01:15.643109+0000","last_fullsized":"2024-04-25T22:01:15.643109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.628481+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:01:16.628481+0000","last_peered":"2024-04-25T22:01:16.628481+0000","last_clean":"2024-04-25T22:01:16.628481+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:01:16.628481+0000","last_undegraded":"2024-04-25T22:01:16.628481+0000","last_fullsized":"2024-04-25T22:01:16.628481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630098+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:01:16.630098+0000","last_peered":"2024-04-25T22:01:16.630098+0000","last_clean":"2024-04-25T22:01:16.630098+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:01:16.630098+0000","last_undegraded":"2024-04-25T22:01:16.630098+0000","last_fullsized":"2024-04-25T22:01:16.630098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641940+0000","last_change":"2024-04-25T22:01:14.633805+0000","last_active":"2024-04-25T22:01:15.641940+0000","last_peered":"2024-04-25T22:01:15.641940+0000","last_clean":"2024-04-25T22:01:15.641940+0000","last_became_active":"2024-04-25T22:01:14.633045+0000","last_became_peered":"2024-04-25T22:01:14.633045+0000","last_unstale":"2024-04-25T22:01:15.641940+0000","last_undegraded":"2024-04-25T22:01:15.641940+0000","last_fullsized":"2024-04-25T22:01:15.641940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:43.718628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644703+0000","last_change":"2024-04-25T22:01:13.631135+0000","last_active":"2024-04-25T22:01:15.644703+0000","last_peered":"2024-04-25T22:01:15.644703+0000","last_clean":"2024-04-25T22:01:15.644703+0000","last_became_active":"2024-04-25T22:01:13.630257+0000","last_became_peered":"2024-04-25T22:01:13.630257+0000","last_unstale":"2024-04-25T22:01:15.644703+0000","last_undegraded":"2024-04-25T22:01:15.644703+0000","last_fullsized":"2024-04-25T22:01:15.644703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641989+0000","last_change":"2024-04-25T22:01:14.630233+0000","last_active":"2024-04-25T22:01:15.641989+0000","last_peered":"2024-04-25T22:01:15.641989+0000","last_clean":"2024-04-25T22:01:15.641989+0000","last_became_active":"2024-04-25T22:01:14.629415+0000","last_became_peered":"2024-04-25T22:01:14.629415+0000","last_unstale":"2024-04-25T22:01:15.641989+0000","last_undegraded":"2024-04-25T22:01:15.641989+0000","last_fullsized":"2024-04-25T22:01:15.641989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:02:28.593163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630847+0000","last_change":"2024-04-25T22:01:13.633106+0000","last_active":"2024-04-25T22:01:16.630847+0000","last_peered":"2024-04-25T22:01:16.630847+0000","last_clean":"2024-04-25T22:01:16.630847+0000","last_became_active":"2024-04-25T22:01:13.631466+0000","last_became_peered":"2024-04-25T22:01:13.631466+0000","last_unstale":"2024-04-25T22:01:16.630847+0000","last_undegraded":"2024-04-25T22:01:16.630847+0000","last_fullsized":"2024-04-25T22:01:16.630847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:23.095422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630867+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:01:16.630867+0000","last_peered":"2024-04-25T22:01:16.630867+0000","last_clean":"2024-04-25T22:01:16.630867+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:01:16.630867+0000","last_undegraded":"2024-04-25T22:01:16.630867+0000","last_fullsized":"2024-04-25T22:01:16.630867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631516+0000","last_change":"2024-04-25T22:01:13.626767+0000","last_active":"2024-04-25T22:01:16.631516+0000","last_peered":"2024-04-25T22:01:16.631516+0000","last_clean":"2024-04-25T22:01:16.631516+0000","last_became_active":"2024-04-25T22:01:13.625984+0000","last_became_peered":"2024-04-25T22:01:13.625984+0000","last_unstale":"2024-04-25T22:01:16.631516+0000","last_undegraded":"2024-04-25T22:01:16.631516+0000","last_fullsized":"2024-04-25T22:01:16.631516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642637+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:01:15.642637+0000","last_peered":"2024-04-25T22:01:15.642637+0000","last_clean":"2024-04-25T22:01:15.642637+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:01:15.642637+0000","last_undegraded":"2024-04-25T22:01:15.642637+0000","last_fullsized":"2024-04-25T22:01:15.642637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643352+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:01:15.643352+0000","last_peered":"2024-04-25T22:01:15.643352+0000","last_clean":"2024-04-25T22:01:15.643352+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:01:15.643352+0000","last_undegraded":"2024-04-25T22:01:15.643352+0000","last_fullsized":"2024-04-25T22:01:15.643352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631293+0000","last_change":"2024-04-25T22:01:14.650077+0000","last_active":"2024-04-25T22:01:16.631293+0000","last_peered":"2024-04-25T22:01:16.631293+0000","last_clean":"2024-04-25T22:01:16.631293+0000","last_became_active":"2024-04-25T22:01:14.649315+0000","last_became_peered":"2024-04-25T22:01:14.649315+0000","last_unstale":"2024-04-25T22:01:16.631293+0000","last_undegraded":"2024-04-25T22:01:16.631293+0000","last_fullsized":"2024-04-25T22:01:16.631293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.976715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631205+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:01:16.631205+0000","last_peered":"2024-04-25T22:01:16.631205+0000","last_clean":"2024-04-25T22:01:16.631205+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:01:16.631205+0000","last_undegraded":"2024-04-25T22:01:16.631205+0000","last_fullsized":"2024-04-25T22:01:16.631205+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630528+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:01:16.630528+0000","last_peered":"2024-04-25T22:01:16.630528+0000","last_clean":"2024-04-25T22:01:16.630528+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:01:16.630528+0000","last_undegraded":"2024-04-25T22:01:16.630528+0000","last_fullsized":"2024-04-25T22:01:16.630528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642713+0000","last_change":"2024-04-25T22:01:13.631439+0000","last_active":"2024-04-25T22:01:15.642713+0000","last_peered":"2024-04-25T22:01:15.642713+0000","last_clean":"2024-04-25T22:01:15.642713+0000","last_became_active":"2024-04-25T22:01:13.630812+0000","last_became_peered":"2024-04-25T22:01:13.630812+0000","last_unstale":"2024-04-25T22:01:15.642713+0000","last_undegraded":"2024-04-25T22:01:15.642713+0000","last_fullsized":"2024-04-25T22:01:15.642713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629606+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:01:16.629606+0000","last_peered":"2024-04-25T22:01:16.629606+0000","last_clean":"2024-04-25T22:01:16.629606+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:01:16.629606+0000","last_undegraded":"2024-04-25T22:01:16.629606+0000","last_fullsized":"2024-04-25T22:01:16.629606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642135+0000","last_change":"2024-04-25T22:01:13.623342+0000","last_active":"2024-04-25T22:01:15.642135+0000","last_peered":"2024-04-25T22:01:15.642135+0000","last_clean":"2024-04-25T22:01:15.642135+0000","last_became_active":"2024-04-25T22:01:13.621460+0000","last_became_peered":"2024-04-25T22:01:13.621460+0000","last_unstale":"2024-04-25T22:01:15.642135+0000","last_undegraded":"2024-04-25T22:01:15.642135+0000","last_fullsized":"2024-04-25T22:01:15.642135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643302+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:01:15.643302+0000","last_peered":"2024-04-25T22:01:15.643302+0000","last_clean":"2024-04-25T22:01:15.643302+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:01:15.643302+0000","last_undegraded":"2024-04-25T22:01:15.643302+0000","last_fullsized":"2024-04-25T22:01:15.643302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629372+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:01:16.629372+0000","last_peered":"2024-04-25T22:01:16.629372+0000","last_clean":"2024-04-25T22:01:16.629372+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:01:16.629372+0000","last_undegraded":"2024-04-25T22:01:16.629372+0000","last_fullsized":"2024-04-25T22:01:16.629372+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630769+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:01:16.630769+0000","last_peered":"2024-04-25T22:01:16.630769+0000","last_clean":"2024-04-25T22:01:16.630769+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:01:16.630769+0000","last_undegraded":"2024-04-25T22:01:16.630769+0000","last_fullsized":"2024-04-25T22:01:16.630769+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642365+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:01:15.642365+0000","last_peered":"2024-04-25T22:01:15.642365+0000","last_clean":"2024-04-25T22:01:15.642365+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:01:15.642365+0000","last_undegraded":"2024-04-25T22:01:15.642365+0000","last_fullsized":"2024-04-25T22:01:15.642365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630930+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:01:16.630930+0000","last_peered":"2024-04-25T22:01:16.630930+0000","last_clean":"2024-04-25T22:01:16.630930+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:01:16.630930+0000","last_undegraded":"2024-04-25T22:01:16.630930+0000","last_fullsized":"2024-04-25T22:01:16.630930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629358+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:01:16.629358+0000","last_peered":"2024-04-25T22:01:16.629358+0000","last_clean":"2024-04-25T22:01:16.629358+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:01:16.629358+0000","last_undegraded":"2024-04-25T22:01:16.629358+0000","last_fullsized":"2024-04-25T22:01:16.629358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641937+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:01:15.641937+0000","last_peered":"2024-04-25T22:01:15.641937+0000","last_clean":"2024-04-25T22:01:15.641937+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:01:15.641937+0000","last_undegraded":"2024-04-25T22:01:15.641937+0000","last_fullsized":"2024-04-25T22:01:15.641937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644200+0000","last_change":"2024-04-25T22:01:14.645176+0000","last_active":"2024-04-25T22:01:15.644200+0000","last_peered":"2024-04-25T22:01:15.644200+0000","last_clean":"2024-04-25T22:01:15.644200+0000","last_became_active":"2024-04-25T22:01:14.642395+0000","last_became_peered":"2024-04-25T22:01:14.642395+0000","last_unstale":"2024-04-25T22:01:15.644200+0000","last_undegraded":"2024-04-25T22:01:15.644200+0000","last_fullsized":"2024-04-25T22:01:15.644200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642690+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:01:15.642690+0000","last_peered":"2024-04-25T22:01:15.642690+0000","last_clean":"2024-04-25T22:01:15.642690+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:01:15.642690+0000","last_undegraded":"2024-04-25T22:01:15.642690+0000","last_fullsized":"2024-04-25T22:01:15.642690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643904+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:01:15.643904+0000","last_peered":"2024-04-25T22:01:15.643904+0000","last_clean":"2024-04-25T22:01:15.643904+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:01:15.643904+0000","last_undegraded":"2024-04-25T22:01:15.643904+0000","last_fullsized":"2024-04-25T22:01:15.643904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643553+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:01:15.643553+0000","last_peered":"2024-04-25T22:01:15.643553+0000","last_clean":"2024-04-25T22:01:15.643553+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:01:15.643553+0000","last_undegraded":"2024-04-25T22:01:15.643553+0000","last_fullsized":"2024-04-25T22:01:15.643553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631460+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:01:16.631460+0000","last_peered":"2024-04-25T22:01:16.631460+0000","last_clean":"2024-04-25T22:01:16.631460+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:01:16.631460+0000","last_undegraded":"2024-04-25T22:01:16.631460+0000","last_fullsized":"2024-04-25T22:01:16.631460+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630582+0000","last_change":"2024-04-25T22:01:13.627274+0000","last_active":"2024-04-25T22:01:16.630582+0000","last_peered":"2024-04-25T22:01:16.630582+0000","last_clean":"2024-04-25T22:01:16.630582+0000","last_became_active":"2024-04-25T22:01:13.626015+0000","last_became_peered":"2024-04-25T22:01:13.626015+0000","last_unstale":"2024-04-25T22:01:16.630582+0000","last_undegraded":"2024-04-25T22:01:16.630582+0000","last_fullsized":"2024-04-25T22:01:16.630582+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643225+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:01:15.643225+0000","last_peered":"2024-04-25T22:01:15.643225+0000","last_clean":"2024-04-25T22:01:15.643225+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:01:15.643225+0000","last_undegraded":"2024-04-25T22:01:15.643225+0000","last_fullsized":"2024-04-25T22:01:15.643225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631136+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:01:16.631136+0000","last_peered":"2024-04-25T22:01:16.631136+0000","last_clean":"2024-04-25T22:01:16.631136+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:01:16.631136+0000","last_undegraded":"2024-04-25T22:01:16.631136+0000","last_fullsized":"2024-04-25T22:01:16.631136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643456+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:01:15.643456+0000","last_peered":"2024-04-25T22:01:15.643456+0000","last_clean":"2024-04-25T22:01:15.643456+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:01:15.643456+0000","last_undegraded":"2024-04-25T22:01:15.643456+0000","last_fullsized":"2024-04-25T22:01:15.643456+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643426+0000","last_change":"2024-04-25T22:01:14.637520+0000","last_active":"2024-04-25T22:01:15.643426+0000","last_peered":"2024-04-25T22:01:15.643426+0000","last_clean":"2024-04-25T22:01:15.643426+0000","last_became_active":"2024-04-25T22:01:14.636765+0000","last_became_peered":"2024-04-25T22:01:14.636765+0000","last_unstale":"2024-04-25T22:01:15.643426+0000","last_undegraded":"2024-04-25T22:01:15.643426+0000","last_fullsized":"2024-04-25T22:01:15.643426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643206+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:01:15.643206+0000","last_peered":"2024-04-25T22:01:15.643206+0000","last_clean":"2024-04-25T22:01:15.643206+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:01:15.643206+0000","last_undegraded":"2024-04-25T22:01:15.643206+0000","last_fullsized":"2024-04-25T22:01:15.643206+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.645129+0000","last_change":"2024-04-25T22:01:09.582204+0000","last_active":"2024-04-25T22:01:15.645129+0000","last_peered":"2024-04-25T22:01:15.645129+0000","last_clean":"2024-04-25T22:01:15.645129+0000","last_became_active":"2024-04-25T22:01:09.581494+0000","last_became_peered":"2024-04-25T22:01:09.581494+0000","last_unstale":"2024-04-25T22:01:15.645129+0000","last_undegraded":"2024-04-25T22:01:15.645129+0000","last_fullsized":"2024-04-25T22:01:15.645129+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:13.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642878+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:01:15.642878+0000","last_peered":"2024-04-25T22:01:15.642878+0000","last_clean":"2024-04-25T22:01:15.642878+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:01:15.642878+0000","last_undegraded":"2024-04-25T22:01:15.642878+0000","last_fullsized":"2024-04-25T22:01:15.642878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644141+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:01:15.644141+0000","last_peered":"2024-04-25T22:01:15.644141+0000","last_clean":"2024-04-25T22:01:15.644141+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:01:15.644141+0000","last_undegraded":"2024-04-25T22:01:15.644141+0000","last_fullsized":"2024-04-25T22:01:15.644141+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644123+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:01:15.644123+0000","last_peered":"2024-04-25T22:01:15.644123+0000","last_clean":"2024-04-25T22:01:15.644123+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:01:15.644123+0000","last_undegraded":"2024-04-25T22:01:15.644123+0000","last_fullsized":"2024-04-25T22:01:15.644123+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641739+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:01:15.641739+0000","last_peered":"2024-04-25T22:01:15.641739+0000","last_clean":"2024-04-25T22:01:15.641739+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:01:15.641739+0000","last_undegraded":"2024-04-25T22:01:15.641739+0000","last_fullsized":"2024-04-25T22:01:15.641739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644055+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:01:15.644055+0000","last_peered":"2024-04-25T22:01:15.644055+0000","last_clean":"2024-04-25T22:01:15.644055+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:01:15.644055+0000","last_undegraded":"2024-04-25T22:01:15.644055+0000","last_fullsized":"2024-04-25T22:01:15.644055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630203+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:01:16.630203+0000","last_peered":"2024-04-25T22:01:16.630203+0000","last_clean":"2024-04-25T22:01:16.630203+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:01:16.630203+0000","last_undegraded":"2024-04-25T22:01:16.630203+0000","last_fullsized":"2024-04-25T22:01:16.630203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642445+0000","last_change":"2024-04-25T22:01:14.632306+0000","last_active":"2024-04-25T22:01:15.642445+0000","last_peered":"2024-04-25T22:01:15.642445+0000","last_clean":"2024-04-25T22:01:15.642445+0000","last_became_active":"2024-04-25T22:01:14.631179+0000","last_became_peered":"2024-04-25T22:01:14.631179+0000","last_unstale":"2024-04-25T22:01:15.642445+0000","last_undegraded":"2024-04-25T22:01:15.642445+0000","last_fullsized":"2024-04-25T22:01:15.642445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.630101+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:01:16.630101+0000","last_peered":"2024-04-25T22:01:16.630101+0000","last_clean":"2024-04-25T22:01:16.630101+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:01:16.630101+0000","last_undegraded":"2024-04-25T22:01:16.630101+0000","last_fullsized":"2024-04-25T22:01:16.630101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631516+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:01:16.631516+0000","last_peered":"2024-04-25T22:01:16.631516+0000","last_clean":"2024-04-25T22:01:16.631516+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:01:16.631516+0000","last_undegraded":"2024-04-25T22:01:16.631516+0000","last_fullsized":"2024-04-25T22:01:16.631516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641760+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:01:15.641760+0000","last_peered":"2024-04-25T22:01:15.641760+0000","last_clean":"2024-04-25T22:01:15.641760+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:01:15.641760+0000","last_undegraded":"2024-04-25T22:01:15.641760+0000","last_fullsized":"2024-04-25T22:01:15.641760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644879+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:01:15.644879+0000","last_peered":"2024-04-25T22:01:15.644879+0000","last_clean":"2024-04-25T22:01:15.644879+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:01:15.644879+0000","last_undegraded":"2024-04-25T22:01:15.644879+0000","last_fullsized":"2024-04-25T22:01:15.644879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629767+0000","last_change":"2024-04-25T22:01:13.626710+0000","last_active":"2024-04-25T22:01:16.629767+0000","last_peered":"2024-04-25T22:01:16.629767+0000","last_clean":"2024-04-25T22:01:16.629767+0000","last_became_active":"2024-04-25T22:01:13.625898+0000","last_became_peered":"2024-04-25T22:01:13.625898+0000","last_unstale":"2024-04-25T22:01:16.629767+0000","last_undegraded":"2024-04-25T22:01:16.629767+0000","last_fullsized":"2024-04-25T22:01:16.629767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641621+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:01:15.641621+0000","last_peered":"2024-04-25T22:01:15.641621+0000","last_clean":"2024-04-25T22:01:15.641621+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:01:15.641621+0000","last_undegraded":"2024-04-25T22:01:15.641621+0000","last_fullsized":"2024-04-25T22:01:15.641621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643856+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:01:15.643856+0000","last_peered":"2024-04-25T22:01:15.643856+0000","last_clean":"2024-04-25T22:01:15.643856+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:01:15.643856+0000","last_undegraded":"2024-04-25T22:01:15.643856+0000","last_fullsized":"2024-04-25T22:01:15.643856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641332+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:01:15.641332+0000","last_peered":"2024-04-25T22:01:15.641332+0000","last_clean":"2024-04-25T22:01:15.641332+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:01:15.641332+0000","last_undegraded":"2024-04-25T22:01:15.641332+0000","last_fullsized":"2024-04-25T22:01:15.641332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644225+0000","last_change":"2024-04-25T22:01:14.639447+0000","last_active":"2024-04-25T22:01:15.644225+0000","last_peered":"2024-04-25T22:01:15.644225+0000","last_clean":"2024-04-25T22:01:15.644225+0000","last_became_active":"2024-04-25T22:01:14.638864+0000","last_became_peered":"2024-04-25T22:01:14.638864+0000","last_unstale":"2024-04-25T22:01:15.644225+0000","last_undegraded":"2024-04-25T22:01:15.644225+0000","last_fullsized":"2024-04-25T22:01:15.644225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.642023+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:01:15.642023+0000","last_peered":"2024-04-25T22:01:15.642023+0000","last_clean":"2024-04-25T22:01:15.642023+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:01:15.642023+0000","last_undegraded":"2024-04-25T22:01:15.642023+0000","last_fullsized":"2024-04-25T22:01:15.642023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643570+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:01:15.643570+0000","last_peered":"2024-04-25T22:01:15.643570+0000","last_clean":"2024-04-25T22:01:15.643570+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:01:15.643570+0000","last_undegraded":"2024-04-25T22:01:15.643570+0000","last_fullsized":"2024-04-25T22:01:15.643570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.641814+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:01:15.641814+0000","last_peered":"2024-04-25T22:01:15.641814+0000","last_clean":"2024-04-25T22:01:15.641814+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:01:15.641814+0000","last_undegraded":"2024-04-25T22:01:15.641814+0000","last_fullsized":"2024-04-25T22:01:15.641814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644642+0000","last_change":"2024-04-25T22:01:14.637452+0000","last_active":"2024-04-25T22:01:15.644642+0000","last_peered":"2024-04-25T22:01:15.644642+0000","last_clean":"2024-04-25T22:01:15.644642+0000","last_became_active":"2024-04-25T22:01:14.636407+0000","last_became_peered":"2024-04-25T22:01:14.636407+0000","last_unstale":"2024-04-25T22:01:15.644642+0000","last_undegraded":"2024-04-25T22:01:15.644642+0000","last_fullsized":"2024-04-25T22:01:15.644642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643041+0000","last_change":"2024-04-25T22:01:13.621997+0000","last_active":"2024-04-25T22:01:15.643041+0000","last_peered":"2024-04-25T22:01:15.643041+0000","last_clean":"2024-04-25T22:01:15.643041+0000","last_became_active":"2024-04-25T22:01:13.620987+0000","last_became_peered":"2024-04-25T22:01:13.620987+0000","last_unstale":"2024-04-25T22:01:15.643041+0000","last_undegraded":"2024-04-25T22:01:15.643041+0000","last_fullsized":"2024-04-25T22:01:15.643041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643601+0000","last_change":"2024-04-25T22:01:14.650437+0000","last_active":"2024-04-25T22:01:15.643601+0000","last_peered":"2024-04-25T22:01:15.643601+0000","last_clean":"2024-04-25T22:01:15.643601+0000","last_became_active":"2024-04-25T22:01:14.648116+0000","last_became_peered":"2024-04-25T22:01:14.648116+0000","last_unstale":"2024-04-25T22:01:15.643601+0000","last_undegraded":"2024-04-25T22:01:15.643601+0000","last_fullsized":"2024-04-25T22:01:15.643601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643173+0000","last_change":"2024-04-25T22:01:13.631562+0000","last_active":"2024-04-25T22:01:15.643173+0000","last_peered":"2024-04-25T22:01:15.643173+0000","last_clean":"2024-04-25T22:01:15.643173+0000","last_became_active":"2024-04-25T22:01:13.630731+0000","last_became_peered":"2024-04-25T22:01:13.630731+0000","last_unstale":"2024-04-25T22:01:15.643173+0000","last_undegraded":"2024-04-25T22:01:15.643173+0000","last_fullsized":"2024-04-25T22:01:15.643173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629517+0000","last_change":"2024-04-25T22:01:14.654909+0000","last_active":"2024-04-25T22:01:16.629517+0000","last_peered":"2024-04-25T22:01:16.629517+0000","last_clean":"2024-04-25T22:01:16.629517+0000","last_became_active":"2024-04-25T22:01:14.653503+0000","last_became_peered":"2024-04-25T22:01:14.653503+0000","last_unstale":"2024-04-25T22:01:16.629517+0000","last_undegraded":"2024-04-25T22:01:16.629517+0000","last_fullsized":"2024-04-25T22:01:16.629517+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631196+0000","last_change":"2024-04-25T22:01:13.628356+0000","last_active":"2024-04-25T22:01:16.631196+0000","last_peered":"2024-04-25T22:01:16.631196+0000","last_clean":"2024-04-25T22:01:16.631196+0000","last_became_active":"2024-04-25T22:01:13.626608+0000","last_became_peered":"2024-04-25T22:01:13.626608+0000","last_unstale":"2024-04-25T22:01:16.631196+0000","last_undegraded":"2024-04-25T22:01:16.631196+0000","last_fullsized":"2024-04-25T22:01:16.631196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.631268+0000","last_change":"2024-04-25T22:01:14.648752+0000","last_active":"2024-04-25T22:01:16.631268+0000","last_peered":"2024-04-25T22:01:16.631268+0000","last_clean":"2024-04-25T22:01:16.631268+0000","last_became_active":"2024-04-25T22:01:14.647463+0000","last_became_peered":"2024-04-25T22:01:14.647463+0000","last_unstale":"2024-04-25T22:01:16.631268+0000","last_undegraded":"2024-04-25T22:01:16.631268+0000","last_fullsized":"2024-04-25T22:01:16.631268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:22.946881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.644469+0000","last_change":"2024-04-25T22:01:13.630502+0000","last_active":"2024-04-25T22:01:15.644469+0000","last_peered":"2024-04-25T22:01:15.644469+0000","last_clean":"2024-04-25T22:01:15.644469+0000","last_became_active":"2024-04-25T22:01:13.629854+0000","last_became_peered":"2024-04-25T22:01:13.629854+0000","last_unstale":"2024-04-25T22:01:15.644469+0000","last_undegraded":"2024-04-25T22:01:15.644469+0000","last_fullsized":"2024-04-25T22:01:15.644469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643115+0000","last_change":"2024-04-25T22:01:14.642104+0000","last_active":"2024-04-25T22:01:15.643115+0000","last_peered":"2024-04-25T22:01:15.643115+0000","last_clean":"2024-04-25T22:01:15.643115+0000","last_became_active":"2024-04-25T22:01:14.641323+0000","last_became_peered":"2024-04-25T22:01:14.641323+0000","last_unstale":"2024-04-25T22:01:15.643115+0000","last_undegraded":"2024-04-25T22:01:15.643115+0000","last_fullsized":"2024-04-25T22:01:15.643115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643826+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:01:15.643826+0000","last_peered":"2024-04-25T22:01:15.643826+0000","last_clean":"2024-04-25T22:01:15.643826+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:01:15.643826+0000","last_undegraded":"2024-04-25T22:01:15.643826+0000","last_fullsized":"2024-04-25T22:01:15.643826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:16.629024+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:01:16.629024+0000","last_peered":"2024-04-25T22:01:16.629024+0000","last_clean":"2024-04-25T22:01:16.629024+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:01:16.629024+0000","last_undegraded":"2024-04-25T22:01:16.629024+0000","last_fullsized":"2024-04-25T22:01:16.629024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T22:01:15.643575+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:01:15.643575+0000","last_peered":"2024-04-25T22:01:15.643575+0000","last_clean":"2024-04-25T22:01:15.643575+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:01:15.643575+0000","last_undegraded":"2024-04-25T22:01:15.643575+0000","last_fullsized":"2024-04-25T22:01:15.643575+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":237568,"data_stored":647274,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":55728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":245760,"data_stored":647890,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:01:35.211 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T22:01:35.212 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-25T22:01:35.557 INFO:teuthology.orchestra.run.smithi044.stdout:epoch 18 2024-04-25T22:01:35.558 INFO:teuthology.orchestra.run.smithi044.stdout:fsid 1ced109c-704f-44b1-9811-a2da74898889 2024-04-25T22:01:35.558 INFO:teuthology.orchestra.run.smithi044.stdout:created 2024-04-25T22:00:52.024472+0000 2024-04-25T22:01:35.558 INFO:teuthology.orchestra.run.smithi044.stdout:modified 2024-04-25T22:01:15.618998+0000 2024-04-25T22:01:35.558 INFO:teuthology.orchestra.run.smithi044.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-25T22:01:35.558 INFO:teuthology.orchestra.run.smithi044.stdout:crush_version 4 2024-04-25T22:01:35.558 INFO:teuthology.orchestra.run.smithi044.stdout:full_ratio 0.95 2024-04-25T22:01:35.558 INFO:teuthology.orchestra.run.smithi044.stdout:backfillfull_ratio 0.9 2024-04-25T22:01:35.558 INFO:teuthology.orchestra.run.smithi044.stdout:nearfull_ratio 0.85 2024-04-25T22:01:35.558 INFO:teuthology.orchestra.run.smithi044.stdout:require_min_compat_client luminous 2024-04-25T22:01:35.558 INFO:teuthology.orchestra.run.smithi044.stdout:min_compat_client jewel 2024-04-25T22:01:35.558 INFO:teuthology.orchestra.run.smithi044.stdout:require_osd_release squid 2024-04-25T22:01:35.558 INFO:teuthology.orchestra.run.smithi044.stdout:stretch_mode_enabled false 2024-04-25T22:01:35.558 INFO:teuthology.orchestra.run.smithi044.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-25T22:01:35.558 INFO:teuthology.orchestra.run.smithi044.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-25T22:01:35.559 INFO:teuthology.orchestra.run.smithi044.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-25T22:01:35.559 INFO:teuthology.orchestra.run.smithi044.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-25T22:01:35.559 INFO:teuthology.orchestra.run.smithi044.stdout:max_osd 3 2024-04-25T22:01:35.559 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6800/2385981072,v1:172.21.15.57:6801/2385981072] [v2:172.21.15.57:6802/2385981072,v1:172.21.15.57:6803/2385981072] exists,up 098ec92c-0fd2-4231-8beb-09fccca634d9 2024-04-25T22:01:35.559 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6800/29975895,v1:172.21.15.79:6801/29975895] [v2:172.21.15.79:6802/29975895,v1:172.21.15.79:6803/29975895] exists,up a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef 2024-04-25T22:01:35.559 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6800/3918111900,v1:172.21.15.81:6801/3918111900] [v2:172.21.15.81:6802/3918111900,v1:172.21.15.81:6803/3918111900] exists,up 290ee5c1-81af-400c-b15a-f63c4794a3b0 2024-04-25T22:01:35.577 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6800/2385981072,v1:172.21.15.57:6801/2385981072] [v2:172.21.15.57:6802/2385981072,v1:172.21.15.57:6803/2385981072] exists,up 098ec92c-0fd2-4231-8beb-09fccca634d9', 'osd.1 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6800/29975895,v1:172.21.15.79:6801/29975895] [v2:172.21.15.79:6802/29975895,v1:172.21.15.79:6803/29975895] exists,up a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef', 'osd.2 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6800/3918111900,v1:172.21.15.81:6801/3918111900] [v2:172.21.15.81:6802/3918111900,v1:172.21.15.81:6803/3918111900] exists,up 290ee5c1-81af-400c-b15a-f63c4794a3b0'] 2024-04-25T22:01:35.577 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-25T22:01:35.700 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-25T22:01:35.700 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mon.a", 2024-04-25T22:01:35.700 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster": "ceph", 2024-04-25T22:01:35.700 INFO:teuthology.orchestra.run.smithi044.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-25T22:01:35.700 INFO:teuthology.orchestra.run.smithi044.stdout: "admin_socket_mode": "", 2024-04-25T22:01:35.700 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-25T22:01:35.700 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_client_required": "cephx, none", 2024-04-25T22:01:35.700 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_cluster_required": "cephx", 2024-04-25T22:01:35.701 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_debug": "true", 2024-04-25T22:01:35.701 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-25T22:01:35.701 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-25T22:01:35.701 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_service_required": "cephx", 2024-04-25T22:01:35.701 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-25T22:01:35.701 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_supported": "cephx", 2024-04-25T22:01:35.701 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_aio": "true", 2024-04-25T22:01:35.701 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-25T22:01:35.701 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_aio_poll_ms": "250", 2024-04-25T22:01:35.701 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_aio_reap_max": "16", 2024-04-25T22:01:35.701 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_async_discard": "false", 2024-04-25T22:01:35.701 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_block_size": "4096", 2024-04-25T22:01:35.701 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_debug_aio": "false", 2024-04-25T22:01:35.701 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-25T22:01:35.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-25T22:01:35.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_debug_inflight_ios": "false", 2024-04-25T22:01:35.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_enable_discard": "false", 2024-04-25T22:01:35.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_flock_retry": "3", 2024-04-25T22:01:35.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-25T22:01:35.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_inject_crash": "0", 2024-04-25T22:01:35.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-25T22:01:35.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_ioring": "false", 2024-04-25T22:01:35.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_ioring_hipri": "false", 2024-04-25T22:01:35.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-25T22:01:35.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-25T22:01:35.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-25T22:01:35.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-25T22:01:35.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bdev_type": "", 2024-04-25T22:01:35.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_alloc_size": "1048576", 2024-04-25T22:01:35.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_allocator": "hybrid", 2024-04-25T22:01:35.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_buffered_io": "true", 2024-04-25T22:01:35.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_check_for_zeros": "false", 2024-04-25T22:01:35.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-25T22:01:35.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-25T22:01:35.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_compact_log_sync": "false", 2024-04-25T22:01:35.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-25T22:01:35.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-25T22:01:35.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-25T22:01:35.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-25T22:01:35.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_max_log_runway": "4194304", 2024-04-25T22:01:35.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_max_prefetch": "1048576", 2024-04-25T22:01:35.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_min_flush_size": "524288", 2024-04-25T22:01:35.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_min_log_runway": "1048576", 2024-04-25T22:01:35.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_replay_recovery": "false", 2024-04-25T22:01:35.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-25T22:01:35.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-25T22:01:35.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_sync_write": "false", 2024-04-25T22:01:35.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-25T22:01:35.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-25T22:01:35.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-25T22:01:35.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_allocation_from_file": "true", 2024-04-25T22:01:35.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_allocator": "hybrid", 2024-04-25T22:01:35.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-25T22:01:35.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-25T22:01:35.705 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-25T22:01:35.705 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-25T22:01:35.705 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-25T22:01:35.705 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-25T22:01:35.705 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-25T22:01:35.705 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_create": "true", 2024-04-25T22:01:35.705 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_db_create": "false", 2024-04-25T22:01:35.705 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_db_path": "", 2024-04-25T22:01:35.705 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_db_size": "0", 2024-04-25T22:01:35.705 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_path": "", 2024-04-25T22:01:35.705 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_preallocate_file": "false", 2024-04-25T22:01:35.705 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_size": "107374182400", 2024-04-25T22:01:35.706 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_wal_create": "false", 2024-04-25T22:01:35.706 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_wal_path": "", 2024-04-25T22:01:35.706 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_block_wal_size": "100663296", 2024-04-25T22:01:35.706 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_bluefs": "true", 2024-04-25T22:01:35.706 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-25T22:01:35.706 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-25T22:01:35.706 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-25T22:01:35.706 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-25T22:01:35.706 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-25T22:01:35.706 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-25T22:01:35.706 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-25T22:01:35.707 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-25T22:01:35.707 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_autotune": "true", 2024-04-25T22:01:35.707 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-25T22:01:35.707 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-25T22:01:35.707 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-25T22:01:35.707 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-25T22:01:35.707 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_size": "0", 2024-04-25T22:01:35.707 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-25T22:01:35.707 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-25T22:01:35.707 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-25T22:01:35.707 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-25T22:01:35.707 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_type": "2q", 2024-04-25T22:01:35.707 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-25T22:01:35.707 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_clone_cow": "true", 2024-04-25T22:01:35.708 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-25T22:01:35.708 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-25T22:01:35.708 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-25T22:01:35.708 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-25T22:01:35.708 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-25T22:01:35.708 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-25T22:01:35.708 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-25T22:01:35.708 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_compression_mode": "none", 2024-04-25T22:01:35.708 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-25T22:01:35.708 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_csum_type": "crc32c", 2024-04-25T22:01:35.708 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-25T22:01:35.708 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_freelist": "false", 2024-04-25T22:01:35.708 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-25T22:01:35.708 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-25T22:01:35.709 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-25T22:01:35.709 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-25T22:01:35.709 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-25T22:01:35.709 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-25T22:01:35.709 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-25T22:01:35.709 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-25T22:01:35.709 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-25T22:01:35.709 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-25T22:01:35.709 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-25T22:01:35.709 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-25T22:01:35.709 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-25T22:01:35.709 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_small_allocations": "0", 2024-04-25T22:01:35.709 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-25T22:01:35.709 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_default_buffered_read": "true", 2024-04-25T22:01:35.710 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_default_buffered_write": "false", 2024-04-25T22:01:35.710 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-25T22:01:35.710 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-25T22:01:35.710 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-25T22:01:35.710 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_elastic_shared_blobs": "true", 2024-04-25T22:01:35.710 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-25T22:01:35.710 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-25T22:01:35.710 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-25T22:01:35.710 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-25T22:01:35.710 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-25T22:01:35.710 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fail_eio": "false", 2024-04-25T22:01:35.710 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-25T22:01:35.710 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-25T22:01:35.711 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-25T22:01:35.711 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-25T22:01:35.711 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-25T22:01:35.711 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-25T22:01:35.711 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_on_mount": "false", 2024-04-25T22:01:35.711 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-25T22:01:35.711 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_on_umount": "false", 2024-04-25T22:01:35.711 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-25T22:01:35.711 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-25T22:01:35.711 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-25T22:01:35.711 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-25T22:01:35.711 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-25T22:01:35.711 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-25T22:01:35.711 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-25T22:01:35.712 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-25T22:01:35.712 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_ignore_data_csum": "false", 2024-04-25T22:01:35.712 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-25T22:01:35.712 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-25T22:01:35.712 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-25T22:01:35.712 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-25T22:01:35.712 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_log_op_age": "5.000000", 2024-04-25T22:01:35.712 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_max_alloc_size": "0", 2024-04-25T22:01:35.712 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_max_blob_size": "0", 2024-04-25T22:01:35.712 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-25T22:01:35.712 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-25T22:01:35.712 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-25T22:01:35.712 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_max_deferred_txc": "32", 2024-04-25T22:01:35.712 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_min_alloc_size": "0", 2024-04-25T22:01:35.713 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-25T22:01:35.713 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-25T22:01:35.713 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_nid_prealloc": "1024", 2024-04-25T22:01:35.713 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-25T22:01:35.713 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-25T22:01:35.713 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-25T22:01:35.713 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-25T22:01:35.713 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_retry_disk_reads": "3", 2024-04-25T22:01:35.713 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_rocksdb_cf": "true", 2024-04-25T22:01:35.713 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-25T22:01:35.713 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-25T22:01:35.713 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-25T22:01:35.713 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-25T22:01:35.713 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-25T22:01:35.714 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-25T22:01:35.714 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_spdk_mem": "512", 2024-04-25T22:01:35.714 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-25T22:01:35.714 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-25T22:01:35.714 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-25T22:01:35.714 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-25T22:01:35.714 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-25T22:01:35.714 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-25T22:01:35.714 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-25T22:01:35.714 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_tracing": "false", 2024-04-25T22:01:35.714 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-25T22:01:35.714 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-25T22:01:35.714 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-25T22:01:35.715 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-25T22:01:35.715 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-25T22:01:35.715 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-25T22:01:35.715 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-25T22:01:35.715 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-25T22:01:35.715 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-25T22:01:35.715 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_zero_block_detection": "false", 2024-04-25T22:01:35.715 INFO:teuthology.orchestra.run.smithi044.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-25T22:01:35.715 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-25T22:01:35.715 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-25T22:01:35.715 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-25T22:01:35.715 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-25T22:01:35.715 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-25T22:01:35.716 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-25T22:01:35.716 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-25T22:01:35.716 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-25T22:01:35.716 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-25T22:01:35.716 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-25T22:01:35.716 INFO:teuthology.orchestra.run.smithi044.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-25T22:01:35.716 INFO:teuthology.orchestra.run.smithi044.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-25T22:01:35.716 INFO:teuthology.orchestra.run.smithi044.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-25T22:01:35.716 INFO:teuthology.orchestra.run.smithi044.stdout: "cephx_cluster_require_signatures": "false", 2024-04-25T22:01:35.716 INFO:teuthology.orchestra.run.smithi044.stdout: "cephx_cluster_require_version": "2", 2024-04-25T22:01:35.716 INFO:teuthology.orchestra.run.smithi044.stdout: "cephx_require_signatures": "false", 2024-04-25T22:01:35.716 INFO:teuthology.orchestra.run.smithi044.stdout: "cephx_require_version": "2", 2024-04-25T22:01:35.716 INFO:teuthology.orchestra.run.smithi044.stdout: "cephx_service_require_signatures": "false", 2024-04-25T22:01:35.716 INFO:teuthology.orchestra.run.smithi044.stdout: "cephx_service_require_version": "2", 2024-04-25T22:01:35.716 INFO:teuthology.orchestra.run.smithi044.stdout: "cephx_sign_messages": "true", 2024-04-25T22:01:35.717 INFO:teuthology.orchestra.run.smithi044.stdout: "chdir": "", 2024-04-25T22:01:35.717 INFO:teuthology.orchestra.run.smithi044.stdout: "client_acl_type": "", 2024-04-25T22:01:35.717 INFO:teuthology.orchestra.run.smithi044.stdout: "client_asio_thread_count": "2", 2024-04-25T22:01:35.717 INFO:teuthology.orchestra.run.smithi044.stdout: "client_cache_mid": "0.750000", 2024-04-25T22:01:35.717 INFO:teuthology.orchestra.run.smithi044.stdout: "client_cache_size": "16384", 2024-04-25T22:01:35.717 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps_release_delay": "5", 2024-04-25T22:01:35.717 INFO:teuthology.orchestra.run.smithi044.stdout: "client_check_pool_perm": "true", 2024-04-25T22:01:35.717 INFO:teuthology.orchestra.run.smithi044.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-25T22:01:35.717 INFO:teuthology.orchestra.run.smithi044.stdout: "client_debug_force_sync_read": "false", 2024-04-25T22:01:35.717 INFO:teuthology.orchestra.run.smithi044.stdout: "client_debug_getattr_caps": "false", 2024-04-25T22:01:35.717 INFO:teuthology.orchestra.run.smithi044.stdout: "client_debug_inject_tick_delay": "0", 2024-04-25T22:01:35.717 INFO:teuthology.orchestra.run.smithi044.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-25T22:01:35.717 INFO:teuthology.orchestra.run.smithi044.stdout: "client_die_on_failed_remount": "false", 2024-04-25T22:01:35.717 INFO:teuthology.orchestra.run.smithi044.stdout: "client_dirsize_rbytes": "true", 2024-04-25T22:01:35.718 INFO:teuthology.orchestra.run.smithi044.stdout: "client_force_lazyio": "false", 2024-04-25T22:01:35.718 INFO:teuthology.orchestra.run.smithi044.stdout: "client_fs": "", 2024-04-25T22:01:35.718 INFO:teuthology.orchestra.run.smithi044.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-25T22:01:35.718 INFO:teuthology.orchestra.run.smithi044.stdout: "client_inject_release_failure": "false", 2024-04-25T22:01:35.718 INFO:teuthology.orchestra.run.smithi044.stdout: "client_max_inline_size": "4096", 2024-04-25T22:01:35.718 INFO:teuthology.orchestra.run.smithi044.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-25T22:01:35.718 INFO:teuthology.orchestra.run.smithi044.stdout: "client_mds_namespace": "", 2024-04-25T22:01:35.718 INFO:teuthology.orchestra.run.smithi044.stdout: "client_metadata": "", 2024-04-25T22:01:35.718 INFO:teuthology.orchestra.run.smithi044.stdout: "client_mount_gid": "-1", 2024-04-25T22:01:35.718 INFO:teuthology.orchestra.run.smithi044.stdout: "client_mount_timeout": "300", 2024-04-25T22:01:35.718 INFO:teuthology.orchestra.run.smithi044.stdout: "client_mount_uid": "-1", 2024-04-25T22:01:35.718 INFO:teuthology.orchestra.run.smithi044.stdout: "client_mountpoint": "/", 2024-04-25T22:01:35.718 INFO:teuthology.orchestra.run.smithi044.stdout: "client_notify_timeout": "10", 2024-04-25T22:01:35.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client_oc": "true", 2024-04-25T22:01:35.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client_oc_max_dirty": "104857600", 2024-04-25T22:01:35.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-25T22:01:35.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client_oc_max_objects": "1000", 2024-04-25T22:01:35.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client_oc_size": "209715200", 2024-04-25T22:01:35.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client_oc_target_dirty": "8388608", 2024-04-25T22:01:35.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client_permissions": "true", 2024-04-25T22:01:35.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client_quota": "true", 2024-04-25T22:01:35.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client_quota_df": "true", 2024-04-25T22:01:35.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client_readahead_max_bytes": "0", 2024-04-25T22:01:35.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client_readahead_max_periods": "4", 2024-04-25T22:01:35.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client_readahead_min": "131072", 2024-04-25T22:01:35.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client_reconnect_stale": "false", 2024-04-25T22:01:35.719 INFO:teuthology.orchestra.run.smithi044.stdout: "client_shutdown_timeout": "30", 2024-04-25T22:01:35.720 INFO:teuthology.orchestra.run.smithi044.stdout: "client_snapdir": ".snap", 2024-04-25T22:01:35.720 INFO:teuthology.orchestra.run.smithi044.stdout: "client_tick_interval": "1", 2024-04-25T22:01:35.720 INFO:teuthology.orchestra.run.smithi044.stdout: "client_trace": "", 2024-04-25T22:01:35.720 INFO:teuthology.orchestra.run.smithi044.stdout: "client_try_dentry_invalidate": "false", 2024-04-25T22:01:35.720 INFO:teuthology.orchestra.run.smithi044.stdout: "client_use_faked_inos": "false", 2024-04-25T22:01:35.720 INFO:teuthology.orchestra.run.smithi044.stdout: "client_use_random_mds": "false", 2024-04-25T22:01:35.720 INFO:teuthology.orchestra.run.smithi044.stdout: "clog_to_graylog": "false", 2024-04-25T22:01:35.720 INFO:teuthology.orchestra.run.smithi044.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-25T22:01:35.720 INFO:teuthology.orchestra.run.smithi044.stdout: "clog_to_graylog_port": "12201", 2024-04-25T22:01:35.720 INFO:teuthology.orchestra.run.smithi044.stdout: "clog_to_monitors": "default=true", 2024-04-25T22:01:35.720 INFO:teuthology.orchestra.run.smithi044.stdout: "clog_to_syslog": "false", 2024-04-25T22:01:35.720 INFO:teuthology.orchestra.run.smithi044.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-25T22:01:35.720 INFO:teuthology.orchestra.run.smithi044.stdout: "clog_to_syslog_level": "info", 2024-04-25T22:01:35.721 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addr": "-", 2024-04-25T22:01:35.721 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_network": "", 2024-04-25T22:01:35.721 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_network_interface": "", 2024-04-25T22:01:35.721 INFO:teuthology.orchestra.run.smithi044.stdout: "compressor_zlib_isal": "false", 2024-04-25T22:01:35.721 INFO:teuthology.orchestra.run.smithi044.stdout: "compressor_zlib_level": "5", 2024-04-25T22:01:35.721 INFO:teuthology.orchestra.run.smithi044.stdout: "compressor_zlib_winsize": "-15", 2024-04-25T22:01:35.721 INFO:teuthology.orchestra.run.smithi044.stdout: "compressor_zstd_level": "1", 2024-04-25T22:01:35.721 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-25T22:01:35.721 INFO:teuthology.orchestra.run.smithi044.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-25T22:01:35.721 INFO:teuthology.orchestra.run.smithi044.stdout: "crimson_alien_op_num_threads": "6", 2024-04-25T22:01:35.721 INFO:teuthology.orchestra.run.smithi044.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-25T22:01:35.721 INFO:teuthology.orchestra.run.smithi044.stdout: "crimson_osd_obc_lru_size": "512", 2024-04-25T22:01:35.721 INFO:teuthology.orchestra.run.smithi044.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-25T22:01:35.721 INFO:teuthology.orchestra.run.smithi044.stdout: "crimson_seastar_cpu_cores": "", 2024-04-25T22:01:35.721 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location": "", 2024-04-25T22:01:35.722 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location_hook": "", 2024-04-25T22:01:35.722 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_location_hook_timeout": "10", 2024-04-25T22:01:35.722 INFO:teuthology.orchestra.run.smithi044.stdout: "daemonize": "false", 2024-04-25T22:01:35.722 INFO:teuthology.orchestra.run.smithi044.stdout: "daos_pool": "tank", 2024-04-25T22:01:35.722 INFO:teuthology.orchestra.run.smithi044.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-25T22:01:35.722 INFO:teuthology.orchestra.run.smithi044.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-25T22:01:35.722 INFO:teuthology.orchestra.run.smithi044.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-25T22:01:35.722 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_alienstore": "0/5", 2024-04-25T22:01:35.722 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_allow_any_pool_priority": "false", 2024-04-25T22:01:35.722 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_asok": "1/5", 2024-04-25T22:01:35.722 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_asok_assert_abort": "false", 2024-04-25T22:01:35.723 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_asserts_on_shutdown": "true", 2024-04-25T22:01:35.723 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_auth": "20/20", 2024-04-25T22:01:35.723 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_bdev": "1/3", 2024-04-25T22:01:35.723 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_bluefs": "1/5", 2024-04-25T22:01:35.723 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_bluestore": "1/5", 2024-04-25T22:01:35.723 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_buffer": "0/1", 2024-04-25T22:01:35.723 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_ceph_exporter": "1/5", 2024-04-25T22:01:35.723 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_cephfs_mirror": "0/5", 2024-04-25T22:01:35.723 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_cephsqlite": "0/5", 2024-04-25T22:01:35.723 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_client": "0/5", 2024-04-25T22:01:35.723 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_compressor": "1/5", 2024-04-25T22:01:35.723 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_context": "0/1", 2024-04-25T22:01:35.723 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_crimson_interrupt": "0/5", 2024-04-25T22:01:35.723 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_crush": "1/1", 2024-04-25T22:01:35.724 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_crypto": "1/5", 2024-04-25T22:01:35.724 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_cyanstore": "0/5", 2024-04-25T22:01:35.724 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_deliberately_leak_memory": "false", 2024-04-25T22:01:35.724 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_disable_randomized_ping": "false", 2024-04-25T22:01:35.724 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_dpdk": "1/5", 2024-04-25T22:01:35.724 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_eventtrace": "1/5", 2024-04-25T22:01:35.724 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_filer": "0/1", 2024-04-25T22:01:35.724 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_filestore": "1/3", 2024-04-25T22:01:35.724 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_finisher": "1/1", 2024-04-25T22:01:35.724 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_fuse": "1/5", 2024-04-25T22:01:35.724 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_heartbeat_testing_span": "0", 2024-04-25T22:01:35.724 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_heartbeatmap": "1/5", 2024-04-25T22:01:35.725 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-25T22:01:35.725 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_javaclient": "1/5", 2024-04-25T22:01:35.725 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_journal": "1/3", 2024-04-25T22:01:35.725 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_journaler": "0/5", 2024-04-25T22:01:35.725 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_kstore": "1/5", 2024-04-25T22:01:35.725 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_lockdep": "0/1", 2024-04-25T22:01:35.725 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mclock": "1/5", 2024-04-25T22:01:35.725 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mds": "1/5", 2024-04-25T22:01:35.725 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mds_balancer": "1/5", 2024-04-25T22:01:35.725 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mds_locker": "1/5", 2024-04-25T22:01:35.725 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mds_log": "1/5", 2024-04-25T22:01:35.725 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mds_log_expire": "1/5", 2024-04-25T22:01:35.726 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mds_migrator": "1/5", 2024-04-25T22:01:35.726 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mds_quiesce": "3/5", 2024-04-25T22:01:35.726 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_memstore": "1/5", 2024-04-25T22:01:35.726 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mgr": "2/5", 2024-04-25T22:01:35.726 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mgrc": "1/5", 2024-04-25T22:01:35.726 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_mon": "20/20", 2024-04-25T22:01:35.726 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_monc": "0/10", 2024-04-25T22:01:35.726 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_ms": "1/1", 2024-04-25T22:01:35.726 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_none": "0/5", 2024-04-25T22:01:35.726 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_objclass": "0/5", 2024-04-25T22:01:35.726 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_objectcacher": "0/5", 2024-04-25T22:01:35.726 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_objecter": "0/1", 2024-04-25T22:01:35.726 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_optracker": "0/5", 2024-04-25T22:01:35.727 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_osd": "1/5", 2024-04-25T22:01:35.727 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_paxos": "20/20", 2024-04-25T22:01:35.727 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_perfcounter": "1/5", 2024-04-25T22:01:35.727 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_prioritycache": "1/5", 2024-04-25T22:01:35.727 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rados": "0/5", 2024-04-25T22:01:35.727 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rbd": "0/5", 2024-04-25T22:01:35.727 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rbd_mirror": "0/5", 2024-04-25T22:01:35.727 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rbd_pwl": "0/5", 2024-04-25T22:01:35.727 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rbd_replay": "0/5", 2024-04-25T22:01:35.727 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_refs": "0/0", 2024-04-25T22:01:35.727 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_reserver": "1/1", 2024-04-25T22:01:35.727 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rgw": "1/5", 2024-04-25T22:01:35.727 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rgw_access": "1/5", 2024-04-25T22:01:35.728 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rgw_datacache": "1/5", 2024-04-25T22:01:35.728 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rgw_dbstore": "1/5", 2024-04-25T22:01:35.728 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rgw_flight": "1/5", 2024-04-25T22:01:35.728 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rgw_lifecycle": "1/5", 2024-04-25T22:01:35.728 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rgw_sync": "1/5", 2024-04-25T22:01:35.728 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_rocksdb": "4/5", 2024-04-25T22:01:35.728 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore": "0/5", 2024-04-25T22:01:35.728 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_backref": "0/5", 2024-04-25T22:01:35.728 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_cache": "0/5", 2024-04-25T22:01:35.728 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_cleaner": "0/5", 2024-04-25T22:01:35.728 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_device": "0/5", 2024-04-25T22:01:35.728 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_epm": "0/5", 2024-04-25T22:01:35.728 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-25T22:01:35.728 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_journal": "0/5", 2024-04-25T22:01:35.728 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_lba": "0/5", 2024-04-25T22:01:35.729 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_odata": "0/5", 2024-04-25T22:01:35.729 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_omap": "0/5", 2024-04-25T22:01:35.729 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_onode": "0/5", 2024-04-25T22:01:35.729 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_t": "0/5", 2024-04-25T22:01:35.729 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_seastore_tm": "0/5", 2024-04-25T22:01:35.729 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_striper": "0/1", 2024-04-25T22:01:35.729 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_test": "0/5", 2024-04-25T22:01:35.729 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_throttle": "1/1", 2024-04-25T22:01:35.729 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_timer": "0/1", 2024-04-25T22:01:35.729 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_tp": "0/5", 2024-04-25T22:01:35.729 INFO:teuthology.orchestra.run.smithi044.stdout: "debug_trace": "1/5", 2024-04-25T22:01:35.730 INFO:teuthology.orchestra.run.smithi044.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-25T22:01:35.730 INFO:teuthology.orchestra.run.smithi044.stdout: "device_failure_prediction_mode": "none", 2024-04-25T22:01:35.730 INFO:teuthology.orchestra.run.smithi044.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-25T22:01:35.730 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-25T22:01:35.730 INFO:teuthology.orchestra.run.smithi044.stdout: "err_to_graylog": "false", 2024-04-25T22:01:35.730 INFO:teuthology.orchestra.run.smithi044.stdout: "err_to_journald": "false", 2024-04-25T22:01:35.730 INFO:teuthology.orchestra.run.smithi044.stdout: "err_to_stderr": "true", 2024-04-25T22:01:35.730 INFO:teuthology.orchestra.run.smithi044.stdout: "err_to_syslog": "false", 2024-04-25T22:01:35.730 INFO:teuthology.orchestra.run.smithi044.stdout: "event_tracing": "false", 2024-04-25T22:01:35.730 INFO:teuthology.orchestra.run.smithi044.stdout: "exporter_addr": "0.0.0.0", 2024-04-25T22:01:35.731 INFO:teuthology.orchestra.run.smithi044.stdout: "exporter_http_port": "9926", 2024-04-25T22:01:35.731 INFO:teuthology.orchestra.run.smithi044.stdout: "exporter_prio_limit": "5", 2024-04-25T22:01:35.731 INFO:teuthology.orchestra.run.smithi044.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-25T22:01:35.731 INFO:teuthology.orchestra.run.smithi044.stdout: "exporter_sort_metrics": "true", 2024-04-25T22:01:35.731 INFO:teuthology.orchestra.run.smithi044.stdout: "exporter_stats_period": "5", 2024-04-25T22:01:35.731 INFO:teuthology.orchestra.run.smithi044.stdout: "fake_statfs_for_testing": "0", 2024-04-25T22:01:35.731 INFO:teuthology.orchestra.run.smithi044.stdout: "fatal_signal_handlers": "true", 2024-04-25T22:01:35.731 INFO:teuthology.orchestra.run.smithi044.stdout: "filer_max_purge_ops": "10", 2024-04-25T22:01:35.731 INFO:teuthology.orchestra.run.smithi044.stdout: "filer_max_truncate_ops": "128", 2024-04-25T22:01:35.731 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_apply_finisher_threads": "1", 2024-04-25T22:01:35.731 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_blackhole": "false", 2024-04-25T22:01:35.731 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_btrfs_clone_range": "true", 2024-04-25T22:01:35.731 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_btrfs_snap": "true", 2024-04-25T22:01:35.732 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_caller_concurrency": "10", 2024-04-25T22:01:35.732 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_collect_device_partition_information": "true", 2024-04-25T22:01:35.732 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_commit_timeout": "600.000000", 2024-04-25T22:01:35.732 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_debug_inject_read_err": "false", 2024-04-25T22:01:35.732 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_debug_omap_check": "false", 2024-04-25T22:01:35.732 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-25T22:01:35.732 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_debug_verify_split": "false", 2024-04-25T22:01:35.732 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_dump_file": "", 2024-04-25T22:01:35.732 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-25T22:01:35.732 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-25T22:01:35.732 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_fadvise": "true", 2024-04-25T22:01:35.732 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_fail_eio": "true", 2024-04-25T22:01:35.732 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_fd_cache_shards": "16", 2024-04-25T22:01:35.732 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_fd_cache_size": "128", 2024-04-25T22:01:35.733 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_fiemap": "false", 2024-04-25T22:01:35.733 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_fiemap_threshold": "4096", 2024-04-25T22:01:35.733 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-25T22:01:35.733 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-25T22:01:35.733 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_inject_stall": "0", 2024-04-25T22:01:35.733 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_journal_parallel": "false", 2024-04-25T22:01:35.733 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_journal_trailing": "false", 2024-04-25T22:01:35.733 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_journal_writeahead": "false", 2024-04-25T22:01:35.733 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_kill_at": "0", 2024-04-25T22:01:35.733 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-25T22:01:35.733 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-25T22:01:35.733 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-25T22:01:35.733 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-25T22:01:35.733 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-25T22:01:35.734 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_inline_xattrs": "0", 2024-04-25T22:01:35.734 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-25T22:01:35.734 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-25T22:01:35.734 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-25T22:01:35.734 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-25T22:01:35.734 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_xattr_value_size": "0", 2024-04-25T22:01:35.734 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-25T22:01:35.734 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-25T22:01:35.734 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-25T22:01:35.734 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_merge_threshold": "-10", 2024-04-25T22:01:35.734 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-25T22:01:35.734 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_odsync_write": "false", 2024-04-25T22:01:35.734 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_omap_backend": "rocksdb", 2024-04-25T22:01:35.735 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_omap_backend_path": "", 2024-04-25T22:01:35.735 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-25T22:01:35.735 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-25T22:01:35.735 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-25T22:01:35.735 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_op_thread_timeout": "60", 2024-04-25T22:01:35.735 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_op_threads": "2", 2024-04-25T22:01:35.735 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_punch_hole": "false", 2024-04-25T22:01:35.735 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-25T22:01:35.735 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-25T22:01:35.735 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-25T22:01:35.735 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-25T22:01:35.735 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-25T22:01:35.735 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-25T22:01:35.735 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-25T22:01:35.736 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-25T22:01:35.736 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-25T22:01:35.736 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_queue_max_ops": "50", 2024-04-25T22:01:35.736 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-25T22:01:35.736 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_seek_data_hole": "false", 2024-04-25T22:01:35.736 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_sloppy_crc": "false", 2024-04-25T22:01:35.736 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-25T22:01:35.736 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_splice": "false", 2024-04-25T22:01:35.736 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_split_multiple": "2", 2024-04-25T22:01:35.736 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_split_rand_factor": "20", 2024-04-25T22:01:35.736 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_update_to": "1000", 2024-04-25T22:01:35.736 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-25T22:01:35.736 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-25T22:01:35.736 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-25T22:01:35.736 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-25T22:01:35.737 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-25T22:01:35.737 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-25T22:01:35.737 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_enable": "true", 2024-04-25T22:01:35.737 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-25T22:01:35.737 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-25T22:01:35.737 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-25T22:01:35.737 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-25T22:01:35.737 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-25T22:01:35.737 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-25T22:01:35.737 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_xfs_extsize": "false", 2024-04-25T22:01:35.737 INFO:teuthology.orchestra.run.smithi044.stdout: "filestore_zfs_snap": "false", 2024-04-25T22:01:35.737 INFO:teuthology.orchestra.run.smithi044.stdout: "fio_dir": "/tmp/fio", 2024-04-25T22:01:35.737 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "1ced109c-704f-44b1-9811-a2da74898889", 2024-04-25T22:01:35.737 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_allow_other": "true", 2024-04-25T22:01:35.738 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_atomic_o_trunc": "true", 2024-04-25T22:01:35.738 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_big_writes": "true", 2024-04-25T22:01:35.738 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_debug": "false", 2024-04-25T22:01:35.738 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_default_permissions": "false", 2024-04-25T22:01:35.738 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_disable_pagecache": "false", 2024-04-25T22:01:35.738 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_max_write": "0", 2024-04-25T22:01:35.738 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_multithreaded": "true", 2024-04-25T22:01:35.738 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_require_active_mds": "true", 2024-04-25T22:01:35.738 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_set_user_groups": "true", 2024-04-25T22:01:35.738 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_splice_move": "true", 2024-04-25T22:01:35.738 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_splice_read": "true", 2024-04-25T22:01:35.738 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_splice_write": "true", 2024-04-25T22:01:35.738 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-25T22:01:35.739 INFO:teuthology.orchestra.run.smithi044.stdout: "fuse_use_invalidate_cb": "true", 2024-04-25T22:01:35.739 INFO:teuthology.orchestra.run.smithi044.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-25T22:01:35.739 INFO:teuthology.orchestra.run.smithi044.stdout: "gss_target_name": "ceph", 2024-04-25T22:01:35.739 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_file": "", 2024-04-25T22:01:35.739 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_inject_failure": "0", 2024-04-25T22:01:35.739 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_interval": "5", 2024-04-25T22:01:35.739 INFO:teuthology.orchestra.run.smithi044.stdout: "host": "smithi044", 2024-04-25T22:01:35.739 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-25T22:01:35.739 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-25T22:01:35.739 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-25T22:01:35.740 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-25T22:01:35.740 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-25T22:01:35.740 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-25T22:01:35.740 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-25T22:01:35.740 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-25T22:01:35.740 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-25T22:01:35.740 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-25T22:01:35.740 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-25T22:01:35.740 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-25T22:01:35.740 INFO:teuthology.orchestra.run.smithi044.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-25T22:01:35.741 INFO:teuthology.orchestra.run.smithi044.stdout: "inject_early_sigterm": "false", 2024-04-25T22:01:35.741 INFO:teuthology.orchestra.run.smithi044.stdout: "jaeger_agent_port": "6799", 2024-04-25T22:01:35.741 INFO:teuthology.orchestra.run.smithi044.stdout: "jaeger_tracing_enable": "false", 2024-04-25T22:01:35.741 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_aio": "true", 2024-04-25T22:01:35.741 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_align_min_size": "65536", 2024-04-25T22:01:35.741 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_block_align": "true", 2024-04-25T22:01:35.741 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_block_size": "4096", 2024-04-25T22:01:35.741 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_dio": "true", 2024-04-25T22:01:35.741 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_discard": "false", 2024-04-25T22:01:35.741 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_force_aio": "false", 2024-04-25T22:01:35.741 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_ignore_corruption": "false", 2024-04-25T22:01:35.741 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_max_write_bytes": "10485760", 2024-04-25T22:01:35.741 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_max_write_entries": "100", 2024-04-25T22:01:35.742 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_replay_from": "0", 2024-04-25T22:01:35.742 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-25T22:01:35.742 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-25T22:01:35.742 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-25T22:01:35.742 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-25T22:01:35.742 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_write_header_frequency": "0", 2024-04-25T22:01:35.742 INFO:teuthology.orchestra.run.smithi044.stdout: "journal_zero_on_create": "false", 2024-04-25T22:01:35.742 INFO:teuthology.orchestra.run.smithi044.stdout: "journaler_prefetch_periods": "10", 2024-04-25T22:01:35.742 INFO:teuthology.orchestra.run.smithi044.stdout: "journaler_prezero_periods": "5", 2024-04-25T22:01:35.742 INFO:teuthology.orchestra.run.smithi044.stdout: "journaler_write_head_interval": "15", 2024-04-25T22:01:35.742 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "", 2024-04-25T22:01:35.743 INFO:teuthology.orchestra.run.smithi044.stdout: "keyfile": "", 2024-04-25T22:01:35.743 INFO:teuthology.orchestra.run.smithi044.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-25T22:01:35.743 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_backend": "rocksdb", 2024-04-25T22:01:35.743 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_default_stripe_size": "65536", 2024-04-25T22:01:35.743 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_fsck_on_mount": "false", 2024-04-25T22:01:35.743 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-25T22:01:35.743 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_max_bytes": "67108864", 2024-04-25T22:01:35.743 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_max_ops": "512", 2024-04-25T22:01:35.743 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_nid_prealloc": "1024", 2024-04-25T22:01:35.743 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_onode_map_size": "1024", 2024-04-25T22:01:35.743 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-25T22:01:35.743 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_sync_submit_transaction": "false", 2024-04-25T22:01:35.743 INFO:teuthology.orchestra.run.smithi044.stdout: "kstore_sync_transaction": "false", 2024-04-25T22:01:35.744 INFO:teuthology.orchestra.run.smithi044.stdout: "librados_thread_count": "2", 2024-04-25T22:01:35.744 INFO:teuthology.orchestra.run.smithi044.stdout: "lockdep": "false", 2024-04-25T22:01:35.744 INFO:teuthology.orchestra.run.smithi044.stdout: "lockdep_force_backtrace": "false", 2024-04-25T22:01:35.744 INFO:teuthology.orchestra.run.smithi044.stdout: "log_coarse_timestamps": "true", 2024-04-25T22:01:35.744 INFO:teuthology.orchestra.run.smithi044.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-25T22:01:35.744 INFO:teuthology.orchestra.run.smithi044.stdout: "log_flush_on_exit": "false", 2024-04-25T22:01:35.744 INFO:teuthology.orchestra.run.smithi044.stdout: "log_graylog_host": "127.0.0.1", 2024-04-25T22:01:35.744 INFO:teuthology.orchestra.run.smithi044.stdout: "log_graylog_port": "12201", 2024-04-25T22:01:35.744 INFO:teuthology.orchestra.run.smithi044.stdout: "log_max_new": "1000", 2024-04-25T22:01:35.744 INFO:teuthology.orchestra.run.smithi044.stdout: "log_max_recent": "10000", 2024-04-25T22:01:35.744 INFO:teuthology.orchestra.run.smithi044.stdout: "log_stderr_prefix": "", 2024-04-25T22:01:35.744 INFO:teuthology.orchestra.run.smithi044.stdout: "log_stop_at_utilization": "0.970000", 2024-04-25T22:01:35.745 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": "true", 2024-04-25T22:01:35.745 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_graylog": "false", 2024-04-25T22:01:35.745 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_journald": "false", 2024-04-25T22:01:35.745 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_stderr": "false", 2024-04-25T22:01:35.745 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_syslog": "false", 2024-04-25T22:01:35.745 INFO:teuthology.orchestra.run.smithi044.stdout: "max_rotating_auth_attempts": "10", 2024-04-25T22:01:35.745 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-25T22:01:35.745 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_action_on_write_error": "1", 2024-04-25T22:01:35.746 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_alternate_name_max": "8192", 2024-04-25T22:01:35.746 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_asio_thread_count": "2", 2024-04-25T22:01:35.746 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_export_pin": "true", 2024-04-25T22:01:35.746 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_fragment_dirs": "true", 2024-04-25T22:01:35.746 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-25T22:01:35.746 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_fragment_interval": "5", 2024-04-25T22:01:35.746 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-25T22:01:35.747 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-25T22:01:35.747 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_interval": "10", 2024-04-25T22:01:35.747 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_max": "-1", 2024-04-25T22:01:35.747 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_max_until": "-1", 2024-04-25T22:01:35.747 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_merge_size": "50", 2024-04-25T22:01:35.747 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_midchunk": "0.300000", 2024-04-25T22:01:35.747 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-25T22:01:35.747 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_min_start": "0.200000", 2024-04-25T22:01:35.748 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_minchunk": "0.001000", 2024-04-25T22:01:35.748 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_mode": "0", 2024-04-25T22:01:35.748 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_need_max": "1.200000", 2024-04-25T22:01:35.748 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_need_min": "0.800000", 2024-04-25T22:01:35.748 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_overload_epochs": "2", 2024-04-25T22:01:35.748 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-25T22:01:35.748 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-25T22:01:35.748 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_split_bits": "3", 2024-04-25T22:01:35.749 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-25T22:01:35.749 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_split_size": "10000", 2024-04-25T22:01:35.749 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-25T22:01:35.749 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_target_decay": "10.000000", 2024-04-25T22:01:35.749 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-25T22:01:35.749 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_beacon_grace": "15.000000", 2024-04-25T22:01:35.749 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_beacon_interval": "4.000000", 2024-04-25T22:01:35.749 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-25T22:01:35.750 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-25T22:01:35.750 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_mid": "0.700000", 2024-04-25T22:01:35.750 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-04-25T22:01:35.750 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_quiesce_delay": "0", 2024-04-25T22:01:35.750 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_quiesce_sleep": "200", 2024-04-25T22:01:35.750 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_quiesce_splitauth": "true", 2024-04-25T22:01:35.750 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_quiesce_threshold": "524288", 2024-04-25T22:01:35.751 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_release_free_interval": "10", 2024-04-25T22:01:35.751 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_reservation": "0.050000", 2024-04-25T22:01:35.751 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-25T22:01:35.751 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_trim_interval": "1", 2024-04-25T22:01:35.751 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache_trim_threshold": "262144", 2024-04-25T22:01:35.751 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-25T22:01:35.751 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-25T22:01:35.751 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-25T22:01:35.752 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_client_prealloc_inos": "1000", 2024-04-25T22:01:35.752 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-25T22:01:35.752 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_connect_bootstrapping": "false", 2024-04-25T22:01:35.752 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_damage_table_max_entries": "10000", 2024-04-25T22:01:35.752 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-25T22:01:35.752 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_debug_auth_pins": "false", 2024-04-25T22:01:35.752 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_debug_frag": "false", 2024-04-25T22:01:35.752 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_debug_scatterstat": "false", 2024-04-25T22:01:35.752 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_debug_subtrees": "false", 2024-04-25T22:01:35.752 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_decay_halflife": "5.000000", 2024-04-25T22:01:35.753 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_default_dir_hash": "2", 2024-04-25T22:01:35.753 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_defer_session_stale": "true", 2024-04-25T22:01:35.753 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_deny_all_reconnect": "false", 2024-04-25T22:01:35.753 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_dir_keys_per_op": "16384", 2024-04-25T22:01:35.753 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_dir_max_commit_size": "10", 2024-04-25T22:01:35.753 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_dir_max_entries": "0", 2024-04-25T22:01:35.753 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_dir_prefetch": "true", 2024-04-25T22:01:35.753 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-25T22:01:35.753 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-25T22:01:35.753 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_dump_cache_on_map": "false", 2024-04-25T22:01:35.753 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-25T22:01:35.753 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-25T22:01:35.753 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_early_reply": "true", 2024-04-25T22:01:35.753 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_enable_op_tracker": "true", 2024-04-25T22:01:35.753 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_enforce_unique_name": "true", 2024-04-25T22:01:35.754 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-25T22:01:35.754 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-25T22:01:35.754 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_export_ephemeral_random": "true", 2024-04-25T22:01:35.754 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-25T22:01:35.754 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-25T22:01:35.754 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-25T22:01:35.754 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-25T22:01:35.754 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-25T22:01:35.754 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-25T22:01:35.754 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-25T22:01:35.754 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-25T22:01:35.754 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_health_summarize_threshold": "10", 2024-04-25T22:01:35.754 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-25T22:01:35.755 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-25T22:01:35.755 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_inject_health_dummy": "false", 2024-04-25T22:01:35.755 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-25T22:01:35.755 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_inject_migrator_session_race": "false", 2024-04-25T22:01:35.755 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-25T22:01:35.755 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-25T22:01:35.755 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-25T22:01:35.755 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_join_fs": "", 2024-04-25T22:01:35.755 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_journal_format": "1", 2024-04-25T22:01:35.755 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_create_at": "0", 2024-04-25T22:01:35.755 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_export_at": "0", 2024-04-25T22:01:35.755 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_import_at": "0", 2024-04-25T22:01:35.756 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_journal_at": "0", 2024-04-25T22:01:35.756 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_journal_expire_at": "0", 2024-04-25T22:01:35.756 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_journal_replay_at": "0", 2024-04-25T22:01:35.756 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_link_at": "0", 2024-04-25T22:01:35.756 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_mdstable_at": "0", 2024-04-25T22:01:35.756 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_openc_at": "0", 2024-04-25T22:01:35.757 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_rename_at": "0", 2024-04-25T22:01:35.757 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_shutdown_at": "0", 2024-04-25T22:01:35.757 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-25T22:01:35.757 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_event_large_threshold": "524288", 2024-04-25T22:01:35.757 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_events_per_segment": "1024", 2024-04-25T22:01:35.757 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_major_segment_event_ratio": "12", 2024-04-25T22:01:35.758 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_max_events": "-1", 2024-04-25T22:01:35.758 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_max_segments": "128", 2024-04-25T22:01:35.758 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_pause": "false", 2024-04-25T22:01:35.758 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_segment_size": "0", 2024-04-25T22:01:35.758 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-25T22:01:35.758 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_skip_unbounded_events": "false", 2024-04-25T22:01:35.759 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-04-25T22:01:35.759 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_trim_threshold": "128", 2024-04-25T22:01:35.759 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-04-25T22:01:35.759 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log_warn_factor": "2.000000", 2024-04-25T22:01:35.759 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_caps_per_client": "1048576", 2024-04-25T22:01:35.759 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_completed_flushes": "100000", 2024-04-25T22:01:35.759 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_completed_requests": "100000", 2024-04-25T22:01:35.760 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_export_size": "20971520", 2024-04-25T22:01:35.760 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_file_recover": "32", 2024-04-25T22:01:35.760 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_purge_files": "64", 2024-04-25T22:01:35.760 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_purge_ops": "8192", 2024-04-25T22:01:35.760 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-25T22:01:35.760 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-25T22:01:35.761 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_max_snaps_per_dir": "100", 2024-04-25T22:01:35.761 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_metrics_update_interval": "2", 2024-04-25T22:01:35.761 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_min_caps_per_client": "100", 2024-04-25T22:01:35.761 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_min_caps_working_set": "10000", 2024-04-25T22:01:35.761 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-25T22:01:35.761 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_numa_node": "-1", 2024-04-25T22:01:35.762 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-25T22:01:35.762 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_op_complaint_time": "30.000000", 2024-04-25T22:01:35.762 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_op_history_duration": "600", 2024-04-25T22:01:35.762 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_op_history_size": "20", 2024-04-25T22:01:35.762 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_op_history_slow_op_size": "20", 2024-04-25T22:01:35.762 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-25T22:01:35.763 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_op_log_threshold": "5", 2024-04-25T22:01:35.763 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_ping_grace": "15", 2024-04-25T22:01:35.763 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_ping_interval": "5", 2024-04-25T22:01:35.763 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-25T22:01:35.763 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-25T22:01:35.763 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_recall_max_caps": "30000", 2024-04-25T22:01:35.764 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-25T22:01:35.764 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-25T22:01:35.764 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-25T22:01:35.764 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_recall_warning_threshold": "262144", 2024-04-25T22:01:35.764 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-25T22:01:35.764 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_replay_interval": "1.000000", 2024-04-25T22:01:35.765 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-25T22:01:35.765 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-25T22:01:35.765 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_root_ino_gid": "0", 2024-04-25T22:01:35.765 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_root_ino_uid": "0", 2024-04-25T22:01:35.765 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-25T22:01:35.765 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-25T22:01:35.766 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-25T22:01:35.766 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-25T22:01:35.766 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-25T22:01:35.766 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-25T22:01:35.766 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-25T22:01:35.766 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-25T22:01:35.766 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-25T22:01:35.766 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-25T22:01:35.767 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_shutdown_check": "0", 2024-04-25T22:01:35.767 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_skip_ino": "0", 2024-04-25T22:01:35.767 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-25T22:01:35.767 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_snap_max_uid": "4294967294", 2024-04-25T22:01:35.767 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_snap_min_uid": "0", 2024-04-25T22:01:35.767 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_snap_rstat": "false", 2024-04-25T22:01:35.767 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_standby_replay_damaged": "false", 2024-04-25T22:01:35.768 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_symlink_recovery": "true", 2024-04-25T22:01:35.768 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-25T22:01:35.768 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_thrash_exports": "0", 2024-04-25T22:01:35.768 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_thrash_fragments": "0", 2024-04-25T22:01:35.768 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_tick_interval": "5.000000", 2024-04-25T22:01:35.768 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_valgrind_exit": "false", 2024-04-25T22:01:35.768 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_verify_backtrace": "1", 2024-04-25T22:01:35.769 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_verify_scatter": "false", 2024-04-25T22:01:35.769 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-25T22:01:35.769 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_wipe_sessions": "false", 2024-04-25T22:01:35.769 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool_debug": "false", 2024-04-25T22:01:35.769 INFO:teuthology.orchestra.run.smithi044.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-25T22:01:35.769 INFO:teuthology.orchestra.run.smithi044.stdout: "memstore_device_bytes": "1073741824", 2024-04-25T22:01:35.770 INFO:teuthology.orchestra.run.smithi044.stdout: "memstore_page_set": "false", 2024-04-25T22:01:35.770 INFO:teuthology.orchestra.run.smithi044.stdout: "memstore_page_size": "65536", 2024-04-25T22:01:35.770 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_client_bytes": "134217728", 2024-04-25T22:01:35.770 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_client_messages": "512", 2024-04-25T22:01:35.770 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-25T22:01:35.771 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-25T22:01:35.771 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-25T22:01:35.771 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-25T22:01:35.771 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_disabled_modules": "", 2024-04-25T22:01:35.771 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-25T22:01:35.771 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_max_pg_num_change": "128", 2024-04-25T22:01:35.772 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_mds_bytes": "134217728", 2024-04-25T22:01:35.772 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_mds_messages": "128", 2024-04-25T22:01:35.772 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-25T22:01:35.772 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_mon_bytes": "134217728", 2024-04-25T22:01:35.772 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_mon_messages": "128", 2024-04-25T22:01:35.772 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_osd_bytes": "536870912", 2024-04-25T22:01:35.773 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_osd_messages": "8192", 2024-04-25T22:01:35.773 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_pool": "true", 2024-04-25T22:01:35.773 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-25T22:01:35.773 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_standby_modules": "true", 2024-04-25T22:01:35.773 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_stats_period": "5", 2024-04-25T22:01:35.773 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_stats_threshold": "5", 2024-04-25T22:01:35.774 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_tick_period": "2", 2024-04-25T22:01:35.774 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-25T22:01:35.774 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-25T22:01:35.774 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_allow_pool_delete": "true", 2024-04-25T22:01:35.774 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_allow_pool_size_one": "true", 2024-04-25T22:01:35.774 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_auth_validate_all_caps": "true", 2024-04-25T22:01:35.775 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-25T22:01:35.775 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-25T22:01:35.775 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_bytes": "104857600", 2024-04-25T22:01:35.775 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_directed_command_retry": "2", 2024-04-25T22:01:35.775 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-25T22:01:35.775 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-25T22:01:35.776 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-25T22:01:35.776 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-25T22:01:35.776 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_hunt_parallel": "3", 2024-04-25T22:01:35.776 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_log_interval": "1.000000", 2024-04-25T22:01:35.776 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-25T22:01:35.776 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_ping_interval": "10.000000", 2024-04-25T22:01:35.776 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-25T22:01:35.777 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_client_target_rank": "-1", 2024-04-25T22:01:35.777 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-25T22:01:35.777 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-25T22:01:35.777 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-25T22:01:35.777 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_file_level": "debug", 2024-04-25T22:01:35.777 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_to_file": "true", 2024-04-25T22:01:35.778 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-25T22:01:35.778 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-25T22:01:35.778 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-25T22:01:35.778 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_to_journald": "false", 2024-04-25T22:01:35.778 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-25T22:01:35.779 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-25T22:01:35.779 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-25T22:01:35.779 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-25T22:01:35.779 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_compact_on_bootstrap": "false", 2024-04-25T22:01:35.779 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_compact_on_start": "false", 2024-04-25T22:01:35.779 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_compact_on_trim": "true", 2024-04-25T22:01:35.779 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-25T22:01:35.779 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-25T22:01:35.780 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-25T22:01:35.780 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_cpu_threads": "4", 2024-04-25T22:01:35.780 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_crush_min_required_version": "hammer", 2024-04-25T22:01:35.780 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_daemon_bytes": "419430400", 2024-04-25T22:01:35.780 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-25T22:01:35.780 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_data_avail_crit": "5", 2024-04-25T22:01:35.780 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_data_avail_warn": "5", 2024-04-25T22:01:35.780 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_data_size_warn": "16106127360", 2024-04-25T22:01:35.781 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-25T22:01:35.781 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-25T22:01:35.781 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_dump_json": "false", 2024-04-25T22:01:35.781 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-25T22:01:35.781 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_dump_transactions": "false", 2024-04-25T22:01:35.781 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_extra_checks": "false", 2024-04-25T22:01:35.781 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-25T22:01:35.781 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-25T22:01:35.782 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_no_require_reef": "false", 2024-04-25T22:01:35.782 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_no_require_squid": "false", 2024-04-25T22:01:35.782 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-25T22:01:35.782 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-25T22:01:35.782 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-25T22:01:35.782 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_down_mkfs_grace": "120", 2024-04-25T22:01:35.783 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_down_uptime_grace": "60", 2024-04-25T22:01:35.783 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_election_default_strategy": "1", 2024-04-25T22:01:35.783 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_election_timeout": "5.000000", 2024-04-25T22:01:35.783 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-25T22:01:35.783 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_elector_ping_divisor": "2", 2024-04-25T22:01:35.783 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-25T22:01:35.783 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_enable_op_tracker": "true", 2024-04-25T22:01:35.783 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_fake_pool_delete": "false", 2024-04-25T22:01:35.783 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_force_quorum_join": "false", 2024-04-25T22:01:35.783 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_globalid_prealloc": "10000", 2024-04-25T22:01:35.783 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_health_detail_to_clog": "false", 2024-04-25T22:01:35.783 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_health_log_update_period": "5", 2024-04-25T22:01:35.783 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_health_max_detail": "50", 2024-04-25T22:01:35.783 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_health_to_clog": "true", 2024-04-25T22:01:35.932 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_health_to_clog_interval": "600", 2024-04-25T22:01:35.932 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-25T22:01:35.932 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_host": "172.21.15.44,[v2:172.21.15.44:3301,v1:172.21.15.44:6790],[v2:172.21.15.44:3302,v1:172.21.15.44:6791]", 2024-04-25T22:01:35.932 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_host_override": "", 2024-04-25T22:01:35.932 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_initial_members": "", 2024-04-25T22:01:35.932 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-25T22:01:35.932 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-25T22:01:35.932 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-25T22:01:35.932 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-25T22:01:35.932 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-25T22:01:35.932 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_lease": "5.000000", 2024-04-25T22:01:35.932 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-25T22:01:35.933 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-25T22:01:35.933 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_log_full_interval": "50", 2024-04-25T22:01:35.933 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_log_max": "10000", 2024-04-25T22:01:35.933 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_log_max_summary": "50", 2024-04-25T22:01:35.933 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-25T22:01:35.933 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_max_log_epochs": "500", 2024-04-25T22:01:35.933 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-25T22:01:35.933 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-25T22:01:35.933 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_max_osd": "10000", 2024-04-25T22:01:35.933 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_max_pg_per_osd": "10000", 2024-04-25T22:01:35.933 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_max_pool_pg_num": "65536", 2024-04-25T22:01:35.933 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-25T22:01:35.933 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-25T22:01:35.934 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_mds_force_trim_to": "0", 2024-04-25T22:01:35.934 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_mds_skip_sanity": "false", 2024-04-25T22:01:35.934 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_memory_autotune": "true", 2024-04-25T22:01:35.934 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_memory_target": "2147483648", 2024-04-25T22:01:35.934 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_mgr_beacon_grace": "30", 2024-04-25T22:01:35.934 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-25T22:01:35.934 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_mgr_digest_period": "5", 2024-04-25T22:01:35.934 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_mgr_inactive_grace": "60", 2024-04-25T22:01:35.934 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-25T22:01:35.934 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-25T22:01:35.934 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_min_osdmap_epochs": "500", 2024-04-25T22:01:35.934 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_op_complaint_time": "30", 2024-04-25T22:01:35.934 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_op_history_duration": "600", 2024-04-25T22:01:35.935 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_op_history_size": "20", 2024-04-25T22:01:35.935 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_op_history_slow_op_size": "20", 2024-04-25T22:01:35.935 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-25T22:01:35.935 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_op_log_threshold": "5", 2024-04-25T22:01:35.935 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-25T22:01:35.935 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-25T22:01:35.935 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-25T22:01:35.935 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_auto_mark_in": "false", 2024-04-25T22:01:35.935 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-25T22:01:35.935 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-25T22:01:35.935 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-25T22:01:35.935 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_cache_size": "500", 2024-04-25T22:01:35.935 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-25T22:01:35.935 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-25T22:01:35.935 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-25T22:01:35.936 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_down_out_interval": "600", 2024-04-25T22:01:35.936 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-25T22:01:35.936 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-25T22:01:35.936 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_force_trim_to": "0", 2024-04-25T22:01:35.936 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-25T22:01:35.936 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-25T22:01:35.936 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-25T22:01:35.936 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-25T22:01:35.936 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-25T22:01:35.936 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-25T22:01:35.936 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-25T22:01:35.936 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-25T22:01:35.936 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_min_down_reporters": "2", 2024-04-25T22:01:35.936 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-25T22:01:35.936 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-25T22:01:35.937 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-25T22:01:35.937 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-25T22:01:35.937 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-25T22:01:35.937 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-25T22:01:35.937 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_report_timeout": "900", 2024-04-25T22:01:35.937 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-25T22:01:35.937 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-25T22:01:35.937 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-25T22:01:35.937 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-25T22:01:35.937 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-25T22:01:35.937 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-25T22:01:35.937 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-25T22:01:35.937 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-25T22:01:35.937 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-25T22:01:35.938 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_pg_stuck_threshold": "60", 2024-04-25T22:01:35.938 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-25T22:01:35.938 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-25T22:01:35.938 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-25T22:01:35.938 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-25T22:01:35.938 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-25T22:01:35.938 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-25T22:01:35.938 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_probe_timeout": "2.000000", 2024-04-25T22:01:35.938 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_reweight_max_change": "0.050000", 2024-04-25T22:01:35.938 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_reweight_max_osds": "4", 2024-04-25T22:01:35.938 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-25T22:01:35.938 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-25T22:01:35.939 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-25T22:01:35.939 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-25T22:01:35.939 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-25T22:01:35.939 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_scrub_interval": "86400", 2024-04-25T22:01:35.939 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_scrub_max_keys": "100", 2024-04-25T22:01:35.939 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_scrub_timeout": "300", 2024-04-25T22:01:35.939 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_session_timeout": "300", 2024-04-25T22:01:35.939 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_smart_report_timeout": "5", 2024-04-25T22:01:35.939 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_stat_smooth_intervals": "6", 2024-04-25T22:01:35.939 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-25T22:01:35.939 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_stretch_pool_min_size": "2", 2024-04-25T22:01:35.939 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_stretch_pool_size": "4", 2024-04-25T22:01:35.939 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-25T22:01:35.939 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-25T22:01:35.940 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_sync_debug": "false", 2024-04-25T22:01:35.940 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-25T22:01:35.940 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-25T22:01:35.940 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_sync_provider_kill_at": "0", 2024-04-25T22:01:35.940 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_sync_requester_kill_at": "0", 2024-04-25T22:01:35.940 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_sync_timeout": "60.000000", 2024-04-25T22:01:35.940 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_target_pg_per_osd": "100", 2024-04-25T22:01:35.940 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_tick_interval": "5", 2024-04-25T22:01:35.940 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_timecheck_interval": "300.000000", 2024-04-25T22:01:35.940 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-25T22:01:35.940 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_use_min_delay_socket": "false", 2024-04-25T22:01:35.940 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_older_version_delay": "604800", 2024-04-25T22:01:35.940 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-25T22:01:35.940 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-25T22:01:35.941 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-25T22:01:35.941 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-25T22:01:35.941 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-25T22:01:35.941 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-25T22:01:35.941 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-25T22:01:35.941 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_misplaced": "false", 2024-04-25T22:01:35.941 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-25T22:01:35.941 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_older_version": "true", 2024-04-25T22:01:35.941 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-25T22:01:35.941 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-25T22:01:35.941 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-25T22:01:35.941 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-25T22:01:35.941 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-25T22:01:35.941 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-25T22:01:35.942 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-25T22:01:35.942 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-25T22:01:35.942 INFO:teuthology.orchestra.run.smithi044.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-25T22:01:35.942 INFO:teuthology.orchestra.run.smithi044.stdout: "monmap": "", 2024-04-25T22:01:35.942 INFO:teuthology.orchestra.run.smithi044.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-25T22:01:35.942 INFO:teuthology.orchestra.run.smithi044.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-25T22:01:35.942 INFO:teuthology.orchestra.run.smithi044.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-25T22:01:35.942 INFO:teuthology.orchestra.run.smithi044.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-25T22:01:35.942 INFO:teuthology.orchestra.run.smithi044.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-25T22:01:35.942 INFO:teuthology.orchestra.run.smithi044.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-25T22:01:35.942 INFO:teuthology.orchestra.run.smithi044.stdout: "motr_tracing_enabled": "false", 2024-04-25T22:01:35.942 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_op_threads": "3", 2024-04-25T22:01:35.942 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-25T22:01:35.942 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_cm": "false", 2024-04-25T22:01:35.943 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_device_name": "", 2024-04-25T22:01:35.943 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_dscp": "96", 2024-04-25T22:01:35.943 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-25T22:01:35.943 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-25T22:01:35.943 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_local_gid": "", 2024-04-25T22:01:35.943 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-25T22:01:35.943 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_port_num": "1", 2024-04-25T22:01:35.943 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-25T22:01:35.943 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-25T22:01:35.943 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-25T22:01:35.943 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-25T22:01:35.943 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_sl": "3", 2024-04-25T22:01:35.943 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_support_srq": "true", 2024-04-25T22:01:35.943 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_rdma_type": "ib", 2024-04-25T22:01:35.944 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_async_reap_threshold": "5", 2024-04-25T22:01:35.944 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_before_connect": "false", 2024-04-25T22:01:35.944 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_ipv4": "true", 2024-04-25T22:01:35.944 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_ipv6": "false", 2024-04-25T22:01:35.944 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_msgr1": "true", 2024-04-25T22:01:35.944 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_msgr2": "true", 2024-04-25T22:01:35.944 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_port_max": "7568", 2024-04-25T22:01:35.944 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_port_min": "6800", 2024-04-25T22:01:35.944 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-25T22:01:35.944 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_retry_count": "3", 2024-04-25T22:01:35.944 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_bind_retry_delay": "5", 2024-04-25T22:01:35.944 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_blackhole_client": "false", 2024-04-25T22:01:35.944 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_blackhole_mds": "false", 2024-04-25T22:01:35.944 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_blackhole_mgr": "false", 2024-04-25T22:01:35.944 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_blackhole_mon": "false", 2024-04-25T22:01:35.945 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_blackhole_osd": "false", 2024-04-25T22:01:35.945 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_client_mode": "crc secure", 2024-04-25T22:01:35.945 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_cluster_mode": "crc secure", 2024-04-25T22:01:35.945 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_cluster_type": "", 2024-04-25T22:01:35.945 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_compress_secure": "false", 2024-04-25T22:01:35.945 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_connection_idle_timeout": "900", 2024-04-25T22:01:35.945 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_connection_ready_timeout": "10", 2024-04-25T22:01:35.945 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_crc_data": "true", 2024-04-25T22:01:35.945 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_crc_header": "true", 2024-04-25T22:01:35.945 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_die_on_bad_msg": "false", 2024-04-25T22:01:35.945 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_die_on_bug": "true", 2024-04-25T22:01:35.945 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_die_on_old_message": "true", 2024-04-25T22:01:35.945 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_die_on_skipped_message": "false", 2024-04-25T22:01:35.945 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-25T22:01:35.946 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-25T22:01:35.946 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_coremask": "0xF", 2024-04-25T22:01:35.946 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-25T22:01:35.946 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-25T22:01:35.946 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_enable_tso": "true", 2024-04-25T22:01:35.946 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-25T22:01:35.946 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-25T22:01:35.946 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_hugepages": "", 2024-04-25T22:01:35.946 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-25T22:01:35.946 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-25T22:01:35.946 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_lro": "true", 2024-04-25T22:01:35.946 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_memory_channel": "4", 2024-04-25T22:01:35.946 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-25T22:01:35.946 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_pmd": "", 2024-04-25T22:01:35.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_port_id": "0", 2024-04-25T22:01:35.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-25T22:01:35.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-25T22:01:35.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_dump_on_send": "false", 2024-04-25T22:01:35.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_initial_backoff": "0.200000", 2024-04-25T22:01:35.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_inject_delay_max": "1.000000", 2024-04-25T22:01:35.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-25T22:01:35.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_inject_delay_type": "", 2024-04-25T22:01:35.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-25T22:01:35.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_inject_network_congestion": "0", 2024-04-25T22:01:35.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_inject_socket_failures": "0", 2024-04-25T22:01:35.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_learn_addr_from_peer": "true", 2024-04-25T22:01:35.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_max_accept_failures": "4", 2024-04-25T22:01:35.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_max_backoff": "15.000000", 2024-04-25T22:01:35.948 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_mon_client_mode": "secure crc", 2024-04-25T22:01:35.948 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-25T22:01:35.948 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_mon_service_mode": "secure crc", 2024-04-25T22:01:35.948 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_osd_compress_min_size": "1024", 2024-04-25T22:01:35.948 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_osd_compress_mode": "none", 2024-04-25T22:01:35.948 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-25T22:01:35.948 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-25T22:01:35.948 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_pq_min_cost": "65536", 2024-04-25T22:01:35.948 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_public_type": "", 2024-04-25T22:01:35.948 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_service_mode": "crc secure", 2024-04-25T22:01:35.948 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_tcp_listen_backlog": "512", 2024-04-25T22:01:35.948 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_tcp_nodelay": "true", 2024-04-25T22:01:35.948 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-25T22:01:35.948 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_tcp_rcvbuf": "0", 2024-04-25T22:01:35.948 INFO:teuthology.orchestra.run.smithi044.stdout: "ms_type": "async+posix", 2024-04-25T22:01:35.949 INFO:teuthology.orchestra.run.smithi044.stdout: "no_config_file": "false", 2024-04-25T22:01:35.949 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter_completion_locks_per_session": "32", 2024-04-25T22:01:35.949 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-25T22:01:35.949 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-25T22:01:35.949 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter_inflight_ops": "1024", 2024-04-25T22:01:35.949 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-25T22:01:35.949 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-25T22:01:35.949 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter_tick_interval": "5.000000", 2024-04-25T22:01:35.949 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter_timeout": "10.000000", 2024-04-25T22:01:35.949 INFO:teuthology.orchestra.run.smithi044.stdout: "objectstore_blackhole": "false", 2024-04-25T22:01:35.949 INFO:teuthology.orchestra.run.smithi044.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-04-25T22:01:35.949 INFO:teuthology.orchestra.run.smithi044.stdout: "openssl_engine_opts": "", 2024-04-25T22:01:35.949 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_agent_delay_time": "5.000000", 2024-04-25T22:01:35.949 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_agent_hist_halflife": "1000", 2024-04-25T22:01:35.950 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_agent_max_low_ops": "2", 2024-04-25T22:01:35.950 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_agent_max_ops": "4", 2024-04-25T22:01:35.950 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-25T22:01:35.950 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-25T22:01:35.950 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_agent_slop": "0.020000", 2024-04-25T22:01:35.950 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-25T22:01:35.950 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-25T22:01:35.950 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_asio_thread_count": "2", 2024-04-25T22:01:35.950 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_async_recovery_min_cost": "100", 2024-04-25T22:01:35.950 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-25T22:01:35.950 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-25T22:01:35.950 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_backfill_scan_max": "512", 2024-04-25T22:01:35.950 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_backfill_scan_min": "64", 2024-04-25T22:01:35.950 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_backoff_on_degraded": "false", 2024-04-25T22:01:35.950 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_backoff_on_peering": "false", 2024-04-25T22:01:35.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_backoff_on_unfound": "true", 2024-04-25T22:01:35.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_beacon_report_interval": "300", 2024-04-25T22:01:35.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bench_duration": "30", 2024-04-25T22:01:35.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-25T22:01:35.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bench_max_block_size": "67108864", 2024-04-25T22:01:35.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-25T22:01:35.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_blkin_trace_all": "false", 2024-04-25T22:01:35.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-25T22:01:35.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-25T22:01:35.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-25T22:01:35.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-25T22:01:35.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_check_for_log_corruption": "false", 2024-04-25T22:01:35.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-25T22:01:35.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-25T22:01:35.952 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-25T22:01:35.952 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-25T22:01:35.952 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_class_update_on_start": "true", 2024-04-25T22:01:35.952 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_client_message_cap": "256", 2024-04-25T22:01:35.952 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_client_message_size_cap": "524288000", 2024-04-25T22:01:35.952 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_client_op_priority": "63", 2024-04-25T22:01:35.952 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_client_watch_timeout": "30", 2024-04-25T22:01:35.952 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_command_max_records": "256", 2024-04-25T22:01:35.952 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_compact_on_start": "false", 2024-04-25T22:01:35.952 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-25T22:01:35.952 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-25T22:01:35.952 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-25T22:01:35.952 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_crush_update_on_start": "true", 2024-04-25T22:01:35.952 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_crush_update_weight_set": "true", 2024-04-25T22:01:35.952 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-25T22:01:35.953 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-25T22:01:35.953 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-25T22:01:35.953 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-25T22:01:35.953 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-25T22:01:35.953 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_feed_pullee": "-1", 2024-04-25T22:01:35.953 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-25T22:01:35.953 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-25T22:01:35.953 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-25T22:01:35.953 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_misdirected_ops": "false", 2024-04-25T22:01:35.953 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_no_acting_change": "false", 2024-04-25T22:01:35.953 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_no_purge_strays": "false", 2024-04-25T22:01:35.953 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_op_order": "false", 2024-04-25T22:01:35.953 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-25T22:01:35.953 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-25T22:01:35.953 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-25T22:01:35.954 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-25T22:01:35.954 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_shutdown": "false", 2024-04-25T22:01:35.954 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-25T22:01:35.954 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-25T22:01:35.954 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_trim_objects": "false", 2024-04-25T22:01:35.954 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-25T22:01:35.954 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-25T22:01:35.954 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_verify_snaps": "false", 2024-04-25T22:01:35.954 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-25T22:01:35.954 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-25T22:01:35.954 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_deep_scrub_keys": "1024", 2024-04-25T22:01:35.954 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-25T22:01:35.954 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-25T22:01:35.955 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-25T22:01:35.955 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_deep_scrub_stride": "524288", 2024-04-25T22:01:35.955 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-25T22:01:35.955 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-25T22:01:35.955 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_default_notify_timeout": "30", 2024-04-25T22:01:35.955 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_delete_sleep": "0.000000", 2024-04-25T22:01:35.955 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-25T22:01:35.955 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-25T22:01:35.955 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-25T22:01:35.955 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_discard_disconnected_ops": "true", 2024-04-25T22:01:35.955 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_enable_op_tracker": "true", 2024-04-25T22:01:35.955 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-25T22:01:35.955 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-25T22:01:35.955 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-25T22:01:35.956 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-25T22:01:35.956 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_fast_info": "true", 2024-04-25T22:01:35.956 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_fast_shutdown": "true", 2024-04-25T22:01:35.956 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-25T22:01:35.956 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-25T22:01:35.956 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-25T22:01:35.956 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-25T22:01:35.956 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-25T22:01:35.956 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_function_tracing": "false", 2024-04-25T22:01:35.956 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_heartbeat_grace": "20", 2024-04-25T22:01:35.956 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_heartbeat_interval": "6", 2024-04-25T22:01:35.956 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-25T22:01:35.956 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_heartbeat_min_peers": "10", 2024-04-25T22:01:35.956 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_heartbeat_min_size": "2000", 2024-04-25T22:01:35.957 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_heartbeat_stale": "600", 2024-04-25T22:01:35.957 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-25T22:01:35.957 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_hit_set_max_size": "100000", 2024-04-25T22:01:35.957 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_hit_set_min_size": "1000", 2024-04-25T22:01:35.957 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-25T22:01:35.957 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-25T22:01:35.957 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-25T22:01:35.957 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-25T22:01:35.957 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-25T22:01:35.957 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-25T22:01:35.957 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_journal_size": "5120", 2024-04-25T22:01:35.957 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_kill_backfill_at": "0", 2024-04-25T22:01:35.957 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-25T22:01:35.957 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_map_cache_size": "50", 2024-04-25T22:01:35.958 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_map_dedup": "true", 2024-04-25T22:01:35.958 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_map_message_max": "40", 2024-04-25T22:01:35.958 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-25T22:01:35.958 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_map_share_max_epochs": "40", 2024-04-25T22:01:35.958 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_attr_name_len": "100", 2024-04-25T22:01:35.958 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_attr_size": "0", 2024-04-25T22:01:35.958 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_backfills": "1", 2024-04-25T22:01:35.958 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_markdown_count": "5", 2024-04-25T22:01:35.958 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_markdown_period": "600", 2024-04-25T22:01:35.958 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_object_name_len": "2048", 2024-04-25T22:01:35.958 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_object_namespace_len": "256", 2024-04-25T22:01:35.958 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_object_size": "134217728", 2024-04-25T22:01:35.958 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-25T22:01:35.958 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-25T22:01:35.959 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_pg_blocked_by": "16", 2024-04-25T22:01:35.959 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_pg_log_entries": "10000", 2024-04-25T22:01:35.959 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-25T22:01:35.959 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_pgls": "1024", 2024-04-25T22:01:35.959 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_push_cost": "8388608", 2024-04-25T22:01:35.959 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_push_objects": "10", 2024-04-25T22:01:35.959 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_scrubs": "3", 2024-04-25T22:01:35.959 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-25T22:01:35.959 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_trimming_pgs": "2", 2024-04-25T22:01:35.959 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_write_op_reply_len": "64", 2024-04-25T22:01:35.959 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_max_write_size": "90", 2024-04-25T22:01:35.959 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-25T22:01:35.959 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-25T22:01:35.959 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-25T22:01:35.960 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-25T22:01:35.960 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-25T22:01:35.960 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-25T22:01:35.960 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-25T22:01:35.960 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-25T22:01:35.960 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_profile": "balanced", 2024-04-25T22:01:35.960 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-25T22:01:35.960 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-25T22:01:35.960 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-25T22:01:35.960 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-25T22:01:35.960 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-25T22:01:35.960 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-25T22:01:35.960 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-25T22:01:35.960 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-25T22:01:35.961 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-25T22:01:35.961 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-25T22:01:35.961 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-25T22:01:35.961 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_memory_base": "805306368", 2024-04-25T22:01:35.961 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_memory_cache_min": "134217728", 2024-04-25T22:01:35.961 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-25T22:01:35.961 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-25T22:01:35.961 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_memory_target": "4294967296", 2024-04-25T22:01:35.961 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_memory_target_autotune": "false", 2024-04-25T22:01:35.961 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-25T22:01:35.961 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_min_pg_log_entries": "250", 2024-04-25T22:01:35.961 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_min_recovery_priority": "0", 2024-04-25T22:01:35.961 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-25T22:01:35.961 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-25T22:01:35.962 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mon_report_interval": "5", 2024-04-25T22:01:35.962 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-25T22:01:35.962 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-25T22:01:35.962 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_num_cache_shards": "32", 2024-04-25T22:01:35.962 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_num_op_tracker_shard": "32", 2024-04-25T22:01:35.962 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_numa_auto_affinity": "true", 2024-04-25T22:01:35.962 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_numa_node": "-1", 2024-04-25T22:01:35.962 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_numa_prefer_iface": "true", 2024-04-25T22:01:35.962 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-25T22:01:35.962 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_objecter_finishers": "1", 2024-04-25T22:01:35.962 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_objectstore": "bluestore", 2024-04-25T22:01:35.962 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_objectstore_fuse": "false", 2024-04-25T22:01:35.962 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_objectstore_tracing": "false", 2024-04-25T22:01:35.962 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_complaint_time": "30.000000", 2024-04-25T22:01:35.962 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_history_duration": "600", 2024-04-25T22:01:35.963 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_history_size": "20", 2024-04-25T22:01:35.963 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_history_slow_op_size": "20", 2024-04-25T22:01:35.963 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-25T22:01:35.963 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_log_threshold": "5", 2024-04-25T22:01:35.963 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_num_shards": "0", 2024-04-25T22:01:35.963 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_num_shards_hdd": "5", 2024-04-25T22:01:35.963 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_num_shards_ssd": "8", 2024-04-25T22:01:35.963 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-25T22:01:35.963 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-25T22:01:35.963 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-25T22:01:35.963 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-25T22:01:35.963 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_pq_min_cost": "65536", 2024-04-25T22:01:35.963 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-25T22:01:35.963 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_queue_cut_off": "high", 2024-04-25T22:01:35.964 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-25T22:01:35.964 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_op_thread_timeout": "15", 2024-04-25T22:01:35.964 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_open_classes_on_start": "true", 2024-04-25T22:01:35.964 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_os_flags": "0", 2024-04-25T22:01:35.964 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_peering_op_priority": "255", 2024-04-25T22:01:35.964 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_delete_cost": "1048576", 2024-04-25T22:01:35.964 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_delete_priority": "5", 2024-04-25T22:01:35.964 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-25T22:01:35.964 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-25T22:01:35.964 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-25T22:01:35.964 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_log_trim_max": "10000", 2024-04-25T22:01:35.964 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_log_trim_min": "100", 2024-04-25T22:01:35.964 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-25T22:01:35.964 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-25T22:01:35.964 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-04-25T22:01:35.965 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-04-25T22:01:35.965 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-25T22:01:35.965 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-25T22:01:35.965 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-25T22:01:35.965 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-25T22:01:35.965 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-25T22:01:35.965 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-25T22:01:35.965 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_crimson": "false", 2024-04-25T22:01:35.965 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-25T22:01:35.965 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-25T22:01:35.965 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-25T22:01:35.965 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-25T22:01:35.965 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-25T22:01:35.965 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-25T22:01:35.965 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-25T22:01:35.966 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-25T22:01:35.966 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_flags": "0", 2024-04-25T22:01:35.966 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-25T22:01:35.966 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_min_size": "0", 2024-04-25T22:01:35.966 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-25T22:01:35.966 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_pg_num": "32", 2024-04-25T22:01:35.966 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_pgp_num": "0", 2024-04-25T22:01:35.966 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-25T22:01:35.966 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_read_ratio": "70", 2024-04-25T22:01:35.966 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_size": "2", 2024-04-25T22:01:35.966 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_default_type": "replicated", 2024-04-25T22:01:35.966 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-25T22:01:35.966 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-25T22:01:35.967 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_push_per_object_cost": "1000", 2024-04-25T22:01:35.967 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-25T22:01:35.967 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recover_clone_overlap": "true", 2024-04-25T22:01:35.967 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-25T22:01:35.967 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_cost": "20971520", 2024-04-25T22:01:35.967 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-25T22:01:35.967 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_max_active": "0", 2024-04-25T22:01:35.967 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-25T22:01:35.967 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-25T22:01:35.967 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-25T22:01:35.967 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-25T22:01:35.967 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_max_single_start": "1", 2024-04-25T22:01:35.967 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_op_priority": "3", 2024-04-25T22:01:35.967 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-25T22:01:35.967 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_priority": "5", 2024-04-25T22:01:35.968 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-25T22:01:35.968 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_sleep": "0.000000", 2024-04-25T22:01:35.968 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-25T22:01:35.968 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-25T22:01:35.968 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-25T22:01:35.968 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_repair_during_recovery": "false", 2024-04-25T22:01:35.968 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_requested_scrub_priority": "120", 2024-04-25T22:01:35.968 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-25T22:01:35.968 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-25T22:01:35.968 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_auto_repair": "false", 2024-04-25T22:01:35.968 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-25T22:01:35.968 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-25T22:01:35.968 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_begin_hour": "0", 2024-04-25T22:01:35.968 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_begin_week_day": "0", 2024-04-25T22:01:35.968 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_chunk_max": "25", 2024-04-25T22:01:35.969 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_chunk_min": "5", 2024-04-25T22:01:35.969 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_cost": "52428800", 2024-04-25T22:01:35.969 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_disable_reservation_queuing": "true", 2024-04-25T22:01:35.969 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_during_recovery": "false", 2024-04-25T22:01:35.969 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_end_hour": "0", 2024-04-25T22:01:35.969 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_end_week_day": "0", 2024-04-25T22:01:35.969 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_event_cost": "4096", 2024-04-25T22:01:35.969 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-25T22:01:35.969 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-25T22:01:35.969 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_invalid_stats": "true", 2024-04-25T22:01:35.969 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-25T22:01:35.969 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-25T22:01:35.969 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_max_preemptions": "5", 2024-04-25T22:01:35.969 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-25T22:01:35.970 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_priority": "5", 2024-04-25T22:01:35.970 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_reservation_timeout": "300000", 2024-04-25T22:01:35.970 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_scrub_sleep": "0.000000", 2024-04-25T22:01:35.970 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-25T22:01:35.970 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-25T22:01:35.970 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-25T22:01:35.970 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_skip_data_digest": "false", 2024-04-25T22:01:35.970 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_smart_report_timeout": "5", 2024-04-25T22:01:35.970 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_snap_trim_cost": "1048576", 2024-04-25T22:01:35.970 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_snap_trim_priority": "5", 2024-04-25T22:01:35.970 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-25T22:01:35.970 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-25T22:01:35.970 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-25T22:01:35.970 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-25T22:01:35.970 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-25T22:01:35.971 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-25T22:01:35.971 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-25T22:01:35.971 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_target_transaction_size": "30", 2024-04-25T22:01:35.971 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-25T22:01:35.971 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-25T22:01:35.971 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-25T22:01:35.971 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-25T22:01:35.971 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-25T22:01:35.971 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-25T22:01:35.971 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-25T22:01:35.971 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-25T22:01:35.971 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-25T22:01:35.971 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-25T22:01:35.971 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_tracing": "false", 2024-04-25T22:01:35.972 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_use_stale_snap": "false", 2024-04-25T22:01:35.972 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-25T22:01:35.972 INFO:teuthology.orchestra.run.smithi044.stdout: "osdc_blkin_trace_all": "false", 2024-04-25T22:01:35.972 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_kill_at": "0", 2024-04-25T22:01:35.972 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_max_join_drift": "10", 2024-04-25T22:01:35.972 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_min": "500", 2024-04-25T22:01:35.972 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_min_wait": "0.050000", 2024-04-25T22:01:35.972 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_propose_interval": "1.000000", 2024-04-25T22:01:35.972 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_service_trim_max": "500", 2024-04-25T22:01:35.972 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-25T22:01:35.972 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_service_trim_min": "250", 2024-04-25T22:01:35.972 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_stash_full_interval": "25", 2024-04-25T22:01:35.972 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_trim_max": "500", 2024-04-25T22:01:35.972 INFO:teuthology.orchestra.run.smithi044.stdout: "paxos_trim_min": "250", 2024-04-25T22:01:35.972 INFO:teuthology.orchestra.run.smithi044.stdout: "perf": "true", 2024-04-25T22:01:35.973 INFO:teuthology.orchestra.run.smithi044.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-25T22:01:35.973 INFO:teuthology.orchestra.run.smithi044.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-25T22:01:35.973 INFO:teuthology.orchestra.run.smithi044.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-25T22:01:35.973 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "-", 2024-04-25T22:01:35.973 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrv": "", 2024-04-25T22:01:35.973 INFO:teuthology.orchestra.run.smithi044.stdout: "public_bind_addr": "-", 2024-04-25T22:01:35.973 INFO:teuthology.orchestra.run.smithi044.stdout: "public_network": "", 2024-04-25T22:01:35.973 INFO:teuthology.orchestra.run.smithi044.stdout: "public_network_interface": "", 2024-04-25T22:01:35.973 INFO:teuthology.orchestra.run.smithi044.stdout: "qat_compressor_enabled": "false", 2024-04-25T22:01:35.973 INFO:teuthology.orchestra.run.smithi044.stdout: "qat_compressor_session_max_number": "256", 2024-04-25T22:01:35.973 INFO:teuthology.orchestra.run.smithi044.stdout: "rados_mon_op_timeout": "0", 2024-04-25T22:01:35.973 INFO:teuthology.orchestra.run.smithi044.stdout: "rados_osd_op_timeout": "0", 2024-04-25T22:01:35.973 INFO:teuthology.orchestra.run.smithi044.stdout: "rados_tracing": "false", 2024-04-25T22:01:35.973 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_atime_update_interval": "60", 2024-04-25T22:01:35.974 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-25T22:01:35.974 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_balance_parent_reads": "false", 2024-04-25T22:01:35.974 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_balance_snap_reads": "false", 2024-04-25T22:01:35.974 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_blkin_trace_all": "false", 2024-04-25T22:01:35.974 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-25T22:01:35.974 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-25T22:01:35.974 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_cache": "true", 2024-04-25T22:01:35.974 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-25T22:01:35.974 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-25T22:01:35.974 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-25T22:01:35.974 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-25T22:01:35.974 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_cache_policy": "writearound", 2024-04-25T22:01:35.974 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_cache_size": "33554432", 2024-04-25T22:01:35.974 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-25T22:01:35.975 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-25T22:01:35.975 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_clone_copy_on_read": "false", 2024-04-25T22:01:35.975 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_compression_hint": "none", 2024-04-25T22:01:35.975 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_concurrent_management_ops": "10", 2024-04-25T22:01:35.975 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-25T22:01:35.975 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_clone_format": "auto", 2024-04-25T22:01:35.975 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_data_pool": "", 2024-04-25T22:01:35.975 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_features": "61", 2024-04-25T22:01:35.975 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_format": "2", 2024-04-25T22:01:35.975 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_map_options": "", 2024-04-25T22:01:35.975 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_order": "22", 2024-04-25T22:01:35.975 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_pool": "rbd", 2024-04-25T22:01:35.975 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-25T22:01:35.975 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_stripe_count": "0", 2024-04-25T22:01:35.975 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_default_stripe_unit": "0", 2024-04-25T22:01:35.976 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-25T22:01:35.976 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-25T22:01:35.976 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-25T22:01:35.976 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_enable_alloc_hint": "true", 2024-04-25T22:01:35.976 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-25T22:01:35.976 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_io_scheduler": "simple", 2024-04-25T22:01:35.976 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-25T22:01:35.976 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-25T22:01:35.976 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-25T22:01:35.976 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-25T22:01:35.976 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-25T22:01:35.976 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-25T22:01:35.976 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-25T22:01:35.976 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-25T22:01:35.977 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-25T22:01:35.977 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_order": "24", 2024-04-25T22:01:35.977 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_pool": "", 2024-04-25T22:01:35.977 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_journal_splay_width": "4", 2024-04-25T22:01:35.977 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_localize_parent_reads": "false", 2024-04-25T22:01:35.977 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_localize_snap_reads": "false", 2024-04-25T22:01:35.977 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-25T22:01:35.977 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-25T22:01:35.977 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-25T22:01:35.977 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-25T22:01:35.977 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-25T22:01:35.977 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-25T22:01:35.977 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-25T22:01:35.977 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-25T22:01:35.978 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-25T22:01:35.978 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-25T22:01:35.978 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-25T22:01:35.978 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-25T22:01:35.978 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-25T22:01:35.978 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-25T22:01:35.978 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-25T22:01:35.978 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-25T22:01:35.978 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-25T22:01:35.978 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-25T22:01:35.978 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-25T22:01:35.978 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-25T22:01:35.978 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-25T22:01:35.978 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-25T22:01:35.978 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-25T22:01:35.979 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-25T22:01:35.979 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-25T22:01:35.979 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-25T22:01:35.979 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-25T22:01:35.979 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-25T22:01:35.979 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-25T22:01:35.979 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-25T22:01:35.979 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-25T22:01:35.979 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_mtime_update_interval": "60", 2024-04-25T22:01:35.979 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_non_blocking_aio": "true", 2024-04-25T22:01:35.979 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_op_thread_timeout": "60", 2024-04-25T22:01:35.979 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_op_threads": "1", 2024-04-25T22:01:35.979 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_parent_cache_enabled": "false", 2024-04-25T22:01:35.979 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-25T22:01:35.980 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-25T22:01:35.980 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-25T22:01:35.980 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_plugins": "", 2024-04-25T22:01:35.980 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_bps_burst": "0", 2024-04-25T22:01:35.980 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-25T22:01:35.980 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_bps_limit": "0", 2024-04-25T22:01:35.980 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_exclude_ops": "0", 2024-04-25T22:01:35.980 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_iops_burst": "0", 2024-04-25T22:01:35.980 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-25T22:01:35.980 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_iops_limit": "0", 2024-04-25T22:01:35.980 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-25T22:01:35.980 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-25T22:01:35.980 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-25T22:01:35.980 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-25T22:01:35.981 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-25T22:01:35.981 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-25T22:01:35.981 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-25T22:01:35.981 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-25T22:01:35.981 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-25T22:01:35.981 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-25T22:01:35.981 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-25T22:01:35.981 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-25T22:01:35.981 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-25T22:01:35.981 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-25T22:01:35.981 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_read_from_replica_policy": "default", 2024-04-25T22:01:35.981 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-25T22:01:35.981 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-25T22:01:35.981 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-25T22:01:35.981 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-25T22:01:35.982 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_skip_partial_discard": "true", 2024-04-25T22:01:35.982 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-25T22:01:35.982 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_tracing": "false", 2024-04-25T22:01:35.982 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_validate_names": "true", 2024-04-25T22:01:35.982 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_validate_pool": "true", 2024-04-25T22:01:35.982 INFO:teuthology.orchestra.run.smithi044.stdout: "restapi_base_url": "", 2024-04-25T22:01:35.982 INFO:teuthology.orchestra.run.smithi044.stdout: "restapi_log_level": "", 2024-04-25T22:01:35.982 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_acl_grants_max_num": "100", 2024-04-25T22:01:35.982 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_admin_entry": "admin", 2024-04-25T22:01:35.982 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-25T22:01:35.982 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_backend_store": "rados", 2024-04-25T22:01:35.982 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_barbican_url": "", 2024-04-25T22:01:35.982 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_beast_enable_async": "true", 2024-04-25T22:01:35.982 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_bucket_counters_cache": "false", 2024-04-25T22:01:35.983 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-04-25T22:01:35.983 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-25T22:01:35.983 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-25T22:01:35.983 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-25T22:01:35.983 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-25T22:01:35.983 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-25T22:01:35.983 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-25T22:01:35.983 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-25T22:01:35.983 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_cache_enabled": "true", 2024-04-25T22:01:35.983 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_cache_expiry_interval": "900", 2024-04-25T22:01:35.983 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_cache_lru_size": "10000", 2024-04-25T22:01:35.983 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_config_store": "rados", 2024-04-25T22:01:35.983 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_content_length_compat": "false", 2024-04-25T22:01:35.983 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_copy_obj_progress": "true", 2024-04-25T22:01:35.983 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-25T22:01:35.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_cors_rules_max_num": "100", 2024-04-25T22:01:35.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_cross_domain_policy": "", 2024-04-25T22:01:35.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-25T22:01:35.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_kmip_addr": "", 2024-04-25T22:01:35.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-25T22:01:35.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-25T22:01:35.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-25T22:01:35.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-25T22:01:35.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_kmip_password": "", 2024-04-25T22:01:35.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-25T22:01:35.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_kmip_username": "", 2024-04-25T22:01:35.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_require_ssl": "true", 2024-04-25T22:01:35.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-25T22:01:35.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-25T22:01:35.985 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-25T22:01:35.985 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-25T22:01:35.985 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-25T22:01:35.985 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-25T22:01:35.985 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-25T22:01:35.985 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-25T22:01:35.985 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-25T22:01:35.985 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-25T22:01:35.985 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-25T22:01:35.985 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-25T22:01:35.985 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-25T22:01:35.985 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-25T22:01:35.985 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-25T22:01:35.985 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_addr": "", 2024-04-25T22:01:35.986 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_auth": "token", 2024-04-25T22:01:35.986 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_namespace": "", 2024-04-25T22:01:35.986 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_prefix": "", 2024-04-25T22:01:35.986 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-25T22:01:35.986 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-25T22:01:35.986 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-25T22:01:35.986 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-25T22:01:35.986 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_token_file": "", 2024-04-25T22:01:35.986 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-25T22:01:35.986 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_curl_buffersize": "524288", 2024-04-25T22:01:35.986 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-25T22:01:35.986 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_curl_low_speed_time": "300", 2024-04-25T22:01:35.986 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-25T22:01:35.986 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-25T22:01:35.987 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-25T22:01:35.987 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-25T22:01:35.987 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-25T22:01:35.987 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-25T22:01:35.987 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-25T22:01:35.987 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-25T22:01:35.987 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-25T22:01:35.987 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-25T22:01:35.987 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d4n_host": "127.0.0.1", 2024-04-25T22:01:35.987 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_d4n_port": "6379", 2024-04-25T22:01:35.987 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-25T22:01:35.987 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_data_log_changes_size": "1000", 2024-04-25T22:01:35.987 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_data_log_num_shards": "128", 2024-04-25T22:01:35.987 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-25T22:01:35.987 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_data_log_window": "30", 2024-04-25T22:01:35.988 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-25T22:01:35.988 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-25T22:01:35.988 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-25T22:01:35.988 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-04-25T22:01:35.988 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-25T22:01:35.988 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-25T22:01:35.988 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-25T22:01:35.988 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-25T22:01:35.988 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-25T22:01:35.988 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-25T22:01:35.988 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-25T22:01:35.988 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-25T22:01:35.988 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-25T22:01:35.988 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-25T22:01:35.989 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-25T22:01:35.989 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-25T22:01:35.989 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-25T22:01:35.989 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-25T22:01:35.989 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-25T22:01:35.989 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-25T22:01:35.989 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-25T22:01:35.989 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-25T22:01:35.989 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-25T22:01:35.989 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-25T22:01:35.989 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-25T22:01:35.989 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dns_name": "", 2024-04-25T22:01:35.989 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dns_s3website_name": "", 2024-04-25T22:01:35.989 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_dynamic_resharding": "true", 2024-04-25T22:01:35.989 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-25T22:01:35.990 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_enable_gc_threads": "true", 2024-04-25T22:01:35.990 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_enable_lc_threads": "true", 2024-04-25T22:01:35.990 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_enable_ops_log": "false", 2024-04-25T22:01:35.990 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_enable_quota_threads": "true", 2024-04-25T22:01:35.990 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_enable_static_website": "false", 2024-04-25T22:01:35.990 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_enable_usage_log": "false", 2024-04-25T22:01:35.990 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_enforce_swift_acls": "true", 2024-04-25T22:01:35.990 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_exit_timeout_secs": "120", 2024-04-25T22:01:35.990 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_expose_bucket": "false", 2024-04-25T22:01:35.990 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_extended_http_attrs": "", 2024-04-25T22:01:35.990 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_filter": "none", 2024-04-25T22:01:35.990 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-25T22:01:35.990 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_frontends": "beast port=7480", 2024-04-25T22:01:35.990 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-25T22:01:35.991 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_gc_max_deferred": "50", 2024-04-25T22:01:35.991 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-25T22:01:35.991 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_gc_max_objs": "32", 2024-04-25T22:01:35.991 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-25T22:01:35.991 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-25T22:01:35.991 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-25T22:01:35.991 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-25T22:01:35.991 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_gc_processor_period": "3600", 2024-04-25T22:01:35.991 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-25T22:01:35.991 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-25T22:01:35.991 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-25T22:01:35.991 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-25T22:01:35.991 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_init_timeout": "300", 2024-04-25T22:01:35.991 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-25T22:01:35.992 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-25T22:01:35.992 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_kafka_connection_idle": "300", 2024-04-25T22:01:35.992 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_kafka_message_timeout": "5000", 2024-04-25T22:01:35.992 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_kafka_sleep_timeout": "10", 2024-04-25T22:01:35.992 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-25T22:01:35.992 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-04-25T22:01:35.992 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-25T22:01:35.992 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_admin_domain": "", 2024-04-25T22:01:35.992 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_admin_password": "", 2024-04-25T22:01:35.992 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_admin_password_path": "", 2024-04-25T22:01:35.992 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_admin_project": "", 2024-04-25T22:01:35.992 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_admin_tenant": "", 2024-04-25T22:01:35.992 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_admin_token": "", 2024-04-25T22:01:35.992 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_admin_token_path": "", 2024-04-25T22:01:35.992 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_admin_user": "", 2024-04-25T22:01:35.993 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_api_version": "2", 2024-04-25T22:01:35.993 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_barbican_domain": "", 2024-04-25T22:01:35.993 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_barbican_password": "", 2024-04-25T22:01:35.993 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_barbican_project": "", 2024-04-25T22:01:35.993 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-25T22:01:35.993 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_barbican_user": "", 2024-04-25T22:01:35.993 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-25T22:01:35.993 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-25T22:01:35.993 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-25T22:01:35.993 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-25T22:01:35.993 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-25T22:01:35.993 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_url": "", 2024-04-25T22:01:35.993 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-25T22:01:35.993 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lc_debug_interval": "-1", 2024-04-25T22:01:35.994 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lc_lock_max_time": "90", 2024-04-25T22:01:35.994 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lc_max_objs": "32", 2024-04-25T22:01:35.994 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lc_max_rules": "1000", 2024-04-25T22:01:35.994 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lc_max_worker": "3", 2024-04-25T22:01:35.994 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-25T22:01:35.994 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lc_thread_delay": "0", 2024-04-25T22:01:35.994 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-25T22:01:35.994 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ldap_dnattr": "uid", 2024-04-25T22:01:35.994 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-25T22:01:35.994 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ldap_searchfilter": "", 2024-04-25T22:01:35.994 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-25T22:01:35.994 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ldap_uri": "", 2024-04-25T22:01:35.994 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-25T22:01:35.994 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-25T22:01:35.995 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-25T22:01:35.995 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_log_http_headers": "", 2024-04-25T22:01:35.995 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-25T22:01:35.995 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-25T22:01:35.995 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_log_object_name_utc": "false", 2024-04-25T22:01:35.995 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-04-25T22:01:35.995 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-04-25T22:01:35.995 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_attr_name_len": "0", 2024-04-25T22:01:35.995 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_attr_size": "0", 2024-04-25T22:01:35.995 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-25T22:01:35.995 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_chunk_size": "4194304", 2024-04-25T22:01:35.995 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-25T22:01:35.995 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-25T22:01:35.995 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-25T22:01:35.996 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_listing_results": "1000", 2024-04-25T22:01:35.996 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_notify_retries": "10", 2024-04-25T22:01:35.996 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-25T22:01:35.996 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_put_param_size": "1048576", 2024-04-25T22:01:35.996 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_put_size": "5368709120", 2024-04-25T22:01:35.996 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_max_slo_entries": "1000", 2024-04-25T22:01:35.996 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_md_log_max_shards": "64", 2024-04-25T22:01:35.996 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-25T22:01:35.996 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-25T22:01:35.996 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-25T22:01:35.996 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-25T22:01:35.996 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_mp_lock_max_time": "600", 2024-04-25T22:01:35.996 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-25T22:01:35.996 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-25T22:01:35.997 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-25T22:01:35.997 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-25T22:01:35.997 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-25T22:01:35.997 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-25T22:01:35.997 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-25T22:01:35.997 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-25T22:01:35.997 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_max_gc": "300", 2024-04-25T22:01:35.997 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-25T22:01:35.997 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-25T22:01:35.997 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-25T22:01:35.997 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-25T22:01:35.997 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-25T22:01:35.997 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-25T22:01:35.997 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-25T22:01:35.997 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_num_async_rados_threads": "32", 2024-04-25T22:01:35.998 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_num_control_oids": "8", 2024-04-25T22:01:35.998 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_numa_node": "-1", 2024-04-25T22:01:35.998 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-25T22:01:35.998 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-25T22:01:35.998 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_objexp_chunk_size": "100", 2024-04-25T22:01:35.998 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_objexp_gc_interval": "600", 2024-04-25T22:01:35.998 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-25T22:01:35.998 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-25T22:01:35.998 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-25T22:01:35.998 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_op_thread_timeout": "600", 2024-04-25T22:01:35.998 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_op_tracing": "false", 2024-04-25T22:01:35.998 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_opa_token": "", 2024-04-25T22:01:35.998 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_opa_url": "", 2024-04-25T22:01:35.998 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_opa_verify_ssl": "true", 2024-04-25T22:01:35.999 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-25T22:01:35.999 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-25T22:01:35.999 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ops_log_rados": "false", 2024-04-25T22:01:35.999 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_ops_log_socket_path": "", 2024-04-25T22:01:35.999 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-25T22:01:35.999 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-25T22:01:35.999 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-25T22:01:35.999 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_period_push_interval": "2.000000", 2024-04-25T22:01:35.999 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-25T22:01:35.999 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-25T22:01:35.999 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-25T22:01:35.999 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-04-25T22:01:35.999 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_posix_cache_lanes": "3", 2024-04-25T22:01:35.999 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-04-25T22:01:36.000 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_posix_cache_max_buckets": "100", 2024-04-25T22:01:36.000 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_posix_cache_partitions": "3", 2024-04-25T22:01:36.000 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-04-25T22:01:36.000 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_print_continue": "true", 2024-04-25T22:01:36.000 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-25T22:01:36.000 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-25T22:01:36.000 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-25T22:01:36.000 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-25T22:01:36.000 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-25T22:01:36.000 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_rados_tracing": "false", 2024-04-25T22:01:36.000 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_realm": "", 2024-04-25T22:01:36.000 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_realm_id": "", 2024-04-25T22:01:36.000 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-25T22:01:36.000 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_region": "", 2024-04-25T22:01:36.000 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-25T22:01:36.001 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-25T22:01:36.001 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-25T22:01:36.001 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-25T22:01:36.001 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_request_uri": "", 2024-04-25T22:01:36.001 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_reshard_batch_size": "64", 2024-04-25T22:01:36.001 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-25T22:01:36.001 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_reshard_max_aio": "128", 2024-04-25T22:01:36.001 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_reshard_num_logs": "16", 2024-04-25T22:01:36.001 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_reshard_thread_interval": "600", 2024-04-25T22:01:36.001 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_resolve_cname": "false", 2024-04-25T22:01:36.001 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-25T22:01:36.001 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_run_sync_thread": "true", 2024-04-25T22:01:36.001 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-04-25T22:01:36.001 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-25T22:01:36.001 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-25T22:01:36.002 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-25T22:01:36.002 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-25T22:01:36.002 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-25T22:01:36.002 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-25T22:01:36.002 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-25T22:01:36.002 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-25T22:01:36.002 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_scheduler_type": "throttler", 2024-04-25T22:01:36.002 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_script_uri": "", 2024-04-25T22:01:36.002 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_service_provider_name": "", 2024-04-25T22:01:36.002 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-25T22:01:36.002 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sts_client_id": "", 2024-04-25T22:01:36.002 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sts_client_secret": "", 2024-04-25T22:01:36.002 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sts_entry": "sts", 2024-04-25T22:01:36.002 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sts_key": "sts", 2024-04-25T22:01:36.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-25T22:01:36.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sts_min_session_duration": "900", 2024-04-25T22:01:36.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sts_token_introspection_url": "", 2024-04-25T22:01:36.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_account_in_url": "false", 2024-04-25T22:01:36.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_auth_entry": "auth", 2024-04-25T22:01:36.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_auth_url": "", 2024-04-25T22:01:36.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_custom_header": "", 2024-04-25T22:01:36.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-25T22:01:36.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_need_stats": "true", 2024-04-25T22:01:36.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_tenant_name": "", 2024-04-25T22:01:36.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_token_expiration": "86400", 2024-04-25T22:01:36.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_url": "", 2024-04-25T22:01:36.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_url_prefix": "swift", 2024-04-25T22:01:36.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-25T22:01:36.004 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-25T22:01:36.004 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-25T22:01:36.004 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_lease_period": "120", 2024-04-25T22:01:36.004 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-25T22:01:36.004 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-25T22:01:36.004 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-25T22:01:36.004 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-25T22:01:36.004 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-25T22:01:36.004 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-25T22:01:36.004 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-25T22:01:36.004 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-25T22:01:36.004 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-25T22:01:36.004 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_thread_pool_size": "512", 2024-04-25T22:01:36.004 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_topic_persistency_max_retries": "0", 2024-04-25T22:01:36.005 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-04-25T22:01:36.005 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-04-25T22:01:36.005 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_topic_require_publish_policy": "false", 2024-04-25T22:01:36.005 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_torrent_comment": "", 2024-04-25T22:01:36.005 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_torrent_createby": "", 2024-04-25T22:01:36.005 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_torrent_encoding": "", 2024-04-25T22:01:36.005 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_torrent_flag": "false", 2024-04-25T22:01:36.005 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_torrent_max_size": "5368709120", 2024-04-25T22:01:36.005 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_torrent_origin": "", 2024-04-25T22:01:36.005 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-25T22:01:36.005 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_torrent_tracker": "", 2024-04-25T22:01:36.005 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_trust_forwarded_https": "false", 2024-04-25T22:01:36.005 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-25T22:01:36.005 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-25T22:01:36.005 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_usage_max_shards": "32", 2024-04-25T22:01:36.006 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_usage_max_user_shards": "1", 2024-04-25T22:01:36.006 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_use_opa_authz": "false", 2024-04-25T22:01:36.006 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_counters_cache": "false", 2024-04-25T22:01:36.006 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_counters_cache_size": "10000", 2024-04-25T22:01:36.006 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-25T22:01:36.006 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-25T22:01:36.006 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_max_buckets": "1000", 2024-04-25T22:01:36.006 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_policies_max_num": "100", 2024-04-25T22:01:36.006 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-25T22:01:36.006 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-25T22:01:36.006 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-25T22:01:36.006 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-25T22:01:36.006 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_user_unique_email": "true", 2024-04-25T22:01:36.006 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_verify_ssl": "true", 2024-04-25T22:01:36.007 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-25T22:01:36.007 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_zone": "", 2024-04-25T22:01:36.007 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_zone_id": "", 2024-04-25T22:01:36.007 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-25T22:01:36.007 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_zonegroup": "", 2024-04-25T22:01:36.007 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_zonegroup_id": "", 2024-04-25T22:01:36.007 INFO:teuthology.orchestra.run.smithi044.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-25T22:01:36.007 INFO:teuthology.orchestra.run.smithi044.stdout: "rgwlc_auto_session_clear": "true", 2024-04-25T22:01:36.007 INFO:teuthology.orchestra.run.smithi044.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-25T22:01:36.007 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_block_size": "4096", 2024-04-25T22:01:36.007 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-25T22:01:36.007 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-25T22:01:36.007 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-25T22:01:36.007 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-25T22:01:36.008 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-25T22:01:36.008 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_cache_size": "536870912", 2024-04-25T22:01:36.008 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-25T22:01:36.008 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-25T22:01:36.008 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-25T22:01:36.008 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-25T22:01:36.008 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-25T22:01:36.008 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-25T22:01:36.008 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-25T22:01:36.008 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-25T22:01:36.008 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_index_type": "binary_search", 2024-04-25T22:01:36.008 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-25T22:01:36.008 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-25T22:01:36.008 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_partition_filters": "false", 2024-04-25T22:01:36.008 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_perf": "false", 2024-04-25T22:01:36.009 INFO:teuthology.orchestra.run.smithi044.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-25T22:01:36.009 INFO:teuthology.orchestra.run.smithi044.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-25T22:01:36.009 INFO:teuthology.orchestra.run.smithi044.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-25T22:01:36.009 INFO:teuthology.orchestra.run.smithi044.stdout: "run_dir": "/var/run/ceph", 2024-04-25T22:01:36.009 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_block_create": "true", 2024-04-25T22:01:36.009 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_cache_lru_size": "67108864", 2024-04-25T22:01:36.009 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-25T22:01:36.009 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_data_delta_based_overwrite": "0", 2024-04-25T22:01:36.009 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_default_max_object_size": "16777216", 2024-04-25T22:01:36.009 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-25T22:01:36.009 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_device_size": "53687091200", 2024-04-25T22:01:36.009 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_journal_batch_capacity": "16", 2024-04-25T22:01:36.009 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-25T22:01:36.009 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-25T22:01:36.010 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-25T22:01:36.010 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_main_device_type": "SSD", 2024-04-25T22:01:36.010 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-25T22:01:36.010 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-25T22:01:36.010 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-25T22:01:36.010 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-25T22:01:36.010 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-25T22:01:36.010 INFO:teuthology.orchestra.run.smithi044.stdout: "seastore_segment_size": "67108864", 2024-04-25T22:01:36.010 INFO:teuthology.orchestra.run.smithi044.stdout: "set_keepcaps": "false", 2024-04-25T22:01:36.010 INFO:teuthology.orchestra.run.smithi044.stdout: "setgroup": "", 2024-04-25T22:01:36.010 INFO:teuthology.orchestra.run.smithi044.stdout: "setuser": "", 2024-04-25T22:01:36.010 INFO:teuthology.orchestra.run.smithi044.stdout: "setuser_match_path": "", 2024-04-25T22:01:36.010 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-25T22:01:36.010 INFO:teuthology.orchestra.run.smithi044.stdout: "thp": "false", 2024-04-25T22:01:36.010 INFO:teuthology.orchestra.run.smithi044.stdout: "threadpool_default_timeout": "60", 2024-04-25T22:01:36.011 INFO:teuthology.orchestra.run.smithi044.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-25T22:01:36.011 INFO:teuthology.orchestra.run.smithi044.stdout: "throttler_perf_counter": "true" 2024-04-25T22:01:36.011 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-25T22:01:36.013 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-25T22:01:36.163 INFO:teuthology.orchestra.run.smithi044.stdout:mon.a: {} 2024-04-25T22:01:36.164 INFO:teuthology.orchestra.run.smithi044.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:01:36.172 INFO:teuthology.orchestra.run.smithi044.stdout:mon.b: {} 2024-04-25T22:01:36.173 INFO:teuthology.orchestra.run.smithi044.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:01:36.183 INFO:teuthology.orchestra.run.smithi044.stdout:mon.c: {} 2024-04-25T22:01:36.183 INFO:teuthology.orchestra.run.smithi044.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:01:36.200 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-25T22:01:36.200 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T22:01:36.225 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T22:01:36.225 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-25T22:01:36.225 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-25T22:01:36.225 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T22:01:36.225 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T22:01:36.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:01:36.226 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-04-25T22:01:36.226 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-25T22:01:36.226 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:01:36.226 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:01:36.226 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-25T22:01:36.227 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-25T22:01:36.227 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-25T22:01:36.227 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-25T22:01:36.227 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-25T22:01:36.228 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-25T22:01:36.228 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:01:36.228 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-25T22:01:36.228 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:01:36.228 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-25T22:01:36.229 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:01:36.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:36.228+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:36.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:01:36.235 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2024-04-25T22:01:36.288 INFO:teuthology.orchestra.run.smithi044.stderr:Cannot find device "ceph-brx" 2024-04-25T22:01:36.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:01:36.290 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T22:01:36.290 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T22:01:36.330 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:36.328+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:36.361 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:01:36.361 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-25T22:01:36.361 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:01:36.365 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:36.365 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:01:36.365 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:01:36.365 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:36.375 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:01:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:01:36.380 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:01:36.395 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:01:36.396 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:01:36.417 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:01:36.417 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:01:36.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:36.428+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:36.508 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:36.508 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:36.524 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:01:36.532 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:36.532+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:36.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:36.632+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:36.647 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:36.648 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:36.657 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T22:01:36.662 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:01:36.674 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T22:01:36.674 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T22:01:36.674 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-04-25T22:01:36.675 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T22:01:36.675 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T22:01:36.675 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T22:01:36.675 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T22:01:36.675 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T22:01:36.675 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T22:01:36.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:01:36.675 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-04-25T22:01:36.681 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T22:01:36.681 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T22:01:36.681 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T22:01:36.681 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-04-25T22:01:36.681 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-04-25T22:01:36.681 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-04-25T22:01:36.681 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T22:01:36.681 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-04-25T22:01:36.682 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-04-25T22:01:36.682 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T22:01:36.682 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-04-25T22:01:36.682 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-04-25T22:01:36.682 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T22:01:36.682 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-04-25T22:01:36.682 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-04-25T22:01:36.682 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T22:01:36.682 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42479sec preferred_lft 42479sec 2024-04-25T22:01:36.682 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-04-25T22:01:36.682 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-04-25T22:01:36.682 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T22:01:36.682 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-04-25T22:01:36.683 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-04-25T22:01:36.683 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T22:01:36.683 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f6:12:b0:a8 brd ff:ff:ff:ff:ff:ff 2024-04-25T22:01:36.683 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T22:01:36.683 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-04-25T22:01:36.683 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T22:01:36.683 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:01:36.683 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-04-25T22:01:36.683 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add name ceph-brx type bridge 2024-04-25T22:01:36.683 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr flush dev ceph-brx 2024-04-25T22:01:36.684 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set ceph-brx up 2024-04-25T22:01:36.684 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T22:01:36.684 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-04-25T22:01:36.719 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-25T22:01:36.734 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:36.730+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:36.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-25T22:01:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:01:36.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-25T22:01:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:01:36.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:01:36.789 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T22:01:36.796 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:36.797 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:36.812 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:01:36.838 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-04-25T22:01:36.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:01:36.839 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-04-25T22:01:36.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:36.856+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:36.904 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-04-25T22:01:36.904 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T22:01:36.904 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T22:01:36.904 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T22:01:36.904 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T22:01:36.904 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T22:01:36.905 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:01:36.905 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-04-25T22:01:36.905 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T22:01:36.905 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T22:01:36.905 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T22:01:36.905 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-04-25T22:01:36.933 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:36.933 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:36.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:36.932+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:36.947 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:01:36.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-25T22:01:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:01:37.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-25T22:01:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:01:37.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:01:37.027 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-04-25T22:01:37.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:01:37.034 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list-id 2024-04-25T22:01:37.036 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:37.036+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:37.083 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:01:37.083 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-04-25T22:01:37.083 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:01:37.083 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T22:01:37.083 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-04-25T22:01:37.114 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:37.115 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:37.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:01:37.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-25T22:01:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:01:37.175 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:37.172+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:37.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-25T22:01:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:01:37.199 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T22:01:37.199 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:01:37.199 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-04-25T22:01:37.199 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T22:01:37.199 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T22:01:37.199 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T22:01:37.200 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T22:01:37.200 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T22:01:37.200 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-04-25T22:01:37.237 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:37.234+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:37.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-25T22:01:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:01:37.262 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:37.263 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:37.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:01:37.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-25T22:01:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:01:37.304 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:01:37.304 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-04-25T22:01:37.304 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-04-25T22:01:37.304 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T22:01:37.305 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-04-25T22:01:37.339 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:37.338+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:37.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-25T22:01:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:01:37.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-25T22:01:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:01:37.405 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-25T22:01:37.406 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T22:01:37.406 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T22:01:37.440 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:37.438+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:37.447 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:37.447 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:37.454 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T22:01:37.454 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T22:01:37.454 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T22:01:37.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:01:37.502 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-04-25T22:01:37.540 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:37.536+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:37.559 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T22:01:37.583 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:37.583 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:37.597 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:01:37.609 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-04-25T22:01:37.609 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-04-25T22:01:37.609 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-04-25T22:01:37.609 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-04-25T22:01:37.609 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-04-25T22:01:37.609 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-04-25T22:01:37.609 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-04-25T22:01:37.609 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-04-25T22:01:37.609 INFO:teuthology.orchestra.run.smithi044.stdout:/run/lock 2024-04-25T22:01:37.609 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-04-25T22:01:37.609 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-04-25T22:01:37.610 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-04-25T22:01:37.610 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T22:01:37.610 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-04-25T22:01:37.610 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-04-25T22:01:37.610 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-04-25T22:01:37.610 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-04-25T22:01:37.610 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/fs/nfsd 2024-04-25T22:01:37.610 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-04-25T22:01:37.610 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-04-25T22:01:37.610 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T22:01:37.610 INFO:teuthology.orchestra.run.smithi044.stdout:/run/rpc_pipefs 2024-04-25T22:01:37.610 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-04-25T22:01:37.610 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-04-25T22:01:37.610 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-04-25T22:01:37.610 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:01:37.611 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:01:37.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:01:37.611 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-04-25T22:01:37.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:37.636+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:37.659 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T22:01:37.659 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-25T22:01:37.703 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-04-25T22:01:37.719 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T22:01:37.733 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:37.733 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:37.743 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:37.740+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:37.749 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:01:37.771 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-04-25T22:01:37.771 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-04-25T22:01:37.772 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-04-25T22:01:37.772 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-04-25T22:01:37.772 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-04-25T22:01:37.772 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-04-25T22:01:37.772 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-04-25T22:01:37.772 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-04-25T22:01:37.772 INFO:teuthology.orchestra.run.smithi044.stdout:/run/lock 2024-04-25T22:01:37.772 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-04-25T22:01:37.772 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-04-25T22:01:37.772 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-04-25T22:01:37.772 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T22:01:37.772 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-04-25T22:01:37.772 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-04-25T22:01:37.772 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-04-25T22:01:37.773 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-04-25T22:01:37.773 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/fs/nfsd 2024-04-25T22:01:37.773 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-04-25T22:01:37.773 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-04-25T22:01:37.773 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T22:01:37.773 INFO:teuthology.orchestra.run.smithi044.stdout:/run/rpc_pipefs 2024-04-25T22:01:37.773 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-04-25T22:01:37.773 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-04-25T22:01:37.773 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-04-25T22:01:37.773 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:01:37.773 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:01:37.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:01:37.773 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-04-25T22:01:37.807 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2024-04-25T22:01:37.804+0000 7f0987e14580 -1 init, newargv = 0x55bf0d4f84c0 newargc=15 2024-04-25T22:01:37.808 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[22891]: starting ceph client 2024-04-25T22:01:37.814 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[22891]: starting fuse 2024-04-25T22:01:37.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:37.844+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:37.873 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:37.873 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:37.887 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:01:37.945 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:37.942+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:38.006 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:38.006 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:38.020 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:01:38.046 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:38.044+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:38.146 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:38.144+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:38.152 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:38.152 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:38.168 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:01:38.247 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:38.248+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:38.293 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:38.293 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:38.306 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:01:38.351 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:38.350+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:38.423 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:38.423 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:38.436 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:01:38.438 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:01:38.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:38.448+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:38.553 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:38.550+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:38.571 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:38.571 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:38.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:01:38.598 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:01:38.598 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:01:38.619 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:01:38.619 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:01:38.637 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:01:38.637 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:01:38.654 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:38.648+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:38.701 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:01:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:01:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:01:38.702 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:38.717 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:01:38.739 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:01:38.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:38.752+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:38.855 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:38.850+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:38.882 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:38.883 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:01:38.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:01:38.883 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:01:38.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.883 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:01:38.883 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:38.883 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.054467340999999, 2024-04-25T22:01:38.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:01:38.883 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.883 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.883 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:38.883 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:38.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:38.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:01:38.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:01:38.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:01:38.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:01:38.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:01:38.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:01:38.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:01:38.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:01:38.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:01:38.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:01:38.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:01:38.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:01:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:01:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:01:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:01:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:01:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:01:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.053736522999998, 2024-04-25T22:01:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:01:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:01:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:01:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:01:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:01:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:01:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:01:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:01:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:01:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:01:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:01:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:01:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:01:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:01:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:01:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:01:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:01:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:01:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.053070251999998, 2024-04-25T22:01:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:01:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:01:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:01:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:01:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:01:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:01:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:01:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:01:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:01:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:01:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:01:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:01:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:01:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:01:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:01:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:01:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:01:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:01:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.052170351999997, 2024-04-25T22:01:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:01:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:01:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:01:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:01:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:01:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:01:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:01:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:01:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:01:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:01:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:01:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:01:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:01:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:01:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:01:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:01:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:01:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:01:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.050134010999997, 2024-04-25T22:01:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:01:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:01:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:01:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:01:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:01:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:01:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:01:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:01:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:01:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:01:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:01:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:01:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:01:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:01:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:01:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:01:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:01:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:01:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.049670673999998, 2024-04-25T22:01:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:01:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:01:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:01:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:01:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:01:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:01:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:01:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:01:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:01:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:01:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:01:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:01:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:01:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:01:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:01:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:01:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:01:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:01:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.048803794999998, 2024-04-25T22:01:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:01:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:01:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:01:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:01:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:01:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:01:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:01:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:01:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:01:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:01:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:01:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:01:38.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:01:38.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:38.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:01:38.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:01:38.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:01:38.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:01:38.913 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.913 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.914 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.914 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:01:38.914 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:38.914 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.048352721000001, 2024-04-25T22:01:38.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:01:38.914 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.914 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.914 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:38.914 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:38.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:38.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:01:38.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:01:38.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:01:38.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:01:38.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:01:38.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:01:38.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:01:38.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:01:38.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:01:38.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:01:38.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:01:38.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:01:38.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:38.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:01:38.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:01:38.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:01:38.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:01:38.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.918 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.918 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:01:38.918 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:38.918 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.047903134999999, 2024-04-25T22:01:38.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:01:38.919 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.919 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.919 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:38.919 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:38.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:38.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:01:38.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:01:38.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:01:38.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:01:38.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:01:38.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:01:38.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:01:38.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:01:38.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:01:38.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:01:38.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:01:38.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:01:38.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:38.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:01:38.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:01:38.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:01:38.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:01:38.923 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.923 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.923 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.923 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:38.923 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:38.924 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 24.251246647999999, 2024-04-25T22:01:38.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:01:38.924 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.924 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.924 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:38.924 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:38.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:38.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:01:38.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:01:38.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:01:38.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:01:38.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:01:38.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:01:38.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:01:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:01:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:01:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:01:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:01:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:01:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:38.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:01:38.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:01:38.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:38.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:01:38.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:01:38.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:38.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:01:38.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:01:38.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:38.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:01:38.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:01:38.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:01:38.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:01:38.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.929 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.929 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:38.929 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:38.929 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 24.251122665, 2024-04-25T22:01:38.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:01:38.929 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.929 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:38.929 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:38.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:38.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:01:38.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:01:38.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:01:38.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:01:38.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:01:38.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:01:38.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:01:38.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:01:38.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:01:38.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:01:38.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:01:38.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:01:38.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:38.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:01:38.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:01:38.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:38.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:01:38.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:01:38.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:38.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:01:38.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:01:38.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:38.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:01:38.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:01:38.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:01:38.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:01:38.933 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.933 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.933 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.934 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:38.934 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:38.934 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 24.251048729000001, 2024-04-25T22:01:38.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:01:38.934 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.934 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.934 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:38.934 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:38.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:38.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:01:38.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:01:38.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:01:38.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:01:38.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:01:38.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:01:38.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:01:38.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:01:38.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:01:38.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:01:38.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:01:38.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:01:38.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:38.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:01:38.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:01:38.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:38.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:01:38.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:01:38.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:38.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:01:38.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:01:38.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:38.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:01:38.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:01:38.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:01:38.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:01:38.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.939 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:38.939 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:38.939 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 24.250932476999999, 2024-04-25T22:01:38.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:01:38.939 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.940 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:38.940 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:38.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:38.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:01:38.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:01:38.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:01:38.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:01:38.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:01:38.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:01:38.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:01:38.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:01:38.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:01:38.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:01:38.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:01:38.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:01:38.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:38.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:01:38.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:01:38.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:38.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:01:38.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:01:38.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:38.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:01:38.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:01:38.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:38.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:01:38.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:01:38.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:01:38.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:01:38.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.948 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.948 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:38.948 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:38.948 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 24.250769068, 2024-04-25T22:01:38.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:01:38.948 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.949 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:38.949 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:38.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:38.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:01:38.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:01:38.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:01:38.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:01:38.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:01:38.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:01:38.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:01:38.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:01:38.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:01:38.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:01:38.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:01:38.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:01:38.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:38.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:01:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:01:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:01:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:01:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:01:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:01:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:01:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:01:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:01:38.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:01:38.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.953 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.953 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:38.953 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:38.953 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 24.250666872, 2024-04-25T22:01:38.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:01:38.953 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.953 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.953 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:38.954 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:38.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:38.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:01:38.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:01:38.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:01:38.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:01:38.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:01:38.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:01:38.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:01:38.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:01:38.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:01:38.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:01:38.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:01:38.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:01:38.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:38.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:01:38.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:01:38.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:38.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:01:38.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:01:38.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:38.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:01:38.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:01:38.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:38.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:01:38.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:01:38.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:01:38.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:01:38.963 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.963 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.963 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.963 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:38.964 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:38.964 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 24.250587919000001, 2024-04-25T22:01:38.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:01:38.964 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.964 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.964 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:38.964 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:38.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:38.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:01:38.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:01:38.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:01:38.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:01:38.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:01:38.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:01:38.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:01:38.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:01:38.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:01:38.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:01:38.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:01:38.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:01:38.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:38.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:01:38.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:01:38.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:38.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:01:38.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:01:38.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:38.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:01:38.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:01:38.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:38.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:01:38.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:01:38.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:01:38.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:01:38.969 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.969 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.969 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.969 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:38.969 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:38.969 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 24.250522896, 2024-04-25T22:01:38.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:01:38.969 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.969 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.970 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:38.970 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:38.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:38.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:01:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:01:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:01:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:01:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:01:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:01:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:01:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:01:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:01:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:01:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:01:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:01:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:01:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:01:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 24.250444704, 2024-04-25T22:01:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:01:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:01:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:01:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:01:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:01:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:01:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:01:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:01:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:01:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:01:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:01:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:01:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:01:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:01:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:01:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:01:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 24.235798244000001, 2024-04-25T22:01:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:01:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:01:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:01:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:01:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:01:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:01:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:01:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:01:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:01:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:01:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:01:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:01:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:01:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:01:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:01:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:01:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:01:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:01:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 24.235638288000001, 2024-04-25T22:01:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:01:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:01:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:01:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:01:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:01:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:01:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:01:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:01:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:01:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:01:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:01:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:01:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:01:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:01:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:01:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:01:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:01:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:38.986 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:38.987 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-04-25T22:01:38.989 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:01:38.990 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:38.986+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:39.001 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T22:01:39.047 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-04-25T22:01:39.047 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-04-25T22:01:39.047 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-04-25T22:01:39.047 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-04-25T22:01:39.047 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-04-25T22:01:39.047 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-04-25T22:01:39.047 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-04-25T22:01:39.048 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-04-25T22:01:39.048 INFO:teuthology.orchestra.run.smithi044.stdout:/run/lock 2024-04-25T22:01:39.048 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-04-25T22:01:39.048 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-04-25T22:01:39.048 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-04-25T22:01:39.048 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T22:01:39.048 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-04-25T22:01:39.048 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-04-25T22:01:39.048 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-04-25T22:01:39.048 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-04-25T22:01:39.048 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/fs/nfsd 2024-04-25T22:01:39.049 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-04-25T22:01:39.049 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-04-25T22:01:39.049 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T22:01:39.049 INFO:teuthology.orchestra.run.smithi044.stdout:/run/rpc_pipefs 2024-04-25T22:01:39.049 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-04-25T22:01:39.049 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-04-25T22:01:39.049 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-04-25T22:01:39.050 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:01:39.050 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:01:39.050 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-25T22:01:39.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:01:39.051 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-04-25T22:01:39.089 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:39.088+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:39.098 INFO:teuthology.orchestra.run.smithi044.stdout:45 2024-04-25T22:01:39.099 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-25T22:01:39.099 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer -- python3 -c ' 2024-04-25T22:01:39.099 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2024-04-25T22:01:39.099 DEBUG:teuthology.orchestra.run.smithi044:> import re 2024-04-25T22:01:39.099 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-04-25T22:01:39.099 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2024-04-25T22:01:39.099 DEBUG:teuthology.orchestra.run.smithi044:> 2024-04-25T22:01:39.099 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2024-04-25T22:01:39.099 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T22:01:39.100 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2024-04-25T22:01:39.100 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T22:01:39.100 DEBUG:teuthology.orchestra.run.smithi044:> 2024-04-25T22:01:39.100 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2024-04-25T22:01:39.100 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2024-04-25T22:01:39.100 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2024-04-25T22:01:39.100 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2024-04-25T22:01:39.100 DEBUG:teuthology.orchestra.run.smithi044:> 2024-04-25T22:01:39.100 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2024-04-25T22:01:39.100 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T22:01:39.100 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T22:01:39.100 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T22:01:39.100 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2024-04-25T22:01:39.101 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2024-04-25T22:01:39.101 DEBUG:teuthology.orchestra.run.smithi044:> return f 2024-04-25T22:01:39.101 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T22:01:39.101 DEBUG:teuthology.orchestra.run.smithi044:> 2024-04-25T22:01:39.101 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2024-04-25T22:01:39.101 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-04-25T22:01:39.123 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:39.123 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:01:39.123 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:01:39.123 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:39.138 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:01:39.189 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:39.188+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:39.226 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.22891.asok 2024-04-25T22:01:39.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-04-25T22:01:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:01:39.239 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.22891.asok 2024-04-25T22:01:39.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:01:39.239 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.22891.asok status 2024-04-25T22:01:39.265 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:39.265 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:01:39.265 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:01:39.265 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:01:39.266 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:39.279 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:01:39.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:39.288+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:39.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:39.392+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:39.397 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-25T22:01:39.398 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2024-04-25T22:01:39.398 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "d2c45d977142e024a59b68a8f1dce8f0b9840551", 2024-04-25T22:01:39.398 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)", 2024-04-25T22:01:39.398 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2024-04-25T22:01:39.398 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-04-25T22:01:39.398 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T22:01:39.398 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "22891", 2024-04-25T22:01:39.398 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-04-25T22:01:39.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:39.398 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2024-04-25T22:01:39.398 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2024-04-25T22:01:39.398 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4564, 2024-04-25T22:01:39.398 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2024-04-25T22:01:39.398 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-04-25T22:01:39.399 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-04-25T22:01:39.399 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4564 2024-04-25T22:01:39.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:39.399 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-04-25T22:01:39.399 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:39.399 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-04-25T22:01:39.399 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 1056895546 2024-04-25T22:01:39.399 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:39.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:39.399 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-04-25T22:01:39.399 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:39.399 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-04-25T22:01:39.399 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 1056895546 2024-04-25T22:01:39.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:39.399 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.4564 192.168.0.1:0/1056895546", 2024-04-25T22:01:39.400 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/1056895546", 2024-04-25T22:01:39.400 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2024-04-25T22:01:39.400 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 5, 2024-04-25T22:01:39.400 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 19, 2024-04-25T22:01:39.400 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2024-04-25T22:01:39.400 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2024-04-25T22:01:39.400 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2024-04-25T22:01:39.400 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-25T22:01:39.405 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:39.405 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:01:39.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:01:39.406 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:01:39.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.406 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:39.406 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:01:39.406 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.407007374999999, 2024-04-25T22:01:39.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:01:39.406 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.406 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.406 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.406 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:39.406 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:39.406 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:39.407 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:01:39.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.407 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:01:39.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:01:39.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:01:39.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:01:39.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:01:39.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:01:39.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:01:39.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:01:39.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:01:39.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:01:39.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:01:39.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:01:39.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:01:39.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:01:39.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:01:39.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:01:39.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:01:39.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:01:39.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:01:39.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:01:39.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:01:39.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:01:39.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:01:39.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:01:39.412 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.412 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.412 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.412 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:39.413 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:01:39.413 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.224944301999997, 2024-04-25T22:01:39.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:01:39.413 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.413 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.413 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.413 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:39.413 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:39.413 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:39.413 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:01:39.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.413 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:01:39.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:01:39.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:01:39.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:01:39.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:01:39.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:01:39.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:01:39.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:01:39.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:01:39.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:01:39.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:01:39.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:01:39.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:01:39.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:01:39.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:01:39.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:01:39.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:01:39.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:01:39.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:01:39.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:01:39.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:01:39.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:01:39.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:01:39.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:01:39.418 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.418 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.418 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.418 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:39.418 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:01:39.418 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.224900022, 2024-04-25T22:01:39.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:01:39.419 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.419 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.419 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.419 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:39.419 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:39.419 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:39.419 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:01:39.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.419 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:01:39.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:01:39.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:01:39.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:01:39.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:01:39.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:01:39.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:01:39.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:01:39.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:01:39.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:01:39.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:01:39.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:01:39.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:01:39.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:01:39.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:01:39.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:01:39.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:01:39.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:01:39.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:01:39.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:01:39.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:01:39.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:01:39.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:01:39.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:01:39.423 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.424 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.424 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.424 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:39.424 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:01:39.424 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.224843497000002, 2024-04-25T22:01:39.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:01:39.424 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.424 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.424 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.424 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:39.424 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:39.424 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:39.425 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:01:39.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.425 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:01:39.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:01:39.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:01:39.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:01:39.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:01:39.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:01:39.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:01:39.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:01:39.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:01:39.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:01:39.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:01:39.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:01:39.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:01:39.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:01:39.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:01:39.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:01:39.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:01:39.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:01:39.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:01:39.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:01:39.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:01:39.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:01:39.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:01:39.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:01:39.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.429 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.430 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:39.430 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:01:39.430 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.224648254999998, 2024-04-25T22:01:39.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:01:39.430 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.430 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.430 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.430 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:39.430 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:39.430 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:39.430 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:01:39.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.430 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:01:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:01:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:01:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:01:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:01:39.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:01:39.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:01:39.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:01:39.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:01:39.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:01:39.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:01:39.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:01:39.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:01:39.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:01:39.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:01:39.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:01:39.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:01:39.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:01:39.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:01:39.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:01:39.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:01:39.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:01:39.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:01:39.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:01:39.435 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.435 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.435 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.435 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:39.435 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:01:39.435 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.224585961999999, 2024-04-25T22:01:39.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:01:39.435 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.436 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.436 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.436 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:39.436 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:39.436 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:39.436 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:01:39.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.436 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:01:39.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:01:39.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:01:39.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:01:39.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:01:39.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:01:39.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:01:39.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:01:39.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:01:39.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:01:39.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:01:39.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:01:39.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:01:39.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:01:39.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:01:39.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:01:39.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:01:39.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:01:39.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:01:39.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:01:39.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:01:39.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:01:39.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:01:39.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:01:39.440 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.441 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.441 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.441 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:39.441 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:01:39.441 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.224525745999998, 2024-04-25T22:01:39.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:01:39.441 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.441 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.441 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.441 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:39.441 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:39.441 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:39.442 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:01:39.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.442 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:01:39.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:01:39.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:01:39.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:01:39.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:01:39.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:01:39.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:01:39.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:01:39.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:01:39.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:01:39.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:01:39.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:01:39.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:01:39.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:01:39.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:01:39.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:01:39.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:01:39.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:01:39.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:01:39.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:01:39.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:01:39.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:01:39.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:01:39.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:01:39.446 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.446 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.446 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.447 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:39.447 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:01:39.447 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.224336233999999, 2024-04-25T22:01:39.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:01:39.447 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.447 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.447 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.447 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:39.447 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:39.447 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:39.447 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:01:39.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.447 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:01:39.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:01:39.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:01:39.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:01:39.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:01:39.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:01:39.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:01:39.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:01:39.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:01:39.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:01:39.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:01:39.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:01:39.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:01:39.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:01:39.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:01:39.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:01:39.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:01:39.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:01:39.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:01:39.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:01:39.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:01:39.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:01:39.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:01:39.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:01:39.452 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.452 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.452 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.453 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:39.453 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:01:39.453 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.032998399999997, 2024-04-25T22:01:39.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:01:39.453 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.453 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.453 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.453 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:39.453 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:39.453 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:39.453 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:01:39.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.453 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:01:39.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:01:39.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:01:39.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:01:39.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:01:39.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:01:39.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:01:39.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:01:39.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:01:39.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:01:39.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:01:39.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:01:39.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:01:39.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:01:39.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:01:39.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:01:39.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:01:39.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:01:39.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:01:39.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:01:39.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:01:39.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:01:39.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:01:39.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:01:39.458 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.458 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.458 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.458 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:39.458 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:01:39.458 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.032960023000001, 2024-04-25T22:01:39.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:01:39.458 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.458 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.459 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.459 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:39.459 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:39.459 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:39.459 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:01:39.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.459 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:01:39.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:01:39.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:01:39.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:01:39.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:01:39.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:01:39.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:01:39.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:01:39.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:01:39.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:01:39.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:01:39.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:01:39.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:01:39.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:01:39.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:01:39.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:01:39.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:01:39.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:01:39.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:01:39.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:01:39.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:01:39.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:01:39.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:01:39.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:01:39.463 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.464 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.464 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.464 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:39.464 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:01:39.464 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.032908763999998, 2024-04-25T22:01:39.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:01:39.464 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.464 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.464 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.464 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:39.464 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:39.464 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:39.465 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:01:39.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.465 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:01:39.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:01:39.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:01:39.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:01:39.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:01:39.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:01:39.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:01:39.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:01:39.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:01:39.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:01:39.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:01:39.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:01:39.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:01:39.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:01:39.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:01:39.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:01:39.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:01:39.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:01:39.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:01:39.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:01:39.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:01:39.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:01:39.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:01:39.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:01:39.469 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.469 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.469 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.469 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:39.469 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:01:39.470 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.032760115000002, 2024-04-25T22:01:39.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:01:39.470 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.470 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.470 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.470 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:39.470 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:39.470 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:39.470 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:01:39.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.470 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:01:39.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:01:39.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:01:39.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:01:39.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:01:39.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:01:39.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:01:39.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:01:39.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:01:39.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:01:39.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:01:39.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:01:39.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:01:39.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:01:39.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:01:39.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:01:39.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:01:39.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:01:39.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:01:39.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:01:39.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:01:39.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:01:39.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:01:39.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:01:39.475 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.475 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.475 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.475 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:39.475 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:01:39.475 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.032717965000003, 2024-04-25T22:01:39.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:01:39.475 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.475 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.476 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.476 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:39.476 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:39.476 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:39.476 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:01:39.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.476 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:01:39.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:01:39.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:01:39.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:01:39.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:01:39.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:01:39.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:01:39.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:01:39.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:01:39.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:01:39.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:01:39.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:01:39.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:01:39.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:01:39.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:01:39.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:01:39.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:01:39.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:01:39.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:01:39.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:01:39.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:01:39.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:01:39.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:01:39.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:01:39.480 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.480 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.480 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.481 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:39.481 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:01:39.481 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.032680112000001, 2024-04-25T22:01:39.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:01:39.481 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.481 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.481 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.481 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:39.481 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:39.481 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:39.481 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:01:39.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.481 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:01:39.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:01:39.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:01:39.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:01:39.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:01:39.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:01:39.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:01:39.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:01:39.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:01:39.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:01:39.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:01:39.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:01:39.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:01:39.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:01:39.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:01:39.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:01:39.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:01:39.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:01:39.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:01:39.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:01:39.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:01:39.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:01:39.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:01:39.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:01:39.486 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.486 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.486 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.486 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:39.486 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:01:39.486 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.032470787000001, 2024-04-25T22:01:39.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:01:39.487 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.487 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.487 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.487 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:39.487 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:39.487 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:39.487 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:01:39.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.487 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:01:39.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:01:39.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:01:39.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:01:39.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:01:39.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:01:39.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:01:39.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:01:39.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:01:39.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:01:39.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:01:39.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:01:39.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:01:39.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:01:39.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:01:39.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:01:39.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:01:39.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:01:39.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:01:39.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:01:39.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:01:39.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:01:39.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:01:39.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:01:39.492 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.492 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.492 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.492 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:39.492 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:01:39.492 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 24.766219515, 2024-04-25T22:01:39.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:01:39.492 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.492 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.492 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.492 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:01:39.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:01:39.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:01:39.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:01:39.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:01:39.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:01:39.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:01:39.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:01:39.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:01:39.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:01:39.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:01:39.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:01:39.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:01:39.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:01:39.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:01:39.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:01:39.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:01:39.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:01:39.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:01:39.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:01:39.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:01:39.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:01:39.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:01:39.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:01:39.497 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.497 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.497 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.497 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:39.497 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:39.497 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 24.766185674999999, 2024-04-25T22:01:39.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:01:39.497 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.498 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.498 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.498 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:39.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:39.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:39.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:01:39.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:01:39.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:01:39.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:01:39.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:01:39.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:01:39.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:01:39.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:01:39.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:01:39.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:01:39.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:01:39.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:01:39.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:01:39.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:01:39.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:01:39.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:01:39.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:01:39.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:01:39.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:01:39.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:01:39.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:01:39.502 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.502 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.502 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.503 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:39.503 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:01:39.503 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 24.766133978999999, 2024-04-25T22:01:39.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:01:39.503 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.503 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.503 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.503 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:01:39.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:01:39.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:01:39.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:01:39.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:01:39.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:01:39.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:01:39.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:01:39.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:01:39.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:01:39.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:01:39.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:01:39.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:01:39.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:01:39.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:01:39.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:01:39.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:01:39.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:01:39.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:01:39.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:01:39.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:01:39.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:01:39.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:01:39.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:01:39.508 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.508 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.508 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.508 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:39.508 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:01:39.508 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 24.765989526999999, 2024-04-25T22:01:39.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:01:39.508 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.508 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.508 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.508 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:01:39.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:01:39.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:01:39.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:01:39.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:01:39.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:01:39.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:01:39.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:01:39.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:01:39.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:01:39.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:01:39.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:01:39.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:01:39.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:01:39.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:01:39.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:01:39.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:01:39.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:01:39.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:01:39.513 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.513 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.513 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.513 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:39.513 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:01:39.513 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 24.765932806999999, 2024-04-25T22:01:39.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:01:39.513 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:39.513 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:39.514 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.514 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:39.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:39.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:01:39.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:39.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:01:39.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:39.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:39.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:01:39.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:01:39.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:39.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:01:39.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:01:39.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:39.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:01:39.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:01:39.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:01:39.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:01:39.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:39.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:01:39.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:01:39.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:39.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:01:39.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:01:39.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:39.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:01:39.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:01:39.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:39.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:01:39.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:01:39.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:01:39.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:01:39.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:39.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:01:39.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:01:39.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:39.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:39.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:39.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:01:39.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:01:39.518 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.518 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.518 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.518 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:39.518 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:39.518 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:39.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:01:39.520 DEBUG:teuthology.orchestra.run.smithi044:> stat --file-system '--printf=%T 2024-04-25T22:01:39.521 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T22:01:39.521 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:01:39.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:39.520+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:39.528 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2024-04-25T22:01:39.528 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T22:01:39.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:01:39.528 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T22:01:39.583 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T22:01:39.596 INFO:tasks.workunit:Pulling workunits from ref b22e2ebdeb24376882b7bda2a7329c8cccc2276a 2024-04-25T22:01:39.597 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T22:01:39.597 INFO:tasks.workunit:timeout=3h 2024-04-25T22:01:39.597 INFO:tasks.workunit:cleanup=True 2024-04-25T22:01:39.597 DEBUG:teuthology.orchestra.run.smithi044:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T22:01:39.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:39.616+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:39.631 INFO:teuthology.orchestra.run.smithi044.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T22:01:39.631 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-25T22:01:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-04-25T22:01:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:01:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T22:01:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-04-25 22:01:14.620962926 +0000 2024-04-25T22:01:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-04-25 22:01:39.582066170 +0000 2024-04-25T22:01:39.632 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2024-04-25T22:01:39.632 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T22:01:39.632 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T22:01:39.652 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:01:39.652 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:01:39.652 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:01:39.652 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:01:39.666 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:01:39.694 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b22e2ebdeb24376882b7bda2a7329c8cccc2276a 2024-04-25T22:01:39.721 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:39.716+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:39.744 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-25T22:01:39.744 INFO:tasks.workunit.client.0.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T22:01:39.822 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:39.820+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:39.833 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:01:39.833 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:01:39.833 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:01:39.833 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:01:39.833 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:01:39.847 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:01:39.923 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:39.922+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:39.967 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:01:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:01:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:01:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:01:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 4 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:27 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:01:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:01:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.327204981000001, 2024-04-25T22:01:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013281644, 2024-04-25T22:01:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:01:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:01:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:01:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637801+0000", 2024-04-25T22:01:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1299999999999998e-07 2024-04-25T22:01:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637828+0000", 2024-04-25T22:01:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6953000000000001e-05 2024-04-25T22:01:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637873+0000", 2024-04-25T22:01:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4676999999999999e-05 2024-04-25T22:01:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637917+0000", 2024-04-25T22:01:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4815999999999999e-05 2024-04-25T22:01:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644220+0000", 2024-04-25T22:01:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063021049999999997 2024-04-25T22:01:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651082+0000", 2024-04-25T22:01:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068621799999999998 2024-04-25T22:01:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:15 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:01:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:01:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.321797368999999, 2024-04-25T22:01:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010973732, 2024-04-25T22:01:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:01:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:01:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643209+0000", 2024-04-25T22:01:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.003e-06 2024-04-25T22:01:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643230+0000", 2024-04-25T22:01:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0815999999999999e-05 2024-04-25T22:01:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643252+0000", 2024-04-25T22:01:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2586999999999999e-05 2024-04-25T22:01:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643271+0000", 2024-04-25T22:01:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8493000000000001e-05 2024-04-25T22:01:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644387+0000", 2024-04-25T22:01:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011160250000000001 2024-04-25T22:01:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644434+0000", 2024-04-25T22:01:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:01:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654103+0000", 2024-04-25T22:01:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096691360000000001 2024-04-25T22:01:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654181+0000", 2024-04-25T22:01:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8546000000000003e-05 2024-04-25T22:01:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:01:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:01:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.321697013000001, 2024-04-25T22:01:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088132450000000008, 2024-04-25T22:01:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:01:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:01:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643309+0000", 2024-04-25T22:01:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9600000000000008e-07 2024-04-25T22:01:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643339+0000", 2024-04-25T22:01:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9467000000000001e-05 2024-04-25T22:01:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644245+0000", 2024-04-25T22:01:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090648200000000001 2024-04-25T22:01:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644268+0000", 2024-04-25T22:01:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3017e-05 2024-04-25T22:01:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647517+0000", 2024-04-25T22:01:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032491680000000002 2024-04-25T22:01:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647561+0000", 2024-04-25T22:01:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3630000000000001e-05 2024-04-25T22:01:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652041+0000", 2024-04-25T22:01:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044804529999999997 2024-04-25T22:01:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652121+0000", 2024-04-25T22:01:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0031999999999995e-05 2024-04-25T22:01:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:34 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-25T22:01:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:01:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.319608385999999, 2024-04-25T22:01:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089225940000000007, 2024-04-25T22:01:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:01:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:01:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645398+0000", 2024-04-25T22:01:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4360000000000001e-06 2024-04-25T22:01:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645412+0000", 2024-04-25T22:01:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4283e-05 2024-04-25T22:01:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645434+0000", 2024-04-25T22:01:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1237e-05 2024-04-25T22:01:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645459+0000", 2024-04-25T22:01:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5675999999999999e-05 2024-04-25T22:01:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646081+0000", 2024-04-25T22:01:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062128900000000002 2024-04-25T22:01:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646131+0000", 2024-04-25T22:01:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0322999999999999e-05 2024-04-25T22:01:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654185+0000", 2024-04-25T22:01:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080542749999999996 2024-04-25T22:01:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654319+0000", 2024-04-25T22:01:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013407499999999999 2024-04-25T22:01:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:19 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-25T22:01:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:01:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.319506876999998, 2024-04-25T22:01:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076631340000000003, 2024-04-25T22:01:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:01:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:01:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645499+0000", 2024-04-25T22:01:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4300000000000001e-07 2024-04-25T22:01:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645509+0000", 2024-04-25T22:01:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0244000000000001e-05 2024-04-25T22:01:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645523+0000", 2024-04-25T22:01:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3315999999999999e-05 2024-04-25T22:01:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645531+0000", 2024-04-25T22:01:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.123e-06 2024-04-25T22:01:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648260+0000", 2024-04-25T22:01:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027289789999999999 2024-04-25T22:01:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648307+0000", 2024-04-25T22:01:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6969999999999999e-05 2024-04-25T22:01:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653039+0000", 2024-04-25T22:01:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047322299999999996 2024-04-25T22:01:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653161+0000", 2024-04-25T22:01:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012232899999999999 2024-04-25T22:01:39.989 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:39.989 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:01:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.317529216000001, 2024-04-25T22:01:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01271303, 2024-04-25T22:01:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:01:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:01:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647479+0000", 2024-04-25T22:01:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.286e-06 2024-04-25T22:01:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647494+0000", 2024-04-25T22:01:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.521e-05 2024-04-25T22:01:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647525+0000", 2024-04-25T22:01:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0403999999999999e-05 2024-04-25T22:01:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647544+0000", 2024-04-25T22:01:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8743e-05 2024-04-25T22:01:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647895+0000", 2024-04-25T22:01:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035099699999999997 2024-04-25T22:01:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648202+0000", 2024-04-25T22:01:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030758499999999998 2024-04-25T22:01:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648496+0000", 2024-04-25T22:01:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029370699999999999 2024-04-25T22:01:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654605+0000", 2024-04-25T22:01:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061095999999999998 2024-04-25T22:01:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.659959+0000", 2024-04-25T22:01:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053531680000000002 2024-04-25T22:01:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660078+0000", 2024-04-25T22:01:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011981600000000001 2024-04-25T22:01:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660189+0000", 2024-04-25T22:01:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011051400000000001 2024-04-25T22:01:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:01:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.317405124, 2024-04-25T22:01:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013053006000000001, 2024-04-25T22:01:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:01:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:01:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647602+0000", 2024-04-25T22:01:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.604e-06 2024-04-25T22:01:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647611+0000", 2024-04-25T22:01:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5689999999999994e-06 2024-04-25T22:01:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647634+0000", 2024-04-25T22:01:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3227e-05 2024-04-25T22:01:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647660+0000", 2024-04-25T22:01:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5829999999999998e-05 2024-04-25T22:01:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649544+0000", 2024-04-25T22:01:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001884066 2024-04-25T22:01:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649783+0000", 2024-04-25T22:01:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238411 2024-04-25T22:01:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.650794+0000", 2024-04-25T22:01:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010109920000000001 2024-04-25T22:01:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654714+0000", 2024-04-25T22:01:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039202170000000001 2024-04-25T22:01:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660403+0000", 2024-04-25T22:01:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056895940000000001 2024-04-25T22:01:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660551+0000", 2024-04-25T22:01:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014717899999999999 2024-04-25T22:01:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660653+0000", 2024-04-25T22:01:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102317 2024-04-25T22:01:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:17 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:01:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.317320943999999, 2024-04-25T22:01:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010101435000000001, 2024-04-25T22:01:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:01:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:01:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647686+0000", 2024-04-25T22:01:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-04-25T22:01:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647693+0000", 2024-04-25T22:01:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7330000000000003e-06 2024-04-25T22:01:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647711+0000", 2024-04-25T22:01:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7436e-05 2024-04-25T22:01:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647727+0000", 2024-04-25T22:01:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6232999999999999e-05 2024-04-25T22:01:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649249+0000", 2024-04-25T22:01:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015219890000000001 2024-04-25T22:01:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649533+0000", 2024-04-25T22:01:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028391799999999997 2024-04-25T22:01:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649841+0000", 2024-04-25T22:01:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030853400000000001 2024-04-25T22:01:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654622+0000", 2024-04-25T22:01:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047809630000000001 2024-04-25T22:01:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657616+0000", 2024-04-25T22:01:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029938769999999998 2024-04-25T22:01:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657724+0000", 2024-04-25T22:01:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108109 2024-04-25T22:01:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657786+0000", 2024-04-25T22:01:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1196000000000002e-05 2024-04-25T22:01:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:01:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.317132615999999, 2024-04-25T22:01:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010260877999999999, 2024-04-25T22:01:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:01:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:01:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647874+0000", 2024-04-25T22:01:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:01:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647884+0000", 2024-04-25T22:01:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.013e-05 2024-04-25T22:01:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647908+0000", 2024-04-25T22:01:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3592999999999999e-05 2024-04-25T22:01:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647926+0000", 2024-04-25T22:01:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8176999999999999e-05 2024-04-25T22:01:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651480+0000", 2024-04-25T22:01:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035540160000000001 2024-04-25T22:01:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651690+0000", 2024-04-25T22:01:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210249 2024-04-25T22:01:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651986+0000", 2024-04-25T22:01:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000296001 2024-04-25T22:01:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655696+0000", 2024-04-25T22:01:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037098410000000002 2024-04-25T22:01:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657896+0000", 2024-04-25T22:01:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022004630000000002 2024-04-25T22:01:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658035+0000", 2024-04-25T22:01:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013831499999999999 2024-04-25T22:01:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658133+0000", 2024-04-25T22:01:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8553000000000003e-05 2024-04-25T22:01:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:18 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:01:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.317053735999998, 2024-04-25T22:01:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013108712, 2024-04-25T22:01:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:01:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:01:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647953+0000", 2024-04-25T22:01:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.697e-06 2024-04-25T22:01:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647963+0000", 2024-04-25T22:01:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9259999999999995e-06 2024-04-25T22:01:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647982+0000", 2024-04-25T22:01:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-04-25T22:01:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648008+0000", 2024-04-25T22:01:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5956e-05 2024-04-25T22:01:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651686+0000", 2024-04-25T22:01:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678073 2024-04-25T22:01:40.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:40.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652023+0000", 2024-04-25T22:01:40.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033739399999999998 2024-04-25T22:01:40.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:40.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652348+0000", 2024-04-25T22:01:40.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032475000000000001 2024-04-25T22:01:40.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:40.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655883+0000", 2024-04-25T22:01:40.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035353030000000001 2024-04-25T22:01:40.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:40.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660791+0000", 2024-04-25T22:01:40.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049075330000000004 2024-04-25T22:01:40.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:40.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660930+0000", 2024-04-25T22:01:40.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000139856 2024-04-25T22:01:40.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:40.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661060+0000", 2024-04-25T22:01:40.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000129651 2024-04-25T22:01:40.016 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.016 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:40.016 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.016 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:40.016 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:01:40.016 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.316976843999999, 2024-04-25T22:01:40.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012451034, 2024-04-25T22:01:40.016 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:40.016 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:40.016 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.016 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:40.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:40.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:01:40.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:40.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:01:40.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:40.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648030+0000", 2024-04-25T22:01:40.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-04-25T22:01:40.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:40.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648036+0000", 2024-04-25T22:01:40.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8059999999999997e-06 2024-04-25T22:01:40.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:40.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648054+0000", 2024-04-25T22:01:40.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7744000000000002e-05 2024-04-25T22:01:40.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648070+0000", 2024-04-25T22:01:40.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-04-25T22:01:40.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:40.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648875+0000", 2024-04-25T22:01:40.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080444000000000002 2024-04-25T22:01:40.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:40.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649078+0000", 2024-04-25T22:01:40.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020391499999999999 2024-04-25T22:01:40.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:40.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649674+0000", 2024-04-25T22:01:40.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00059555299999999997 2024-04-25T22:01:40.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:40.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653185+0000", 2024-04-25T22:01:40.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035113459999999998 2024-04-25T22:01:40.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:40.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660251+0000", 2024-04-25T22:01:40.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070661350000000003 2024-04-25T22:01:40.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:40.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660382+0000", 2024-04-25T22:01:40.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013095899999999999 2024-04-25T22:01:40.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:40.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660479+0000", 2024-04-25T22:01:40.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6852e-05 2024-04-25T22:01:40.021 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.021 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:40.021 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.021 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:25 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:40.021 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:01:40.021 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.316911031, 2024-04-25T22:01:40.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012691025999999999, 2024-04-25T22:01:40.021 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:40.021 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:40.021 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:40.022 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:40.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:40.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:01:40.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:40.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:01:40.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:40.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648095+0000", 2024-04-25T22:01:40.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.424e-06 2024-04-25T22:01:40.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:40.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648102+0000", 2024-04-25T22:01:40.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2099999999999998e-06 2024-04-25T22:01:40.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:40.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648122+0000", 2024-04-25T22:01:40.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0242999999999999e-05 2024-04-25T22:01:40.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648138+0000", 2024-04-25T22:01:40.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6192999999999999e-05 2024-04-25T22:01:40.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:40.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651461+0000", 2024-04-25T22:01:40.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033225709999999999 2024-04-25T22:01:40.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:40.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651776+0000", 2024-04-25T22:01:40.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031567500000000002 2024-04-25T22:01:40.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:40.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660785+0000", 2024-04-25T22:01:40.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090087099999999996 2024-04-25T22:01:40.025 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.025 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:40.025 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.025 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:40.025 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:01:40.025 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.316848544999999, 2024-04-25T22:01:40.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013102702000000001, 2024-04-25T22:01:40.025 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:40.025 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:40.025 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:40.025 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:40.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:40.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:01:40.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:40.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:01:40.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:40.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648158+0000", 2024-04-25T22:01:40.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2839999999999999e-06 2024-04-25T22:01:40.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:40.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648163+0000", 2024-04-25T22:01:40.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-04-25T22:01:40.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:40.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648181+0000", 2024-04-25T22:01:40.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8484000000000001e-05 2024-04-25T22:01:40.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648196+0000", 2024-04-25T22:01:40.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4496e-05 2024-04-25T22:01:40.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:40.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653737+0000", 2024-04-25T22:01:40.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055414009999999996 2024-04-25T22:01:40.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:40.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653972+0000", 2024-04-25T22:01:40.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000234732 2024-04-25T22:01:40.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:40.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661259+0000", 2024-04-25T22:01:40.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072872689999999999 2024-04-25T22:01:40.029 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.029 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:40.029 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.029 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:40.029 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:01:40.029 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.316791725000002, 2024-04-25T22:01:40.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086984829999999999, 2024-04-25T22:01:40.029 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:40.029 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:40.029 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:40.029 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:40.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:40.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:01:40.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:40.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:01:40.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:40.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648214+0000", 2024-04-25T22:01:40.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-04-25T22:01:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648233+0000", 2024-04-25T22:01:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.878e-05 2024-04-25T22:01:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648252+0000", 2024-04-25T22:01:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8603000000000001e-05 2024-04-25T22:01:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648267+0000", 2024-04-25T22:01:40.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:01:40.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:40.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648846+0000", 2024-04-25T22:01:40.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057923000000000002 2024-04-25T22:01:40.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:40.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649027+0000", 2024-04-25T22:01:40.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181585 2024-04-25T22:01:40.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:40.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.656912+0000", 2024-04-25T22:01:40.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078844589999999999 2024-04-25T22:01:40.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.033 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:40.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.033 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e17/15 ondisk, result = 0)", 2024-04-25T22:01:40.033 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.657534+0000", 2024-04-25T22:01:40.033 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.307471502999999, 2024-04-25T22:01:40.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061820500000000003, 2024-04-25T22:01:40.033 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:40.033 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:40.033 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:40.033 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:40.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:40.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657534+0000", 2024-04-25T22:01:40.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:40.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657534+0000", 2024-04-25T22:01:40.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:40.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657544+0000", 2024-04-25T22:01:40.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0403e-05 2024-04-25T22:01:40.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:40.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657551+0000", 2024-04-25T22:01:40.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1230000000000002e-06 2024-04-25T22:01:40.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:40.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657572+0000", 2024-04-25T22:01:40.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0826999999999999e-05 2024-04-25T22:01:40.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657586+0000", 2024-04-25T22:01:40.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:01:40.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:40.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657861+0000", 2024-04-25T22:01:40.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027576100000000002 2024-04-25T22:01:40.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:40.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657882+0000", 2024-04-25T22:01:40.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0378999999999999e-05 2024-04-25T22:01:40.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:40.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658152+0000", 2024-04-25T22:01:40.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027015200000000001 2024-04-25T22:01:40.037 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.037 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:40.037 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.037 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 6 lcod 17'2)", 2024-04-25T22:01:40.037 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:01:40.037 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.304861808999998, 2024-04-25T22:01:40.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064966000000000004, 2024-04-25T22:01:40.037 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:40.037 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:40.037 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:01:40.037 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:40.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:40.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:01:40.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:40.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:01:40.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:40.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660144+0000", 2024-04-25T22:01:40.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1800000000000005e-07 2024-04-25T22:01:40.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:40.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660181+0000", 2024-04-25T22:01:40.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6408000000000001e-05 2024-04-25T22:01:40.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:40.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660197+0000", 2024-04-25T22:01:40.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6177000000000001e-05 2024-04-25T22:01:40.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660210+0000", 2024-04-25T22:01:40.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:01:40.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:40.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660556+0000", 2024-04-25T22:01:40.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034612899999999998 2024-04-25T22:01:40.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:40.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660793+0000", 2024-04-25T22:01:40.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023656799999999999 2024-04-25T22:01:40.040 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.040 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:40.040 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.041 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-25T22:01:40.041 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660233+0000", 2024-04-25T22:01:40.041 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.304772566, 2024-04-25T22:01:40.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043904799999999999, 2024-04-25T22:01:40.041 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:40.041 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:40.041 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:40.041 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:40.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:40.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660233+0000", 2024-04-25T22:01:40.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:40.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660233+0000", 2024-04-25T22:01:40.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:40.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660233+0000", 2024-04-25T22:01:40.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-04-25T22:01:40.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:40.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660237+0000", 2024-04-25T22:01:40.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.817e-06 2024-04-25T22:01:40.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:40.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660248+0000", 2024-04-25T22:01:40.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0909e-05 2024-04-25T22:01:40.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660255+0000", 2024-04-25T22:01:40.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8680000000000001e-06 2024-04-25T22:01:40.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:40.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660367+0000", 2024-04-25T22:01:40.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000112185 2024-04-25T22:01:40.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:40.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660384+0000", 2024-04-25T22:01:40.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6752000000000002e-05 2024-04-25T22:01:40.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:40.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660672+0000", 2024-04-25T22:01:40.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000287872 2024-04-25T22:01:40.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.044 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:40.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.045 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:18 3.1f e17/15 ondisk, result = 0)", 2024-04-25T22:01:40.045 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:01:40.045 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.304600036, 2024-04-25T22:01:40.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067878299999999997, 2024-04-25T22:01:40.045 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:40.045 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:40.045 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:40.045 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:40.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:40.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:01:40.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:40.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:01:40.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:40.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660406+0000", 2024-04-25T22:01:40.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2800000000000005e-07 2024-04-25T22:01:40.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:40.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660412+0000", 2024-04-25T22:01:40.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0399999999999998e-06 2024-04-25T22:01:40.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:40.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660429+0000", 2024-04-25T22:01:40.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7394e-05 2024-04-25T22:01:40.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660445+0000", 2024-04-25T22:01:40.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6069000000000001e-05 2024-04-25T22:01:40.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:40.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660757+0000", 2024-04-25T22:01:40.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031194300000000002 2024-04-25T22:01:40.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:40.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660776+0000", 2024-04-25T22:01:40.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8862999999999999e-05 2024-04-25T22:01:40.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:40.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661084+0000", 2024-04-25T22:01:40.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030754600000000001 2024-04-25T22:01:40.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.048 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:40.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.048 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-25T22:01:40.048 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:01:40.049 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.304535808000001, 2024-04-25T22:01:40.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080007600000000004, 2024-04-25T22:01:40.049 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:40.049 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:40.049 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:01:40.049 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:40.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:40.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:01:40.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:40.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:01:40.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:40.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660470+0000", 2024-04-25T22:01:40.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4499999999999996e-07 2024-04-25T22:01:40.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:40.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660475+0000", 2024-04-25T22:01:40.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-04-25T22:01:40.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:40.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660490+0000", 2024-04-25T22:01:40.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5274e-05 2024-04-25T22:01:40.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660501+0000", 2024-04-25T22:01:40.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0694e-05 2024-04-25T22:01:40.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:40.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661130+0000", 2024-04-25T22:01:40.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062887499999999999 2024-04-25T22:01:40.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:40.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661269+0000", 2024-04-25T22:01:40.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013955900000000001 2024-04-25T22:01:40.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.052 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:40.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.052 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:01:40.052 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:01:40.052 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.340803809000001, 2024-04-25T22:01:40.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037104880000000001, 2024-04-25T22:01:40.052 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:40.052 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:40.052 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.052 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:40.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:40.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:01:40.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:40.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:01:40.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:40.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:40.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624204+0000", 2024-04-25T22:01:40.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.757e-06 2024-04-25T22:01:40.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:40.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624233+0000", 2024-04-25T22:01:40.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9362000000000001e-05 2024-04-25T22:01:40.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:40.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624264+0000", 2024-04-25T22:01:40.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0843000000000003e-05 2024-04-25T22:01:40.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624280+0000", 2024-04-25T22:01:40.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5577e-05 2024-04-25T22:01:40.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:40.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624458+0000", 2024-04-25T22:01:40.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017821199999999999 2024-04-25T22:01:40.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:40.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624661+0000", 2024-04-25T22:01:40.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020283200000000001 2024-04-25T22:01:40.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:40.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624842+0000", 2024-04-25T22:01:40.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018115500000000001 2024-04-25T22:01:40.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:40.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.626271+0000", 2024-04-25T22:01:40.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001429416 2024-04-25T22:01:40.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:40.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627749+0000", 2024-04-25T22:01:40.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014778650000000001 2024-04-25T22:01:40.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:40.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627849+0000", 2024-04-25T22:01:40.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9261999999999999e-05 2024-04-25T22:01:40.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:40.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:40.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:40.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627912+0000", 2024-04-25T22:01:40.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3207000000000007e-05 2024-04-25T22:01:40.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.057 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:40.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:40.057 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:40.057 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:01:40.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:01:40.059 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:40.056+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:40.160 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:40.158+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:40.191 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:01:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:01:40.191 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:40.206 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:01:40.261 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:40.256+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:40.324 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:40.324 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:01:40.324 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:01:40.324 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:01:40.324 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:40.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:01:40.362 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:40.358+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:40.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:40.464+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:40.465 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:01:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:01:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:01:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:01:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.637775388000001, 2024-04-25T22:01:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:01:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:01:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:01:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:01:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:01:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:01:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:01:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:01:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:01:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:01:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:01:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:01:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:01:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:01:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:01:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:01:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:01:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:01:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.63704457, 2024-04-25T22:01:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:01:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:01:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:01:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:01:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:01:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:01:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:01:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:01:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:01:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:01:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:01:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:01:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:01:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:01:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:01:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:01:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:01:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:01:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.636378299, 2024-04-25T22:01:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:01:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:01:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:01:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:01:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:01:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:01:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:01:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:01:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:01:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:01:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:01:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:01:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:01:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:01:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:01:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:01:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:01:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:01:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.635478399, 2024-04-25T22:01:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:01:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:01:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:01:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:01:40.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:01:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:01:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:01:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:01:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:01:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:01:40.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:01:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:01:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:01:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:01:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:01:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:01:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:01:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:01:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.633442058, 2024-04-25T22:01:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:01:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:01:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:01:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:01:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:01:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:01:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:01:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:01:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:01:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:01:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:01:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:01:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:01:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:01:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:01:40.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:01:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:01:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:01:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.632978721000001, 2024-04-25T22:01:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:01:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:01:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:01:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:01:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:01:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:01:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:01:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:01:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:01:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:01:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:01:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:01:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:01:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:01:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:01:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:01:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:01:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:01:40.491 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.632111842, 2024-04-25T22:01:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:01:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:01:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:01:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:01:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:01:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:01:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:01:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:01:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:01:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:01:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:01:40.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:01:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:01:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:01:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:01:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:01:40.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:01:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:01:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.631660768000003, 2024-04-25T22:01:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:01:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:01:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:01:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:01:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:01:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:01:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:01:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:01:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:01:40.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:01:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:01:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:01:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:01:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:01:40.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:01:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:01:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:01:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:01:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.631211182000001, 2024-04-25T22:01:40.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:01:40.501 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.501 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.501 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:40.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:40.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:01:40.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:01:40.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:01:40.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:01:40.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:01:40.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:01:40.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:01:40.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:01:40.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:01:40.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:01:40.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:01:40.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:01:40.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:40.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:01:40.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:01:40.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:01:40.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:01:40.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.504 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.505 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:40.505 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:40.505 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 25.834554695000001, 2024-04-25T22:01:40.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:01:40.505 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.505 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.505 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:40.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:40.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:01:40.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:01:40.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:01:40.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:01:40.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:01:40.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:01:40.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:01:40.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:01:40.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:01:40.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:01:40.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:01:40.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:01:40.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:40.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:01:40.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:01:40.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:40.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:01:40.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:01:40.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:40.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:01:40.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:01:40.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:40.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:01:40.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:01:40.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:01:40.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:01:40.510 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.510 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.510 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.510 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:40.510 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:40.510 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 25.834430712, 2024-04-25T22:01:40.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:01:40.510 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.510 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.510 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.510 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:40.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:40.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:01:40.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:01:40.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:01:40.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:01:40.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:01:40.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:01:40.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:01:40.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:01:40.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:01:40.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:01:40.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:01:40.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:01:40.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:40.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:01:40.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:01:40.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:40.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:01:40.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:01:40.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:40.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:01:40.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:01:40.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:40.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:01:40.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:01:40.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:01:40.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:01:40.515 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.515 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.515 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.515 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:40.515 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:40.515 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 25.834356776, 2024-04-25T22:01:40.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:01:40.516 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.516 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.516 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:40.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:40.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:01:40.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:01:40.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:01:40.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:01:40.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:01:40.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:01:40.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:01:40.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:01:40.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:01:40.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:01:40.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:01:40.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:01:40.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:40.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:01:40.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:01:40.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:40.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:01:40.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:01:40.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:40.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:01:40.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:01:40.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:40.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:01:40.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:01:40.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:01:40.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:01:40.520 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.520 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.520 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.521 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:40.521 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:40.521 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 25.834240523999998, 2024-04-25T22:01:40.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:01:40.521 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.521 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.521 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:40.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:40.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:01:40.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:01:40.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:01:40.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:01:40.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:01:40.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:01:40.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:01:40.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:01:40.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:01:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:01:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:01:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:01:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:01:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:01:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:01:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:01:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:01:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:01:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:01:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:01:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:01:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:01:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 25.834077114999999, 2024-04-25T22:01:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:01:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:01:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:01:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:01:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:01:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:01:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:01:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:01:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:01:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:01:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:01:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:01:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:01:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:01:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:01:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:01:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:01:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:01:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:01:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:01:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:01:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:01:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:01:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 25.833974918999999, 2024-04-25T22:01:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:01:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:01:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:01:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:01:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:01:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:01:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:01:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:01:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:01:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:01:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:01:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:01:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:01:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:01:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:01:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:01:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:01:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:01:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:01:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:01:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:01:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:01:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:01:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 25.833895966, 2024-04-25T22:01:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:01:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:01:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:01:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:01:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:01:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:01:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:01:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:01:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:01:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:01:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:01:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:01:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:01:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:01:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:01:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:01:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:01:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:01:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:01:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:01:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:01:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:01:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:01:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 25.833830942999999, 2024-04-25T22:01:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:01:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:01:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:01:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:01:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:01:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:01:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:01:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:01:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:01:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:01:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:01:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:01:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:01:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:01:40.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:01:40.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.546 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.546 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:40.546 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:40.546 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 25.833752750999999, 2024-04-25T22:01:40.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:01:40.546 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.546 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:01:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:01:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:01:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:01:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:01:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:01:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:01:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:01:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:01:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:01:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:01:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:01:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:01:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:01:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:01:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 25.819106291000001, 2024-04-25T22:01:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:01:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:01:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:01:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:01:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:01:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:01:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:01:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:01:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:01:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:01:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:01:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:01:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:01:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:01:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:01:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:01:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:01:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:01:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 25.818946335, 2024-04-25T22:01:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:01:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:01:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:01:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:01:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:01:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:01:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:01:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:01:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:01:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:01:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:01:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:01:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:01:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:01:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:01:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:01:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:01:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:40.558 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:40.559 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:01:40.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:40.560+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:40.655 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:01:40.664 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:40.658+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:40.697 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:40.697 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:01:40.697 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:01:40.697 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:40.711 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:01:40.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:40.760+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:40.815 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:01:40.816 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:01:40.836 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:01:40.836 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:01:40.857 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:01:40.857 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:01:40.865 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:40.862+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:40.871 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:40.871 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:40.886 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:01:40.966 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:40.964+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:41.053 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:41.053 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:41.067 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:01:41.068 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:41.068+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:41.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:41.164+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:41.199 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:41.200 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:41.213 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:01:41.298 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:41.296+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:41.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:41.364+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:41.377 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:01:41.377 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:01:41.377 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-25T22:01:41.377 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-25T22:01:41.378 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:41.378 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:41.391 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:01:41.470 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:41.470+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:41.551 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:41.551 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:41.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:01:41.611 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:41.612+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:41.672 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:41.670+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:41.696 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:41.696 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:41.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:41.699 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-25T22:01:41.699 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 20, 2024-04-25T22:01:41.699 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "1ced109c-704f-44b1-9811-a2da74898889", 2024-04-25T22:01:41.700 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-25T22:00:52.024472+0000", 2024-04-25T22:01:41.700 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-25T22:01:39.732893+0000", 2024-04-25T22:01:41.700 INFO:teuthology.orchestra.run.smithi044.stdout: "last_up_change": "2024-04-25T22:01:03.432353+0000", 2024-04-25T22:01:41.700 INFO:teuthology.orchestra.run.smithi044.stdout: "last_in_change": "2024-04-25T22:00:53.642701+0000", 2024-04-25T22:01:41.700 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-25T22:01:41.700 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_num": 5806080, 2024-04-25T22:01:41.700 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_set": [ 2024-04-25T22:01:41.700 INFO:teuthology.orchestra.run.smithi044.stdout: "nodeep-scrub", 2024-04-25T22:01:41.700 INFO:teuthology.orchestra.run.smithi044.stdout: "noscrub", 2024-04-25T22:01:41.700 INFO:teuthology.orchestra.run.smithi044.stdout: "pglog_hardlimit", 2024-04-25T22:01:41.700 INFO:teuthology.orchestra.run.smithi044.stdout: "purged_snapdirs", 2024-04-25T22:01:41.700 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_deletes", 2024-04-25T22:01:41.700 INFO:teuthology.orchestra.run.smithi044.stdout: "sortbitwise" 2024-04-25T22:01:41.700 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:01:41.700 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_version": 4, 2024-04-25T22:01:41.700 INFO:teuthology.orchestra.run.smithi044.stdout: "full_ratio": 0.94999998807907104, 2024-04-25T22:01:41.701 INFO:teuthology.orchestra.run.smithi044.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-25T22:01:41.701 INFO:teuthology.orchestra.run.smithi044.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-25T22:01:41.701 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_snapshot": "", 2024-04-25T22:01:41.701 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_max": 4, 2024-04-25T22:01:41.701 INFO:teuthology.orchestra.run.smithi044.stdout: "max_osd": 3, 2024-04-25T22:01:41.701 INFO:teuthology.orchestra.run.smithi044.stdout: "require_min_compat_client": "luminous", 2024-04-25T22:01:41.701 INFO:teuthology.orchestra.run.smithi044.stdout: "min_compat_client": "jewel", 2024-04-25T22:01:41.701 INFO:teuthology.orchestra.run.smithi044.stdout: "require_osd_release": "squid", 2024-04-25T22:01:41.701 INFO:teuthology.orchestra.run.smithi044.stdout: "allow_crimson": false, 2024-04-25T22:01:41.701 INFO:teuthology.orchestra.run.smithi044.stdout: "pools": [ 2024-04-25T22:01:41.701 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.701 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 1, 2024-04-25T22:01:41.701 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": ".mgr", 2024-04-25T22:01:41.701 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:03.632568+0000", 2024-04-25T22:01:41.701 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:01:41.702 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:01:41.702 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:01:41.702 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:01:41.702 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:01:41.702 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:01:41.702 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:01:41.702 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:01:41.702 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:01:41.702 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:01:41.702 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:01:41.702 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:01:41.702 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 1, 2024-04-25T22:01:41.702 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 1, 2024-04-25T22:01:41.703 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 1, 2024-04-25T22:01:41.703 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 1, 2024-04-25T22:01:41.703 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 1, 2024-04-25T22:01:41.703 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:01:41.703 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:01:41.703 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:01:41.703 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:01:41.703 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:01:41.703 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:01:41.703 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:01:41.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.703 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "11", 2024-04-25T22:01:41.703 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:01:41.703 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:01:41.703 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:01:41.704 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:01:41.704 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:01:41.704 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:01:41.704 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:01:41.704 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:01:41.704 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:01:41.704 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:01:41.704 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:01:41.704 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:01:41.704 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:01:41.704 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:01:41.704 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:01:41.704 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:01:41.704 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:01:41.705 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:01:41.705 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:01:41.705 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:01:41.705 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:01:41.705 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:01:41.705 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:01:41.705 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:01:41.705 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:01:41.705 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:01:41.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.705 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:01:41.705 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:01:41.705 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:01:41.705 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:01:41.705 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:01:41.706 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:01:41.706 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:01:41.706 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:01:41.706 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:01:41.706 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:01:41.706 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:01:41.706 INFO:teuthology.orchestra.run.smithi044.stdout: "options": { 2024-04-25T22:01:41.706 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_max": 32, 2024-04-25T22:01:41.706 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_min": 1 2024-04-25T22:01:41.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.706 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:01:41.708 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": {} 2024-04-25T22:01:41.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.708 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:01:41.708 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:01:41.708 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 2.9900000095367432, 2024-04-25T22:01:41.708 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 2.9900000095367432, 2024-04-25T22:01:41.708 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 0.67000001668930054, 2024-04-25T22:01:41.708 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 2, 2024-04-25T22:01:41.708 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 2, 2024-04-25T22:01:41.708 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:01:41.708 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 1, 2024-04-25T22:01:41.708 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:01:41.708 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.709 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.709 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 2, 2024-04-25T22:01:41.709 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": "rbd", 2024-04-25T22:01:41.709 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:07.995071+0000", 2024-04-25T22:01:41.709 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:01:41.709 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:01:41.709 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:01:41.709 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:01:41.709 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:01:41.709 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:01:41.709 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:01:41.709 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:01:41.709 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:01:41.709 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:01:41.709 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:01:41.710 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:01:41.710 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 8, 2024-04-25T22:01:41.710 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 8, 2024-04-25T22:01:41.710 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 8, 2024-04-25T22:01:41.710 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 8, 2024-04-25T22:01:41.710 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 8, 2024-04-25T22:01:41.710 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:01:41.710 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:01:41.710 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:01:41.710 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:01:41.710 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:01:41.710 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:01:41.710 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:01:41.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.711 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "14", 2024-04-25T22:01:41.711 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:01:41.711 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:01:41.711 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:01:41.711 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:01:41.711 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:01:41.711 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:01:41.711 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:01:41.711 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:01:41.711 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:01:41.711 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:01:41.711 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:01:41.711 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:01:41.711 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:01:41.712 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:01:41.712 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:01:41.712 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:01:41.712 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:01:41.712 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:01:41.712 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:01:41.712 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:01:41.712 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:01:41.712 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:01:41.712 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:01:41.712 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:01:41.712 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:01:41.712 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:01:41.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.712 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:01:41.713 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:01:41.713 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:01:41.713 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:01:41.713 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:01:41.713 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:01:41.713 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:01:41.713 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:01:41.713 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:01:41.713 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:01:41.713 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:01:41.713 INFO:teuthology.orchestra.run.smithi044.stdout: "options": {}, 2024-04-25T22:01:41.713 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:01:41.713 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd": {} 2024-04-25T22:01:41.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.714 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:01:41.714 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:01:41.714 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 1.5, 2024-04-25T22:01:41.714 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 1.5, 2024-04-25T22:01:41.714 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 1, 2024-04-25T22:01:41.714 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 1.5, 2024-04-25T22:01:41.714 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 1.5, 2024-04-25T22:01:41.714 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:01:41.714 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 1, 2024-04-25T22:01:41.714 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:01:41.714 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.714 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.714 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 3, 2024-04-25T22:01:41.714 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": "cephfs_metadata", 2024-04-25T22:01:41.715 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:12.514055+0000", 2024-04-25T22:01:41.715 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:01:41.715 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:01:41.715 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:01:41.715 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:01:41.715 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:01:41.715 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:01:41.715 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:01:41.715 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:01:41.715 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:01:41.715 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:01:41.715 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:01:41.715 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:01:41.715 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 32, 2024-04-25T22:01:41.716 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 32, 2024-04-25T22:01:41.716 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 32, 2024-04-25T22:01:41.716 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 32, 2024-04-25T22:01:41.716 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 32, 2024-04-25T22:01:41.716 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:01:41.716 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:01:41.716 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:01:41.716 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:01:41.716 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:01:41.716 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:01:41.716 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:01:41.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.716 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "17", 2024-04-25T22:01:41.716 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:01:41.717 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:01:41.717 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:01:41.717 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:01:41.717 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:01:41.717 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:01:41.717 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:01:41.717 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:01:41.717 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:01:41.717 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:01:41.717 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:01:41.717 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:01:41.717 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:01:41.717 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:01:41.717 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:01:41.718 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:01:41.718 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:01:41.718 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:01:41.718 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:01:41.718 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:01:41.718 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:01:41.718 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:01:41.718 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:01:41.718 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:01:41.718 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:01:41.718 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:01:41.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.718 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:01:41.718 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:01:41.719 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:01:41.719 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:01:41.719 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:01:41.719 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:01:41.719 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:01:41.719 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:01:41.719 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:01:41.719 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:01:41.719 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:01:41.719 INFO:teuthology.orchestra.run.smithi044.stdout: "options": { 2024-04-25T22:01:41.719 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_bias": 4, 2024-04-25T22:01:41.719 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_min": 16, 2024-04-25T22:01:41.719 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_priority": 5 2024-04-25T22:01:41.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.720 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:01:41.720 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs": { 2024-04-25T22:01:41.720 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": "cephfs" 2024-04-25T22:01:41.720 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.720 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:01:41.720 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:01:41.720 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 1.1299999952316284, 2024-04-25T22:01:41.720 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 1.1299999952316284, 2024-04-25T22:01:41.720 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 1, 2024-04-25T22:01:41.720 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-25T22:01:41.720 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-25T22:01:41.720 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:01:41.720 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 1, 2024-04-25T22:01:41.721 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:01:41.721 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.721 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 4, 2024-04-25T22:01:41.721 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": "cephfs_data", 2024-04-25T22:01:41.721 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:12.963831+0000", 2024-04-25T22:01:41.721 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:01:41.721 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:01:41.721 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:01:41.721 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:01:41.721 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:01:41.721 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:01:41.721 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:01:41.721 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:01:41.722 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:01:41.722 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:01:41.722 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:01:41.722 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:01:41.722 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 64, 2024-04-25T22:01:41.722 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 64, 2024-04-25T22:01:41.722 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 64, 2024-04-25T22:01:41.722 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 64, 2024-04-25T22:01:41.722 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 64, 2024-04-25T22:01:41.722 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:01:41.722 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:01:41.722 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:01:41.722 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:01:41.723 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:01:41.723 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:01:41.723 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:01:41.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.723 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "18", 2024-04-25T22:01:41.723 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:01:41.723 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:01:41.723 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:01:41.723 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:01:41.723 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:01:41.723 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:01:41.723 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:01:41.723 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:01:41.723 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:01:41.723 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:01:41.724 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:01:41.724 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:01:41.724 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:01:41.724 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:01:41.724 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:01:41.724 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:01:41.724 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:01:41.724 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:01:41.724 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:01:41.724 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:01:41.724 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:01:41.724 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:01:41.724 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:01:41.724 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:01:41.724 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:01:41.725 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:01:41.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.725 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:01:41.725 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:01:41.725 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:01:41.725 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:01:41.725 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:01:41.725 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:01:41.725 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:01:41.725 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:01:41.725 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:01:41.725 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:01:41.725 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:01:41.725 INFO:teuthology.orchestra.run.smithi044.stdout: "options": { 2024-04-25T22:01:41.725 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_min": 64, 2024-04-25T22:01:41.726 INFO:teuthology.orchestra.run.smithi044.stdout: "target_size_ratio": 0.89999997615814209 2024-04-25T22:01:41.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.726 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:01:41.726 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs": { 2024-04-25T22:01:41.726 INFO:teuthology.orchestra.run.smithi044.stdout: "data": "cephfs" 2024-04-25T22:01:41.726 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.726 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:01:41.726 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:01:41.726 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 1.1299999952316284, 2024-04-25T22:01:41.726 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 1.1299999952316284, 2024-04-25T22:01:41.726 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 1, 2024-04-25T22:01:41.726 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-25T22:01:41.726 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-25T22:01:41.727 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:01:41.727 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 1, 2024-04-25T22:01:41.727 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:01:41.727 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.727 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.727 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:01:41.727 INFO:teuthology.orchestra.run.smithi044.stdout: "osds": [ 2024-04-25T22:01:41.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.727 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 0, 2024-04-25T22:01:41.727 INFO:teuthology.orchestra.run.smithi044.stdout: "uuid": "098ec92c-0fd2-4231-8beb-09fccca634d9", 2024-04-25T22:01:41.727 INFO:teuthology.orchestra.run.smithi044.stdout: "up": 1, 2024-04-25T22:01:41.727 INFO:teuthology.orchestra.run.smithi044.stdout: "in": 1, 2024-04-25T22:01:41.727 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 1, 2024-04-25T22:01:41.727 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity": 1, 2024-04-25T22:01:41.728 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_begin": 0, 2024-04-25T22:01:41.728 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_end": 0, 2024-04-25T22:01:41.728 INFO:teuthology.orchestra.run.smithi044.stdout: "up_from": 8, 2024-04-25T22:01:41.728 INFO:teuthology.orchestra.run.smithi044.stdout: "up_thru": 16, 2024-04-25T22:01:41.728 INFO:teuthology.orchestra.run.smithi044.stdout: "down_at": 0, 2024-04-25T22:01:41.728 INFO:teuthology.orchestra.run.smithi044.stdout: "lost_at": 0, 2024-04-25T22:01:41.728 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-25T22:01:41.728 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:41.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.728 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:41.728 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6800", 2024-04-25T22:01:41.728 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:01:41.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.728 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.728 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:41.729 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6801", 2024-04-25T22:01:41.729 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:01:41.729 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.729 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:41.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.729 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addrs": { 2024-04-25T22:01:41.729 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:41.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.729 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:41.729 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6802", 2024-04-25T22:01:41.729 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:01:41.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.729 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.729 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:41.730 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6803", 2024-04-25T22:01:41.730 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:01:41.730 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.730 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:41.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.730 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addrs": { 2024-04-25T22:01:41.730 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:41.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.730 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:41.730 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6806", 2024-04-25T22:01:41.730 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:01:41.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.730 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.730 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:41.730 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6807", 2024-04-25T22:01:41.731 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:01:41.731 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.731 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:41.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.731 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addrs": { 2024-04-25T22:01:41.731 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:41.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.731 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:41.731 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6804", 2024-04-25T22:01:41.731 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:01:41.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.731 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:41.731 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6805", 2024-04-25T22:01:41.732 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:01:41.732 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.732 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:41.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.732 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.57:6801/2385981072", 2024-04-25T22:01:41.732 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addr": "172.21.15.57:6803/2385981072", 2024-04-25T22:01:41.732 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addr": "172.21.15.57:6807/2385981072", 2024-04-25T22:01:41.732 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addr": "172.21.15.57:6805/2385981072", 2024-04-25T22:01:41.732 INFO:teuthology.orchestra.run.smithi044.stdout: "state": [ 2024-04-25T22:01:41.732 INFO:teuthology.orchestra.run.smithi044.stdout: "exists", 2024-04-25T22:01:41.732 INFO:teuthology.orchestra.run.smithi044.stdout: "up" 2024-04-25T22:01:41.732 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:41.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.732 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.733 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 1, 2024-04-25T22:01:41.733 INFO:teuthology.orchestra.run.smithi044.stdout: "uuid": "a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef", 2024-04-25T22:01:41.733 INFO:teuthology.orchestra.run.smithi044.stdout: "up": 1, 2024-04-25T22:01:41.733 INFO:teuthology.orchestra.run.smithi044.stdout: "in": 1, 2024-04-25T22:01:41.733 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 1, 2024-04-25T22:01:41.733 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity": 1, 2024-04-25T22:01:41.733 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_begin": 0, 2024-04-25T22:01:41.733 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_end": 0, 2024-04-25T22:01:41.733 INFO:teuthology.orchestra.run.smithi044.stdout: "up_from": 8, 2024-04-25T22:01:41.733 INFO:teuthology.orchestra.run.smithi044.stdout: "up_thru": 16, 2024-04-25T22:01:41.733 INFO:teuthology.orchestra.run.smithi044.stdout: "down_at": 0, 2024-04-25T22:01:41.733 INFO:teuthology.orchestra.run.smithi044.stdout: "lost_at": 0, 2024-04-25T22:01:41.733 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-25T22:01:41.733 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:41.733 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.734 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:41.734 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6800", 2024-04-25T22:01:41.734 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:01:41.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.734 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:41.734 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6801", 2024-04-25T22:01:41.734 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:01:41.734 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.734 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:41.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.734 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addrs": { 2024-04-25T22:01:41.734 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:41.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.735 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:41.735 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6802", 2024-04-25T22:01:41.735 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:01:41.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.735 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:41.735 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6803", 2024-04-25T22:01:41.735 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:01:41.735 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.735 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:41.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.735 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addrs": { 2024-04-25T22:01:41.735 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:41.735 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.735 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:41.736 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6806", 2024-04-25T22:01:41.736 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:01:41.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.736 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:41.736 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6807", 2024-04-25T22:01:41.736 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:01:41.736 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.736 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:41.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.736 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addrs": { 2024-04-25T22:01:41.736 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:41.736 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.736 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:41.737 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6804", 2024-04-25T22:01:41.737 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:01:41.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.737 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.737 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:41.737 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6805", 2024-04-25T22:01:41.737 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:01:41.737 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.737 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:41.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.737 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.79:6801/29975895", 2024-04-25T22:01:41.737 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addr": "172.21.15.79:6803/29975895", 2024-04-25T22:01:41.737 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addr": "172.21.15.79:6807/29975895", 2024-04-25T22:01:41.737 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addr": "172.21.15.79:6805/29975895", 2024-04-25T22:01:41.738 INFO:teuthology.orchestra.run.smithi044.stdout: "state": [ 2024-04-25T22:01:41.738 INFO:teuthology.orchestra.run.smithi044.stdout: "exists", 2024-04-25T22:01:41.738 INFO:teuthology.orchestra.run.smithi044.stdout: "up" 2024-04-25T22:01:41.738 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:41.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.738 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 2, 2024-04-25T22:01:41.738 INFO:teuthology.orchestra.run.smithi044.stdout: "uuid": "290ee5c1-81af-400c-b15a-f63c4794a3b0", 2024-04-25T22:01:41.738 INFO:teuthology.orchestra.run.smithi044.stdout: "up": 1, 2024-04-25T22:01:41.738 INFO:teuthology.orchestra.run.smithi044.stdout: "in": 1, 2024-04-25T22:01:41.738 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 1, 2024-04-25T22:01:41.738 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity": 1, 2024-04-25T22:01:41.738 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_begin": 0, 2024-04-25T22:01:41.738 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_end": 0, 2024-04-25T22:01:41.739 INFO:teuthology.orchestra.run.smithi044.stdout: "up_from": 8, 2024-04-25T22:01:41.739 INFO:teuthology.orchestra.run.smithi044.stdout: "up_thru": 16, 2024-04-25T22:01:41.739 INFO:teuthology.orchestra.run.smithi044.stdout: "down_at": 0, 2024-04-25T22:01:41.739 INFO:teuthology.orchestra.run.smithi044.stdout: "lost_at": 0, 2024-04-25T22:01:41.739 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-25T22:01:41.739 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:41.739 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.739 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:41.739 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6800", 2024-04-25T22:01:41.739 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:01:41.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.739 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.739 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:41.739 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6801", 2024-04-25T22:01:41.739 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:01:41.740 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.740 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:41.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.740 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addrs": { 2024-04-25T22:01:41.740 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:41.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.740 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:41.740 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6802", 2024-04-25T22:01:41.740 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:01:41.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.740 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:41.740 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6803", 2024-04-25T22:01:41.740 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:01:41.740 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.741 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:41.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.741 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addrs": { 2024-04-25T22:01:41.741 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:41.741 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.741 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:41.741 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6806", 2024-04-25T22:01:41.741 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:01:41.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.741 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.741 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:41.741 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6807", 2024-04-25T22:01:41.741 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:01:41.741 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.741 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:41.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.742 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addrs": { 2024-04-25T22:01:41.742 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:41.742 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.742 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:41.742 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6804", 2024-04-25T22:01:41.742 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:01:41.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.742 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.742 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:41.742 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6805", 2024-04-25T22:01:41.742 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:01:41.742 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.742 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:41.743 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.743 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.81:6801/3918111900", 2024-04-25T22:01:41.743 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addr": "172.21.15.81:6803/3918111900", 2024-04-25T22:01:41.743 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addr": "172.21.15.81:6807/3918111900", 2024-04-25T22:01:41.743 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addr": "172.21.15.81:6805/3918111900", 2024-04-25T22:01:41.743 INFO:teuthology.orchestra.run.smithi044.stdout: "state": [ 2024-04-25T22:01:41.743 INFO:teuthology.orchestra.run.smithi044.stdout: "exists", 2024-04-25T22:01:41.743 INFO:teuthology.orchestra.run.smithi044.stdout: "up" 2024-04-25T22:01:41.743 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:41.743 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.743 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:01:41.743 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_xinfo": [ 2024-04-25T22:01:41.743 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.743 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 0, 2024-04-25T22:01:41.744 INFO:teuthology.orchestra.run.smithi044.stdout: "down_stamp": "0.000000", 2024-04-25T22:01:41.744 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_probability": 0, 2024-04-25T22:01:41.744 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_interval": 0, 2024-04-25T22:01:41.744 INFO:teuthology.orchestra.run.smithi044.stdout: "features": 4540701547738038271, 2024-04-25T22:01:41.744 INFO:teuthology.orchestra.run.smithi044.stdout: "old_weight": 0, 2024-04-25T22:01:41.744 INFO:teuthology.orchestra.run.smithi044.stdout: "last_purged_snaps_scrub": "2024-04-25T22:00:59.025944+0000", 2024-04-25T22:01:41.744 INFO:teuthology.orchestra.run.smithi044.stdout: "dead_epoch": 0 2024-04-25T22:01:41.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.744 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.744 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 1, 2024-04-25T22:01:41.744 INFO:teuthology.orchestra.run.smithi044.stdout: "down_stamp": "0.000000", 2024-04-25T22:01:41.744 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_probability": 0, 2024-04-25T22:01:41.744 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_interval": 0, 2024-04-25T22:01:41.744 INFO:teuthology.orchestra.run.smithi044.stdout: "features": 4540701547738038271, 2024-04-25T22:01:41.744 INFO:teuthology.orchestra.run.smithi044.stdout: "old_weight": 0, 2024-04-25T22:01:41.745 INFO:teuthology.orchestra.run.smithi044.stdout: "last_purged_snaps_scrub": "2024-04-25T22:00:58.986080+0000", 2024-04-25T22:01:41.745 INFO:teuthology.orchestra.run.smithi044.stdout: "dead_epoch": 0 2024-04-25T22:01:41.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:41.745 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 2, 2024-04-25T22:01:41.745 INFO:teuthology.orchestra.run.smithi044.stdout: "down_stamp": "0.000000", 2024-04-25T22:01:41.745 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_probability": 0, 2024-04-25T22:01:41.745 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_interval": 0, 2024-04-25T22:01:41.745 INFO:teuthology.orchestra.run.smithi044.stdout: "features": 4540701547738038271, 2024-04-25T22:01:41.745 INFO:teuthology.orchestra.run.smithi044.stdout: "old_weight": 0, 2024-04-25T22:01:41.745 INFO:teuthology.orchestra.run.smithi044.stdout: "last_purged_snaps_scrub": "2024-04-25T22:00:58.971238+0000", 2024-04-25T22:01:41.745 INFO:teuthology.orchestra.run.smithi044.stdout: "dead_epoch": 0 2024-04-25T22:01:41.745 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.745 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:01:41.745 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_upmap": [], 2024-04-25T22:01:41.746 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_upmap_items": [], 2024-04-25T22:01:41.746 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_upmap_primaries": [], 2024-04-25T22:01:41.746 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_temp": [], 2024-04-25T22:01:41.746 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_temp": [], 2024-04-25T22:01:41.746 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklist": {}, 2024-04-25T22:01:41.746 INFO:teuthology.orchestra.run.smithi044.stdout: "range_blocklist": {}, 2024-04-25T22:01:41.746 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profiles": { 2024-04-25T22:01:41.746 INFO:teuthology.orchestra.run.smithi044.stdout: "default": { 2024-04-25T22:01:41.746 INFO:teuthology.orchestra.run.smithi044.stdout: "crush-failure-domain": "osd", 2024-04-25T22:01:41.746 INFO:teuthology.orchestra.run.smithi044.stdout: "k": "2", 2024-04-25T22:01:41.746 INFO:teuthology.orchestra.run.smithi044.stdout: "m": "1", 2024-04-25T22:01:41.746 INFO:teuthology.orchestra.run.smithi044.stdout: "plugin": "jerasure", 2024-04-25T22:01:41.746 INFO:teuthology.orchestra.run.smithi044.stdout: "technique": "reed_sol_van" 2024-04-25T22:01:41.746 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:41.747 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps_queue": [], 2024-04-25T22:01:41.747 INFO:teuthology.orchestra.run.smithi044.stdout: "new_removed_snaps": [], 2024-04-25T22:01:41.747 INFO:teuthology.orchestra.run.smithi044.stdout: "new_purged_snaps": [], 2024-04-25T22:01:41.747 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_node_flags": {}, 2024-04-25T22:01:41.747 INFO:teuthology.orchestra.run.smithi044.stdout: "device_class_flags": {}, 2024-04-25T22:01:41.747 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": { 2024-04-25T22:01:41.747 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode_enabled": false, 2024-04-25T22:01:41.747 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_bucket_count": 0, 2024-04-25T22:01:41.747 INFO:teuthology.orchestra.run.smithi044.stdout: "degraded_stretch_mode": 0, 2024-04-25T22:01:41.747 INFO:teuthology.orchestra.run.smithi044.stdout: "recovering_stretch_mode": 0, 2024-04-25T22:01:41.747 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode_bucket": 0 2024-04-25T22:01:41.747 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:41.747 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-25T22:01:41.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:01:41.750 INFO:tasks.thrashosds.thrasher:j is {'epoch': 20, 'fsid': '1ced109c-704f-44b1-9811-a2da74898889', 'created': '2024-04-25T22:00:52.024472+0000', 'modified': '2024-04-25T22:01:39.732893+0000', 'last_up_change': '2024-04-25T22:01:03.432353+0000', 'last_in_change': '2024-04-25T22:00:53.642701+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:01:03.632568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:01:07.995071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:01:12.514055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:01:12.963831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '098ec92c-0fd2-4231-8beb-09fccca634d9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6800', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6801', 'nonce': 2385981072}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6802', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6803', 'nonce': 2385981072}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6806', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6807', 'nonce': 2385981072}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6804', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6805', 'nonce': 2385981072}]}, 'public_addr': '172.21.15.57:6801/2385981072', 'cluster_addr': '172.21.15.57:6803/2385981072', 'heartbeat_back_addr': '172.21.15.57:6807/2385981072', 'heartbeat_front_addr': '172.21.15.57:6805/2385981072', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 29975895}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 29975895}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 29975895}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 29975895}]}, 'public_addr': '172.21.15.79:6801/29975895', 'cluster_addr': '172.21.15.79:6803/29975895', 'heartbeat_back_addr': '172.21.15.79:6807/29975895', 'heartbeat_front_addr': '172.21.15.79:6805/29975895', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '290ee5c1-81af-400c-b15a-f63c4794a3b0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6800', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6801', 'nonce': 3918111900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 3918111900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 3918111900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 3918111900}]}, 'public_addr': '172.21.15.81:6801/3918111900', 'cluster_addr': '172.21.15.81:6803/3918111900', 'heartbeat_back_addr': '172.21.15.81:6807/3918111900', 'heartbeat_front_addr': '172.21.15.81:6805/3918111900', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:00:59.025944+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:00:58.986080+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:00:58.971238+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-25T22:01:41.750 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:01:41.772 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:01:41.791 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:41.792+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:41.874 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:41.872+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:41.917 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:41.917 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:41.933 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:01:41.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:41.972+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:42.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:42.060 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:01:42.075 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-25T22:01:41.570182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593219,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90028,"kb_used_data":656,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025492,"statfs":{"total":289910292480,"available":289818103808,"internally_reserved":0,"allocated":671744,"data_stored":1364410,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":441,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002677"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.723321+0000","last_change":"2024-04-25T22:01:14.641678+0000","last_active":"2024-04-25T22:01:36.723321+0000","last_peered":"2024-04-25T22:01:36.723321+0000","last_clean":"2024-04-25T22:01:36.723321+0000","last_became_active":"2024-04-25T22:01:14.640808+0000","last_became_peered":"2024-04-25T22:01:14.640808+0000","last_unstale":"2024-04-25T22:01:36.723321+0000","last_undegraded":"2024-04-25T22:01:36.723321+0000","last_fullsized":"2024-04-25T22:01:36.723321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.724474+0000","last_change":"2024-04-25T22:01:14.648935+0000","last_active":"2024-04-25T22:01:36.724474+0000","last_peered":"2024-04-25T22:01:36.724474+0000","last_clean":"2024-04-25T22:01:36.724474+0000","last_became_active":"2024-04-25T22:01:14.647871+0000","last_became_peered":"2024-04-25T22:01:14.647871+0000","last_unstale":"2024-04-25T22:01:36.724474+0000","last_undegraded":"2024-04-25T22:01:36.724474+0000","last_fullsized":"2024-04-25T22:01:36.724474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720950+0000","last_change":"2024-04-25T22:01:14.647262+0000","last_active":"2024-04-25T22:01:36.720950+0000","last_peered":"2024-04-25T22:01:36.720950+0000","last_clean":"2024-04-25T22:01:36.720950+0000","last_became_active":"2024-04-25T22:01:14.645878+0000","last_became_peered":"2024-04-25T22:01:14.645878+0000","last_unstale":"2024-04-25T22:01:36.720950+0000","last_undegraded":"2024-04-25T22:01:36.720950+0000","last_fullsized":"2024-04-25T22:01:36.720950+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720623+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:01:36.720623+0000","last_peered":"2024-04-25T22:01:36.720623+0000","last_clean":"2024-04-25T22:01:36.720623+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:01:36.720623+0000","last_undegraded":"2024-04-25T22:01:36.720623+0000","last_fullsized":"2024-04-25T22:01:36.720623+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.722382+0000","last_change":"2024-04-25T22:01:14.642505+0000","last_active":"2024-04-25T22:01:36.722382+0000","last_peered":"2024-04-25T22:01:36.722382+0000","last_clean":"2024-04-25T22:01:36.722382+0000","last_became_active":"2024-04-25T22:01:14.641574+0000","last_became_peered":"2024-04-25T22:01:14.641574+0000","last_unstale":"2024-04-25T22:01:36.722382+0000","last_undegraded":"2024-04-25T22:01:36.722382+0000","last_fullsized":"2024-04-25T22:01:36.722382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720112+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:01:36.720112+0000","last_peered":"2024-04-25T22:01:36.720112+0000","last_clean":"2024-04-25T22:01:36.720112+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:01:36.720112+0000","last_undegraded":"2024-04-25T22:01:36.720112+0000","last_fullsized":"2024-04-25T22:01:36.720112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720177+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:01:36.720177+0000","last_peered":"2024-04-25T22:01:36.720177+0000","last_clean":"2024-04-25T22:01:36.720177+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:01:36.720177+0000","last_undegraded":"2024-04-25T22:01:36.720177+0000","last_fullsized":"2024-04-25T22:01:36.720177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.719635+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:01:36.719635+0000","last_peered":"2024-04-25T22:01:36.719635+0000","last_clean":"2024-04-25T22:01:36.719635+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:01:36.719635+0000","last_undegraded":"2024-04-25T22:01:36.719635+0000","last_fullsized":"2024-04-25T22:01:36.719635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.911507+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:01:36.911507+0000","last_peered":"2024-04-25T22:01:36.911507+0000","last_clean":"2024-04-25T22:01:36.911507+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:01:36.911507+0000","last_undegraded":"2024-04-25T22:01:36.911507+0000","last_fullsized":"2024-04-25T22:01:36.911507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.723144+0000","last_change":"2024-04-25T22:01:14.647968+0000","last_active":"2024-04-25T22:01:36.723144+0000","last_peered":"2024-04-25T22:01:36.723144+0000","last_clean":"2024-04-25T22:01:36.723144+0000","last_became_active":"2024-04-25T22:01:14.646872+0000","last_became_peered":"2024-04-25T22:01:14.646872+0000","last_unstale":"2024-04-25T22:01:36.723144+0000","last_undegraded":"2024-04-25T22:01:36.723144+0000","last_fullsized":"2024-04-25T22:01:36.723144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720920+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:01:36.720920+0000","last_peered":"2024-04-25T22:01:36.720920+0000","last_clean":"2024-04-25T22:01:36.720920+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:01:36.720920+0000","last_undegraded":"2024-04-25T22:01:36.720920+0000","last_fullsized":"2024-04-25T22:01:36.720920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.722754+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:01:36.722754+0000","last_peered":"2024-04-25T22:01:36.722754+0000","last_clean":"2024-04-25T22:01:36.722754+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:01:36.722754+0000","last_undegraded":"2024-04-25T22:01:36.722754+0000","last_fullsized":"2024-04-25T22:01:36.722754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.722037+0000","last_change":"2024-04-25T22:01:14.643909+0000","last_active":"2024-04-25T22:01:36.722037+0000","last_peered":"2024-04-25T22:01:36.722037+0000","last_clean":"2024-04-25T22:01:36.722037+0000","last_became_active":"2024-04-25T22:01:14.642421+0000","last_became_peered":"2024-04-25T22:01:14.642421+0000","last_unstale":"2024-04-25T22:01:36.722037+0000","last_undegraded":"2024-04-25T22:01:36.722037+0000","last_fullsized":"2024-04-25T22:01:36.722037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720099+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:01:36.720099+0000","last_peered":"2024-04-25T22:01:36.720099+0000","last_clean":"2024-04-25T22:01:36.720099+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:01:36.720099+0000","last_undegraded":"2024-04-25T22:01:36.720099+0000","last_fullsized":"2024-04-25T22:01:36.720099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720210+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:01:36.720210+0000","last_peered":"2024-04-25T22:01:36.720210+0000","last_clean":"2024-04-25T22:01:36.720210+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:01:36.720210+0000","last_undegraded":"2024-04-25T22:01:36.720210+0000","last_fullsized":"2024-04-25T22:01:36.720210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.719658+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:01:36.719658+0000","last_peered":"2024-04-25T22:01:36.719658+0000","last_clean":"2024-04-25T22:01:36.719658+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:01:36.719658+0000","last_undegraded":"2024-04-25T22:01:36.719658+0000","last_fullsized":"2024-04-25T22:01:36.719658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.912340+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:01:36.912340+0000","last_peered":"2024-04-25T22:01:36.912340+0000","last_clean":"2024-04-25T22:01:36.912340+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:01:36.912340+0000","last_undegraded":"2024-04-25T22:01:36.912340+0000","last_fullsized":"2024-04-25T22:01:36.912340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.723837+0000","last_change":"2024-04-25T22:01:14.647317+0000","last_active":"2024-04-25T22:01:36.723837+0000","last_peered":"2024-04-25T22:01:36.723837+0000","last_clean":"2024-04-25T22:01:36.723837+0000","last_became_active":"2024-04-25T22:01:14.644027+0000","last_became_peered":"2024-04-25T22:01:14.644027+0000","last_unstale":"2024-04-25T22:01:36.723837+0000","last_undegraded":"2024-04-25T22:01:36.723837+0000","last_fullsized":"2024-04-25T22:01:36.723837+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.911396+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:01:36.911396+0000","last_peered":"2024-04-25T22:01:36.911396+0000","last_clean":"2024-04-25T22:01:36.911396+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:01:36.911396+0000","last_undegraded":"2024-04-25T22:01:36.911396+0000","last_fullsized":"2024-04-25T22:01:36.911396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720765+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:01:36.720765+0000","last_peered":"2024-04-25T22:01:36.720765+0000","last_clean":"2024-04-25T22:01:36.720765+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:01:36.720765+0000","last_undegraded":"2024-04-25T22:01:36.720765+0000","last_fullsized":"2024-04-25T22:01:36.720765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720620+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:01:36.720620+0000","last_peered":"2024-04-25T22:01:36.720620+0000","last_clean":"2024-04-25T22:01:36.720620+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:01:36.720620+0000","last_undegraded":"2024-04-25T22:01:36.720620+0000","last_fullsized":"2024-04-25T22:01:36.720620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721745+0000","last_change":"2024-04-25T22:01:14.633477+0000","last_active":"2024-04-25T22:01:36.721745+0000","last_peered":"2024-04-25T22:01:36.721745+0000","last_clean":"2024-04-25T22:01:36.721745+0000","last_became_active":"2024-04-25T22:01:14.632678+0000","last_became_peered":"2024-04-25T22:01:14.632678+0000","last_unstale":"2024-04-25T22:01:36.721745+0000","last_undegraded":"2024-04-25T22:01:36.721745+0000","last_fullsized":"2024-04-25T22:01:36.721745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.910337+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:01:36.910337+0000","last_peered":"2024-04-25T22:01:36.910337+0000","last_clean":"2024-04-25T22:01:36.910337+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:01:36.910337+0000","last_undegraded":"2024-04-25T22:01:36.910337+0000","last_fullsized":"2024-04-25T22:01:36.910337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721149+0000","last_change":"2024-04-25T22:01:14.641991+0000","last_active":"2024-04-25T22:01:36.721149+0000","last_peered":"2024-04-25T22:01:36.721149+0000","last_clean":"2024-04-25T22:01:36.721149+0000","last_became_active":"2024-04-25T22:01:14.641244+0000","last_became_peered":"2024-04-25T22:01:14.641244+0000","last_unstale":"2024-04-25T22:01:36.721149+0000","last_undegraded":"2024-04-25T22:01:36.721149+0000","last_fullsized":"2024-04-25T22:01:36.721149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:03.098700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.723480+0000","last_change":"2024-04-25T22:01:14.638103+0000","last_active":"2024-04-25T22:01:36.723480+0000","last_peered":"2024-04-25T22:01:36.723480+0000","last_clean":"2024-04-25T22:01:36.723480+0000","last_became_active":"2024-04-25T22:01:14.636488+0000","last_became_peered":"2024-04-25T22:01:14.636488+0000","last_unstale":"2024-04-25T22:01:36.723480+0000","last_undegraded":"2024-04-25T22:01:36.723480+0000","last_fullsized":"2024-04-25T22:01:36.723480+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.912153+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:01:36.912153+0000","last_peered":"2024-04-25T22:01:36.912153+0000","last_clean":"2024-04-25T22:01:36.912153+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:01:36.912153+0000","last_undegraded":"2024-04-25T22:01:36.912153+0000","last_fullsized":"2024-04-25T22:01:36.912153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721055+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:01:36.721055+0000","last_peered":"2024-04-25T22:01:36.721055+0000","last_clean":"2024-04-25T22:01:36.721055+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:01:36.721055+0000","last_undegraded":"2024-04-25T22:01:36.721055+0000","last_fullsized":"2024-04-25T22:01:36.721055+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.723140+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:01:36.723140+0000","last_peered":"2024-04-25T22:01:36.723140+0000","last_clean":"2024-04-25T22:01:36.723140+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:01:36.723140+0000","last_undegraded":"2024-04-25T22:01:36.723140+0000","last_fullsized":"2024-04-25T22:01:36.723140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.911996+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:01:36.911996+0000","last_peered":"2024-04-25T22:01:36.911996+0000","last_clean":"2024-04-25T22:01:36.911996+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:01:36.911996+0000","last_undegraded":"2024-04-25T22:01:36.911996+0000","last_fullsized":"2024-04-25T22:01:36.911996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.722046+0000","last_change":"2024-04-25T22:01:14.638343+0000","last_active":"2024-04-25T22:01:36.722046+0000","last_peered":"2024-04-25T22:01:36.722046+0000","last_clean":"2024-04-25T22:01:36.722046+0000","last_became_active":"2024-04-25T22:01:14.637694+0000","last_became_peered":"2024-04-25T22:01:14.637694+0000","last_unstale":"2024-04-25T22:01:36.722046+0000","last_undegraded":"2024-04-25T22:01:36.722046+0000","last_fullsized":"2024-04-25T22:01:36.722046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.910375+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:01:36.910375+0000","last_peered":"2024-04-25T22:01:36.910375+0000","last_clean":"2024-04-25T22:01:36.910375+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:01:36.910375+0000","last_undegraded":"2024-04-25T22:01:36.910375+0000","last_fullsized":"2024-04-25T22:01:36.910375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.719786+0000","last_change":"2024-04-25T22:01:14.648196+0000","last_active":"2024-04-25T22:01:36.719786+0000","last_peered":"2024-04-25T22:01:36.719786+0000","last_clean":"2024-04-25T22:01:36.719786+0000","last_became_active":"2024-04-25T22:01:14.647509+0000","last_became_peered":"2024-04-25T22:01:14.647509+0000","last_unstale":"2024-04-25T22:01:36.719786+0000","last_undegraded":"2024-04-25T22:01:36.719786+0000","last_fullsized":"2024-04-25T22:01:36.719786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.722941+0000","last_change":"2024-04-25T22:01:14.641706+0000","last_active":"2024-04-25T22:01:36.722941+0000","last_peered":"2024-04-25T22:01:36.722941+0000","last_clean":"2024-04-25T22:01:36.722941+0000","last_became_active":"2024-04-25T22:01:14.641043+0000","last_became_peered":"2024-04-25T22:01:14.641043+0000","last_unstale":"2024-04-25T22:01:36.722941+0000","last_undegraded":"2024-04-25T22:01:36.722941+0000","last_fullsized":"2024-04-25T22:01:36.722941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720639+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:01:36.720639+0000","last_peered":"2024-04-25T22:01:36.720639+0000","last_clean":"2024-04-25T22:01:36.720639+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:01:36.720639+0000","last_undegraded":"2024-04-25T22:01:36.720639+0000","last_fullsized":"2024-04-25T22:01:36.720639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.722896+0000","last_change":"2024-04-25T22:01:14.635075+0000","last_active":"2024-04-25T22:01:36.722896+0000","last_peered":"2024-04-25T22:01:36.722896+0000","last_clean":"2024-04-25T22:01:36.722896+0000","last_became_active":"2024-04-25T22:01:14.630677+0000","last_became_peered":"2024-04-25T22:01:14.630677+0000","last_unstale":"2024-04-25T22:01:36.722896+0000","last_undegraded":"2024-04-25T22:01:36.722896+0000","last_fullsized":"2024-04-25T22:01:36.722896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.911290+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:01:36.911290+0000","last_peered":"2024-04-25T22:01:36.911290+0000","last_clean":"2024-04-25T22:01:36.911290+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:01:36.911290+0000","last_undegraded":"2024-04-25T22:01:36.911290+0000","last_fullsized":"2024-04-25T22:01:36.911290+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.912537+0000","last_change":"2024-04-25T22:01:14.648527+0000","last_active":"2024-04-25T22:01:36.912537+0000","last_peered":"2024-04-25T22:01:36.912537+0000","last_clean":"2024-04-25T22:01:36.912537+0000","last_became_active":"2024-04-25T22:01:14.645040+0000","last_became_peered":"2024-04-25T22:01:14.645040+0000","last_unstale":"2024-04-25T22:01:36.912537+0000","last_undegraded":"2024-04-25T22:01:36.912537+0000","last_fullsized":"2024-04-25T22:01:36.912537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721790+0000","last_change":"2024-04-25T22:01:13.630817+0000","last_active":"2024-04-25T22:01:36.721790+0000","last_peered":"2024-04-25T22:01:36.721790+0000","last_clean":"2024-04-25T22:01:36.721790+0000","last_became_active":"2024-04-25T22:01:13.629994+0000","last_became_peered":"2024-04-25T22:01:13.629994+0000","last_unstale":"2024-04-25T22:01:36.721790+0000","last_undegraded":"2024-04-25T22:01:36.721790+0000","last_fullsized":"2024-04-25T22:01:36.721790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.911773+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:01:36.911773+0000","last_peered":"2024-04-25T22:01:36.911773+0000","last_clean":"2024-04-25T22:01:36.911773+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:01:36.911773+0000","last_undegraded":"2024-04-25T22:01:36.911773+0000","last_fullsized":"2024-04-25T22:01:36.911773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.719790+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:01:36.719790+0000","last_peered":"2024-04-25T22:01:36.719790+0000","last_clean":"2024-04-25T22:01:36.719790+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:01:36.719790+0000","last_undegraded":"2024-04-25T22:01:36.719790+0000","last_fullsized":"2024-04-25T22:01:36.719790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721405+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:01:36.721405+0000","last_peered":"2024-04-25T22:01:36.721405+0000","last_clean":"2024-04-25T22:01:36.721405+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:01:36.721405+0000","last_undegraded":"2024-04-25T22:01:36.721405+0000","last_fullsized":"2024-04-25T22:01:36.721405+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721206+0000","last_change":"2024-04-25T22:01:14.633805+0000","last_active":"2024-04-25T22:01:36.721206+0000","last_peered":"2024-04-25T22:01:36.721206+0000","last_clean":"2024-04-25T22:01:36.721206+0000","last_became_active":"2024-04-25T22:01:14.633045+0000","last_became_peered":"2024-04-25T22:01:14.633045+0000","last_unstale":"2024-04-25T22:01:36.721206+0000","last_undegraded":"2024-04-25T22:01:36.721206+0000","last_fullsized":"2024-04-25T22:01:36.721206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:43.718628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.724071+0000","last_change":"2024-04-25T22:01:13.631135+0000","last_active":"2024-04-25T22:01:36.724071+0000","last_peered":"2024-04-25T22:01:36.724071+0000","last_clean":"2024-04-25T22:01:36.724071+0000","last_became_active":"2024-04-25T22:01:13.630257+0000","last_became_peered":"2024-04-25T22:01:13.630257+0000","last_unstale":"2024-04-25T22:01:36.724071+0000","last_undegraded":"2024-04-25T22:01:36.724071+0000","last_fullsized":"2024-04-25T22:01:36.724071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721477+0000","last_change":"2024-04-25T22:01:14.630233+0000","last_active":"2024-04-25T22:01:36.721477+0000","last_peered":"2024-04-25T22:01:36.721477+0000","last_clean":"2024-04-25T22:01:36.721477+0000","last_became_active":"2024-04-25T22:01:14.629415+0000","last_became_peered":"2024-04-25T22:01:14.629415+0000","last_unstale":"2024-04-25T22:01:36.721477+0000","last_undegraded":"2024-04-25T22:01:36.721477+0000","last_fullsized":"2024-04-25T22:01:36.721477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:02:28.593163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721589+0000","last_change":"2024-04-25T22:01:13.633106+0000","last_active":"2024-04-25T22:01:36.721589+0000","last_peered":"2024-04-25T22:01:36.721589+0000","last_clean":"2024-04-25T22:01:36.721589+0000","last_became_active":"2024-04-25T22:01:13.631466+0000","last_became_peered":"2024-04-25T22:01:13.631466+0000","last_unstale":"2024-04-25T22:01:36.721589+0000","last_undegraded":"2024-04-25T22:01:36.721589+0000","last_fullsized":"2024-04-25T22:01:36.721589+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:23.095422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720223+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:01:36.720223+0000","last_peered":"2024-04-25T22:01:36.720223+0000","last_clean":"2024-04-25T22:01:36.720223+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:01:36.720223+0000","last_undegraded":"2024-04-25T22:01:36.720223+0000","last_fullsized":"2024-04-25T22:01:36.720223+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721088+0000","last_change":"2024-04-25T22:01:13.626767+0000","last_active":"2024-04-25T22:01:36.721088+0000","last_peered":"2024-04-25T22:01:36.721088+0000","last_clean":"2024-04-25T22:01:36.721088+0000","last_became_active":"2024-04-25T22:01:13.625984+0000","last_became_peered":"2024-04-25T22:01:13.625984+0000","last_unstale":"2024-04-25T22:01:36.721088+0000","last_undegraded":"2024-04-25T22:01:36.721088+0000","last_fullsized":"2024-04-25T22:01:36.721088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.911483+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:01:36.911483+0000","last_peered":"2024-04-25T22:01:36.911483+0000","last_clean":"2024-04-25T22:01:36.911483+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:01:36.911483+0000","last_undegraded":"2024-04-25T22:01:36.911483+0000","last_fullsized":"2024-04-25T22:01:36.911483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.911905+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:01:36.911905+0000","last_peered":"2024-04-25T22:01:36.911905+0000","last_clean":"2024-04-25T22:01:36.911905+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:01:36.911905+0000","last_undegraded":"2024-04-25T22:01:36.911905+0000","last_fullsized":"2024-04-25T22:01:36.911905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720766+0000","last_change":"2024-04-25T22:01:14.650077+0000","last_active":"2024-04-25T22:01:36.720766+0000","last_peered":"2024-04-25T22:01:36.720766+0000","last_clean":"2024-04-25T22:01:36.720766+0000","last_became_active":"2024-04-25T22:01:14.649315+0000","last_became_peered":"2024-04-25T22:01:14.649315+0000","last_unstale":"2024-04-25T22:01:36.720766+0000","last_undegraded":"2024-04-25T22:01:36.720766+0000","last_fullsized":"2024-04-25T22:01:36.720766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.976715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720454+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:01:36.720454+0000","last_peered":"2024-04-25T22:01:36.720454+0000","last_clean":"2024-04-25T22:01:36.720454+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:01:36.720454+0000","last_undegraded":"2024-04-25T22:01:36.720454+0000","last_fullsized":"2024-04-25T22:01:36.720454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721427+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:01:36.721427+0000","last_peered":"2024-04-25T22:01:36.721427+0000","last_clean":"2024-04-25T22:01:36.721427+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:01:36.721427+0000","last_undegraded":"2024-04-25T22:01:36.721427+0000","last_fullsized":"2024-04-25T22:01:36.721427+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721828+0000","last_change":"2024-04-25T22:01:13.631439+0000","last_active":"2024-04-25T22:01:36.721828+0000","last_peered":"2024-04-25T22:01:36.721828+0000","last_clean":"2024-04-25T22:01:36.721828+0000","last_became_active":"2024-04-25T22:01:13.630812+0000","last_became_peered":"2024-04-25T22:01:13.630812+0000","last_unstale":"2024-04-25T22:01:36.721828+0000","last_undegraded":"2024-04-25T22:01:36.721828+0000","last_fullsized":"2024-04-25T22:01:36.721828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721174+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:01:36.721174+0000","last_peered":"2024-04-25T22:01:36.721174+0000","last_clean":"2024-04-25T22:01:36.721174+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:01:36.721174+0000","last_undegraded":"2024-04-25T22:01:36.721174+0000","last_fullsized":"2024-04-25T22:01:36.721174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721427+0000","last_change":"2024-04-25T22:01:13.623342+0000","last_active":"2024-04-25T22:01:36.721427+0000","last_peered":"2024-04-25T22:01:36.721427+0000","last_clean":"2024-04-25T22:01:36.721427+0000","last_became_active":"2024-04-25T22:01:13.621460+0000","last_became_peered":"2024-04-25T22:01:13.621460+0000","last_unstale":"2024-04-25T22:01:36.721427+0000","last_undegraded":"2024-04-25T22:01:36.721427+0000","last_fullsized":"2024-04-25T22:01:36.721427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.912035+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:01:36.912035+0000","last_peered":"2024-04-25T22:01:36.912035+0000","last_clean":"2024-04-25T22:01:36.912035+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:01:36.912035+0000","last_undegraded":"2024-04-25T22:01:36.912035+0000","last_fullsized":"2024-04-25T22:01:36.912035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":224,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720035+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:01:36.720035+0000","last_peered":"2024-04-25T22:01:36.720035+0000","last_clean":"2024-04-25T22:01:36.720035+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:01:36.720035+0000","last_undegraded":"2024-04-25T22:01:36.720035+0000","last_fullsized":"2024-04-25T22:01:36.720035+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720826+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:01:36.720826+0000","last_peered":"2024-04-25T22:01:36.720826+0000","last_clean":"2024-04-25T22:01:36.720826+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:01:36.720826+0000","last_undegraded":"2024-04-25T22:01:36.720826+0000","last_fullsized":"2024-04-25T22:01:36.720826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.911695+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:01:36.911695+0000","last_peered":"2024-04-25T22:01:36.911695+0000","last_clean":"2024-04-25T22:01:36.911695+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:01:36.911695+0000","last_undegraded":"2024-04-25T22:01:36.911695+0000","last_fullsized":"2024-04-25T22:01:36.911695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721577+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:01:36.721577+0000","last_peered":"2024-04-25T22:01:36.721577+0000","last_clean":"2024-04-25T22:01:36.721577+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:01:36.721577+0000","last_undegraded":"2024-04-25T22:01:36.721577+0000","last_fullsized":"2024-04-25T22:01:36.721577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.719966+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:01:36.719966+0000","last_peered":"2024-04-25T22:01:36.719966+0000","last_clean":"2024-04-25T22:01:36.719966+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:01:36.719966+0000","last_undegraded":"2024-04-25T22:01:36.719966+0000","last_fullsized":"2024-04-25T22:01:36.719966+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.910611+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:01:36.910611+0000","last_peered":"2024-04-25T22:01:36.910611+0000","last_clean":"2024-04-25T22:01:36.910611+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:01:36.910611+0000","last_undegraded":"2024-04-25T22:01:36.910611+0000","last_fullsized":"2024-04-25T22:01:36.910611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.723428+0000","last_change":"2024-04-25T22:01:14.645176+0000","last_active":"2024-04-25T22:01:36.723428+0000","last_peered":"2024-04-25T22:01:36.723428+0000","last_clean":"2024-04-25T22:01:36.723428+0000","last_became_active":"2024-04-25T22:01:14.642395+0000","last_became_peered":"2024-04-25T22:01:14.642395+0000","last_unstale":"2024-04-25T22:01:36.723428+0000","last_undegraded":"2024-04-25T22:01:36.723428+0000","last_fullsized":"2024-04-25T22:01:36.723428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.910799+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:01:36.910799+0000","last_peered":"2024-04-25T22:01:36.910799+0000","last_clean":"2024-04-25T22:01:36.910799+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:01:36.910799+0000","last_undegraded":"2024-04-25T22:01:36.910799+0000","last_fullsized":"2024-04-25T22:01:36.910799+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721483+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:01:36.721483+0000","last_peered":"2024-04-25T22:01:36.721483+0000","last_clean":"2024-04-25T22:01:36.721483+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:01:36.721483+0000","last_undegraded":"2024-04-25T22:01:36.721483+0000","last_fullsized":"2024-04-25T22:01:36.721483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.912024+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:01:36.912024+0000","last_peered":"2024-04-25T22:01:36.912024+0000","last_clean":"2024-04-25T22:01:36.912024+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:01:36.912024+0000","last_undegraded":"2024-04-25T22:01:36.912024+0000","last_fullsized":"2024-04-25T22:01:36.912024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720595+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:01:36.720595+0000","last_peered":"2024-04-25T22:01:36.720595+0000","last_clean":"2024-04-25T22:01:36.720595+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:01:36.720595+0000","last_undegraded":"2024-04-25T22:01:36.720595+0000","last_fullsized":"2024-04-25T22:01:36.720595+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720723+0000","last_change":"2024-04-25T22:01:13.627274+0000","last_active":"2024-04-25T22:01:36.720723+0000","last_peered":"2024-04-25T22:01:36.720723+0000","last_clean":"2024-04-25T22:01:36.720723+0000","last_became_active":"2024-04-25T22:01:13.626015+0000","last_became_peered":"2024-04-25T22:01:13.626015+0000","last_unstale":"2024-04-25T22:01:36.720723+0000","last_undegraded":"2024-04-25T22:01:36.720723+0000","last_fullsized":"2024-04-25T22:01:36.720723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.911515+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:01:36.911515+0000","last_peered":"2024-04-25T22:01:36.911515+0000","last_clean":"2024-04-25T22:01:36.911515+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:01:36.911515+0000","last_undegraded":"2024-04-25T22:01:36.911515+0000","last_fullsized":"2024-04-25T22:01:36.911515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721651+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:01:36.721651+0000","last_peered":"2024-04-25T22:01:36.721651+0000","last_clean":"2024-04-25T22:01:36.721651+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:01:36.721651+0000","last_undegraded":"2024-04-25T22:01:36.721651+0000","last_fullsized":"2024-04-25T22:01:36.721651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.911702+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:01:36.911702+0000","last_peered":"2024-04-25T22:01:36.911702+0000","last_clean":"2024-04-25T22:01:36.911702+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:01:36.911702+0000","last_undegraded":"2024-04-25T22:01:36.911702+0000","last_fullsized":"2024-04-25T22:01:36.911702+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721906+0000","last_change":"2024-04-25T22:01:14.637520+0000","last_active":"2024-04-25T22:01:36.721906+0000","last_peered":"2024-04-25T22:01:36.721906+0000","last_clean":"2024-04-25T22:01:36.721906+0000","last_became_active":"2024-04-25T22:01:14.636765+0000","last_became_peered":"2024-04-25T22:01:14.636765+0000","last_unstale":"2024-04-25T22:01:36.721906+0000","last_undegraded":"2024-04-25T22:01:36.721906+0000","last_fullsized":"2024-04-25T22:01:36.721906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.911588+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:01:36.911588+0000","last_peered":"2024-04-25T22:01:36.911588+0000","last_clean":"2024-04-25T22:01:36.911588+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:01:36.911588+0000","last_undegraded":"2024-04-25T22:01:36.911588+0000","last_fullsized":"2024-04-25T22:01:36.911588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.723552+0000","last_change":"2024-04-25T22:01:09.582204+0000","last_active":"2024-04-25T22:01:36.723552+0000","last_peered":"2024-04-25T22:01:36.723552+0000","last_clean":"2024-04-25T22:01:36.723552+0000","last_became_active":"2024-04-25T22:01:09.581494+0000","last_became_peered":"2024-04-25T22:01:09.581494+0000","last_unstale":"2024-04-25T22:01:36.723552+0000","last_undegraded":"2024-04-25T22:01:36.723552+0000","last_fullsized":"2024-04-25T22:01:36.723552+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:13.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.722131+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:01:36.722131+0000","last_peered":"2024-04-25T22:01:36.722131+0000","last_clean":"2024-04-25T22:01:36.722131+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:01:36.722131+0000","last_undegraded":"2024-04-25T22:01:36.722131+0000","last_fullsized":"2024-04-25T22:01:36.722131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.912442+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:01:36.912442+0000","last_peered":"2024-04-25T22:01:36.912442+0000","last_clean":"2024-04-25T22:01:36.912442+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:01:36.912442+0000","last_undegraded":"2024-04-25T22:01:36.912442+0000","last_fullsized":"2024-04-25T22:01:36.912442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.912686+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:01:36.912686+0000","last_peered":"2024-04-25T22:01:36.912686+0000","last_clean":"2024-04-25T22:01:36.912686+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:01:36.912686+0000","last_undegraded":"2024-04-25T22:01:36.912686+0000","last_fullsized":"2024-04-25T22:01:36.912686+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.910565+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:01:36.910565+0000","last_peered":"2024-04-25T22:01:36.910565+0000","last_clean":"2024-04-25T22:01:36.910565+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:01:36.910565+0000","last_undegraded":"2024-04-25T22:01:36.910565+0000","last_fullsized":"2024-04-25T22:01:36.910565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.912694+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:01:36.912694+0000","last_peered":"2024-04-25T22:01:36.912694+0000","last_clean":"2024-04-25T22:01:36.912694+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:01:36.912694+0000","last_undegraded":"2024-04-25T22:01:36.912694+0000","last_fullsized":"2024-04-25T22:01:36.912694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721445+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:01:36.721445+0000","last_peered":"2024-04-25T22:01:36.721445+0000","last_clean":"2024-04-25T22:01:36.721445+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:01:36.721445+0000","last_undegraded":"2024-04-25T22:01:36.721445+0000","last_fullsized":"2024-04-25T22:01:36.721445+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721479+0000","last_change":"2024-04-25T22:01:14.632306+0000","last_active":"2024-04-25T22:01:36.721479+0000","last_peered":"2024-04-25T22:01:36.721479+0000","last_clean":"2024-04-25T22:01:36.721479+0000","last_became_active":"2024-04-25T22:01:14.631179+0000","last_became_peered":"2024-04-25T22:01:14.631179+0000","last_unstale":"2024-04-25T22:01:36.721479+0000","last_undegraded":"2024-04-25T22:01:36.721479+0000","last_fullsized":"2024-04-25T22:01:36.721479+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720429+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:01:36.720429+0000","last_peered":"2024-04-25T22:01:36.720429+0000","last_clean":"2024-04-25T22:01:36.720429+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:01:36.720429+0000","last_undegraded":"2024-04-25T22:01:36.720429+0000","last_fullsized":"2024-04-25T22:01:36.720429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"19'8","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:37.814071+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:01:37.814071+0000","last_peered":"2024-04-25T22:01:37.814071+0000","last_clean":"2024-04-25T22:01:37.814071+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:01:37.814071+0000","last_undegraded":"2024-04-25T22:01:37.814071+0000","last_fullsized":"2024-04-25T22:01:37.814071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.911009+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:01:36.911009+0000","last_peered":"2024-04-25T22:01:36.911009+0000","last_clean":"2024-04-25T22:01:36.911009+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:01:36.911009+0000","last_undegraded":"2024-04-25T22:01:36.911009+0000","last_fullsized":"2024-04-25T22:01:36.911009+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.723251+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:01:36.723251+0000","last_peered":"2024-04-25T22:01:36.723251+0000","last_clean":"2024-04-25T22:01:36.723251+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:01:36.723251+0000","last_undegraded":"2024-04-25T22:01:36.723251+0000","last_fullsized":"2024-04-25T22:01:36.723251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.721274+0000","last_change":"2024-04-25T22:01:13.626710+0000","last_active":"2024-04-25T22:01:36.721274+0000","last_peered":"2024-04-25T22:01:36.721274+0000","last_clean":"2024-04-25T22:01:36.721274+0000","last_became_active":"2024-04-25T22:01:13.625898+0000","last_became_peered":"2024-04-25T22:01:13.625898+0000","last_unstale":"2024-04-25T22:01:36.721274+0000","last_undegraded":"2024-04-25T22:01:36.721274+0000","last_fullsized":"2024-04-25T22:01:36.721274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.910497+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:01:36.910497+0000","last_peered":"2024-04-25T22:01:36.910497+0000","last_clean":"2024-04-25T22:01:36.910497+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:01:36.910497+0000","last_undegraded":"2024-04-25T22:01:36.910497+0000","last_fullsized":"2024-04-25T22:01:36.910497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.912347+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:01:36.912347+0000","last_peered":"2024-04-25T22:01:36.912347+0000","last_clean":"2024-04-25T22:01:36.912347+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:01:36.912347+0000","last_undegraded":"2024-04-25T22:01:36.912347+0000","last_fullsized":"2024-04-25T22:01:36.912347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.910469+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:01:36.910469+0000","last_peered":"2024-04-25T22:01:36.910469+0000","last_clean":"2024-04-25T22:01:36.910469+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:01:36.910469+0000","last_undegraded":"2024-04-25T22:01:36.910469+0000","last_fullsized":"2024-04-25T22:01:36.910469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.723477+0000","last_change":"2024-04-25T22:01:14.639447+0000","last_active":"2024-04-25T22:01:36.723477+0000","last_peered":"2024-04-25T22:01:36.723477+0000","last_clean":"2024-04-25T22:01:36.723477+0000","last_became_active":"2024-04-25T22:01:14.638864+0000","last_became_peered":"2024-04-25T22:01:14.638864+0000","last_unstale":"2024-04-25T22:01:36.723477+0000","last_undegraded":"2024-04-25T22:01:36.723477+0000","last_fullsized":"2024-04-25T22:01:36.723477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.910604+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:01:36.910604+0000","last_peered":"2024-04-25T22:01:36.910604+0000","last_clean":"2024-04-25T22:01:36.910604+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:01:36.910604+0000","last_undegraded":"2024-04-25T22:01:36.910604+0000","last_fullsized":"2024-04-25T22:01:36.910604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.912162+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:01:36.912162+0000","last_peered":"2024-04-25T22:01:36.912162+0000","last_clean":"2024-04-25T22:01:36.912162+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:01:36.912162+0000","last_undegraded":"2024-04-25T22:01:36.912162+0000","last_fullsized":"2024-04-25T22:01:36.912162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.910573+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:01:36.910573+0000","last_peered":"2024-04-25T22:01:36.910573+0000","last_clean":"2024-04-25T22:01:36.910573+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:01:36.910573+0000","last_undegraded":"2024-04-25T22:01:36.910573+0000","last_fullsized":"2024-04-25T22:01:36.910573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.722680+0000","last_change":"2024-04-25T22:01:14.637452+0000","last_active":"2024-04-25T22:01:36.722680+0000","last_peered":"2024-04-25T22:01:36.722680+0000","last_clean":"2024-04-25T22:01:36.722680+0000","last_became_active":"2024-04-25T22:01:14.636407+0000","last_became_peered":"2024-04-25T22:01:14.636407+0000","last_unstale":"2024-04-25T22:01:36.722680+0000","last_undegraded":"2024-04-25T22:01:36.722680+0000","last_fullsized":"2024-04-25T22:01:36.722680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.722299+0000","last_change":"2024-04-25T22:01:13.621997+0000","last_active":"2024-04-25T22:01:36.722299+0000","last_peered":"2024-04-25T22:01:36.722299+0000","last_clean":"2024-04-25T22:01:36.722299+0000","last_became_active":"2024-04-25T22:01:13.620987+0000","last_became_peered":"2024-04-25T22:01:13.620987+0000","last_unstale":"2024-04-25T22:01:36.722299+0000","last_undegraded":"2024-04-25T22:01:36.722299+0000","last_fullsized":"2024-04-25T22:01:36.722299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.722823+0000","last_change":"2024-04-25T22:01:14.650437+0000","last_active":"2024-04-25T22:01:36.722823+0000","last_peered":"2024-04-25T22:01:36.722823+0000","last_clean":"2024-04-25T22:01:36.722823+0000","last_became_active":"2024-04-25T22:01:14.648116+0000","last_became_peered":"2024-04-25T22:01:14.648116+0000","last_unstale":"2024-04-25T22:01:36.722823+0000","last_undegraded":"2024-04-25T22:01:36.722823+0000","last_fullsized":"2024-04-25T22:01:36.722823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.722487+0000","last_change":"2024-04-25T22:01:13.631562+0000","last_active":"2024-04-25T22:01:36.722487+0000","last_peered":"2024-04-25T22:01:36.722487+0000","last_clean":"2024-04-25T22:01:36.722487+0000","last_became_active":"2024-04-25T22:01:13.630731+0000","last_became_peered":"2024-04-25T22:01:13.630731+0000","last_unstale":"2024-04-25T22:01:36.722487+0000","last_undegraded":"2024-04-25T22:01:36.722487+0000","last_fullsized":"2024-04-25T22:01:36.722487+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720367+0000","last_change":"2024-04-25T22:01:14.654909+0000","last_active":"2024-04-25T22:01:36.720367+0000","last_peered":"2024-04-25T22:01:36.720367+0000","last_clean":"2024-04-25T22:01:36.720367+0000","last_became_active":"2024-04-25T22:01:14.653503+0000","last_became_peered":"2024-04-25T22:01:14.653503+0000","last_unstale":"2024-04-25T22:01:36.720367+0000","last_undegraded":"2024-04-25T22:01:36.720367+0000","last_fullsized":"2024-04-25T22:01:36.720367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720972+0000","last_change":"2024-04-25T22:01:13.628356+0000","last_active":"2024-04-25T22:01:36.720972+0000","last_peered":"2024-04-25T22:01:36.720972+0000","last_clean":"2024-04-25T22:01:36.720972+0000","last_became_active":"2024-04-25T22:01:13.626608+0000","last_became_peered":"2024-04-25T22:01:13.626608+0000","last_unstale":"2024-04-25T22:01:36.720972+0000","last_undegraded":"2024-04-25T22:01:36.720972+0000","last_fullsized":"2024-04-25T22:01:36.720972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.720372+0000","last_change":"2024-04-25T22:01:14.648752+0000","last_active":"2024-04-25T22:01:36.720372+0000","last_peered":"2024-04-25T22:01:36.720372+0000","last_clean":"2024-04-25T22:01:36.720372+0000","last_became_active":"2024-04-25T22:01:14.647463+0000","last_became_peered":"2024-04-25T22:01:14.647463+0000","last_unstale":"2024-04-25T22:01:36.720372+0000","last_undegraded":"2024-04-25T22:01:36.720372+0000","last_fullsized":"2024-04-25T22:01:36.720372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:22.946881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.722958+0000","last_change":"2024-04-25T22:01:13.630502+0000","last_active":"2024-04-25T22:01:36.722958+0000","last_peered":"2024-04-25T22:01:36.722958+0000","last_clean":"2024-04-25T22:01:36.722958+0000","last_became_active":"2024-04-25T22:01:13.629854+0000","last_became_peered":"2024-04-25T22:01:13.629854+0000","last_unstale":"2024-04-25T22:01:36.722958+0000","last_undegraded":"2024-04-25T22:01:36.722958+0000","last_fullsized":"2024-04-25T22:01:36.722958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.722084+0000","last_change":"2024-04-25T22:01:14.642104+0000","last_active":"2024-04-25T22:01:36.722084+0000","last_peered":"2024-04-25T22:01:36.722084+0000","last_clean":"2024-04-25T22:01:36.722084+0000","last_became_active":"2024-04-25T22:01:14.641323+0000","last_became_peered":"2024-04-25T22:01:14.641323+0000","last_unstale":"2024-04-25T22:01:36.722084+0000","last_undegraded":"2024-04-25T22:01:36.722084+0000","last_fullsized":"2024-04-25T22:01:36.722084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.912428+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:01:36.912428+0000","last_peered":"2024-04-25T22:01:36.912428+0000","last_clean":"2024-04-25T22:01:36.912428+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:01:36.912428+0000","last_undegraded":"2024-04-25T22:01:36.912428+0000","last_fullsized":"2024-04-25T22:01:36.912428+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.719902+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:01:36.719902+0000","last_peered":"2024-04-25T22:01:36.719902+0000","last_clean":"2024-04-25T22:01:36.719902+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:01:36.719902+0000","last_undegraded":"2024-04-25T22:01:36.719902+0000","last_fullsized":"2024-04-25T22:01:36.719902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:01:36.912142+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:01:36.912142+0000","last_peered":"2024-04-25T22:01:36.912142+0000","last_clean":"2024-04-25T22:01:36.912142+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:01:36.912142+0000","last_undegraded":"2024-04-25T22:01:36.912142+0000","last_fullsized":"2024-04-25T22:01:36.912142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2851,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":245760,"data_stored":651927,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":59940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":253952,"data_stored":652543,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:01:42.079 INFO:tasks.thrashosds.thrasher:Setting 3.1c to [1, 2, 0] 2024-04-25T22:01:42.080 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.1c', '1', '2', '0'] 2024-04-25T22:01:42.080 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.1c 1 2 0 2024-04-25T22:01:42.080 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:42.076+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:42.095 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:42.095 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:42.109 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:01:42.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:42.176+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:42.245 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:42.245 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:42.259 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:01:42.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:42.272+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:42.377 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:42.374+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:42.383 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:42.383 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:42.397 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:01:42.420 INFO:teuthology.orchestra.run.smithi044.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-25T22:01:42.425 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T22:01:42.426 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-25T22:01:42.479 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:42.480+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:42.569 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:42.569 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:42.579 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:42.580+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:42.583 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:01:42.681 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:42.678+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:42.714 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:42.715 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:42.729 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:01:42.749 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-25T22:01:42.781 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:42.780+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:42.845 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:42.846 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:42.861 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:01:42.876 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:01:42.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:42.908+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:42.982 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:42.982 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:42.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:42.980+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:42.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:01:43.029 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:01:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:01:43.047 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:01:43.048 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:01:43.068 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:01:43.068 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:01:43.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:43.080+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:43.125 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:43.125 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:01:43.126 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:01:43.126 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:43.141 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:01:43.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:43.184+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:43.264 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:01:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:01:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:01:43.265 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:43.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:01:43.285 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:43.282+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:43.386 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:43.384+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:43.405 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:01:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:01:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:01:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:01:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.577820074999998, 2024-04-25T22:01:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:01:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:01:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:01:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:01:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:01:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:01:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:01:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:01:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:01:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:01:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:01:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:01:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:01:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:01:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:01:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:01:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:01:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:01:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.577089256999997, 2024-04-25T22:01:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:01:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:01:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:01:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:01:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:01:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:01:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:01:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:01:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:01:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:01:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:01:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:01:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:01:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:01:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:01:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:01:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:01:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:01:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.576422985999997, 2024-04-25T22:01:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:01:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:01:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:01:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:01:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:01:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:01:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:01:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:01:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:01:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:01:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:01:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:01:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:01:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:01:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:01:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:01:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:01:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:01:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.575523085999997, 2024-04-25T22:01:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:01:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:01:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:01:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:01:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:01:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:01:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:01:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:01:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:01:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:01:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:01:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:01:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:01:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:01:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:01:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:01:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:01:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:01:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.573486744999997, 2024-04-25T22:01:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:01:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:01:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:01:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:01:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:01:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:01:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:01:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:01:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:01:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:01:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:01:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:01:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:01:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:01:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:01:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:01:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:01:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:01:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.573023407999997, 2024-04-25T22:01:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:01:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:01:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:01:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:01:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:01:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:01:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:01:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:01:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:01:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:01:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:01:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:01:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:01:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:01:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:01:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:01:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:01:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:01:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.572156528999997, 2024-04-25T22:01:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:01:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:01:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:01:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:01:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:01:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:01:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:01:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:01:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:01:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:01:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:01:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:01:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:01:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:01:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:01:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:01:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:01:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:01:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.571705455, 2024-04-25T22:01:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:01:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:01:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:01:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:01:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:01:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:01:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:01:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:01:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:01:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:01:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:01:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:01:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:01:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:01:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:01:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:01:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:01:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:01:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.571255868999998, 2024-04-25T22:01:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:01:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:01:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:01:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:01:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:01:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:01:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:01:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:01:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:01:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:01:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:01:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:01:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:01:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:01:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:01:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:01:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:01:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.774599382000002, 2024-04-25T22:01:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:01:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:01:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:01:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:01:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:01:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:01:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:01:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:01:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:01:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:01:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:01:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:01:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:01:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:01:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:01:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:01:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:01:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:01:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:01:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:01:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:01:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:01:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:01:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.774475399, 2024-04-25T22:01:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:01:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:01:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:01:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:01:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:01:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:01:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:01:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:01:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:01:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:01:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:01:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:01:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:01:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:01:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:01:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:01:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:01:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:01:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:01:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:01:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:01:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:01:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:01:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.774401463, 2024-04-25T22:01:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:01:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:01:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:01:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:01:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:01:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:01:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:01:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:01:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:01:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:01:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:01:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:01:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:01:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:01:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:01:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:01:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:01:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:01:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:01:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:01:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:01:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:01:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:01:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.774285210999999, 2024-04-25T22:01:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:01:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:01:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:01:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:01:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:01:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:01:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:01:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:01:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:01:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:01:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:01:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:01:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:01:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:01:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:01:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:01:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:01:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:01:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:01:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:01:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:01:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:01:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:01:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.774121802, 2024-04-25T22:01:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:01:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:01:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:01:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:01:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:01:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:01:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:01:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:01:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:01:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:01:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:01:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:01:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:01:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:01:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:01:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:01:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:01:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:01:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:01:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:01:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:01:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:01:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:01:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.774019606, 2024-04-25T22:01:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:01:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:01:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:01:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:01:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:01:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:01:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:01:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:01:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:01:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:01:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:01:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:01:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:01:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:01:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:01:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:01:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:01:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:01:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:01:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:01:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:01:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:01:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:01:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.773940653, 2024-04-25T22:01:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:01:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:01:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:01:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:01:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:01:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:01:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:01:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:01:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:01:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:01:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:01:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:01:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:01:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:01:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:01:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:01:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:01:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:01:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:01:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:01:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:01:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:01:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:01:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.773875629999999, 2024-04-25T22:01:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:01:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:01:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:01:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:01:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:01:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:01:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:01:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:01:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:01:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:01:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:01:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:01:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:01:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:01:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:01:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.773797437999999, 2024-04-25T22:01:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:01:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:01:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:01:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:01:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:01:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:01:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:01:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:01:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:01:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:01:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:01:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:01:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:01:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:01:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:01:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:01:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.759150978000001, 2024-04-25T22:01:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:01:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:01:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:01:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:01:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:01:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:01:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:01:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:01:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:01:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:01:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:01:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:01:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:01:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:01:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:01:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:01:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:01:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:01:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.758991022, 2024-04-25T22:01:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:01:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:01:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:01:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:01:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:01:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:01:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:01:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:01:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:01:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:01:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:01:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:01:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:01:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:01:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:01:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:01:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:01:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:43.498 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:43.500 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:01:43.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:43.496+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:43.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:43.596+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:43.634 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:43.634 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:01:43.634 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:01:43.634 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:43.648 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:01:43.701 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:43.698+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:43.775 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:43.775 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:01:43.775 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:01:43.775 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:01:43.775 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:43.789 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:01:43.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:43.796+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:43.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:43.900+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:43.954 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:43.954 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:01:43.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:01:43.954 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:01:43.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.954 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:43.954 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:01:43.954 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.957928043999999, 2024-04-25T22:01:43.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:01:43.955 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:43.955 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:43.955 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.955 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:43.955 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:43.955 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:43.955 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:01:43.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.955 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:43.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:43.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:01:43.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:43.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:43.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:01:43.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:43.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:43.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:01:43.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:01:43.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:43.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:01:43.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:01:43.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:43.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:01:43.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:01:43.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:01:43.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:01:43.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:43.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:01:43.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:01:43.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:43.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:01:43.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:01:43.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:43.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:01:43.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:01:43.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:43.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:01:43.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:01:43.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:43.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:01:43.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:01:43.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:43.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:01:43.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:01:43.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:43.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:01:43.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:01:43.960 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:43.960 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:43.960 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:43.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.960 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:43.960 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:01:43.960 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.775864970999997, 2024-04-25T22:01:43.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:01:43.960 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:43.960 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:43.960 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.961 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:43.961 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:43.961 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:43.961 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:01:43.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.961 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:43.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:43.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:01:43.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:43.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:43.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:01:43.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:43.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:43.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:01:43.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:01:43.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:43.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:01:43.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:01:43.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:43.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:01:43.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:01:43.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:01:43.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:01:43.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:43.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:01:43.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:01:43.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:43.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:01:43.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:01:43.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:43.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:01:43.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:01:43.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:43.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:01:43.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:01:43.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:43.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:01:43.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:01:43.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:43.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:01:43.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:01:43.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:43.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:01:43.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:01:43.965 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:43.965 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:43.966 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:43.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.966 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:43.966 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:01:43.966 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.775820691, 2024-04-25T22:01:43.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:01:43.966 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:43.966 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:43.966 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.966 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:43.966 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:43.966 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:43.966 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:01:43.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.967 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:43.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:43.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:01:43.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:43.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:43.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:01:43.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:43.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:43.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:01:43.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:01:43.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:43.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:01:43.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:01:43.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:43.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:01:43.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:01:43.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:01:43.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:01:43.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:43.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:01:43.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:01:43.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:43.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:01:43.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:01:43.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:43.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:01:43.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:01:43.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:43.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:01:43.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:01:43.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:43.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:01:43.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:01:43.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:43.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:01:43.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:01:43.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:43.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:01:43.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:01:43.971 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:43.971 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:43.971 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:43.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.971 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:43.971 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:01:43.971 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.775764166000002, 2024-04-25T22:01:43.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:01:43.972 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:43.972 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:43.972 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.972 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:43.972 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:43.972 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:43.972 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:01:43.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.972 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:43.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:43.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:01:43.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:43.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:43.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:01:43.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:43.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:43.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:01:43.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:01:43.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:43.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:01:43.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:01:43.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:43.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:01:43.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:01:43.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:01:43.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:01:43.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:43.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:01:43.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:01:43.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:43.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:01:43.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:01:43.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:43.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:01:43.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:01:43.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:43.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:01:43.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:01:43.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:43.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:01:43.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:01:43.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:43.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:01:43.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:01:43.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:43.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:01:43.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:01:43.977 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:43.977 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:43.977 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:43.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.977 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:43.977 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:01:43.977 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.775568923999998, 2024-04-25T22:01:43.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:01:43.977 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:43.977 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:43.977 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.977 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:43.977 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:43.978 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:43.978 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:01:43.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.978 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:43.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:43.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:01:43.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:43.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:43.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:01:43.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:43.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:43.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:01:43.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:01:43.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:43.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:01:43.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:01:43.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:43.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:01:43.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:01:43.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:01:43.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:01:43.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:43.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:01:43.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:01:43.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:43.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:01:43.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:01:43.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:43.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:01:43.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:01:43.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:43.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:01:43.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:01:43.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:43.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:01:43.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:01:43.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:43.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:01:43.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:01:43.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:43.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:01:43.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:01:43.982 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:43.982 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:43.982 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:43.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.983 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:43.983 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:01:43.983 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.775506630999999, 2024-04-25T22:01:43.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:01:43.983 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:43.983 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:43.983 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.983 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:43.983 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:43.983 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:43.983 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:01:43.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.983 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:43.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:43.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:01:43.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:43.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:43.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:01:43.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:43.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:43.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:01:43.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:01:43.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:43.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:01:43.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:01:43.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:43.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:01:43.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:01:43.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:01:43.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:01:43.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:43.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:01:43.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:01:43.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:43.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:01:43.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:01:43.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:43.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:01:43.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:01:43.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:43.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:01:43.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:01:43.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:43.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:01:43.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:01:43.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:43.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:01:43.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:01:43.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:43.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:01:43.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:01:43.988 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:43.988 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:43.988 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:43.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.988 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:43.988 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:01:43.988 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.775446414999998, 2024-04-25T22:01:43.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:01:43.989 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:43.989 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:43.989 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.989 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:43.989 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:43.989 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:43.989 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:01:43.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.989 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:43.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:43.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:01:43.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:43.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:43.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:01:43.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:43.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:43.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:01:43.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:01:43.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:43.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:01:43.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:01:43.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:43.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:01:43.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:01:43.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:01:43.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:01:43.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:43.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:01:43.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:01:43.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:43.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:01:43.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:01:43.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:43.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:01:43.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:01:43.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:43.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:01:43.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:01:43.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:43.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:01:43.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:01:43.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:43.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:01:43.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:01:43.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:43.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:01:43.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:01:43.994 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:43.994 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:43.994 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:43.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.994 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:43.994 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:01:43.994 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.775256902999999, 2024-04-25T22:01:43.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:01:43.994 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:43.994 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:43.994 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:43.994 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:43.995 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:43.995 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:43.995 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:01:43.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.995 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:43.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:43.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:01:43.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:43.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:43.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:01:43.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:43.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:43.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:01:43.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:01:43.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:43.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:01:43.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:01:43.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:43.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:01:43.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:01:43.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:43.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:01:43.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:01:43.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:43.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:01:43.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:01:43.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:43.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:01:43.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:01:43.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:43.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:01:43.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:01:43.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:43.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:01:43.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:01:43.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:43.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:01:43.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:01:43.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:43.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:01:43.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:01:43.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:43.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:43.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:43.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:01:43.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:01:43.999 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:43.999 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:43.999 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:43.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.000 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:44.000 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:01:44.000 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.583919068999997, 2024-04-25T22:01:44.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:01:44.000 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:44.000 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:44.000 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.000 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:44.000 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:44.000 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:44.000 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:01:44.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.000 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:44.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:44.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:01:44.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:44.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:01:44.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:44.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:01:44.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:01:44.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:44.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:01:44.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:01:44.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:44.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:01:44.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:01:44.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:01:44.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:01:44.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:44.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:01:44.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:01:44.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:44.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:01:44.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:01:44.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:44.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:01:44.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:01:44.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:01:44.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:01:44.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:44.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:01:44.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:01:44.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:44.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:01:44.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:01:44.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:44.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:01:44.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:01:44.005 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.005 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:44.005 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.005 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:44.005 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:01:44.005 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.583880692000001, 2024-04-25T22:01:44.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:01:44.006 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:44.006 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:44.006 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.006 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:44.006 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:44.006 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:44.006 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:01:44.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.006 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:44.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:44.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:01:44.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:44.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:01:44.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:44.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:01:44.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:01:44.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:44.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:01:44.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:01:44.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:44.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:01:44.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:01:44.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:01:44.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:01:44.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:44.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:01:44.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:01:44.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:44.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:01:44.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:01:44.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:44.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:01:44.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:01:44.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:01:44.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:01:44.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:44.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:01:44.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:01:44.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:44.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:01:44.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:01:44.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:44.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:01:44.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:01:44.011 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.011 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:44.011 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.011 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:44.011 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:01:44.011 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.583829432999998, 2024-04-25T22:01:44.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:01:44.011 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:44.012 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:44.012 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.012 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:44.012 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:44.012 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:44.012 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:01:44.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.012 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:44.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:44.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:01:44.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:44.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:01:44.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:44.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:01:44.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:01:44.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:44.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:01:44.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:01:44.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:44.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:01:44.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:01:44.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:01:44.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:01:44.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:44.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:01:44.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:01:44.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:44.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:01:44.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:01:44.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:44.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:01:44.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:01:44.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:01:44.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:01:44.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:44.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:01:44.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:01:44.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:44.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:01:44.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:01:44.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:44.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:01:44.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:01:44.017 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.017 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:44.017 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.017 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:44.017 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:01:44.017 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.583680784000002, 2024-04-25T22:01:44.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:01:44.017 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:44.017 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:44.017 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.017 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:44.017 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:44.017 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:44.018 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:01:44.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.018 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:44.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:44.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:01:44.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:44.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:01:44.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:44.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:01:44.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:01:44.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:44.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:01:44.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:01:44.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:44.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:01:44.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:01:44.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:01:44.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:01:44.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:44.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:01:44.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:01:44.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:44.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:01:44.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:01:44.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:44.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:01:44.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:01:44.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:01:44.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:01:44.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:44.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:01:44.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:01:44.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:44.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:01:44.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:01:44.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:44.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:01:44.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:01:44.022 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.022 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:44.022 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.023 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:44.023 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:01:44.023 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.583638634000003, 2024-04-25T22:01:44.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:01:44.023 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:44.023 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:44.023 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.023 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:44.023 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:44.023 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:44.023 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:01:44.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.023 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:44.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:44.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:01:44.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:44.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:01:44.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:44.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:01:44.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:01:44.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:44.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:01:44.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:01:44.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:44.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:01:44.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:01:44.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:01:44.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:01:44.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:44.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:01:44.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:01:44.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:44.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:01:44.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:01:44.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:44.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:01:44.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:01:44.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:01:44.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:01:44.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:44.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:01:44.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:01:44.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:44.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:01:44.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:01:44.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:44.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:01:44.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:01:44.028 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.028 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:44.028 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.028 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:44.028 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:01:44.029 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.583600781000001, 2024-04-25T22:01:44.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:01:44.029 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:44.029 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:44.029 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.029 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:44.029 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:44.029 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:44.029 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:01:44.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.029 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:44.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:44.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:01:44.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:44.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:01:44.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:44.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:01:44.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:01:44.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:44.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:01:44.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:01:44.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:44.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:01:44.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:01:44.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:01:44.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:01:44.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:44.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:01:44.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:01:44.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:44.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:01:44.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:01:44.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:44.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:01:44.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:01:44.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:01:44.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:01:44.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:44.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:01:44.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:01:44.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:44.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:01:44.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:01:44.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:44.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:01:44.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:01:44.034 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.034 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:44.034 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.034 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:44.034 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:01:44.034 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.583391456000001, 2024-04-25T22:01:44.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:01:44.034 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:44.034 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:44.035 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.035 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:44.035 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:44.035 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:44.035 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:01:44.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.035 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:44.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:44.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:01:44.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:44.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:01:44.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:44.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:01:44.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:01:44.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:44.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:01:44.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:01:44.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:44.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:01:44.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:01:44.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:01:44.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:01:44.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:44.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:01:44.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:01:44.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:44.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:01:44.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:01:44.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:44.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:01:44.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:01:44.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:44.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:01:44.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:01:44.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:01:44.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:01:44.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:44.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:01:44.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:01:44.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:44.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:01:44.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:01:44.039 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.039 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:44.040 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.040 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:44.040 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:01:44.040 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 29.317140183999999, 2024-04-25T22:01:44.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:01:44.040 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:44.040 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:44.040 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.040 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:44.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:44.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:01:44.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:44.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:01:44.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:44.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:01:44.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:01:44.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:44.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:01:44.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:01:44.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:44.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:01:44.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:01:44.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:01:44.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:01:44.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:44.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:01:44.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:01:44.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:44.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:01:44.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:01:44.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:44.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:01:44.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:01:44.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:44.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:01:44.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:01:44.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:01:44.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:01:44.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:44.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:01:44.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:01:44.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:44.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:01:44.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:01:44.045 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.045 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:44.045 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.045 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:44.045 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:44.045 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 29.317106343999999, 2024-04-25T22:01:44.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:01:44.045 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:44.045 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:44.045 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.045 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:44.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:44.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:44.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:44.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:44.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:44.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:44.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:01:44.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:44.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:01:44.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:01:44.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:44.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:01:44.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:01:44.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:01:44.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:01:44.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:44.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:01:44.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:01:44.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:44.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:01:44.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:01:44.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:44.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:01:44.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:01:44.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:44.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:01:44.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:01:44.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:01:44.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:01:44.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:44.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:01:44.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:01:44.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:44.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:01:44.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:01:44.050 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.050 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:44.050 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.050 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:44.050 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:01:44.050 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 29.317054647999999, 2024-04-25T22:01:44.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:01:44.051 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:44.051 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:44.051 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.051 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:44.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:44.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:01:44.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:44.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:01:44.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:44.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:01:44.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:01:44.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:44.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:01:44.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:01:44.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:44.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:01:44.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:01:44.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:01:44.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:01:44.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:44.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:01:44.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:01:44.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:44.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:01:44.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:01:44.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:44.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:01:44.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:01:44.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:44.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:01:44.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:01:44.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:01:44.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:01:44.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:44.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:01:44.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:01:44.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:44.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:01:44.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:01:44.055 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.055 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:44.056 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.056 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:44.056 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:01:44.056 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 29.316910195999998, 2024-04-25T22:01:44.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:01:44.056 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:44.056 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:44.056 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.056 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:44.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:44.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:01:44.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:44.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:01:44.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:44.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:01:44.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:01:44.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:44.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:01:44.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:01:44.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:44.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:01:44.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:01:44.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:01:44.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:01:44.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:44.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:01:44.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:01:44.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:44.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:01:44.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:01:44.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:44.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:01:44.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:01:44.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:44.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:01:44.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:01:44.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:01:44.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:01:44.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:44.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:01:44.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:01:44.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:44.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:01:44.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:01:44.061 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.061 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:44.061 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.061 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:44.061 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:01:44.061 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 29.316853475999999, 2024-04-25T22:01:44.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:01:44.061 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:44.061 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:44.061 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.061 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:44.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:44.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:01:44.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:44.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:01:44.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:44.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:44.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:01:44.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:01:44.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:44.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:01:44.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:01:44.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:44.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:01:44.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:01:44.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:01:44.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:01:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:01:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:01:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:01:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:01:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:01:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:01:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:01:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:01:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:01:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:01:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:01:44.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:01:44.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:44.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:44.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:44.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:01:44.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:01:44.066 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.066 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:44.066 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.066 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:44.066 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:44.066 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:44.068 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:01:44.068 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:44.068+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:44.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:44.164+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:44.201 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:01:44.202 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:01:44.202 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:01:44.202 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:01:44.216 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:01:44.270 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:44.270+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:44.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:44.368+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:44.382 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:01:44.382 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:01:44.382 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:01:44.382 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:01:44.382 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:01:44.396 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:01:44.472 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:44.472+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:44.566 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:01:44.567 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:01:44.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:01:44.567 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:01:44.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.567 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 4 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:27 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:01:44.567 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:01:44.567 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.926304679000001, 2024-04-25T22:01:44.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013281644, 2024-04-25T22:01:44.567 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.567 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.567 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:01:44.567 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:01:44.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:01:44.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637801+0000", 2024-04-25T22:01:44.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1299999999999998e-07 2024-04-25T22:01:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637828+0000", 2024-04-25T22:01:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6953000000000001e-05 2024-04-25T22:01:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637873+0000", 2024-04-25T22:01:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4676999999999999e-05 2024-04-25T22:01:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637917+0000", 2024-04-25T22:01:44.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4815999999999999e-05 2024-04-25T22:01:44.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644220+0000", 2024-04-25T22:01:44.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063021049999999997 2024-04-25T22:01:44.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651082+0000", 2024-04-25T22:01:44.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068621799999999998 2024-04-25T22:01:44.570 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.570 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:15 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:01:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:01:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.920897066999999, 2024-04-25T22:01:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010973732, 2024-04-25T22:01:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:01:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:01:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643209+0000", 2024-04-25T22:01:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.003e-06 2024-04-25T22:01:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643230+0000", 2024-04-25T22:01:44.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0815999999999999e-05 2024-04-25T22:01:44.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643252+0000", 2024-04-25T22:01:44.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2586999999999999e-05 2024-04-25T22:01:44.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643271+0000", 2024-04-25T22:01:44.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8493000000000001e-05 2024-04-25T22:01:44.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644387+0000", 2024-04-25T22:01:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011160250000000001 2024-04-25T22:01:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644434+0000", 2024-04-25T22:01:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:01:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654103+0000", 2024-04-25T22:01:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096691360000000001 2024-04-25T22:01:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654181+0000", 2024-04-25T22:01:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8546000000000003e-05 2024-04-25T22:01:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:01:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:01:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.920796711000001, 2024-04-25T22:01:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088132450000000008, 2024-04-25T22:01:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.576 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.576 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:01:44.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:01:44.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643309+0000", 2024-04-25T22:01:44.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9600000000000008e-07 2024-04-25T22:01:44.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643339+0000", 2024-04-25T22:01:44.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9467000000000001e-05 2024-04-25T22:01:44.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644245+0000", 2024-04-25T22:01:44.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090648200000000001 2024-04-25T22:01:44.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644268+0000", 2024-04-25T22:01:44.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3017e-05 2024-04-25T22:01:44.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647517+0000", 2024-04-25T22:01:44.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032491680000000002 2024-04-25T22:01:44.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:44.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647561+0000", 2024-04-25T22:01:44.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3630000000000001e-05 2024-04-25T22:01:44.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:44.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652041+0000", 2024-04-25T22:01:44.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044804529999999997 2024-04-25T22:01:44.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652121+0000", 2024-04-25T22:01:44.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0031999999999995e-05 2024-04-25T22:01:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:34 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-25T22:01:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:01:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.918708083999999, 2024-04-25T22:01:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089225940000000007, 2024-04-25T22:01:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:01:44.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:01:44.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645398+0000", 2024-04-25T22:01:44.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4360000000000001e-06 2024-04-25T22:01:44.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645412+0000", 2024-04-25T22:01:44.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4283e-05 2024-04-25T22:01:44.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645434+0000", 2024-04-25T22:01:44.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1237e-05 2024-04-25T22:01:44.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645459+0000", 2024-04-25T22:01:44.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5675999999999999e-05 2024-04-25T22:01:44.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646081+0000", 2024-04-25T22:01:44.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062128900000000002 2024-04-25T22:01:44.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:44.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646131+0000", 2024-04-25T22:01:44.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0322999999999999e-05 2024-04-25T22:01:44.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:44.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654185+0000", 2024-04-25T22:01:44.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080542749999999996 2024-04-25T22:01:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654319+0000", 2024-04-25T22:01:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013407499999999999 2024-04-25T22:01:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:19 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-25T22:01:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:01:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.918606574999998, 2024-04-25T22:01:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076631340000000003, 2024-04-25T22:01:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.585 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.585 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.585 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:01:44.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:01:44.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645499+0000", 2024-04-25T22:01:44.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4300000000000001e-07 2024-04-25T22:01:44.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645509+0000", 2024-04-25T22:01:44.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0244000000000001e-05 2024-04-25T22:01:44.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645523+0000", 2024-04-25T22:01:44.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3315999999999999e-05 2024-04-25T22:01:44.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645531+0000", 2024-04-25T22:01:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.123e-06 2024-04-25T22:01:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648260+0000", 2024-04-25T22:01:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027289789999999999 2024-04-25T22:01:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648307+0000", 2024-04-25T22:01:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6969999999999999e-05 2024-04-25T22:01:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653039+0000", 2024-04-25T22:01:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047322299999999996 2024-04-25T22:01:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653161+0000", 2024-04-25T22:01:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012232899999999999 2024-04-25T22:01:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:44.588 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:01:44.589 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.916628914, 2024-04-25T22:01:44.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01271303, 2024-04-25T22:01:44.589 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.589 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.589 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.589 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:01:44.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:01:44.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647479+0000", 2024-04-25T22:01:44.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.286e-06 2024-04-25T22:01:44.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647494+0000", 2024-04-25T22:01:44.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.521e-05 2024-04-25T22:01:44.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647525+0000", 2024-04-25T22:01:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0403999999999999e-05 2024-04-25T22:01:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647544+0000", 2024-04-25T22:01:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8743e-05 2024-04-25T22:01:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647895+0000", 2024-04-25T22:01:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035099699999999997 2024-04-25T22:01:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:44.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648202+0000", 2024-04-25T22:01:44.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030758499999999998 2024-04-25T22:01:44.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:44.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648496+0000", 2024-04-25T22:01:44.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029370699999999999 2024-04-25T22:01:44.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:44.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654605+0000", 2024-04-25T22:01:44.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061095999999999998 2024-04-25T22:01:44.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.659959+0000", 2024-04-25T22:01:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053531680000000002 2024-04-25T22:01:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660078+0000", 2024-04-25T22:01:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011981600000000001 2024-04-25T22:01:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660189+0000", 2024-04-25T22:01:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011051400000000001 2024-04-25T22:01:44.594 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.594 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.594 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.594 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:44.594 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:01:44.594 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.916504822, 2024-04-25T22:01:44.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013053006000000001, 2024-04-25T22:01:44.594 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.594 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.594 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:01:44.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:01:44.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647602+0000", 2024-04-25T22:01:44.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.604e-06 2024-04-25T22:01:44.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647611+0000", 2024-04-25T22:01:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5689999999999994e-06 2024-04-25T22:01:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647634+0000", 2024-04-25T22:01:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3227e-05 2024-04-25T22:01:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647660+0000", 2024-04-25T22:01:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5829999999999998e-05 2024-04-25T22:01:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649544+0000", 2024-04-25T22:01:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001884066 2024-04-25T22:01:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649783+0000", 2024-04-25T22:01:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238411 2024-04-25T22:01:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.650794+0000", 2024-04-25T22:01:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010109920000000001 2024-04-25T22:01:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654714+0000", 2024-04-25T22:01:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039202170000000001 2024-04-25T22:01:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660403+0000", 2024-04-25T22:01:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056895940000000001 2024-04-25T22:01:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660551+0000", 2024-04-25T22:01:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014717899999999999 2024-04-25T22:01:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660653+0000", 2024-04-25T22:01:44.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102317 2024-04-25T22:01:44.599 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.599 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.599 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.599 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:17 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:44.599 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:01:44.599 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.916420641999999, 2024-04-25T22:01:44.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010101435000000001, 2024-04-25T22:01:44.599 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.600 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.600 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.600 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:01:44.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:01:44.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647686+0000", 2024-04-25T22:01:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-04-25T22:01:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647693+0000", 2024-04-25T22:01:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7330000000000003e-06 2024-04-25T22:01:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647711+0000", 2024-04-25T22:01:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7436e-05 2024-04-25T22:01:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647727+0000", 2024-04-25T22:01:44.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6232999999999999e-05 2024-04-25T22:01:44.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649249+0000", 2024-04-25T22:01:44.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015219890000000001 2024-04-25T22:01:44.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:44.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649533+0000", 2024-04-25T22:01:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028391799999999997 2024-04-25T22:01:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649841+0000", 2024-04-25T22:01:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030853400000000001 2024-04-25T22:01:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654622+0000", 2024-04-25T22:01:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047809630000000001 2024-04-25T22:01:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657616+0000", 2024-04-25T22:01:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029938769999999998 2024-04-25T22:01:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657724+0000", 2024-04-25T22:01:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108109 2024-04-25T22:01:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657786+0000", 2024-04-25T22:01:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1196000000000002e-05 2024-04-25T22:01:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.605 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:44.605 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:01:44.605 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.916232313999998, 2024-04-25T22:01:44.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010260877999999999, 2024-04-25T22:01:44.605 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.605 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.605 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.605 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:01:44.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:01:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647874+0000", 2024-04-25T22:01:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:01:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647884+0000", 2024-04-25T22:01:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.013e-05 2024-04-25T22:01:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647908+0000", 2024-04-25T22:01:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3592999999999999e-05 2024-04-25T22:01:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647926+0000", 2024-04-25T22:01:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8176999999999999e-05 2024-04-25T22:01:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651480+0000", 2024-04-25T22:01:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035540160000000001 2024-04-25T22:01:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651690+0000", 2024-04-25T22:01:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210249 2024-04-25T22:01:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651986+0000", 2024-04-25T22:01:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000296001 2024-04-25T22:01:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655696+0000", 2024-04-25T22:01:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037098410000000002 2024-04-25T22:01:44.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657896+0000", 2024-04-25T22:01:44.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022004630000000002 2024-04-25T22:01:44.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:44.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658035+0000", 2024-04-25T22:01:44.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013831499999999999 2024-04-25T22:01:44.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658133+0000", 2024-04-25T22:01:44.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8553000000000003e-05 2024-04-25T22:01:44.610 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.610 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.610 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.610 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:18 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:44.610 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:01:44.610 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.916153434000002, 2024-04-25T22:01:44.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013108712, 2024-04-25T22:01:44.610 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.610 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.610 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:01:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:01:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647953+0000", 2024-04-25T22:01:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.697e-06 2024-04-25T22:01:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647963+0000", 2024-04-25T22:01:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9259999999999995e-06 2024-04-25T22:01:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647982+0000", 2024-04-25T22:01:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-04-25T22:01:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648008+0000", 2024-04-25T22:01:44.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5956e-05 2024-04-25T22:01:44.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651686+0000", 2024-04-25T22:01:44.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678073 2024-04-25T22:01:44.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:44.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652023+0000", 2024-04-25T22:01:44.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033739399999999998 2024-04-25T22:01:44.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:44.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652348+0000", 2024-04-25T22:01:44.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032475000000000001 2024-04-25T22:01:44.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:44.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655883+0000", 2024-04-25T22:01:44.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035353030000000001 2024-04-25T22:01:44.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660791+0000", 2024-04-25T22:01:44.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049075330000000004 2024-04-25T22:01:44.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:44.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660930+0000", 2024-04-25T22:01:44.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000139856 2024-04-25T22:01:44.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661060+0000", 2024-04-25T22:01:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000129651 2024-04-25T22:01:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:01:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.916076541999999, 2024-04-25T22:01:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012451034, 2024-04-25T22:01:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:01:44.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:01:44.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648030+0000", 2024-04-25T22:01:44.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-04-25T22:01:44.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648036+0000", 2024-04-25T22:01:44.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8059999999999997e-06 2024-04-25T22:01:44.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648054+0000", 2024-04-25T22:01:44.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7744000000000002e-05 2024-04-25T22:01:44.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648070+0000", 2024-04-25T22:01:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-04-25T22:01:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648875+0000", 2024-04-25T22:01:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080444000000000002 2024-04-25T22:01:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649078+0000", 2024-04-25T22:01:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020391499999999999 2024-04-25T22:01:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649674+0000", 2024-04-25T22:01:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00059555299999999997 2024-04-25T22:01:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653185+0000", 2024-04-25T22:01:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035113459999999998 2024-04-25T22:01:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660251+0000", 2024-04-25T22:01:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070661350000000003 2024-04-25T22:01:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660382+0000", 2024-04-25T22:01:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013095899999999999 2024-04-25T22:01:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660479+0000", 2024-04-25T22:01:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6852e-05 2024-04-25T22:01:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.622 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:25 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:44.622 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:01:44.622 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.916010729, 2024-04-25T22:01:44.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012691025999999999, 2024-04-25T22:01:44.622 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.622 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.622 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:44.622 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:01:44.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:01:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648095+0000", 2024-04-25T22:01:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.424e-06 2024-04-25T22:01:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648102+0000", 2024-04-25T22:01:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2099999999999998e-06 2024-04-25T22:01:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648122+0000", 2024-04-25T22:01:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0242999999999999e-05 2024-04-25T22:01:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648138+0000", 2024-04-25T22:01:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6192999999999999e-05 2024-04-25T22:01:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651461+0000", 2024-04-25T22:01:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033225709999999999 2024-04-25T22:01:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651776+0000", 2024-04-25T22:01:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031567500000000002 2024-04-25T22:01:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660785+0000", 2024-04-25T22:01:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090087099999999996 2024-04-25T22:01:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.626 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:44.626 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:01:44.626 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.915948242999999, 2024-04-25T22:01:44.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013102702000000001, 2024-04-25T22:01:44.626 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.626 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.626 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:44.626 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:01:44.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:01:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648158+0000", 2024-04-25T22:01:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2839999999999999e-06 2024-04-25T22:01:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648163+0000", 2024-04-25T22:01:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-04-25T22:01:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648181+0000", 2024-04-25T22:01:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8484000000000001e-05 2024-04-25T22:01:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648196+0000", 2024-04-25T22:01:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4496e-05 2024-04-25T22:01:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653737+0000", 2024-04-25T22:01:44.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055414009999999996 2024-04-25T22:01:44.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:44.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653972+0000", 2024-04-25T22:01:44.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000234732 2024-04-25T22:01:44.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661259+0000", 2024-04-25T22:01:44.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072872689999999999 2024-04-25T22:01:44.629 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.629 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:01:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.915891423000001, 2024-04-25T22:01:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086984829999999999, 2024-04-25T22:01:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:01:44.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:01:44.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648214+0000", 2024-04-25T22:01:44.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-04-25T22:01:44.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648233+0000", 2024-04-25T22:01:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.878e-05 2024-04-25T22:01:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648252+0000", 2024-04-25T22:01:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8603000000000001e-05 2024-04-25T22:01:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648267+0000", 2024-04-25T22:01:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:01:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648846+0000", 2024-04-25T22:01:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057923000000000002 2024-04-25T22:01:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649027+0000", 2024-04-25T22:01:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181585 2024-04-25T22:01:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.656912+0000", 2024-04-25T22:01:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078844589999999999 2024-04-25T22:01:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.634 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e17/15 ondisk, result = 0)", 2024-04-25T22:01:44.634 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.657534+0000", 2024-04-25T22:01:44.634 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.906571200999998, 2024-04-25T22:01:44.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061820500000000003, 2024-04-25T22:01:44.634 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.634 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.634 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:44.634 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657534+0000", 2024-04-25T22:01:44.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657534+0000", 2024-04-25T22:01:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657544+0000", 2024-04-25T22:01:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0403e-05 2024-04-25T22:01:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657551+0000", 2024-04-25T22:01:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1230000000000002e-06 2024-04-25T22:01:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657572+0000", 2024-04-25T22:01:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0826999999999999e-05 2024-04-25T22:01:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657586+0000", 2024-04-25T22:01:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:01:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657861+0000", 2024-04-25T22:01:44.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027576100000000002 2024-04-25T22:01:44.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:44.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657882+0000", 2024-04-25T22:01:44.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0378999999999999e-05 2024-04-25T22:01:44.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658152+0000", 2024-04-25T22:01:44.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027015200000000001 2024-04-25T22:01:44.637 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.637 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.637 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 6 lcod 17'2)", 2024-04-25T22:01:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:01:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.903961506999998, 2024-04-25T22:01:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064966000000000004, 2024-04-25T22:01:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:01:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:01:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:01:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660144+0000", 2024-04-25T22:01:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1800000000000005e-07 2024-04-25T22:01:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660181+0000", 2024-04-25T22:01:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6408000000000001e-05 2024-04-25T22:01:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660197+0000", 2024-04-25T22:01:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6177000000000001e-05 2024-04-25T22:01:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660210+0000", 2024-04-25T22:01:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:01:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660556+0000", 2024-04-25T22:01:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034612899999999998 2024-04-25T22:01:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660793+0000", 2024-04-25T22:01:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023656799999999999 2024-04-25T22:01:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:18 3.1f e17/15 ondisk, result = 0)", 2024-04-25T22:01:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:01:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.903699734, 2024-04-25T22:01:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067878299999999997, 2024-04-25T22:01:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:01:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:01:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660406+0000", 2024-04-25T22:01:44.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2800000000000005e-07 2024-04-25T22:01:44.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660412+0000", 2024-04-25T22:01:44.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0399999999999998e-06 2024-04-25T22:01:44.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660429+0000", 2024-04-25T22:01:44.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7394e-05 2024-04-25T22:01:44.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660445+0000", 2024-04-25T22:01:44.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6069000000000001e-05 2024-04-25T22:01:44.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660757+0000", 2024-04-25T22:01:44.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031194300000000002 2024-04-25T22:01:44.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660776+0000", 2024-04-25T22:01:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8862999999999999e-05 2024-04-25T22:01:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661084+0000", 2024-04-25T22:01:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030754600000000001 2024-04-25T22:01:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-25T22:01:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:01:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.903635506000001, 2024-04-25T22:01:44.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080007600000000004, 2024-04-25T22:01:44.646 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.646 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.646 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:01:44.646 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:01:44.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:01:44.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660470+0000", 2024-04-25T22:01:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4499999999999996e-07 2024-04-25T22:01:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660475+0000", 2024-04-25T22:01:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-04-25T22:01:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660490+0000", 2024-04-25T22:01:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5274e-05 2024-04-25T22:01:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660501+0000", 2024-04-25T22:01:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0694e-05 2024-04-25T22:01:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661130+0000", 2024-04-25T22:01:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062887499999999999 2024-04-25T22:01:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661269+0000", 2024-04-25T22:01:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013955900000000001 2024-04-25T22:01:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:01:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:01:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.939903507, 2024-04-25T22:01:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037104880000000001, 2024-04-25T22:01:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:01:44.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:01:44.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624204+0000", 2024-04-25T22:01:44.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.757e-06 2024-04-25T22:01:44.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624233+0000", 2024-04-25T22:01:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9362000000000001e-05 2024-04-25T22:01:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624264+0000", 2024-04-25T22:01:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0843000000000003e-05 2024-04-25T22:01:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624280+0000", 2024-04-25T22:01:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5577e-05 2024-04-25T22:01:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624458+0000", 2024-04-25T22:01:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017821199999999999 2024-04-25T22:01:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624661+0000", 2024-04-25T22:01:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020283200000000001 2024-04-25T22:01:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624842+0000", 2024-04-25T22:01:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018115500000000001 2024-04-25T22:01:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.626271+0000", 2024-04-25T22:01:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001429416 2024-04-25T22:01:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627749+0000", 2024-04-25T22:01:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014778650000000001 2024-04-25T22:01:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627849+0000", 2024-04-25T22:01:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9261999999999999e-05 2024-04-25T22:01:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627912+0000", 2024-04-25T22:01:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3207000000000007e-05 2024-04-25T22:01:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-25T22:01:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:01:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.9372061560000002, 2024-04-25T22:01:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029804620000000001, 2024-04-25T22:01:44.655 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:44.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:44.655 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:44.655 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:44.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:44.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:01:44.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:44.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:01:44.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:44.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626903+0000", 2024-04-25T22:01:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0029999999999996e-06 2024-04-25T22:01:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626921+0000", 2024-04-25T22:01:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8272999999999999e-05 2024-04-25T22:01:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626959+0000", 2024-04-25T22:01:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7843999999999999e-05 2024-04-25T22:01:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626977+0000", 2024-04-25T22:01:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7756000000000001e-05 2024-04-25T22:01:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627153+0000", 2024-04-25T22:01:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017643800000000001 2024-04-25T22:01:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627425+0000", 2024-04-25T22:01:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027207300000000001 2024-04-25T22:01:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:44.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627848+0000", 2024-04-25T22:01:44.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042297199999999997 2024-04-25T22:01:44.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:44.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629590+0000", 2024-04-25T22:01:44.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017416809999999999 2024-04-25T22:01:44.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:44.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629720+0000", 2024-04-25T22:01:44.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130526 2024-04-25T22:01:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629808+0000", 2024-04-25T22:01:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7449999999999998e-05 2024-04-25T22:01:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629879+0000", 2024-04-25T22:01:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1445999999999993e-05 2024-04-25T22:01:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:44.660 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:01:44.661 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:01:44.662 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:44.660+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:44.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:44.760+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:44.771 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:01:44.794 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:44.794 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:01:44.794 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:01:44.794 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:44.809 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:01:44.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:44.864+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:44.931 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:44.931 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:01:44.931 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:01:44.931 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:01:44.931 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:44.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:01:44.964 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:44.962+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:45.065 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:45.064+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:45.069 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:45.069 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:01:45.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:01:45.070 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:01:45.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.070 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:01:45.070 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:45.070 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.241851080000004, 2024-04-25T22:01:45.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:01:45.070 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.070 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.070 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:45.070 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:45.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:45.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:01:45.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:01:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:01:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:01:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:01:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:01:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:01:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:01:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:01:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:01:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:01:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:01:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:45.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:01:45.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:01:45.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:01:45.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:01:45.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.074 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.074 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:01:45.075 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:45.075 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.241120262000003, 2024-04-25T22:01:45.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:01:45.075 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.075 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:45.075 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:45.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:45.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:01:45.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:01:45.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:01:45.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:01:45.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:01:45.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:01:45.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:01:45.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:01:45.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:01:45.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:01:45.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:01:45.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:01:45.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:45.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:01:45.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:01:45.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:01:45.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:01:45.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.079 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.079 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:01:45.079 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:45.079 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.240453991000003, 2024-04-25T22:01:45.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:01:45.079 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.079 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.079 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:45.080 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:45.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:45.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:01:45.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:01:45.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:01:45.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:01:45.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:01:45.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:01:45.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:01:45.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:01:45.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:01:45.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:01:45.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:01:45.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:01:45.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:45.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:01:45.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:01:45.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:01:45.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:01:45.084 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.084 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.084 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.084 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:01:45.084 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:45.084 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.239554091000002, 2024-04-25T22:01:45.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:01:45.085 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.085 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.085 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:45.085 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:45.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:45.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:01:45.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:01:45.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:01:45.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:01:45.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:01:45.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:01:45.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:01:45.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:01:45.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:01:45.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:01:45.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:01:45.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:01:45.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:45.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:01:45.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:01:45.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:01:45.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:01:45.089 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.089 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.089 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.089 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:01:45.089 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:45.089 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.237517750000002, 2024-04-25T22:01:45.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:01:45.089 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.090 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.090 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:45.090 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:45.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:45.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:01:45.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:01:45.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:01:45.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:01:45.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:01:45.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:01:45.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:01:45.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:01:45.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:01:45.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:01:45.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:01:45.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:01:45.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:45.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:01:45.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:01:45.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:01:45.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:01:45.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.094 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.094 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.094 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:01:45.094 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:45.094 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.237054413000003, 2024-04-25T22:01:45.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:01:45.094 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.094 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.094 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:45.094 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:45.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:45.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:01:45.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:01:45.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:01:45.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:01:45.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:01:45.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:01:45.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:01:45.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:01:45.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:01:45.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:01:45.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:01:45.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:01:45.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:45.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:01:45.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:01:45.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:01:45.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:01:45.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.102 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.102 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:01:45.102 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:45.103 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.236187534000003, 2024-04-25T22:01:45.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:01:45.103 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.103 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.103 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:45.103 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:45.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:45.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:01:45.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:01:45.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:01:45.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:01:45.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:01:45.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:01:45.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:01:45.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:01:45.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:01:45.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:01:45.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:01:45.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:01:45.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:45.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:01:45.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:01:45.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:01:45.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:01:45.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.107 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.107 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:01:45.107 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:45.107 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.235736459999998, 2024-04-25T22:01:45.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:01:45.107 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.107 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.107 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:45.108 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:45.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:45.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:01:45.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:01:45.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:01:45.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:01:45.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:01:45.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:01:45.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:01:45.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:01:45.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:01:45.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:01:45.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:01:45.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:01:45.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:45.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:01:45.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:01:45.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:01:45.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:01:45.111 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.111 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.111 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.112 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:01:45.112 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:45.112 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.235286874000003, 2024-04-25T22:01:45.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:01:45.112 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.112 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.112 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:45.112 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:45.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:45.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:01:45.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:01:45.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:01:45.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:01:45.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:01:45.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:01:45.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:01:45.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:01:45.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:01:45.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:01:45.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:01:45.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:01:45.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:45.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:01:45.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:01:45.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:01:45.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:01:45.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.115 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.116 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:45.116 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:45.116 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.438630387, 2024-04-25T22:01:45.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:01:45.116 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.116 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:45.116 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:45.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:45.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:01:45.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:01:45.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:01:45.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:01:45.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:01:45.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:01:45.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:01:45.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:01:45.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:01:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:01:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:01:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:01:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:01:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:01:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:45.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:01:45.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:01:45.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:45.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:01:45.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:01:45.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:45.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:01:45.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:01:45.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:01:45.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:01:45.121 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.121 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.121 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.121 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:45.122 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:45.122 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.438506404000002, 2024-04-25T22:01:45.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:01:45.122 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.122 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.122 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:45.122 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:45.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:45.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:01:45.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:01:45.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:01:45.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:01:45.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:01:45.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:01:45.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:01:45.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:01:45.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:01:45.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:01:45.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:01:45.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:01:45.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:45.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:01:45.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:01:45.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:45.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:01:45.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:01:45.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:45.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:01:45.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:01:45.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:45.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:01:45.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:01:45.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:01:45.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:01:45.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.127 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.127 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:45.127 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:45.128 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.438432467999998, 2024-04-25T22:01:45.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:01:45.128 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.128 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.128 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:45.128 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:45.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:45.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:01:45.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:01:45.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:01:45.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:01:45.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:01:45.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:01:45.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:01:45.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:01:45.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:01:45.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:01:45.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:01:45.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:01:45.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:45.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:01:45.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:01:45.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:45.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:01:45.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:01:45.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:45.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:01:45.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:01:45.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:45.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:01:45.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:01:45.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:01:45.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:01:45.133 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.133 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.133 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.133 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:45.134 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:45.134 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.438316216, 2024-04-25T22:01:45.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:01:45.134 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.134 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.134 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:45.134 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:45.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:45.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:01:45.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:01:45.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:01:45.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:01:45.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:01:45.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:01:45.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:01:45.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:01:45.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:01:45.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:01:45.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:01:45.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:01:45.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:45.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:01:45.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:01:45.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:45.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:01:45.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:01:45.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:45.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:01:45.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:01:45.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:45.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:01:45.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:01:45.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:01:45.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:01:45.139 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.139 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.139 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.139 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:45.139 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:45.139 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.438152807000002, 2024-04-25T22:01:45.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:01:45.139 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.139 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.139 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:45.139 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:45.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:45.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:01:45.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:01:45.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:01:45.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:01:45.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:01:45.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:01:45.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:01:45.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:01:45.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:01:45.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:01:45.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:01:45.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:01:45.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:45.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:01:45.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:01:45.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:45.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:01:45.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:01:45.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:45.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:01:45.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:01:45.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:45.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:01:45.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:01:45.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:01:45.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:01:45.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.144 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.145 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:45.145 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:45.145 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.438050611000001, 2024-04-25T22:01:45.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:01:45.145 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.145 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.145 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:45.145 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:45.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:45.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:01:45.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:01:45.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:01:45.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:01:45.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:01:45.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:01:45.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:01:45.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:01:45.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:01:45.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:01:45.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:01:45.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:01:45.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:45.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:01:45.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:01:45.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:45.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:01:45.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:01:45.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:45.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:01:45.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:01:45.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:45.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:01:45.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:01:45.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:01:45.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:01:45.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.150 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.150 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:45.150 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:45.150 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.437971657999999, 2024-04-25T22:01:45.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:01:45.150 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.151 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.151 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:45.151 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:45.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:45.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:01:45.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:01:45.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:01:45.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:01:45.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:01:45.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:01:45.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:01:45.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:01:45.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:01:45.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:01:45.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:01:45.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:01:45.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:45.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:01:45.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:01:45.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:45.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:01:45.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:01:45.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:45.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:01:45.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:01:45.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:45.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:01:45.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:01:45.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:01:45.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:01:45.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.155 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.156 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:45.156 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:45.156 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.437906635000001, 2024-04-25T22:01:45.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:01:45.156 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.156 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.156 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:45.156 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:45.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:45.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:01:45.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:01:45.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:01:45.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:01:45.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:01:45.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:01:45.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:01:45.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:01:45.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:01:45.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:01:45.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:01:45.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:01:45.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:01:45.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:01:45.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.160 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.160 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.160 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:45.160 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:45.160 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.437828443000001, 2024-04-25T22:01:45.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:01:45.160 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.160 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.160 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:45.161 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:45.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:45.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:01:45.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:01:45.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:01:45.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:01:45.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:01:45.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:01:45.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:01:45.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:01:45.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:01:45.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:01:45.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:01:45.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:01:45.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:01:45.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:01:45.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.164 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.164 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:01:45.164 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:45.164 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.423181982999999, 2024-04-25T22:01:45.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:01:45.164 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.165 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.165 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:45.165 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:45.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:45.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:01:45.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:01:45.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:01:45.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:01:45.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:01:45.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:01:45.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:01:45.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:01:45.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:01:45.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:01:45.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:01:45.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:01:45.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:45.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:01:45.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:01:45.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:01:45.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:01:45.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.168 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.169 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:01:45.169 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:45.169 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.423022027000002, 2024-04-25T22:01:45.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:01:45.169 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:45.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:45.169 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:45.169 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:45.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:45.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:45.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:45.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:45.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:45.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:45.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:01:45.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:01:45.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:45.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:01:45.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:01:45.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:45.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:01:45.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:01:45.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:45.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:01:45.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:01:45.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:45.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:01:45.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:01:45.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:45.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:01:45.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:01:45.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:45.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:01:45.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:01:45.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:45.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:45.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:45.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:01:45.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:01:45.172 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.172 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:45.173 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:45.173 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:45.173 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:01:45.175 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:45.170+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:45.176 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:01:45.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:45.276+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:45.313 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:45.313 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:01:45.313 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:01:45.313 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:45.328 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:01:45.329 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:01:45.329 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:01:45.349 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:01:45.350 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:01:45.371 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:01:45.371 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:01:45.377 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:45.376+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:45.457 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:45.457 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:45.471 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:01:45.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:45.472+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:45.578 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:45.574+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:45.589 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:45.589 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:45.603 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:01:45.681 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:45.678+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:45.732 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:45.732 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:45.746 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:01:45.782 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:45.778+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:45.785 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-25T22:01:45.866 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:45.866 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:45.879 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:01:45.882 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:45.879+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:45.983 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:45.983+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:46.003 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:46.003 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:46.017 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:01:46.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:46.084+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:46.146 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:46.146 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:46.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:01:46.185 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:46.182+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:46.285 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:46.285 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:46.286 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:46.283+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:46.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:01:46.387 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:46.382+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:46.463 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:46.463 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:46.477 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:01:46.525 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:46.522+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:46.588 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:46.582+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:46.612 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:46.613 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:46.627 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:01:46.713 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:46.710+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:46.790 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:46.787+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:46.796 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:46.796 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:46.811 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:01:46.901 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:46.898+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:46.980 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:46.980 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:46.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:46.992+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:46.994 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:01:47.092 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:47.091+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:47.124 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:47.125 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:47.138 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:01:47.193 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:47.191+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:47.255 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:47.255 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:47.269 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:01:47.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:47.311+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:47.390 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:01:47.392 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:47.392 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:47.394 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:47.390+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:47.408 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:01:47.427 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:01:47.427 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:01:47.427 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-25T22:01:47.427 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-25T22:01:47.495 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:47.495+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:47.538 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:47.539 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:47.554 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:01:47.554 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:01:47.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:01:47.573 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:01:47.573 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:01:47.593 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:01:47.593 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:01:47.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:47.591+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:47.697 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:47.695+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:47.723 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:47.723 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:01:47.723 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:01:47.723 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:01:47.723 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:47.737 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:01:47.756 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:47.757 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-25T22:01:47.757 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 22, 2024-04-25T22:01:47.757 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "1ced109c-704f-44b1-9811-a2da74898889", 2024-04-25T22:01:47.757 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-25T22:00:52.024472+0000", 2024-04-25T22:01:47.757 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-25T22:01:45.769358+0000", 2024-04-25T22:01:47.757 INFO:teuthology.orchestra.run.smithi044.stdout: "last_up_change": "2024-04-25T22:01:03.432353+0000", 2024-04-25T22:01:47.757 INFO:teuthology.orchestra.run.smithi044.stdout: "last_in_change": "2024-04-25T22:00:53.642701+0000", 2024-04-25T22:01:47.757 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-25T22:01:47.757 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_num": 5799936, 2024-04-25T22:01:47.757 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_set": [ 2024-04-25T22:01:47.757 INFO:teuthology.orchestra.run.smithi044.stdout: "pglog_hardlimit", 2024-04-25T22:01:47.757 INFO:teuthology.orchestra.run.smithi044.stdout: "purged_snapdirs", 2024-04-25T22:01:47.757 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_deletes", 2024-04-25T22:01:47.757 INFO:teuthology.orchestra.run.smithi044.stdout: "sortbitwise" 2024-04-25T22:01:47.758 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:01:47.758 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_version": 4, 2024-04-25T22:01:47.758 INFO:teuthology.orchestra.run.smithi044.stdout: "full_ratio": 0.94999998807907104, 2024-04-25T22:01:47.758 INFO:teuthology.orchestra.run.smithi044.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-25T22:01:47.758 INFO:teuthology.orchestra.run.smithi044.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-25T22:01:47.758 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_snapshot": "", 2024-04-25T22:01:47.758 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_max": 4, 2024-04-25T22:01:47.758 INFO:teuthology.orchestra.run.smithi044.stdout: "max_osd": 3, 2024-04-25T22:01:47.758 INFO:teuthology.orchestra.run.smithi044.stdout: "require_min_compat_client": "luminous", 2024-04-25T22:01:47.758 INFO:teuthology.orchestra.run.smithi044.stdout: "min_compat_client": "jewel", 2024-04-25T22:01:47.758 INFO:teuthology.orchestra.run.smithi044.stdout: "require_osd_release": "squid", 2024-04-25T22:01:47.758 INFO:teuthology.orchestra.run.smithi044.stdout: "allow_crimson": false, 2024-04-25T22:01:47.758 INFO:teuthology.orchestra.run.smithi044.stdout: "pools": [ 2024-04-25T22:01:47.758 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.759 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 1, 2024-04-25T22:01:47.759 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": ".mgr", 2024-04-25T22:01:47.759 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:03.632568+0000", 2024-04-25T22:01:47.759 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:01:47.759 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:01:47.759 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:01:47.759 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:01:47.759 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:01:47.759 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:01:47.759 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:01:47.759 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:01:47.759 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:01:47.759 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:01:47.759 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:01:47.759 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:01:47.759 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 1, 2024-04-25T22:01:47.760 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 1, 2024-04-25T22:01:47.760 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 1, 2024-04-25T22:01:47.760 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 1, 2024-04-25T22:01:47.760 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 1, 2024-04-25T22:01:47.760 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:01:47.760 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:01:47.760 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:01:47.760 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:01:47.760 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:01:47.760 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:01:47.760 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:01:47.760 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.760 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "11", 2024-04-25T22:01:47.760 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:01:47.760 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:01:47.761 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:01:47.761 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:01:47.761 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:01:47.761 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:01:47.761 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:01:47.761 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:01:47.761 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:01:47.761 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:01:47.761 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:01:47.761 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:01:47.761 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:01:47.761 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:01:47.761 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:01:47.761 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:01:47.762 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:01:47.762 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:01:47.762 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:01:47.762 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:01:47.762 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:01:47.762 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:01:47.762 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:01:47.762 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:01:47.762 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:01:47.762 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:01:47.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.762 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:01:47.762 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:01:47.762 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:01:47.763 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:01:47.763 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:01:47.763 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:01:47.763 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:01:47.763 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:01:47.763 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:01:47.763 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:01:47.763 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:01:47.763 INFO:teuthology.orchestra.run.smithi044.stdout: "options": { 2024-04-25T22:01:47.763 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_max": 32, 2024-04-25T22:01:47.763 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_min": 1 2024-04-25T22:01:47.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.763 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:01:47.763 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": {} 2024-04-25T22:01:47.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.764 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:01:47.764 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:01:47.764 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 2.9900000095367432, 2024-04-25T22:01:47.764 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 2.9900000095367432, 2024-04-25T22:01:47.764 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 0.67000001668930054, 2024-04-25T22:01:47.764 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 2, 2024-04-25T22:01:47.764 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 2, 2024-04-25T22:01:47.764 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:01:47.764 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 1, 2024-04-25T22:01:47.764 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:01:47.764 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.764 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.764 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 2, 2024-04-25T22:01:47.764 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": "rbd", 2024-04-25T22:01:47.764 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:07.995071+0000", 2024-04-25T22:01:47.765 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:01:47.765 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:01:47.765 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:01:47.765 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:01:47.765 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:01:47.765 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:01:47.765 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:01:47.765 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:01:47.765 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:01:47.765 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:01:47.765 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:01:47.765 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:01:47.765 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 8, 2024-04-25T22:01:47.765 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 8, 2024-04-25T22:01:47.765 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 8, 2024-04-25T22:01:47.765 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 8, 2024-04-25T22:01:47.766 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 8, 2024-04-25T22:01:47.766 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:01:47.766 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:01:47.766 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:01:47.766 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:01:47.766 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:01:47.766 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:01:47.766 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:01:47.766 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.766 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "14", 2024-04-25T22:01:47.766 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:01:47.766 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:01:47.766 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:01:47.766 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:01:47.767 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:01:47.767 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:01:47.767 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:01:47.767 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:01:47.767 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:01:47.767 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:01:47.767 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:01:47.767 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:01:47.767 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:01:47.767 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:01:47.767 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:01:47.767 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:01:47.767 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:01:47.767 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:01:47.767 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:01:47.768 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:01:47.768 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:01:47.768 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:01:47.768 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:01:47.768 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:01:47.768 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:01:47.768 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:01:47.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.768 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:01:47.768 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:01:47.768 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:01:47.768 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:01:47.768 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:01:47.768 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:01:47.769 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:01:47.769 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:01:47.769 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:01:47.769 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:01:47.769 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:01:47.769 INFO:teuthology.orchestra.run.smithi044.stdout: "options": {}, 2024-04-25T22:01:47.769 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:01:47.769 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd": {} 2024-04-25T22:01:47.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.769 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:01:47.769 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:01:47.769 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 1.5, 2024-04-25T22:01:47.769 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 1.5, 2024-04-25T22:01:47.769 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 1, 2024-04-25T22:01:47.769 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 1.5, 2024-04-25T22:01:47.770 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 1.5, 2024-04-25T22:01:47.770 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:01:47.770 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 1, 2024-04-25T22:01:47.770 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:01:47.770 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.770 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 3, 2024-04-25T22:01:47.770 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": "cephfs_metadata", 2024-04-25T22:01:47.770 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:12.514055+0000", 2024-04-25T22:01:47.770 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:01:47.770 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:01:47.770 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:01:47.771 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:01:47.771 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:01:47.771 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:01:47.771 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:01:47.771 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:01:47.771 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:01:47.771 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:01:47.771 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:01:47.771 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:01:47.771 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 32, 2024-04-25T22:01:47.771 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 32, 2024-04-25T22:01:47.771 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 32, 2024-04-25T22:01:47.771 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 32, 2024-04-25T22:01:47.771 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 32, 2024-04-25T22:01:47.771 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:01:47.771 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:01:47.772 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:01:47.772 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:01:47.772 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:01:47.772 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:01:47.772 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:01:47.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.772 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "17", 2024-04-25T22:01:47.772 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:01:47.772 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:01:47.772 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:01:47.772 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:01:47.772 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:01:47.772 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:01:47.772 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:01:47.773 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:01:47.773 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:01:47.773 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:01:47.773 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:01:47.773 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:01:47.773 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:01:47.773 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:01:47.773 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:01:47.773 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:01:47.773 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:01:47.773 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:01:47.773 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:01:47.773 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:01:47.773 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:01:47.774 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:01:47.774 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:01:47.774 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:01:47.774 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:01:47.774 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:01:47.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.774 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:01:47.774 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:01:47.774 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:01:47.774 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:01:47.774 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:01:47.774 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:01:47.774 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:01:47.774 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:01:47.775 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:01:47.775 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:01:47.775 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:01:47.775 INFO:teuthology.orchestra.run.smithi044.stdout: "options": { 2024-04-25T22:01:47.775 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_bias": 4, 2024-04-25T22:01:47.775 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_min": 16, 2024-04-25T22:01:47.775 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_priority": 5 2024-04-25T22:01:47.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.775 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:01:47.775 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs": { 2024-04-25T22:01:47.775 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": "cephfs" 2024-04-25T22:01:47.775 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.775 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:01:47.775 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:01:47.776 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 1.1299999952316284, 2024-04-25T22:01:47.776 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 1.1299999952316284, 2024-04-25T22:01:47.776 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 1, 2024-04-25T22:01:47.776 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-25T22:01:47.776 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-25T22:01:47.776 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:01:47.776 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 1, 2024-04-25T22:01:47.776 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:01:47.776 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.776 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.776 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 4, 2024-04-25T22:01:47.776 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": "cephfs_data", 2024-04-25T22:01:47.776 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:12.963831+0000", 2024-04-25T22:01:47.776 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:01:47.777 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:01:47.777 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:01:47.777 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:01:47.777 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:01:47.777 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:01:47.777 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:01:47.777 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:01:47.777 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:01:47.777 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:01:47.777 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:01:47.777 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:01:47.777 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 64, 2024-04-25T22:01:47.777 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 64, 2024-04-25T22:01:47.777 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 64, 2024-04-25T22:01:47.777 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 64, 2024-04-25T22:01:47.778 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 64, 2024-04-25T22:01:47.778 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:01:47.778 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:01:47.778 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:01:47.778 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:01:47.778 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:01:47.778 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:01:47.778 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:01:47.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.778 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "18", 2024-04-25T22:01:47.778 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:01:47.778 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:01:47.778 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:01:47.778 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:01:47.779 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:01:47.779 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:01:47.779 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:01:47.779 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:01:47.779 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:01:47.779 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:01:47.779 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:01:47.779 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:01:47.779 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:01:47.779 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:01:47.779 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:01:47.779 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:01:47.779 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:01:47.779 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:01:47.779 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:01:47.780 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:01:47.780 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:01:47.780 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:01:47.780 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:01:47.780 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:01:47.780 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:01:47.780 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:01:47.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.780 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:01:47.780 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:01:47.780 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:01:47.780 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:01:47.780 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:01:47.780 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:01:47.780 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:01:47.781 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:01:47.781 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:01:47.781 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:01:47.781 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:01:47.781 INFO:teuthology.orchestra.run.smithi044.stdout: "options": { 2024-04-25T22:01:47.781 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_min": 64, 2024-04-25T22:01:47.781 INFO:teuthology.orchestra.run.smithi044.stdout: "target_size_ratio": 0.89999997615814209 2024-04-25T22:01:47.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.781 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:01:47.781 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs": { 2024-04-25T22:01:47.781 INFO:teuthology.orchestra.run.smithi044.stdout: "data": "cephfs" 2024-04-25T22:01:47.781 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.781 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:01:47.781 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:01:47.781 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 1.1299999952316284, 2024-04-25T22:01:47.782 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 1.1299999952316284, 2024-04-25T22:01:47.782 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 1, 2024-04-25T22:01:47.782 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-25T22:01:47.782 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-25T22:01:47.782 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:01:47.782 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 1, 2024-04-25T22:01:47.782 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:01:47.782 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.782 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.782 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:01:47.782 INFO:teuthology.orchestra.run.smithi044.stdout: "osds": [ 2024-04-25T22:01:47.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.782 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 0, 2024-04-25T22:01:47.782 INFO:teuthology.orchestra.run.smithi044.stdout: "uuid": "098ec92c-0fd2-4231-8beb-09fccca634d9", 2024-04-25T22:01:47.782 INFO:teuthology.orchestra.run.smithi044.stdout: "up": 1, 2024-04-25T22:01:47.783 INFO:teuthology.orchestra.run.smithi044.stdout: "in": 1, 2024-04-25T22:01:47.783 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 1, 2024-04-25T22:01:47.783 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity": 1, 2024-04-25T22:01:47.783 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_begin": 0, 2024-04-25T22:01:47.783 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_end": 0, 2024-04-25T22:01:47.783 INFO:teuthology.orchestra.run.smithi044.stdout: "up_from": 8, 2024-04-25T22:01:47.783 INFO:teuthology.orchestra.run.smithi044.stdout: "up_thru": 16, 2024-04-25T22:01:47.783 INFO:teuthology.orchestra.run.smithi044.stdout: "down_at": 0, 2024-04-25T22:01:47.783 INFO:teuthology.orchestra.run.smithi044.stdout: "lost_at": 0, 2024-04-25T22:01:47.783 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-25T22:01:47.783 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:47.783 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.783 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:47.783 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6800", 2024-04-25T22:01:47.784 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:01:47.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.784 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:47.784 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6801", 2024-04-25T22:01:47.784 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:01:47.784 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.784 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:47.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.784 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addrs": { 2024-04-25T22:01:47.784 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:47.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.784 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:47.784 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6802", 2024-04-25T22:01:47.784 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:01:47.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.785 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:47.785 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6803", 2024-04-25T22:01:47.785 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:01:47.785 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.785 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:47.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.785 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addrs": { 2024-04-25T22:01:47.785 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:47.785 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.785 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:47.786 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6806", 2024-04-25T22:01:47.786 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:01:47.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.786 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:47.786 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6807", 2024-04-25T22:01:47.786 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:01:47.786 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.786 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:47.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.786 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addrs": { 2024-04-25T22:01:47.786 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:47.786 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.786 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:47.787 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6804", 2024-04-25T22:01:47.787 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:01:47.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.787 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.787 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:47.787 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6805", 2024-04-25T22:01:47.787 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:01:47.787 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.787 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:47.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.787 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.57:6801/2385981072", 2024-04-25T22:01:47.787 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addr": "172.21.15.57:6803/2385981072", 2024-04-25T22:01:47.787 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addr": "172.21.15.57:6807/2385981072", 2024-04-25T22:01:47.787 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addr": "172.21.15.57:6805/2385981072", 2024-04-25T22:01:47.788 INFO:teuthology.orchestra.run.smithi044.stdout: "state": [ 2024-04-25T22:01:47.788 INFO:teuthology.orchestra.run.smithi044.stdout: "exists", 2024-04-25T22:01:47.788 INFO:teuthology.orchestra.run.smithi044.stdout: "up" 2024-04-25T22:01:47.788 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:47.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.788 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 1, 2024-04-25T22:01:47.788 INFO:teuthology.orchestra.run.smithi044.stdout: "uuid": "a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef", 2024-04-25T22:01:47.788 INFO:teuthology.orchestra.run.smithi044.stdout: "up": 1, 2024-04-25T22:01:47.788 INFO:teuthology.orchestra.run.smithi044.stdout: "in": 1, 2024-04-25T22:01:47.788 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 1, 2024-04-25T22:01:47.788 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity": 1, 2024-04-25T22:01:47.788 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_begin": 0, 2024-04-25T22:01:47.788 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_end": 0, 2024-04-25T22:01:47.789 INFO:teuthology.orchestra.run.smithi044.stdout: "up_from": 8, 2024-04-25T22:01:47.789 INFO:teuthology.orchestra.run.smithi044.stdout: "up_thru": 16, 2024-04-25T22:01:47.789 INFO:teuthology.orchestra.run.smithi044.stdout: "down_at": 0, 2024-04-25T22:01:47.789 INFO:teuthology.orchestra.run.smithi044.stdout: "lost_at": 0, 2024-04-25T22:01:47.789 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-25T22:01:47.789 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:47.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.789 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:47.789 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6800", 2024-04-25T22:01:47.789 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:01:47.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.789 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:47.790 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6801", 2024-04-25T22:01:47.790 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:01:47.790 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.790 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:47.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.790 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addrs": { 2024-04-25T22:01:47.790 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:47.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.790 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:47.790 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6802", 2024-04-25T22:01:47.790 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:01:47.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.790 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:47.791 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6803", 2024-04-25T22:01:47.791 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:01:47.791 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.791 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:47.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.791 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addrs": { 2024-04-25T22:01:47.791 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:47.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.791 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:47.791 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6806", 2024-04-25T22:01:47.791 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:01:47.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.791 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:47.792 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6807", 2024-04-25T22:01:47.792 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:01:47.792 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.792 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:47.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.792 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addrs": { 2024-04-25T22:01:47.792 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:47.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.792 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:47.792 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6804", 2024-04-25T22:01:47.792 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:01:47.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.792 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:47.793 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6805", 2024-04-25T22:01:47.793 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:01:47.793 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.793 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:47.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.793 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.79:6801/29975895", 2024-04-25T22:01:47.793 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addr": "172.21.15.79:6803/29975895", 2024-04-25T22:01:47.793 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addr": "172.21.15.79:6807/29975895", 2024-04-25T22:01:47.793 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addr": "172.21.15.79:6805/29975895", 2024-04-25T22:01:47.793 INFO:teuthology.orchestra.run.smithi044.stdout: "state": [ 2024-04-25T22:01:47.793 INFO:teuthology.orchestra.run.smithi044.stdout: "exists", 2024-04-25T22:01:47.793 INFO:teuthology.orchestra.run.smithi044.stdout: "up" 2024-04-25T22:01:47.793 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:47.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.794 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 2, 2024-04-25T22:01:47.794 INFO:teuthology.orchestra.run.smithi044.stdout: "uuid": "290ee5c1-81af-400c-b15a-f63c4794a3b0", 2024-04-25T22:01:47.794 INFO:teuthology.orchestra.run.smithi044.stdout: "up": 1, 2024-04-25T22:01:47.794 INFO:teuthology.orchestra.run.smithi044.stdout: "in": 1, 2024-04-25T22:01:47.794 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 1, 2024-04-25T22:01:47.794 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity": 1, 2024-04-25T22:01:47.794 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_begin": 0, 2024-04-25T22:01:47.794 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_end": 0, 2024-04-25T22:01:47.794 INFO:teuthology.orchestra.run.smithi044.stdout: "up_from": 8, 2024-04-25T22:01:47.794 INFO:teuthology.orchestra.run.smithi044.stdout: "up_thru": 16, 2024-04-25T22:01:47.794 INFO:teuthology.orchestra.run.smithi044.stdout: "down_at": 0, 2024-04-25T22:01:47.794 INFO:teuthology.orchestra.run.smithi044.stdout: "lost_at": 0, 2024-04-25T22:01:47.795 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-25T22:01:47.795 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:47.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.795 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:47.795 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6800", 2024-04-25T22:01:47.795 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:01:47.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.795 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:47.795 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6801", 2024-04-25T22:01:47.795 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:01:47.795 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.795 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:47.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.796 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addrs": { 2024-04-25T22:01:47.796 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:47.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.796 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:47.796 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6802", 2024-04-25T22:01:47.796 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:01:47.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.796 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:47.796 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6803", 2024-04-25T22:01:47.796 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:01:47.796 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.796 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:47.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.797 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addrs": { 2024-04-25T22:01:47.797 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:47.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.797 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:47.797 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6806", 2024-04-25T22:01:47.797 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:01:47.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.797 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:47.797 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6807", 2024-04-25T22:01:47.797 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:01:47.797 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.797 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:47.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.798 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addrs": { 2024-04-25T22:01:47.798 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:01:47.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.798 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:01:47.798 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6804", 2024-04-25T22:01:47.798 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:01:47.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.798 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:01:47.798 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6805", 2024-04-25T22:01:47.798 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:01:47.798 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.798 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:47.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.799 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.81:6801/3918111900", 2024-04-25T22:01:47.799 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addr": "172.21.15.81:6803/3918111900", 2024-04-25T22:01:47.799 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addr": "172.21.15.81:6807/3918111900", 2024-04-25T22:01:47.799 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addr": "172.21.15.81:6805/3918111900", 2024-04-25T22:01:47.799 INFO:teuthology.orchestra.run.smithi044.stdout: "state": [ 2024-04-25T22:01:47.799 INFO:teuthology.orchestra.run.smithi044.stdout: "exists", 2024-04-25T22:01:47.799 INFO:teuthology.orchestra.run.smithi044.stdout: "up" 2024-04-25T22:01:47.799 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:01:47.799 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.799 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:01:47.799 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_xinfo": [ 2024-04-25T22:01:47.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.800 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 0, 2024-04-25T22:01:47.800 INFO:teuthology.orchestra.run.smithi044.stdout: "down_stamp": "0.000000", 2024-04-25T22:01:47.800 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_probability": 0, 2024-04-25T22:01:47.800 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_interval": 0, 2024-04-25T22:01:47.800 INFO:teuthology.orchestra.run.smithi044.stdout: "features": 4540701547738038271, 2024-04-25T22:01:47.800 INFO:teuthology.orchestra.run.smithi044.stdout: "old_weight": 0, 2024-04-25T22:01:47.800 INFO:teuthology.orchestra.run.smithi044.stdout: "last_purged_snaps_scrub": "2024-04-25T22:00:59.025944+0000", 2024-04-25T22:01:47.800 INFO:teuthology.orchestra.run.smithi044.stdout: "dead_epoch": 0 2024-04-25T22:01:47.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.800 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 1, 2024-04-25T22:01:47.800 INFO:teuthology.orchestra.run.smithi044.stdout: "down_stamp": "0.000000", 2024-04-25T22:01:47.800 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_probability": 0, 2024-04-25T22:01:47.800 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_interval": 0, 2024-04-25T22:01:47.800 INFO:teuthology.orchestra.run.smithi044.stdout: "features": 4540701547738038271, 2024-04-25T22:01:47.801 INFO:teuthology.orchestra.run.smithi044.stdout: "old_weight": 0, 2024-04-25T22:01:47.801 INFO:teuthology.orchestra.run.smithi044.stdout: "last_purged_snaps_scrub": "2024-04-25T22:00:58.986080+0000", 2024-04-25T22:01:47.801 INFO:teuthology.orchestra.run.smithi044.stdout: "dead_epoch": 0 2024-04-25T22:01:47.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:01:47.801 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 2, 2024-04-25T22:01:47.801 INFO:teuthology.orchestra.run.smithi044.stdout: "down_stamp": "0.000000", 2024-04-25T22:01:47.801 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_probability": 0, 2024-04-25T22:01:47.801 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_interval": 0, 2024-04-25T22:01:47.801 INFO:teuthology.orchestra.run.smithi044.stdout: "features": 4540701547738038271, 2024-04-25T22:01:47.801 INFO:teuthology.orchestra.run.smithi044.stdout: "old_weight": 0, 2024-04-25T22:01:47.801 INFO:teuthology.orchestra.run.smithi044.stdout: "last_purged_snaps_scrub": "2024-04-25T22:00:58.971238+0000", 2024-04-25T22:01:47.801 INFO:teuthology.orchestra.run.smithi044.stdout: "dead_epoch": 0 2024-04-25T22:01:47.801 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.802 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:01:47.802 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_upmap": [], 2024-04-25T22:01:47.802 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_upmap_items": [], 2024-04-25T22:01:47.802 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_upmap_primaries": [], 2024-04-25T22:01:47.802 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_temp": [], 2024-04-25T22:01:47.802 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_temp": [], 2024-04-25T22:01:47.802 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklist": {}, 2024-04-25T22:01:47.802 INFO:teuthology.orchestra.run.smithi044.stdout: "range_blocklist": {}, 2024-04-25T22:01:47.802 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profiles": { 2024-04-25T22:01:47.802 INFO:teuthology.orchestra.run.smithi044.stdout: "default": { 2024-04-25T22:01:47.802 INFO:teuthology.orchestra.run.smithi044.stdout: "crush-failure-domain": "osd", 2024-04-25T22:01:47.802 INFO:teuthology.orchestra.run.smithi044.stdout: "k": "2", 2024-04-25T22:01:47.802 INFO:teuthology.orchestra.run.smithi044.stdout: "m": "1", 2024-04-25T22:01:47.802 INFO:teuthology.orchestra.run.smithi044.stdout: "plugin": "jerasure", 2024-04-25T22:01:47.802 INFO:teuthology.orchestra.run.smithi044.stdout: "technique": "reed_sol_van" 2024-04-25T22:01:47.803 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:01:47.803 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps_queue": [], 2024-04-25T22:01:47.803 INFO:teuthology.orchestra.run.smithi044.stdout: "new_removed_snaps": [], 2024-04-25T22:01:47.803 INFO:teuthology.orchestra.run.smithi044.stdout: "new_purged_snaps": [], 2024-04-25T22:01:47.803 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_node_flags": {}, 2024-04-25T22:01:47.803 INFO:teuthology.orchestra.run.smithi044.stdout: "device_class_flags": {}, 2024-04-25T22:01:47.803 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": { 2024-04-25T22:01:47.803 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode_enabled": false, 2024-04-25T22:01:47.803 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_bucket_count": 0, 2024-04-25T22:01:47.803 INFO:teuthology.orchestra.run.smithi044.stdout: "degraded_stretch_mode": 0, 2024-04-25T22:01:47.803 INFO:teuthology.orchestra.run.smithi044.stdout: "recovering_stretch_mode": 0, 2024-04-25T22:01:47.803 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode_bucket": 0 2024-04-25T22:01:47.803 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:01:47.804 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-25T22:01:47.806 INFO:tasks.thrashosds.thrasher:j is {'epoch': 22, 'fsid': '1ced109c-704f-44b1-9811-a2da74898889', 'created': '2024-04-25T22:00:52.024472+0000', 'modified': '2024-04-25T22:01:45.769358+0000', 'last_up_change': '2024-04-25T22:01:03.432353+0000', 'last_in_change': '2024-04-25T22:00:53.642701+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:01:03.632568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:01:07.995071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:01:12.514055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:01:12.963831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '098ec92c-0fd2-4231-8beb-09fccca634d9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6800', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6801', 'nonce': 2385981072}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6802', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6803', 'nonce': 2385981072}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6806', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6807', 'nonce': 2385981072}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6804', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6805', 'nonce': 2385981072}]}, 'public_addr': '172.21.15.57:6801/2385981072', 'cluster_addr': '172.21.15.57:6803/2385981072', 'heartbeat_back_addr': '172.21.15.57:6807/2385981072', 'heartbeat_front_addr': '172.21.15.57:6805/2385981072', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 29975895}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 29975895}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 29975895}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 29975895}]}, 'public_addr': '172.21.15.79:6801/29975895', 'cluster_addr': '172.21.15.79:6803/29975895', 'heartbeat_back_addr': '172.21.15.79:6807/29975895', 'heartbeat_front_addr': '172.21.15.79:6805/29975895', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '290ee5c1-81af-400c-b15a-f63c4794a3b0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6800', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6801', 'nonce': 3918111900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 3918111900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 3918111900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 3918111900}]}, 'public_addr': '172.21.15.81:6801/3918111900', 'cluster_addr': '172.21.15.81:6803/3918111900', 'heartbeat_back_addr': '172.21.15.81:6807/3918111900', 'heartbeat_front_addr': '172.21.15.81:6805/3918111900', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:00:59.025944+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:00:58.986080+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:00:58.971238+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-25T22:01:47.806 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:01:47.807 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:47.803+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:47.808 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:01:47.906 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:47.902+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:47.932 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:01:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:01:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:01:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:01:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.104201512000003, 2024-04-25T22:01:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:01:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:01:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:01:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:01:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:01:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:01:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:01:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:01:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:01:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:01:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:01:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:01:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:01:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:01:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:01:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:01:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:01:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:01:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.103470694000002, 2024-04-25T22:01:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:01:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:01:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:01:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:01:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:01:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:01:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:01:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:01:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:01:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:01:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:01:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:01:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:01:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:01:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:01:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:01:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:01:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:01:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.102804423000002, 2024-04-25T22:01:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:01:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:01:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:01:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:01:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:01:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:01:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:01:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:01:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:01:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:01:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:01:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:01:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:01:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:01:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:01:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:01:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:01:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:01:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.101904523000002, 2024-04-25T22:01:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:01:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:01:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:01:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:01:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:01:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:01:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:01:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:01:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:01:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:01:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:01:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:01:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:01:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:01:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:01:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:01:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:01:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:01:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.099868182000002, 2024-04-25T22:01:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:01:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:01:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:01:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:01:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:01:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:01:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:01:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:01:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:01:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:01:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:01:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:01:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:01:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:01:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:01:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:01:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:01:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:01:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.099404845000002, 2024-04-25T22:01:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:01:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:01:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:01:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:01:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:01:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:01:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:01:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:01:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:01:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:01:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:01:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:01:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:01:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:01:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:01:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:01:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:01:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:01:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.098537966000002, 2024-04-25T22:01:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:01:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:01:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:01:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:01:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:01:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:01:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:01:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:01:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:01:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:01:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:01:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:01:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:01:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:01:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:01:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:01:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:01:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:01:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.098086891999998, 2024-04-25T22:01:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:01:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:01:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:01:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:01:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:01:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:01:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:01:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:01:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:01:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:01:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:01:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:01:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:01:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:01:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:01:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:01:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:01:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:01:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.097637306000003, 2024-04-25T22:01:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:01:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:01:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:01:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:01:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:01:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:01:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:01:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:01:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:01:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:01:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:01:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:01:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:01:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:01:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:01:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:01:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:01:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.300980819000003, 2024-04-25T22:01:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:01:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:01:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:01:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:01:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:01:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:01:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:01:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:01:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:01:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:01:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:01:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:01:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:01:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:01:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:01:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:01:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:01:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:01:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:01:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:01:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:01:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:01:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:01:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.300856836000001, 2024-04-25T22:01:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:01:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:01:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:01:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:01:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:01:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:01:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:01:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:01:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:01:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:01:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:01:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:01:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:01:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:01:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:01:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:01:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:01:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:01:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:01:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:01:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:01:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:01:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:01:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.300782900000002, 2024-04-25T22:01:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:01:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:01:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:01:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:01:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:01:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:01:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:01:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:01:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:01:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:01:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:01:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:01:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:01:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:01:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:01:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:01:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:01:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:01:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:01:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:01:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:01:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:01:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:01:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.300666648000004, 2024-04-25T22:01:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:01:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:01:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:01:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:01:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:01:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:01:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:01:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:01:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:01:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:01:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:01:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:01:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:01:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:01:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:01:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:01:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:01:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:01:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:01:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:01:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:01:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:01:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:01:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.300503239000001, 2024-04-25T22:01:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:01:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:01:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:01:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:01:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:01:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:01:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:01:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:01:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:01:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:01:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:01:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:01:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:01:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:01:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:01:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:01:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:01:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:01:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:01:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:01:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:01:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:01:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:01:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.300401043000001, 2024-04-25T22:01:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:01:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:01:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:01:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:01:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:01:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:01:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:01:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:01:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:01:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:01:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:01:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:01:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:01:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:01:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:01:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:01:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:01:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:01:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:01:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:01:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:01:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:01:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:01:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.300322090000002, 2024-04-25T22:01:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:01:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:01:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:01:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:01:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:01:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:01:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:01:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:01:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:01:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:01:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:01:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:01:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:01:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:01:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:01:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:01:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:01:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:01:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:01:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:01:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:01:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:01:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:01:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.300257066999997, 2024-04-25T22:01:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:01:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:01:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:01:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:01:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:01:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:01:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:01:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:01:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:01:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:01:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:01:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:01:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:01:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:01:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:01:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.300178875, 2024-04-25T22:01:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:01:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:01:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:01:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:01:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:01:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:01:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:01:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:01:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:01:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:01:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:01:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:01:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:01:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:01:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:01:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:01:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.285532414999999, 2024-04-25T22:01:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:01:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:01:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:01:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:01:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:01:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:01:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:01:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:01:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:01:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:01:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:01:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:01:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:01:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:01:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:01:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:01:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:01:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:01:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.285372459000001, 2024-04-25T22:01:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:01:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:01:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:01:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:01:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:01:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:01:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:01:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:01:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:01:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:01:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:01:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:01:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:01:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:01:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:01:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:01:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:01:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:48.027 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:48.027 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:48.029 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:01:48.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:48.023+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:48.122 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:01:48.124 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:01:48.130 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:48.127+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:48.139 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-04-25T22:01:47.572059+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596050,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":254,"num_write_kb":3480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90084,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025436,"statfs":{"total":289910292480,"available":289818046464,"internally_reserved":0,"allocated":720896,"data_stored":1391132,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2831,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.830620"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.759265+0000","last_change":"2024-04-25T22:01:14.641678+0000","last_active":"2024-04-25T22:01:42.759265+0000","last_peered":"2024-04-25T22:01:42.759265+0000","last_clean":"2024-04-25T22:01:42.759265+0000","last_became_active":"2024-04-25T22:01:14.640808+0000","last_became_peered":"2024-04-25T22:01:14.640808+0000","last_unstale":"2024-04-25T22:01:42.759265+0000","last_undegraded":"2024-04-25T22:01:42.759265+0000","last_fullsized":"2024-04-25T22:01:42.759265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.758649+0000","last_change":"2024-04-25T22:01:14.648935+0000","last_active":"2024-04-25T22:01:42.758649+0000","last_peered":"2024-04-25T22:01:42.758649+0000","last_clean":"2024-04-25T22:01:42.758649+0000","last_became_active":"2024-04-25T22:01:14.647871+0000","last_became_peered":"2024-04-25T22:01:14.647871+0000","last_unstale":"2024-04-25T22:01:42.758649+0000","last_undegraded":"2024-04-25T22:01:42.758649+0000","last_fullsized":"2024-04-25T22:01:42.758649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.347588+0000","last_change":"2024-04-25T22:01:14.647262+0000","last_active":"2024-04-25T22:01:43.347588+0000","last_peered":"2024-04-25T22:01:43.347588+0000","last_clean":"2024-04-25T22:01:43.347588+0000","last_became_active":"2024-04-25T22:01:14.645878+0000","last_became_peered":"2024-04-25T22:01:14.645878+0000","last_unstale":"2024-04-25T22:01:43.347588+0000","last_undegraded":"2024-04-25T22:01:43.347588+0000","last_fullsized":"2024-04-25T22:01:43.347588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.347280+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:01:43.347280+0000","last_peered":"2024-04-25T22:01:43.347280+0000","last_clean":"2024-04-25T22:01:43.347280+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:01:43.347280+0000","last_undegraded":"2024-04-25T22:01:43.347280+0000","last_fullsized":"2024-04-25T22:01:43.347280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.757911+0000","last_change":"2024-04-25T22:01:14.642505+0000","last_active":"2024-04-25T22:01:42.757911+0000","last_peered":"2024-04-25T22:01:42.757911+0000","last_clean":"2024-04-25T22:01:42.757911+0000","last_became_active":"2024-04-25T22:01:14.641574+0000","last_became_peered":"2024-04-25T22:01:14.641574+0000","last_unstale":"2024-04-25T22:01:42.757911+0000","last_undegraded":"2024-04-25T22:01:42.757911+0000","last_fullsized":"2024-04-25T22:01:42.757911+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.346824+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:01:43.346824+0000","last_peered":"2024-04-25T22:01:43.346824+0000","last_clean":"2024-04-25T22:01:43.346824+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:01:43.346824+0000","last_undegraded":"2024-04-25T22:01:43.346824+0000","last_fullsized":"2024-04-25T22:01:43.346824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.347152+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:01:43.347152+0000","last_peered":"2024-04-25T22:01:43.347152+0000","last_clean":"2024-04-25T22:01:43.347152+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:01:43.347152+0000","last_undegraded":"2024-04-25T22:01:43.347152+0000","last_fullsized":"2024-04-25T22:01:43.347152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.346316+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:01:43.346316+0000","last_peered":"2024-04-25T22:01:43.346316+0000","last_clean":"2024-04-25T22:01:43.346316+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:01:43.346316+0000","last_undegraded":"2024-04-25T22:01:43.346316+0000","last_fullsized":"2024-04-25T22:01:43.346316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756359+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:01:42.756359+0000","last_peered":"2024-04-25T22:01:42.756359+0000","last_clean":"2024-04-25T22:01:42.756359+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:01:42.756359+0000","last_undegraded":"2024-04-25T22:01:42.756359+0000","last_fullsized":"2024-04-25T22:01:42.756359+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.758785+0000","last_change":"2024-04-25T22:01:14.647968+0000","last_active":"2024-04-25T22:01:42.758785+0000","last_peered":"2024-04-25T22:01:42.758785+0000","last_clean":"2024-04-25T22:01:42.758785+0000","last_became_active":"2024-04-25T22:01:14.646872+0000","last_became_peered":"2024-04-25T22:01:14.646872+0000","last_unstale":"2024-04-25T22:01:42.758785+0000","last_undegraded":"2024-04-25T22:01:42.758785+0000","last_fullsized":"2024-04-25T22:01:42.758785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.347696+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:01:43.347696+0000","last_peered":"2024-04-25T22:01:43.347696+0000","last_clean":"2024-04-25T22:01:43.347696+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:01:43.347696+0000","last_undegraded":"2024-04-25T22:01:43.347696+0000","last_fullsized":"2024-04-25T22:01:43.347696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.757721+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:01:42.757721+0000","last_peered":"2024-04-25T22:01:42.757721+0000","last_clean":"2024-04-25T22:01:42.757721+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:01:42.757721+0000","last_undegraded":"2024-04-25T22:01:42.757721+0000","last_fullsized":"2024-04-25T22:01:42.757721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.757329+0000","last_change":"2024-04-25T22:01:14.643909+0000","last_active":"2024-04-25T22:01:42.757329+0000","last_peered":"2024-04-25T22:01:42.757329+0000","last_clean":"2024-04-25T22:01:42.757329+0000","last_became_active":"2024-04-25T22:01:14.642421+0000","last_became_peered":"2024-04-25T22:01:14.642421+0000","last_unstale":"2024-04-25T22:01:42.757329+0000","last_undegraded":"2024-04-25T22:01:42.757329+0000","last_fullsized":"2024-04-25T22:01:42.757329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.348143+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:01:43.348143+0000","last_peered":"2024-04-25T22:01:43.348143+0000","last_clean":"2024-04-25T22:01:43.348143+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:01:43.348143+0000","last_undegraded":"2024-04-25T22:01:43.348143+0000","last_fullsized":"2024-04-25T22:01:43.348143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.347865+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:01:43.347865+0000","last_peered":"2024-04-25T22:01:43.347865+0000","last_clean":"2024-04-25T22:01:43.347865+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:01:43.347865+0000","last_undegraded":"2024-04-25T22:01:43.347865+0000","last_fullsized":"2024-04-25T22:01:43.347865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.346387+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:01:43.346387+0000","last_peered":"2024-04-25T22:01:43.346387+0000","last_clean":"2024-04-25T22:01:43.346387+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:01:43.346387+0000","last_undegraded":"2024-04-25T22:01:43.346387+0000","last_fullsized":"2024-04-25T22:01:43.346387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756812+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:01:42.756812+0000","last_peered":"2024-04-25T22:01:42.756812+0000","last_clean":"2024-04-25T22:01:42.756812+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:01:42.756812+0000","last_undegraded":"2024-04-25T22:01:42.756812+0000","last_fullsized":"2024-04-25T22:01:42.756812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.759267+0000","last_change":"2024-04-25T22:01:14.647317+0000","last_active":"2024-04-25T22:01:42.759267+0000","last_peered":"2024-04-25T22:01:42.759267+0000","last_clean":"2024-04-25T22:01:42.759267+0000","last_became_active":"2024-04-25T22:01:14.644027+0000","last_became_peered":"2024-04-25T22:01:14.644027+0000","last_unstale":"2024-04-25T22:01:42.759267+0000","last_undegraded":"2024-04-25T22:01:42.759267+0000","last_fullsized":"2024-04-25T22:01:42.759267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756952+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:01:42.756952+0000","last_peered":"2024-04-25T22:01:42.756952+0000","last_clean":"2024-04-25T22:01:42.756952+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:01:42.756952+0000","last_undegraded":"2024-04-25T22:01:42.756952+0000","last_fullsized":"2024-04-25T22:01:42.756952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.348190+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:01:43.348190+0000","last_peered":"2024-04-25T22:01:43.348190+0000","last_clean":"2024-04-25T22:01:43.348190+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:01:43.348190+0000","last_undegraded":"2024-04-25T22:01:43.348190+0000","last_fullsized":"2024-04-25T22:01:43.348190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.347645+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:01:43.347645+0000","last_peered":"2024-04-25T22:01:43.347645+0000","last_clean":"2024-04-25T22:01:43.347645+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:01:43.347645+0000","last_undegraded":"2024-04-25T22:01:43.347645+0000","last_fullsized":"2024-04-25T22:01:43.347645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.757104+0000","last_change":"2024-04-25T22:01:14.633477+0000","last_active":"2024-04-25T22:01:42.757104+0000","last_peered":"2024-04-25T22:01:42.757104+0000","last_clean":"2024-04-25T22:01:42.757104+0000","last_became_active":"2024-04-25T22:01:14.632678+0000","last_became_peered":"2024-04-25T22:01:14.632678+0000","last_unstale":"2024-04-25T22:01:42.757104+0000","last_undegraded":"2024-04-25T22:01:42.757104+0000","last_fullsized":"2024-04-25T22:01:42.757104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.755621+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:01:42.755621+0000","last_peered":"2024-04-25T22:01:42.755621+0000","last_clean":"2024-04-25T22:01:42.755621+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:01:42.755621+0000","last_undegraded":"2024-04-25T22:01:42.755621+0000","last_fullsized":"2024-04-25T22:01:42.755621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756638+0000","last_change":"2024-04-25T22:01:14.641991+0000","last_active":"2024-04-25T22:01:42.756638+0000","last_peered":"2024-04-25T22:01:42.756638+0000","last_clean":"2024-04-25T22:01:42.756638+0000","last_became_active":"2024-04-25T22:01:14.641244+0000","last_became_peered":"2024-04-25T22:01:14.641244+0000","last_unstale":"2024-04-25T22:01:42.756638+0000","last_undegraded":"2024-04-25T22:01:42.756638+0000","last_fullsized":"2024-04-25T22:01:42.756638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:03.098700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.759456+0000","last_change":"2024-04-25T22:01:14.638103+0000","last_active":"2024-04-25T22:01:42.759456+0000","last_peered":"2024-04-25T22:01:42.759456+0000","last_clean":"2024-04-25T22:01:42.759456+0000","last_became_active":"2024-04-25T22:01:14.636488+0000","last_became_peered":"2024-04-25T22:01:14.636488+0000","last_unstale":"2024-04-25T22:01:42.759456+0000","last_undegraded":"2024-04-25T22:01:42.759456+0000","last_fullsized":"2024-04-25T22:01:42.759456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756488+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:01:42.756488+0000","last_peered":"2024-04-25T22:01:42.756488+0000","last_clean":"2024-04-25T22:01:42.756488+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:01:42.756488+0000","last_undegraded":"2024-04-25T22:01:42.756488+0000","last_fullsized":"2024-04-25T22:01:42.756488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.347899+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:01:43.347899+0000","last_peered":"2024-04-25T22:01:43.347899+0000","last_clean":"2024-04-25T22:01:43.347899+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:01:43.347899+0000","last_undegraded":"2024-04-25T22:01:43.347899+0000","last_fullsized":"2024-04-25T22:01:43.347899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.758143+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:01:42.758143+0000","last_peered":"2024-04-25T22:01:42.758143+0000","last_clean":"2024-04-25T22:01:42.758143+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:01:42.758143+0000","last_undegraded":"2024-04-25T22:01:42.758143+0000","last_fullsized":"2024-04-25T22:01:42.758143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756235+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:01:42.756235+0000","last_peered":"2024-04-25T22:01:42.756235+0000","last_clean":"2024-04-25T22:01:42.756235+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:01:42.756235+0000","last_undegraded":"2024-04-25T22:01:42.756235+0000","last_fullsized":"2024-04-25T22:01:42.756235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.757615+0000","last_change":"2024-04-25T22:01:14.638343+0000","last_active":"2024-04-25T22:01:42.757615+0000","last_peered":"2024-04-25T22:01:42.757615+0000","last_clean":"2024-04-25T22:01:42.757615+0000","last_became_active":"2024-04-25T22:01:14.637694+0000","last_became_peered":"2024-04-25T22:01:14.637694+0000","last_unstale":"2024-04-25T22:01:42.757615+0000","last_undegraded":"2024-04-25T22:01:42.757615+0000","last_fullsized":"2024-04-25T22:01:42.757615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.755653+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:01:42.755653+0000","last_peered":"2024-04-25T22:01:42.755653+0000","last_clean":"2024-04-25T22:01:42.755653+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:01:42.755653+0000","last_undegraded":"2024-04-25T22:01:42.755653+0000","last_fullsized":"2024-04-25T22:01:42.755653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.346617+0000","last_change":"2024-04-25T22:01:14.648196+0000","last_active":"2024-04-25T22:01:43.346617+0000","last_peered":"2024-04-25T22:01:43.346617+0000","last_clean":"2024-04-25T22:01:43.346617+0000","last_became_active":"2024-04-25T22:01:14.647509+0000","last_became_peered":"2024-04-25T22:01:14.647509+0000","last_unstale":"2024-04-25T22:01:43.346617+0000","last_undegraded":"2024-04-25T22:01:43.346617+0000","last_fullsized":"2024-04-25T22:01:43.346617+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.757940+0000","last_change":"2024-04-25T22:01:14.641706+0000","last_active":"2024-04-25T22:01:42.757940+0000","last_peered":"2024-04-25T22:01:42.757940+0000","last_clean":"2024-04-25T22:01:42.757940+0000","last_became_active":"2024-04-25T22:01:14.641043+0000","last_became_peered":"2024-04-25T22:01:14.641043+0000","last_unstale":"2024-04-25T22:01:42.757940+0000","last_undegraded":"2024-04-25T22:01:42.757940+0000","last_fullsized":"2024-04-25T22:01:42.757940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.347962+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:01:43.347962+0000","last_peered":"2024-04-25T22:01:43.347962+0000","last_clean":"2024-04-25T22:01:43.347962+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:01:43.347962+0000","last_undegraded":"2024-04-25T22:01:43.347962+0000","last_fullsized":"2024-04-25T22:01:43.347962+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.758668+0000","last_change":"2024-04-25T22:01:14.635075+0000","last_active":"2024-04-25T22:01:42.758668+0000","last_peered":"2024-04-25T22:01:42.758668+0000","last_clean":"2024-04-25T22:01:42.758668+0000","last_became_active":"2024-04-25T22:01:14.630677+0000","last_became_peered":"2024-04-25T22:01:14.630677+0000","last_unstale":"2024-04-25T22:01:42.758668+0000","last_undegraded":"2024-04-25T22:01:42.758668+0000","last_fullsized":"2024-04-25T22:01:42.758668+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.755995+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:01:42.755995+0000","last_peered":"2024-04-25T22:01:42.755995+0000","last_clean":"2024-04-25T22:01:42.755995+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:01:42.755995+0000","last_undegraded":"2024-04-25T22:01:42.755995+0000","last_fullsized":"2024-04-25T22:01:42.755995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756709+0000","last_change":"2024-04-25T22:01:14.648527+0000","last_active":"2024-04-25T22:01:42.756709+0000","last_peered":"2024-04-25T22:01:42.756709+0000","last_clean":"2024-04-25T22:01:42.756709+0000","last_became_active":"2024-04-25T22:01:14.645040+0000","last_became_peered":"2024-04-25T22:01:14.645040+0000","last_unstale":"2024-04-25T22:01:42.756709+0000","last_undegraded":"2024-04-25T22:01:42.756709+0000","last_fullsized":"2024-04-25T22:01:42.756709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.757124+0000","last_change":"2024-04-25T22:01:13.630817+0000","last_active":"2024-04-25T22:01:42.757124+0000","last_peered":"2024-04-25T22:01:42.757124+0000","last_clean":"2024-04-25T22:01:42.757124+0000","last_became_active":"2024-04-25T22:01:13.629994+0000","last_became_peered":"2024-04-25T22:01:13.629994+0000","last_unstale":"2024-04-25T22:01:42.757124+0000","last_undegraded":"2024-04-25T22:01:42.757124+0000","last_fullsized":"2024-04-25T22:01:42.757124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756457+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:01:42.756457+0000","last_peered":"2024-04-25T22:01:42.756457+0000","last_clean":"2024-04-25T22:01:42.756457+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:01:42.756457+0000","last_undegraded":"2024-04-25T22:01:42.756457+0000","last_fullsized":"2024-04-25T22:01:42.756457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.346689+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:01:43.346689+0000","last_peered":"2024-04-25T22:01:43.346689+0000","last_clean":"2024-04-25T22:01:43.346689+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:01:43.346689+0000","last_undegraded":"2024-04-25T22:01:43.346689+0000","last_fullsized":"2024-04-25T22:01:43.346689+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.349194+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:01:43.349194+0000","last_peered":"2024-04-25T22:01:43.349194+0000","last_clean":"2024-04-25T22:01:43.349194+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:01:43.349194+0000","last_undegraded":"2024-04-25T22:01:43.349194+0000","last_fullsized":"2024-04-25T22:01:43.349194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756711+0000","last_change":"2024-04-25T22:01:14.633805+0000","last_active":"2024-04-25T22:01:42.756711+0000","last_peered":"2024-04-25T22:01:42.756711+0000","last_clean":"2024-04-25T22:01:42.756711+0000","last_became_active":"2024-04-25T22:01:14.633045+0000","last_became_peered":"2024-04-25T22:01:14.633045+0000","last_unstale":"2024-04-25T22:01:42.756711+0000","last_undegraded":"2024-04-25T22:01:42.756711+0000","last_fullsized":"2024-04-25T22:01:42.756711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:43.718628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.759273+0000","last_change":"2024-04-25T22:01:13.631135+0000","last_active":"2024-04-25T22:01:42.759273+0000","last_peered":"2024-04-25T22:01:42.759273+0000","last_clean":"2024-04-25T22:01:42.759273+0000","last_became_active":"2024-04-25T22:01:13.630257+0000","last_became_peered":"2024-04-25T22:01:13.630257+0000","last_unstale":"2024-04-25T22:01:42.759273+0000","last_undegraded":"2024-04-25T22:01:42.759273+0000","last_fullsized":"2024-04-25T22:01:42.759273+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756857+0000","last_change":"2024-04-25T22:01:14.630233+0000","last_active":"2024-04-25T22:01:42.756857+0000","last_peered":"2024-04-25T22:01:42.756857+0000","last_clean":"2024-04-25T22:01:42.756857+0000","last_became_active":"2024-04-25T22:01:14.629415+0000","last_became_peered":"2024-04-25T22:01:14.629415+0000","last_unstale":"2024-04-25T22:01:42.756857+0000","last_undegraded":"2024-04-25T22:01:42.756857+0000","last_fullsized":"2024-04-25T22:01:42.756857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:02:28.593163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.348537+0000","last_change":"2024-04-25T22:01:13.633106+0000","last_active":"2024-04-25T22:01:43.348537+0000","last_peered":"2024-04-25T22:01:43.348537+0000","last_clean":"2024-04-25T22:01:43.348537+0000","last_became_active":"2024-04-25T22:01:13.631466+0000","last_became_peered":"2024-04-25T22:01:13.631466+0000","last_unstale":"2024-04-25T22:01:43.348537+0000","last_undegraded":"2024-04-25T22:01:43.348537+0000","last_fullsized":"2024-04-25T22:01:43.348537+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:23.095422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.347102+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:01:43.347102+0000","last_peered":"2024-04-25T22:01:43.347102+0000","last_clean":"2024-04-25T22:01:43.347102+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:01:43.347102+0000","last_undegraded":"2024-04-25T22:01:43.347102+0000","last_fullsized":"2024-04-25T22:01:43.347102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.348887+0000","last_change":"2024-04-25T22:01:13.626767+0000","last_active":"2024-04-25T22:01:43.348887+0000","last_peered":"2024-04-25T22:01:43.348887+0000","last_clean":"2024-04-25T22:01:43.348887+0000","last_became_active":"2024-04-25T22:01:13.625984+0000","last_became_peered":"2024-04-25T22:01:13.625984+0000","last_unstale":"2024-04-25T22:01:43.348887+0000","last_undegraded":"2024-04-25T22:01:43.348887+0000","last_fullsized":"2024-04-25T22:01:43.348887+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756339+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:01:42.756339+0000","last_peered":"2024-04-25T22:01:42.756339+0000","last_clean":"2024-04-25T22:01:42.756339+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:01:42.756339+0000","last_undegraded":"2024-04-25T22:01:42.756339+0000","last_fullsized":"2024-04-25T22:01:42.756339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756497+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:01:42.756497+0000","last_peered":"2024-04-25T22:01:42.756497+0000","last_clean":"2024-04-25T22:01:42.756497+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:01:42.756497+0000","last_undegraded":"2024-04-25T22:01:42.756497+0000","last_fullsized":"2024-04-25T22:01:42.756497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.348351+0000","last_change":"2024-04-25T22:01:14.650077+0000","last_active":"2024-04-25T22:01:43.348351+0000","last_peered":"2024-04-25T22:01:43.348351+0000","last_clean":"2024-04-25T22:01:43.348351+0000","last_became_active":"2024-04-25T22:01:14.649315+0000","last_became_peered":"2024-04-25T22:01:14.649315+0000","last_unstale":"2024-04-25T22:01:43.348351+0000","last_undegraded":"2024-04-25T22:01:43.348351+0000","last_fullsized":"2024-04-25T22:01:43.348351+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.976715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.347902+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:01:43.347902+0000","last_peered":"2024-04-25T22:01:43.347902+0000","last_clean":"2024-04-25T22:01:43.347902+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:01:43.347902+0000","last_undegraded":"2024-04-25T22:01:43.347902+0000","last_fullsized":"2024-04-25T22:01:43.347902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.348312+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:01:43.348312+0000","last_peered":"2024-04-25T22:01:43.348312+0000","last_clean":"2024-04-25T22:01:43.348312+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:01:43.348312+0000","last_undegraded":"2024-04-25T22:01:43.348312+0000","last_fullsized":"2024-04-25T22:01:43.348312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.757286+0000","last_change":"2024-04-25T22:01:13.631439+0000","last_active":"2024-04-25T22:01:42.757286+0000","last_peered":"2024-04-25T22:01:42.757286+0000","last_clean":"2024-04-25T22:01:42.757286+0000","last_became_active":"2024-04-25T22:01:13.630812+0000","last_became_peered":"2024-04-25T22:01:13.630812+0000","last_unstale":"2024-04-25T22:01:42.757286+0000","last_undegraded":"2024-04-25T22:01:42.757286+0000","last_fullsized":"2024-04-25T22:01:42.757286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.348692+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:01:43.348692+0000","last_peered":"2024-04-25T22:01:43.348692+0000","last_clean":"2024-04-25T22:01:43.348692+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:01:43.348692+0000","last_undegraded":"2024-04-25T22:01:43.348692+0000","last_fullsized":"2024-04-25T22:01:43.348692+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756894+0000","last_change":"2024-04-25T22:01:13.623342+0000","last_active":"2024-04-25T22:01:42.756894+0000","last_peered":"2024-04-25T22:01:42.756894+0000","last_clean":"2024-04-25T22:01:42.756894+0000","last_became_active":"2024-04-25T22:01:13.621460+0000","last_became_peered":"2024-04-25T22:01:13.621460+0000","last_unstale":"2024-04-25T22:01:42.756894+0000","last_undegraded":"2024-04-25T22:01:42.756894+0000","last_fullsized":"2024-04-25T22:01:42.756894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756504+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:01:42.756504+0000","last_peered":"2024-04-25T22:01:42.756504+0000","last_clean":"2024-04-25T22:01:42.756504+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:01:42.756504+0000","last_undegraded":"2024-04-25T22:01:42.756504+0000","last_fullsized":"2024-04-25T22:01:42.756504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":228,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.347403+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:01:43.347403+0000","last_peered":"2024-04-25T22:01:43.347403+0000","last_clean":"2024-04-25T22:01:43.347403+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:01:43.347403+0000","last_undegraded":"2024-04-25T22:01:43.347403+0000","last_fullsized":"2024-04-25T22:01:43.347403+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.348508+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:01:43.348508+0000","last_peered":"2024-04-25T22:01:43.348508+0000","last_clean":"2024-04-25T22:01:43.348508+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:01:43.348508+0000","last_undegraded":"2024-04-25T22:01:43.348508+0000","last_fullsized":"2024-04-25T22:01:43.348508+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756139+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:01:42.756139+0000","last_peered":"2024-04-25T22:01:42.756139+0000","last_clean":"2024-04-25T22:01:42.756139+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:01:42.756139+0000","last_undegraded":"2024-04-25T22:01:42.756139+0000","last_fullsized":"2024-04-25T22:01:42.756139+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.348224+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:01:43.348224+0000","last_peered":"2024-04-25T22:01:43.348224+0000","last_clean":"2024-04-25T22:01:43.348224+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:01:43.348224+0000","last_undegraded":"2024-04-25T22:01:43.348224+0000","last_fullsized":"2024-04-25T22:01:43.348224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.347060+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:01:43.347060+0000","last_peered":"2024-04-25T22:01:43.347060+0000","last_clean":"2024-04-25T22:01:43.347060+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:01:43.347060+0000","last_undegraded":"2024-04-25T22:01:43.347060+0000","last_fullsized":"2024-04-25T22:01:43.347060+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.755955+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:01:42.755955+0000","last_peered":"2024-04-25T22:01:42.755955+0000","last_clean":"2024-04-25T22:01:42.755955+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:01:42.755955+0000","last_undegraded":"2024-04-25T22:01:42.755955+0000","last_fullsized":"2024-04-25T22:01:42.755955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.758972+0000","last_change":"2024-04-25T22:01:14.645176+0000","last_active":"2024-04-25T22:01:42.758972+0000","last_peered":"2024-04-25T22:01:42.758972+0000","last_clean":"2024-04-25T22:01:42.758972+0000","last_became_active":"2024-04-25T22:01:14.642395+0000","last_became_peered":"2024-04-25T22:01:14.642395+0000","last_unstale":"2024-04-25T22:01:42.758972+0000","last_undegraded":"2024-04-25T22:01:42.758972+0000","last_fullsized":"2024-04-25T22:01:42.758972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756459+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:01:42.756459+0000","last_peered":"2024-04-25T22:01:42.756459+0000","last_clean":"2024-04-25T22:01:42.756459+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:01:42.756459+0000","last_undegraded":"2024-04-25T22:01:42.756459+0000","last_fullsized":"2024-04-25T22:01:42.756459+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756986+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:01:42.756986+0000","last_peered":"2024-04-25T22:01:42.756986+0000","last_clean":"2024-04-25T22:01:42.756986+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:01:42.756986+0000","last_undegraded":"2024-04-25T22:01:42.756986+0000","last_fullsized":"2024-04-25T22:01:42.756986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756613+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:01:42.756613+0000","last_peered":"2024-04-25T22:01:42.756613+0000","last_clean":"2024-04-25T22:01:42.756613+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:01:42.756613+0000","last_undegraded":"2024-04-25T22:01:42.756613+0000","last_fullsized":"2024-04-25T22:01:42.756613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.348094+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:01:43.348094+0000","last_peered":"2024-04-25T22:01:43.348094+0000","last_clean":"2024-04-25T22:01:43.348094+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:01:43.348094+0000","last_undegraded":"2024-04-25T22:01:43.348094+0000","last_fullsized":"2024-04-25T22:01:43.348094+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.347963+0000","last_change":"2024-04-25T22:01:13.627274+0000","last_active":"2024-04-25T22:01:43.347963+0000","last_peered":"2024-04-25T22:01:43.347963+0000","last_clean":"2024-04-25T22:01:43.347963+0000","last_became_active":"2024-04-25T22:01:13.626015+0000","last_became_peered":"2024-04-25T22:01:13.626015+0000","last_unstale":"2024-04-25T22:01:43.347963+0000","last_undegraded":"2024-04-25T22:01:43.347963+0000","last_fullsized":"2024-04-25T22:01:43.347963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756983+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:01:42.756983+0000","last_peered":"2024-04-25T22:01:42.756983+0000","last_clean":"2024-04-25T22:01:42.756983+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:01:42.756983+0000","last_undegraded":"2024-04-25T22:01:42.756983+0000","last_fullsized":"2024-04-25T22:01:42.756983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.348642+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:01:43.348642+0000","last_peered":"2024-04-25T22:01:43.348642+0000","last_clean":"2024-04-25T22:01:43.348642+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:01:43.348642+0000","last_undegraded":"2024-04-25T22:01:43.348642+0000","last_fullsized":"2024-04-25T22:01:43.348642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.757081+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:01:42.757081+0000","last_peered":"2024-04-25T22:01:42.757081+0000","last_clean":"2024-04-25T22:01:42.757081+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:01:42.757081+0000","last_undegraded":"2024-04-25T22:01:42.757081+0000","last_fullsized":"2024-04-25T22:01:42.757081+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.757365+0000","last_change":"2024-04-25T22:01:14.637520+0000","last_active":"2024-04-25T22:01:42.757365+0000","last_peered":"2024-04-25T22:01:42.757365+0000","last_clean":"2024-04-25T22:01:42.757365+0000","last_became_active":"2024-04-25T22:01:14.636765+0000","last_became_peered":"2024-04-25T22:01:14.636765+0000","last_unstale":"2024-04-25T22:01:42.757365+0000","last_undegraded":"2024-04-25T22:01:42.757365+0000","last_fullsized":"2024-04-25T22:01:42.757365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.757079+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:01:42.757079+0000","last_peered":"2024-04-25T22:01:42.757079+0000","last_clean":"2024-04-25T22:01:42.757079+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:01:42.757079+0000","last_undegraded":"2024-04-25T22:01:42.757079+0000","last_fullsized":"2024-04-25T22:01:42.757079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.759323+0000","last_change":"2024-04-25T22:01:09.582204+0000","last_active":"2024-04-25T22:01:42.759323+0000","last_peered":"2024-04-25T22:01:42.759323+0000","last_clean":"2024-04-25T22:01:42.759323+0000","last_became_active":"2024-04-25T22:01:09.581494+0000","last_became_peered":"2024-04-25T22:01:09.581494+0000","last_unstale":"2024-04-25T22:01:42.759323+0000","last_undegraded":"2024-04-25T22:01:42.759323+0000","last_fullsized":"2024-04-25T22:01:42.759323+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:13.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.757629+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:01:42.757629+0000","last_peered":"2024-04-25T22:01:42.757629+0000","last_clean":"2024-04-25T22:01:42.757629+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:01:42.757629+0000","last_undegraded":"2024-04-25T22:01:42.757629+0000","last_fullsized":"2024-04-25T22:01:42.757629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756876+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:01:42.756876+0000","last_peered":"2024-04-25T22:01:42.756876+0000","last_clean":"2024-04-25T22:01:42.756876+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:01:42.756876+0000","last_undegraded":"2024-04-25T22:01:42.756876+0000","last_fullsized":"2024-04-25T22:01:42.756876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756847+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:01:42.756847+0000","last_peered":"2024-04-25T22:01:42.756847+0000","last_clean":"2024-04-25T22:01:42.756847+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:01:42.756847+0000","last_undegraded":"2024-04-25T22:01:42.756847+0000","last_fullsized":"2024-04-25T22:01:42.756847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.755633+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:01:42.755633+0000","last_peered":"2024-04-25T22:01:42.755633+0000","last_clean":"2024-04-25T22:01:42.755633+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:01:42.755633+0000","last_undegraded":"2024-04-25T22:01:42.755633+0000","last_fullsized":"2024-04-25T22:01:42.755633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756799+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:01:42.756799+0000","last_peered":"2024-04-25T22:01:42.756799+0000","last_clean":"2024-04-25T22:01:42.756799+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:01:42.756799+0000","last_undegraded":"2024-04-25T22:01:42.756799+0000","last_fullsized":"2024-04-25T22:01:42.756799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.349196+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:01:43.349196+0000","last_peered":"2024-04-25T22:01:43.349196+0000","last_clean":"2024-04-25T22:01:43.349196+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:01:43.349196+0000","last_undegraded":"2024-04-25T22:01:43.349196+0000","last_fullsized":"2024-04-25T22:01:43.349196+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756869+0000","last_change":"2024-04-25T22:01:14.632306+0000","last_active":"2024-04-25T22:01:42.756869+0000","last_peered":"2024-04-25T22:01:42.756869+0000","last_clean":"2024-04-25T22:01:42.756869+0000","last_became_active":"2024-04-25T22:01:14.631179+0000","last_became_peered":"2024-04-25T22:01:14.631179+0000","last_unstale":"2024-04-25T22:01:42.756869+0000","last_undegraded":"2024-04-25T22:01:42.756869+0000","last_fullsized":"2024-04-25T22:01:42.756869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.347632+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:01:43.347632+0000","last_peered":"2024-04-25T22:01:43.347632+0000","last_clean":"2024-04-25T22:01:43.347632+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:01:43.347632+0000","last_undegraded":"2024-04-25T22:01:43.347632+0000","last_fullsized":"2024-04-25T22:01:43.347632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"19'10","reported_seq":30,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.348832+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:01:43.348832+0000","last_peered":"2024-04-25T22:01:43.348832+0000","last_clean":"2024-04-25T22:01:43.348832+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:01:43.348832+0000","last_undegraded":"2024-04-25T22:01:43.348832+0000","last_fullsized":"2024-04-25T22:01:43.348832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4884,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.755936+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:01:42.755936+0000","last_peered":"2024-04-25T22:01:42.755936+0000","last_clean":"2024-04-25T22:01:42.755936+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:01:42.755936+0000","last_undegraded":"2024-04-25T22:01:42.755936+0000","last_fullsized":"2024-04-25T22:01:42.755936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.759039+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:01:42.759039+0000","last_peered":"2024-04-25T22:01:42.759039+0000","last_clean":"2024-04-25T22:01:42.759039+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:01:42.759039+0000","last_undegraded":"2024-04-25T22:01:42.759039+0000","last_fullsized":"2024-04-25T22:01:42.759039+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.348873+0000","last_change":"2024-04-25T22:01:13.626710+0000","last_active":"2024-04-25T22:01:43.348873+0000","last_peered":"2024-04-25T22:01:43.348873+0000","last_clean":"2024-04-25T22:01:43.348873+0000","last_became_active":"2024-04-25T22:01:13.625898+0000","last_became_peered":"2024-04-25T22:01:13.625898+0000","last_unstale":"2024-04-25T22:01:43.348873+0000","last_undegraded":"2024-04-25T22:01:43.348873+0000","last_fullsized":"2024-04-25T22:01:43.348873+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.755818+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:01:42.755818+0000","last_peered":"2024-04-25T22:01:42.755818+0000","last_clean":"2024-04-25T22:01:42.755818+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:01:42.755818+0000","last_undegraded":"2024-04-25T22:01:42.755818+0000","last_fullsized":"2024-04-25T22:01:42.755818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756757+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:01:42.756757+0000","last_peered":"2024-04-25T22:01:42.756757+0000","last_clean":"2024-04-25T22:01:42.756757+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:01:42.756757+0000","last_undegraded":"2024-04-25T22:01:42.756757+0000","last_fullsized":"2024-04-25T22:01:42.756757+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.755556+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:01:42.755556+0000","last_peered":"2024-04-25T22:01:42.755556+0000","last_clean":"2024-04-25T22:01:42.755556+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:01:42.755556+0000","last_undegraded":"2024-04-25T22:01:42.755556+0000","last_fullsized":"2024-04-25T22:01:42.755556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.759449+0000","last_change":"2024-04-25T22:01:14.639447+0000","last_active":"2024-04-25T22:01:42.759449+0000","last_peered":"2024-04-25T22:01:42.759449+0000","last_clean":"2024-04-25T22:01:42.759449+0000","last_became_active":"2024-04-25T22:01:14.638864+0000","last_became_peered":"2024-04-25T22:01:14.638864+0000","last_unstale":"2024-04-25T22:01:42.759449+0000","last_undegraded":"2024-04-25T22:01:42.759449+0000","last_fullsized":"2024-04-25T22:01:42.759449+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.755732+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:01:42.755732+0000","last_peered":"2024-04-25T22:01:42.755732+0000","last_clean":"2024-04-25T22:01:42.755732+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:01:42.755732+0000","last_undegraded":"2024-04-25T22:01:42.755732+0000","last_fullsized":"2024-04-25T22:01:42.755732+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756484+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:01:42.756484+0000","last_peered":"2024-04-25T22:01:42.756484+0000","last_clean":"2024-04-25T22:01:42.756484+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:01:42.756484+0000","last_undegraded":"2024-04-25T22:01:42.756484+0000","last_fullsized":"2024-04-25T22:01:42.756484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756407+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:01:42.756407+0000","last_peered":"2024-04-25T22:01:42.756407+0000","last_clean":"2024-04-25T22:01:42.756407+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:01:42.756407+0000","last_undegraded":"2024-04-25T22:01:42.756407+0000","last_fullsized":"2024-04-25T22:01:42.756407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.758514+0000","last_change":"2024-04-25T22:01:14.637452+0000","last_active":"2024-04-25T22:01:42.758514+0000","last_peered":"2024-04-25T22:01:42.758514+0000","last_clean":"2024-04-25T22:01:42.758514+0000","last_became_active":"2024-04-25T22:01:14.636407+0000","last_became_peered":"2024-04-25T22:01:14.636407+0000","last_unstale":"2024-04-25T22:01:42.758514+0000","last_undegraded":"2024-04-25T22:01:42.758514+0000","last_fullsized":"2024-04-25T22:01:42.758514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.757736+0000","last_change":"2024-04-25T22:01:13.621997+0000","last_active":"2024-04-25T22:01:42.757736+0000","last_peered":"2024-04-25T22:01:42.757736+0000","last_clean":"2024-04-25T22:01:42.757736+0000","last_became_active":"2024-04-25T22:01:13.620987+0000","last_became_peered":"2024-04-25T22:01:13.620987+0000","last_unstale":"2024-04-25T22:01:42.757736+0000","last_undegraded":"2024-04-25T22:01:42.757736+0000","last_fullsized":"2024-04-25T22:01:42.757736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.757823+0000","last_change":"2024-04-25T22:01:14.650437+0000","last_active":"2024-04-25T22:01:42.757823+0000","last_peered":"2024-04-25T22:01:42.757823+0000","last_clean":"2024-04-25T22:01:42.757823+0000","last_became_active":"2024-04-25T22:01:14.648116+0000","last_became_peered":"2024-04-25T22:01:14.648116+0000","last_unstale":"2024-04-25T22:01:42.757823+0000","last_undegraded":"2024-04-25T22:01:42.757823+0000","last_fullsized":"2024-04-25T22:01:42.757823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.758151+0000","last_change":"2024-04-25T22:01:13.631562+0000","last_active":"2024-04-25T22:01:42.758151+0000","last_peered":"2024-04-25T22:01:42.758151+0000","last_clean":"2024-04-25T22:01:42.758151+0000","last_became_active":"2024-04-25T22:01:13.630731+0000","last_became_peered":"2024-04-25T22:01:13.630731+0000","last_unstale":"2024-04-25T22:01:42.758151+0000","last_undegraded":"2024-04-25T22:01:42.758151+0000","last_fullsized":"2024-04-25T22:01:42.758151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.347177+0000","last_change":"2024-04-25T22:01:14.654909+0000","last_active":"2024-04-25T22:01:43.347177+0000","last_peered":"2024-04-25T22:01:43.347177+0000","last_clean":"2024-04-25T22:01:43.347177+0000","last_became_active":"2024-04-25T22:01:14.653503+0000","last_became_peered":"2024-04-25T22:01:14.653503+0000","last_unstale":"2024-04-25T22:01:43.347177+0000","last_undegraded":"2024-04-25T22:01:43.347177+0000","last_fullsized":"2024-04-25T22:01:43.347177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.348536+0000","last_change":"2024-04-25T22:01:13.628356+0000","last_active":"2024-04-25T22:01:43.348536+0000","last_peered":"2024-04-25T22:01:43.348536+0000","last_clean":"2024-04-25T22:01:43.348536+0000","last_became_active":"2024-04-25T22:01:13.626608+0000","last_became_peered":"2024-04-25T22:01:13.626608+0000","last_unstale":"2024-04-25T22:01:43.348536+0000","last_undegraded":"2024-04-25T22:01:43.348536+0000","last_fullsized":"2024-04-25T22:01:43.348536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.347573+0000","last_change":"2024-04-25T22:01:14.648752+0000","last_active":"2024-04-25T22:01:43.347573+0000","last_peered":"2024-04-25T22:01:43.347573+0000","last_clean":"2024-04-25T22:01:43.347573+0000","last_became_active":"2024-04-25T22:01:14.647463+0000","last_became_peered":"2024-04-25T22:01:14.647463+0000","last_unstale":"2024-04-25T22:01:43.347573+0000","last_undegraded":"2024-04-25T22:01:43.347573+0000","last_fullsized":"2024-04-25T22:01:43.347573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:22.946881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.758758+0000","last_change":"2024-04-25T22:01:13.630502+0000","last_active":"2024-04-25T22:01:42.758758+0000","last_peered":"2024-04-25T22:01:42.758758+0000","last_clean":"2024-04-25T22:01:42.758758+0000","last_became_active":"2024-04-25T22:01:13.629854+0000","last_became_peered":"2024-04-25T22:01:13.629854+0000","last_unstale":"2024-04-25T22:01:42.758758+0000","last_undegraded":"2024-04-25T22:01:42.758758+0000","last_fullsized":"2024-04-25T22:01:42.758758+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.757400+0000","last_change":"2024-04-25T22:01:14.642104+0000","last_active":"2024-04-25T22:01:42.757400+0000","last_peered":"2024-04-25T22:01:42.757400+0000","last_clean":"2024-04-25T22:01:42.757400+0000","last_became_active":"2024-04-25T22:01:14.641323+0000","last_became_peered":"2024-04-25T22:01:14.641323+0000","last_unstale":"2024-04-25T22:01:42.757400+0000","last_undegraded":"2024-04-25T22:01:42.757400+0000","last_fullsized":"2024-04-25T22:01:42.757400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756665+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:01:42.756665+0000","last_peered":"2024-04-25T22:01:42.756665+0000","last_clean":"2024-04-25T22:01:42.756665+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:01:42.756665+0000","last_undegraded":"2024-04-25T22:01:42.756665+0000","last_fullsized":"2024-04-25T22:01:42.756665+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:43.346904+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:01:43.346904+0000","last_peered":"2024-04-25T22:01:43.346904+0000","last_clean":"2024-04-25T22:01:43.346904+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:01:43.346904+0000","last_undegraded":"2024-04-25T22:01:43.346904+0000","last_fullsized":"2024-04-25T22:01:43.346904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T22:01:42.756636+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:01:42.756636+0000","last_peered":"2024-04-25T22:01:42.756636+0000","last_clean":"2024-04-25T22:01:42.756636+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:01:42.756636+0000","last_undegraded":"2024-04-25T22:01:42.756636+0000","last_fullsized":"2024-04-25T22:01:42.756636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5682,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738382,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":663182,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738381,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":188416,"data_stored":68364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738382,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":659586,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:01:48.146 INFO:tasks.thrashosds.thrasher:Setting 4.7 to [0, 1, 2] 2024-04-25T22:01:48.146 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.7', '0', '1', '2'] 2024-04-25T22:01:48.146 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.7 0 1 2 2024-04-25T22:01:48.164 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:48.164 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:01:48.164 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:01:48.164 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:48.179 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:01:48.231 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:48.226+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:48.307 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:48.307 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:01:48.307 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:01:48.307 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:01:48.307 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:48.321 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:01:48.332 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:48.331+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:48.433 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:48.431+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:48.483 INFO:teuthology.orchestra.run.smithi044.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-25T22:01:48.490 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T22:01:48.491 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-25T22:01:48.498 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:48.498 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:01:48.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:01:48.498 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:01:48.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.498 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:01:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.499996422999999, 2024-04-25T22:01:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:01:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:01:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:01:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:01:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:01:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:01:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:01:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:01:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:01:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:01:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:01:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:01:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:01:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:01:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:01:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:01:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:01:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:01:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:01:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:01:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:01:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:01:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:01:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:01:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:01:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:01:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:01:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.317933349999997, 2024-04-25T22:01:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:01:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:01:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:01:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:01:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:01:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:01:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:01:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:01:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:01:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:01:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:01:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:01:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:01:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:01:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:01:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:01:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:01:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:01:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:01:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:01:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:01:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:01:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:01:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:01:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:01:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:01:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:01:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.31788907, 2024-04-25T22:01:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:01:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:01:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:01:48.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:01:48.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:01:48.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:01:48.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:01:48.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:01:48.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:01:48.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:01:48.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:01:48.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:01:48.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:01:48.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:01:48.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:01:48.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:01:48.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:01:48.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:01:48.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:01:48.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:01:48.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:01:48.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:01:48.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:01:48.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:01:48.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:01:48.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:01:48.516 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.516 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.516 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.516 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:48.517 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:01:48.517 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.317832545000002, 2024-04-25T22:01:48.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:01:48.517 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.517 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.517 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.517 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:48.517 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:48.517 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:48.517 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:01:48.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.517 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:01:48.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:01:48.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:01:48.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:01:48.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:01:48.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:01:48.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:01:48.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:01:48.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:01:48.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:01:48.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:01:48.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:01:48.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:01:48.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:01:48.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:01:48.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:01:48.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:01:48.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:01:48.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:01:48.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:01:48.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:01:48.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:01:48.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:01:48.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:01:48.524 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.524 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.525 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.525 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:48.525 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:01:48.525 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.317637302999998, 2024-04-25T22:01:48.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:01:48.526 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.526 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.526 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.526 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:48.526 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:48.527 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:48.527 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:01:48.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.527 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:01:48.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:01:48.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:01:48.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:01:48.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:01:48.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:01:48.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:01:48.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:01:48.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:01:48.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:01:48.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:01:48.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:01:48.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:01:48.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:01:48.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:01:48.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:01:48.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:01:48.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:01:48.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:01:48.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:01:48.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:01:48.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:01:48.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:01:48.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:01:48.535 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.535 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.535 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.536 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:48.536 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:01:48.536 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.317575009999999, 2024-04-25T22:01:48.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:01:48.536 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.536 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.536 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.536 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:48.536 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:48.536 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:48.536 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:01:48.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.537 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:01:48.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:01:48.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:01:48.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:01:48.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:01:48.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:01:48.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:01:48.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:01:48.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:01:48.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:01:48.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:01:48.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:01:48.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:01:48.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:01:48.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:01:48.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:01:48.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:01:48.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:01:48.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:01:48.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:01:48.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:01:48.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:01:48.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:01:48.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:01:48.541 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.541 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.542 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.542 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:48.542 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:01:48.542 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.317514793999997, 2024-04-25T22:01:48.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:01:48.542 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.542 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.542 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.542 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:48.542 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:48.542 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:48.542 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:01:48.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.543 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:01:48.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:01:48.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:01:48.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:01:48.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:01:48.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:01:48.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:01:48.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:01:48.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:01:48.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:01:48.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:01:48.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:01:48.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:01:48.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:01:48.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:01:48.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:01:48.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:01:48.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:01:48.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:01:48.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:01:48.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:01:48.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:01:48.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:01:48.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:01:48.547 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.547 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.548 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.548 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:48.548 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:01:48.548 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.317325281999999, 2024-04-25T22:01:48.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:01:48.548 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.548 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.548 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.548 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:48.548 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:48.548 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:48.548 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:01:48.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.549 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:01:48.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:01:48.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:01:48.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:01:48.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:01:48.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:01:48.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:01:48.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:01:48.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:01:48.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:01:48.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:01:48.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:01:48.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:01:48.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:01:48.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:01:48.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:01:48.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:01:48.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:01:48.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:01:48.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:01:48.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:01:48.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:01:48.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:01:48.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:01:48.553 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.553 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.553 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.554 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:48.554 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:01:48.554 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.125987447999997, 2024-04-25T22:01:48.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:01:48.554 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.554 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.554 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.554 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:48.554 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:48.555 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:48.555 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:01:48.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.555 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:01:48.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:01:48.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:01:48.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:01:48.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:01:48.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:01:48.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:01:48.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:01:48.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:01:48.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:01:48.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:01:48.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:01:48.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:01:48.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:01:48.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:01:48.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:01:48.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:01:48.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:01:48.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:01:48.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:01:48.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:01:48.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:01:48.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:01:48.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:01:48.559 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.559 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.560 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.560 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:48.560 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:01:48.560 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.125949071000001, 2024-04-25T22:01:48.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:01:48.560 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.560 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.560 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.560 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:48.560 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:48.560 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:48.560 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:01:48.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.561 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:01:48.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:01:48.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:01:48.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:01:48.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:01:48.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:01:48.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:01:48.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:01:48.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:01:48.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:01:48.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:01:48.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:01:48.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:01:48.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:01:48.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:01:48.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:01:48.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:01:48.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:01:48.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:01:48.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:01:48.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:01:48.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:01:48.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:01:48.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:01:48.565 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.566 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.566 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.566 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:48.566 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:01:48.566 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.125897811999998, 2024-04-25T22:01:48.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:01:48.566 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.566 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.566 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.566 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:48.566 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:48.566 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:48.567 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:01:48.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.567 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:01:48.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:01:48.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:01:48.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:01:48.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:01:48.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:01:48.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:01:48.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:01:48.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:01:48.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:01:48.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:01:48.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:01:48.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:01:48.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:01:48.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:01:48.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:01:48.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:01:48.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:01:48.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:01:48.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:01:48.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:01:48.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:01:48.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:01:48.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:01:48.572 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.572 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.572 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.572 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:48.572 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:01:48.572 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.125749163000002, 2024-04-25T22:01:48.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:01:48.572 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.572 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.572 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.572 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:48.573 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:48.573 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:48.573 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:01:48.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.573 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:01:48.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:01:48.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:01:48.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:01:48.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:01:48.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:01:48.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:01:48.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:01:48.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:01:48.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:01:48.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:01:48.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:01:48.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:01:48.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:01:48.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:01:48.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:01:48.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:01:48.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:01:48.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:01:48.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:01:48.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:01:48.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:01:48.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:01:48.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:01:48.578 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.578 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.578 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.578 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:48.578 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:01:48.578 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.125707013000003, 2024-04-25T22:01:48.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:01:48.578 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.578 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.579 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.579 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:48.579 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:48.579 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:48.579 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:01:48.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.579 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:01:48.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:01:48.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:01:48.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:01:48.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:01:48.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:01:48.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:01:48.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:01:48.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:01:48.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:01:48.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:01:48.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:01:48.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:01:48.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:01:48.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:01:48.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:01:48.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:01:48.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:01:48.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:01:48.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:01:48.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:01:48.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:01:48.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:01:48.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:01:48.584 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.584 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.584 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.584 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:48.584 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:01:48.584 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.125669160000001, 2024-04-25T22:01:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:01:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:01:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:01:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:01:48.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:01:48.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:01:48.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:01:48.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:01:48.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:01:48.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:01:48.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:01:48.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:01:48.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:01:48.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:01:48.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:01:48.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:01:48.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:01:48.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:01:48.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:01:48.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:01:48.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:01:48.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:01:48.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:01:48.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:01:48.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:01:48.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:01:48.590 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.590 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.590 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.590 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:48.590 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:01:48.590 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.125459835000001, 2024-04-25T22:01:48.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:01:48.590 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.590 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.590 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.590 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:48.591 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:48.591 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:48.591 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:01:48.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.591 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:01:48.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:01:48.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:01:48.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:01:48.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:01:48.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:01:48.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:01:48.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:01:48.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:01:48.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:01:48.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:01:48.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:01:48.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:01:48.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:01:48.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:01:48.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:01:48.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:01:48.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:01:48.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:01:48.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:01:48.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:01:48.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:01:48.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:01:48.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:01:48.596 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.596 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.596 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.597 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:48.597 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:01:48.597 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.859208563000003, 2024-04-25T22:01:48.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:01:48.597 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.597 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.597 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.597 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:01:48.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:01:48.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:01:48.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:01:48.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:01:48.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:01:48.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:01:48.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:01:48.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:01:48.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:01:48.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:01:48.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:01:48.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:01:48.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:01:48.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:01:48.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:01:48.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:01:48.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:01:48.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:01:48.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:01:48.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:01:48.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:01:48.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:01:48.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:01:48.602 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.602 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.602 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.602 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:48.602 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:48.602 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.859174723000002, 2024-04-25T22:01:48.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:01:48.602 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.603 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.603 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.603 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:48.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:48.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:48.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:01:48.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:01:48.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:01:48.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:01:48.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:01:48.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:01:48.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:01:48.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:01:48.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:01:48.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:01:48.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:01:48.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:01:48.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:01:48.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:01:48.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:01:48.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:01:48.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:01:48.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:01:48.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:01:48.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:01:48.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:01:48.607 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.607 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.607 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.608 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:48.608 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:01:48.608 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.859123027000003, 2024-04-25T22:01:48.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:01:48.608 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.608 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.608 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.608 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:01:48.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:01:48.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:01:48.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:01:48.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:01:48.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:01:48.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:01:48.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:01:48.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:01:48.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:01:48.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:01:48.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:01:48.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:01:48.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:01:48.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:01:48.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:01:48.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:01:48.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:01:48.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:01:48.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:01:48.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:01:48.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:01:48.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:01:48.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:01:48.613 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.613 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.613 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.613 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:48.613 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:01:48.613 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.858978575000002, 2024-04-25T22:01:48.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:01:48.614 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.614 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.614 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.614 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:01:48.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:01:48.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:01:48.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:01:48.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:01:48.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:01:48.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:01:48.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:01:48.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:01:48.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:01:48.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:01:48.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:01:48.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:01:48.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:01:48.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:01:48.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:01:48.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:01:48.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:01:48.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:01:48.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:01:48.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:01:48.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:01:48.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:01:48.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:01:48.619 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.619 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.619 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.620 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:48.620 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:01:48.620 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.858921854999998, 2024-04-25T22:01:48.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:01:48.620 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:48.620 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:48.620 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:48.620 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:48.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:48.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:01:48.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:48.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:01:48.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:48.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:48.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:01:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:01:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:01:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:01:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:01:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:01:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:01:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:01:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:01:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:01:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:01:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:01:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:01:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:01:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:01:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:01:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:01:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:01:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:01:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:01:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:01:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:01:48.625 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.626 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.626 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.626 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:48.626 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:48.626 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:48.627 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:01:48.628 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:48.627+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:48.728 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:48.727+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:48.760 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:01:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:01:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:01:48.760 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:01:48.774 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:01:48.793 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-25T22:01:48.829 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:48.826+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:48.890 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:01:48.890 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:01:48.890 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:01:48.890 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:01:48.891 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:01:48.904 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:01:48.930 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:48.927+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:49.024 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:01:49.025 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:01:49.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:01:49.025 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:01:49.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.025 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 4 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:27 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:01:49.025 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:01:49.025 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.384496661999997, 2024-04-25T22:01:49.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013281644, 2024-04-25T22:01:49.025 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.025 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.025 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:01:49.025 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:01:49.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:01:49.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637801+0000", 2024-04-25T22:01:49.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1299999999999998e-07 2024-04-25T22:01:49.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637828+0000", 2024-04-25T22:01:49.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6953000000000001e-05 2024-04-25T22:01:49.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637873+0000", 2024-04-25T22:01:49.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4676999999999999e-05 2024-04-25T22:01:49.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637917+0000", 2024-04-25T22:01:49.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4815999999999999e-05 2024-04-25T22:01:49.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644220+0000", 2024-04-25T22:01:49.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063021049999999997 2024-04-25T22:01:49.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651082+0000", 2024-04-25T22:01:49.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068621799999999998 2024-04-25T22:01:49.030 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.030 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.031 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.031 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:15 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:01:49.031 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:01:49.031 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.379089049999997, 2024-04-25T22:01:49.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010973732, 2024-04-25T22:01:49.031 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.031 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.031 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.031 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:01:49.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:01:49.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643209+0000", 2024-04-25T22:01:49.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.003e-06 2024-04-25T22:01:49.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643230+0000", 2024-04-25T22:01:49.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0815999999999999e-05 2024-04-25T22:01:49.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643252+0000", 2024-04-25T22:01:49.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2586999999999999e-05 2024-04-25T22:01:49.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643271+0000", 2024-04-25T22:01:49.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8493000000000001e-05 2024-04-25T22:01:49.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644387+0000", 2024-04-25T22:01:49.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011160250000000001 2024-04-25T22:01:49.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:49.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644434+0000", 2024-04-25T22:01:49.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:01:49.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:49.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654103+0000", 2024-04-25T22:01:49.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096691360000000001 2024-04-25T22:01:49.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654181+0000", 2024-04-25T22:01:49.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8546000000000003e-05 2024-04-25T22:01:49.035 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.035 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.035 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.035 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:01:49.035 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:01:49.035 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.378988694, 2024-04-25T22:01:49.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088132450000000008, 2024-04-25T22:01:49.035 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.035 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.036 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.036 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:01:49.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:01:49.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643309+0000", 2024-04-25T22:01:49.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9600000000000008e-07 2024-04-25T22:01:49.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643339+0000", 2024-04-25T22:01:49.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9467000000000001e-05 2024-04-25T22:01:49.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644245+0000", 2024-04-25T22:01:49.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090648200000000001 2024-04-25T22:01:49.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644268+0000", 2024-04-25T22:01:49.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3017e-05 2024-04-25T22:01:49.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647517+0000", 2024-04-25T22:01:49.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032491680000000002 2024-04-25T22:01:49.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:49.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647561+0000", 2024-04-25T22:01:49.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3630000000000001e-05 2024-04-25T22:01:49.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:49.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652041+0000", 2024-04-25T22:01:49.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044804529999999997 2024-04-25T22:01:49.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652121+0000", 2024-04-25T22:01:49.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0031999999999995e-05 2024-04-25T22:01:49.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.039 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.040 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:34 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-25T22:01:49.040 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:01:49.040 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.376900067000001, 2024-04-25T22:01:49.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089225940000000007, 2024-04-25T22:01:49.040 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.040 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.040 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.040 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:01:49.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:01:49.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645398+0000", 2024-04-25T22:01:49.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4360000000000001e-06 2024-04-25T22:01:49.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645412+0000", 2024-04-25T22:01:49.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4283e-05 2024-04-25T22:01:49.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645434+0000", 2024-04-25T22:01:49.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1237e-05 2024-04-25T22:01:49.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645459+0000", 2024-04-25T22:01:49.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5675999999999999e-05 2024-04-25T22:01:49.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646081+0000", 2024-04-25T22:01:49.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062128900000000002 2024-04-25T22:01:49.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:49.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646131+0000", 2024-04-25T22:01:49.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0322999999999999e-05 2024-04-25T22:01:49.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:49.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654185+0000", 2024-04-25T22:01:49.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080542749999999996 2024-04-25T22:01:49.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654319+0000", 2024-04-25T22:01:49.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013407499999999999 2024-04-25T22:01:49.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.044 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.044 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:19 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-25T22:01:49.044 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:01:49.044 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.376798557999997, 2024-04-25T22:01:49.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076631340000000003, 2024-04-25T22:01:49.044 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.044 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.044 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.044 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:01:49.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:01:49.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645499+0000", 2024-04-25T22:01:49.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4300000000000001e-07 2024-04-25T22:01:49.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645509+0000", 2024-04-25T22:01:49.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0244000000000001e-05 2024-04-25T22:01:49.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645523+0000", 2024-04-25T22:01:49.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3315999999999999e-05 2024-04-25T22:01:49.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645531+0000", 2024-04-25T22:01:49.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.123e-06 2024-04-25T22:01:49.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648260+0000", 2024-04-25T22:01:49.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027289789999999999 2024-04-25T22:01:49.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:49.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648307+0000", 2024-04-25T22:01:49.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6969999999999999e-05 2024-04-25T22:01:49.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:49.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653039+0000", 2024-04-25T22:01:49.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047322299999999996 2024-04-25T22:01:49.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653161+0000", 2024-04-25T22:01:49.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012232899999999999 2024-04-25T22:01:49.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.048 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.048 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:49.048 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:01:49.048 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.374820896999999, 2024-04-25T22:01:49.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01271303, 2024-04-25T22:01:49.049 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.049 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.049 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.049 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:01:49.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:01:49.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647479+0000", 2024-04-25T22:01:49.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.286e-06 2024-04-25T22:01:49.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647494+0000", 2024-04-25T22:01:49.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.521e-05 2024-04-25T22:01:49.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647525+0000", 2024-04-25T22:01:49.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0403999999999999e-05 2024-04-25T22:01:49.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647544+0000", 2024-04-25T22:01:49.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8743e-05 2024-04-25T22:01:49.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647895+0000", 2024-04-25T22:01:49.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035099699999999997 2024-04-25T22:01:49.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:49.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648202+0000", 2024-04-25T22:01:49.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030758499999999998 2024-04-25T22:01:49.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:49.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648496+0000", 2024-04-25T22:01:49.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029370699999999999 2024-04-25T22:01:49.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:49.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654605+0000", 2024-04-25T22:01:49.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061095999999999998 2024-04-25T22:01:49.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:49.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.659959+0000", 2024-04-25T22:01:49.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053531680000000002 2024-04-25T22:01:49.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:49.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660078+0000", 2024-04-25T22:01:49.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011981600000000001 2024-04-25T22:01:49.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660189+0000", 2024-04-25T22:01:49.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011051400000000001 2024-04-25T22:01:49.061 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.061 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.062 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:49.062 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:01:49.062 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.374696804999999, 2024-04-25T22:01:49.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013053006000000001, 2024-04-25T22:01:49.063 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.063 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.063 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:01:49.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:01:49.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647602+0000", 2024-04-25T22:01:49.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.604e-06 2024-04-25T22:01:49.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647611+0000", 2024-04-25T22:01:49.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5689999999999994e-06 2024-04-25T22:01:49.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647634+0000", 2024-04-25T22:01:49.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3227e-05 2024-04-25T22:01:49.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647660+0000", 2024-04-25T22:01:49.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5829999999999998e-05 2024-04-25T22:01:49.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649544+0000", 2024-04-25T22:01:49.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001884066 2024-04-25T22:01:49.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:49.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649783+0000", 2024-04-25T22:01:49.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238411 2024-04-25T22:01:49.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:49.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.650794+0000", 2024-04-25T22:01:49.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010109920000000001 2024-04-25T22:01:49.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:49.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654714+0000", 2024-04-25T22:01:49.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039202170000000001 2024-04-25T22:01:49.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:49.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660403+0000", 2024-04-25T22:01:49.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056895940000000001 2024-04-25T22:01:49.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:49.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660551+0000", 2024-04-25T22:01:49.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014717899999999999 2024-04-25T22:01:49.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660653+0000", 2024-04-25T22:01:49.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102317 2024-04-25T22:01:49.075 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.075 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.075 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.075 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:17 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:49.076 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:01:49.076 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.374612624999997, 2024-04-25T22:01:49.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010101435000000001, 2024-04-25T22:01:49.076 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.076 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.076 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.077 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:01:49.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:01:49.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647686+0000", 2024-04-25T22:01:49.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-04-25T22:01:49.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647693+0000", 2024-04-25T22:01:49.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7330000000000003e-06 2024-04-25T22:01:49.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647711+0000", 2024-04-25T22:01:49.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7436e-05 2024-04-25T22:01:49.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647727+0000", 2024-04-25T22:01:49.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6232999999999999e-05 2024-04-25T22:01:49.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649249+0000", 2024-04-25T22:01:49.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015219890000000001 2024-04-25T22:01:49.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:49.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649533+0000", 2024-04-25T22:01:49.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028391799999999997 2024-04-25T22:01:49.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:49.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649841+0000", 2024-04-25T22:01:49.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030853400000000001 2024-04-25T22:01:49.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:49.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654622+0000", 2024-04-25T22:01:49.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047809630000000001 2024-04-25T22:01:49.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:49.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657616+0000", 2024-04-25T22:01:49.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029938769999999998 2024-04-25T22:01:49.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:49.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657724+0000", 2024-04-25T22:01:49.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108109 2024-04-25T22:01:49.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657786+0000", 2024-04-25T22:01:49.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1196000000000002e-05 2024-04-25T22:01:49.088 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.088 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.088 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.089 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:49.089 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:01:49.090 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.374424296999997, 2024-04-25T22:01:49.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010260877999999999, 2024-04-25T22:01:49.090 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.090 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.090 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.091 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:01:49.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:01:49.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647874+0000", 2024-04-25T22:01:49.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:01:49.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647884+0000", 2024-04-25T22:01:49.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.013e-05 2024-04-25T22:01:49.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647908+0000", 2024-04-25T22:01:49.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3592999999999999e-05 2024-04-25T22:01:49.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647926+0000", 2024-04-25T22:01:49.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8176999999999999e-05 2024-04-25T22:01:49.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651480+0000", 2024-04-25T22:01:49.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035540160000000001 2024-04-25T22:01:49.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:49.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651690+0000", 2024-04-25T22:01:49.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210249 2024-04-25T22:01:49.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:49.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651986+0000", 2024-04-25T22:01:49.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000296001 2024-04-25T22:01:49.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:49.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655696+0000", 2024-04-25T22:01:49.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037098410000000002 2024-04-25T22:01:49.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:49.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657896+0000", 2024-04-25T22:01:49.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022004630000000002 2024-04-25T22:01:49.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:49.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658035+0000", 2024-04-25T22:01:49.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013831499999999999 2024-04-25T22:01:49.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658133+0000", 2024-04-25T22:01:49.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8553000000000003e-05 2024-04-25T22:01:49.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.103 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.103 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:18 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:49.104 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:01:49.104 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.374345417000001, 2024-04-25T22:01:49.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013108712, 2024-04-25T22:01:49.104 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.104 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.104 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.105 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:01:49.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:01:49.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647953+0000", 2024-04-25T22:01:49.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.697e-06 2024-04-25T22:01:49.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647963+0000", 2024-04-25T22:01:49.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9259999999999995e-06 2024-04-25T22:01:49.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647982+0000", 2024-04-25T22:01:49.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-04-25T22:01:49.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648008+0000", 2024-04-25T22:01:49.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5956e-05 2024-04-25T22:01:49.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651686+0000", 2024-04-25T22:01:49.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678073 2024-04-25T22:01:49.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:49.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652023+0000", 2024-04-25T22:01:49.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033739399999999998 2024-04-25T22:01:49.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:49.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652348+0000", 2024-04-25T22:01:49.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032475000000000001 2024-04-25T22:01:49.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:49.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655883+0000", 2024-04-25T22:01:49.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035353030000000001 2024-04-25T22:01:49.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:49.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660791+0000", 2024-04-25T22:01:49.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049075330000000004 2024-04-25T22:01:49.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:49.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660930+0000", 2024-04-25T22:01:49.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000139856 2024-04-25T22:01:49.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661060+0000", 2024-04-25T22:01:49.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000129651 2024-04-25T22:01:49.116 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.116 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.116 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.116 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:49.117 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:01:49.117 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.374268524999998, 2024-04-25T22:01:49.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012451034, 2024-04-25T22:01:49.117 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.117 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.117 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.117 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:01:49.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:01:49.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648030+0000", 2024-04-25T22:01:49.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-04-25T22:01:49.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648036+0000", 2024-04-25T22:01:49.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8059999999999997e-06 2024-04-25T22:01:49.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648054+0000", 2024-04-25T22:01:49.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7744000000000002e-05 2024-04-25T22:01:49.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648070+0000", 2024-04-25T22:01:49.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-04-25T22:01:49.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648875+0000", 2024-04-25T22:01:49.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080444000000000002 2024-04-25T22:01:49.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:49.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649078+0000", 2024-04-25T22:01:49.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020391499999999999 2024-04-25T22:01:49.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:49.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649674+0000", 2024-04-25T22:01:49.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00059555299999999997 2024-04-25T22:01:49.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:49.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653185+0000", 2024-04-25T22:01:49.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035113459999999998 2024-04-25T22:01:49.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:49.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660251+0000", 2024-04-25T22:01:49.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070661350000000003 2024-04-25T22:01:49.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:49.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660382+0000", 2024-04-25T22:01:49.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013095899999999999 2024-04-25T22:01:49.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660479+0000", 2024-04-25T22:01:49.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6852e-05 2024-04-25T22:01:49.122 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.122 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.122 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.122 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:25 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:49.122 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:01:49.122 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.374202711999999, 2024-04-25T22:01:49.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012691025999999999, 2024-04-25T22:01:49.122 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.122 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.122 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:49.122 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:01:49.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:01:49.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648095+0000", 2024-04-25T22:01:49.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.424e-06 2024-04-25T22:01:49.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648102+0000", 2024-04-25T22:01:49.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2099999999999998e-06 2024-04-25T22:01:49.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648122+0000", 2024-04-25T22:01:49.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0242999999999999e-05 2024-04-25T22:01:49.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648138+0000", 2024-04-25T22:01:49.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6192999999999999e-05 2024-04-25T22:01:49.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651461+0000", 2024-04-25T22:01:49.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033225709999999999 2024-04-25T22:01:49.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:49.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651776+0000", 2024-04-25T22:01:49.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031567500000000002 2024-04-25T22:01:49.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660785+0000", 2024-04-25T22:01:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090087099999999996 2024-04-25T22:01:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:01:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.374140226000002, 2024-04-25T22:01:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013102702000000001, 2024-04-25T22:01:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.126 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:01:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:01:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648158+0000", 2024-04-25T22:01:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2839999999999999e-06 2024-04-25T22:01:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648163+0000", 2024-04-25T22:01:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-04-25T22:01:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648181+0000", 2024-04-25T22:01:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8484000000000001e-05 2024-04-25T22:01:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648196+0000", 2024-04-25T22:01:49.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4496e-05 2024-04-25T22:01:49.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653737+0000", 2024-04-25T22:01:49.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055414009999999996 2024-04-25T22:01:49.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:49.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653972+0000", 2024-04-25T22:01:49.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000234732 2024-04-25T22:01:49.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661259+0000", 2024-04-25T22:01:49.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072872689999999999 2024-04-25T22:01:49.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.130 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.130 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:49.130 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:01:49.130 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.374083405999997, 2024-04-25T22:01:49.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086984829999999999, 2024-04-25T22:01:49.131 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.131 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.131 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:49.131 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:01:49.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:01:49.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648214+0000", 2024-04-25T22:01:49.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-04-25T22:01:49.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648233+0000", 2024-04-25T22:01:49.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.878e-05 2024-04-25T22:01:49.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648252+0000", 2024-04-25T22:01:49.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8603000000000001e-05 2024-04-25T22:01:49.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648267+0000", 2024-04-25T22:01:49.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:01:49.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648846+0000", 2024-04-25T22:01:49.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057923000000000002 2024-04-25T22:01:49.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:49.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649027+0000", 2024-04-25T22:01:49.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181585 2024-04-25T22:01:49.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.656912+0000", 2024-04-25T22:01:49.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078844589999999999 2024-04-25T22:01:49.134 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.134 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.134 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.134 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e17/15 ondisk, result = 0)", 2024-04-25T22:01:49.134 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.657534+0000", 2024-04-25T22:01:49.135 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.364763183999997, 2024-04-25T22:01:49.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061820500000000003, 2024-04-25T22:01:49.135 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.135 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.135 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:49.135 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657534+0000", 2024-04-25T22:01:49.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657534+0000", 2024-04-25T22:01:49.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657544+0000", 2024-04-25T22:01:49.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0403e-05 2024-04-25T22:01:49.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657551+0000", 2024-04-25T22:01:49.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1230000000000002e-06 2024-04-25T22:01:49.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657572+0000", 2024-04-25T22:01:49.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0826999999999999e-05 2024-04-25T22:01:49.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657586+0000", 2024-04-25T22:01:49.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:01:49.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657861+0000", 2024-04-25T22:01:49.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027576100000000002 2024-04-25T22:01:49.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:49.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657882+0000", 2024-04-25T22:01:49.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0378999999999999e-05 2024-04-25T22:01:49.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658152+0000", 2024-04-25T22:01:49.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027015200000000001 2024-04-25T22:01:49.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.138 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.138 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 6 lcod 17'2)", 2024-04-25T22:01:49.138 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:01:49.139 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.362153489999997, 2024-04-25T22:01:49.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064966000000000004, 2024-04-25T22:01:49.139 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.139 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.139 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:01:49.139 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:01:49.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:01:49.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660144+0000", 2024-04-25T22:01:49.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1800000000000005e-07 2024-04-25T22:01:49.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660181+0000", 2024-04-25T22:01:49.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6408000000000001e-05 2024-04-25T22:01:49.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660197+0000", 2024-04-25T22:01:49.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6177000000000001e-05 2024-04-25T22:01:49.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660210+0000", 2024-04-25T22:01:49.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:01:49.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660556+0000", 2024-04-25T22:01:49.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034612899999999998 2024-04-25T22:01:49.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660793+0000", 2024-04-25T22:01:49.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023656799999999999 2024-04-25T22:01:49.142 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.142 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.142 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.142 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:18 3.1f e17/15 ondisk, result = 0)", 2024-04-25T22:01:49.142 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:01:49.142 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.361891716999999, 2024-04-25T22:01:49.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067878299999999997, 2024-04-25T22:01:49.142 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.142 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.143 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:49.143 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:01:49.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:01:49.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660406+0000", 2024-04-25T22:01:49.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2800000000000005e-07 2024-04-25T22:01:49.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660412+0000", 2024-04-25T22:01:49.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0399999999999998e-06 2024-04-25T22:01:49.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660429+0000", 2024-04-25T22:01:49.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7394e-05 2024-04-25T22:01:49.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660445+0000", 2024-04-25T22:01:49.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6069000000000001e-05 2024-04-25T22:01:49.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660757+0000", 2024-04-25T22:01:49.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031194300000000002 2024-04-25T22:01:49.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:49.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660776+0000", 2024-04-25T22:01:49.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8862999999999999e-05 2024-04-25T22:01:49.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661084+0000", 2024-04-25T22:01:49.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030754600000000001 2024-04-25T22:01:49.146 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.146 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.146 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.146 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-25T22:01:49.146 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:01:49.147 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.361827489, 2024-04-25T22:01:49.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080007600000000004, 2024-04-25T22:01:49.147 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.147 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.147 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:01:49.147 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:01:49.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:01:49.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660470+0000", 2024-04-25T22:01:49.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4499999999999996e-07 2024-04-25T22:01:49.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660475+0000", 2024-04-25T22:01:49.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-04-25T22:01:49.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660490+0000", 2024-04-25T22:01:49.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5274e-05 2024-04-25T22:01:49.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660501+0000", 2024-04-25T22:01:49.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0694e-05 2024-04-25T22:01:49.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661130+0000", 2024-04-25T22:01:49.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062887499999999999 2024-04-25T22:01:49.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661269+0000", 2024-04-25T22:01:49.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013955900000000001 2024-04-25T22:01:49.150 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.150 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.150 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.150 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:01:49.150 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:01:49.150 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.398095490000003, 2024-04-25T22:01:49.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037104880000000001, 2024-04-25T22:01:49.150 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.151 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.151 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.151 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:01:49.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:01:49.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624204+0000", 2024-04-25T22:01:49.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.757e-06 2024-04-25T22:01:49.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624233+0000", 2024-04-25T22:01:49.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9362000000000001e-05 2024-04-25T22:01:49.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624264+0000", 2024-04-25T22:01:49.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0843000000000003e-05 2024-04-25T22:01:49.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624280+0000", 2024-04-25T22:01:49.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5577e-05 2024-04-25T22:01:49.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624458+0000", 2024-04-25T22:01:49.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017821199999999999 2024-04-25T22:01:49.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:49.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624661+0000", 2024-04-25T22:01:49.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020283200000000001 2024-04-25T22:01:49.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:49.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624842+0000", 2024-04-25T22:01:49.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018115500000000001 2024-04-25T22:01:49.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:49.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.626271+0000", 2024-04-25T22:01:49.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001429416 2024-04-25T22:01:49.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:49.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627749+0000", 2024-04-25T22:01:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014778650000000001 2024-04-25T22:01:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627849+0000", 2024-04-25T22:01:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9261999999999999e-05 2024-04-25T22:01:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627912+0000", 2024-04-25T22:01:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3207000000000007e-05 2024-04-25T22:01:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.155 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.156 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.156 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-25T22:01:49.156 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:01:49.156 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.3953981389999992, 2024-04-25T22:01:49.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029804620000000001, 2024-04-25T22:01:49.156 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:49.156 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:49.156 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.156 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:49.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:49.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:01:49.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:49.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:01:49.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:49.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:49.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626903+0000", 2024-04-25T22:01:49.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0029999999999996e-06 2024-04-25T22:01:49.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:49.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626921+0000", 2024-04-25T22:01:49.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8272999999999999e-05 2024-04-25T22:01:49.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:49.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626959+0000", 2024-04-25T22:01:49.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7843999999999999e-05 2024-04-25T22:01:49.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626977+0000", 2024-04-25T22:01:49.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7756000000000001e-05 2024-04-25T22:01:49.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:49.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627153+0000", 2024-04-25T22:01:49.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017643800000000001 2024-04-25T22:01:49.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:49.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627425+0000", 2024-04-25T22:01:49.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027207300000000001 2024-04-25T22:01:49.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:49.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627848+0000", 2024-04-25T22:01:49.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042297199999999997 2024-04-25T22:01:49.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:49.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629590+0000", 2024-04-25T22:01:49.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017416809999999999 2024-04-25T22:01:49.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:49.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629720+0000", 2024-04-25T22:01:49.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130526 2024-04-25T22:01:49.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:49.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629808+0000", 2024-04-25T22:01:49.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7449999999999998e-05 2024-04-25T22:01:49.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:49.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:49.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:49.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629879+0000", 2024-04-25T22:01:49.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1445999999999993e-05 2024-04-25T22:01:49.161 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.161 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.161 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.161 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:49.161 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:49.161 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:01:49.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:01:49.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:49.159+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:49.263 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:49.263+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:49.293 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:01:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:01:49.293 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:49.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:01:49.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:49.363+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:49.465 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:49.462+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:49.470 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:49.470 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:01:49.470 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:01:49.470 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:01:49.470 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:49.485 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:01:49.566 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:49.566+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:49.611 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:49.611 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:01:49.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:01:49.611 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:01:49.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.611 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:01:49.611 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.782970894000002, 2024-04-25T22:01:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:01:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:49.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:01:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:01:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:01:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:01:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:01:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:01:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:01:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:01:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:01:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:01:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:01:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:01:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:01:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:01:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:01:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:01:49.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:01:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.782240076000001, 2024-04-25T22:01:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:01:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:01:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:01:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:01:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:01:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:01:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:01:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:01:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:01:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:01:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:01:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:01:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:01:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:01:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:01:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:01:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:01:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:01:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.781573805000001, 2024-04-25T22:01:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:01:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:01:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:01:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:01:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:01:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:01:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:01:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:01:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:01:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:01:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:01:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:01:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:01:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:01:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:01:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:01:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:01:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:01:49.624 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.780673905, 2024-04-25T22:01:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:01:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:01:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:01:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:01:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:01:49.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:01:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:01:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:01:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:01:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:01:49.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:01:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:01:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:01:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:01:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:01:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:01:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:01:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:01:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.778637564, 2024-04-25T22:01:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:01:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:01:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:01:49.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:01:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:01:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:01:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:01:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:01:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:01:49.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:01:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:01:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:01:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:01:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:01:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:01:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:01:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:01:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:01:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.778174227000001, 2024-04-25T22:01:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:01:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:01:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:01:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:01:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:01:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:01:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:01:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:01:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:01:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:01:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:01:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:01:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:01:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:01:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:01:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:01:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:01:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:01:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.777307348000001, 2024-04-25T22:01:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:01:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:01:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:01:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:01:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:01:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:01:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:01:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:01:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:01:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:01:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:01:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:01:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:01:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:01:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:01:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:01:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:01:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:01:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.776856273999996, 2024-04-25T22:01:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:01:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:01:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:01:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:01:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:01:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:01:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:01:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:01:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:01:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:01:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:01:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:01:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:01:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:01:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:01:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:01:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:01:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:01:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.776406688000002, 2024-04-25T22:01:49.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:01:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:01:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:01:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:01:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:01:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:01:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:01:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:01:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:01:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:01:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:01:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:01:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:01:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:49.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:01:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:01:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:01:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:01:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.979750201000002, 2024-04-25T22:01:49.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:01:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:01:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:01:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:01:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:01:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:01:49.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:01:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:01:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:01:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:01:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:01:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:01:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:01:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:01:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:01:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:01:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:01:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:01:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:01:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:01:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:01:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:01:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:01:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.979626218, 2024-04-25T22:01:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:01:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:01:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:01:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:01:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:01:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:01:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:01:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:01:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:01:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:01:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:01:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:01:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:01:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:01:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:01:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:01:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:01:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:01:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:01:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:01:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:01:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:01:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:01:49.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.979552282, 2024-04-25T22:01:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:01:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:01:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:01:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:01:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:01:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:01:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:01:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:01:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:01:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:01:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:01:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:01:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:01:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:01:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:01:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:01:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:01:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:01:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:01:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:01:49.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:01:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:01:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:01:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.979436030000002, 2024-04-25T22:01:49.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:01:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:01:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:01:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:01:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:01:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:01:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:01:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:01:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:01:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:01:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:01:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:01:49.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:01:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:01:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:01:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:01:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:01:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:49.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:01:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:01:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:01:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:01:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:01:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:01:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.670 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.979272621, 2024-04-25T22:01:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:01:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:01:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:01:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:01:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:01:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:01:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:01:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:01:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:01:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:01:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:01:49.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:01:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:01:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:01:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:01:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:01:49.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:01:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:01:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:01:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:01:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:01:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:01:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:01:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.979170425, 2024-04-25T22:01:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:01:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.676 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:01:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:01:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:01:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:01:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:01:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:01:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:01:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:01:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:01:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:01:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:01:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:01:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:01:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:01:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:01:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:01:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:01:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:01:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:01:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:01:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:01:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:01:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.979091472, 2024-04-25T22:01:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:01:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:01:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:01:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:01:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:01:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:01:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:01:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:01:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:01:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:01:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:01:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:01:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:01:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:01:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:01:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:01:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:01:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:01:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:01:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:01:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:01:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:01:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:01:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.979026449000003, 2024-04-25T22:01:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:01:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:01:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:01:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:01:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:01:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:01:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:01:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:01:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:01:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:01:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:01:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:01:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:01:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:01:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:01:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.978948256999999, 2024-04-25T22:01:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:01:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:01:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:01:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:01:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:01:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:01:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:01:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:01:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:01:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:01:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:01:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:01:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:01:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:01:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:01:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:01:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.964301796999997, 2024-04-25T22:01:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:01:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:01:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:01:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:01:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:01:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:01:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:01:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:01:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:01:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:01:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:01:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:01:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:01:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:01:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:01:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:01:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:01:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:01:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 34.964141841, 2024-04-25T22:01:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:01:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:01:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:01:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:01:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:01:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:01:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:01:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:01:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:01:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:01:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:01:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:01:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:01:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:01:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:01:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:01:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:01:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:49.702 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:49.702 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:01:49.704 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:49.703+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:49.705 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:01:49.805 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:49.803+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:49.840 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:49.841 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:01:49.841 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:01:49.841 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:49.855 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:01:49.864 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:01:49.865 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:01:49.886 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:01:49.887 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:01:49.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:49.903+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:49.907 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:01:49.907 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:01:49.980 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:49.980 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:49.994 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:01:50.007 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:50.003+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:50.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:50.103+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:50.111 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:50.111 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:50.126 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:01:50.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:50.203+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:50.252 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:50.253 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:50.267 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:01:50.309 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:50.307+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:50.411 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:50.410+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:50.430 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:50.430 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:50.445 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:01:50.512 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:50.511+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:50.560 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:50.561 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:50.574 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:01:50.619 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:50.619+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:50.707 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:50.707 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:50.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:50.707+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:50.721 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:01:50.815 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:50.815+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:50.817 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:01:50.886 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:50.886 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:50.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:01:50.943 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:50.943+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:51.017 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:51.015+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:51.066 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:51.066 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:51.080 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:01:51.127 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:51.127+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:51.215 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:51.215 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:51.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:51.215+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:51.230 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:01:51.318 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:51.314+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:51.348 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:51.348 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:51.362 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:01:51.419 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:51.419+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:51.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:51.519+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:51.533 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:51.533 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:51.549 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:01:51.621 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:51.619+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:51.682 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:51.683 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:51.697 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:01:51.722 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:51.719+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:51.813 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:51.813 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:51.821 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-25T22:01:51.825 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:51.818+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:51.827 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:01:51.924 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:51.918+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:51.925 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:01:51.948 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:51.948 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:51.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:01:52.025 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:52.022+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:52.084 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:01:52.085 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:01:52.095 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:52.095 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:52.108 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:01:52.108 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:01:52.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:01:52.126 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:52.122+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:52.127 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:01:52.127 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:01:52.227 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:52.227+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:52.230 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:52.230 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:01:52.230 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:01:52.230 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:01:52.230 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:52.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:01:52.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:52.327+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:52.415 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:01:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:01:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:01:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:01:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.587438028000001, 2024-04-25T22:01:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:01:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:01:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:01:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:01:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:01:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:01:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:01:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:01:52.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:01:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:01:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:01:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:01:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:01:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:01:52.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:01:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:01:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:01:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:01:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.58670721, 2024-04-25T22:01:52.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:01:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:01:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:01:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:01:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:01:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:01:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:01:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:01:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:01:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:01:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:01:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:01:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:01:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:01:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:01:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:01:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:01:52.424 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.425 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.425 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:01:52.425 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:52.425 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.586040939, 2024-04-25T22:01:52.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:01:52.425 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.425 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.425 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.425 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:52.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:52.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:01:52.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:01:52.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:01:52.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:01:52.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:01:52.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:01:52.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:01:52.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:01:52.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:01:52.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:01:52.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:01:52.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:01:52.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:52.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:01:52.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:01:52.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:01:52.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:01:52.429 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.429 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.429 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.430 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:01:52.430 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:52.430 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.585141039, 2024-04-25T22:01:52.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:01:52.430 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.430 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.430 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:52.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:52.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:01:52.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:01:52.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:01:52.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:01:52.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:01:52.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:01:52.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:01:52.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:01:52.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:01:52.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:01:52.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:01:52.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:01:52.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:52.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:01:52.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:01:52.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:01:52.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:01:52.434 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.434 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.434 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.435 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:01:52.435 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:52.435 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.583104698, 2024-04-25T22:01:52.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:01:52.435 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.435 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.435 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.435 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:52.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:52.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:01:52.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:01:52.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:01:52.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:01:52.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:01:52.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:01:52.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:01:52.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:01:52.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:01:52.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:01:52.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:01:52.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:01:52.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:52.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:01:52.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:01:52.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:01:52.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:01:52.439 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.439 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.439 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.440 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:01:52.440 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:52.440 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.582641361, 2024-04-25T22:01:52.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:01:52.440 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.440 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.440 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.440 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:52.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:52.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:01:52.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:01:52.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:01:52.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:01:52.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:01:52.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:01:52.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:01:52.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:01:52.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:01:52.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:01:52.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:01:52.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:01:52.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:52.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:01:52.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:01:52.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:01:52.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:01:52.445 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.445 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.445 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.445 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:01:52.445 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:52.446 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.581774482, 2024-04-25T22:01:52.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:01:52.446 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.446 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.446 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.446 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:52.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:52.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:01:52.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:01:52.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:01:52.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:01:52.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:01:52.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:01:52.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:01:52.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:01:52.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:01:52.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:01:52.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:01:52.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:01:52.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:52.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:01:52.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:01:52.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:01:52.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:01:52.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.450 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.450 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:01:52.450 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:52.450 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.581323408000003, 2024-04-25T22:01:52.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:01:52.450 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.451 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.451 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:52.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:52.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:01:52.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:01:52.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:01:52.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:01:52.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:01:52.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:01:52.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:01:52.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:01:52.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:01:52.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:01:52.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:01:52.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:01:52.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:52.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:01:52.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:01:52.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:01:52.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:01:52.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.455 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.455 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:01:52.455 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:52.455 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.580873822000001, 2024-04-25T22:01:52.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:01:52.455 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.455 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.455 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.455 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:01:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:01:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:01:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:01:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:01:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:01:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:01:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:01:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:01:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:01:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:01:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:01:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:01:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:01:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:01:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:01:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.784217335000001, 2024-04-25T22:01:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:01:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:01:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:01:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:01:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:01:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:01:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:01:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:01:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:01:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:01:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:01:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:01:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:01:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:01:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:01:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:01:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:01:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:01:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:01:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:01:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:01:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:01:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:01:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.784093351999999, 2024-04-25T22:01:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:01:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:01:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:01:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:01:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:01:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:01:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:01:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:01:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:01:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:01:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:01:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:01:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:01:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:01:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:01:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:01:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:01:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:01:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:01:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:01:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:01:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:01:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:01:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.784019416, 2024-04-25T22:01:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:01:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:01:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:01:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:01:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:01:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:01:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:01:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:01:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:01:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:01:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:01:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:01:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:01:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:01:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:01:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:01:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:01:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:01:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:01:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:01:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:01:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:01:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:01:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.783903164000002, 2024-04-25T22:01:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:01:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:01:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:01:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:01:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:01:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:01:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:01:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:01:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:01:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:01:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:01:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:01:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:01:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:01:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:01:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:01:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:01:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:01:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:01:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:01:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:01:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:01:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:01:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.783739754999999, 2024-04-25T22:01:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:01:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:01:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:01:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:01:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:01:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:01:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:01:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:01:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:01:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:01:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:01:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:01:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:01:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:01:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:01:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:01:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:01:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:01:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:01:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:01:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:01:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:01:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:01:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.783637558999999, 2024-04-25T22:01:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:01:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:01:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:01:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:01:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:01:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:01:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:01:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:01:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:01:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:01:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:01:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:01:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:01:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:01:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:01:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:01:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:01:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:01:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:01:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:01:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:01:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:01:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:01:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.783558606, 2024-04-25T22:01:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:01:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:01:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:01:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:01:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:01:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:01:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:01:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:01:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:01:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:01:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:01:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:01:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:01:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:01:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:01:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:01:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:01:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:01:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:01:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:01:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:01:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:01:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:01:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.783493583000002, 2024-04-25T22:01:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:01:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:01:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:01:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:01:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:01:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:01:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:01:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:01:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:01:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:01:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:01:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:01:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:01:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:01:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:01:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.783415390999998, 2024-04-25T22:01:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:01:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:01:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:01:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:01:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:01:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:01:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:01:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:01:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:01:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:01:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:01:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:01:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:01:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:01:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:01:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:01:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.768768930999997, 2024-04-25T22:01:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:01:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:01:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:01:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:01:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:01:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:01:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:01:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:01:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:01:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:01:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:01:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:01:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:01:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:01:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:01:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:01:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:01:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:01:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.768608974999999, 2024-04-25T22:01:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:01:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:01:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:01:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:01:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:01:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:01:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:01:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:01:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:01:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:01:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:01:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:01:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:01:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:01:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:01:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:01:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:01:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:52.516 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:52.516 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:52.518 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:52.515+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:52.518 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:01:52.618 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:52.615+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:52.653 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:52.653 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:01:52.653 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:01:52.653 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:52.667 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:01:52.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:52.719+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:52.786 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:52.786 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:01:52.786 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:01:52.786 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:01:52.787 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:52.801 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:01:52.845 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:52.842+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:52.922 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:52.922 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:01:52.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:01:52.922 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:01:52.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.922 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:52.923 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:01:52.923 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.925931812999998, 2024-04-25T22:01:52.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:01:52.923 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:52.923 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:52.923 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.923 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:52.923 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:52.923 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:52.923 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:01:52.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.923 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:52.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:52.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:01:52.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:52.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:01:52.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:52.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:01:52.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:01:52.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:52.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:01:52.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:01:52.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:52.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:01:52.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:01:52.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:01:52.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:01:52.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:52.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:01:52.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:01:52.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:52.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:01:52.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:01:52.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:52.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:01:52.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:01:52.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:01:52.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:01:52.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:52.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:01:52.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:01:52.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:52.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:01:52.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:01:52.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:52.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:01:52.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:01:52.929 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.929 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:52.929 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.929 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:52.929 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:01:52.929 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.743868740000003, 2024-04-25T22:01:52.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:01:52.929 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:52.929 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:52.930 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.930 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:52.930 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:52.930 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:52.930 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:01:52.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.930 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:52.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:52.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:01:52.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:52.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:01:52.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:52.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:01:52.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:01:52.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:52.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:01:52.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:01:52.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:52.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:01:52.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:01:52.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:01:52.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:01:52.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:52.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:01:52.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:01:52.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:52.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:01:52.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:01:52.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:52.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:01:52.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:01:52.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:01:52.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:01:52.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:52.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:01:52.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:01:52.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:52.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:01:52.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:01:52.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:52.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:01:52.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:01:52.935 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.935 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:52.935 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.935 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:52.935 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:01:52.935 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.743824459999999, 2024-04-25T22:01:52.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:01:52.935 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:52.935 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:52.936 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.936 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:52.936 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:52.936 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:52.936 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:01:52.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.936 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:52.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:52.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:01:52.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:52.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:01:52.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:52.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:01:52.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:01:52.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:52.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:01:52.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:01:52.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:52.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:01:52.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:01:52.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:01:52.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:01:52.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:52.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:01:52.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:01:52.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:52.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:01:52.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:01:52.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:52.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:01:52.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:01:52.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:01:52.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:01:52.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:52.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:01:52.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:01:52.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:52.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:01:52.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:01:52.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:52.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:01:52.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:01:52.940 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.940 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:52.940 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.941 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:52.941 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:01:52.941 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.743767935000001, 2024-04-25T22:01:52.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:01:52.941 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:52.941 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:52.941 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.941 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:52.941 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:52.941 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:52.941 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:01:52.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.942 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:52.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:52.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:01:52.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:52.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:01:52.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:52.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:01:52.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:01:52.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:52.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:01:52.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:01:52.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:52.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:01:52.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:01:52.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:01:52.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:01:52.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:52.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:01:52.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:01:52.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:52.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:01:52.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:01:52.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:52.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:01:52.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:01:52.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:01:52.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:01:52.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:52.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:01:52.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:01:52.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:52.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:01:52.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:01:52.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:52.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:01:52.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:01:52.946 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.946 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:52.946 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.946 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:52.946 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:01:52.946 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.743572692999997, 2024-04-25T22:01:52.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:01:52.947 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:52.947 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:52.947 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.947 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:52.947 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:52.947 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:52.947 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:01:52.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.947 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:52.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:52.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:01:52.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:52.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:01:52.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:52.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:01:52.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:01:52.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:52.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:01:52.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:01:52.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:52.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:01:52.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:01:52.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:01:52.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:01:52.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:52.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:01:52.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:01:52.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:52.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:01:52.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:01:52.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:52.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:01:52.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:01:52.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:01:52.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:01:52.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:52.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:01:52.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:01:52.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:52.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:01:52.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:01:52.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:52.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:01:52.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:01:52.952 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.952 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:52.952 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.952 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:52.952 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:01:52.952 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.743510399999998, 2024-04-25T22:01:52.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:01:52.953 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:52.953 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:52.953 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.953 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:52.953 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:52.953 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:52.953 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:01:52.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.953 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:52.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:52.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:01:52.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:52.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:01:52.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:52.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:01:52.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:01:52.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:52.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:01:52.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:01:52.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:52.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:01:52.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:01:52.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:01:52.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:01:52.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:52.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:01:52.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:01:52.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:52.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:01:52.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:01:52.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:52.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:01:52.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:01:52.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:01:52.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:01:52.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:52.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:01:52.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:01:52.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:52.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:01:52.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:01:52.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:52.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:01:52.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:01:52.957 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.957 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:52.958 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.958 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:52.958 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:01:52.958 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.743450183999997, 2024-04-25T22:01:52.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:01:52.958 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:52.958 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:52.958 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.958 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:52.958 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:52.958 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:52.958 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:01:52.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.959 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:52.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:52.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:01:52.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:52.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:01:52.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:52.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:01:52.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:01:52.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:52.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:01:52.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:01:52.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:52.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:01:52.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:01:52.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:01:52.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:01:52.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:52.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:01:52.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:01:52.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:52.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:01:52.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:01:52.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:52.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:01:52.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:01:52.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:01:52.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:01:52.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:52.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:01:52.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:01:52.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:52.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:01:52.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:01:52.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:52.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:01:52.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:01:52.963 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.963 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:52.963 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.964 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:52.964 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:01:52.964 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.743260671999998, 2024-04-25T22:01:52.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:01:52.964 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:52.964 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:52.964 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.964 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:52.964 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:52.964 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:52.964 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:01:52.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.964 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:52.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:52.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:01:52.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:52.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:01:52.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:52.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:01:52.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:01:52.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:52.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:01:52.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:01:52.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:52.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:01:52.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:01:52.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:01:52.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:01:52.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:52.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:01:52.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:01:52.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:52.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:01:52.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:01:52.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:52.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:01:52.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:01:52.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:01:52.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:01:52.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:52.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:01:52.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:01:52.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:52.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:01:52.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:01:52.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:52.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:01:52.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:01:52.970 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.970 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:52.970 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.970 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:52.970 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:01:52.970 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.551922838000003, 2024-04-25T22:01:52.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:01:52.971 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:52.971 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:52.971 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.971 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:52.971 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:52.971 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:52.971 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:01:52.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.971 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:52.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:52.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:01:52.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:52.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:01:52.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:52.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:01:52.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:01:52.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:52.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:01:52.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:01:52.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:52.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:01:52.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:01:52.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:01:52.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:01:52.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:52.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:01:52.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:01:52.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:52.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:01:52.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:01:52.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:52.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:01:52.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:01:52.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:01:52.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:01:52.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:52.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:01:52.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:01:52.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:52.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:01:52.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:01:52.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:52.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:01:52.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:01:52.976 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.976 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:52.976 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.976 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:52.976 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:01:52.976 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.551884461, 2024-04-25T22:01:52.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:01:52.976 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:52.976 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:52.976 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.977 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:52.977 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:52.977 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:52.977 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:01:52.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.977 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:52.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:52.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:01:52.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:52.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:01:52.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:52.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:01:52.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:01:52.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:52.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:01:52.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:01:52.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:52.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:01:52.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:01:52.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:01:52.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:01:52.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:52.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:01:52.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:01:52.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:52.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:01:52.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:01:52.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:52.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:01:52.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:01:52.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:01:52.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:01:52.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:52.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:01:52.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:01:52.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:52.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:01:52.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:01:52.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:52.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:01:52.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:01:52.981 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.981 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:52.982 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.982 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:52.982 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:01:52.982 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.551833201999997, 2024-04-25T22:01:52.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:01:52.982 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:52.982 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:52.982 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.982 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:52.982 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:52.982 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:52.982 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:01:52.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.983 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:52.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:52.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:01:52.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:52.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:01:52.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:52.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:01:52.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:01:52.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:52.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:01:52.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:01:52.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:52.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:01:52.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:01:52.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:01:52.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:01:52.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:52.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:01:52.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:01:52.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:52.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:01:52.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:01:52.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:52.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:01:52.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:01:52.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:01:52.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:01:52.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:52.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:01:52.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:01:52.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:52.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:01:52.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:01:52.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:52.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:01:52.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:01:52.987 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.987 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:52.987 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.987 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:52.988 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:01:52.988 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.551684553000001, 2024-04-25T22:01:52.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:01:52.988 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:52.988 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:52.988 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.988 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:52.988 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:52.988 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:52.988 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:01:52.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.988 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:52.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:52.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:01:52.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:52.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:01:52.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:52.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:01:52.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:01:52.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:52.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:01:52.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:01:52.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:52.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:01:52.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:01:52.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:01:52.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:01:52.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:52.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:01:52.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:01:52.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:52.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:01:52.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:01:52.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:52.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:01:52.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:01:52.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:01:52.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:01:52.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:52.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:01:52.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:01:52.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:52.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:01:52.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:01:52.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:52.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:01:52.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:01:52.993 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.993 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:52.993 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.993 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:52.993 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:01:52.993 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.551642403000002, 2024-04-25T22:01:52.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:01:52.994 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:52.994 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:52.994 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:52.994 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:52.994 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:52.994 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:52.994 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:01:52.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.994 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:52.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:52.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:01:52.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:52.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:01:52.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:52.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:52.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:01:52.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:01:52.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:52.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:01:52.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:01:52.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:52.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:01:52.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:01:52.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:52.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:01:52.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:01:52.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:52.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:01:52.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:01:52.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:52.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:01:52.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:01:52.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:52.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:01:52.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:01:52.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:52.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:01:52.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:01:52.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:52.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:01:52.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:01:52.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:52.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:01:52.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:01:52.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:52.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:01:52.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:01:52.999 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.999 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:52.999 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:52.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:52.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:52.999 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:53.001 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:01:53.001 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.55160455, 2024-04-25T22:01:53.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:01:53.001 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:53.001 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:53.001 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.001 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:53.001 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:53.001 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:53.001 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:01:53.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.002 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:53.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:53.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:01:53.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:53.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:53.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:01:53.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:53.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:53.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:01:53.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:01:53.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:53.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:01:53.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:01:53.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:53.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:01:53.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:01:53.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:01:53.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:01:53.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:53.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:01:53.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:01:53.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:53.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:01:53.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:01:53.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:53.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:01:53.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:01:53.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:53.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:01:53.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:01:53.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:53.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:01:53.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:01:53.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:53.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:01:53.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:01:53.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:53.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:01:53.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:01:53.015 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:53.015 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:53.015 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:53.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.016 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:53.016 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:01:53.016 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.551395225, 2024-04-25T22:01:53.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:01:53.016 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:53.016 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:53.016 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.016 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:53.016 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:53.016 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:53.016 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:01:53.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.016 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:53.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:53.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:01:53.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:53.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:53.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:01:53.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:53.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:53.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:01:53.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:01:53.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:53.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:01:53.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:01:53.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:53.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:01:53.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:01:53.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:01:53.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:01:53.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:53.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:01:53.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:01:53.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:53.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:01:53.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:01:53.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:53.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:01:53.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:01:53.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:53.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:01:53.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:01:53.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:53.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:01:53.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:01:53.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:53.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:01:53.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:01:53.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:53.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:01:53.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:01:53.021 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:53.021 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:53.021 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:53.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.021 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:53.021 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:01:53.021 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 38.285143953000002, 2024-04-25T22:01:53.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:01:53.021 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:53.021 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:53.022 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.022 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:53.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:53.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:01:53.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:53.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:53.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:01:53.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:53.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:53.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:01:53.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:01:53.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:53.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:01:53.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:01:53.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:53.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:01:53.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:01:53.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:01:53.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:01:53.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:53.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:01:53.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:01:53.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:53.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:01:53.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:01:53.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:53.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:01:53.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:01:53.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:53.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:01:53.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:01:53.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:53.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:01:53.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:01:53.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:53.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:01:53.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:01:53.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:53.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:01:53.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:01:53.026 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:53.026 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:53.026 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:53.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.026 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:53.026 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:53.027 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 38.285110113000002, 2024-04-25T22:01:53.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:01:53.027 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:53.027 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:53.027 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.027 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:53.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:53.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:53.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:53.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:53.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:53.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:53.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:53.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:53.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:01:53.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:53.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:01:53.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:01:53.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:53.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:01:53.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:01:53.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:01:53.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:01:53.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:53.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:01:53.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:01:53.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:53.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:01:53.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:01:53.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:53.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:01:53.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:01:53.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:53.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:01:53.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:01:53.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:53.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:01:53.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:01:53.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:53.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:01:53.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:01:53.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:53.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:01:53.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:01:53.031 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:53.031 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:53.031 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:53.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.032 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:53.032 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:01:53.032 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 38.285058417000002, 2024-04-25T22:01:53.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:01:53.032 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:53.032 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:53.032 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.032 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:53.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:53.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:01:53.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:53.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:53.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:01:53.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:53.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:53.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:01:53.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:01:53.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:53.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:01:53.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:01:53.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:53.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:01:53.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:01:53.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:01:53.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:01:53.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:53.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:01:53.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:01:53.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:53.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:01:53.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:01:53.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:53.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:01:53.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:01:53.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:53.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:01:53.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:01:53.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:53.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:01:53.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:01:53.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:53.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:01:53.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:01:53.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:53.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:01:53.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:01:53.036 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:53.036 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:53.037 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:53.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.037 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:53.037 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:01:53.037 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 38.284913965000001, 2024-04-25T22:01:53.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:01:53.037 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:53.037 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:53.037 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.037 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:53.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:53.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:01:53.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:53.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:53.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:01:53.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:53.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:53.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:01:53.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:01:53.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:53.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:01:53.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:01:53.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:53.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:01:53.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:01:53.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:01:53.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:01:53.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:53.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:01:53.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:01:53.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:53.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:01:53.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:01:53.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:53.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:01:53.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:01:53.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:53.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:01:53.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:01:53.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:53.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:01:53.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:01:53.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:53.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:01:53.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:01:53.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:53.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:01:53.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:01:53.042 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:53.042 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:53.042 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:53.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.042 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:53.042 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:01:53.042 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 38.284857244999998, 2024-04-25T22:01:53.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:01:53.042 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:53.042 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:53.042 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.042 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:53.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:53.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:01:53.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:53.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:53.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:01:53.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:53.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:53.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:01:53.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:01:53.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:53.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:01:53.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:01:53.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:53.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:01:53.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:01:53.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:01:53.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:01:53.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:53.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:01:53.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:01:53.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:53.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:01:53.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:01:53.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:53.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:01:53.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:01:53.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:53.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:01:53.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:01:53.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:53.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:01:53.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:01:53.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:53.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:01:53.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:01:53.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:53.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:53.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:53.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:01:53.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:01:53.047 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:53.047 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:53.047 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:53.047 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:53.047 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:53.047 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:53.047 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:52.918+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:53.048 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:01:53.050 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:53.047+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:53.151 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:53.150+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:53.180 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:01:53.180 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:01:53.180 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:01:53.180 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:01:53.193 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:01:53.252 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:53.250+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:53.313 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:01:53.313 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:01:53.313 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:01:53.313 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:01:53.313 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:01:53.327 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:01:53.353 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:53.351+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:53.449 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:01:53.450 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:01:53.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:01:53.450 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:01:53.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.450 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 4 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:27 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:01:53.450 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:01:53.450 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.810589802000003, 2024-04-25T22:01:53.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013281644, 2024-04-25T22:01:53.450 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.450 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.450 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:01:53.450 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:01:53.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:01:53.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637801+0000", 2024-04-25T22:01:53.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1299999999999998e-07 2024-04-25T22:01:53.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637828+0000", 2024-04-25T22:01:53.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6953000000000001e-05 2024-04-25T22:01:53.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637873+0000", 2024-04-25T22:01:53.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4676999999999999e-05 2024-04-25T22:01:53.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637917+0000", 2024-04-25T22:01:53.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4815999999999999e-05 2024-04-25T22:01:53.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644220+0000", 2024-04-25T22:01:53.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063021049999999997 2024-04-25T22:01:53.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651082+0000", 2024-04-25T22:01:53.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068621799999999998 2024-04-25T22:01:53.453 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.453 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.453 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.454 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:15 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:01:53.454 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:01:53.454 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.805182189999996, 2024-04-25T22:01:53.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010973732, 2024-04-25T22:01:53.454 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.454 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.454 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.454 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:01:53.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:01:53.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643209+0000", 2024-04-25T22:01:53.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.003e-06 2024-04-25T22:01:53.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643230+0000", 2024-04-25T22:01:53.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0815999999999999e-05 2024-04-25T22:01:53.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643252+0000", 2024-04-25T22:01:53.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2586999999999999e-05 2024-04-25T22:01:53.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643271+0000", 2024-04-25T22:01:53.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8493000000000001e-05 2024-04-25T22:01:53.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644387+0000", 2024-04-25T22:01:53.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011160250000000001 2024-04-25T22:01:53.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:53.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644434+0000", 2024-04-25T22:01:53.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:01:53.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:53.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654103+0000", 2024-04-25T22:01:53.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096691360000000001 2024-04-25T22:01:53.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654181+0000", 2024-04-25T22:01:53.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8546000000000003e-05 2024-04-25T22:01:53.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.458 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.458 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:01:53.458 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:01:53.458 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.805081833999999, 2024-04-25T22:01:53.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088132450000000008, 2024-04-25T22:01:53.458 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.458 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.458 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.458 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:01:53.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:01:53.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643309+0000", 2024-04-25T22:01:53.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9600000000000008e-07 2024-04-25T22:01:53.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643339+0000", 2024-04-25T22:01:53.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9467000000000001e-05 2024-04-25T22:01:53.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644245+0000", 2024-04-25T22:01:53.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090648200000000001 2024-04-25T22:01:53.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644268+0000", 2024-04-25T22:01:53.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3017e-05 2024-04-25T22:01:53.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647517+0000", 2024-04-25T22:01:53.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032491680000000002 2024-04-25T22:01:53.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:53.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647561+0000", 2024-04-25T22:01:53.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3630000000000001e-05 2024-04-25T22:01:53.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:53.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652041+0000", 2024-04-25T22:01:53.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044804529999999997 2024-04-25T22:01:53.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652121+0000", 2024-04-25T22:01:53.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0031999999999995e-05 2024-04-25T22:01:53.462 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.462 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.462 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.462 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:34 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-25T22:01:53.462 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:01:53.462 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.802993207, 2024-04-25T22:01:53.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089225940000000007, 2024-04-25T22:01:53.462 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.463 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.463 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.463 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:01:53.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:01:53.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645398+0000", 2024-04-25T22:01:53.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4360000000000001e-06 2024-04-25T22:01:53.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645412+0000", 2024-04-25T22:01:53.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4283e-05 2024-04-25T22:01:53.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645434+0000", 2024-04-25T22:01:53.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1237e-05 2024-04-25T22:01:53.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645459+0000", 2024-04-25T22:01:53.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5675999999999999e-05 2024-04-25T22:01:53.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646081+0000", 2024-04-25T22:01:53.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062128900000000002 2024-04-25T22:01:53.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:53.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646131+0000", 2024-04-25T22:01:53.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0322999999999999e-05 2024-04-25T22:01:53.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:53.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654185+0000", 2024-04-25T22:01:53.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080542749999999996 2024-04-25T22:01:53.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654319+0000", 2024-04-25T22:01:53.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013407499999999999 2024-04-25T22:01:53.466 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.466 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.466 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.467 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:19 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-25T22:01:53.467 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:01:53.467 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.802891698000003, 2024-04-25T22:01:53.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076631340000000003, 2024-04-25T22:01:53.467 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.467 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.467 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.467 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:01:53.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:01:53.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645499+0000", 2024-04-25T22:01:53.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4300000000000001e-07 2024-04-25T22:01:53.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645509+0000", 2024-04-25T22:01:53.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0244000000000001e-05 2024-04-25T22:01:53.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645523+0000", 2024-04-25T22:01:53.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3315999999999999e-05 2024-04-25T22:01:53.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645531+0000", 2024-04-25T22:01:53.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.123e-06 2024-04-25T22:01:53.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648260+0000", 2024-04-25T22:01:53.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027289789999999999 2024-04-25T22:01:53.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:53.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648307+0000", 2024-04-25T22:01:53.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6969999999999999e-05 2024-04-25T22:01:53.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:53.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653039+0000", 2024-04-25T22:01:53.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047322299999999996 2024-04-25T22:01:53.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653161+0000", 2024-04-25T22:01:53.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012232899999999999 2024-04-25T22:01:53.471 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.471 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.471 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.471 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:53.471 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:01:53.471 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.800914036999998, 2024-04-25T22:01:53.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01271303, 2024-04-25T22:01:53.471 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.471 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.471 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.471 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:01:53.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:01:53.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647479+0000", 2024-04-25T22:01:53.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.286e-06 2024-04-25T22:01:53.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647494+0000", 2024-04-25T22:01:53.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.521e-05 2024-04-25T22:01:53.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647525+0000", 2024-04-25T22:01:53.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0403999999999999e-05 2024-04-25T22:01:53.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647544+0000", 2024-04-25T22:01:53.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8743e-05 2024-04-25T22:01:53.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647895+0000", 2024-04-25T22:01:53.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035099699999999997 2024-04-25T22:01:53.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:53.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648202+0000", 2024-04-25T22:01:53.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030758499999999998 2024-04-25T22:01:53.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:53.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648496+0000", 2024-04-25T22:01:53.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029370699999999999 2024-04-25T22:01:53.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:53.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654605+0000", 2024-04-25T22:01:53.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061095999999999998 2024-04-25T22:01:53.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:53.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.659959+0000", 2024-04-25T22:01:53.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053531680000000002 2024-04-25T22:01:53.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:53.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660078+0000", 2024-04-25T22:01:53.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011981600000000001 2024-04-25T22:01:53.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660189+0000", 2024-04-25T22:01:53.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011051400000000001 2024-04-25T22:01:53.476 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.476 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.476 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.476 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:53.476 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:01:53.476 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.800789944999998, 2024-04-25T22:01:53.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013053006000000001, 2024-04-25T22:01:53.476 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.476 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.476 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.477 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:01:53.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:01:53.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647602+0000", 2024-04-25T22:01:53.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.604e-06 2024-04-25T22:01:53.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647611+0000", 2024-04-25T22:01:53.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5689999999999994e-06 2024-04-25T22:01:53.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647634+0000", 2024-04-25T22:01:53.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3227e-05 2024-04-25T22:01:53.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647660+0000", 2024-04-25T22:01:53.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5829999999999998e-05 2024-04-25T22:01:53.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649544+0000", 2024-04-25T22:01:53.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001884066 2024-04-25T22:01:53.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:53.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649783+0000", 2024-04-25T22:01:53.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238411 2024-04-25T22:01:53.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:53.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.650794+0000", 2024-04-25T22:01:53.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010109920000000001 2024-04-25T22:01:53.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:53.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654714+0000", 2024-04-25T22:01:53.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039202170000000001 2024-04-25T22:01:53.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:53.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660403+0000", 2024-04-25T22:01:53.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056895940000000001 2024-04-25T22:01:53.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:53.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660551+0000", 2024-04-25T22:01:53.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014717899999999999 2024-04-25T22:01:53.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660653+0000", 2024-04-25T22:01:53.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102317 2024-04-25T22:01:53.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.481 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.481 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:17 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:53.481 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:01:53.481 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.800705765000004, 2024-04-25T22:01:53.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010101435000000001, 2024-04-25T22:01:53.482 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.482 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.482 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.482 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:01:53.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:01:53.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647686+0000", 2024-04-25T22:01:53.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-04-25T22:01:53.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647693+0000", 2024-04-25T22:01:53.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7330000000000003e-06 2024-04-25T22:01:53.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647711+0000", 2024-04-25T22:01:53.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7436e-05 2024-04-25T22:01:53.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647727+0000", 2024-04-25T22:01:53.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6232999999999999e-05 2024-04-25T22:01:53.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649249+0000", 2024-04-25T22:01:53.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015219890000000001 2024-04-25T22:01:53.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:53.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649533+0000", 2024-04-25T22:01:53.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028391799999999997 2024-04-25T22:01:53.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:53.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649841+0000", 2024-04-25T22:01:53.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030853400000000001 2024-04-25T22:01:53.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:53.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654622+0000", 2024-04-25T22:01:53.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047809630000000001 2024-04-25T22:01:53.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:53.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657616+0000", 2024-04-25T22:01:53.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029938769999999998 2024-04-25T22:01:53.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:53.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657724+0000", 2024-04-25T22:01:53.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108109 2024-04-25T22:01:53.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657786+0000", 2024-04-25T22:01:53.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1196000000000002e-05 2024-04-25T22:01:53.488 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.488 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.488 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.488 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:53.488 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:01:53.488 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.800517437000003, 2024-04-25T22:01:53.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010260877999999999, 2024-04-25T22:01:53.488 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.489 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.489 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.489 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:01:53.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:01:53.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647874+0000", 2024-04-25T22:01:53.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:01:53.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647884+0000", 2024-04-25T22:01:53.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.013e-05 2024-04-25T22:01:53.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647908+0000", 2024-04-25T22:01:53.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3592999999999999e-05 2024-04-25T22:01:53.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647926+0000", 2024-04-25T22:01:53.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8176999999999999e-05 2024-04-25T22:01:53.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651480+0000", 2024-04-25T22:01:53.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035540160000000001 2024-04-25T22:01:53.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:53.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651690+0000", 2024-04-25T22:01:53.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210249 2024-04-25T22:01:53.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:53.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651986+0000", 2024-04-25T22:01:53.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000296001 2024-04-25T22:01:53.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:53.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655696+0000", 2024-04-25T22:01:53.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037098410000000002 2024-04-25T22:01:53.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:53.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657896+0000", 2024-04-25T22:01:53.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022004630000000002 2024-04-25T22:01:53.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:53.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658035+0000", 2024-04-25T22:01:53.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013831499999999999 2024-04-25T22:01:53.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658133+0000", 2024-04-25T22:01:53.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8553000000000003e-05 2024-04-25T22:01:53.493 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.493 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.493 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.493 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:18 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:53.494 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:01:53.494 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.800438557, 2024-04-25T22:01:53.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013108712, 2024-04-25T22:01:53.494 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.494 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.494 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.494 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:01:53.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:01:53.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647953+0000", 2024-04-25T22:01:53.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.697e-06 2024-04-25T22:01:53.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647963+0000", 2024-04-25T22:01:53.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9259999999999995e-06 2024-04-25T22:01:53.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647982+0000", 2024-04-25T22:01:53.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-04-25T22:01:53.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648008+0000", 2024-04-25T22:01:53.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5956e-05 2024-04-25T22:01:53.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651686+0000", 2024-04-25T22:01:53.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678073 2024-04-25T22:01:53.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:53.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652023+0000", 2024-04-25T22:01:53.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033739399999999998 2024-04-25T22:01:53.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:53.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652348+0000", 2024-04-25T22:01:53.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032475000000000001 2024-04-25T22:01:53.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:53.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655883+0000", 2024-04-25T22:01:53.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035353030000000001 2024-04-25T22:01:53.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:53.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660791+0000", 2024-04-25T22:01:53.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049075330000000004 2024-04-25T22:01:53.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:53.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660930+0000", 2024-04-25T22:01:53.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000139856 2024-04-25T22:01:53.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661060+0000", 2024-04-25T22:01:53.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000129651 2024-04-25T22:01:53.498 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.498 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.498 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.499 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:53.499 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:01:53.499 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.800361664999997, 2024-04-25T22:01:53.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012451034, 2024-04-25T22:01:53.499 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.499 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.499 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.499 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:01:53.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:01:53.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648030+0000", 2024-04-25T22:01:53.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-04-25T22:01:53.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648036+0000", 2024-04-25T22:01:53.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8059999999999997e-06 2024-04-25T22:01:53.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648054+0000", 2024-04-25T22:01:53.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7744000000000002e-05 2024-04-25T22:01:53.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648070+0000", 2024-04-25T22:01:53.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-04-25T22:01:53.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648875+0000", 2024-04-25T22:01:53.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080444000000000002 2024-04-25T22:01:53.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:53.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649078+0000", 2024-04-25T22:01:53.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020391499999999999 2024-04-25T22:01:53.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:53.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649674+0000", 2024-04-25T22:01:53.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00059555299999999997 2024-04-25T22:01:53.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:53.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653185+0000", 2024-04-25T22:01:53.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035113459999999998 2024-04-25T22:01:53.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:53.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660251+0000", 2024-04-25T22:01:53.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070661350000000003 2024-04-25T22:01:53.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:53.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660382+0000", 2024-04-25T22:01:53.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013095899999999999 2024-04-25T22:01:53.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660479+0000", 2024-04-25T22:01:53.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6852e-05 2024-04-25T22:01:53.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.504 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.504 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:25 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:53.504 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:01:53.504 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.800295851999998, 2024-04-25T22:01:53.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012691025999999999, 2024-04-25T22:01:53.505 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.505 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.505 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:53.505 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:01:53.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:01:53.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648095+0000", 2024-04-25T22:01:53.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.424e-06 2024-04-25T22:01:53.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648102+0000", 2024-04-25T22:01:53.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2099999999999998e-06 2024-04-25T22:01:53.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648122+0000", 2024-04-25T22:01:53.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0242999999999999e-05 2024-04-25T22:01:53.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648138+0000", 2024-04-25T22:01:53.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6192999999999999e-05 2024-04-25T22:01:53.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651461+0000", 2024-04-25T22:01:53.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033225709999999999 2024-04-25T22:01:53.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:53.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651776+0000", 2024-04-25T22:01:53.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031567500000000002 2024-04-25T22:01:53.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660785+0000", 2024-04-25T22:01:53.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090087099999999996 2024-04-25T22:01:53.508 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.508 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.508 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.508 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:53.508 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:01:53.508 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.800233366000001, 2024-04-25T22:01:53.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013102702000000001, 2024-04-25T22:01:53.509 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.509 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.509 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:53.509 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:01:53.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:01:53.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648158+0000", 2024-04-25T22:01:53.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2839999999999999e-06 2024-04-25T22:01:53.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648163+0000", 2024-04-25T22:01:53.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-04-25T22:01:53.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648181+0000", 2024-04-25T22:01:53.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8484000000000001e-05 2024-04-25T22:01:53.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648196+0000", 2024-04-25T22:01:53.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4496e-05 2024-04-25T22:01:53.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653737+0000", 2024-04-25T22:01:53.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055414009999999996 2024-04-25T22:01:53.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:53.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653972+0000", 2024-04-25T22:01:53.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000234732 2024-04-25T22:01:53.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661259+0000", 2024-04-25T22:01:53.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072872689999999999 2024-04-25T22:01:53.512 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.512 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.512 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.512 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:53.512 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:01:53.512 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.800176546000003, 2024-04-25T22:01:53.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086984829999999999, 2024-04-25T22:01:53.512 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.513 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.513 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:53.513 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:01:53.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:01:53.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648214+0000", 2024-04-25T22:01:53.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-04-25T22:01:53.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648233+0000", 2024-04-25T22:01:53.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.878e-05 2024-04-25T22:01:53.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648252+0000", 2024-04-25T22:01:53.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8603000000000001e-05 2024-04-25T22:01:53.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648267+0000", 2024-04-25T22:01:53.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:01:53.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648846+0000", 2024-04-25T22:01:53.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057923000000000002 2024-04-25T22:01:53.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:53.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649027+0000", 2024-04-25T22:01:53.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181585 2024-04-25T22:01:53.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.656912+0000", 2024-04-25T22:01:53.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078844589999999999 2024-04-25T22:01:53.516 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.516 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.516 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.516 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e17/15 ondisk, result = 0)", 2024-04-25T22:01:53.516 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.657534+0000", 2024-04-25T22:01:53.516 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.790856324000003, 2024-04-25T22:01:53.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061820500000000003, 2024-04-25T22:01:53.516 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.516 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.517 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:53.517 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657534+0000", 2024-04-25T22:01:53.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657534+0000", 2024-04-25T22:01:53.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657544+0000", 2024-04-25T22:01:53.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0403e-05 2024-04-25T22:01:53.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657551+0000", 2024-04-25T22:01:53.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1230000000000002e-06 2024-04-25T22:01:53.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657572+0000", 2024-04-25T22:01:53.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0826999999999999e-05 2024-04-25T22:01:53.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657586+0000", 2024-04-25T22:01:53.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:01:53.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657861+0000", 2024-04-25T22:01:53.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027576100000000002 2024-04-25T22:01:53.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:53.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657882+0000", 2024-04-25T22:01:53.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0378999999999999e-05 2024-04-25T22:01:53.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658152+0000", 2024-04-25T22:01:53.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027015200000000001 2024-04-25T22:01:53.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.520 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.520 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 6 lcod 17'2)", 2024-04-25T22:01:53.520 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:01:53.520 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.788246630000003, 2024-04-25T22:01:53.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064966000000000004, 2024-04-25T22:01:53.520 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.520 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.520 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:01:53.520 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:01:53.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:01:53.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660144+0000", 2024-04-25T22:01:53.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1800000000000005e-07 2024-04-25T22:01:53.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660181+0000", 2024-04-25T22:01:53.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6408000000000001e-05 2024-04-25T22:01:53.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660197+0000", 2024-04-25T22:01:53.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6177000000000001e-05 2024-04-25T22:01:53.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660210+0000", 2024-04-25T22:01:53.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:01:53.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660556+0000", 2024-04-25T22:01:53.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034612899999999998 2024-04-25T22:01:53.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660793+0000", 2024-04-25T22:01:53.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023656799999999999 2024-04-25T22:01:53.523 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.523 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.523 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.523 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:18 3.1f e17/15 ondisk, result = 0)", 2024-04-25T22:01:53.523 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:01:53.524 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.787984856999998, 2024-04-25T22:01:53.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067878299999999997, 2024-04-25T22:01:53.524 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.524 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.524 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:53.524 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:01:53.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:01:53.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660406+0000", 2024-04-25T22:01:53.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2800000000000005e-07 2024-04-25T22:01:53.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660412+0000", 2024-04-25T22:01:53.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0399999999999998e-06 2024-04-25T22:01:53.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660429+0000", 2024-04-25T22:01:53.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7394e-05 2024-04-25T22:01:53.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660445+0000", 2024-04-25T22:01:53.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6069000000000001e-05 2024-04-25T22:01:53.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660757+0000", 2024-04-25T22:01:53.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031194300000000002 2024-04-25T22:01:53.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:53.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660776+0000", 2024-04-25T22:01:53.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8862999999999999e-05 2024-04-25T22:01:53.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661084+0000", 2024-04-25T22:01:53.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030754600000000001 2024-04-25T22:01:53.527 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.527 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.527 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.527 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-25T22:01:53.527 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:01:53.527 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.787920628999998, 2024-04-25T22:01:53.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080007600000000004, 2024-04-25T22:01:53.527 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.528 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.528 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:01:53.528 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:01:53.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:01:53.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660470+0000", 2024-04-25T22:01:53.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4499999999999996e-07 2024-04-25T22:01:53.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660475+0000", 2024-04-25T22:01:53.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-04-25T22:01:53.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660490+0000", 2024-04-25T22:01:53.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5274e-05 2024-04-25T22:01:53.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660501+0000", 2024-04-25T22:01:53.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0694e-05 2024-04-25T22:01:53.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661130+0000", 2024-04-25T22:01:53.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062887499999999999 2024-04-25T22:01:53.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661269+0000", 2024-04-25T22:01:53.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013955900000000001 2024-04-25T22:01:53.530 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.531 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.531 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.531 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:01:53.531 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:01:53.531 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.824188630000002, 2024-04-25T22:01:53.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037104880000000001, 2024-04-25T22:01:53.531 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.531 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.531 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.531 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:01:53.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:01:53.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624204+0000", 2024-04-25T22:01:53.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.757e-06 2024-04-25T22:01:53.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624233+0000", 2024-04-25T22:01:53.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9362000000000001e-05 2024-04-25T22:01:53.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624264+0000", 2024-04-25T22:01:53.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0843000000000003e-05 2024-04-25T22:01:53.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624280+0000", 2024-04-25T22:01:53.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5577e-05 2024-04-25T22:01:53.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624458+0000", 2024-04-25T22:01:53.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017821199999999999 2024-04-25T22:01:53.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:53.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624661+0000", 2024-04-25T22:01:53.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020283200000000001 2024-04-25T22:01:53.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:53.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624842+0000", 2024-04-25T22:01:53.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018115500000000001 2024-04-25T22:01:53.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:53.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.626271+0000", 2024-04-25T22:01:53.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001429416 2024-04-25T22:01:53.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:53.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627749+0000", 2024-04-25T22:01:53.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014778650000000001 2024-04-25T22:01:53.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:53.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627849+0000", 2024-04-25T22:01:53.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9261999999999999e-05 2024-04-25T22:01:53.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627912+0000", 2024-04-25T22:01:53.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3207000000000007e-05 2024-04-25T22:01:53.536 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.536 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.536 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.536 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-25T22:01:53.536 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:01:53.536 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.821491279, 2024-04-25T22:01:53.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029804620000000001, 2024-04-25T22:01:53.536 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:53.536 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:53.537 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:53.537 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:53.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:53.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:01:53.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:53.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:01:53.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:53.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:53.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626903+0000", 2024-04-25T22:01:53.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0029999999999996e-06 2024-04-25T22:01:53.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:53.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626921+0000", 2024-04-25T22:01:53.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8272999999999999e-05 2024-04-25T22:01:53.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:53.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626959+0000", 2024-04-25T22:01:53.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7843999999999999e-05 2024-04-25T22:01:53.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:53.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626977+0000", 2024-04-25T22:01:53.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7756000000000001e-05 2024-04-25T22:01:53.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:53.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627153+0000", 2024-04-25T22:01:53.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017643800000000001 2024-04-25T22:01:53.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:53.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627425+0000", 2024-04-25T22:01:53.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027207300000000001 2024-04-25T22:01:53.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:53.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627848+0000", 2024-04-25T22:01:53.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042297199999999997 2024-04-25T22:01:53.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:53.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629590+0000", 2024-04-25T22:01:53.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017416809999999999 2024-04-25T22:01:53.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:53.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629720+0000", 2024-04-25T22:01:53.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130526 2024-04-25T22:01:53.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:53.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629808+0000", 2024-04-25T22:01:53.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7449999999999998e-05 2024-04-25T22:01:53.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:53.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:53.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:53.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629879+0000", 2024-04-25T22:01:53.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1445999999999993e-05 2024-04-25T22:01:53.541 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.541 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.541 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.541 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:53.541 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:53.541 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:01:53.542 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:01:53.542 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:01:53.542 INFO:tasks.thrashosds.thrasher:Setting full ratio to .001 2024-04-25T22:01:53.542 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .001 2024-04-25T22:01:53.544 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:01:53.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:53.543+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:53.644 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:53.643+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:53.677 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:53.678 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:01:53.678 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:01:53.678 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:53.691 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:01:53.779 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:53.779+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:53.844 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:01:53.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:53.843+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:53.856 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:01:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:01:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:01:53.856 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:53.870 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:01:53.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:53.943+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:54.033 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:01:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:01:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:01:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:01:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.205449371, 2024-04-25T22:01:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:01:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:54.034 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:01:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:01:54.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:01:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:01:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:01:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:01:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:01:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:01:54.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:01:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:01:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:01:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:01:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:01:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:01:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:01:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:01:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:01:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.204718552999999, 2024-04-25T22:01:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:01:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:01:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:01:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:01:54.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:01:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:01:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:01:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:01:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:01:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:01:54.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:01:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:01:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:01:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:01:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:01:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:01:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:01:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:01:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.204052281999999, 2024-04-25T22:01:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:01:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:01:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:01:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:01:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:01:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:01:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:01:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:01:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:01:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:01:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:01:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:01:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:01:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:01:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:01:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:01:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:01:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:01:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.203152381999999, 2024-04-25T22:01:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:01:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.047 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:01:54.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:01:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:01:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:01:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:01:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:01:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:01:54.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:01:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:01:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:01:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:01:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:01:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:54.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:01:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:01:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:01:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:01:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:01:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.201116040999999, 2024-04-25T22:01:54.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:01:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:01:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:01:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:01:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:01:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:01:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:01:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:01:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:01:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:01:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:01:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:01:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:01:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:01:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:01:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:01:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:01:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:01:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.200652703999999, 2024-04-25T22:01:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:01:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:54.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:01:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:01:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:01:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:01:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:01:54.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:01:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:01:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:01:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:01:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:01:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:01:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:01:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:01:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:01:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:01:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:01:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:01:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.199785824999999, 2024-04-25T22:01:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:01:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:01:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:01:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:01:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:01:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:01:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:01:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:01:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:01:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:01:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:01:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:01:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:01:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:01:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:01:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:01:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:01:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:01:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.199334751000002, 2024-04-25T22:01:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:01:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:01:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:01:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:01:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:01:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:01:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:01:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:01:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:01:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:01:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:01:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:01:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:01:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:01:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:01:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:01:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:01:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:01:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.198885165, 2024-04-25T22:01:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:01:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:01:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:01:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:01:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:01:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:01:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:01:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:01:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:01:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:01:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:01:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:01:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:01:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:01:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:01:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:01:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:01:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.402228678, 2024-04-25T22:01:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:01:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:01:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:01:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:01:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:01:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:01:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:01:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:01:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:01:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:01:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:01:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:01:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:01:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:01:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:01:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:01:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:01:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:01:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:01:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:01:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:01:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:01:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:01:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.402104694999998, 2024-04-25T22:01:54.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:01:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:01:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:01:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:01:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:01:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:01:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:01:54.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:01:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:01:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:01:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:01:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:01:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:01:54.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:01:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:01:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:01:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:01:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:01:54.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:01:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:01:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:01:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:01:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:01:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.083 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:54.083 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:54.083 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.402030758999999, 2024-04-25T22:01:54.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:01:54.083 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.083 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.083 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:54.083 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:54.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:01:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:01:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:01:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:01:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:01:54.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:01:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:01:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:01:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:01:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:01:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:01:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:01:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:01:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:01:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:01:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:01:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:54.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:01:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:01:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:01:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:01:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:01:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:01:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.401914507000001, 2024-04-25T22:01:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:01:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:01:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:01:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:01:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:01:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:01:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:01:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:01:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:01:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:01:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:01:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:01:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:01:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:01:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:01:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:01:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:01:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:01:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:01:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:01:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:01:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:01:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:01:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.092 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.401751097999998, 2024-04-25T22:01:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:01:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:54.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:01:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:01:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:01:54.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:01:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:01:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:01:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:01:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:01:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:01:54.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:01:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:01:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:01:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:01:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:01:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:01:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:01:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:01:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:01:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:01:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:01:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:01:54.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:01:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.401648901999998, 2024-04-25T22:01:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:01:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:01:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:01:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:01:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:01:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:01:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:01:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:01:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:01:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:01:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:01:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:01:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:01:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:01:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:01:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:01:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:01:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:01:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:01:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:01:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:01:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:01:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:01:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.401569948999999, 2024-04-25T22:01:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:01:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:01:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:01:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:01:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:01:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:01:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:01:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:01:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:01:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:01:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:01:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:01:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:01:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:54.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:01:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:01:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:01:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:01:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:01:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:01:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:54.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:01:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:01:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:01:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:01:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.401504926000001, 2024-04-25T22:01:54.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:01:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:01:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:01:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:01:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:01:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:01:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:01:54.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:01:54.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:01:54.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:01:54.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:01:54.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:01:54.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:01:54.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:01:54.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:01:54.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.112 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.112 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:54.112 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:54.112 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.401426733999998, 2024-04-25T22:01:54.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:01:54.112 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.113 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:54.113 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:54.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:54.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:01:54.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:01:54.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:01:54.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:01:54.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:01:54.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:01:54.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:01:54.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:01:54.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:01:54.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:01:54.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:01:54.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:01:54.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:01:54.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:01:54.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.116 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.116 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:01:54.116 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:54.117 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.386780274000003, 2024-04-25T22:01:54.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:01:54.117 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.117 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.117 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:54.117 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:54.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:54.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:01:54.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:01:54.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:01:54.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:01:54.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:01:54.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:01:54.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:01:54.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:01:54.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:01:54.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:01:54.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:01:54.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:01:54.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:54.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:01:54.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:01:54.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:01:54.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:01:54.120 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.120 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.120 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.121 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:01:54.121 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:54.121 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 39.386620317999999, 2024-04-25T22:01:54.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:01:54.121 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:54.121 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:54.121 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:54.121 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:54.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:54.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:54.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:54.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:54.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:54.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:54.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:01:54.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:01:54.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:54.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:01:54.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:01:54.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:54.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:01:54.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:01:54.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:54.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:01:54.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:01:54.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:54.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:01:54.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:01:54.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:54.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:01:54.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:01:54.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:54.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:01:54.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:01:54.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:54.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:54.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:54.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:01:54.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:01:54.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.124 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:54.125 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:54.125 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:54.126 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:01:54.127 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:54.126+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:54.145 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:01:54.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:54.227+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:54.261 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:54.261 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:01:54.261 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:01:54.261 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:54.276 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:01:54.289 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:01:54.289 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:01:54.310 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:01:54.310 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:01:54.328 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:54.322+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:54.330 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:01:54.330 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:01:54.403 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:54.403 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:54.418 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:01:54.461 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:54.458+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:54.530 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:54.526+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:54.586 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:54.587 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:54.602 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:01:54.645 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:54.642+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:54.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:54.731+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:54.733 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:54.733 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:54.748 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:01:54.827 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-04-25T22:01:54.824+0000 7f8be96fd640 -1 log_channel(cluster) log [ERR] : Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2024-04-25T22:01:54.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:54.835+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:54.835 INFO:teuthology.orchestra.run.smithi044.stderr:osd set-full-ratio 0.001 2024-04-25T22:01:54.841 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-25T22:01:54.911 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:54.911 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:54.925 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:01:54.933 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:54.931+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:55.034 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:55.030+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:55.088 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:55.089 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:55.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:01:55.151 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:55.151+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:55.235 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:55.235 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:55.235 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:55.235+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:55.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:01:55.337 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:55.334+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:55.409 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:55.410 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:55.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:01:55.438 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:55.434+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:55.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:55.539+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:55.540 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:55.540 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:55.555 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:01:55.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:55.639+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:55.689 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:55.689 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:55.703 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:01:55.741 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:55.739+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:55.824 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:55.824 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:55.838 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:01:55.862 INFO:tasks.thrashosds.thrasher:Setting full ratio back to .95 2024-04-25T22:01:55.862 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .95 2024-04-25T22:01:55.885 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:55.882+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:55.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:55.939+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:55.956 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:55.956 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:55.970 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:01:56.044 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:56.038+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:56.100 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:56.100 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:56.114 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:01:56.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:56.159+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:56.230 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:56.230 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:56.244 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:01:56.245 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:56.243+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:56.345 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:56.343+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:56.367 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:01:56.403 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:56.403 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:56.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:01:56.463 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:56.463+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:56.526 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:01:56.526 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:01:56.546 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:01:56.546 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:01:56.547 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:56.546+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:56.549 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:56.549 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:56.563 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:01:56.566 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:01:56.566 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:01:56.647 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:56.646+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:56.730 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:56.730 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:01:56.730 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:01:56.730 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:01:56.730 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:56.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:01:56.748 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:56.747+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:56.847 INFO:teuthology.orchestra.run.smithi044.stderr:osd set-full-ratio 0.95 2024-04-25T22:01:56.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:56.847+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:56.866 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:01:56.870 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:01:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:01:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:01:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:01:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.042600690999997, 2024-04-25T22:01:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:01:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:01:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:01:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:01:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:01:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:01:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:01:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:01:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:01:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:01:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:01:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:01:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:01:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:01:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:01:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:01:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:01:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:01:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.041869873000003, 2024-04-25T22:01:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:01:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:01:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:01:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:01:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:01:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:01:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:01:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:01:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:01:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:01:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:01:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:01:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:01:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:01:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:01:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:01:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:01:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:01:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.041203602000003, 2024-04-25T22:01:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:01:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:01:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:01:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:01:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:01:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:01:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:01:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:01:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:01:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:01:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:01:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:01:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:01:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:01:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:01:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:01:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:01:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:01:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.040303702000003, 2024-04-25T22:01:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:01:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:01:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:01:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:01:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:01:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:01:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:01:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:01:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:01:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:01:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:01:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:01:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:01:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:01:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:01:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:01:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:01:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:01:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.038267361000003, 2024-04-25T22:01:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:01:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:01:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:01:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:01:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:01:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:01:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:01:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:01:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:01:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:01:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:01:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:01:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:01:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:01:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:01:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:01:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:01:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:01:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.037804024000003, 2024-04-25T22:01:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:01:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:01:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:01:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:01:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:01:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:01:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:01:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:01:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:01:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:01:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:01:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:01:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:01:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:01:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:01:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:01:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:01:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:01:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.036937145000003, 2024-04-25T22:01:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:01:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:01:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:01:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:01:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:01:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:01:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:01:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:01:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:01:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:01:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:01:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:01:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:01:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:01:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:01:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:01:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:01:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:01:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.036486070999999, 2024-04-25T22:01:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:01:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:01:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:01:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:01:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:01:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:01:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:01:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:01:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:01:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:01:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:01:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:01:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:01:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:01:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:01:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:01:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:01:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:01:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.036036484999997, 2024-04-25T22:01:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:01:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:01:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:01:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:01:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:01:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:01:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:01:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:01:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:01:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:01:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:01:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:01:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:01:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:01:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:01:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:01:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:01:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.239379997999997, 2024-04-25T22:01:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:01:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:01:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:01:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:01:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:01:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:01:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:01:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:01:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:01:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:01:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:01:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:01:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:01:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:01:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:01:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:01:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:01:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:01:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:01:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:01:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:01:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:01:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:01:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.239256015000002, 2024-04-25T22:01:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:01:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:01:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:01:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:01:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:01:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:01:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:01:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:01:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:01:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:01:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:01:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:01:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:01:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:01:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:01:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:01:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:01:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:01:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:01:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:01:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:01:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:01:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:01:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.239182079000003, 2024-04-25T22:01:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:01:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:01:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:01:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:01:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:01:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:01:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:01:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:01:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:01:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:01:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:01:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:01:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:01:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:01:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:01:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:01:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:01:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:01:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:01:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:01:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:01:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:01:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:01:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.239065826999997, 2024-04-25T22:01:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:01:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:01:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:01:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:01:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:01:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:01:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:01:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:01:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:01:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:01:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:01:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:01:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:01:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:01:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:01:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:01:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:01:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:01:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:01:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:01:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:01:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:01:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:01:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.238902418000002, 2024-04-25T22:01:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:01:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:01:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:01:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:01:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:01:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:01:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:01:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:01:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:01:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:01:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:01:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:01:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:01:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:01:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:01:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:01:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:01:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:01:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:01:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:01:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:01:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:01:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:01:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.238800222000002, 2024-04-25T22:01:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:01:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:01:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:01:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:01:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:01:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:01:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:01:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:01:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:01:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:01:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:01:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:01:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:01:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:01:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:01:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:01:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:01:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:01:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:01:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:01:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:01:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:01:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:01:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.238721269000003, 2024-04-25T22:01:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:01:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:01:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:01:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:01:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:01:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:01:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:01:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:01:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:01:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:01:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:01:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:01:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:01:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:01:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:01:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:01:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:01:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:01:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:01:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:01:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:01:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:01:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:01:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.238656245999998, 2024-04-25T22:01:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:01:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:01:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:01:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:01:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:01:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:01:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:01:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:01:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:01:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:01:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:01:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:01:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:01:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:01:56.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:01:56.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.950 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.950 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:56.950 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:56.950 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.238578054000001, 2024-04-25T22:01:56.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:01:56.950 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.951 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:56.951 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:56.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:56.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:01:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:01:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:01:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:01:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:01:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:01:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:01:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:01:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:01:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:01:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:01:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:01:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:01:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:01:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:01:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.223931594, 2024-04-25T22:01:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:01:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:01:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:01:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:01:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:01:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:01:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:01:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:01:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:01:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:01:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:01:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:01:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:01:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:01:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:01:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:01:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:01:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:01:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.223771638000002, 2024-04-25T22:01:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:01:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:01:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:01:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:01:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:01:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:01:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:01:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:01:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:01:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:01:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:01:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:01:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:01:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:01:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:01:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:01:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:01:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:56.963 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:56.965 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:01:56.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:56.963+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:57.065 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:57.063+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:57.100 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:57.100 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:01:57.100 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:01:57.100 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:57.114 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:01:57.166 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:57.163+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:57.240 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:57.240 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:01:57.241 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:01:57.241 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:01:57.241 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:57.254 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:01:57.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:57.267+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:57.369 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:57.362+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:57.380 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:01:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:01:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:01:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:01:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.382154372999999, 2024-04-25T22:01:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:01:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:01:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:01:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:01:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:01:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:01:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:01:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:01:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:01:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:01:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:01:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:01:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:01:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:01:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:01:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:01:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:01:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:01:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:01:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:01:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:01:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:01:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:01:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:01:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:01:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:01:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:01:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.200091299999997, 2024-04-25T22:01:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:01:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:01:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:01:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:01:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:01:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:01:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:01:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:01:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:01:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:01:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:01:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:01:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:01:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:01:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:01:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:01:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:01:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:01:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:01:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:01:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:01:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:01:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:01:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:01:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:01:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:01:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:01:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.20004702, 2024-04-25T22:01:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:01:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:01:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:01:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:01:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:01:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:01:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:01:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:01:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:01:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:01:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:01:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:01:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:01:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:01:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:01:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:01:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:01:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:01:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:01:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:01:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:01:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:01:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:01:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:01:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:01:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:01:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:01:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.199990495000002, 2024-04-25T22:01:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:01:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:01:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:01:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:01:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:01:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:01:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:01:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:01:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:01:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:01:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:01:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:01:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:01:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:01:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:01:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:01:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:01:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:01:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:01:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:01:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:01:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:01:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:01:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:01:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:01:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:01:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:01:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.199795252999998, 2024-04-25T22:01:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:01:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:01:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:01:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:01:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:01:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:01:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:01:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:01:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:01:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:01:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:01:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:01:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:01:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:01:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:01:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:01:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:01:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:01:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:01:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:01:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:01:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:01:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:01:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:01:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:01:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:01:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:01:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.199732959999999, 2024-04-25T22:01:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:01:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:01:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:01:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:01:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:01:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:01:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:01:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:01:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:01:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:01:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:01:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:01:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:01:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:01:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:01:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:01:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:01:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:01:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:01:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:01:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:01:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:01:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:01:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:01:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:01:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:01:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:01:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.199672743999997, 2024-04-25T22:01:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:01:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:01:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:01:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:01:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:01:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:01:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:01:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:01:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:01:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:01:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:01:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:01:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:01:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:01:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:01:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:01:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:01:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:01:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:01:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:01:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:01:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:01:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:01:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:01:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:01:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:01:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:01:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.199483231999999, 2024-04-25T22:01:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:01:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:01:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:01:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:01:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:01:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:01:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:01:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:01:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:01:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:01:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:01:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:01:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:01:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:01:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:01:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:01:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:01:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:01:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:01:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:01:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:01:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:01:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:01:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:01:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:01:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:01:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:01:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.008145398000003, 2024-04-25T22:01:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:01:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:01:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:01:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:01:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:01:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:01:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:01:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:01:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:01:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:01:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:01:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:01:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:01:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:01:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:01:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:01:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:01:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:01:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:01:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:01:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:01:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:01:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:01:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:01:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:01:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:01:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:01:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.008107021000001, 2024-04-25T22:01:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:01:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:01:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:01:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:01:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:01:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:01:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:01:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:01:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:01:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:01:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:01:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:01:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:01:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:01:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:01:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:01:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:01:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:01:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:01:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:01:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:01:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:01:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:01:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:01:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:01:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:01:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:01:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.008055761999998, 2024-04-25T22:01:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:01:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:01:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:01:57.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:01:57.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:01:57.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:01:57.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:01:57.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:01:57.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:01:57.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:01:57.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:01:57.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:01:57.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:01:57.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:01:57.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:01:57.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:01:57.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:01:57.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:01:57.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:01:57.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:01:57.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:01:57.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:01:57.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:01:57.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:01:57.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:01:57.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:01:57.461 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.461 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.461 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.461 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:57.461 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:01:57.461 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.007907113000002, 2024-04-25T22:01:57.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:01:57.462 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.462 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.462 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.462 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:57.462 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:57.462 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:57.462 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:01:57.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.462 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:01:57.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:01:57.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:01:57.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:01:57.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:01:57.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:01:57.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:01:57.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:01:57.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:01:57.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:01:57.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:01:57.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:01:57.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:01:57.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:01:57.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:01:57.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:01:57.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:01:57.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:01:57.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:01:57.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:01:57.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:01:57.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:01:57.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:01:57.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:01:57.467 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.467 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.467 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.467 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:57.467 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:01:57.467 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.007864963000003, 2024-04-25T22:01:57.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:01:57.467 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.468 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.468 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.468 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:57.468 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:57.468 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:57.468 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:01:57.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.468 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:01:57.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:01:57.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:01:57.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:01:57.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:01:57.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:01:57.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:01:57.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:01:57.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:01:57.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:01:57.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:01:57.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:01:57.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:01:57.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:01:57.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:01:57.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:01:57.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:01:57.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:01:57.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:01:57.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:01:57.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:01:57.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:01:57.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:01:57.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:01:57.472 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.473 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.473 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.473 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:57.473 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:01:57.473 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.007827110000001, 2024-04-25T22:01:57.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:01:57.473 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.473 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.473 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.473 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:57.473 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:57.473 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:57.473 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:01:57.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.474 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:01:57.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:01:57.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:01:57.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:01:57.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:01:57.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:01:57.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:01:57.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:01:57.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:01:57.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:01:57.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:01:57.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:01:57.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:01:57.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:01:57.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:01:57.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:01:57.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:01:57.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:01:57.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:01:57.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:01:57.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:01:57.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:01:57.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:01:57.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:01:57.479 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.479 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.479 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.479 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:01:57.479 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:01:57.479 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.007617785000001, 2024-04-25T22:01:57.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:01:57.479 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.479 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.479 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.479 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:01:57.480 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:01:57.480 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:01:57.480 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:01:57.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.480 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:01:57.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:01:57.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:01:57.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:01:57.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:01:57.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:01:57.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:01:57.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:01:57.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:01:57.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:01:57.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:01:57.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:01:57.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:01:57.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:01:57.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:01:57.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:01:57.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:01:57.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:01:57.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:01:57.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:01:57.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:01:57.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:01:57.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:01:57.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:01:57.485 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.485 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.485 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.485 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:57.485 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:01:57.485 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.741366513000003, 2024-04-25T22:01:57.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:01:57.485 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.486 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.486 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.486 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:01:57.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:01:57.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:01:57.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:01:57.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:01:57.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:01:57.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:01:57.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:01:57.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:01:57.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:01:57.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:01:57.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:01:57.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:01:57.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:01:57.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:01:57.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:01:57.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:01:57.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:01:57.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:01:57.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:01:57.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:01:57.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:01:57.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:01:57.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:01:57.490 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.490 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.490 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.490 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:57.491 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:57.491 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.741332673000002, 2024-04-25T22:01:57.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:01:57.491 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.491 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.491 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.491 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:57.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:01:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:01:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:01:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:01:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:01:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:01:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:01:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:01:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:01:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:01:57.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:01:57.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:01:57.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:01:57.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:01:57.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:01:57.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:01:57.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:01:57.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:01:57.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:01:57.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:01:57.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:01:57.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:01:57.496 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.496 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.496 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.496 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:57.496 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:01:57.496 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.741280977000002, 2024-04-25T22:01:57.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:01:57.496 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.496 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.496 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.497 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:01:57.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:01:57.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:01:57.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:01:57.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:01:57.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:01:57.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:01:57.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:01:57.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:01:57.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:01:57.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:01:57.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:01:57.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:01:57.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:01:57.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:01:57.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:01:57.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:01:57.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:01:57.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:01:57.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:01:57.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:01:57.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:01:57.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:01:57.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:01:57.501 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.501 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.501 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.501 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:57.501 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:01:57.502 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.741136525000002, 2024-04-25T22:01:57.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:01:57.502 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.502 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.502 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.502 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:01:57.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:01:57.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:01:57.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:01:57.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:01:57.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:01:57.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:01:57.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:01:57.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:01:57.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:01:57.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:01:57.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:01:57.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:01:57.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:01:57.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:01:57.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:01:57.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:01:57.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:01:57.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:01:57.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:01:57.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:01:57.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:01:57.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:01:57.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:01:57.507 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.507 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.507 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.507 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:57.507 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:01:57.507 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.741079804999998, 2024-04-25T22:01:57.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:01:57.507 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:01:57.507 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:01:57.508 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.508 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:01:57.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:01:57.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:01:57.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:01:57.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:01:57.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:01:57.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:01:57.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:01:57.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:01:57.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:01:57.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:01:57.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:01:57.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:01:57.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:01:57.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:01:57.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:01:57.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:01:57.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:01:57.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:01:57.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:01:57.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:01:57.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:01:57.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:01:57.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:01:57.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:01:57.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:01:57.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:01:57.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:01:57.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:01:57.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:01:57.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:01:57.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:01:57.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:01:57.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:01:57.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:01:57.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:01:57.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:01:57.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:01:57.512 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.512 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.512 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.512 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:01:57.512 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:01:57.513 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:57.514 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:01:57.515 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:57.510+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:57.615 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:57.610+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:57.646 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:01:57.646 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:01:57.646 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:01:57.646 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:01:57.660 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:01:57.717 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:57.715+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:57.777 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:01:57.777 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:01:57.777 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:01:57.777 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:01:57.777 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:01:57.791 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:01:57.818 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:57.814+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:57.866 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-25T22:01:57.910 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:01:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:01:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:01:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:01:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 4 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:27 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:01:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:01:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.269926867999999, 2024-04-25T22:01:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013281644, 2024-04-25T22:01:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:01:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:01:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:01:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637801+0000", 2024-04-25T22:01:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1299999999999998e-07 2024-04-25T22:01:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637828+0000", 2024-04-25T22:01:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6953000000000001e-05 2024-04-25T22:01:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637873+0000", 2024-04-25T22:01:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4676999999999999e-05 2024-04-25T22:01:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637917+0000", 2024-04-25T22:01:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4815999999999999e-05 2024-04-25T22:01:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644220+0000", 2024-04-25T22:01:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063021049999999997 2024-04-25T22:01:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651082+0000", 2024-04-25T22:01:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068621799999999998 2024-04-25T22:01:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:15 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:01:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:01:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.264519256, 2024-04-25T22:01:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010973732, 2024-04-25T22:01:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:01:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:01:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643209+0000", 2024-04-25T22:01:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.003e-06 2024-04-25T22:01:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643230+0000", 2024-04-25T22:01:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0815999999999999e-05 2024-04-25T22:01:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643252+0000", 2024-04-25T22:01:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2586999999999999e-05 2024-04-25T22:01:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643271+0000", 2024-04-25T22:01:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8493000000000001e-05 2024-04-25T22:01:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644387+0000", 2024-04-25T22:01:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011160250000000001 2024-04-25T22:01:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644434+0000", 2024-04-25T22:01:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:01:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654103+0000", 2024-04-25T22:01:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096691360000000001 2024-04-25T22:01:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654181+0000", 2024-04-25T22:01:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8546000000000003e-05 2024-04-25T22:01:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:01:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:01:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.264418900000003, 2024-04-25T22:01:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088132450000000008, 2024-04-25T22:01:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:01:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:01:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643309+0000", 2024-04-25T22:01:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9600000000000008e-07 2024-04-25T22:01:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643339+0000", 2024-04-25T22:01:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9467000000000001e-05 2024-04-25T22:01:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644245+0000", 2024-04-25T22:01:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090648200000000001 2024-04-25T22:01:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644268+0000", 2024-04-25T22:01:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3017e-05 2024-04-25T22:01:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647517+0000", 2024-04-25T22:01:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032491680000000002 2024-04-25T22:01:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647561+0000", 2024-04-25T22:01:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3630000000000001e-05 2024-04-25T22:01:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652041+0000", 2024-04-25T22:01:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044804529999999997 2024-04-25T22:01:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652121+0000", 2024-04-25T22:01:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0031999999999995e-05 2024-04-25T22:01:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:34 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-25T22:01:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:01:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.262330273000003, 2024-04-25T22:01:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089225940000000007, 2024-04-25T22:01:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:01:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:01:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645398+0000", 2024-04-25T22:01:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4360000000000001e-06 2024-04-25T22:01:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645412+0000", 2024-04-25T22:01:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4283e-05 2024-04-25T22:01:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645434+0000", 2024-04-25T22:01:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1237e-05 2024-04-25T22:01:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645459+0000", 2024-04-25T22:01:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5675999999999999e-05 2024-04-25T22:01:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646081+0000", 2024-04-25T22:01:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062128900000000002 2024-04-25T22:01:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646131+0000", 2024-04-25T22:01:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0322999999999999e-05 2024-04-25T22:01:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654185+0000", 2024-04-25T22:01:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080542749999999996 2024-04-25T22:01:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654319+0000", 2024-04-25T22:01:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013407499999999999 2024-04-25T22:01:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:19 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-25T22:01:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:01:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.262228764, 2024-04-25T22:01:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076631340000000003, 2024-04-25T22:01:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:01:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:01:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645499+0000", 2024-04-25T22:01:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4300000000000001e-07 2024-04-25T22:01:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645509+0000", 2024-04-25T22:01:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0244000000000001e-05 2024-04-25T22:01:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645523+0000", 2024-04-25T22:01:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3315999999999999e-05 2024-04-25T22:01:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645531+0000", 2024-04-25T22:01:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.123e-06 2024-04-25T22:01:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648260+0000", 2024-04-25T22:01:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027289789999999999 2024-04-25T22:01:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648307+0000", 2024-04-25T22:01:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6969999999999999e-05 2024-04-25T22:01:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653039+0000", 2024-04-25T22:01:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047322299999999996 2024-04-25T22:01:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653161+0000", 2024-04-25T22:01:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012232899999999999 2024-04-25T22:01:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:01:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.260251103000002, 2024-04-25T22:01:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01271303, 2024-04-25T22:01:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:01:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:01:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647479+0000", 2024-04-25T22:01:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.286e-06 2024-04-25T22:01:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647494+0000", 2024-04-25T22:01:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.521e-05 2024-04-25T22:01:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647525+0000", 2024-04-25T22:01:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0403999999999999e-05 2024-04-25T22:01:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647544+0000", 2024-04-25T22:01:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8743e-05 2024-04-25T22:01:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647895+0000", 2024-04-25T22:01:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035099699999999997 2024-04-25T22:01:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648202+0000", 2024-04-25T22:01:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030758499999999998 2024-04-25T22:01:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648496+0000", 2024-04-25T22:01:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029370699999999999 2024-04-25T22:01:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654605+0000", 2024-04-25T22:01:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061095999999999998 2024-04-25T22:01:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.659959+0000", 2024-04-25T22:01:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053531680000000002 2024-04-25T22:01:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660078+0000", 2024-04-25T22:01:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011981600000000001 2024-04-25T22:01:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660189+0000", 2024-04-25T22:01:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011051400000000001 2024-04-25T22:01:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:01:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.260127011000002, 2024-04-25T22:01:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013053006000000001, 2024-04-25T22:01:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:01:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:01:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647602+0000", 2024-04-25T22:01:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.604e-06 2024-04-25T22:01:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647611+0000", 2024-04-25T22:01:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5689999999999994e-06 2024-04-25T22:01:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647634+0000", 2024-04-25T22:01:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3227e-05 2024-04-25T22:01:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647660+0000", 2024-04-25T22:01:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5829999999999998e-05 2024-04-25T22:01:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649544+0000", 2024-04-25T22:01:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001884066 2024-04-25T22:01:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649783+0000", 2024-04-25T22:01:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238411 2024-04-25T22:01:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.650794+0000", 2024-04-25T22:01:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010109920000000001 2024-04-25T22:01:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654714+0000", 2024-04-25T22:01:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039202170000000001 2024-04-25T22:01:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660403+0000", 2024-04-25T22:01:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056895940000000001 2024-04-25T22:01:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660551+0000", 2024-04-25T22:01:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014717899999999999 2024-04-25T22:01:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660653+0000", 2024-04-25T22:01:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102317 2024-04-25T22:01:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:17 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:01:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.260042831, 2024-04-25T22:01:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010101435000000001, 2024-04-25T22:01:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:01:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:01:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647686+0000", 2024-04-25T22:01:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-04-25T22:01:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647693+0000", 2024-04-25T22:01:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7330000000000003e-06 2024-04-25T22:01:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647711+0000", 2024-04-25T22:01:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7436e-05 2024-04-25T22:01:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647727+0000", 2024-04-25T22:01:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6232999999999999e-05 2024-04-25T22:01:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649249+0000", 2024-04-25T22:01:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015219890000000001 2024-04-25T22:01:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649533+0000", 2024-04-25T22:01:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028391799999999997 2024-04-25T22:01:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649841+0000", 2024-04-25T22:01:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030853400000000001 2024-04-25T22:01:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654622+0000", 2024-04-25T22:01:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047809630000000001 2024-04-25T22:01:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657616+0000", 2024-04-25T22:01:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029938769999999998 2024-04-25T22:01:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657724+0000", 2024-04-25T22:01:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108109 2024-04-25T22:01:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657786+0000", 2024-04-25T22:01:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1196000000000002e-05 2024-04-25T22:01:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:01:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.259854503, 2024-04-25T22:01:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010260877999999999, 2024-04-25T22:01:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:01:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:01:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647874+0000", 2024-04-25T22:01:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:01:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647884+0000", 2024-04-25T22:01:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.013e-05 2024-04-25T22:01:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647908+0000", 2024-04-25T22:01:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3592999999999999e-05 2024-04-25T22:01:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647926+0000", 2024-04-25T22:01:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8176999999999999e-05 2024-04-25T22:01:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651480+0000", 2024-04-25T22:01:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035540160000000001 2024-04-25T22:01:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651690+0000", 2024-04-25T22:01:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210249 2024-04-25T22:01:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:01:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651986+0000", 2024-04-25T22:01:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000296001 2024-04-25T22:01:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:57.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655696+0000", 2024-04-25T22:01:57.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037098410000000002 2024-04-25T22:01:57.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657896+0000", 2024-04-25T22:01:57.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022004630000000002 2024-04-25T22:01:57.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:57.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658035+0000", 2024-04-25T22:01:57.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013831499999999999 2024-04-25T22:01:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658133+0000", 2024-04-25T22:01:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8553000000000003e-05 2024-04-25T22:01:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:18 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:01:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.259775623000003, 2024-04-25T22:01:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013108712, 2024-04-25T22:01:57.953 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:01:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:01:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647953+0000", 2024-04-25T22:01:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.697e-06 2024-04-25T22:01:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647963+0000", 2024-04-25T22:01:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9259999999999995e-06 2024-04-25T22:01:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647982+0000", 2024-04-25T22:01:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-04-25T22:01:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648008+0000", 2024-04-25T22:01:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5956e-05 2024-04-25T22:01:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651686+0000", 2024-04-25T22:01:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678073 2024-04-25T22:01:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652023+0000", 2024-04-25T22:01:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033739399999999998 2024-04-25T22:01:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652348+0000", 2024-04-25T22:01:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032475000000000001 2024-04-25T22:01:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655883+0000", 2024-04-25T22:01:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035353030000000001 2024-04-25T22:01:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660791+0000", 2024-04-25T22:01:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049075330000000004 2024-04-25T22:01:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:57.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660930+0000", 2024-04-25T22:01:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000139856 2024-04-25T22:01:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661060+0000", 2024-04-25T22:01:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000129651 2024-04-25T22:01:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:01:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.259698731, 2024-04-25T22:01:57.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012451034, 2024-04-25T22:01:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:01:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:01:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648030+0000", 2024-04-25T22:01:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-04-25T22:01:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648036+0000", 2024-04-25T22:01:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8059999999999997e-06 2024-04-25T22:01:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648054+0000", 2024-04-25T22:01:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7744000000000002e-05 2024-04-25T22:01:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648070+0000", 2024-04-25T22:01:57.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-04-25T22:01:57.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648875+0000", 2024-04-25T22:01:57.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080444000000000002 2024-04-25T22:01:57.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:57.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649078+0000", 2024-04-25T22:01:57.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020391499999999999 2024-04-25T22:01:57.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649674+0000", 2024-04-25T22:01:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00059555299999999997 2024-04-25T22:01:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653185+0000", 2024-04-25T22:01:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035113459999999998 2024-04-25T22:01:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660251+0000", 2024-04-25T22:01:57.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070661350000000003 2024-04-25T22:01:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660382+0000", 2024-04-25T22:01:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013095899999999999 2024-04-25T22:01:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660479+0000", 2024-04-25T22:01:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6852e-05 2024-04-25T22:01:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:25 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:01:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.259632918000001, 2024-04-25T22:01:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012691025999999999, 2024-04-25T22:01:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:01:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:01:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648095+0000", 2024-04-25T22:01:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.424e-06 2024-04-25T22:01:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648102+0000", 2024-04-25T22:01:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2099999999999998e-06 2024-04-25T22:01:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648122+0000", 2024-04-25T22:01:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0242999999999999e-05 2024-04-25T22:01:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648138+0000", 2024-04-25T22:01:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6192999999999999e-05 2024-04-25T22:01:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651461+0000", 2024-04-25T22:01:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033225709999999999 2024-04-25T22:01:57.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651776+0000", 2024-04-25T22:01:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031567500000000002 2024-04-25T22:01:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660785+0000", 2024-04-25T22:01:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090087099999999996 2024-04-25T22:01:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.967 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:01:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.259570431999997, 2024-04-25T22:01:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013102702000000001, 2024-04-25T22:01:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:01:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:01:57.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648158+0000", 2024-04-25T22:01:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2839999999999999e-06 2024-04-25T22:01:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648163+0000", 2024-04-25T22:01:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-04-25T22:01:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648181+0000", 2024-04-25T22:01:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8484000000000001e-05 2024-04-25T22:01:57.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648196+0000", 2024-04-25T22:01:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4496e-05 2024-04-25T22:01:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653737+0000", 2024-04-25T22:01:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055414009999999996 2024-04-25T22:01:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653972+0000", 2024-04-25T22:01:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000234732 2024-04-25T22:01:57.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661259+0000", 2024-04-25T22:01:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072872689999999999 2024-04-25T22:01:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:01:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.259513611999999, 2024-04-25T22:01:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086984829999999999, 2024-04-25T22:01:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.971 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:01:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:01:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648214+0000", 2024-04-25T22:01:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-04-25T22:01:57.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648233+0000", 2024-04-25T22:01:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.878e-05 2024-04-25T22:01:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648252+0000", 2024-04-25T22:01:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8603000000000001e-05 2024-04-25T22:01:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648267+0000", 2024-04-25T22:01:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:01:57.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648846+0000", 2024-04-25T22:01:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057923000000000002 2024-04-25T22:01:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649027+0000", 2024-04-25T22:01:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181585 2024-04-25T22:01:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.656912+0000", 2024-04-25T22:01:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078844589999999999 2024-04-25T22:01:57.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 6 lcod 17'2)", 2024-04-25T22:01:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:01:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.247583696, 2024-04-25T22:01:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064966000000000004, 2024-04-25T22:01:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:01:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:01:57.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:01:57.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660144+0000", 2024-04-25T22:01:57.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1800000000000005e-07 2024-04-25T22:01:57.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660181+0000", 2024-04-25T22:01:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6408000000000001e-05 2024-04-25T22:01:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660197+0000", 2024-04-25T22:01:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6177000000000001e-05 2024-04-25T22:01:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660210+0000", 2024-04-25T22:01:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:01:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660556+0000", 2024-04-25T22:01:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034612899999999998 2024-04-25T22:01:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660793+0000", 2024-04-25T22:01:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023656799999999999 2024-04-25T22:01:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:18 3.1f e17/15 ondisk, result = 0)", 2024-04-25T22:01:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:01:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.247321923000001, 2024-04-25T22:01:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067878299999999997, 2024-04-25T22:01:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:01:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:01:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:01:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660406+0000", 2024-04-25T22:01:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2800000000000005e-07 2024-04-25T22:01:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660412+0000", 2024-04-25T22:01:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0399999999999998e-06 2024-04-25T22:01:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660429+0000", 2024-04-25T22:01:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7394e-05 2024-04-25T22:01:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660445+0000", 2024-04-25T22:01:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6069000000000001e-05 2024-04-25T22:01:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660757+0000", 2024-04-25T22:01:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031194300000000002 2024-04-25T22:01:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660776+0000", 2024-04-25T22:01:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8862999999999999e-05 2024-04-25T22:01:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661084+0000", 2024-04-25T22:01:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030754600000000001 2024-04-25T22:01:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-25T22:01:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:01:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.247257695000002, 2024-04-25T22:01:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080007600000000004, 2024-04-25T22:01:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:01:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:01:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:01:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660470+0000", 2024-04-25T22:01:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4499999999999996e-07 2024-04-25T22:01:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660475+0000", 2024-04-25T22:01:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-04-25T22:01:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660490+0000", 2024-04-25T22:01:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5274e-05 2024-04-25T22:01:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660501+0000", 2024-04-25T22:01:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0694e-05 2024-04-25T22:01:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661130+0000", 2024-04-25T22:01:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062887499999999999 2024-04-25T22:01:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661269+0000", 2024-04-25T22:01:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013955900000000001 2024-04-25T22:01:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:01:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:01:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.283525695999998, 2024-04-25T22:01:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037104880000000001, 2024-04-25T22:01:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:01:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:01:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624204+0000", 2024-04-25T22:01:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.757e-06 2024-04-25T22:01:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624233+0000", 2024-04-25T22:01:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9362000000000001e-05 2024-04-25T22:01:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624264+0000", 2024-04-25T22:01:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0843000000000003e-05 2024-04-25T22:01:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624280+0000", 2024-04-25T22:01:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5577e-05 2024-04-25T22:01:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624458+0000", 2024-04-25T22:01:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017821199999999999 2024-04-25T22:01:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624661+0000", 2024-04-25T22:01:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020283200000000001 2024-04-25T22:01:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624842+0000", 2024-04-25T22:01:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018115500000000001 2024-04-25T22:01:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.626271+0000", 2024-04-25T22:01:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001429416 2024-04-25T22:01:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627749+0000", 2024-04-25T22:01:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014778650000000001 2024-04-25T22:01:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627849+0000", 2024-04-25T22:01:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9261999999999999e-05 2024-04-25T22:01:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627912+0000", 2024-04-25T22:01:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3207000000000007e-05 2024-04-25T22:01:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-25T22:01:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:01:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.280828345, 2024-04-25T22:01:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029804620000000001, 2024-04-25T22:01:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:01:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:01:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626903+0000", 2024-04-25T22:01:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0029999999999996e-06 2024-04-25T22:01:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626921+0000", 2024-04-25T22:01:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8272999999999999e-05 2024-04-25T22:01:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626959+0000", 2024-04-25T22:01:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7843999999999999e-05 2024-04-25T22:01:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626977+0000", 2024-04-25T22:01:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7756000000000001e-05 2024-04-25T22:01:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627153+0000", 2024-04-25T22:01:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017643800000000001 2024-04-25T22:01:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:01:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627425+0000", 2024-04-25T22:01:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027207300000000001 2024-04-25T22:01:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627848+0000", 2024-04-25T22:01:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042297199999999997 2024-04-25T22:01:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:01:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629590+0000", 2024-04-25T22:01:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017416809999999999 2024-04-25T22:01:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629720+0000", 2024-04-25T22:01:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130526 2024-04-25T22:01:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:01:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629808+0000", 2024-04-25T22:01:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7449999999999998e-05 2024-04-25T22:01:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629879+0000", 2024-04-25T22:01:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1445999999999993e-05 2024-04-25T22:01:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4185.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-04-25T22:01:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:01:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.29272027499999997, 2024-04-25T22:01:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0036257939999999999, 2024-04-25T22:01:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:01:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:01:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:01:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:01:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4185", 2024-04-25T22:01:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.44:0/2048337248", 2024-04-25T22:01:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2 2024-04-25T22:01:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:01:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:01:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:01:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:01:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:01:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:01:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:01:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615010+0000", 2024-04-25T22:01:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8059999999999999e-06 2024-04-25T22:01:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:01:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615023+0000", 2024-04-25T22:01:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3159999999999999e-05 2024-04-25T22:01:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:01:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615043+0000", 2024-04-25T22:01:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:01:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615059+0000", 2024-04-25T22:01:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5519000000000002e-05 2024-04-25T22:01:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615241+0000", 2024-04-25T22:01:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018207100000000001 2024-04-25T22:01:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:01:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615258+0000", 2024-04-25T22:01:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7278999999999998e-05 2024-04-25T22:01:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:01:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618429+0000", 2024-04-25T22:01:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003171213 2024-04-25T22:01:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:01:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:01:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:01:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618633+0000", 2024-04-25T22:01:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020343999999999999 2024-04-25T22:01:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:01:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:01:58.002 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:01:58.004 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:01:58.004 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:58.003+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:58.104 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:58.103+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:58.133 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:58.134 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:01:58.134 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:01:58.134 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:58.148 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:01:58.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:58.203+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:58.271 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:58.271 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:01:58.272 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:01:58.272 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:01:58.272 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:58.285 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:01:58.306 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:58.306+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:58.405 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:01:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:01:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:01:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:01:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:01:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.577110361999999, 2024-04-25T22:01:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:01:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:01:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:01:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:01:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:01:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:01:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:01:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:01:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:01:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:01:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:01:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:01:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:01:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:01:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:01:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:01:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:01:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:01:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:01:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.576379543999998, 2024-04-25T22:01:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:01:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:01:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:01:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:01:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:01:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:01:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:01:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:01:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:01:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:01:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:01:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:01:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:01:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:01:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:01:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:01:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:01:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:01:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:01:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.575713272999998, 2024-04-25T22:01:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:01:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:58.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:01:58.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:01:58.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:01:58.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:01:58.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:01:58.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:01:58.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:01:58.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:01:58.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:01:58.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:01:58.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:01:58.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:01:58.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:01:58.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:58.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:01:58.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:01:58.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:01:58.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:01:58.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.419 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.419 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:01:58.419 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:58.419 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.574813372999998, 2024-04-25T22:01:58.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:01:58.419 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.420 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:58.420 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:58.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:01:58.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:01:58.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:01:58.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:01:58.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:01:58.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:01:58.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:01:58.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:01:58.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:01:58.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:01:58.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:01:58.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:01:58.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:01:58.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:58.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:01:58.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:01:58.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:01:58.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:01:58.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.423 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.423 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:01:58.424 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:58.424 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.572777031999998, 2024-04-25T22:01:58.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:01:58.424 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.424 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.424 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:58.424 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:58.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:01:58.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:01:58.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:01:58.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:01:58.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:01:58.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:01:58.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:01:58.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:01:58.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:01:58.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:01:58.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:01:58.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:01:58.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:01:58.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:58.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:01:58.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:01:58.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:01:58.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:01:58.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.428 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.428 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:01:58.428 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:58.428 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.572313694999998, 2024-04-25T22:01:58.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:01:58.428 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.428 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:58.428 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:58.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:01:58.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:01:58.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:01:58.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:01:58.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:01:58.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:01:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:01:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:01:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:01:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:01:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:01:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:01:58.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:01:58.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:58.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:01:58.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:01:58.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:01:58.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:01:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:01:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.571446815999998, 2024-04-25T22:01:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:01:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:01:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:01:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:01:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:01:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:01:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:01:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:01:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:01:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:01:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:01:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:01:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:01:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:01:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:01:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:01:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:01:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:01:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:01:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.570995742000001, 2024-04-25T22:01:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:01:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:01:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:01:58.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:01:58.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:01:58.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:01:58.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:01:58.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:01:58.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:01:58.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:01:58.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:01:58.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:01:58.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:01:58.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:01:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:01:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:01:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:01:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:01:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:01:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.570546155999999, 2024-04-25T22:01:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:01:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:01:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:01:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:01:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:01:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:01:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:01:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:01:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:01:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:01:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:01:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:01:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:01:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:01:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:01:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:01:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:01:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:01:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.773889668999999, 2024-04-25T22:01:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:01:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:01:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:01:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:01:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:01:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:01:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:01:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:01:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:01:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:01:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:01:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:01:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:01:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:01:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:01:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:01:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:01:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:01:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:01:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:01:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:01:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:01:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:01:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:01:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.773765685999997, 2024-04-25T22:01:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:01:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:01:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:01:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:01:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:01:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:01:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:01:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:01:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:01:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:01:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:01:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:01:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:01:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:01:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:01:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:01:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:01:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:01:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:01:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:01:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:01:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:01:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:01:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:01:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.773691749999998, 2024-04-25T22:01:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:01:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:58.457 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:58.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:01:58.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:01:58.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:01:58.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:01:58.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:01:58.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:01:58.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:01:58.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:01:58.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:01:58.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:01:58.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:01:58.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:01:58.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:01:58.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:58.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:01:58.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:01:58.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:58.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:01:58.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:01:58.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:58.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:01:58.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:01:58.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:58.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:01:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:01:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:01:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:01:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.773575498, 2024-04-25T22:01:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:01:58.462 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.462 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.462 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:58.462 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:58.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:01:58.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:01:58.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:01:58.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:01:58.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:01:58.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:01:58.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:01:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:01:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:01:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:01:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:01:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:01:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:01:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:01:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:01:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:01:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:01:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:01:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:01:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:01:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:01:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:01:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:01:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.467 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:58.467 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:58.467 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.773412088999997, 2024-04-25T22:01:58.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:01:58.467 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.467 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.467 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:58.467 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:58.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:01:58.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:01:58.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:01:58.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:01:58.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:01:58.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:01:58.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:01:58.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:01:58.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:01:58.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:01:58.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:01:58.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:01:58.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:01:58.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:58.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:01:58.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:01:58.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:58.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:01:58.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:01:58.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:58.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:01:58.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:01:58.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:58.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:01:58.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:01:58.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:01:58.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:01:58.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.472 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.472 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:58.472 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:58.472 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.773309892999997, 2024-04-25T22:01:58.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:01:58.472 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.472 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.472 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:58.473 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:58.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:01:58.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:01:58.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:01:58.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:01:58.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:01:58.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:01:58.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:01:58.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:01:58.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:01:58.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:01:58.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:01:58.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:01:58.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:01:58.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:58.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:01:58.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:01:58.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:58.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:01:58.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:01:58.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:58.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:01:58.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:01:58.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:58.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:01:58.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:01:58.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:01:58.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:01:58.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.477 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.477 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:58.477 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:58.478 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.773230939999998, 2024-04-25T22:01:58.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:01:58.478 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.478 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.478 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:58.478 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:58.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:01:58.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:01:58.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:01:58.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:01:58.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:01:58.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:01:58.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:01:58.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:01:58.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:01:58.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:01:58.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:01:58.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:01:58.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:01:58.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:01:58.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:01:58.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:01:58.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:01:58.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:01:58.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:01:58.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:01:58.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:01:58.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:01:58.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:58.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:01:58.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:01:58.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:01:58.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:01:58.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.483 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.483 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.483 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:58.483 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:58.483 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.773165917, 2024-04-25T22:01:58.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:01:58.483 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:58.483 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:58.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:01:58.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:01:58.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:01:58.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:01:58.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:01:58.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:01:58.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:01:58.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:01:58.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:01:58.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:01:58.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:01:58.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:01:58.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:01:58.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:01:58.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:01:58.486 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.486 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.486 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.487 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:01:58.487 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:58.487 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.773087725000003, 2024-04-25T22:01:58.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:01:58.487 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.487 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.487 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:01:58.487 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:58.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:01:58.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:01:58.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:01:58.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:01:58.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:01:58.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:01:58.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:01:58.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:01:58.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:01:58.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:01:58.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:01:58.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:01:58.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:01:58.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:01:58.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:01:58.490 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.490 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.490 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.491 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:01:58.491 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:58.491 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.758441265000002, 2024-04-25T22:01:58.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:01:58.491 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.491 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:58.491 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:58.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:01:58.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:01:58.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:01:58.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:01:58.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:01:58.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:01:58.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:01:58.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:01:58.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:01:58.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:01:58.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:01:58.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:01:58.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:01:58.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:58.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:01:58.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:01:58.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:01:58.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:01:58.495 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.495 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.495 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.495 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:01:58.495 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:58.495 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.758281308999997, 2024-04-25T22:01:58.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:01:58.495 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:01:58.495 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:01:58.495 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:01:58.495 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:01:58.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:01:58.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:58.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:01:58.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:01:58.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:01:58.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:01:58.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:01:58.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:01:58.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:01:58.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:01:58.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:01:58.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:01:58.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:01:58.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:01:58.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:01:58.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:01:58.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:01:58.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:01:58.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:01:58.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:01:58.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:01:58.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:01:58.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:01:58.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:01:58.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:01:58.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:01:58.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:01:58.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:01:58.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:01:58.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:01:58.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:01:58.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.499 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:01:58.499 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:01:58.499 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:01:58.501 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:58.499+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:58.501 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:01:58.587 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:01:58.601 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:58.599+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:58.638 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:01:58.638 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:01:58.638 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:01:58.638 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:01:58.651 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:01:58.702 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:58.703+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:58.749 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:01:58.749 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:01:58.770 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:01:58.770 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:01:58.777 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:58.777 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:58.792 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:01:58.793 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:01:58.793 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:01:58.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:58.803+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:58.905 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:58.903+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:58.910 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:58.910 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:58.927 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:01:59.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:59.003+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:59.059 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:59.060 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:59.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:01:59.107 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:59.107+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:59.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:59.207+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:59.232 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:59.232 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:59.247 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:01:59.309 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:59.307+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:59.410 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:59.410+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:59.414 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:59.414 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:59.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:01:59.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:59.511+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:59.562 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:59.562 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:59.576 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:01:59.613 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:59.610+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:59.691 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:59.691 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:59.705 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:01:59.713 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:01:59.710+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:01:59.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:01:59.811+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:01:59.821 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:59.821 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:59.835 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:01:59.890 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:01:59.914 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:01:59.911+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:01:59.969 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:01:59.970 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:01:59.984 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:00.015 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:00.011+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:00.104 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:00.104 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:00.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:00.115+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:00.118 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:00.217 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:00.214+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:00.243 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:00.244 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:00.258 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:00.318 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:00.314+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:00.389 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:00.389 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:00.405 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:00.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:00.451+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:00.519 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:00.515+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:00.528 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:00.528 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:00.542 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:00.620 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:00.614+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:00.709 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:00.709 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:00.720 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:00.718+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:00.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:00.813 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:02:00.821 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:00.819+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:00.855 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:00.855 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:00.864 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-25T22:02:00.870 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:00.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:00.919+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:00.972 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:00.973 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:00.993 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:00.994 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:01.013 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:01.014 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:01.023 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:01.018+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:01.031 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:01.031 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:01.031 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:02:01.032 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:02:01.032 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:01.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:01.123 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:01.123+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:01.168 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:01.168 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:01.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:01.168 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:01.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.169 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:01.169 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:01.169 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.341458537999998, 2024-04-25T22:02:01.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:01.169 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.169 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.169 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:01.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:01.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:01.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:01.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:01.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:01.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:01.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:01.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:01.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:01.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:01.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:01.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:01.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:01.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:01.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:01.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:01.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:01.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:01.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.173 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.173 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:01.173 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:01.173 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.340727719999997, 2024-04-25T22:02:01.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:01.173 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.173 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.173 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.173 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:01.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:01.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:01.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:01.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:01.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:01.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:01.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:01.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:01.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:01.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:01.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:01.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:01.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:01.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:01.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:01.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:01.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:01.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:01.177 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.177 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.177 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.177 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:01.177 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:01.177 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.340061448999997, 2024-04-25T22:02:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:01.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:01.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:01.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:01.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:01.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:01.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:01.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:01.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:01.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:01.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:01.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:01.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:01.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:01.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:01.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:01.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:01.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.181 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.182 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:01.182 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:01.182 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.339161549000004, 2024-04-25T22:02:01.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:01.182 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.182 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.182 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.182 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:01.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:01.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:01.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:01.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:01.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:01.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:01.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:01.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:01.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:01.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:01.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:01.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:01.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:01.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:01.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:01.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:01.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:01.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:01.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.186 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.186 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:01.186 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:01.186 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.337125208000003, 2024-04-25T22:02:01.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:01.186 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.186 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.186 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.186 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:01.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:01.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:01.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:01.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:01.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:01.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:01.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:01.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:01.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:01.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:01.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:01.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:01.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:01.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:01.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:01.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:01.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:01.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:01.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.190 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.190 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:01.190 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:01.190 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.336661870999997, 2024-04-25T22:02:01.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:01.191 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.191 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.191 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:01.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:01.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:01.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:01.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:01.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:01.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:01.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:01.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:01.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:01.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:01.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:01.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:01.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:01.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:01.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:01.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:01.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:01.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:01.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.194 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.195 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:01.195 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:01.195 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.335794991999997, 2024-04-25T22:02:01.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:01.195 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.195 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.195 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:01.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:01.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:01.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:01.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:01.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:01.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:01.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:01.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:01.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:01.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:01.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:01.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:01.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:01.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:01.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:01.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:01.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:01.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:01.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.199 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:01.199 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:01.199 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.335343918, 2024-04-25T22:02:01.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:01.199 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.199 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.200 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:01.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:01.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:01.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:01.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:01.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:01.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:01.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:01.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:01.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:01.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:01.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:01.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:01.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:01.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:01.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:01.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:01.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:01.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:01.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.203 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.203 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:01.203 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:01.203 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.334894331999998, 2024-04-25T22:02:01.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:01.204 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.204 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.204 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:01.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:01.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:01.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:01.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:01.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:01.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:01.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:01.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:01.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:01.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:01.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:01.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:01.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:01.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:01.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:01.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:01.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:01.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:01.207 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.207 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.207 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.208 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:01.208 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:01.208 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.538237844999998, 2024-04-25T22:02:01.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:01.208 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.208 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.208 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.208 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:01.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:01.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:01.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:01.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:01.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:01.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:01.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:01.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:01.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:01.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:01.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:01.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:01.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:01.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:01.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:01.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:01.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:01.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:01.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:01.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:01.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:01.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:01.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:01.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:01.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:01.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:01.212 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.213 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.213 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:01.213 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:01.213 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.538113862000003, 2024-04-25T22:02:01.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:01.213 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.213 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.213 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.213 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:01.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:01.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:01.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:01.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:01.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:01.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:01.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:01.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:01.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:01.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:01.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:01.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:01.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:01.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:01.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:01.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:01.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:01.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:01.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:01.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:01.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:01.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:01.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:01.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:01.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:01.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:01.218 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.218 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.218 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.218 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:01.218 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:01.218 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.538039926000003, 2024-04-25T22:02:01.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:01.218 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.218 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.218 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.218 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:01.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:01.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:01.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:01.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:01.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:01.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:01.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:01.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:01.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:01.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:01.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:01.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:01.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:01.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:01.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:01.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:01.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.537923673999998, 2024-04-25T22:02:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.537760265000003, 2024-04-25T22:02:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.537658069000003, 2024-04-25T22:02:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.537579116000003, 2024-04-25T22:02:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.537514092999999, 2024-04-25T22:02:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.537435901000002, 2024-04-25T22:02:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.522789441, 2024-04-25T22:02:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:01.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:01.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:01.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:01.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:01.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:01.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.522629485000003, 2024-04-25T22:02:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:01.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:01.262 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:01.263 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:01.263+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:01.264 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:01.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:01.363+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:01.398 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:01.398 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:01.398 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:01.399 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:01.412 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:01.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:01.463+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:01.531 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:01.531 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:01.531 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:01.531 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:01.531 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:01.545 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:01.568 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:01.563+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:01.670 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:01.670 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.671896748999998, 2024-04-25T22:02:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:02:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:02:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:02:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:02:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:02:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:02:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:02:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:02:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:02:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:02:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:02:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:02:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:02:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:02:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:02:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:02:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:02:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:02:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:02:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:02:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:02:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:02:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:02:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:02:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.489833676000003, 2024-04-25T22:02:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:02:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:02:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:02:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:02:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:02:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:02:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:02:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:02:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:02:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:02:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:02:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:02:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:02:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:02:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:02:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:02:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:02:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:02:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:02:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:02:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:02:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:02:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:02:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:02:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.489789395999999, 2024-04-25T22:02:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:02:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:02:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:02:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:02:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:02:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:02:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:02:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:02:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:02:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:02:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:02:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:02:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:02:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:02:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:02:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:02:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:02:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:02:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:02:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:02:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:02:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:02:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:02:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:02:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.489732871000001, 2024-04-25T22:02:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:01.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:01.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:01.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:01.693 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.693 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.693 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.694 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:01.694 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:01.694 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.489537628999997, 2024-04-25T22:02:01.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:01.694 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.694 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.694 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.694 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:01.694 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:01.694 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:01.694 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:01.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.694 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:01.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:01.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:01.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:01.699 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.699 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.699 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.489475335999998, 2024-04-25T22:02:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:01.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:01.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:01.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:01.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:01.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.489415119999997, 2024-04-25T22:02:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:01.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:01.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:01.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:01.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:01.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:01.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:01.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:01.711 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.711 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.711 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.711 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:01.711 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.489225607999998, 2024-04-25T22:02:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.297887774000003, 2024-04-25T22:02:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:02:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:02:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:02:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:02:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:02:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:02:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:02:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:02:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:02:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:02:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:02:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:02:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:02:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:02:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:02:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:02:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:02:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:02:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:02:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:02:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:02:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:02:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:02:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:02:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.297849397, 2024-04-25T22:02:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:02:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:02:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:02:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:02:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:02:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:02:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:02:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:02:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:02:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:02:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:02:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:02:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:02:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:02:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:02:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:02:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:02:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:02:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:02:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:02:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:02:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:02:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:02:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:02:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.297798137999997, 2024-04-25T22:02:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:02:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:02:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:02:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:02:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:02:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:02:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:02:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:02:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:02:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:02:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:02:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:02:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:02:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:02:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:02:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:02:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:02:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:02:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:02:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:02:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:02:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:02:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:02:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:02:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.297649489000001, 2024-04-25T22:02:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:02:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:02:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:02:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:02:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:02:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:02:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:02:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:02:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:02:01.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:02:01.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:02:01.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:02:01.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:02:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:02:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:02:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:02:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:02:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:02:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:02:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:02:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:02:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:02:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:02:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:02:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.297607339000002, 2024-04-25T22:02:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:02:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:02:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:02:01.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:02:01.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:02:01.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:02:01.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:02:01.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:02:01.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:02:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:02:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:02:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:02:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:02:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:02:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:02:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:02:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:02:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:02:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:02:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:02:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:02:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:02:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:02:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:02:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.297569486, 2024-04-25T22:02:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.297360161, 2024-04-25T22:02:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 47.031108889000002, 2024-04-25T22:02:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:02:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:02:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:02:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:02:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:02:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:02:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:02:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:02:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:02:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:02:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:02:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:02:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:02:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:02:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:02:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:02:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:02:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:02:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:02:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:02:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:02:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:02:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 47.031075049000002, 2024-04-25T22:02:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:02:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:02:01.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:02:01.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:02:01.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:02:01.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:02:01.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:02:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:02:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:02:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:02:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:02:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:02:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:02:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:02:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:02:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:02:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:02:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:02:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:02:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:02:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:02:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 47.031023353000002, 2024-04-25T22:02:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:02:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:02:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:02:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:02:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:02:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:02:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:02:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:02:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:02:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:02:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:02:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:02:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:02:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:02:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:02:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:02:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:02:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:02:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:02:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:02:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:02:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:02:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:02:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 47.030878901000001, 2024-04-25T22:02:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:02:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:02:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:02:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:02:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:02:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:02:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:02:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:02:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:02:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:02:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:02:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:02:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:02:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:02:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:02:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:02:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:02:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:02:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:02:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:02:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:02:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:02:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:02:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 47.030822180999998, 2024-04-25T22:02:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:02:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:02:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:02:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:02:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:02:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:02:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:02:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:02:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:02:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:02:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:02:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:02:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:02:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:02:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:02:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:02:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:02:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:02:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:02:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:02:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:02:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:02:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:02:01.783 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.783 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.783 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.783 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:01.783 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:01.783 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:01.783 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:01.666+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:01.784 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:01.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:01.783+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:01.887 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:01.883+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:01.916 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:01.917 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:01.917 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:02:01.917 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:01.932 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:01.965 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:02:01.966 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:02:01.966 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-25T22:02:01.966 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-25T22:02:01.966 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-25T22:02:01.966 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-25T22:02:02.013 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:02.010+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:02.053 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:02.054 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:02.054 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:02:02.054 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:02:02.054 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:02.069 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:02.100 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:02.100 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-25T22:02:02.100 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:02.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:02.115+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:02.189 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:02.186+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:02.193 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:02:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:02:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:02:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 4 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:27 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:02:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.553483237000002, 2024-04-25T22:02:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013281644, 2024-04-25T22:02:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637801+0000", 2024-04-25T22:02:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1299999999999998e-07 2024-04-25T22:02:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637828+0000", 2024-04-25T22:02:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6953000000000001e-05 2024-04-25T22:02:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637873+0000", 2024-04-25T22:02:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4676999999999999e-05 2024-04-25T22:02:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637917+0000", 2024-04-25T22:02:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4815999999999999e-05 2024-04-25T22:02:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644220+0000", 2024-04-25T22:02:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063021049999999997 2024-04-25T22:02:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651082+0000", 2024-04-25T22:02:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068621799999999998 2024-04-25T22:02:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:15 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.548075625000003, 2024-04-25T22:02:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010973732, 2024-04-25T22:02:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643209+0000", 2024-04-25T22:02:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.003e-06 2024-04-25T22:02:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643230+0000", 2024-04-25T22:02:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0815999999999999e-05 2024-04-25T22:02:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643252+0000", 2024-04-25T22:02:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2586999999999999e-05 2024-04-25T22:02:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643271+0000", 2024-04-25T22:02:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8493000000000001e-05 2024-04-25T22:02:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644387+0000", 2024-04-25T22:02:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011160250000000001 2024-04-25T22:02:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644434+0000", 2024-04-25T22:02:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:02:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654103+0000", 2024-04-25T22:02:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096691360000000001 2024-04-25T22:02:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654181+0000", 2024-04-25T22:02:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8546000000000003e-05 2024-04-25T22:02:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.547975268999998, 2024-04-25T22:02:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088132450000000008, 2024-04-25T22:02:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643309+0000", 2024-04-25T22:02:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9600000000000008e-07 2024-04-25T22:02:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643339+0000", 2024-04-25T22:02:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9467000000000001e-05 2024-04-25T22:02:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644245+0000", 2024-04-25T22:02:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090648200000000001 2024-04-25T22:02:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644268+0000", 2024-04-25T22:02:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3017e-05 2024-04-25T22:02:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647517+0000", 2024-04-25T22:02:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032491680000000002 2024-04-25T22:02:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647561+0000", 2024-04-25T22:02:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3630000000000001e-05 2024-04-25T22:02:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652041+0000", 2024-04-25T22:02:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044804529999999997 2024-04-25T22:02:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652121+0000", 2024-04-25T22:02:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0031999999999995e-05 2024-04-25T22:02:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:34 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.545886641999999, 2024-04-25T22:02:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089225940000000007, 2024-04-25T22:02:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645398+0000", 2024-04-25T22:02:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4360000000000001e-06 2024-04-25T22:02:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645412+0000", 2024-04-25T22:02:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4283e-05 2024-04-25T22:02:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645434+0000", 2024-04-25T22:02:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1237e-05 2024-04-25T22:02:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645459+0000", 2024-04-25T22:02:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5675999999999999e-05 2024-04-25T22:02:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646081+0000", 2024-04-25T22:02:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062128900000000002 2024-04-25T22:02:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646131+0000", 2024-04-25T22:02:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0322999999999999e-05 2024-04-25T22:02:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654185+0000", 2024-04-25T22:02:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080542749999999996 2024-04-25T22:02:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654319+0000", 2024-04-25T22:02:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013407499999999999 2024-04-25T22:02:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:19 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.545785133000003, 2024-04-25T22:02:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076631340000000003, 2024-04-25T22:02:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645499+0000", 2024-04-25T22:02:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4300000000000001e-07 2024-04-25T22:02:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645509+0000", 2024-04-25T22:02:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0244000000000001e-05 2024-04-25T22:02:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645523+0000", 2024-04-25T22:02:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3315999999999999e-05 2024-04-25T22:02:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645531+0000", 2024-04-25T22:02:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.123e-06 2024-04-25T22:02:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648260+0000", 2024-04-25T22:02:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027289789999999999 2024-04-25T22:02:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648307+0000", 2024-04-25T22:02:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6969999999999999e-05 2024-04-25T22:02:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653039+0000", 2024-04-25T22:02:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047322299999999996 2024-04-25T22:02:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653161+0000", 2024-04-25T22:02:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012232899999999999 2024-04-25T22:02:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.543807471999997, 2024-04-25T22:02:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01271303, 2024-04-25T22:02:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647479+0000", 2024-04-25T22:02:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.286e-06 2024-04-25T22:02:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647494+0000", 2024-04-25T22:02:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.521e-05 2024-04-25T22:02:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647525+0000", 2024-04-25T22:02:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0403999999999999e-05 2024-04-25T22:02:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647544+0000", 2024-04-25T22:02:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8743e-05 2024-04-25T22:02:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647895+0000", 2024-04-25T22:02:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035099699999999997 2024-04-25T22:02:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648202+0000", 2024-04-25T22:02:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030758499999999998 2024-04-25T22:02:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648496+0000", 2024-04-25T22:02:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029370699999999999 2024-04-25T22:02:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654605+0000", 2024-04-25T22:02:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061095999999999998 2024-04-25T22:02:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.659959+0000", 2024-04-25T22:02:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053531680000000002 2024-04-25T22:02:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660078+0000", 2024-04-25T22:02:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011981600000000001 2024-04-25T22:02:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660189+0000", 2024-04-25T22:02:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011051400000000001 2024-04-25T22:02:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.543683379999997, 2024-04-25T22:02:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013053006000000001, 2024-04-25T22:02:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647602+0000", 2024-04-25T22:02:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.604e-06 2024-04-25T22:02:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647611+0000", 2024-04-25T22:02:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5689999999999994e-06 2024-04-25T22:02:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647634+0000", 2024-04-25T22:02:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3227e-05 2024-04-25T22:02:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647660+0000", 2024-04-25T22:02:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5829999999999998e-05 2024-04-25T22:02:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649544+0000", 2024-04-25T22:02:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001884066 2024-04-25T22:02:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649783+0000", 2024-04-25T22:02:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238411 2024-04-25T22:02:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.650794+0000", 2024-04-25T22:02:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010109920000000001 2024-04-25T22:02:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654714+0000", 2024-04-25T22:02:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039202170000000001 2024-04-25T22:02:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660403+0000", 2024-04-25T22:02:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056895940000000001 2024-04-25T22:02:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660551+0000", 2024-04-25T22:02:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014717899999999999 2024-04-25T22:02:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660653+0000", 2024-04-25T22:02:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102317 2024-04-25T22:02:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:17 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.543599200000003, 2024-04-25T22:02:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010101435000000001, 2024-04-25T22:02:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647686+0000", 2024-04-25T22:02:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-04-25T22:02:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647693+0000", 2024-04-25T22:02:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7330000000000003e-06 2024-04-25T22:02:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647711+0000", 2024-04-25T22:02:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7436e-05 2024-04-25T22:02:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647727+0000", 2024-04-25T22:02:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6232999999999999e-05 2024-04-25T22:02:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649249+0000", 2024-04-25T22:02:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015219890000000001 2024-04-25T22:02:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649533+0000", 2024-04-25T22:02:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028391799999999997 2024-04-25T22:02:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:02.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649841+0000", 2024-04-25T22:02:02.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030853400000000001 2024-04-25T22:02:02.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:02.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654622+0000", 2024-04-25T22:02:02.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047809630000000001 2024-04-25T22:02:02.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:02.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657616+0000", 2024-04-25T22:02:02.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029938769999999998 2024-04-25T22:02:02.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:02.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657724+0000", 2024-04-25T22:02:02.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108109 2024-04-25T22:02:02.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657786+0000", 2024-04-25T22:02:02.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1196000000000002e-05 2024-04-25T22:02:02.229 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.229 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.229 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.229 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:02.229 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:02.229 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.543410872000003, 2024-04-25T22:02:02.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010260877999999999, 2024-04-25T22:02:02.229 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.230 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.230 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.230 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:02.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:02.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647874+0000", 2024-04-25T22:02:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:02:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647884+0000", 2024-04-25T22:02:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.013e-05 2024-04-25T22:02:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647908+0000", 2024-04-25T22:02:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3592999999999999e-05 2024-04-25T22:02:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647926+0000", 2024-04-25T22:02:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8176999999999999e-05 2024-04-25T22:02:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651480+0000", 2024-04-25T22:02:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035540160000000001 2024-04-25T22:02:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651690+0000", 2024-04-25T22:02:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210249 2024-04-25T22:02:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651986+0000", 2024-04-25T22:02:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000296001 2024-04-25T22:02:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655696+0000", 2024-04-25T22:02:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037098410000000002 2024-04-25T22:02:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657896+0000", 2024-04-25T22:02:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022004630000000002 2024-04-25T22:02:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658035+0000", 2024-04-25T22:02:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013831499999999999 2024-04-25T22:02:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658133+0000", 2024-04-25T22:02:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8553000000000003e-05 2024-04-25T22:02:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:18 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.543331991999999, 2024-04-25T22:02:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013108712, 2024-04-25T22:02:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647953+0000", 2024-04-25T22:02:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.697e-06 2024-04-25T22:02:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647963+0000", 2024-04-25T22:02:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9259999999999995e-06 2024-04-25T22:02:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647982+0000", 2024-04-25T22:02:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-04-25T22:02:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648008+0000", 2024-04-25T22:02:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5956e-05 2024-04-25T22:02:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651686+0000", 2024-04-25T22:02:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678073 2024-04-25T22:02:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652023+0000", 2024-04-25T22:02:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033739399999999998 2024-04-25T22:02:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652348+0000", 2024-04-25T22:02:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032475000000000001 2024-04-25T22:02:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655883+0000", 2024-04-25T22:02:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035353030000000001 2024-04-25T22:02:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660791+0000", 2024-04-25T22:02:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049075330000000004 2024-04-25T22:02:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660930+0000", 2024-04-25T22:02:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000139856 2024-04-25T22:02:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661060+0000", 2024-04-25T22:02:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000129651 2024-04-25T22:02:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.543255100000003, 2024-04-25T22:02:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012451034, 2024-04-25T22:02:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648030+0000", 2024-04-25T22:02:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-04-25T22:02:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648036+0000", 2024-04-25T22:02:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8059999999999997e-06 2024-04-25T22:02:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648054+0000", 2024-04-25T22:02:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7744000000000002e-05 2024-04-25T22:02:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648070+0000", 2024-04-25T22:02:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-04-25T22:02:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648875+0000", 2024-04-25T22:02:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080444000000000002 2024-04-25T22:02:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649078+0000", 2024-04-25T22:02:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020391499999999999 2024-04-25T22:02:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649674+0000", 2024-04-25T22:02:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00059555299999999997 2024-04-25T22:02:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653185+0000", 2024-04-25T22:02:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035113459999999998 2024-04-25T22:02:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660251+0000", 2024-04-25T22:02:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070661350000000003 2024-04-25T22:02:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660382+0000", 2024-04-25T22:02:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013095899999999999 2024-04-25T22:02:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660479+0000", 2024-04-25T22:02:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6852e-05 2024-04-25T22:02:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:25 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.543189286999997, 2024-04-25T22:02:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012691025999999999, 2024-04-25T22:02:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648095+0000", 2024-04-25T22:02:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.424e-06 2024-04-25T22:02:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648102+0000", 2024-04-25T22:02:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2099999999999998e-06 2024-04-25T22:02:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648122+0000", 2024-04-25T22:02:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0242999999999999e-05 2024-04-25T22:02:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648138+0000", 2024-04-25T22:02:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6192999999999999e-05 2024-04-25T22:02:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651461+0000", 2024-04-25T22:02:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033225709999999999 2024-04-25T22:02:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651776+0000", 2024-04-25T22:02:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031567500000000002 2024-04-25T22:02:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660785+0000", 2024-04-25T22:02:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090087099999999996 2024-04-25T22:02:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.543126801, 2024-04-25T22:02:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013102702000000001, 2024-04-25T22:02:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648158+0000", 2024-04-25T22:02:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2839999999999999e-06 2024-04-25T22:02:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648163+0000", 2024-04-25T22:02:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-04-25T22:02:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648181+0000", 2024-04-25T22:02:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8484000000000001e-05 2024-04-25T22:02:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648196+0000", 2024-04-25T22:02:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4496e-05 2024-04-25T22:02:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653737+0000", 2024-04-25T22:02:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055414009999999996 2024-04-25T22:02:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653972+0000", 2024-04-25T22:02:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000234732 2024-04-25T22:02:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661259+0000", 2024-04-25T22:02:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072872689999999999 2024-04-25T22:02:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.543069981000002, 2024-04-25T22:02:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086984829999999999, 2024-04-25T22:02:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648214+0000", 2024-04-25T22:02:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-04-25T22:02:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648233+0000", 2024-04-25T22:02:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.878e-05 2024-04-25T22:02:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648252+0000", 2024-04-25T22:02:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8603000000000001e-05 2024-04-25T22:02:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648267+0000", 2024-04-25T22:02:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:02:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648846+0000", 2024-04-25T22:02:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057923000000000002 2024-04-25T22:02:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649027+0000", 2024-04-25T22:02:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181585 2024-04-25T22:02:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.656912+0000", 2024-04-25T22:02:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078844589999999999 2024-04-25T22:02:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.255 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 6 lcod 17'2)", 2024-04-25T22:02:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.531140065000002, 2024-04-25T22:02:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064966000000000004, 2024-04-25T22:02:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:02.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660144+0000", 2024-04-25T22:02:02.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1800000000000005e-07 2024-04-25T22:02:02.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660181+0000", 2024-04-25T22:02:02.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6408000000000001e-05 2024-04-25T22:02:02.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660197+0000", 2024-04-25T22:02:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6177000000000001e-05 2024-04-25T22:02:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660210+0000", 2024-04-25T22:02:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:02:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660556+0000", 2024-04-25T22:02:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034612899999999998 2024-04-25T22:02:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660793+0000", 2024-04-25T22:02:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023656799999999999 2024-04-25T22:02:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:18 3.1f e17/15 ondisk, result = 0)", 2024-04-25T22:02:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.530878291999997, 2024-04-25T22:02:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067878299999999997, 2024-04-25T22:02:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:02.259 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660406+0000", 2024-04-25T22:02:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2800000000000005e-07 2024-04-25T22:02:02.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660412+0000", 2024-04-25T22:02:02.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0399999999999998e-06 2024-04-25T22:02:02.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660429+0000", 2024-04-25T22:02:02.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7394e-05 2024-04-25T22:02:02.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660445+0000", 2024-04-25T22:02:02.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6069000000000001e-05 2024-04-25T22:02:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660757+0000", 2024-04-25T22:02:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031194300000000002 2024-04-25T22:02:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660776+0000", 2024-04-25T22:02:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8862999999999999e-05 2024-04-25T22:02:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661084+0000", 2024-04-25T22:02:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030754600000000001 2024-04-25T22:02:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-25T22:02:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.530814063999998, 2024-04-25T22:02:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080007600000000004, 2024-04-25T22:02:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:02.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:02.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660470+0000", 2024-04-25T22:02:02.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4499999999999996e-07 2024-04-25T22:02:02.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660475+0000", 2024-04-25T22:02:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-04-25T22:02:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660490+0000", 2024-04-25T22:02:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5274e-05 2024-04-25T22:02:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660501+0000", 2024-04-25T22:02:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0694e-05 2024-04-25T22:02:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661130+0000", 2024-04-25T22:02:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062887499999999999 2024-04-25T22:02:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661269+0000", 2024-04-25T22:02:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013955900000000001 2024-04-25T22:02:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:02:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 45.567082065000001, 2024-04-25T22:02:02.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037104880000000001, 2024-04-25T22:02:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624204+0000", 2024-04-25T22:02:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.757e-06 2024-04-25T22:02:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624233+0000", 2024-04-25T22:02:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9362000000000001e-05 2024-04-25T22:02:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624264+0000", 2024-04-25T22:02:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0843000000000003e-05 2024-04-25T22:02:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624280+0000", 2024-04-25T22:02:02.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5577e-05 2024-04-25T22:02:02.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624458+0000", 2024-04-25T22:02:02.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017821199999999999 2024-04-25T22:02:02.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:02.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624661+0000", 2024-04-25T22:02:02.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020283200000000001 2024-04-25T22:02:02.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:02.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624842+0000", 2024-04-25T22:02:02.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018115500000000001 2024-04-25T22:02:02.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:02.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.626271+0000", 2024-04-25T22:02:02.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001429416 2024-04-25T22:02:02.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:02.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627749+0000", 2024-04-25T22:02:02.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014778650000000001 2024-04-25T22:02:02.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627849+0000", 2024-04-25T22:02:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9261999999999999e-05 2024-04-25T22:02:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627912+0000", 2024-04-25T22:02:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3207000000000007e-05 2024-04-25T22:02:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.272 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-25T22:02:02.272 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:02.272 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.564384713999999, 2024-04-25T22:02:02.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029804620000000001, 2024-04-25T22:02:02.272 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.272 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.272 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.272 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:02.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626903+0000", 2024-04-25T22:02:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0029999999999996e-06 2024-04-25T22:02:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626921+0000", 2024-04-25T22:02:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8272999999999999e-05 2024-04-25T22:02:02.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626959+0000", 2024-04-25T22:02:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7843999999999999e-05 2024-04-25T22:02:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626977+0000", 2024-04-25T22:02:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7756000000000001e-05 2024-04-25T22:02:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627153+0000", 2024-04-25T22:02:02.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017643800000000001 2024-04-25T22:02:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627425+0000", 2024-04-25T22:02:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027207300000000001 2024-04-25T22:02:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627848+0000", 2024-04-25T22:02:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042297199999999997 2024-04-25T22:02:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629590+0000", 2024-04-25T22:02:02.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017416809999999999 2024-04-25T22:02:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629720+0000", 2024-04-25T22:02:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130526 2024-04-25T22:02:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629808+0000", 2024-04-25T22:02:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7449999999999998e-05 2024-04-25T22:02:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629879+0000", 2024-04-25T22:02:02.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1445999999999993e-05 2024-04-25T22:02:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4185.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-04-25T22:02:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.576276644, 2024-04-25T22:02:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0036257939999999999, 2024-04-25T22:02:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4185", 2024-04-25T22:02:02.277 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.44:0/2048337248", 2024-04-25T22:02:02.278 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2 2024-04-25T22:02:02.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.278 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:02.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:02.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:02.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:02.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:02.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:02.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615010+0000", 2024-04-25T22:02:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8059999999999999e-06 2024-04-25T22:02:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615023+0000", 2024-04-25T22:02:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3159999999999999e-05 2024-04-25T22:02:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615043+0000", 2024-04-25T22:02:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:02:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615059+0000", 2024-04-25T22:02:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5519000000000002e-05 2024-04-25T22:02:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615241+0000", 2024-04-25T22:02:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018207100000000001 2024-04-25T22:02:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:02:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615258+0000", 2024-04-25T22:02:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7278999999999998e-05 2024-04-25T22:02:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:02.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618429+0000", 2024-04-25T22:02:02.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003171213 2024-04-25T22:02:02.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:02.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:02.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:02.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618633+0000", 2024-04-25T22:02:02.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020343999999999999 2024-04-25T22:02:02.281 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.281 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.281 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.281 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:02.281 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:02.281 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:02.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:02.327 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:02.327+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:02.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:02.391+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:02.416 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:02.416 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:02.416 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:02:02.416 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:02.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:02.515 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:02.515+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:02.593 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:02.590+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:02.594 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:02.594 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:02.594 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:02:02.594 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:02:02.595 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:02.608 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:02.694 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:02.694+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:02.775 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:02.775 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:02.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:02.775 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:02.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.775 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:02.775 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:02.775 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.947692443000001, 2024-04-25T22:02:02.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:02.775 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.776 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.776 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.776 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:02.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:02.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:02.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:02.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:02.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:02.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:02.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:02.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:02.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:02.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:02.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:02.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:02.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:02.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:02.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:02.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:02.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:02.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:02.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.779 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.780 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:02.780 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:02.780 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.946961625, 2024-04-25T22:02:02.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:02.780 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.780 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:02.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:02.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:02.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:02.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:02.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:02.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:02.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:02.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:02.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:02.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:02.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:02.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:02.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:02.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:02.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:02.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:02.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:02.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:02.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.784 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.784 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:02.784 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:02.784 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.946295354, 2024-04-25T22:02:02.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:02.784 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.784 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.784 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:02.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:02.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:02.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:02.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:02.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:02.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:02.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:02.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:02.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:02.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:02.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:02.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:02.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:02.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:02.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:02.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:02.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:02.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:02.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.788 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.788 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:02.788 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:02.788 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.945395454, 2024-04-25T22:02:02.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:02.788 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.789 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.789 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:02.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:02.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:02.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:02.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:02.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:02.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:02.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:02.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:02.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:02.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:02.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:02.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:02.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:02.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:02.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:02.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:02.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:02.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:02.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.792 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.792 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:02.792 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:02.792 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.943359113, 2024-04-25T22:02:02.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:02.793 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.793 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.793 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:02.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:02.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:02.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:02.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:02.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:02.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:02.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:02.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:02.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:02.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:02.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:02.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:02.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:02.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:02.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:02.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:02.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:02.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:02.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.796 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.796 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:02.797 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:02.797 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.942895776, 2024-04-25T22:02:02.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:02.797 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.797 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.797 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:02.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:02.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:02.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:02.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:02.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:02.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:02.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:02.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:02.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:02.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:02.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:02.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:02.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:02.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:02.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:02.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:02.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:02.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:02.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.800 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.801 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:02.801 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:02.801 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.942028897, 2024-04-25T22:02:02.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:02.801 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.801 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.801 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:02.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:02.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:02.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:02.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:02.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:02.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:02.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:02.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:02.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:02.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:02.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:02.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:02.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:02.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:02.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:02.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:02.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:02.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:02.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.805 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.805 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:02.805 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:02.805 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.941577823000003, 2024-04-25T22:02:02.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:02.806 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.806 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.806 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:02.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:02.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:02.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:02.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:02.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:02.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:02.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:02.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:02.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:02.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:02.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:02.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:02.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:02.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:02.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:02.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:02.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:02.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:02.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.809 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.810 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:02.810 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:02.810 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.941128237000001, 2024-04-25T22:02:02.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:02.810 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.810 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.810 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:02.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:02.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:02.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:02.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:02.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:02.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:02.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:02.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:02.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:02.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:02.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:02.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:02.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:02.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:02.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:02.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:02.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:02.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:02.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.813 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.814 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:02.814 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:02.814 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.144471750000001, 2024-04-25T22:02:02.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:02.814 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.814 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.814 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:02.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:02.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:02.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:02.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:02.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:02.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:02.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:02.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:02.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:02.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:02.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:02.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:02.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:02.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:02.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:02.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:02.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:02.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:02.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:02.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:02.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:02.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:02.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:02.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:02.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:02.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:02.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:02.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.819 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.819 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:02.819 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:02.819 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.144347766999999, 2024-04-25T22:02:02.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:02.819 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.819 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.819 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.820 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:02.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:02.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:02.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:02.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:02.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:02.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:02.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:02.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:02.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:02.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:02.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:02.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:02.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:02.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:02.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:02.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:02.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:02.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:02.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:02.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:02.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:02.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:02.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:02.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:02.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:02.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:02.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:02.824 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.824 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.824 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.824 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:02.824 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:02.824 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.144273831, 2024-04-25T22:02:02.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:02.824 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.825 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.825 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.825 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:02.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:02.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:02.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:02.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:02.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:02.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:02.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:02.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:02.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:02.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:02.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:02.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:02.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:02.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:02.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:02.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:02.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:02.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:02.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:02.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:02.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:02.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:02.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:02.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:02.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:02.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:02.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:02.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.829 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.829 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:02.829 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:02.830 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.144157579000002, 2024-04-25T22:02:02.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:02.830 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.830 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.830 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.830 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:02.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:02.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:02.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:02.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:02.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:02.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:02.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:02.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:02.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:02.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:02.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:02.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:02.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:02.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:02.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:02.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:02.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:02.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:02.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:02.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:02.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:02.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:02.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:02.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:02.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:02.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:02.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:02.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.834 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.835 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:02.835 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:02.835 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.143994169999999, 2024-04-25T22:02:02.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:02.835 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.835 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.835 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:02.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:02.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:02.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:02.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:02.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:02.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:02.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:02.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:02.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:02.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:02.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:02.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:02.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:02.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:02.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:02.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:02.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:02.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:02.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:02.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:02.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:02.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:02.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:02.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:02.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:02.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:02.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:02.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.840 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.840 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:02.840 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:02.840 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.143891973999999, 2024-04-25T22:02:02.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:02.840 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.840 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.840 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.840 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:02.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:02.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:02.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:02.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:02.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:02.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:02.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:02.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:02.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:02.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:02.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:02.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:02.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:02.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:02.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:02.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:02.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:02.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:02.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:02.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:02.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:02.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:02.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:02.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:02.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:02.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:02.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:02.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.845 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.845 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:02.845 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:02.845 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.143813021, 2024-04-25T22:02:02.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:02.845 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.846 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.846 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:02.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:02.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:02.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:02.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:02.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:02.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:02.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:02.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:02.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:02.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:02.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:02.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:02.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:02.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:02.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:02.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:02.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:02.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:02.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:02.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:02.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:02.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:02.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:02.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:02.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:02.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:02.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:02.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.850 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.850 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:02.850 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:02.850 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.143747998000002, 2024-04-25T22:02:02.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:02.851 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.851 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.851 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:02.851 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:02.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:02.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:02.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:02.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:02.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:02.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:02.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:02.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:02.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:02.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:02.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:02.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:02.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:02.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:02.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:02.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.854 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.854 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:02.854 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:02.854 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.143669805999998, 2024-04-25T22:02:02.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:02.854 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.855 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:02.855 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:02.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:02.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:02.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:02.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:02.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:02.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:02.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:02.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:02.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:02.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:02.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:02.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:02.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:02.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:02.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:02.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.858 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.858 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:02.858 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:02.858 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.129023345999997, 2024-04-25T22:02:02.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:02.858 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.858 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.859 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:02.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:02.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:02.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:02.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:02.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:02.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:02.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:02.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:02.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:02.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:02.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:02.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:02.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:02.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:02.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:02.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:02.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:02.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:02.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.862 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.862 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:02.862 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:02.862 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.128863389999999, 2024-04-25T22:02:02.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:02.863 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:02.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:02.863 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:02.863 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:02.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:02.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:02.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:02.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:02.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:02.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:02.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:02.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:02.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:02.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:02.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:02.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:02.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:02.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:02.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:02.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:02.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:02.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:02.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:02.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:02.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:02.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:02.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:02.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:02.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:02.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:02.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:02.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:02.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:02.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:02.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:02.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.866 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:02.866 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:02.866 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:02.868 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:02.868 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:02.862+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:02.887 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:02:02.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:02.967+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:03.003 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:03.003 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:03.004 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:03.004 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:03.018 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:03.031 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:02:03.070 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:03.067+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:03.135 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:03.135 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:03.135 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:03.136 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:03.136 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:03.150 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:03.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:03.171+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:03.172 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:03.173 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:03.193 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:03.193 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:03.216 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:03.216 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:03.269 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:03.269 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:03.272 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:03.271+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:03.283 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:03.373 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:03.370+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:03.415 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:03.415 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:03.429 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:03.474 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:03.471+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:03.545 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:03.545 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:03.559 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:03.575 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:03.570+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:03.676 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:03.676 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:03.677 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:03.675+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:03.689 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:03.777 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:03.775+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:03.821 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:03.821 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:03.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:03.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:03.875+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:03.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:03.979+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:04.001 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:04.001 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:04.015 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:04.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:04.079+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:04.137 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:04.137 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:04.152 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:04.197 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:04.194+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:04.221 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-25T22:02:04.283 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:04.279+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:04.288 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:04.288 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:04.303 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:04.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:04.383+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:04.472 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:04.472 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:04.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:04.483+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:04.486 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:04.585 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:04.583+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:04.613 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:04.614 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:04.628 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:04.686 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:04.682+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:04.760 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:04.760 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:04.775 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:04.786 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:04.786+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:04.887 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:04.882+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:04.892 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:04.893 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:04.906 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:04.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:04.987+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:05.030 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:05.031 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:05.044 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:05.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:05.087+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:05.174 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:05.175 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:05.190 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:05.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:05.187+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:05.235 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:02:05.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:05.291+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:05.309 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:05.309 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:05.324 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:05.392 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:05.390+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:05.395 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:05.395 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:05.419 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:05.419 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:05.442 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:05.442 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:05.451 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.622629472, 2024-04-25T22:02:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.621898653999999, 2024-04-25T22:02:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.621232382999999, 2024-04-25T22:02:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.620332482999999, 2024-04-25T22:02:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.618296141999998, 2024-04-25T22:02:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.617832804999999, 2024-04-25T22:02:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.616965925999999, 2024-04-25T22:02:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.616514852000002, 2024-04-25T22:02:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.616065266, 2024-04-25T22:02:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.819408779, 2024-04-25T22:02:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.819284795999998, 2024-04-25T22:02:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.819210859999998, 2024-04-25T22:02:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.819094608, 2024-04-25T22:02:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.818931198999998, 2024-04-25T22:02:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.818829002999998, 2024-04-25T22:02:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.818750049999998, 2024-04-25T22:02:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.818685027000001, 2024-04-25T22:02:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.818606834999997, 2024-04-25T22:02:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.803960375000003, 2024-04-25T22:02:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.803800418999998, 2024-04-25T22:02:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:05.563 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:05.565 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:05.566 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:05.562+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:05.666 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:05.663+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:05.699 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:05.700 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:05.700 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:05.700 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:05.714 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:05.766 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:05.762+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:05.840 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:05.841 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:05.841 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:05.841 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:05.841 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:05.855 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:05.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:05.867+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:05.968 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:05.967+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:06.016 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:06.017 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:06.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:06.017 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:06.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.017 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:06.017 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:06.017 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 60.020395827999998, 2024-04-25T22:02:06.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:02:06.018 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.018 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.018 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.018 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:06.018 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:06.019 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:06.019 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:02:06.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.019 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:06.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:06.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:02:06.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:02:06.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:02:06.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:02:06.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:02:06.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:02:06.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:02:06.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:02:06.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:02:06.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:02:06.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:02:06.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:02:06.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:02:06.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:02:06.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:02:06.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:02:06.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:02:06.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:02:06.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:02:06.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:02:06.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:02:06.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:02:06.027 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.027 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.027 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.027 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:06.027 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:06.027 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 59.838332755000003, 2024-04-25T22:02:06.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:02:06.027 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.027 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.027 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.027 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:06.027 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:06.027 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:06.027 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:02:06.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.028 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:06.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:06.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:02:06.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:02:06.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:02:06.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:02:06.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:02:06.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:02:06.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:02:06.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:02:06.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:02:06.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:02:06.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:02:06.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:02:06.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:02:06.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:02:06.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:02:06.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:02:06.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:02:06.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:02:06.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:02:06.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:02:06.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:02:06.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:02:06.032 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.032 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.032 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.032 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:06.032 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:06.032 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 59.838288474999999, 2024-04-25T22:02:06.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:02:06.032 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.033 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.033 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.033 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:06.033 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:06.033 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:06.033 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:02:06.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.033 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:06.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:06.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:02:06.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:02:06.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:02:06.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:02:06.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:02:06.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:02:06.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:02:06.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:02:06.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:02:06.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:02:06.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:02:06.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:02:06.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:02:06.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:02:06.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:02:06.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:02:06.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:02:06.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:02:06.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:02:06.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:02:06.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:02:06.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:02:06.037 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.038 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.038 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.038 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:06.038 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:06.038 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 59.838231950000001, 2024-04-25T22:02:06.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:06.038 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.038 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.038 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.038 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:06.038 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:06.038 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:06.039 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:06.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.039 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:06.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:06.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:06.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:06.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:06.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:06.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:06.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:06.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:06.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:06.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:06.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:06.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:06.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:06.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:06.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:06.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:06.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:06.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:06.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:06.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:06.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:06.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:06.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:06.043 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.043 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.043 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.044 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:06.044 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:06.044 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 59.838036707999997, 2024-04-25T22:02:06.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:06.044 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.044 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.044 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.044 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:06.044 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:06.044 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:06.044 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:06.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.044 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:06.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:06.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:06.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:06.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:06.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:06.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:06.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:06.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:06.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:06.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:06.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:06.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:06.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:06.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:06.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:06.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:06.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:06.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:06.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:06.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:06.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:06.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:06.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:06.049 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.049 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.049 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.049 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:06.049 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:06.049 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 59.837974414999998, 2024-04-25T22:02:06.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:06.049 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.049 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.050 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.050 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:06.050 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:06.050 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:06.050 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:06.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.050 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:06.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:06.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:06.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:06.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:06.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:06.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:06.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:06.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:06.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:06.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:06.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:06.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:06.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:06.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:06.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:06.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:06.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:06.054 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.054 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.054 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.055 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:06.055 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:06.055 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 59.837914198999997, 2024-04-25T22:02:06.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:06.055 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.055 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.055 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.055 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:06.055 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:06.055 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:06.055 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:06.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.055 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:06.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:06.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:06.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:06.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:06.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:06.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:06.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:06.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:06.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:06.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:06.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:06.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:06.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:06.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:06.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:06.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:06.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:06.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:06.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:06.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:06.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:06.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:06.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:06.060 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.060 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.060 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.060 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:06.060 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:06.060 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 59.837724686999998, 2024-04-25T22:02:06.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:06.060 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.060 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.061 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.061 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:06.061 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:06.061 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:06.061 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:06.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.061 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:06.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 59.646386853000003, 2024-04-25T22:02:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:02:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:02:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:02:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:02:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:02:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:02:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:02:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:02:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:02:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:02:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:02:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:02:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:02:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:02:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:02:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:02:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:02:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:02:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:02:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:02:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:02:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:02:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:02:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:02:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 59.646348476, 2024-04-25T22:02:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:02:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:02:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:02:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:02:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:02:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:02:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:02:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:02:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:02:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:02:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:02:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:02:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:02:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:02:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:02:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:02:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:02:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:02:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:02:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:02:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:02:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:02:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:02:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:02:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 59.646297216999997, 2024-04-25T22:02:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:02:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:02:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:02:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:02:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:02:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:02:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:02:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:02:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:02:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:02:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:02:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:02:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:02:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:02:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:02:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:02:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:02:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:02:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:02:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:02:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:02:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:02:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:02:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:02:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 59.646148568000001, 2024-04-25T22:02:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:02:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:02:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:02:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:02:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:02:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:02:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:02:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:02:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:02:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:02:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:02:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:02:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:02:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:02:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:02:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:02:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:02:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:02:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:02:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:02:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:02:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:02:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:02:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:02:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 59.646106418000002, 2024-04-25T22:02:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:02:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:02:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:02:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:02:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:02:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:02:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:02:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:02:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:02:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:02:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:02:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:02:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:02:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:02:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:02:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:02:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:02:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:02:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:02:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:02:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:02:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:02:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:02:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:02:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 59.646068565, 2024-04-25T22:02:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 59.64585924, 2024-04-25T22:02:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.379607968000002, 2024-04-25T22:02:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:02:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:02:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:02:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:02:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:02:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:02:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:02:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:02:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:02:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:02:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:02:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:02:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:02:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:02:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:02:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:02:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:02:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:02:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:02:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:02:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:02:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:02:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.379574128000002, 2024-04-25T22:02:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:02:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:02:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:02:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:02:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:02:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:02:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:02:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:02:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:02:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:02:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:02:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:02:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:02:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:02:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:02:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:02:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:02:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:02:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:02:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:02:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:02:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.379522432000002, 2024-04-25T22:02:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:02:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:02:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:02:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:02:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:02:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:02:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:02:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:02:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:02:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:02:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:02:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:02:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:02:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:02:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:02:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:02:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:02:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:02:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:02:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:02:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:02:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:02:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:02:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.379377980000001, 2024-04-25T22:02:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:02:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:02:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:02:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:02:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:02:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:02:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:02:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:02:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:02:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:02:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:02:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:02:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:02:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:02:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:02:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:02:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:02:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:02:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:02:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:02:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:02:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:02:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:02:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.379321259999998, 2024-04-25T22:02:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:02:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:02:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:02:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:02:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:02:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:02:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:02:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:02:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:02:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:02:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:02:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:02:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:02:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:02:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:02:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:02:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:02:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:02:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:02:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:02:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:02:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:02:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:02:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.131 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:06.131 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:06.131 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:06.132 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:06.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:06.131+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:06.233 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:06.230+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:06.245 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:02:06.265 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:06.265 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:06.265 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:02:06.265 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:06.281 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:06.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:06.331+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:06.403 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:02:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:02:06.403 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:06.417 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:06.436 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:06.435+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:06.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:06.535+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:06.585 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:06.585 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:02:06.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:02:06.586 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:02:06.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.586 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 4 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:27 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:02:06.586 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:06.586 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.946710416000002, 2024-04-25T22:02:06.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013281644, 2024-04-25T22:02:06.586 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.586 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.586 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:06.586 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:06.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:06.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637801+0000", 2024-04-25T22:02:06.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1299999999999998e-07 2024-04-25T22:02:06.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637828+0000", 2024-04-25T22:02:06.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6953000000000001e-05 2024-04-25T22:02:06.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637873+0000", 2024-04-25T22:02:06.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4676999999999999e-05 2024-04-25T22:02:06.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637917+0000", 2024-04-25T22:02:06.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4815999999999999e-05 2024-04-25T22:02:06.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644220+0000", 2024-04-25T22:02:06.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063021049999999997 2024-04-25T22:02:06.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651082+0000", 2024-04-25T22:02:06.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068621799999999998 2024-04-25T22:02:06.589 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.589 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.589 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.589 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:15 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:06.589 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:06.589 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.941302804000003, 2024-04-25T22:02:06.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010973732, 2024-04-25T22:02:06.589 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.590 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.590 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.590 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:06.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:06.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643209+0000", 2024-04-25T22:02:06.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.003e-06 2024-04-25T22:02:06.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643230+0000", 2024-04-25T22:02:06.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0815999999999999e-05 2024-04-25T22:02:06.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643252+0000", 2024-04-25T22:02:06.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2586999999999999e-05 2024-04-25T22:02:06.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643271+0000", 2024-04-25T22:02:06.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8493000000000001e-05 2024-04-25T22:02:06.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644387+0000", 2024-04-25T22:02:06.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011160250000000001 2024-04-25T22:02:06.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:06.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644434+0000", 2024-04-25T22:02:06.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:02:06.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:06.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654103+0000", 2024-04-25T22:02:06.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096691360000000001 2024-04-25T22:02:06.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654181+0000", 2024-04-25T22:02:06.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8546000000000003e-05 2024-04-25T22:02:06.593 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.593 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.593 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.593 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:06.593 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:06.593 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.941202447999999, 2024-04-25T22:02:06.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088132450000000008, 2024-04-25T22:02:06.594 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.594 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.594 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:06.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:06.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643309+0000", 2024-04-25T22:02:06.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9600000000000008e-07 2024-04-25T22:02:06.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643339+0000", 2024-04-25T22:02:06.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9467000000000001e-05 2024-04-25T22:02:06.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644245+0000", 2024-04-25T22:02:06.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090648200000000001 2024-04-25T22:02:06.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644268+0000", 2024-04-25T22:02:06.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3017e-05 2024-04-25T22:02:06.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647517+0000", 2024-04-25T22:02:06.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032491680000000002 2024-04-25T22:02:06.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:06.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647561+0000", 2024-04-25T22:02:06.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3630000000000001e-05 2024-04-25T22:02:06.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652041+0000", 2024-04-25T22:02:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044804529999999997 2024-04-25T22:02:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652121+0000", 2024-04-25T22:02:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0031999999999995e-05 2024-04-25T22:02:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:34 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:06.598 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.939113820999999, 2024-04-25T22:02:06.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089225940000000007, 2024-04-25T22:02:06.598 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.598 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.598 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.598 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:06.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:06.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645398+0000", 2024-04-25T22:02:06.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4360000000000001e-06 2024-04-25T22:02:06.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645412+0000", 2024-04-25T22:02:06.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4283e-05 2024-04-25T22:02:06.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645434+0000", 2024-04-25T22:02:06.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1237e-05 2024-04-25T22:02:06.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645459+0000", 2024-04-25T22:02:06.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5675999999999999e-05 2024-04-25T22:02:06.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646081+0000", 2024-04-25T22:02:06.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062128900000000002 2024-04-25T22:02:06.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:06.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646131+0000", 2024-04-25T22:02:06.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0322999999999999e-05 2024-04-25T22:02:06.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:06.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654185+0000", 2024-04-25T22:02:06.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080542749999999996 2024-04-25T22:02:06.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654319+0000", 2024-04-25T22:02:06.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013407499999999999 2024-04-25T22:02:06.601 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.601 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.601 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.602 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:19 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:06.602 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:06.602 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.939012312000003, 2024-04-25T22:02:06.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076631340000000003, 2024-04-25T22:02:06.602 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.602 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.602 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:06.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645499+0000", 2024-04-25T22:02:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4300000000000001e-07 2024-04-25T22:02:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645509+0000", 2024-04-25T22:02:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0244000000000001e-05 2024-04-25T22:02:06.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645523+0000", 2024-04-25T22:02:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3315999999999999e-05 2024-04-25T22:02:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645531+0000", 2024-04-25T22:02:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.123e-06 2024-04-25T22:02:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648260+0000", 2024-04-25T22:02:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027289789999999999 2024-04-25T22:02:06.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:06.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648307+0000", 2024-04-25T22:02:06.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6969999999999999e-05 2024-04-25T22:02:06.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:06.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653039+0000", 2024-04-25T22:02:06.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047322299999999996 2024-04-25T22:02:06.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653161+0000", 2024-04-25T22:02:06.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012232899999999999 2024-04-25T22:02:06.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.605 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.606 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.606 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:06.606 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:06.606 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.937034650999998, 2024-04-25T22:02:06.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01271303, 2024-04-25T22:02:06.606 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.606 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.606 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.606 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:06.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:06.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647479+0000", 2024-04-25T22:02:06.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.286e-06 2024-04-25T22:02:06.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647494+0000", 2024-04-25T22:02:06.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.521e-05 2024-04-25T22:02:06.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647525+0000", 2024-04-25T22:02:06.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0403999999999999e-05 2024-04-25T22:02:06.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647544+0000", 2024-04-25T22:02:06.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8743e-05 2024-04-25T22:02:06.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647895+0000", 2024-04-25T22:02:06.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035099699999999997 2024-04-25T22:02:06.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:06.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648202+0000", 2024-04-25T22:02:06.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030758499999999998 2024-04-25T22:02:06.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:06.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648496+0000", 2024-04-25T22:02:06.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029370699999999999 2024-04-25T22:02:06.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:06.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654605+0000", 2024-04-25T22:02:06.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061095999999999998 2024-04-25T22:02:06.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.659959+0000", 2024-04-25T22:02:06.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053531680000000002 2024-04-25T22:02:06.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:06.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660078+0000", 2024-04-25T22:02:06.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011981600000000001 2024-04-25T22:02:06.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660189+0000", 2024-04-25T22:02:06.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011051400000000001 2024-04-25T22:02:06.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.611 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.611 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:06.611 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:06.611 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.936910558999998, 2024-04-25T22:02:06.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013053006000000001, 2024-04-25T22:02:06.611 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.611 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.611 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.611 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:06.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:06.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647602+0000", 2024-04-25T22:02:06.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.604e-06 2024-04-25T22:02:06.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647611+0000", 2024-04-25T22:02:06.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5689999999999994e-06 2024-04-25T22:02:06.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647634+0000", 2024-04-25T22:02:06.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3227e-05 2024-04-25T22:02:06.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647660+0000", 2024-04-25T22:02:06.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5829999999999998e-05 2024-04-25T22:02:06.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649544+0000", 2024-04-25T22:02:06.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001884066 2024-04-25T22:02:06.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:06.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649783+0000", 2024-04-25T22:02:06.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238411 2024-04-25T22:02:06.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:06.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.650794+0000", 2024-04-25T22:02:06.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010109920000000001 2024-04-25T22:02:06.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:06.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654714+0000", 2024-04-25T22:02:06.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039202170000000001 2024-04-25T22:02:06.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660403+0000", 2024-04-25T22:02:06.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056895940000000001 2024-04-25T22:02:06.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:06.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660551+0000", 2024-04-25T22:02:06.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014717899999999999 2024-04-25T22:02:06.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660653+0000", 2024-04-25T22:02:06.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102317 2024-04-25T22:02:06.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.616 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.616 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:17 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:06.616 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:06.616 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.936826379000003, 2024-04-25T22:02:06.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010101435000000001, 2024-04-25T22:02:06.616 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.616 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.617 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.617 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:06.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:06.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647686+0000", 2024-04-25T22:02:06.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-04-25T22:02:06.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647693+0000", 2024-04-25T22:02:06.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7330000000000003e-06 2024-04-25T22:02:06.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647711+0000", 2024-04-25T22:02:06.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7436e-05 2024-04-25T22:02:06.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647727+0000", 2024-04-25T22:02:06.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6232999999999999e-05 2024-04-25T22:02:06.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649249+0000", 2024-04-25T22:02:06.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015219890000000001 2024-04-25T22:02:06.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:06.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649533+0000", 2024-04-25T22:02:06.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028391799999999997 2024-04-25T22:02:06.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649841+0000", 2024-04-25T22:02:06.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030853400000000001 2024-04-25T22:02:06.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:06.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654622+0000", 2024-04-25T22:02:06.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047809630000000001 2024-04-25T22:02:06.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657616+0000", 2024-04-25T22:02:06.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029938769999999998 2024-04-25T22:02:06.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:06.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657724+0000", 2024-04-25T22:02:06.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108109 2024-04-25T22:02:06.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657786+0000", 2024-04-25T22:02:06.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1196000000000002e-05 2024-04-25T22:02:06.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.621 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.621 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:06.621 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:06.621 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.936638051000003, 2024-04-25T22:02:06.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010260877999999999, 2024-04-25T22:02:06.621 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.622 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.622 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.622 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:06.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:06.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647874+0000", 2024-04-25T22:02:06.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:02:06.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647884+0000", 2024-04-25T22:02:06.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.013e-05 2024-04-25T22:02:06.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647908+0000", 2024-04-25T22:02:06.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3592999999999999e-05 2024-04-25T22:02:06.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647926+0000", 2024-04-25T22:02:06.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8176999999999999e-05 2024-04-25T22:02:06.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651480+0000", 2024-04-25T22:02:06.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035540160000000001 2024-04-25T22:02:06.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:06.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651690+0000", 2024-04-25T22:02:06.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210249 2024-04-25T22:02:06.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:06.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651986+0000", 2024-04-25T22:02:06.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000296001 2024-04-25T22:02:06.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:06.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655696+0000", 2024-04-25T22:02:06.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037098410000000002 2024-04-25T22:02:06.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657896+0000", 2024-04-25T22:02:06.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022004630000000002 2024-04-25T22:02:06.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:06.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658035+0000", 2024-04-25T22:02:06.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013831499999999999 2024-04-25T22:02:06.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658133+0000", 2024-04-25T22:02:06.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8553000000000003e-05 2024-04-25T22:02:06.626 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.626 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.626 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.626 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:18 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:06.626 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:06.626 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.936559170999999, 2024-04-25T22:02:06.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013108712, 2024-04-25T22:02:06.627 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.627 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.627 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.627 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:06.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:06.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647953+0000", 2024-04-25T22:02:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.697e-06 2024-04-25T22:02:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647963+0000", 2024-04-25T22:02:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9259999999999995e-06 2024-04-25T22:02:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647982+0000", 2024-04-25T22:02:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-04-25T22:02:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648008+0000", 2024-04-25T22:02:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5956e-05 2024-04-25T22:02:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651686+0000", 2024-04-25T22:02:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678073 2024-04-25T22:02:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652023+0000", 2024-04-25T22:02:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033739399999999998 2024-04-25T22:02:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652348+0000", 2024-04-25T22:02:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032475000000000001 2024-04-25T22:02:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655883+0000", 2024-04-25T22:02:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035353030000000001 2024-04-25T22:02:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660791+0000", 2024-04-25T22:02:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049075330000000004 2024-04-25T22:02:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660930+0000", 2024-04-25T22:02:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000139856 2024-04-25T22:02:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661060+0000", 2024-04-25T22:02:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000129651 2024-04-25T22:02:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:06.632 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:06.632 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.936482279000003, 2024-04-25T22:02:06.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012451034, 2024-04-25T22:02:06.632 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.632 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.632 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.632 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:06.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:06.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648030+0000", 2024-04-25T22:02:06.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-04-25T22:02:06.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648036+0000", 2024-04-25T22:02:06.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8059999999999997e-06 2024-04-25T22:02:06.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648054+0000", 2024-04-25T22:02:06.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7744000000000002e-05 2024-04-25T22:02:06.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648070+0000", 2024-04-25T22:02:06.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-04-25T22:02:06.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648875+0000", 2024-04-25T22:02:06.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080444000000000002 2024-04-25T22:02:06.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:06.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649078+0000", 2024-04-25T22:02:06.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020391499999999999 2024-04-25T22:02:06.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:06.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649674+0000", 2024-04-25T22:02:06.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00059555299999999997 2024-04-25T22:02:06.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:06.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653185+0000", 2024-04-25T22:02:06.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035113459999999998 2024-04-25T22:02:06.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660251+0000", 2024-04-25T22:02:06.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070661350000000003 2024-04-25T22:02:06.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:06.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660382+0000", 2024-04-25T22:02:06.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013095899999999999 2024-04-25T22:02:06.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660479+0000", 2024-04-25T22:02:06.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6852e-05 2024-04-25T22:02:06.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.636 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.637 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:25 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:06.637 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:06.637 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.936416465999997, 2024-04-25T22:02:06.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012691025999999999, 2024-04-25T22:02:06.637 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.637 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:06.637 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:06.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:06.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648095+0000", 2024-04-25T22:02:06.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.424e-06 2024-04-25T22:02:06.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648102+0000", 2024-04-25T22:02:06.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2099999999999998e-06 2024-04-25T22:02:06.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648122+0000", 2024-04-25T22:02:06.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0242999999999999e-05 2024-04-25T22:02:06.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648138+0000", 2024-04-25T22:02:06.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6192999999999999e-05 2024-04-25T22:02:06.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651461+0000", 2024-04-25T22:02:06.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033225709999999999 2024-04-25T22:02:06.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:06.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651776+0000", 2024-04-25T22:02:06.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031567500000000002 2024-04-25T22:02:06.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660785+0000", 2024-04-25T22:02:06.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090087099999999996 2024-04-25T22:02:06.640 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.640 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.640 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.640 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:06.640 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:06.640 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.93635398, 2024-04-25T22:02:06.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013102702000000001, 2024-04-25T22:02:06.641 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.641 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.641 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:06.641 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:06.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:06.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648158+0000", 2024-04-25T22:02:06.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2839999999999999e-06 2024-04-25T22:02:06.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648163+0000", 2024-04-25T22:02:06.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-04-25T22:02:06.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648181+0000", 2024-04-25T22:02:06.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8484000000000001e-05 2024-04-25T22:02:06.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648196+0000", 2024-04-25T22:02:06.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4496e-05 2024-04-25T22:02:06.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653737+0000", 2024-04-25T22:02:06.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055414009999999996 2024-04-25T22:02:06.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:06.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653972+0000", 2024-04-25T22:02:06.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000234732 2024-04-25T22:02:06.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661259+0000", 2024-04-25T22:02:06.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072872689999999999 2024-04-25T22:02:06.644 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.644 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.644 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.644 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:06.644 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:06.644 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.936297160000002, 2024-04-25T22:02:06.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086984829999999999, 2024-04-25T22:02:06.644 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.644 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.645 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:06.645 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:06.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:06.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648214+0000", 2024-04-25T22:02:06.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-04-25T22:02:06.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648233+0000", 2024-04-25T22:02:06.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.878e-05 2024-04-25T22:02:06.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648252+0000", 2024-04-25T22:02:06.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8603000000000001e-05 2024-04-25T22:02:06.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648267+0000", 2024-04-25T22:02:06.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:02:06.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648846+0000", 2024-04-25T22:02:06.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057923000000000002 2024-04-25T22:02:06.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:06.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649027+0000", 2024-04-25T22:02:06.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181585 2024-04-25T22:02:06.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.656912+0000", 2024-04-25T22:02:06.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078844589999999999 2024-04-25T22:02:06.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.648 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.648 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 6 lcod 17'2)", 2024-04-25T22:02:06.648 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:06.648 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.924367244000003, 2024-04-25T22:02:06.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064966000000000004, 2024-04-25T22:02:06.648 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.648 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.648 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:06.648 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:06.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:06.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660144+0000", 2024-04-25T22:02:06.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1800000000000005e-07 2024-04-25T22:02:06.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660181+0000", 2024-04-25T22:02:06.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6408000000000001e-05 2024-04-25T22:02:06.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660197+0000", 2024-04-25T22:02:06.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6177000000000001e-05 2024-04-25T22:02:06.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660210+0000", 2024-04-25T22:02:06.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:02:06.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660556+0000", 2024-04-25T22:02:06.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034612899999999998 2024-04-25T22:02:06.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660793+0000", 2024-04-25T22:02:06.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023656799999999999 2024-04-25T22:02:06.651 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.651 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.651 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.651 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:18 3.1f e17/15 ondisk, result = 0)", 2024-04-25T22:02:06.651 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:06.651 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.924105470999997, 2024-04-25T22:02:06.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067878299999999997, 2024-04-25T22:02:06.652 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.652 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.652 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:06.652 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:06.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:06.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660406+0000", 2024-04-25T22:02:06.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2800000000000005e-07 2024-04-25T22:02:06.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660412+0000", 2024-04-25T22:02:06.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0399999999999998e-06 2024-04-25T22:02:06.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660429+0000", 2024-04-25T22:02:06.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7394e-05 2024-04-25T22:02:06.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660445+0000", 2024-04-25T22:02:06.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6069000000000001e-05 2024-04-25T22:02:06.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660757+0000", 2024-04-25T22:02:06.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031194300000000002 2024-04-25T22:02:06.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:06.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660776+0000", 2024-04-25T22:02:06.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8862999999999999e-05 2024-04-25T22:02:06.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661084+0000", 2024-04-25T22:02:06.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030754600000000001 2024-04-25T22:02:06.655 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.655 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.655 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.655 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-25T22:02:06.655 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:06.655 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.924041242999998, 2024-04-25T22:02:06.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080007600000000004, 2024-04-25T22:02:06.655 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.655 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:06.655 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:06.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:06.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660470+0000", 2024-04-25T22:02:06.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4499999999999996e-07 2024-04-25T22:02:06.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660475+0000", 2024-04-25T22:02:06.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-04-25T22:02:06.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660490+0000", 2024-04-25T22:02:06.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5274e-05 2024-04-25T22:02:06.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660501+0000", 2024-04-25T22:02:06.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0694e-05 2024-04-25T22:02:06.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661130+0000", 2024-04-25T22:02:06.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062887499999999999 2024-04-25T22:02:06.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661269+0000", 2024-04-25T22:02:06.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013955900000000001 2024-04-25T22:02:06.658 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.658 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.658 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.658 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:02:06.659 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:06.659 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 49.960309244000001, 2024-04-25T22:02:06.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037104880000000001, 2024-04-25T22:02:06.659 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.659 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.659 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.659 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:06.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:06.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624204+0000", 2024-04-25T22:02:06.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.757e-06 2024-04-25T22:02:06.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624233+0000", 2024-04-25T22:02:06.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9362000000000001e-05 2024-04-25T22:02:06.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624264+0000", 2024-04-25T22:02:06.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0843000000000003e-05 2024-04-25T22:02:06.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624280+0000", 2024-04-25T22:02:06.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5577e-05 2024-04-25T22:02:06.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624458+0000", 2024-04-25T22:02:06.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017821199999999999 2024-04-25T22:02:06.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:06.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624661+0000", 2024-04-25T22:02:06.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020283200000000001 2024-04-25T22:02:06.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:06.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624842+0000", 2024-04-25T22:02:06.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018115500000000001 2024-04-25T22:02:06.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:06.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.626271+0000", 2024-04-25T22:02:06.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001429416 2024-04-25T22:02:06.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627749+0000", 2024-04-25T22:02:06.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014778650000000001 2024-04-25T22:02:06.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:06.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627849+0000", 2024-04-25T22:02:06.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9261999999999999e-05 2024-04-25T22:02:06.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627912+0000", 2024-04-25T22:02:06.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3207000000000007e-05 2024-04-25T22:02:06.663 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.663 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.663 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.664 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-25T22:02:06.664 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:06.664 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.957611892999999, 2024-04-25T22:02:06.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029804620000000001, 2024-04-25T22:02:06.664 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.664 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.664 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:06.664 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:06.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:06.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626903+0000", 2024-04-25T22:02:06.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0029999999999996e-06 2024-04-25T22:02:06.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626921+0000", 2024-04-25T22:02:06.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8272999999999999e-05 2024-04-25T22:02:06.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626959+0000", 2024-04-25T22:02:06.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7843999999999999e-05 2024-04-25T22:02:06.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626977+0000", 2024-04-25T22:02:06.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7756000000000001e-05 2024-04-25T22:02:06.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627153+0000", 2024-04-25T22:02:06.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017643800000000001 2024-04-25T22:02:06.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:06.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627425+0000", 2024-04-25T22:02:06.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027207300000000001 2024-04-25T22:02:06.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:06.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627848+0000", 2024-04-25T22:02:06.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042297199999999997 2024-04-25T22:02:06.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:06.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629590+0000", 2024-04-25T22:02:06.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017416809999999999 2024-04-25T22:02:06.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:06.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629720+0000", 2024-04-25T22:02:06.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130526 2024-04-25T22:02:06.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:06.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629808+0000", 2024-04-25T22:02:06.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7449999999999998e-05 2024-04-25T22:02:06.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629879+0000", 2024-04-25T22:02:06.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1445999999999993e-05 2024-04-25T22:02:06.668 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.668 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.668 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.669 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4185.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-04-25T22:02:06.669 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:06.669 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.9695038230000002, 2024-04-25T22:02:06.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0036257939999999999, 2024-04-25T22:02:06.669 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:06.669 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:06.669 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:06.669 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:06.669 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4185", 2024-04-25T22:02:06.669 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.44:0/2048337248", 2024-04-25T22:02:06.669 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2 2024-04-25T22:02:06.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.669 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:06.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:06.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:06.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:06.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:06.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:06.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:06.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615010+0000", 2024-04-25T22:02:06.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8059999999999999e-06 2024-04-25T22:02:06.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:06.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615023+0000", 2024-04-25T22:02:06.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3159999999999999e-05 2024-04-25T22:02:06.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:06.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615043+0000", 2024-04-25T22:02:06.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:02:06.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:06.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615059+0000", 2024-04-25T22:02:06.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5519000000000002e-05 2024-04-25T22:02:06.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615241+0000", 2024-04-25T22:02:06.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018207100000000001 2024-04-25T22:02:06.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:02:06.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615258+0000", 2024-04-25T22:02:06.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7278999999999998e-05 2024-04-25T22:02:06.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:06.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618429+0000", 2024-04-25T22:02:06.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003171213 2024-04-25T22:02:06.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:06.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:06.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:06.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618633+0000", 2024-04-25T22:02:06.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020343999999999999 2024-04-25T22:02:06.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.673 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:06.673 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:06.673 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:06.674 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:06.675 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:06.671+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:06.776 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:06.775+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:06.806 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:06.806 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:06.807 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:02:06.807 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:06.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:06.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:06.875+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:06.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:06.975+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:06.989 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:06.989 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:06.989 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:02:06.989 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:02:06.989 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:07.002 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:07.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:07.079+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:07.114 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:02:07.114 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:02:07.114 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-04-25T22:02:07.114 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-04-25T22:02:07.127 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:07.128 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:07.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:07.128 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:07.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.128 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:07.128 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:07.128 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.299315034000003, 2024-04-25T22:02:07.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:07.128 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.128 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.128 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.128 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:07.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:07.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:07.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:07.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:07.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:07.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:07.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:07.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:07.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:07.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:07.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:07.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:07.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:07.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:07.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:07.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:07.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:07.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:07.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.132 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.132 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:07.132 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:07.132 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.298584216000002, 2024-04-25T22:02:07.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:07.132 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.133 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.133 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.133 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:07.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:07.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:07.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:07.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:07.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:07.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:07.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:07.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:07.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:07.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:07.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:07.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:07.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:07.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:07.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:07.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:07.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:07.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:07.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.136 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.136 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:07.137 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:07.137 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.297917945000002, 2024-04-25T22:02:07.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:07.137 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.137 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.137 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.137 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:07.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:07.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:07.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:07.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:07.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:07.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:07.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:07.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:07.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:07.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:07.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:07.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:07.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:07.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:07.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:07.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:07.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:07.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:07.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.140 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.141 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:07.141 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:07.141 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.297018045000002, 2024-04-25T22:02:07.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:07.141 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.141 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.141 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.141 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:07.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:07.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:07.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:07.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:07.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:07.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:07.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:07.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:07.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:07.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:07.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:07.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:07.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:07.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:07.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:07.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:07.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:07.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:07.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.145 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.145 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:07.145 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:07.145 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.294981704000001, 2024-04-25T22:02:07.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:07.145 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.145 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.146 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.146 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:07.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:07.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:07.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:07.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:07.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:07.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:07.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:07.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:07.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:07.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:07.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:07.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:07.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:07.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:07.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:07.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:07.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:07.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:07.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.149 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.149 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:07.149 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:07.149 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.294518367000002, 2024-04-25T22:02:07.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:07.150 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.150 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.150 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.150 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:07.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:07.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:07.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:07.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:07.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:07.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:07.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:07.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:07.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:07.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:07.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:07.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:07.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:07.153 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.153 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.153 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.154 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:07.154 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:07.154 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.293651488000002, 2024-04-25T22:02:07.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:07.154 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.154 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.154 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.154 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:07.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:07.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:07.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:07.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:07.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:07.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:07.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:07.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:07.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:07.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:07.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:07.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:07.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:07.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:07.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:07.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:07.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:07.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:07.158 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.158 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.158 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.158 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:07.158 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:07.158 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.293200413999998, 2024-04-25T22:02:07.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:07.158 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.158 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.158 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.158 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:07.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:07.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:07.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:07.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:07.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:07.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:07.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:07.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:07.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:07.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:07.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:07.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:07.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:07.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:07.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:07.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:07.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:07.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:07.162 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.162 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.162 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.162 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:07.162 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:07.162 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.292750828000003, 2024-04-25T22:02:07.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:07.162 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.163 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.163 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:07.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:07.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:07.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:07.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:07.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:07.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:07.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:07.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:07.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:07.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:07.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:07.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:07.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:07.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:07.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:07.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:07.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:07.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:07.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.166 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.166 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:07.166 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:07.167 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.496094341000003, 2024-04-25T22:02:07.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:07.167 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.167 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.167 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.167 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:07.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:07.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:07.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:07.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:07.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:07.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:07.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:07.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:07.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:07.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:07.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:07.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:07.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:07.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:07.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:07.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:07.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:07.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:07.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:07.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:07.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:07.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:07.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:07.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:07.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:07.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:07.171 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.171 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.171 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.172 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:07.172 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:07.172 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.495970358000001, 2024-04-25T22:02:07.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:07.172 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.172 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.172 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.172 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:07.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:07.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:07.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:07.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:07.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:07.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:07.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:07.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:07.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:07.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:07.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:07.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:07.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:07.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:07.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:07.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:07.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:07.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:07.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:07.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.177 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.177 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:07.177 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:07.177 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.495896422000001, 2024-04-25T22:02:07.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:07.177 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.177 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.177 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.177 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:07.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:07.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:07.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:07.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:07.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:07.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:07.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:07.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:07.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:07.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:07.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:07.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:07.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:07.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:07.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:07.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:07.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:07.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:07.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:07.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:07.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:07.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:07.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:07.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:07.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:07.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:07.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.182 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.182 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:07.182 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:07.182 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.495780170000003, 2024-04-25T22:02:07.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:07.182 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.182 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.182 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.182 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:07.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:07.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:07.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:07.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:07.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:07.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:07.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:07.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:07.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:07.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:07.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:07.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:07.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:07.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:07.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:07.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:07.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:07.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:07.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:07.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:07.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:07.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:07.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:07.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:07.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:07.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.495616761000001, 2024-04-25T22:02:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.495514565000001, 2024-04-25T22:02:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.195 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:07.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:07.200 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.495435612000001, 2024-04-25T22:02:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:07.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:07.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:07.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:07.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:07.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:07.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:07.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:07.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:07.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:07.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:07.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:07.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:07.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:07.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:07.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:07.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:07.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:07.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:07.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:07.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:07.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:07.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:07.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:07.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:07.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:07.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.205 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.206 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:07.206 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:07.206 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.495370588999997, 2024-04-25T22:02:07.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:07.206 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.206 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:07.206 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:07.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:07.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:07.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:07.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:07.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:07.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:07.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:07.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:07.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:07.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:07.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:07.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:07.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:07.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:07.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:07.209 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.209 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.209 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.209 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:07.210 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:07.210 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.495292397, 2024-04-25T22:02:07.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:07.210 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.210 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:07.210 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:07.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:07.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:07.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:07.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:07.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:07.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:07.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:07.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:07.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:07.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:07.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:07.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:07.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:07.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:07.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:07.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.213 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.213 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:07.213 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:07.214 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.480645936999998, 2024-04-25T22:02:07.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:07.214 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.214 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.214 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.214 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:07.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:07.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:07.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:07.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:07.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:07.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:07.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:07.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:07.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:07.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:07.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:07.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:07.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:07.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:07.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:07.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:07.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:07.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:07.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.217 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.218 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.218 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:07.218 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:07.218 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.480485981000001, 2024-04-25T22:02:07.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:07.218 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:07.218 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:07.218 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.218 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:07.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:07.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:07.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:07.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:07.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:07.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:07.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:07.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:07.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:07.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:07.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:07.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:07.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:07.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:07.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:07.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:07.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:07.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:07.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:07.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:07.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:07.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:07.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:07.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:07.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:07.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:07.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:07.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:07.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:07.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:07.222 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.222 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.222 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.222 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:07.222 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:07.222 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:07.223 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:07.224 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:07.218+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-25T22:02:07.293 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-04-25T22:02:07.324 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:07.323+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:07.358 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:07.358 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:07.359 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:07.359 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:07.373 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:07.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:07.423+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:07.491 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:07.491 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:07.491 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:07.491 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:07.491 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:07.501 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-04-25T22:02:07.505 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:07.526 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:07.523+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:07.565 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:02:07.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:07.627+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:07.628 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:07.628 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:07.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:07.628 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:07.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.628 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:07.628 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:07.628 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.630024665000001, 2024-04-25T22:02:07.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:02:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:02:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:02:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:02:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:02:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:02:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:02:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:02:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:02:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:02:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:02:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:02:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:02:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:02:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:02:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:02:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:02:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:02:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:02:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:02:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:02:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:02:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:02:07.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:02:07.634 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.634 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.634 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.634 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:07.634 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:07.634 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.447961591999999, 2024-04-25T22:02:07.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:02:07.634 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.634 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.635 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.635 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:07.635 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:07.635 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:02:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:02:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:02:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:02:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:02:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:02:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:02:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:02:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:02:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:02:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:02:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:02:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:02:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:02:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:02:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:02:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:02:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:02:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:02:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:02:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:02:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:02:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:02:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.447917312000001, 2024-04-25T22:02:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:02:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:02:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:02:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:02:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:02:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:02:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:02:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:02:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:02:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:02:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:02:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:02:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:02:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:02:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:02:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:02:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:02:07.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:02:07.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:02:07.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:02:07.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:02:07.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:02:07.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:02:07.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:02:07.646 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.447860787000003, 2024-04-25T22:02:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.447665545, 2024-04-25T22:02:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:07.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:07.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:07.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:07.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:07.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:07.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.447603252, 2024-04-25T22:02:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.447543035999999, 2024-04-25T22:02:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:07.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:07.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:07.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.447353524, 2024-04-25T22:02:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:07.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:07.677 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.677 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.677 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.256015689999998, 2024-04-25T22:02:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:02:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:02:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:02:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:02:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:02:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:02:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:02:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:02:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:02:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:02:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:02:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:02:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:02:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:02:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:02:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:02:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:02:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:02:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:02:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:02:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:02:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:02:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:02:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:02:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.255977313000002, 2024-04-25T22:02:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:02:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:02:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:02:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:02:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:02:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:02:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:02:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:02:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:02:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:02:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:02:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:02:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:02:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:02:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:02:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:02:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:02:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:02:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:02:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:02:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:02:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:02:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:02:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:02:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.255926054, 2024-04-25T22:02:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:02:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:02:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:02:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:02:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:02:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:02:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:02:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:02:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:02:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:02:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:02:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:02:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:02:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:02:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:02:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:02:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:02:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:02:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:02:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:02:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:02:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:02:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:02:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:02:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.255777405000003, 2024-04-25T22:02:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:02:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:02:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:02:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:02:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:02:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:02:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:02:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:02:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:02:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:02:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:02:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:02:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:02:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:02:07.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:02:07.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:02:07.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:02:07.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:02:07.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:02:07.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:02:07.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:02:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:02:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:02:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:02:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.255735254999998, 2024-04-25T22:02:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:02:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:02:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:02:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:02:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:02:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:02:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:02:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:02:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:02:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:02:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:02:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:02:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:02:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:02:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:02:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:02:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:02:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:02:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:02:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:02:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:02:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:02:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:02:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:02:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.255697402000003, 2024-04-25T22:02:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.255488077000003, 2024-04-25T22:02:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.720 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:07.720 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:07.720 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.989236804999997, 2024-04-25T22:02:07.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:02:07.720 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.720 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.720 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:07.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:02:07.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:07.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:02:07.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:02:07.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:02:07.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:02:07.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:02:07.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:02:07.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:02:07.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:02:07.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:02:07.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:02:07.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:02:07.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:02:07.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:02:07.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:02:07.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:02:07.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:02:07.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:02:07.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:02:07.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:02:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:02:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.989202964999997, 2024-04-25T22:02:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:02:07.731 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.731 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.731 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.731 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:07.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:07.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:07.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:02:07.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:02:07.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:02:07.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:02:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:02:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:02:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:02:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:02:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:02:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:02:07.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:02:07.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:02:07.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:02:07.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:02:07.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:02:07.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:07.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:02:07.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:02:07.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:02:07.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:02:07.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:02:07.736 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.736 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.736 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.736 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:07.736 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:07.736 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.989151268999997, 2024-04-25T22:02:07.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:02:07.737 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.737 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.737 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.737 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:07.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:07.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:02:07.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:02:07.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:02:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:02:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:02:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:02:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:02:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:02:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:02:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:02:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:02:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:02:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:02:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:02:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:02:07.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:02:07.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:02:07.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:02:07.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:02:07.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:02:07.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:02:07.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:02:07.743 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.743 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.743 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.744 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:07.744 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:07.744 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.989006817000003, 2024-04-25T22:02:07.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:02:07.744 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.745 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.745 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.745 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:07.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:07.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:02:07.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:02:07.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:02:07.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:02:07.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:02:07.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:02:07.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:02:07.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:02:07.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:02:07.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:02:07.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:02:07.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:02:07.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:02:07.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:02:07.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:02:07.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:02:07.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:02:07.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:02:07.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:02:07.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:02:07.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:02:07.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:02:07.755 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.755 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.755 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.755 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:07.755 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:07.755 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.988950097, 2024-04-25T22:02:07.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:02:07.756 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:07.756 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:07.756 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:07.756 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:07.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:07.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:07.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:07.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:07.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:07.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:02:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:02:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:02:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:02:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:07.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:02:07.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:02:07.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:07.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:02:07.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:02:07.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:07.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:02:07.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:02:07.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:02:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:02:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:02:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:02:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:02:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:02:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:02:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:02:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:02:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:02:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:02:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:02:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.761 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:07.762 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:07.762 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:07.764 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:07.764 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:07.765 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:07.765 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:07.765 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:07.766 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:07.766 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:07.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:07.763+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:07.865 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:07.863+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:07.897 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:07.897 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:07.911 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:07.966 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:07.962+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:08.029 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:08.029 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:08.042 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:08.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:08.087+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:08.166 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:08.166 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:08.167 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:08.163+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:08.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:08.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:08.267+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:08.315 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:08.315 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:08.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:08.376 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:08.375+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:08.449 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:08.449 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:08.464 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:08.508 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:08.507+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:08.571 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:08.567+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:08.630 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:08.630 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:08.644 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:08.688 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:08.687+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:08.773 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:08.770+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:08.781 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:08.781 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:08.795 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:08.873 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:08.871+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:08.963 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:08.964 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:08.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:08.971+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:08.979 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:09.075 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:09.070+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:09.104 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:09.104 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:09.119 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:09.177 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:09.175+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:09.250 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:09.250 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:09.263 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:02:09.264 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:09.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:09.307+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:09.379 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:09.374+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:09.429 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:09.429 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:09.444 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:09.480 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:09.478+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:09.560 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:09.560 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:09.574 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:09.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:09.579+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:09.645 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-25T22:02:09.681 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:09.678+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:09.706 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:09.706 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:09.720 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:09.768 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:02:09.782 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:09.782+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:09.835 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:09.835 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:09.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:09.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:09.883+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:09.925 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:09.925 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:09.946 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:09.946 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:09.967 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:09.967 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:09.970 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:09.970 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.141843182000002, 2024-04-25T22:02:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.141112363999994, 2024-04-25T22:02:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.140446092999994, 2024-04-25T22:02:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.139546193000001, 2024-04-25T22:02:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.137509851999994, 2024-04-25T22:02:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.137046514999994, 2024-04-25T22:02:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.136179635999994, 2024-04-25T22:02:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:10.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:10.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:10.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:10.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:10.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:10.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:10.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:10.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:10.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.135728561999997, 2024-04-25T22:02:10.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:10.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:10.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:10.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:10.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:10.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:10.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:10.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:10.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:10.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:10.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:10.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:10.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:10.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:10.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:10.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:10.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:10.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:10.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:10.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:10.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:10.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:10.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:10.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.005 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:10.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.006 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:10.006 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:10.006 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.135278975999995, 2024-04-25T22:02:10.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:10.006 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:10.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:10.006 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.006 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:10.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:10.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:10.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:10.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:10.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:10.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:10.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:10.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:10.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:10.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:10.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:10.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:10.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:10.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:10.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:10.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:10.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:10.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:10.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:10.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:10.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:10.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:10.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:10.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:10.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:10.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:10.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:10.010 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.010 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:10.010 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.010 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:10.010 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:10.010 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.338622489000002, 2024-04-25T22:02:10.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:10.010 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:10.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:10.010 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.010 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:10.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:10.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:10.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:10.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:10.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:10.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:10.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:10.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:10.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:10.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:10.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:10.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:10.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:10.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:10.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:10.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:10.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:10.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:10.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:10.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:10.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:10.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:10.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:10.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:10.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:10.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:10.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:10.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:10.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:10.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:10.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:10.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:10.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:10.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:10.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:10.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.015 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:10.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.015 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:10.015 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:10.016 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.338498506000001, 2024-04-25T22:02:10.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:10.016 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:10.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:10.016 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.016 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:10.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:10.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:10.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:10.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:10.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:10.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:10.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:10.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:10.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:10.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:10.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:10.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:10.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:10.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:10.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:10.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:10.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:10.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:10.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:10.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:10.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:10.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:10.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:10.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:10.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:10.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:10.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:10.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:10.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:10.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:10.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:10.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:10.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:10.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:10.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:10.020 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.021 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:10.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.021 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:10.021 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:10.021 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.338424570000001, 2024-04-25T22:02:10.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:10.021 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:10.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:10.021 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.021 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:10.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:10.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:10.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:10.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:10.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:10.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:10.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:10.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:10.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:10.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:10.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:10.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:10.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:10.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:10.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:10.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:10.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:10.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:10.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:10.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:10.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:10.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:10.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:10.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:10.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:10.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:10.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:10.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:10.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:10.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:10.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:10.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:10.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:10.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:10.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:10.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.026 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:10.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.026 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:10.026 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:10.026 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.338308318000003, 2024-04-25T22:02:10.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:10.026 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:10.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:10.027 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.027 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:10.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:10.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:10.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:10.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:10.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:10.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:10.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:10.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:10.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:10.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:10.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:10.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:10.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:10.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:10.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:10.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:10.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:10.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:10.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:10.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:10.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:10.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:10.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:10.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:10.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:10.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:10.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:10.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:10.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:10.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:10.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:10.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:10.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:10.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:10.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:10.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.031 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:10.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.032 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:10.032 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:10.032 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.338144909, 2024-04-25T22:02:10.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:10.032 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:10.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:10.032 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.032 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:10.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:10.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:10.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:10.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:10.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:10.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:10.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:10.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:10.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:10.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:10.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:10.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:10.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:10.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:10.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:10.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:10.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:10.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:10.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:10.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:10.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:10.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:10.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:10.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:10.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:10.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:10.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:10.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:10.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:10.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:10.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:10.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:10.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:10.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:10.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:10.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.037 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:10.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.037 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:10.037 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:10.037 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.338042713, 2024-04-25T22:02:10.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:10.037 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:10.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:10.037 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.037 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:10.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:10.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:10.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:10.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:10.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:10.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:10.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:10.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:10.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:10.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:10.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:10.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:10.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:10.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:10.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:10.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:10.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:10.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:10.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:10.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:10.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:10.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:10.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:10.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:10.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:10.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:10.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:10.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:10.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:10.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:10.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:10.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:10.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:10.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:10.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:10.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.042 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:10.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.042 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:10.043 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:10.043 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.337963760000001, 2024-04-25T22:02:10.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:10.043 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:10.043 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:10.043 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.043 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:10.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:10.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:10.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:10.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:10.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:10.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:10.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:10.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:10.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:10.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:10.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:10.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:10.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:10.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:10.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:10.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:10.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:10.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:10.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:10.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:10.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:10.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:10.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:10.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:10.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:10.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:10.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:10.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:10.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:10.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:10.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:10.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:10.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:10.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:10.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:10.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.048 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:10.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.048 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:10.048 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:10.048 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.337898737000003, 2024-04-25T22:02:10.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:10.048 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:10.048 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:10.048 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:10.048 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:10.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:10.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:10.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:10.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:10.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:10.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:10.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:10.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:10.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:10.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:10.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:10.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:10.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:10.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:10.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:10.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:10.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:10.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:10.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:10.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:10.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:10.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:10.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:10.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:10.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.052 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:10.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.052 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:10.052 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:10.052 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.337820545, 2024-04-25T22:02:10.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:10.052 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:10.052 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:10.052 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:10.052 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:10.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:10.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:10.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:10.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:10.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:10.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:10.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:10.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:10.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:10.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:10.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:10.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:10.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:10.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:10.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:10.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:10.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:10.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:10.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:10.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:10.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:10.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:10.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:10.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:10.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.056 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:10.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.057 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:10.057 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:10.058 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.323174084999998, 2024-04-25T22:02:10.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:10.058 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:10.058 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:10.058 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.058 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:10.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:10.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:10.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:10.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:10.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:10.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:10.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:10.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:10.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:10.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:10.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:10.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:10.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:10.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:10.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:10.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:10.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:10.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:10.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:10.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:10.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:10.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:10.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:10.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:10.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:10.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:10.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:10.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.062 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:10.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.062 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:10.062 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:10.062 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.323014129000001, 2024-04-25T22:02:10.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:10.062 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:10.063 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:10.063 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.063 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:10.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:10.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:10.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:10.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:10.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:10.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:10.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:10.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:10.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:10.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:10.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:10.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:10.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:10.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:10.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:10.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:10.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:10.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:10.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:10.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:10.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:10.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:10.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:10.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:10.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:10.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:10.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:10.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:10.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:10.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:10.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.066 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:10.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:10.066 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:10.066 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:10.068 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:10.069 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:10.066+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:10.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:10.167+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:10.202 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:10.202 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:10.202 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:10.202 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:10.216 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:10.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:10.267+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:10.344 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:10.344 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:10.358 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:10.371 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:10.370+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:10.474 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:10.470+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:10.481 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:10.481 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:10.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:10.481 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:10.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.481 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:10.481 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.483423389999999, 2024-04-25T22:02:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:02:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:02:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:02:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:02:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:02:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:02:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:02:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:02:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:02:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:02:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:02:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:02:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:02:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:02:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:02:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:02:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:02:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:02:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:02:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:02:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:02:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:02:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:02:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:02:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.301360317000004, 2024-04-25T22:02:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:02:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.488 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:10.488 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:10.488 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:10.488 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:02:10.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.488 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:10.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:02:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:02:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:02:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:02:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:02:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:02:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:02:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:02:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:02:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:02:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:02:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:02:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:02:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:02:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:02:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:02:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:02:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:02:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:02:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:02:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:02:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:02:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.493 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:10.493 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:10.493 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.301316037000007, 2024-04-25T22:02:10.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:02:10.493 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.493 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.493 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.493 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:10.493 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:10.493 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:10.493 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:02:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:02:10.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:02:10.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:02:10.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:02:10.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:02:10.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:02:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:02:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:02:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:02:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:02:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:02:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:02:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:02:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:02:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:02:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:02:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:02:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:02:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:02:10.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:02:10.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:02:10.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:02:10.498 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.498 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.498 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.301259512000001, 2024-04-25T22:02:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.301064269999998, 2024-04-25T22:02:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.301001976999999, 2024-04-25T22:02:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.300941761000004, 2024-04-25T22:02:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.300752248999999, 2024-04-25T22:02:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.109414415000003, 2024-04-25T22:02:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:02:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:02:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:02:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:02:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:02:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:02:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:02:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:02:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:02:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:02:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:02:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:02:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:02:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:02:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:02:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:02:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:02:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:02:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:02:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:02:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:02:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:02:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:02:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:02:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.109376037999994, 2024-04-25T22:02:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:02:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:02:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:02:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:02:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:02:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:02:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:02:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:02:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:02:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:02:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:02:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:02:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:02:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:02:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:02:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:02:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:02:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:02:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:02:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:02:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:02:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:02:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:02:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:02:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.538 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:10.538 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:10.538 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.109324779000005, 2024-04-25T22:02:10.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:02:10.538 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.538 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.538 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.538 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:10.538 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:10.538 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:10.538 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:02:10.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.539 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:10.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:10.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:02:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:02:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:02:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:02:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:02:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:02:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:02:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:02:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:02:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:02:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:02:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:02:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:02:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:02:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:02:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:02:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:02:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:02:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:02:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:02:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:02:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:02:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.109176129999994, 2024-04-25T22:02:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:02:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:02:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:02:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:02:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:02:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:02:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:02:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:02:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:02:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:02:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:02:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:02:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:02:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:02:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:02:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:02:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:02:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:02:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:02:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:02:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:02:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:02:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:02:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:02:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.109133979999996, 2024-04-25T22:02:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:02:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:02:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:02:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:02:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:02:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:02:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:02:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:02:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:02:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:02:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:02:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:02:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:02:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:02:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:02:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:02:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:02:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:02:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:02:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:02:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:02:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:02:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:02:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:02:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.109096127000001, 2024-04-25T22:02:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:10.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:10.561 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.561 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.561 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.561 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:10.561 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:10.561 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.108886802000001, 2024-04-25T22:02:10.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:10.561 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.561 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.561 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:10.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:10.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:10.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:10.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:10.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:10.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.842635530000003, 2024-04-25T22:02:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:02:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:02:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:02:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:02:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:02:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:02:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:02:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:02:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:02:10.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:02:10.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:02:10.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:02:10.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:02:10.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:02:10.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:02:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:02:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:02:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:02:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:02:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:02:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:02:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:02:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.842601690000002, 2024-04-25T22:02:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:02:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:02:10.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:02:10.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:02:10.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:02:10.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:02:10.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:02:10.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:02:10.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:02:10.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:02:10.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:02:10.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:02:10.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:02:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:02:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:02:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:02:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:02:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:02:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:02:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:02:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:02:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.842549994000002, 2024-04-25T22:02:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:02:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:02:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:02:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:02:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:02:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:02:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:02:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:02:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:02:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:02:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:02:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:02:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:02:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:02:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:02:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:02:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:02:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:02:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:02:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:02:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:02:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:02:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:02:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.842405542000002, 2024-04-25T22:02:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:02:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:02:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:02:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:02:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:02:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:02:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:02:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:02:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:02:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:02:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:02:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:02:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:02:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:02:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:02:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:02:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:02:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:02:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:02:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:02:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:02:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:02:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:02:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.842348821999998, 2024-04-25T22:02:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:02:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:10.589 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:10.589 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:10.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:10.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:10.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:10.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:10.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:10.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:02:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:02:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:02:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:02:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:02:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:02:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:02:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:02:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:02:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:02:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:02:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:02:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:02:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:02:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:02:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:02:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:02:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:02:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:02:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:02:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:02:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:02:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:10.594 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:10.594 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:10.595 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:10.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:10.595+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:10.697 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:10.694+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:10.727 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:10.727 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:10.727 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:02:10.728 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:10.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:10.798 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:10.794+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:10.867 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:02:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:02:10.867 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:10.882 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:10.898 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:10.894+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:10.999 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:10.998+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:11.007 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:02:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:02:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:02:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 4 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:27 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:02:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.366573703, 2024-04-25T22:02:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013281644, 2024-04-25T22:02:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637801+0000", 2024-04-25T22:02:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1299999999999998e-07 2024-04-25T22:02:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637828+0000", 2024-04-25T22:02:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6953000000000001e-05 2024-04-25T22:02:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637873+0000", 2024-04-25T22:02:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4676999999999999e-05 2024-04-25T22:02:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637917+0000", 2024-04-25T22:02:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4815999999999999e-05 2024-04-25T22:02:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644220+0000", 2024-04-25T22:02:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063021049999999997 2024-04-25T22:02:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651082+0000", 2024-04-25T22:02:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068621799999999998 2024-04-25T22:02:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:15 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.361166091000001, 2024-04-25T22:02:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010973732, 2024-04-25T22:02:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643209+0000", 2024-04-25T22:02:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.003e-06 2024-04-25T22:02:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643230+0000", 2024-04-25T22:02:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0815999999999999e-05 2024-04-25T22:02:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643252+0000", 2024-04-25T22:02:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2586999999999999e-05 2024-04-25T22:02:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643271+0000", 2024-04-25T22:02:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8493000000000001e-05 2024-04-25T22:02:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644387+0000", 2024-04-25T22:02:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011160250000000001 2024-04-25T22:02:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644434+0000", 2024-04-25T22:02:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:02:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654103+0000", 2024-04-25T22:02:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096691360000000001 2024-04-25T22:02:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654181+0000", 2024-04-25T22:02:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8546000000000003e-05 2024-04-25T22:02:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.361065734999997, 2024-04-25T22:02:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088132450000000008, 2024-04-25T22:02:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643309+0000", 2024-04-25T22:02:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9600000000000008e-07 2024-04-25T22:02:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643339+0000", 2024-04-25T22:02:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9467000000000001e-05 2024-04-25T22:02:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644245+0000", 2024-04-25T22:02:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090648200000000001 2024-04-25T22:02:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644268+0000", 2024-04-25T22:02:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3017e-05 2024-04-25T22:02:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647517+0000", 2024-04-25T22:02:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032491680000000002 2024-04-25T22:02:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647561+0000", 2024-04-25T22:02:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3630000000000001e-05 2024-04-25T22:02:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652041+0000", 2024-04-25T22:02:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044804529999999997 2024-04-25T22:02:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652121+0000", 2024-04-25T22:02:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0031999999999995e-05 2024-04-25T22:02:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:34 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.358977107999998, 2024-04-25T22:02:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089225940000000007, 2024-04-25T22:02:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645398+0000", 2024-04-25T22:02:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4360000000000001e-06 2024-04-25T22:02:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645412+0000", 2024-04-25T22:02:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4283e-05 2024-04-25T22:02:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645434+0000", 2024-04-25T22:02:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1237e-05 2024-04-25T22:02:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645459+0000", 2024-04-25T22:02:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5675999999999999e-05 2024-04-25T22:02:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646081+0000", 2024-04-25T22:02:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062128900000000002 2024-04-25T22:02:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646131+0000", 2024-04-25T22:02:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0322999999999999e-05 2024-04-25T22:02:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654185+0000", 2024-04-25T22:02:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080542749999999996 2024-04-25T22:02:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654319+0000", 2024-04-25T22:02:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013407499999999999 2024-04-25T22:02:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:19 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.358875599000001, 2024-04-25T22:02:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076631340000000003, 2024-04-25T22:02:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645499+0000", 2024-04-25T22:02:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4300000000000001e-07 2024-04-25T22:02:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645509+0000", 2024-04-25T22:02:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0244000000000001e-05 2024-04-25T22:02:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645523+0000", 2024-04-25T22:02:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3315999999999999e-05 2024-04-25T22:02:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645531+0000", 2024-04-25T22:02:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.123e-06 2024-04-25T22:02:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648260+0000", 2024-04-25T22:02:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027289789999999999 2024-04-25T22:02:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648307+0000", 2024-04-25T22:02:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6969999999999999e-05 2024-04-25T22:02:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653039+0000", 2024-04-25T22:02:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047322299999999996 2024-04-25T22:02:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653161+0000", 2024-04-25T22:02:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012232899999999999 2024-04-25T22:02:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.356897938000003, 2024-04-25T22:02:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01271303, 2024-04-25T22:02:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647479+0000", 2024-04-25T22:02:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.286e-06 2024-04-25T22:02:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647494+0000", 2024-04-25T22:02:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.521e-05 2024-04-25T22:02:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647525+0000", 2024-04-25T22:02:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0403999999999999e-05 2024-04-25T22:02:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647544+0000", 2024-04-25T22:02:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8743e-05 2024-04-25T22:02:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647895+0000", 2024-04-25T22:02:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035099699999999997 2024-04-25T22:02:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648202+0000", 2024-04-25T22:02:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030758499999999998 2024-04-25T22:02:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648496+0000", 2024-04-25T22:02:11.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029370699999999999 2024-04-25T22:02:11.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:11.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654605+0000", 2024-04-25T22:02:11.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061095999999999998 2024-04-25T22:02:11.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:11.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.659959+0000", 2024-04-25T22:02:11.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053531680000000002 2024-04-25T22:02:11.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:11.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660078+0000", 2024-04-25T22:02:11.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011981600000000001 2024-04-25T22:02:11.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660189+0000", 2024-04-25T22:02:11.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011051400000000001 2024-04-25T22:02:11.038 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.038 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.038 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.039 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:11.039 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:11.039 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.356773846000003, 2024-04-25T22:02:11.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013053006000000001, 2024-04-25T22:02:11.039 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.039 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.039 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.039 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:11.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:11.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647602+0000", 2024-04-25T22:02:11.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.604e-06 2024-04-25T22:02:11.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647611+0000", 2024-04-25T22:02:11.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5689999999999994e-06 2024-04-25T22:02:11.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647634+0000", 2024-04-25T22:02:11.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3227e-05 2024-04-25T22:02:11.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647660+0000", 2024-04-25T22:02:11.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5829999999999998e-05 2024-04-25T22:02:11.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649544+0000", 2024-04-25T22:02:11.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001884066 2024-04-25T22:02:11.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:11.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649783+0000", 2024-04-25T22:02:11.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238411 2024-04-25T22:02:11.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:11.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.650794+0000", 2024-04-25T22:02:11.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010109920000000001 2024-04-25T22:02:11.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:11.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654714+0000", 2024-04-25T22:02:11.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039202170000000001 2024-04-25T22:02:11.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:11.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660403+0000", 2024-04-25T22:02:11.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056895940000000001 2024-04-25T22:02:11.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:11.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660551+0000", 2024-04-25T22:02:11.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014717899999999999 2024-04-25T22:02:11.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660653+0000", 2024-04-25T22:02:11.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102317 2024-04-25T22:02:11.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.045 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.045 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:17 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:11.045 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:11.045 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.356689666000001, 2024-04-25T22:02:11.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010101435000000001, 2024-04-25T22:02:11.045 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.045 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.046 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.046 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:11.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:11.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647686+0000", 2024-04-25T22:02:11.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-04-25T22:02:11.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647693+0000", 2024-04-25T22:02:11.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7330000000000003e-06 2024-04-25T22:02:11.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647711+0000", 2024-04-25T22:02:11.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7436e-05 2024-04-25T22:02:11.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647727+0000", 2024-04-25T22:02:11.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6232999999999999e-05 2024-04-25T22:02:11.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649249+0000", 2024-04-25T22:02:11.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015219890000000001 2024-04-25T22:02:11.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:11.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649533+0000", 2024-04-25T22:02:11.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028391799999999997 2024-04-25T22:02:11.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:11.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649841+0000", 2024-04-25T22:02:11.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030853400000000001 2024-04-25T22:02:11.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:11.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654622+0000", 2024-04-25T22:02:11.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047809630000000001 2024-04-25T22:02:11.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:11.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657616+0000", 2024-04-25T22:02:11.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029938769999999998 2024-04-25T22:02:11.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:11.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657724+0000", 2024-04-25T22:02:11.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108109 2024-04-25T22:02:11.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657786+0000", 2024-04-25T22:02:11.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1196000000000002e-05 2024-04-25T22:02:11.051 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.051 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.051 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.051 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:11.051 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:11.052 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.356501338000001, 2024-04-25T22:02:11.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010260877999999999, 2024-04-25T22:02:11.052 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.052 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.052 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.052 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:11.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:11.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647874+0000", 2024-04-25T22:02:11.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:02:11.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647884+0000", 2024-04-25T22:02:11.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.013e-05 2024-04-25T22:02:11.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647908+0000", 2024-04-25T22:02:11.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3592999999999999e-05 2024-04-25T22:02:11.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647926+0000", 2024-04-25T22:02:11.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8176999999999999e-05 2024-04-25T22:02:11.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651480+0000", 2024-04-25T22:02:11.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035540160000000001 2024-04-25T22:02:11.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:11.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651690+0000", 2024-04-25T22:02:11.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210249 2024-04-25T22:02:11.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:11.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651986+0000", 2024-04-25T22:02:11.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000296001 2024-04-25T22:02:11.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:11.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655696+0000", 2024-04-25T22:02:11.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037098410000000002 2024-04-25T22:02:11.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:11.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657896+0000", 2024-04-25T22:02:11.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022004630000000002 2024-04-25T22:02:11.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:11.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658035+0000", 2024-04-25T22:02:11.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013831499999999999 2024-04-25T22:02:11.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658133+0000", 2024-04-25T22:02:11.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8553000000000003e-05 2024-04-25T22:02:11.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.057 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.058 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:18 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:11.058 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:11.058 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.356422457999997, 2024-04-25T22:02:11.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013108712, 2024-04-25T22:02:11.058 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.058 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.058 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.058 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:11.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:11.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647953+0000", 2024-04-25T22:02:11.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.697e-06 2024-04-25T22:02:11.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647963+0000", 2024-04-25T22:02:11.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9259999999999995e-06 2024-04-25T22:02:11.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647982+0000", 2024-04-25T22:02:11.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-04-25T22:02:11.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648008+0000", 2024-04-25T22:02:11.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5956e-05 2024-04-25T22:02:11.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651686+0000", 2024-04-25T22:02:11.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678073 2024-04-25T22:02:11.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:11.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652023+0000", 2024-04-25T22:02:11.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033739399999999998 2024-04-25T22:02:11.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:11.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652348+0000", 2024-04-25T22:02:11.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032475000000000001 2024-04-25T22:02:11.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:11.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655883+0000", 2024-04-25T22:02:11.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035353030000000001 2024-04-25T22:02:11.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:11.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660791+0000", 2024-04-25T22:02:11.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049075330000000004 2024-04-25T22:02:11.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:11.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660930+0000", 2024-04-25T22:02:11.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000139856 2024-04-25T22:02:11.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661060+0000", 2024-04-25T22:02:11.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000129651 2024-04-25T22:02:11.064 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.064 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.064 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.064 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:11.064 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:11.064 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.356345566000002, 2024-04-25T22:02:11.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012451034, 2024-04-25T22:02:11.065 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.065 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.065 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.065 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:11.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:11.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648030+0000", 2024-04-25T22:02:11.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-04-25T22:02:11.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648036+0000", 2024-04-25T22:02:11.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8059999999999997e-06 2024-04-25T22:02:11.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648054+0000", 2024-04-25T22:02:11.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7744000000000002e-05 2024-04-25T22:02:11.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648070+0000", 2024-04-25T22:02:11.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-04-25T22:02:11.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648875+0000", 2024-04-25T22:02:11.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080444000000000002 2024-04-25T22:02:11.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:11.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649078+0000", 2024-04-25T22:02:11.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020391499999999999 2024-04-25T22:02:11.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:11.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649674+0000", 2024-04-25T22:02:11.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00059555299999999997 2024-04-25T22:02:11.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:11.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653185+0000", 2024-04-25T22:02:11.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035113459999999998 2024-04-25T22:02:11.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:11.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660251+0000", 2024-04-25T22:02:11.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070661350000000003 2024-04-25T22:02:11.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:11.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660382+0000", 2024-04-25T22:02:11.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013095899999999999 2024-04-25T22:02:11.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660479+0000", 2024-04-25T22:02:11.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6852e-05 2024-04-25T22:02:11.070 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.070 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.070 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.071 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:25 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:11.071 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:11.071 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.356279753000003, 2024-04-25T22:02:11.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012691025999999999, 2024-04-25T22:02:11.071 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.071 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.071 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:11.071 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:11.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:11.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648095+0000", 2024-04-25T22:02:11.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.424e-06 2024-04-25T22:02:11.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648102+0000", 2024-04-25T22:02:11.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2099999999999998e-06 2024-04-25T22:02:11.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648122+0000", 2024-04-25T22:02:11.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0242999999999999e-05 2024-04-25T22:02:11.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648138+0000", 2024-04-25T22:02:11.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6192999999999999e-05 2024-04-25T22:02:11.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651461+0000", 2024-04-25T22:02:11.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033225709999999999 2024-04-25T22:02:11.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:11.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651776+0000", 2024-04-25T22:02:11.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031567500000000002 2024-04-25T22:02:11.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660785+0000", 2024-04-25T22:02:11.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090087099999999996 2024-04-25T22:02:11.075 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.075 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.075 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.075 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:11.076 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:11.076 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.356217266999998, 2024-04-25T22:02:11.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013102702000000001, 2024-04-25T22:02:11.076 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.076 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.076 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:11.076 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:11.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:11.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648158+0000", 2024-04-25T22:02:11.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2839999999999999e-06 2024-04-25T22:02:11.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648163+0000", 2024-04-25T22:02:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-04-25T22:02:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648181+0000", 2024-04-25T22:02:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8484000000000001e-05 2024-04-25T22:02:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648196+0000", 2024-04-25T22:02:11.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4496e-05 2024-04-25T22:02:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653737+0000", 2024-04-25T22:02:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055414009999999996 2024-04-25T22:02:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653972+0000", 2024-04-25T22:02:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000234732 2024-04-25T22:02:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661259+0000", 2024-04-25T22:02:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072872689999999999 2024-04-25T22:02:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.356160447000001, 2024-04-25T22:02:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086984829999999999, 2024-04-25T22:02:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.080 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.081 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:11.081 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:11.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:11.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648214+0000", 2024-04-25T22:02:11.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-04-25T22:02:11.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648233+0000", 2024-04-25T22:02:11.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.878e-05 2024-04-25T22:02:11.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648252+0000", 2024-04-25T22:02:11.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8603000000000001e-05 2024-04-25T22:02:11.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648267+0000", 2024-04-25T22:02:11.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:02:11.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648846+0000", 2024-04-25T22:02:11.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057923000000000002 2024-04-25T22:02:11.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:11.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649027+0000", 2024-04-25T22:02:11.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181585 2024-04-25T22:02:11.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.656912+0000", 2024-04-25T22:02:11.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078844589999999999 2024-04-25T22:02:11.086 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.086 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.086 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.086 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 6 lcod 17'2)", 2024-04-25T22:02:11.086 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:11.086 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.344230531000001, 2024-04-25T22:02:11.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064966000000000004, 2024-04-25T22:02:11.086 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.087 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:11.087 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:11.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:11.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660144+0000", 2024-04-25T22:02:11.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1800000000000005e-07 2024-04-25T22:02:11.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660181+0000", 2024-04-25T22:02:11.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6408000000000001e-05 2024-04-25T22:02:11.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660197+0000", 2024-04-25T22:02:11.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6177000000000001e-05 2024-04-25T22:02:11.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660210+0000", 2024-04-25T22:02:11.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:02:11.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660556+0000", 2024-04-25T22:02:11.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034612899999999998 2024-04-25T22:02:11.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660793+0000", 2024-04-25T22:02:11.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023656799999999999 2024-04-25T22:02:11.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.090 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.091 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:18 3.1f e17/15 ondisk, result = 0)", 2024-04-25T22:02:11.091 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:11.091 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.343968758000003, 2024-04-25T22:02:11.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067878299999999997, 2024-04-25T22:02:11.091 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.091 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.091 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:11.091 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:11.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:11.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660406+0000", 2024-04-25T22:02:11.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2800000000000005e-07 2024-04-25T22:02:11.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660412+0000", 2024-04-25T22:02:11.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0399999999999998e-06 2024-04-25T22:02:11.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660429+0000", 2024-04-25T22:02:11.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7394e-05 2024-04-25T22:02:11.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660445+0000", 2024-04-25T22:02:11.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6069000000000001e-05 2024-04-25T22:02:11.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660757+0000", 2024-04-25T22:02:11.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031194300000000002 2024-04-25T22:02:11.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:11.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660776+0000", 2024-04-25T22:02:11.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8862999999999999e-05 2024-04-25T22:02:11.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661084+0000", 2024-04-25T22:02:11.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030754600000000001 2024-04-25T22:02:11.095 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.095 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.095 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.095 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-25T22:02:11.095 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:11.095 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.343904530000003, 2024-04-25T22:02:11.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080007600000000004, 2024-04-25T22:02:11.096 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.096 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.096 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:11.096 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:11.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:11.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660470+0000", 2024-04-25T22:02:11.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4499999999999996e-07 2024-04-25T22:02:11.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660475+0000", 2024-04-25T22:02:11.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-04-25T22:02:11.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660490+0000", 2024-04-25T22:02:11.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5274e-05 2024-04-25T22:02:11.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660501+0000", 2024-04-25T22:02:11.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0694e-05 2024-04-25T22:02:11.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661130+0000", 2024-04-25T22:02:11.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062887499999999999 2024-04-25T22:02:11.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661269+0000", 2024-04-25T22:02:11.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013955900000000001 2024-04-25T22:02:11.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.099 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.099 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:02:11.100 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:11.100 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 54.380172530999999, 2024-04-25T22:02:11.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037104880000000001, 2024-04-25T22:02:11.100 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.100 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.100 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.100 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:11.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:11.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624204+0000", 2024-04-25T22:02:11.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.757e-06 2024-04-25T22:02:11.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624233+0000", 2024-04-25T22:02:11.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9362000000000001e-05 2024-04-25T22:02:11.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624264+0000", 2024-04-25T22:02:11.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0843000000000003e-05 2024-04-25T22:02:11.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624280+0000", 2024-04-25T22:02:11.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5577e-05 2024-04-25T22:02:11.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624458+0000", 2024-04-25T22:02:11.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017821199999999999 2024-04-25T22:02:11.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:11.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624661+0000", 2024-04-25T22:02:11.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020283200000000001 2024-04-25T22:02:11.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:11.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624842+0000", 2024-04-25T22:02:11.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018115500000000001 2024-04-25T22:02:11.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:11.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.626271+0000", 2024-04-25T22:02:11.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001429416 2024-04-25T22:02:11.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:11.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627749+0000", 2024-04-25T22:02:11.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014778650000000001 2024-04-25T22:02:11.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:11.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627849+0000", 2024-04-25T22:02:11.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9261999999999999e-05 2024-04-25T22:02:11.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627912+0000", 2024-04-25T22:02:11.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3207000000000007e-05 2024-04-25T22:02:11.105 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.105 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.105 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.106 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-25T22:02:11.106 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:11.106 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.377475180000001, 2024-04-25T22:02:11.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029804620000000001, 2024-04-25T22:02:11.106 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.106 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.106 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.106 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:11.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:11.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626903+0000", 2024-04-25T22:02:11.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0029999999999996e-06 2024-04-25T22:02:11.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626921+0000", 2024-04-25T22:02:11.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8272999999999999e-05 2024-04-25T22:02:11.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626959+0000", 2024-04-25T22:02:11.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7843999999999999e-05 2024-04-25T22:02:11.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626977+0000", 2024-04-25T22:02:11.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7756000000000001e-05 2024-04-25T22:02:11.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627153+0000", 2024-04-25T22:02:11.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017643800000000001 2024-04-25T22:02:11.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:11.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627425+0000", 2024-04-25T22:02:11.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027207300000000001 2024-04-25T22:02:11.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:11.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627848+0000", 2024-04-25T22:02:11.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042297199999999997 2024-04-25T22:02:11.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:11.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629590+0000", 2024-04-25T22:02:11.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017416809999999999 2024-04-25T22:02:11.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:11.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629720+0000", 2024-04-25T22:02:11.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130526 2024-04-25T22:02:11.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:11.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629808+0000", 2024-04-25T22:02:11.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7449999999999998e-05 2024-04-25T22:02:11.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629879+0000", 2024-04-25T22:02:11.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1445999999999993e-05 2024-04-25T22:02:11.111 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.112 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.112 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.112 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4185.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-04-25T22:02:11.112 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:11.112 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.38936711, 2024-04-25T22:02:11.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0036257939999999999, 2024-04-25T22:02:11.112 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:11.112 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:11.112 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:11.112 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:11.112 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4185", 2024-04-25T22:02:11.112 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.44:0/2048337248", 2024-04-25T22:02:11.113 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2 2024-04-25T22:02:11.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.113 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:11.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:11.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:11.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:11.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:11.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:11.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:11.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615010+0000", 2024-04-25T22:02:11.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8059999999999999e-06 2024-04-25T22:02:11.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:11.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615023+0000", 2024-04-25T22:02:11.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3159999999999999e-05 2024-04-25T22:02:11.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:11.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615043+0000", 2024-04-25T22:02:11.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:02:11.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615059+0000", 2024-04-25T22:02:11.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5519000000000002e-05 2024-04-25T22:02:11.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615241+0000", 2024-04-25T22:02:11.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018207100000000001 2024-04-25T22:02:11.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:02:11.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615258+0000", 2024-04-25T22:02:11.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7278999999999998e-05 2024-04-25T22:02:11.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:11.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618429+0000", 2024-04-25T22:02:11.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003171213 2024-04-25T22:02:11.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:11.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:11.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:11.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618633+0000", 2024-04-25T22:02:11.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020343999999999999 2024-04-25T22:02:11.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.117 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:11.117 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:11.117 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:11.119 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:11.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:11.119+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:11.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:11.219+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:11.251 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:11.251 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:11.251 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:02:11.251 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:11.265 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:11.320 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:11.318+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:11.381 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:11.381 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:11.381 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:02:11.382 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:02:11.382 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:11.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:11.421 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:11.418+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:11.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:11.523+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:11.567 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.567 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.738626765000006, 2024-04-25T22:02:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.737895946999998, 2024-04-25T22:02:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.737229675999998, 2024-04-25T22:02:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.576 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:11.580 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.736329776000005, 2024-04-25T22:02:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:11.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.734293434999998, 2024-04-25T22:02:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:11.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:11.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:11.589 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.733830097999999, 2024-04-25T22:02:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:11.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:11.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.732963218999998, 2024-04-25T22:02:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:11.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:11.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.732512145000001, 2024-04-25T22:02:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.732062558999999, 2024-04-25T22:02:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:11.606 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.935406071999999, 2024-04-25T22:02:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:11.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:11.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:11.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.935282088999998, 2024-04-25T22:02:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.935208152999998, 2024-04-25T22:02:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:11.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:11.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:11.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:11.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.935091901, 2024-04-25T22:02:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:11.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:11.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:11.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.934928491999997, 2024-04-25T22:02:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:11.627 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.934826295999997, 2024-04-25T22:02:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.934747342999998, 2024-04-25T22:02:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.93468232, 2024-04-25T22:02:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.934604127999997, 2024-04-25T22:02:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.919957668000002, 2024-04-25T22:02:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.919797711999998, 2024-04-25T22:02:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:11.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.659 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:11.659 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:11.659 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:11.660 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:11.661 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:11.654+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:11.668 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:02:11.761 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:11.758+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:11.794 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:11.794 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:11.794 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:11.794 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:11.808 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:11.897 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:11.894+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:11.963 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:11.958+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:11.983 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:11.983 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:11.983 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:11.984 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:11.984 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:11.999 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:12.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:12.063+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:12.069 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:02:12.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:12.163+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:12.173 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:12.173 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:12.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:12.173 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:12.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.173 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:12.173 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.174926851999999, 2024-04-25T22:02:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:02:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:02:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:12.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:02:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:02:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:02:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:02:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:02:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:02:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:02:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:02:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:02:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:02:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:02:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:02:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:02:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:02:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:02:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:02:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:02:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:02:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:02:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:02:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:02:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:02:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.179 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 65.992863779000004, 2024-04-25T22:02:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:02:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:02:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.180 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:02:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:02:12.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:02:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:02:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:02:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:02:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:02:12.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:02:12.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:02:12.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:02:12.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:02:12.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:02:12.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:02:12.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:02:12.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:02:12.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:02:12.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:02:12.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:02:12.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:02:12.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:02:12.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:02:12.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:02:12.185 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.185 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.185 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.185 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:12.185 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:12.185 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 65.992819499000007, 2024-04-25T22:02:12.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:02:12.185 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.185 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:02:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:12.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:02:12.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:02:12.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:02:12.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:02:12.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:02:12.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:02:12.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:02:12.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:02:12.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:02:12.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:02:12.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:02:12.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:02:12.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:02:12.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:02:12.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:02:12.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:02:12.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:02:12.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:02:12.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:02:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:02:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:02:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:02:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 65.992762974000001, 2024-04-25T22:02:12.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:12.192 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.192 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.192 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.192 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:12.192 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:12.192 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:12.192 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:12.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.192 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:12.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:12.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:12.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:12.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:12.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:12.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:12.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:12.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:12.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:12.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:12.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:12.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:12.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:12.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:12.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:12.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:12.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:12.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.197 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.197 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:12.197 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:12.197 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 65.992567731999998, 2024-04-25T22:02:12.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:12.197 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.197 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.197 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.197 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:12.197 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:12.197 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:12.197 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:12.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:12.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:12.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:12.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:12.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:12.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:12.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:12.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:12.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:12.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:12.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:12.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:12.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:12.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:12.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:12.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:12.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:12.202 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.202 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.202 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.202 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:12.202 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:12.202 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 65.992505438999999, 2024-04-25T22:02:12.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:12.203 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.203 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.203 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.203 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:12.203 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:12.203 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:12.203 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:12.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.203 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:12.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:12.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:12.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:12.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:12.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:12.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:12.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:12.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:12.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:12.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:12.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:12.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:12.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:12.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:12.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:12.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:12.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:12.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:12.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:12.208 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.208 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.208 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 65.992445223000004, 2024-04-25T22:02:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:12.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:12.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:12.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:12.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:12.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:12.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:12.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:12.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:12.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:12.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:12.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:12.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:12.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:12.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:12.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:12.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:12.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:12.215 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.215 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.215 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.215 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:12.215 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:12.215 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 65.992255710999999, 2024-04-25T22:02:12.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:12.215 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.215 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.216 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.216 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:12.216 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:12.216 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:12.216 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:12.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.216 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:12.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:12.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:12.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:12.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:12.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:12.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:12.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:12.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:12.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:12.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:12.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:12.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:12.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:12.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.222 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:12.222 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:12.222 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 65.800917877000003, 2024-04-25T22:02:12.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:02:12.222 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.222 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.222 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.222 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:12.222 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:12.222 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:12.222 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:02:12.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.222 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:02:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:02:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:02:12.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:02:12.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:02:12.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:02:12.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:02:12.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:02:12.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:02:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:02:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:02:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:02:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:02:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:02:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:02:12.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:02:12.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:02:12.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:02:12.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:02:12.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:02:12.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:02:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:02:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 65.800879499999994, 2024-04-25T22:02:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:02:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.227 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.228 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:12.228 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:12.228 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:12.228 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:02:12.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.228 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:12.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:02:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:02:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:02:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:02:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:02:12.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:02:12.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:02:12.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:02:12.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:02:12.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:02:12.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:02:12.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:02:12.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:02:12.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:02:12.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:02:12.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:02:12.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:02:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:02:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:02:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:02:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:02:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:02:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.232 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.233 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.233 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:12.233 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:12.233 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 65.800828241000005, 2024-04-25T22:02:12.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:02:12.233 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.233 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.233 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.233 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:12.233 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:12.233 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:12.233 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:02:12.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.234 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:12.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:12.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:02:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:02:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:02:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:02:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:02:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:02:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:02:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:02:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:02:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:02:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:02:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:02:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:02:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:02:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:02:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:02:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:02:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:02:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:02:12.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:02:12.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:02:12.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:02:12.238 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.238 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.238 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.238 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:12.238 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 65.800679591999994, 2024-04-25T22:02:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:02:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:02:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:12.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:12.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:02:12.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:02:12.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:02:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:02:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:02:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:02:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:02:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:02:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:02:12.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:02:12.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:02:12.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:02:12.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:02:12.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:02:12.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:02:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:02:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:02:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:02:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:02:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:02:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:02:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:02:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 65.800637441999996, 2024-04-25T22:02:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:02:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.244 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:02:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:12.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:02:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:02:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:02:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:02:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:02:12.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:02:12.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:02:12.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:02:12.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:02:12.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:02:12.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:02:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:02:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:02:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:02:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:02:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:02:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:02:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:02:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:02:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:02:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:02:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:02:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.249 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.250 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:12.250 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:12.250 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 65.800599589000001, 2024-04-25T22:02:12.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:12.250 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.250 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.250 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.250 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:12.250 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:12.250 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:12.251 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:12.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.251 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:12.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:12.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:12.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:12.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:12.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:12.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:12.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:12.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:12.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:12.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:12.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:12.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:12.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:12.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:12.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:12.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:12.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:12.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:12.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:12.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:12.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:12.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:12.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:12.255 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.255 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.256 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.256 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:12.256 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:12.256 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 65.800390264000001, 2024-04-25T22:02:12.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:12.256 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.256 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.256 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.256 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:12.256 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:12.256 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:12.256 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:12.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:12.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:12.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:12.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:12.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:12.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:12.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:12.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:12.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:12.266 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.266 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.266 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.266 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:12.266 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:12.266 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.534138992000003, 2024-04-25T22:02:12.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:02:12.266 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.267 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.267 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.267 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:12.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:12.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:02:12.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:12.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:02:12.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:02:12.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:02:12.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:02:12.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:02:12.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:02:12.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:02:12.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:02:12.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:02:12.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:02:12.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:02:12.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:02:12.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:02:12.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:02:12.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:02:12.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:02:12.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:02:12.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:02:12.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:02:12.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:02:12.272 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.272 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.272 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.272 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:12.272 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:12.272 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.534105152000002, 2024-04-25T22:02:12.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:02:12.273 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.273 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.273 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.273 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:12.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:12.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:12.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:02:12.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:02:12.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:02:12.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:02:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:02:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:02:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:02:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:02:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:02:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:02:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:02:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:02:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:02:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:02:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:02:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:02:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:02:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:02:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:02:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:02:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.278 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:12.278 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:12.278 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.534053456000002, 2024-04-25T22:02:12.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:02:12.278 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.278 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.278 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.278 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:12.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:12.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:02:12.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:02:12.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:02:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:02:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:02:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:02:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:02:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:02:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:02:12.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:02:12.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:02:12.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:02:12.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:02:12.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:02:12.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:02:12.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:02:12.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:02:12.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:02:12.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:02:12.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:02:12.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:02:12.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:02:12.283 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.283 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.283 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.283 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:12.283 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:12.283 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.533909004000002, 2024-04-25T22:02:12.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:02:12.283 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.283 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.284 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.284 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:12.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:12.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:02:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:02:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:02:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:02:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:02:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:02:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:02:12.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:02:12.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:02:12.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:02:12.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:02:12.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:02:12.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:02:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:02:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:02:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:02:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:02:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:02:12.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:02:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:02:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:02:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:02:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.533852283999998, 2024-04-25T22:02:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:02:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:02:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:02:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:02:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:02:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:02:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:02:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:02:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:02:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:02:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:02:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:02:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:02:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:02:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:02:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:02:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:02:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:02:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:02:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:02:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:02:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:02:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:02:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.294 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.294 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.294 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:12.294 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:12.294 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:12.295 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:12.295 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:12.296 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:12.296 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:12.297 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:12.297 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:12.298 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:12.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:12.295+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:12.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:12.395+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:12.428 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:12.428 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:12.444 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:12.497 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:12.494+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:12.598 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:12.594+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:12.607 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:12.607 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:12.621 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:12.659 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-25T22:02:12.699 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:12.694+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:12.742 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:12.743 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:12.756 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:12.764 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:02:12.764 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:02:12.765 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-04-25T22:02:12.765 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-04-25T22:02:12.804 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:12.802+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:12.888 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:12.888 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:12.901 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:12.898+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:12.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:12.927 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-04-25T22:02:13.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:12.999+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:13.065 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:13.065 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:13.079 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:13.080 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-04-25T22:02:13.102 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:13.102+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:13.197 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:13.197 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:13.203 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:13.202+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:13.211 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:13.304 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:13.302+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:13.345 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:13.346 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:13.360 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:13.405 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:13.402+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:13.486 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:13.486 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:13.500 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:13.545 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:13.542+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:13.606 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:13.602+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:13.674 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:13.674 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:13.689 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:13.733 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:13.730+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:13.808 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:13.802+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:13.820 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:13.820 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:13.836 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:13.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:13.907+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:13.960 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:13.960 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:13.974 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:14.011 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:14.006+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:14.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:14.111+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:14.137 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:14.137 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:14.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:14.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:14.211+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:14.286 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:14.286 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:14.299 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:02:14.300 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:14.314 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:14.309+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:14.415 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:14.414+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:14.416 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:14.416 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:14.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:14.456 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:14.457 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:14.477 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:14.477 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:14.497 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:14.516 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:14.509+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:14.603 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.774149147000003, 2024-04-25T22:02:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.773418328999995, 2024-04-25T22:02:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.772752057999995, 2024-04-25T22:02:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.771852158000002, 2024-04-25T22:02:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.769815816999994, 2024-04-25T22:02:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.769352479999995, 2024-04-25T22:02:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.768485600999995, 2024-04-25T22:02:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.768034526999998, 2024-04-25T22:02:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.767584940999996, 2024-04-25T22:02:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.970928454000003, 2024-04-25T22:02:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.970804471000001, 2024-04-25T22:02:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.970730535000001, 2024-04-25T22:02:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.970614283000003, 2024-04-25T22:02:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.970450874000001, 2024-04-25T22:02:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.970348678000001, 2024-04-25T22:02:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.970269725000001, 2024-04-25T22:02:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.970204701999997, 2024-04-25T22:02:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:14.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:14.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:14.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:14.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:14.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:14.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:14.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:14.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:14.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:14.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:14.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:14.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.688 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.688 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:14.688 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:14.688 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.97012651, 2024-04-25T22:02:14.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:14.688 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.688 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.688 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:14.689 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:14.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:14.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:14.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:14.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:14.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:14.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:14.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:14.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:14.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:14.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:14.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:14.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:14.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:14.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:14.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:14.692 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.692 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.692 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.692 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:14.692 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:14.692 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.955480049999998, 2024-04-25T22:02:14.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:14.692 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.693 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:14.693 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:14.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:14.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:14.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:14.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:14.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:14.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:14.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:14.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:14.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:14.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:14.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:14.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:14.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:14.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.955320094000001, 2024-04-25T22:02:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:14.701 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:14.702 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:02:14.703 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:14.698+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:14.704 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:14.803 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:14.798+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:14.839 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:14.839 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:14.839 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:14.839 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:14.853 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:14.904 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:14.902+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:14.972 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:14.972 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:14.972 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:14.972 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:14.972 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:14.986 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:15.005 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:15.002+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:15.106 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:15.102+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:15.109 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:15.109 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:15.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:15.109 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 69.111600089000007, 2024-04-25T22:02:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:02:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:02:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:02:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:02:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:02:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:02:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:02:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:02:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:02:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:02:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:02:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:02:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:02:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:02:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:02:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:02:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:02:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:02:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:02:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:02:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:02:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:02:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:02:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:02:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 68.929537015999998, 2024-04-25T22:02:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:02:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:02:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:02:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:02:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:02:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:02:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:02:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:02:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:02:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:02:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:02:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:02:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:02:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:02:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:02:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:02:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:02:15.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:02:15.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:02:15.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:02:15.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:02:15.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:02:15.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:02:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:02:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 68.929492736, 2024-04-25T22:02:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:02:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:02:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:02:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:02:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:02:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:02:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:02:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:02:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:02:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:02:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:02:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:02:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:02:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:02:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:02:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:02:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:02:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:02:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:02:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:02:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:02:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:02:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:02:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:02:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 68.929436210999995, 2024-04-25T22:02:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 68.929240969000006, 2024-04-25T22:02:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:15.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:15.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:15.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:15.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:15.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:15.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:15.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:15.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:15.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:15.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:15.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:15.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:15.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:15.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:15.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:15.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:15.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:15.137 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.137 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.137 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.138 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:15.138 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:15.138 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 68.929178676000006, 2024-04-25T22:02:15.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:15.138 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.138 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.138 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.138 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:15.138 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:15.138 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:15.138 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:15.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.138 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:15.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:15.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:15.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:15.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:15.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:15.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:15.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:15.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:15.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:15.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:15.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:15.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:15.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:15.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:15.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:15.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:15.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:15.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:15.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:15.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:15.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:15.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:15.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:15.143 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.143 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.143 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.143 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:15.143 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:15.143 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 68.929118459999998, 2024-04-25T22:02:15.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:15.143 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.143 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.144 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.144 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:15.144 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:15.144 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:15.144 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:15.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.144 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:15.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:15.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:15.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:15.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:15.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:15.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:15.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:15.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:15.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:15.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:15.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:15.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:15.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:15.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:15.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:15.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:15.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:15.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:15.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:15.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:15.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:15.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:15.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:15.149 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.149 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.149 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.149 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:15.149 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:15.149 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 68.928928948000006, 2024-04-25T22:02:15.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:15.149 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.150 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.150 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.150 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:15.150 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:15.150 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:15.150 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:15.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.150 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:15.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:15.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:15.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:15.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:15.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:15.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:15.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:15.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:15.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:15.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:15.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:15.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:15.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:15.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:15.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:15.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:15.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:15.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:15.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:15.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:15.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:15.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:15.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:15.154 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.155 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.155 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.155 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:15.155 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:15.155 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 68.737591113999997, 2024-04-25T22:02:15.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:02:15.155 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.155 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.155 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.155 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:15.155 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:15.155 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:15.155 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:02:15.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.156 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:15.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:15.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:02:15.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:02:15.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:02:15.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:02:15.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:02:15.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:02:15.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:02:15.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:02:15.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:02:15.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:02:15.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:02:15.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:02:15.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:02:15.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:02:15.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:02:15.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:02:15.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:02:15.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:02:15.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:02:15.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:02:15.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:02:15.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:02:15.160 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.160 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.160 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.160 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:15.160 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:15.160 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 68.737552737000001, 2024-04-25T22:02:15.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:02:15.161 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.161 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.161 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.161 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:15.161 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:15.161 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:15.161 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:02:15.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.161 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:15.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:15.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:02:15.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:02:15.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:02:15.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:02:15.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:02:15.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:02:15.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:02:15.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:02:15.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:02:15.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:02:15.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:02:15.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:02:15.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:02:15.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:02:15.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:02:15.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:02:15.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:02:15.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:02:15.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:02:15.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:02:15.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:02:15.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:02:15.166 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.166 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.166 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.166 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:15.166 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:15.166 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 68.737501477999999, 2024-04-25T22:02:15.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:02:15.166 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.166 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.167 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.167 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:15.167 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:15.167 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:15.167 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:02:15.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.167 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:15.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:15.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:02:15.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:02:15.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:02:15.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:02:15.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:02:15.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:02:15.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:02:15.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:02:15.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:02:15.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:02:15.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:02:15.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:02:15.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:02:15.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:02:15.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:02:15.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:02:15.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:02:15.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:02:15.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:02:15.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:02:15.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:02:15.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:02:15.173 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.174 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.174 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.174 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:15.174 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:15.174 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 68.737352829000002, 2024-04-25T22:02:15.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:02:15.174 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.174 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.174 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.174 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:15.174 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:15.174 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:15.175 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:02:15.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.175 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:15.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:15.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:02:15.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:02:15.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:02:15.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:02:15.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:02:15.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:02:15.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:02:15.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:02:15.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:02:15.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:02:15.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:02:15.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:02:15.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:02:15.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:02:15.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:02:15.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:02:15.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:02:15.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:02:15.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:02:15.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:02:15.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:02:15.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:02:15.179 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.179 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.179 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.180 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:15.180 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:15.180 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 68.737310679000004, 2024-04-25T22:02:15.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:02:15.180 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.180 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.180 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.180 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:15.180 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:15.180 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:15.180 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:02:15.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.180 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:02:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:02:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:02:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:02:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:02:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:02:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:02:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:02:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:02:15.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:02:15.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:02:15.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:02:15.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:02:15.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:02:15.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:02:15.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:02:15.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:02:15.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:02:15.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:02:15.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:02:15.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:02:15.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:02:15.185 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.185 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.185 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.185 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:15.185 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:15.185 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 68.737272825999995, 2024-04-25T22:02:15.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:15.185 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.185 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.185 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.186 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:15.186 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:15.186 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:15.186 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:15.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.186 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:15.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:15.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:15.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:15.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:15.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:15.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:15.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:15.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:15.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:15.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:15.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:15.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:15.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:15.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:15.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:15.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:15.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:15.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:15.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:15.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:15.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:15.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:15.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:15.190 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.190 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.190 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.191 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:15.191 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:15.191 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 68.737063500999994, 2024-04-25T22:02:15.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:15.191 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.191 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.191 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.191 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:15.191 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:15.191 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:15.191 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:15.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.191 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:15.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:15.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:15.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:15.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:15.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:15.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:15.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:15.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:15.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:15.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:15.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:15.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:15.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:15.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:15.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:15.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:15.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:15.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:15.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:15.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:15.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:15.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:15.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:15.196 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.196 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.196 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.196 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:15.196 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:15.196 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 60.470812229000003, 2024-04-25T22:02:15.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:02:15.196 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.197 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.197 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.197 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:15.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:15.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:02:15.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:15.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:02:15.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:02:15.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:02:15.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:02:15.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:02:15.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:02:15.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:02:15.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:02:15.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:02:15.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:02:15.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:02:15.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:02:15.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:02:15.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:02:15.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:02:15.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:02:15.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:02:15.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:02:15.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:02:15.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:02:15.201 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.201 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.201 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.201 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:15.201 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:15.201 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 60.470778389000003, 2024-04-25T22:02:15.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:02:15.202 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.202 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.202 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.202 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:15.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:15.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:15.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:02:15.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:02:15.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:02:15.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:02:15.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:02:15.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:02:15.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:02:15.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:02:15.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:02:15.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:02:15.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:02:15.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:02:15.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:02:15.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:02:15.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:02:15.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:15.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:02:15.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:02:15.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:02:15.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:02:15.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:02:15.206 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.206 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.206 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.206 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:15.207 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:15.207 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 60.470726693000003, 2024-04-25T22:02:15.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:02:15.207 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.207 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.207 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.207 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:15.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:15.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:02:15.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:02:15.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:02:15.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:02:15.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:02:15.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:02:15.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:02:15.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:02:15.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:02:15.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:02:15.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:02:15.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:02:15.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:02:15.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:02:15.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:02:15.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:02:15.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:02:15.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:02:15.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:02:15.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:02:15.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:02:15.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:02:15.211 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.211 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.211 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.212 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:15.212 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:15.212 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 60.470582241000002, 2024-04-25T22:02:15.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:02:15.212 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.212 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.212 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.212 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:15.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:15.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:02:15.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:02:15.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:02:15.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:02:15.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:02:15.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:02:15.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:02:15.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:02:15.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:02:15.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:02:15.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:02:15.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:02:15.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:02:15.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:02:15.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:02:15.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:02:15.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:02:15.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:02:15.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:02:15.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:02:15.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:02:15.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:02:15.217 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.217 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.217 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.217 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:15.217 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:15.217 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 60.470525520999999, 2024-04-25T22:02:15.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:02:15.217 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:15.217 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:15.217 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.217 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:15.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:15.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:15.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:15.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:15.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:15.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:15.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:02:15.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:02:15.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:15.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:02:15.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:02:15.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:15.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:02:15.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:02:15.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:02:15.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:02:15.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:15.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:02:15.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:02:15.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:15.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:02:15.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:02:15.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:02:15.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:02:15.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:15.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:02:15.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:02:15.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:02:15.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:02:15.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:15.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:02:15.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:02:15.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:15.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:15.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:15.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:02:15.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:02:15.222 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.222 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.222 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.222 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:15.222 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:15.222 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:15.224 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:15.224 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:15.221+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:15.325 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:15.321+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:15.354 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:02:15.354 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:15.368 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:15.426 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:15.426+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:15.494 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:15.494 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:15.494 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:02:15.494 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:02:15.494 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:15.509 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:15.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:15.555+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:15.628 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:15.626+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:15.629 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:02:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:02:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:02:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 4 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:27 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:02:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.988336156999999, 2024-04-25T22:02:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013281644, 2024-04-25T22:02:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637801+0000", 2024-04-25T22:02:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1299999999999998e-07 2024-04-25T22:02:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637828+0000", 2024-04-25T22:02:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6953000000000001e-05 2024-04-25T22:02:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637873+0000", 2024-04-25T22:02:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4676999999999999e-05 2024-04-25T22:02:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637917+0000", 2024-04-25T22:02:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4815999999999999e-05 2024-04-25T22:02:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644220+0000", 2024-04-25T22:02:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063021049999999997 2024-04-25T22:02:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651082+0000", 2024-04-25T22:02:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068621799999999998 2024-04-25T22:02:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:15 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.982928545, 2024-04-25T22:02:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010973732, 2024-04-25T22:02:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643209+0000", 2024-04-25T22:02:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.003e-06 2024-04-25T22:02:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643230+0000", 2024-04-25T22:02:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0815999999999999e-05 2024-04-25T22:02:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643252+0000", 2024-04-25T22:02:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2586999999999999e-05 2024-04-25T22:02:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643271+0000", 2024-04-25T22:02:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8493000000000001e-05 2024-04-25T22:02:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644387+0000", 2024-04-25T22:02:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011160250000000001 2024-04-25T22:02:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644434+0000", 2024-04-25T22:02:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:02:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654103+0000", 2024-04-25T22:02:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096691360000000001 2024-04-25T22:02:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654181+0000", 2024-04-25T22:02:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8546000000000003e-05 2024-04-25T22:02:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.982828189000003, 2024-04-25T22:02:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088132450000000008, 2024-04-25T22:02:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643309+0000", 2024-04-25T22:02:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9600000000000008e-07 2024-04-25T22:02:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643339+0000", 2024-04-25T22:02:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9467000000000001e-05 2024-04-25T22:02:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644245+0000", 2024-04-25T22:02:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090648200000000001 2024-04-25T22:02:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644268+0000", 2024-04-25T22:02:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3017e-05 2024-04-25T22:02:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647517+0000", 2024-04-25T22:02:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032491680000000002 2024-04-25T22:02:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647561+0000", 2024-04-25T22:02:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3630000000000001e-05 2024-04-25T22:02:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652041+0000", 2024-04-25T22:02:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044804529999999997 2024-04-25T22:02:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652121+0000", 2024-04-25T22:02:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0031999999999995e-05 2024-04-25T22:02:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:34 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.980739561999997, 2024-04-25T22:02:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089225940000000007, 2024-04-25T22:02:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645398+0000", 2024-04-25T22:02:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4360000000000001e-06 2024-04-25T22:02:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645412+0000", 2024-04-25T22:02:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4283e-05 2024-04-25T22:02:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645434+0000", 2024-04-25T22:02:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1237e-05 2024-04-25T22:02:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645459+0000", 2024-04-25T22:02:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5675999999999999e-05 2024-04-25T22:02:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646081+0000", 2024-04-25T22:02:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062128900000000002 2024-04-25T22:02:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646131+0000", 2024-04-25T22:02:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0322999999999999e-05 2024-04-25T22:02:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654185+0000", 2024-04-25T22:02:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080542749999999996 2024-04-25T22:02:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654319+0000", 2024-04-25T22:02:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013407499999999999 2024-04-25T22:02:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:19 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.980638053, 2024-04-25T22:02:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076631340000000003, 2024-04-25T22:02:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645499+0000", 2024-04-25T22:02:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4300000000000001e-07 2024-04-25T22:02:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645509+0000", 2024-04-25T22:02:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0244000000000001e-05 2024-04-25T22:02:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645523+0000", 2024-04-25T22:02:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3315999999999999e-05 2024-04-25T22:02:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645531+0000", 2024-04-25T22:02:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.123e-06 2024-04-25T22:02:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648260+0000", 2024-04-25T22:02:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027289789999999999 2024-04-25T22:02:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648307+0000", 2024-04-25T22:02:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6969999999999999e-05 2024-04-25T22:02:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653039+0000", 2024-04-25T22:02:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047322299999999996 2024-04-25T22:02:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653161+0000", 2024-04-25T22:02:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012232899999999999 2024-04-25T22:02:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.978660392000002, 2024-04-25T22:02:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01271303, 2024-04-25T22:02:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647479+0000", 2024-04-25T22:02:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.286e-06 2024-04-25T22:02:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647494+0000", 2024-04-25T22:02:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.521e-05 2024-04-25T22:02:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647525+0000", 2024-04-25T22:02:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0403999999999999e-05 2024-04-25T22:02:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647544+0000", 2024-04-25T22:02:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8743e-05 2024-04-25T22:02:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647895+0000", 2024-04-25T22:02:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035099699999999997 2024-04-25T22:02:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648202+0000", 2024-04-25T22:02:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030758499999999998 2024-04-25T22:02:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648496+0000", 2024-04-25T22:02:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029370699999999999 2024-04-25T22:02:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654605+0000", 2024-04-25T22:02:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061095999999999998 2024-04-25T22:02:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.659959+0000", 2024-04-25T22:02:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053531680000000002 2024-04-25T22:02:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660078+0000", 2024-04-25T22:02:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011981600000000001 2024-04-25T22:02:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660189+0000", 2024-04-25T22:02:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011051400000000001 2024-04-25T22:02:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.978536300000002, 2024-04-25T22:02:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013053006000000001, 2024-04-25T22:02:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647602+0000", 2024-04-25T22:02:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.604e-06 2024-04-25T22:02:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647611+0000", 2024-04-25T22:02:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5689999999999994e-06 2024-04-25T22:02:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647634+0000", 2024-04-25T22:02:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3227e-05 2024-04-25T22:02:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647660+0000", 2024-04-25T22:02:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5829999999999998e-05 2024-04-25T22:02:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649544+0000", 2024-04-25T22:02:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001884066 2024-04-25T22:02:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649783+0000", 2024-04-25T22:02:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238411 2024-04-25T22:02:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.650794+0000", 2024-04-25T22:02:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010109920000000001 2024-04-25T22:02:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654714+0000", 2024-04-25T22:02:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039202170000000001 2024-04-25T22:02:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660403+0000", 2024-04-25T22:02:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056895940000000001 2024-04-25T22:02:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660551+0000", 2024-04-25T22:02:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014717899999999999 2024-04-25T22:02:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660653+0000", 2024-04-25T22:02:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102317 2024-04-25T22:02:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:17 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.97845212, 2024-04-25T22:02:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010101435000000001, 2024-04-25T22:02:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647686+0000", 2024-04-25T22:02:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-04-25T22:02:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647693+0000", 2024-04-25T22:02:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7330000000000003e-06 2024-04-25T22:02:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647711+0000", 2024-04-25T22:02:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7436e-05 2024-04-25T22:02:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647727+0000", 2024-04-25T22:02:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6232999999999999e-05 2024-04-25T22:02:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649249+0000", 2024-04-25T22:02:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015219890000000001 2024-04-25T22:02:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649533+0000", 2024-04-25T22:02:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028391799999999997 2024-04-25T22:02:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649841+0000", 2024-04-25T22:02:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030853400000000001 2024-04-25T22:02:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654622+0000", 2024-04-25T22:02:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047809630000000001 2024-04-25T22:02:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657616+0000", 2024-04-25T22:02:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029938769999999998 2024-04-25T22:02:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657724+0000", 2024-04-25T22:02:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108109 2024-04-25T22:02:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657786+0000", 2024-04-25T22:02:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1196000000000002e-05 2024-04-25T22:02:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.978263792, 2024-04-25T22:02:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010260877999999999, 2024-04-25T22:02:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647874+0000", 2024-04-25T22:02:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:02:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647884+0000", 2024-04-25T22:02:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.013e-05 2024-04-25T22:02:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647908+0000", 2024-04-25T22:02:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3592999999999999e-05 2024-04-25T22:02:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647926+0000", 2024-04-25T22:02:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8176999999999999e-05 2024-04-25T22:02:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651480+0000", 2024-04-25T22:02:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035540160000000001 2024-04-25T22:02:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651690+0000", 2024-04-25T22:02:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210249 2024-04-25T22:02:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651986+0000", 2024-04-25T22:02:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000296001 2024-04-25T22:02:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655696+0000", 2024-04-25T22:02:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037098410000000002 2024-04-25T22:02:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657896+0000", 2024-04-25T22:02:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022004630000000002 2024-04-25T22:02:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658035+0000", 2024-04-25T22:02:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013831499999999999 2024-04-25T22:02:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658133+0000", 2024-04-25T22:02:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8553000000000003e-05 2024-04-25T22:02:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:18 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.978184912000003, 2024-04-25T22:02:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013108712, 2024-04-25T22:02:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647953+0000", 2024-04-25T22:02:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.697e-06 2024-04-25T22:02:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647963+0000", 2024-04-25T22:02:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9259999999999995e-06 2024-04-25T22:02:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647982+0000", 2024-04-25T22:02:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-04-25T22:02:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648008+0000", 2024-04-25T22:02:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5956e-05 2024-04-25T22:02:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651686+0000", 2024-04-25T22:02:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678073 2024-04-25T22:02:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652023+0000", 2024-04-25T22:02:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033739399999999998 2024-04-25T22:02:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652348+0000", 2024-04-25T22:02:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032475000000000001 2024-04-25T22:02:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655883+0000", 2024-04-25T22:02:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035353030000000001 2024-04-25T22:02:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660791+0000", 2024-04-25T22:02:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049075330000000004 2024-04-25T22:02:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660930+0000", 2024-04-25T22:02:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000139856 2024-04-25T22:02:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661060+0000", 2024-04-25T22:02:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000129651 2024-04-25T22:02:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.978108020000001, 2024-04-25T22:02:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012451034, 2024-04-25T22:02:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648030+0000", 2024-04-25T22:02:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-04-25T22:02:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648036+0000", 2024-04-25T22:02:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8059999999999997e-06 2024-04-25T22:02:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648054+0000", 2024-04-25T22:02:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7744000000000002e-05 2024-04-25T22:02:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648070+0000", 2024-04-25T22:02:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-04-25T22:02:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648875+0000", 2024-04-25T22:02:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080444000000000002 2024-04-25T22:02:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649078+0000", 2024-04-25T22:02:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020391499999999999 2024-04-25T22:02:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649674+0000", 2024-04-25T22:02:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00059555299999999997 2024-04-25T22:02:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653185+0000", 2024-04-25T22:02:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035113459999999998 2024-04-25T22:02:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660251+0000", 2024-04-25T22:02:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070661350000000003 2024-04-25T22:02:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660382+0000", 2024-04-25T22:02:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013095899999999999 2024-04-25T22:02:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660479+0000", 2024-04-25T22:02:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6852e-05 2024-04-25T22:02:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:25 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.978042207000001, 2024-04-25T22:02:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012691025999999999, 2024-04-25T22:02:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648095+0000", 2024-04-25T22:02:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.424e-06 2024-04-25T22:02:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648102+0000", 2024-04-25T22:02:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2099999999999998e-06 2024-04-25T22:02:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648122+0000", 2024-04-25T22:02:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0242999999999999e-05 2024-04-25T22:02:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648138+0000", 2024-04-25T22:02:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6192999999999999e-05 2024-04-25T22:02:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651461+0000", 2024-04-25T22:02:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033225709999999999 2024-04-25T22:02:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651776+0000", 2024-04-25T22:02:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031567500000000002 2024-04-25T22:02:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660785+0000", 2024-04-25T22:02:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090087099999999996 2024-04-25T22:02:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.977979720999997, 2024-04-25T22:02:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013102702000000001, 2024-04-25T22:02:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:15.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648158+0000", 2024-04-25T22:02:15.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2839999999999999e-06 2024-04-25T22:02:15.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648163+0000", 2024-04-25T22:02:15.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-04-25T22:02:15.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648181+0000", 2024-04-25T22:02:15.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8484000000000001e-05 2024-04-25T22:02:15.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648196+0000", 2024-04-25T22:02:15.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4496e-05 2024-04-25T22:02:15.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653737+0000", 2024-04-25T22:02:15.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055414009999999996 2024-04-25T22:02:15.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:15.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653972+0000", 2024-04-25T22:02:15.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000234732 2024-04-25T22:02:15.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661259+0000", 2024-04-25T22:02:15.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072872689999999999 2024-04-25T22:02:15.696 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.697 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.697 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:15.697 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:15.697 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.977922900999999, 2024-04-25T22:02:15.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086984829999999999, 2024-04-25T22:02:15.697 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.697 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:15.697 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:15.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:15.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648214+0000", 2024-04-25T22:02:15.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-04-25T22:02:15.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648233+0000", 2024-04-25T22:02:15.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.878e-05 2024-04-25T22:02:15.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648252+0000", 2024-04-25T22:02:15.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8603000000000001e-05 2024-04-25T22:02:15.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648267+0000", 2024-04-25T22:02:15.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:02:15.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648846+0000", 2024-04-25T22:02:15.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057923000000000002 2024-04-25T22:02:15.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649027+0000", 2024-04-25T22:02:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181585 2024-04-25T22:02:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.656912+0000", 2024-04-25T22:02:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078844589999999999 2024-04-25T22:02:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 6 lcod 17'2)", 2024-04-25T22:02:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.965992985, 2024-04-25T22:02:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064966000000000004, 2024-04-25T22:02:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:15.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:15.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660144+0000", 2024-04-25T22:02:15.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1800000000000005e-07 2024-04-25T22:02:15.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660181+0000", 2024-04-25T22:02:15.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6408000000000001e-05 2024-04-25T22:02:15.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660197+0000", 2024-04-25T22:02:15.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6177000000000001e-05 2024-04-25T22:02:15.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660210+0000", 2024-04-25T22:02:15.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:02:15.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660556+0000", 2024-04-25T22:02:15.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034612899999999998 2024-04-25T22:02:15.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660793+0000", 2024-04-25T22:02:15.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023656799999999999 2024-04-25T22:02:15.705 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.705 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.705 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.705 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:18 3.1f e17/15 ondisk, result = 0)", 2024-04-25T22:02:15.705 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:15.705 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.965731212000001, 2024-04-25T22:02:15.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067878299999999997, 2024-04-25T22:02:15.705 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.706 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.706 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:15.706 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:15.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:15.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660406+0000", 2024-04-25T22:02:15.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2800000000000005e-07 2024-04-25T22:02:15.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660412+0000", 2024-04-25T22:02:15.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0399999999999998e-06 2024-04-25T22:02:15.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660429+0000", 2024-04-25T22:02:15.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7394e-05 2024-04-25T22:02:15.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660445+0000", 2024-04-25T22:02:15.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6069000000000001e-05 2024-04-25T22:02:15.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660757+0000", 2024-04-25T22:02:15.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031194300000000002 2024-04-25T22:02:15.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:15.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660776+0000", 2024-04-25T22:02:15.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8862999999999999e-05 2024-04-25T22:02:15.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661084+0000", 2024-04-25T22:02:15.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030754600000000001 2024-04-25T22:02:15.709 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.709 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.709 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.710 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-25T22:02:15.710 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:15.710 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.965666984000002, 2024-04-25T22:02:15.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080007600000000004, 2024-04-25T22:02:15.710 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.710 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.710 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:15.710 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:15.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:15.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660470+0000", 2024-04-25T22:02:15.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4499999999999996e-07 2024-04-25T22:02:15.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660475+0000", 2024-04-25T22:02:15.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-04-25T22:02:15.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660490+0000", 2024-04-25T22:02:15.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5274e-05 2024-04-25T22:02:15.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660501+0000", 2024-04-25T22:02:15.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0694e-05 2024-04-25T22:02:15.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661130+0000", 2024-04-25T22:02:15.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062887499999999999 2024-04-25T22:02:15.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661269+0000", 2024-04-25T22:02:15.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013955900000000001 2024-04-25T22:02:15.713 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.713 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.713 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.713 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:02:15.713 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:15.714 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.001934984999998, 2024-04-25T22:02:15.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037104880000000001, 2024-04-25T22:02:15.714 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.714 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.714 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.714 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:15.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:15.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624204+0000", 2024-04-25T22:02:15.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.757e-06 2024-04-25T22:02:15.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624233+0000", 2024-04-25T22:02:15.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9362000000000001e-05 2024-04-25T22:02:15.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624264+0000", 2024-04-25T22:02:15.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0843000000000003e-05 2024-04-25T22:02:15.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624280+0000", 2024-04-25T22:02:15.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5577e-05 2024-04-25T22:02:15.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624458+0000", 2024-04-25T22:02:15.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017821199999999999 2024-04-25T22:02:15.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:15.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624661+0000", 2024-04-25T22:02:15.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020283200000000001 2024-04-25T22:02:15.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:15.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624842+0000", 2024-04-25T22:02:15.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018115500000000001 2024-04-25T22:02:15.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:15.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.626271+0000", 2024-04-25T22:02:15.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001429416 2024-04-25T22:02:15.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627749+0000", 2024-04-25T22:02:15.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014778650000000001 2024-04-25T22:02:15.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:15.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627849+0000", 2024-04-25T22:02:15.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9261999999999999e-05 2024-04-25T22:02:15.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627912+0000", 2024-04-25T22:02:15.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3207000000000007e-05 2024-04-25T22:02:15.719 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.719 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.719 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.720 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-25T22:02:15.720 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:15.720 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.999237633999996, 2024-04-25T22:02:15.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029804620000000001, 2024-04-25T22:02:15.720 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.720 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.720 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:15.720 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:15.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:15.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626903+0000", 2024-04-25T22:02:15.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0029999999999996e-06 2024-04-25T22:02:15.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626921+0000", 2024-04-25T22:02:15.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8272999999999999e-05 2024-04-25T22:02:15.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626959+0000", 2024-04-25T22:02:15.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7843999999999999e-05 2024-04-25T22:02:15.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626977+0000", 2024-04-25T22:02:15.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7756000000000001e-05 2024-04-25T22:02:15.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627153+0000", 2024-04-25T22:02:15.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017643800000000001 2024-04-25T22:02:15.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:15.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627425+0000", 2024-04-25T22:02:15.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027207300000000001 2024-04-25T22:02:15.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:15.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627848+0000", 2024-04-25T22:02:15.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042297199999999997 2024-04-25T22:02:15.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:15.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629590+0000", 2024-04-25T22:02:15.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017416809999999999 2024-04-25T22:02:15.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:15.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629720+0000", 2024-04-25T22:02:15.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130526 2024-04-25T22:02:15.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:15.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629808+0000", 2024-04-25T22:02:15.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7449999999999998e-05 2024-04-25T22:02:15.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629879+0000", 2024-04-25T22:02:15.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1445999999999993e-05 2024-04-25T22:02:15.726 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.726 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.726 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.726 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4185.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-04-25T22:02:15.726 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:15.726 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.011129564000001, 2024-04-25T22:02:15.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0036257939999999999, 2024-04-25T22:02:15.727 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:15.727 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:15.727 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:15.727 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:15.727 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4185", 2024-04-25T22:02:15.727 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.44:0/2048337248", 2024-04-25T22:02:15.727 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2 2024-04-25T22:02:15.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.727 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:15.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:15.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:15.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:15.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:15.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:15.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:15.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615010+0000", 2024-04-25T22:02:15.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8059999999999999e-06 2024-04-25T22:02:15.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:15.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615023+0000", 2024-04-25T22:02:15.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3159999999999999e-05 2024-04-25T22:02:15.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:15.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615043+0000", 2024-04-25T22:02:15.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:02:15.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:15.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615059+0000", 2024-04-25T22:02:15.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5519000000000002e-05 2024-04-25T22:02:15.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615241+0000", 2024-04-25T22:02:15.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018207100000000001 2024-04-25T22:02:15.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:02:15.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615258+0000", 2024-04-25T22:02:15.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7278999999999998e-05 2024-04-25T22:02:15.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:15.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618429+0000", 2024-04-25T22:02:15.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003171213 2024-04-25T22:02:15.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:15.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:15.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:15.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618633+0000", 2024-04-25T22:02:15.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020343999999999999 2024-04-25T22:02:15.731 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.732 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.732 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.732 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:15.732 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:15.732 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:15.734 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-25T22:02:15.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:15.735 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:15.729+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:15.834 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:15.830+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:15.865 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:15.865 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:15.865 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:02:15.865 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:15.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:15.935 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:15.933+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:16.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:16.035+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:16.048 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:16.048 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:16.048 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:02:16.048 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:02:16.048 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:16.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:16.136 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:16.134+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:16.189 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.361295006999995, 2024-04-25T22:02:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.360564189000002, 2024-04-25T22:02:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.359897918000001, 2024-04-25T22:02:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.358998017999994, 2024-04-25T22:02:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:16.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:16.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:16.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:16.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:16.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:16.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:16.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:16.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.210 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.210 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:16.211 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:16.211 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.356961677000001, 2024-04-25T22:02:16.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:16.211 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.211 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.211 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:16.211 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:16.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:16.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:16.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:16.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:16.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:16.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:16.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:16.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.356498340000002, 2024-04-25T22:02:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.355631461000002, 2024-04-25T22:02:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.355180387000004, 2024-04-25T22:02:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:16.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:16.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:16.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:16.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:16.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:16.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:16.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.231 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.231 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:16.231 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:16.232 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.354730801000002, 2024-04-25T22:02:16.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:16.232 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.232 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.232 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:16.232 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:16.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:16.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:16.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:16.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:16.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:16.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:16.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:16.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:16.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:16.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:16.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:16.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:16.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:16.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:16.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:16.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:16.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:16.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:16.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.238 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.238 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.238 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:16.238 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:16.238 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.558074314000002, 2024-04-25T22:02:16.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:16.239 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.239 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:16.239 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:16.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:16.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:16.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:16.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:16.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:16.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:16.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:16.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:16.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:16.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:16.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:16.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:16.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.557950331000001, 2024-04-25T22:02:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.557876395000001, 2024-04-25T22:02:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.557760143000003, 2024-04-25T22:02:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.557596734000001, 2024-04-25T22:02:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:16.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:16.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:16.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:16.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:16.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:16.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:16.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:16.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:16.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:16.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:16.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:16.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:16.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:16.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:16.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:16.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:16.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:16.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:16.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:16.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:16.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:16.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:16.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:16.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:16.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:16.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:16.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.268 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.268 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:16.268 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:16.269 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.557494538, 2024-04-25T22:02:16.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:16.269 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.269 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.269 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:16.269 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:16.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:16.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:16.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:16.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:16.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:16.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:16.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:16.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:16.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:16.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:16.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:16.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:16.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:16.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:16.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:16.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:16.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:16.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:16.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:16.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:16.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:16.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:16.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:16.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:16.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:16.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:16.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:16.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.276 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.276 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:16.276 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:16.276 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.557415585000001, 2024-04-25T22:02:16.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:16.276 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.276 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:16.276 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:16.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:16.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:16.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:16.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:16.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:16.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:16.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:16.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:16.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:16.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:16.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:16.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:16.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:16.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:16.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:16.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:16.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:16.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:16.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:16.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:16.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:16.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:16.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:16.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:16.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:16.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:16.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:16.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.281 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.281 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:16.281 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:16.281 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.557350562000003, 2024-04-25T22:02:16.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:16.281 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.281 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:16.281 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:16.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:16.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:16.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:16.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:16.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:16.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:16.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:16.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:16.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:16.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:16.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:16.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:16.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:16.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:16.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:16.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.285 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.285 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:16.285 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:16.285 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.55727237, 2024-04-25T22:02:16.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:16.285 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.285 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.285 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:16.286 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:16.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:16.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:16.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:16.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:16.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:16.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:16.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:16.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:16.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:16.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:16.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:16.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:16.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:16.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:16.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:16.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.289 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.290 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:16.290 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:16.290 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.542625909999998, 2024-04-25T22:02:16.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:16.290 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.290 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.290 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:16.290 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:16.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:16.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:16.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:16.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:16.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:16.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:16.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:16.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:16.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:16.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:16.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:16.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:16.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:16.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:16.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:16.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:16.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:16.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:16.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.294 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.295 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:16.295 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:16.295 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.542465954000001, 2024-04-25T22:02:16.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:16.295 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:16.295 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:16.295 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:16.295 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:16.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:16.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:16.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:16.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:16.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:16.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:16.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:16.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:16.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:16.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:16.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:16.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:16.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:16.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:16.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:16.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:16.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:16.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:16.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:16.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:16.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:16.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:16.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:16.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:16.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:16.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:16.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:16.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:16.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:16.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:16.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:16.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.300 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:16.300 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:16.300 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:16.303 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:16.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:16.299+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:16.405 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:16.397+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:16.437 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:16.438 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:16.438 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:16.438 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:16.452 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:16.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:16.503+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:16.514 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:02:16.604 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:16.597+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:16.619 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:16.619 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:16.619 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:16.619 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:16.619 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:16.633 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:16.669 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:16.670 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:16.691 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:16.691 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:16.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:16.703+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:16.711 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:16.711 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:16.802 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:16.802 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:16.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:16.807+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:16.816 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:16.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:16.907+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:16.948 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:16.949 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:16.963 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:17.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:17.007+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:17.111 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:17.109+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:17.130 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:17.130 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:17.146 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:17.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:17.211+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:17.262 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:17.263 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:17.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:17.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:17.319+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:17.411 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:17.411 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:17.414 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:17.411+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:17.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:17.515 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:17.509+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:17.551 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:17.552 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:17.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:17.616 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:17.613+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:17.687 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:17.687 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:17.701 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:17.717 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:17.715+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:17.736 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:02:17.818 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:17.814+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:17.838 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:17.838 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:17.851 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:17.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:17.919+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:17.979 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:17.979 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:17.994 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:18.041 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:18.037+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:18.113 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:18.113 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:18.120 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:18.113+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:18.127 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:18.221 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:18.217+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:18.253 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:02:18.253 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T22:02:18.259 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:18.259 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:18.275 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:18.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:18.319+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:18.398 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:18.398 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:18.412 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:18.422 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:18.417+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:18.523 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:18.522+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:18.574 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:18.574 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:18.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:18.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:18.623+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:18.675 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T22:02:18.682 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-25T22:02:18.703 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T22:02:18.723 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:18.724 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:18.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:18.723+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:18.728 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:02:18.737 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:18.825 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:18.822+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:18.858 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:18.858 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:18.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:18.914 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:18.915 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:18.936 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:18.936 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:18.955 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:18.959 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:18.958+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:19.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:19.027+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:19.040 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:19.040 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:19.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:19.040 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:19.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.040 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:19.040 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:19.040 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.211317503999993, 2024-04-25T22:02:19.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:19.040 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.040 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.041 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.041 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:19.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:19.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:19.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:19.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:19.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:19.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:19.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:19.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:19.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:19.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:19.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:19.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:19.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:19.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:19.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:19.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:19.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:19.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:19.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.044 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.044 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:19.044 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:19.044 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.210586685999999, 2024-04-25T22:02:19.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:19.045 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.045 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.045 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.045 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:19.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:19.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:19.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:19.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:19.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:19.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:19.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:19.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:19.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:19.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:19.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:19.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:19.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:19.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:19.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:19.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:19.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:19.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:19.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.048 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.049 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:19.049 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:19.049 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.209920414999999, 2024-04-25T22:02:19.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:19.049 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.049 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.049 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:19.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:19.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:19.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:19.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:19.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:19.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:19.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:19.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:19.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:19.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:19.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:19.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:19.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:19.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:19.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:19.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:19.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:19.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:19.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.052 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.053 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:19.053 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:19.053 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.209020515000006, 2024-04-25T22:02:19.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:19.053 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.053 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.053 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:19.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:19.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:19.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:19.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:19.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:19.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:19.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:19.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:19.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:19.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:19.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:19.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:19.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:19.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:19.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:19.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:19.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:19.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:19.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.206984173999999, 2024-04-25T22:02:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:19.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:19.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.206520836999999, 2024-04-25T22:02:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:19.061 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.205653957999999, 2024-04-25T22:02:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:19.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:19.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:19.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:19.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:19.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:19.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:19.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:19.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:19.070 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.205202884000002, 2024-04-25T22:02:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:19.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.204753298, 2024-04-25T22:02:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:19.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:19.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:19.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:19.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:19.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:19.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.079 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.408096810999993, 2024-04-25T22:02:19.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:19.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:19.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:19.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:19.086 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.407972827999998, 2024-04-25T22:02:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:19.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:19.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.407898892000006, 2024-04-25T22:02:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:19.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:19.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:19.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:19.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.407782639999994, 2024-04-25T22:02:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.407619230999998, 2024-04-25T22:02:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.106 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:19.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:19.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:19.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.407517034999998, 2024-04-25T22:02:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:19.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:19.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:19.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.407438081999999, 2024-04-25T22:02:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:19.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:19.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:19.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:19.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:19.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:19.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:19.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:19.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:19.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:19.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:19.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:19.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.407373058999994, 2024-04-25T22:02:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:19.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:19.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.407294867000005, 2024-04-25T22:02:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.392648406999996, 2024-04-25T22:02:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:19.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.392488451000006, 2024-04-25T22:02:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:19.142 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:19.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:19.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:19.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:19.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:19.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:19.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:19.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:19.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.150 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:19.150 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:19.151 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:19.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:19.151+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:19.154 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:19.253 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:19.249+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:19.291 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:19.291 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:19.291 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:19.292 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:19.305 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:19.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:19.351+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:19.455 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:19.454+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:19.480 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:19.480 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:19.480 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:19.481 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:19.482 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:19.495 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:19.556 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:19.554+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:19.620 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:19.620 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:19.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:19.620 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:19.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.620 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:19.620 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:19.620 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.622061005000006, 2024-04-25T22:02:19.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:02:19.620 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:02:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:19.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:02:19.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:02:19.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:02:19.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:02:19.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:02:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:02:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:02:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:02:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:02:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:02:19.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:02:19.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:02:19.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:02:19.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:02:19.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:02:19.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:02:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:02:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:02:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:02:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:02:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:02:19.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:02:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.439997931999997, 2024-04-25T22:02:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:02:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:19.626 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:02:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:02:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:02:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:02:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:02:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:02:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:02:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:02:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:02:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:02:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:02:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:02:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:02:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:02:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:02:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:02:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:02:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:02:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:02:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:02:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:02:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:02:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:02:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:19.631 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.439953652, 2024-04-25T22:02:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:02:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:02:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:19.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:19.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:02:19.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:02:19.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:02:19.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:02:19.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:02:19.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:02:19.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:02:19.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:02:19.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:02:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:02:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:02:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:02:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:02:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:02:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:02:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:02:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:02:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:02:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:02:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:02:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:02:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:02:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.439897126999995, 2024-04-25T22:02:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.637 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:19.638 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:19.638 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:19.638 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:19.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.638 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:19.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:19.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:19.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:19.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:19.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:19.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:19.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:19.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:19.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:19.642 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.642 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.642 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.439701885000005, 2024-04-25T22:02:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:19.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:19.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:19.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:19.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:19.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:19.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.439639592000006, 2024-04-25T22:02:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:19.648 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:19.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:19.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:19.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:19.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:19.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.653 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.654 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.654 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:19.654 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:19.654 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.439579375999998, 2024-04-25T22:02:19.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:19.654 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.654 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.654 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.654 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:19.654 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:19.654 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:19.654 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:19.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:19.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:19.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:19.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:19.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:19.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:19.659 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.439389864000006, 2024-04-25T22:02:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:19.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:19.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:19.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:19.665 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.665 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.665 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.665 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:19.665 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:19.665 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.248052029999997, 2024-04-25T22:02:19.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:02:19.665 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.665 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.665 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.665 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:19.665 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:19.666 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:19.666 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:02:19.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.666 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:19.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:19.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:02:19.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:02:19.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:02:19.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:02:19.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:02:19.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:02:19.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:02:19.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:02:19.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:02:19.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:02:19.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:02:19.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:02:19.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:02:19.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:02:19.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:02:19.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:02:19.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:02:19.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:02:19.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:02:19.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:02:19.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:02:19.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:02:19.670 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.670 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.670 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.671 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:19.671 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:19.671 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.248013653000001, 2024-04-25T22:02:19.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:02:19.671 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.671 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.671 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.671 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:19.671 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:19.671 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:19.671 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:02:19.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.671 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:19.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:19.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:02:19.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:02:19.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:02:19.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:02:19.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:02:19.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:02:19.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:02:19.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:02:19.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:02:19.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:02:19.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:02:19.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:02:19.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:02:19.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:02:19.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:02:19.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:02:19.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:02:19.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:02:19.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:02:19.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:02:19.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:02:19.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:02:19.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.676 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.676 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:19.676 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:19.676 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.247962393999998, 2024-04-25T22:02:19.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:02:19.676 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.676 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.676 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.676 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:19.677 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:19.677 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:19.677 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:02:19.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.677 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:19.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:19.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:02:19.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:02:19.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:02:19.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:02:19.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:02:19.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:02:19.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:02:19.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:02:19.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:02:19.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:02:19.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:02:19.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:02:19.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:02:19.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:02:19.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:02:19.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:02:19.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:02:19.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:02:19.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:02:19.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:02:19.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:02:19.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:02:19.685 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.685 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.685 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.685 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:19.685 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:19.686 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.247813745000002, 2024-04-25T22:02:19.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:02:19.686 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.686 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.686 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.686 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:19.686 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:19.686 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:19.686 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:02:19.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.686 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:19.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:19.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:02:19.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:02:19.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:02:19.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:02:19.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:02:19.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:02:19.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:02:19.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:02:19.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:02:19.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:02:19.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:02:19.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:02:19.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:02:19.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:02:19.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:02:19.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:02:19.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:02:19.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:02:19.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:02:19.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:02:19.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:02:19.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:02:19.690 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.691 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.691 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.691 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:19.691 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:19.691 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.247771595000003, 2024-04-25T22:02:19.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:02:19.691 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.691 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.691 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.691 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:19.691 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:19.691 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:19.691 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:02:19.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.692 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:19.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:19.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:02:19.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:02:19.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:02:19.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:02:19.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:02:19.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:02:19.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:02:19.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:02:19.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:02:19.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:02:19.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:02:19.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:02:19.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:02:19.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:02:19.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:02:19.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:02:19.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:02:19.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:02:19.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:02:19.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:02:19.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:02:19.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:02:19.696 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.696 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.696 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.696 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:19.696 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:19.697 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.247733741999994, 2024-04-25T22:02:19.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:19.697 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.697 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.697 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.697 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:19.697 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:19.697 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:19.697 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:19.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.697 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:19.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:19.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:19.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:19.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:19.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:19.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:19.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:19.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:19.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:19.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:19.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:19.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:19.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:19.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:19.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:19.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:19.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:19.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:19.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:19.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:19.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:19.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:19.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:19.701 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.701 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.701 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.701 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:19.702 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:19.702 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.247524416999994, 2024-04-25T22:02:19.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:19.702 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.702 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.702 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.702 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:19.702 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:19.702 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:19.702 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:19.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.702 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:19.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:19.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:19.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:19.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:19.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:19.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:19.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:19.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:19.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:19.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:19.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:19.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:19.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:19.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:19.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:19.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:19.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:19.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:19.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:19.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:19.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:19.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:19.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:19.707 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.707 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.707 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.707 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:19.707 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:19.707 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.981273145000003, 2024-04-25T22:02:19.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:02:19.707 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.707 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.707 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.707 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:19.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:19.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:02:19.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:19.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:02:19.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:02:19.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:02:19.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:02:19.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:02:19.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:02:19.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:02:19.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:02:19.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:02:19.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:02:19.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:02:19.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:02:19.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:02:19.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:02:19.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:02:19.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:02:19.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:02:19.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:02:19.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:02:19.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:02:19.712 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.712 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.712 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.712 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:19.712 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:19.712 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.981239305000003, 2024-04-25T22:02:19.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:02:19.712 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.713 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.713 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.713 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:19.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:19.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:19.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:02:19.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:02:19.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:02:19.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:02:19.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:02:19.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:02:19.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:02:19.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:02:19.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:02:19.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:02:19.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:02:19.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:02:19.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:02:19.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:02:19.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:02:19.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:19.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:02:19.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:02:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:02:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:02:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:02:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.981187609000003, 2024-04-25T22:02:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:02:19.718 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.718 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.718 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.718 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:19.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:19.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:02:19.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:02:19.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:02:19.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:02:19.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:02:19.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:02:19.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:02:19.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:02:19.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:02:19.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:02:19.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:02:19.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:02:19.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:02:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:02:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:02:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:02:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:02:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:02:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:02:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:02:19.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:02:19.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:02:19.722 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.722 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.722 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.722 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:19.722 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:19.722 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.981043157000002, 2024-04-25T22:02:19.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:02:19.722 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.723 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.723 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.723 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:19.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:19.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:02:19.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:02:19.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:02:19.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:02:19.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:02:19.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:02:19.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:02:19.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:02:19.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:02:19.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:02:19.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:02:19.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:02:19.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:02:19.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:02:19.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:02:19.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:02:19.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:02:19.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:02:19.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:02:19.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:02:19.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:02:19.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:02:19.727 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.727 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.727 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.727 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:19.728 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:19.728 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 64.980986436999999, 2024-04-25T22:02:19.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:02:19.728 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:19.728 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:19.728 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:19.728 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:19.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:19.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:19.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:19.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:19.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:19.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:19.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:02:19.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:02:19.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:19.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:02:19.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:02:19.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:19.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:02:19.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:02:19.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:19.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:02:19.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:02:19.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:19.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:02:19.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:02:19.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:19.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:02:19.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:02:19.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:19.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:02:19.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:02:19.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:19.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:02:19.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:02:19.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:19.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:02:19.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:02:19.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:19.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:02:19.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:02:19.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:19.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:19.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:19.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:02:19.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:02:19.732 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.732 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.732 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.732 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:19.733 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:19.733 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:19.735 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T22:02:19.735 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:19.735 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:19.733+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:19.736 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T22:02:19.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:19.835+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:19.867 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:02:19.867 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:19.882 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:19.935 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:19.934+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:20.037 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:20.033+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:20.047 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:02:20.047 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:02:20.047 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:20.061 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:20.138 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:20.134+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:20.181 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:02:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:02:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:02:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 4 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:27 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:02:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.542185183000001, 2024-04-25T22:02:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013281644, 2024-04-25T22:02:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637801+0000", 2024-04-25T22:02:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1299999999999998e-07 2024-04-25T22:02:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637828+0000", 2024-04-25T22:02:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6953000000000001e-05 2024-04-25T22:02:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637873+0000", 2024-04-25T22:02:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4676999999999999e-05 2024-04-25T22:02:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637917+0000", 2024-04-25T22:02:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4815999999999999e-05 2024-04-25T22:02:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644220+0000", 2024-04-25T22:02:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063021049999999997 2024-04-25T22:02:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651082+0000", 2024-04-25T22:02:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068621799999999998 2024-04-25T22:02:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:15 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.536777571000002, 2024-04-25T22:02:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010973732, 2024-04-25T22:02:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643209+0000", 2024-04-25T22:02:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.003e-06 2024-04-25T22:02:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643230+0000", 2024-04-25T22:02:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0815999999999999e-05 2024-04-25T22:02:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643252+0000", 2024-04-25T22:02:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2586999999999999e-05 2024-04-25T22:02:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643271+0000", 2024-04-25T22:02:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8493000000000001e-05 2024-04-25T22:02:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644387+0000", 2024-04-25T22:02:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011160250000000001 2024-04-25T22:02:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644434+0000", 2024-04-25T22:02:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:02:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654103+0000", 2024-04-25T22:02:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096691360000000001 2024-04-25T22:02:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654181+0000", 2024-04-25T22:02:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8546000000000003e-05 2024-04-25T22:02:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.536677214999997, 2024-04-25T22:02:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088132450000000008, 2024-04-25T22:02:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643309+0000", 2024-04-25T22:02:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9600000000000008e-07 2024-04-25T22:02:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643339+0000", 2024-04-25T22:02:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9467000000000001e-05 2024-04-25T22:02:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644245+0000", 2024-04-25T22:02:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090648200000000001 2024-04-25T22:02:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644268+0000", 2024-04-25T22:02:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3017e-05 2024-04-25T22:02:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647517+0000", 2024-04-25T22:02:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032491680000000002 2024-04-25T22:02:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647561+0000", 2024-04-25T22:02:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3630000000000001e-05 2024-04-25T22:02:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652041+0000", 2024-04-25T22:02:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044804529999999997 2024-04-25T22:02:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652121+0000", 2024-04-25T22:02:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0031999999999995e-05 2024-04-25T22:02:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:34 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.534588588000005, 2024-04-25T22:02:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089225940000000007, 2024-04-25T22:02:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645398+0000", 2024-04-25T22:02:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4360000000000001e-06 2024-04-25T22:02:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645412+0000", 2024-04-25T22:02:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4283e-05 2024-04-25T22:02:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645434+0000", 2024-04-25T22:02:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1237e-05 2024-04-25T22:02:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645459+0000", 2024-04-25T22:02:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5675999999999999e-05 2024-04-25T22:02:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646081+0000", 2024-04-25T22:02:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062128900000000002 2024-04-25T22:02:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646131+0000", 2024-04-25T22:02:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0322999999999999e-05 2024-04-25T22:02:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654185+0000", 2024-04-25T22:02:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080542749999999996 2024-04-25T22:02:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654319+0000", 2024-04-25T22:02:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013407499999999999 2024-04-25T22:02:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:19 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.534487079000002, 2024-04-25T22:02:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076631340000000003, 2024-04-25T22:02:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645499+0000", 2024-04-25T22:02:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4300000000000001e-07 2024-04-25T22:02:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645509+0000", 2024-04-25T22:02:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0244000000000001e-05 2024-04-25T22:02:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645523+0000", 2024-04-25T22:02:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3315999999999999e-05 2024-04-25T22:02:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645531+0000", 2024-04-25T22:02:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.123e-06 2024-04-25T22:02:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648260+0000", 2024-04-25T22:02:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027289789999999999 2024-04-25T22:02:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648307+0000", 2024-04-25T22:02:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6969999999999999e-05 2024-04-25T22:02:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653039+0000", 2024-04-25T22:02:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047322299999999996 2024-04-25T22:02:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653161+0000", 2024-04-25T22:02:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012232899999999999 2024-04-25T22:02:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.532509418000004, 2024-04-25T22:02:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01271303, 2024-04-25T22:02:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647479+0000", 2024-04-25T22:02:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.286e-06 2024-04-25T22:02:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647494+0000", 2024-04-25T22:02:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.521e-05 2024-04-25T22:02:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647525+0000", 2024-04-25T22:02:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0403999999999999e-05 2024-04-25T22:02:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647544+0000", 2024-04-25T22:02:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8743e-05 2024-04-25T22:02:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647895+0000", 2024-04-25T22:02:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035099699999999997 2024-04-25T22:02:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648202+0000", 2024-04-25T22:02:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030758499999999998 2024-04-25T22:02:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648496+0000", 2024-04-25T22:02:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029370699999999999 2024-04-25T22:02:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654605+0000", 2024-04-25T22:02:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061095999999999998 2024-04-25T22:02:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.659959+0000", 2024-04-25T22:02:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053531680000000002 2024-04-25T22:02:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660078+0000", 2024-04-25T22:02:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011981600000000001 2024-04-25T22:02:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660189+0000", 2024-04-25T22:02:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011051400000000001 2024-04-25T22:02:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.532385325999996, 2024-04-25T22:02:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013053006000000001, 2024-04-25T22:02:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647602+0000", 2024-04-25T22:02:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.604e-06 2024-04-25T22:02:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647611+0000", 2024-04-25T22:02:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5689999999999994e-06 2024-04-25T22:02:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647634+0000", 2024-04-25T22:02:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3227e-05 2024-04-25T22:02:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647660+0000", 2024-04-25T22:02:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5829999999999998e-05 2024-04-25T22:02:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649544+0000", 2024-04-25T22:02:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001884066 2024-04-25T22:02:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649783+0000", 2024-04-25T22:02:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238411 2024-04-25T22:02:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.650794+0000", 2024-04-25T22:02:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010109920000000001 2024-04-25T22:02:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654714+0000", 2024-04-25T22:02:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039202170000000001 2024-04-25T22:02:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660403+0000", 2024-04-25T22:02:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056895940000000001 2024-04-25T22:02:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660551+0000", 2024-04-25T22:02:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014717899999999999 2024-04-25T22:02:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660653+0000", 2024-04-25T22:02:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102317 2024-04-25T22:02:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:17 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.532301145999995, 2024-04-25T22:02:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010101435000000001, 2024-04-25T22:02:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647686+0000", 2024-04-25T22:02:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-04-25T22:02:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647693+0000", 2024-04-25T22:02:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7330000000000003e-06 2024-04-25T22:02:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647711+0000", 2024-04-25T22:02:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7436e-05 2024-04-25T22:02:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647727+0000", 2024-04-25T22:02:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6232999999999999e-05 2024-04-25T22:02:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649249+0000", 2024-04-25T22:02:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015219890000000001 2024-04-25T22:02:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649533+0000", 2024-04-25T22:02:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028391799999999997 2024-04-25T22:02:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649841+0000", 2024-04-25T22:02:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030853400000000001 2024-04-25T22:02:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654622+0000", 2024-04-25T22:02:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047809630000000001 2024-04-25T22:02:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657616+0000", 2024-04-25T22:02:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029938769999999998 2024-04-25T22:02:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657724+0000", 2024-04-25T22:02:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108109 2024-04-25T22:02:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657786+0000", 2024-04-25T22:02:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1196000000000002e-05 2024-04-25T22:02:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.532112818000002, 2024-04-25T22:02:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010260877999999999, 2024-04-25T22:02:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647874+0000", 2024-04-25T22:02:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:02:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647884+0000", 2024-04-25T22:02:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.013e-05 2024-04-25T22:02:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647908+0000", 2024-04-25T22:02:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3592999999999999e-05 2024-04-25T22:02:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647926+0000", 2024-04-25T22:02:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8176999999999999e-05 2024-04-25T22:02:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651480+0000", 2024-04-25T22:02:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035540160000000001 2024-04-25T22:02:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651690+0000", 2024-04-25T22:02:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210249 2024-04-25T22:02:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651986+0000", 2024-04-25T22:02:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000296001 2024-04-25T22:02:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655696+0000", 2024-04-25T22:02:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037098410000000002 2024-04-25T22:02:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657896+0000", 2024-04-25T22:02:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022004630000000002 2024-04-25T22:02:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658035+0000", 2024-04-25T22:02:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013831499999999999 2024-04-25T22:02:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658133+0000", 2024-04-25T22:02:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8553000000000003e-05 2024-04-25T22:02:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:18 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.532033937999998, 2024-04-25T22:02:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013108712, 2024-04-25T22:02:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647953+0000", 2024-04-25T22:02:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.697e-06 2024-04-25T22:02:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647963+0000", 2024-04-25T22:02:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9259999999999995e-06 2024-04-25T22:02:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647982+0000", 2024-04-25T22:02:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-04-25T22:02:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648008+0000", 2024-04-25T22:02:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5956e-05 2024-04-25T22:02:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651686+0000", 2024-04-25T22:02:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678073 2024-04-25T22:02:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652023+0000", 2024-04-25T22:02:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033739399999999998 2024-04-25T22:02:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652348+0000", 2024-04-25T22:02:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032475000000000001 2024-04-25T22:02:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655883+0000", 2024-04-25T22:02:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035353030000000001 2024-04-25T22:02:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660791+0000", 2024-04-25T22:02:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049075330000000004 2024-04-25T22:02:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660930+0000", 2024-04-25T22:02:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000139856 2024-04-25T22:02:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661060+0000", 2024-04-25T22:02:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000129651 2024-04-25T22:02:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.531957046000002, 2024-04-25T22:02:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012451034, 2024-04-25T22:02:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648030+0000", 2024-04-25T22:02:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-04-25T22:02:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648036+0000", 2024-04-25T22:02:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8059999999999997e-06 2024-04-25T22:02:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648054+0000", 2024-04-25T22:02:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7744000000000002e-05 2024-04-25T22:02:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648070+0000", 2024-04-25T22:02:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-04-25T22:02:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648875+0000", 2024-04-25T22:02:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080444000000000002 2024-04-25T22:02:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649078+0000", 2024-04-25T22:02:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020391499999999999 2024-04-25T22:02:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649674+0000", 2024-04-25T22:02:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00059555299999999997 2024-04-25T22:02:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653185+0000", 2024-04-25T22:02:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035113459999999998 2024-04-25T22:02:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660251+0000", 2024-04-25T22:02:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070661350000000003 2024-04-25T22:02:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660382+0000", 2024-04-25T22:02:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013095899999999999 2024-04-25T22:02:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660479+0000", 2024-04-25T22:02:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6852e-05 2024-04-25T22:02:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:25 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.531891232999996, 2024-04-25T22:02:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012691025999999999, 2024-04-25T22:02:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648095+0000", 2024-04-25T22:02:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.424e-06 2024-04-25T22:02:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648102+0000", 2024-04-25T22:02:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2099999999999998e-06 2024-04-25T22:02:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648122+0000", 2024-04-25T22:02:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0242999999999999e-05 2024-04-25T22:02:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648138+0000", 2024-04-25T22:02:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6192999999999999e-05 2024-04-25T22:02:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651461+0000", 2024-04-25T22:02:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033225709999999999 2024-04-25T22:02:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651776+0000", 2024-04-25T22:02:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031567500000000002 2024-04-25T22:02:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660785+0000", 2024-04-25T22:02:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090087099999999996 2024-04-25T22:02:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.531828747000006, 2024-04-25T22:02:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013102702000000001, 2024-04-25T22:02:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648158+0000", 2024-04-25T22:02:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2839999999999999e-06 2024-04-25T22:02:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648163+0000", 2024-04-25T22:02:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-04-25T22:02:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648181+0000", 2024-04-25T22:02:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8484000000000001e-05 2024-04-25T22:02:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648196+0000", 2024-04-25T22:02:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4496e-05 2024-04-25T22:02:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653737+0000", 2024-04-25T22:02:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055414009999999996 2024-04-25T22:02:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653972+0000", 2024-04-25T22:02:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000234732 2024-04-25T22:02:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661259+0000", 2024-04-25T22:02:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072872689999999999 2024-04-25T22:02:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.531771926999994, 2024-04-25T22:02:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086984829999999999, 2024-04-25T22:02:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648214+0000", 2024-04-25T22:02:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-04-25T22:02:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648233+0000", 2024-04-25T22:02:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.878e-05 2024-04-25T22:02:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648252+0000", 2024-04-25T22:02:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8603000000000001e-05 2024-04-25T22:02:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648267+0000", 2024-04-25T22:02:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:02:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648846+0000", 2024-04-25T22:02:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057923000000000002 2024-04-25T22:02:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649027+0000", 2024-04-25T22:02:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181585 2024-04-25T22:02:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.656912+0000", 2024-04-25T22:02:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078844589999999999 2024-04-25T22:02:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 6 lcod 17'2)", 2024-04-25T22:02:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.519842010999994, 2024-04-25T22:02:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064966000000000004, 2024-04-25T22:02:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660144+0000", 2024-04-25T22:02:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1800000000000005e-07 2024-04-25T22:02:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660181+0000", 2024-04-25T22:02:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6408000000000001e-05 2024-04-25T22:02:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660197+0000", 2024-04-25T22:02:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6177000000000001e-05 2024-04-25T22:02:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660210+0000", 2024-04-25T22:02:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:02:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660556+0000", 2024-04-25T22:02:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034612899999999998 2024-04-25T22:02:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660793+0000", 2024-04-25T22:02:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023656799999999999 2024-04-25T22:02:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:18 3.1f e17/15 ondisk, result = 0)", 2024-04-25T22:02:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.519580238000003, 2024-04-25T22:02:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067878299999999997, 2024-04-25T22:02:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660406+0000", 2024-04-25T22:02:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2800000000000005e-07 2024-04-25T22:02:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660412+0000", 2024-04-25T22:02:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0399999999999998e-06 2024-04-25T22:02:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660429+0000", 2024-04-25T22:02:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7394e-05 2024-04-25T22:02:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660445+0000", 2024-04-25T22:02:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6069000000000001e-05 2024-04-25T22:02:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660757+0000", 2024-04-25T22:02:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031194300000000002 2024-04-25T22:02:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660776+0000", 2024-04-25T22:02:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8862999999999999e-05 2024-04-25T22:02:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661084+0000", 2024-04-25T22:02:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030754600000000001 2024-04-25T22:02:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-25T22:02:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.519516010000004, 2024-04-25T22:02:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080007600000000004, 2024-04-25T22:02:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660470+0000", 2024-04-25T22:02:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4499999999999996e-07 2024-04-25T22:02:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660475+0000", 2024-04-25T22:02:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-04-25T22:02:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660490+0000", 2024-04-25T22:02:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5274e-05 2024-04-25T22:02:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660501+0000", 2024-04-25T22:02:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0694e-05 2024-04-25T22:02:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661130+0000", 2024-04-25T22:02:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062887499999999999 2024-04-25T22:02:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661269+0000", 2024-04-25T22:02:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013955900000000001 2024-04-25T22:02:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:02:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.555784011, 2024-04-25T22:02:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037104880000000001, 2024-04-25T22:02:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624204+0000", 2024-04-25T22:02:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.757e-06 2024-04-25T22:02:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624233+0000", 2024-04-25T22:02:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9362000000000001e-05 2024-04-25T22:02:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624264+0000", 2024-04-25T22:02:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0843000000000003e-05 2024-04-25T22:02:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624280+0000", 2024-04-25T22:02:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5577e-05 2024-04-25T22:02:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624458+0000", 2024-04-25T22:02:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017821199999999999 2024-04-25T22:02:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624661+0000", 2024-04-25T22:02:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020283200000000001 2024-04-25T22:02:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624842+0000", 2024-04-25T22:02:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018115500000000001 2024-04-25T22:02:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.626271+0000", 2024-04-25T22:02:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001429416 2024-04-25T22:02:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627749+0000", 2024-04-25T22:02:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014778650000000001 2024-04-25T22:02:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627849+0000", 2024-04-25T22:02:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9261999999999999e-05 2024-04-25T22:02:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627912+0000", 2024-04-25T22:02:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3207000000000007e-05 2024-04-25T22:02:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-25T22:02:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 39.553086659999998, 2024-04-25T22:02:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029804620000000001, 2024-04-25T22:02:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626903+0000", 2024-04-25T22:02:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0029999999999996e-06 2024-04-25T22:02:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626921+0000", 2024-04-25T22:02:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8272999999999999e-05 2024-04-25T22:02:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626959+0000", 2024-04-25T22:02:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7843999999999999e-05 2024-04-25T22:02:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626977+0000", 2024-04-25T22:02:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7756000000000001e-05 2024-04-25T22:02:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627153+0000", 2024-04-25T22:02:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017643800000000001 2024-04-25T22:02:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627425+0000", 2024-04-25T22:02:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027207300000000001 2024-04-25T22:02:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627848+0000", 2024-04-25T22:02:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042297199999999997 2024-04-25T22:02:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629590+0000", 2024-04-25T22:02:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017416809999999999 2024-04-25T22:02:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629720+0000", 2024-04-25T22:02:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130526 2024-04-25T22:02:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629808+0000", 2024-04-25T22:02:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7449999999999998e-05 2024-04-25T22:02:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629879+0000", 2024-04-25T22:02:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1445999999999993e-05 2024-04-25T22:02:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4185.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-04-25T22:02:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.564978589999999, 2024-04-25T22:02:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0036257939999999999, 2024-04-25T22:02:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4185", 2024-04-25T22:02:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.44:0/2048337248", 2024-04-25T22:02:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2 2024-04-25T22:02:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615010+0000", 2024-04-25T22:02:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8059999999999999e-06 2024-04-25T22:02:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615023+0000", 2024-04-25T22:02:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3159999999999999e-05 2024-04-25T22:02:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615043+0000", 2024-04-25T22:02:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:02:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615059+0000", 2024-04-25T22:02:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5519000000000002e-05 2024-04-25T22:02:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615241+0000", 2024-04-25T22:02:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018207100000000001 2024-04-25T22:02:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:02:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615258+0000", 2024-04-25T22:02:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7278999999999998e-05 2024-04-25T22:02:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618429+0000", 2024-04-25T22:02:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003171213 2024-04-25T22:02:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618633+0000", 2024-04-25T22:02:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020343999999999999 2024-04-25T22:02:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.271 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:20.271 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:20.271 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:20.272 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:20.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:20.271+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:20.373 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:20.370+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:20.403 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:20.403 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:20.403 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:02:20.403 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:20.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:20.475 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:20.473+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:20.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:20.574+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:20.582 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:20.582 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:20.583 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:02:20.583 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:02:20.583 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:20.596 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:20.676 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:20.673+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:20.705 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:02:20.706 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T22:02:20.724 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:20.724 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:20.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:20.724 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:20.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.724 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:20.724 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:20.724 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.895405784000005, 2024-04-25T22:02:20.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:20.725 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.725 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.725 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:20.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:20.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:20.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:20.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:20.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:20.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:20.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:20.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:20.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:20.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:20.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:20.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:20.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:20.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:20.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:20.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:20.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:20.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:20.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.728 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.728 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:20.729 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:20.729 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.894674965999997, 2024-04-25T22:02:20.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:20.729 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.729 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.729 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.729 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:20.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:20.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:20.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:20.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:20.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:20.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:20.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:20.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:20.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:20.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:20.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:20.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:20.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:20.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:20.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:20.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:20.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:20.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:20.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.732 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.733 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:20.733 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:20.733 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.894008694999997, 2024-04-25T22:02:20.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:20.733 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.733 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.733 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.733 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:20.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:20.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:20.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:20.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:20.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:20.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:20.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:20.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:20.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:20.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:20.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:20.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:20.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:20.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:20.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:20.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:20.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:20.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:20.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.737 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.737 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:20.737 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:20.737 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.893108795000003, 2024-04-25T22:02:20.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:20.737 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.737 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.737 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.737 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:20.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:20.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:20.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:20.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:20.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:20.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:20.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:20.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:20.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:20.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:20.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:20.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:20.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:20.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:20.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:20.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:20.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:20.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:20.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.741 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.741 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:20.741 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:20.741 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.891072453999996, 2024-04-25T22:02:20.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:20.741 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.741 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.741 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:20.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:20.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:20.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:20.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:20.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:20.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:20.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:20.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:20.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:20.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:20.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:20.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:20.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:20.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:20.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:20.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:20.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:20.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:20.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.747 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.747 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.747 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:20.747 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:20.747 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.890609116999997, 2024-04-25T22:02:20.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:20.747 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.747 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.747 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.747 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:20.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:20.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:20.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:20.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:20.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:20.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:20.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:20.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:20.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:20.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:20.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:20.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:20.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:20.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:20.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:20.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:20.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:20.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:20.751 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.751 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.751 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.752 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:20.752 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:20.752 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.889742237999997, 2024-04-25T22:02:20.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:20.752 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.752 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.752 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:20.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:20.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:20.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:20.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:20.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:20.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:20.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:20.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:20.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:20.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:20.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:20.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:20.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:20.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:20.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:20.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:20.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:20.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:20.755 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.756 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.756 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.756 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:20.756 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:20.756 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.889291163999999, 2024-04-25T22:02:20.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:20.756 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.756 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.756 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:20.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:20.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:20.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:20.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:20.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:20.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:20.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:20.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:20.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:20.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:20.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:20.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:20.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:20.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:20.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:20.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:20.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:20.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:20.760 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.760 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.760 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.760 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:20.760 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:20.760 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.888841577999997, 2024-04-25T22:02:20.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:20.760 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.761 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:20.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:20.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:20.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:20.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:20.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:20.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:20.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:20.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:20.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:20.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:20.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:20.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:20.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:20.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:20.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:20.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:20.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:20.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:20.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.764 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.764 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:20.764 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:20.764 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 66.092185091000005, 2024-04-25T22:02:20.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:20.764 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.765 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.765 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:20.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:20.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:20.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:20.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:20.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:20.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:20.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:20.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:20.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:20.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:20.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:20.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:20.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:20.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:20.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:20.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:20.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:20.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:20.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:20.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:20.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:20.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:20.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:20.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:20.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:20.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:20.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:20.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.769 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.769 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:20.769 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:20.769 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 66.092061107999996, 2024-04-25T22:02:20.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:20.770 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.770 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.770 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.770 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:20.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:20.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:20.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:20.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:20.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:20.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:20.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:20.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:20.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:20.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:20.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:20.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:20.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:20.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:20.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:20.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:20.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:20.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:20.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:20.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:20.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:20.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:20.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:20.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:20.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:20.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:20.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:20.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.774 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.774 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:20.775 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:20.775 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 66.091987172000003, 2024-04-25T22:02:20.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:20.775 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.775 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.775 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:20.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:20.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:20.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:20.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:20.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:20.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:20.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:20.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:20.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:20.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:20.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:20.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:20.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:20.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:20.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:20.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:20.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:20.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:20.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:20.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:20.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:20.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:20.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:20.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:20.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:20.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:20.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:20.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.779 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.780 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:20.780 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:20.780 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 66.091870920000005, 2024-04-25T22:02:20.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:20.780 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.780 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:20.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:20.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:20.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:20.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:20.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:20.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:20.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:20.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:20.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:20.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:20.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:20.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:20.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:20.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:20.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:20.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:20.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:20.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:20.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:20.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:20.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:20.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:20.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:20.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:20.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:20.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:20.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:20.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.784 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.785 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:20.785 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:20.785 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 66.091707510999996, 2024-04-25T22:02:20.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:20.785 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.785 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.785 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:20.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:20.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:20.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:20.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:20.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:20.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:20.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:20.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:20.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:20.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:20.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:20.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:20.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:20.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:20.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:20.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:20.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:20.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:20.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:20.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:20.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:20.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:20.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:20.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:20.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:20.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:20.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:20.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.790 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.790 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.790 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:20.790 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:20.790 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 66.091605314999995, 2024-04-25T22:02:20.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:20.790 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.790 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.790 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 66.091526361999996, 2024-04-25T22:02:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.795 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:20.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:20.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:20.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 66.091461339000006, 2024-04-25T22:02:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:20.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:20.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:20.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:20.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:20.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:20.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:20.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:20.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.804 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.804 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:20.804 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:20.804 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 66.091383147000002, 2024-04-25T22:02:20.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:20.804 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.804 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:20.804 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:20.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:20.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:20.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:20.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:20.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:20.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:20.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:20.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:20.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:20.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:20.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:20.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:20.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:20.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:20.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:20.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.808 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.808 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.808 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:20.808 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:20.808 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 66.076736686999993, 2024-04-25T22:02:20.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:20.808 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.808 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.808 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.808 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:20.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:20.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:20.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:20.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:20.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:20.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:20.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:20.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:20.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:20.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:20.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:20.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:20.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:20.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:20.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:20.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:20.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:20.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:20.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.812 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.812 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:20.812 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:20.812 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 66.076576731000003, 2024-04-25T22:02:20.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:20.812 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:20.812 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:20.812 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:20.812 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:20.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:20.816 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:20.818 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T22:02:20.818 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:02:20.819 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:20.819 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:20.813+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:20.919 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:20.913+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:20.954 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:20.954 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:20.954 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:20.954 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:20.968 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:20.973 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:02:21.019 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:21.018+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:21.111 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:21.111 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:21.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:21.118+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:21.132 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:21.132 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:21.141 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:21.141 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:21.152 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:21.152 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:21.155 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:21.193 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:02:21.195 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:02:21.210 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2024-04-25T22:02:20.705305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":257,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90380,"kb_used_data":1000,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025140,"statfs":{"total":289910292480,"available":289817743360,"internally_reserved":0,"allocated":1024000,"data_stored":1550314,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.124774"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677392+0000","last_change":"2024-04-25T22:01:14.641678+0000","last_active":"2024-04-25T22:02:15.677392+0000","last_peered":"2024-04-25T22:02:15.677392+0000","last_clean":"2024-04-25T22:02:15.677392+0000","last_became_active":"2024-04-25T22:01:14.640808+0000","last_became_peered":"2024-04-25T22:01:14.640808+0000","last_unstale":"2024-04-25T22:02:15.677392+0000","last_undegraded":"2024-04-25T22:02:15.677392+0000","last_fullsized":"2024-04-25T22:02:15.677392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676780+0000","last_change":"2024-04-25T22:01:14.648935+0000","last_active":"2024-04-25T22:02:15.676780+0000","last_peered":"2024-04-25T22:02:15.676780+0000","last_clean":"2024-04-25T22:02:15.676780+0000","last_became_active":"2024-04-25T22:01:14.647871+0000","last_became_peered":"2024-04-25T22:01:14.647871+0000","last_unstale":"2024-04-25T22:02:15.676780+0000","last_undegraded":"2024-04-25T22:02:15.676780+0000","last_fullsized":"2024-04-25T22:02:15.676780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676035+0000","last_change":"2024-04-25T22:01:14.647262+0000","last_active":"2024-04-25T22:02:15.676035+0000","last_peered":"2024-04-25T22:02:15.676035+0000","last_clean":"2024-04-25T22:02:15.676035+0000","last_became_active":"2024-04-25T22:01:14.645878+0000","last_became_peered":"2024-04-25T22:01:14.645878+0000","last_unstale":"2024-04-25T22:02:15.676035+0000","last_undegraded":"2024-04-25T22:02:15.676035+0000","last_fullsized":"2024-04-25T22:02:15.676035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675648+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:02:15.675648+0000","last_peered":"2024-04-25T22:02:15.675648+0000","last_clean":"2024-04-25T22:02:15.675648+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:02:15.675648+0000","last_undegraded":"2024-04-25T22:02:15.675648+0000","last_fullsized":"2024-04-25T22:02:15.675648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676042+0000","last_change":"2024-04-25T22:01:14.642505+0000","last_active":"2024-04-25T22:02:15.676042+0000","last_peered":"2024-04-25T22:02:15.676042+0000","last_clean":"2024-04-25T22:02:15.676042+0000","last_became_active":"2024-04-25T22:01:14.641574+0000","last_became_peered":"2024-04-25T22:01:14.641574+0000","last_unstale":"2024-04-25T22:02:15.676042+0000","last_undegraded":"2024-04-25T22:02:15.676042+0000","last_fullsized":"2024-04-25T22:02:15.676042+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.674992+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:02:15.674992+0000","last_peered":"2024-04-25T22:02:15.674992+0000","last_clean":"2024-04-25T22:02:15.674992+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:02:15.674992+0000","last_undegraded":"2024-04-25T22:02:15.674992+0000","last_fullsized":"2024-04-25T22:02:15.674992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.674929+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:02:15.674929+0000","last_peered":"2024-04-25T22:02:15.674929+0000","last_clean":"2024-04-25T22:02:15.674929+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:02:15.674929+0000","last_undegraded":"2024-04-25T22:02:15.674929+0000","last_fullsized":"2024-04-25T22:02:15.674929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.674387+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:02:15.674387+0000","last_peered":"2024-04-25T22:02:15.674387+0000","last_clean":"2024-04-25T22:02:15.674387+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:02:15.674387+0000","last_undegraded":"2024-04-25T22:02:15.674387+0000","last_fullsized":"2024-04-25T22:02:15.674387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.465751+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:02:16.465751+0000","last_peered":"2024-04-25T22:02:16.465751+0000","last_clean":"2024-04-25T22:02:16.465751+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:02:16.465751+0000","last_undegraded":"2024-04-25T22:02:16.465751+0000","last_fullsized":"2024-04-25T22:02:16.465751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676935+0000","last_change":"2024-04-25T22:01:14.647968+0000","last_active":"2024-04-25T22:02:15.676935+0000","last_peered":"2024-04-25T22:02:15.676935+0000","last_clean":"2024-04-25T22:02:15.676935+0000","last_became_active":"2024-04-25T22:01:14.646872+0000","last_became_peered":"2024-04-25T22:01:14.646872+0000","last_unstale":"2024-04-25T22:02:15.676935+0000","last_undegraded":"2024-04-25T22:02:15.676935+0000","last_fullsized":"2024-04-25T22:02:15.676935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676245+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:02:15.676245+0000","last_peered":"2024-04-25T22:02:15.676245+0000","last_clean":"2024-04-25T22:02:15.676245+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:02:15.676245+0000","last_undegraded":"2024-04-25T22:02:15.676245+0000","last_fullsized":"2024-04-25T22:02:15.676245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676224+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:02:15.676224+0000","last_peered":"2024-04-25T22:02:15.676224+0000","last_clean":"2024-04-25T22:02:15.676224+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:02:15.676224+0000","last_undegraded":"2024-04-25T22:02:15.676224+0000","last_fullsized":"2024-04-25T22:02:15.676224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675747+0000","last_change":"2024-04-25T22:01:14.643909+0000","last_active":"2024-04-25T22:02:15.675747+0000","last_peered":"2024-04-25T22:02:15.675747+0000","last_clean":"2024-04-25T22:02:15.675747+0000","last_became_active":"2024-04-25T22:01:14.642421+0000","last_became_peered":"2024-04-25T22:01:14.642421+0000","last_unstale":"2024-04-25T22:02:15.675747+0000","last_undegraded":"2024-04-25T22:02:15.675747+0000","last_fullsized":"2024-04-25T22:02:15.675747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675020+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:02:15.675020+0000","last_peered":"2024-04-25T22:02:15.675020+0000","last_clean":"2024-04-25T22:02:15.675020+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:02:15.675020+0000","last_undegraded":"2024-04-25T22:02:15.675020+0000","last_fullsized":"2024-04-25T22:02:15.675020+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675115+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:02:15.675115+0000","last_peered":"2024-04-25T22:02:15.675115+0000","last_clean":"2024-04-25T22:02:15.675115+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:02:15.675115+0000","last_undegraded":"2024-04-25T22:02:15.675115+0000","last_fullsized":"2024-04-25T22:02:15.675115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.674543+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:02:15.674543+0000","last_peered":"2024-04-25T22:02:15.674543+0000","last_clean":"2024-04-25T22:02:15.674543+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:02:15.674543+0000","last_undegraded":"2024-04-25T22:02:15.674543+0000","last_fullsized":"2024-04-25T22:02:15.674543+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466558+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:02:16.466558+0000","last_peered":"2024-04-25T22:02:16.466558+0000","last_clean":"2024-04-25T22:02:16.466558+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:02:16.466558+0000","last_undegraded":"2024-04-25T22:02:16.466558+0000","last_fullsized":"2024-04-25T22:02:16.466558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677392+0000","last_change":"2024-04-25T22:01:14.647317+0000","last_active":"2024-04-25T22:02:15.677392+0000","last_peered":"2024-04-25T22:02:15.677392+0000","last_clean":"2024-04-25T22:02:15.677392+0000","last_became_active":"2024-04-25T22:01:14.644027+0000","last_became_peered":"2024-04-25T22:01:14.644027+0000","last_unstale":"2024-04-25T22:02:15.677392+0000","last_undegraded":"2024-04-25T22:02:15.677392+0000","last_fullsized":"2024-04-25T22:02:15.677392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.465447+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:02:16.465447+0000","last_peered":"2024-04-25T22:02:16.465447+0000","last_clean":"2024-04-25T22:02:16.465447+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:02:16.465447+0000","last_undegraded":"2024-04-25T22:02:16.465447+0000","last_fullsized":"2024-04-25T22:02:16.465447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675774+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:02:15.675774+0000","last_peered":"2024-04-25T22:02:15.675774+0000","last_clean":"2024-04-25T22:02:15.675774+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:02:15.675774+0000","last_undegraded":"2024-04-25T22:02:15.675774+0000","last_fullsized":"2024-04-25T22:02:15.675774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675609+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:02:15.675609+0000","last_peered":"2024-04-25T22:02:15.675609+0000","last_clean":"2024-04-25T22:02:15.675609+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:02:15.675609+0000","last_undegraded":"2024-04-25T22:02:15.675609+0000","last_fullsized":"2024-04-25T22:02:15.675609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675789+0000","last_change":"2024-04-25T22:01:14.633477+0000","last_active":"2024-04-25T22:02:15.675789+0000","last_peered":"2024-04-25T22:02:15.675789+0000","last_clean":"2024-04-25T22:02:15.675789+0000","last_became_active":"2024-04-25T22:01:14.632678+0000","last_became_peered":"2024-04-25T22:01:14.632678+0000","last_unstale":"2024-04-25T22:02:15.675789+0000","last_undegraded":"2024-04-25T22:02:15.675789+0000","last_fullsized":"2024-04-25T22:02:15.675789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.463733+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:02:16.463733+0000","last_peered":"2024-04-25T22:02:16.463733+0000","last_clean":"2024-04-25T22:02:16.463733+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:02:16.463733+0000","last_undegraded":"2024-04-25T22:02:16.463733+0000","last_fullsized":"2024-04-25T22:02:16.463733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675155+0000","last_change":"2024-04-25T22:01:14.641991+0000","last_active":"2024-04-25T22:02:15.675155+0000","last_peered":"2024-04-25T22:02:15.675155+0000","last_clean":"2024-04-25T22:02:15.675155+0000","last_became_active":"2024-04-25T22:01:14.641244+0000","last_became_peered":"2024-04-25T22:01:14.641244+0000","last_unstale":"2024-04-25T22:02:15.675155+0000","last_undegraded":"2024-04-25T22:02:15.675155+0000","last_fullsized":"2024-04-25T22:02:15.675155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:03.098700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677412+0000","last_change":"2024-04-25T22:01:14.638103+0000","last_active":"2024-04-25T22:02:15.677412+0000","last_peered":"2024-04-25T22:02:15.677412+0000","last_clean":"2024-04-25T22:02:15.677412+0000","last_became_active":"2024-04-25T22:01:14.636488+0000","last_became_peered":"2024-04-25T22:01:14.636488+0000","last_unstale":"2024-04-25T22:02:15.677412+0000","last_undegraded":"2024-04-25T22:02:15.677412+0000","last_fullsized":"2024-04-25T22:02:15.677412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.465885+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:02:16.465885+0000","last_peered":"2024-04-25T22:02:16.465885+0000","last_clean":"2024-04-25T22:02:16.465885+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:02:16.465885+0000","last_undegraded":"2024-04-25T22:02:16.465885+0000","last_fullsized":"2024-04-25T22:02:16.465885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676328+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:02:15.676328+0000","last_peered":"2024-04-25T22:02:15.676328+0000","last_clean":"2024-04-25T22:02:15.676328+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:02:15.676328+0000","last_undegraded":"2024-04-25T22:02:15.676328+0000","last_fullsized":"2024-04-25T22:02:15.676328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676562+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:02:15.676562+0000","last_peered":"2024-04-25T22:02:15.676562+0000","last_clean":"2024-04-25T22:02:15.676562+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:02:15.676562+0000","last_undegraded":"2024-04-25T22:02:15.676562+0000","last_fullsized":"2024-04-25T22:02:15.676562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464969+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:02:16.464969+0000","last_peered":"2024-04-25T22:02:16.464969+0000","last_clean":"2024-04-25T22:02:16.464969+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:02:16.464969+0000","last_undegraded":"2024-04-25T22:02:16.464969+0000","last_fullsized":"2024-04-25T22:02:16.464969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675864+0000","last_change":"2024-04-25T22:01:14.638343+0000","last_active":"2024-04-25T22:02:15.675864+0000","last_peered":"2024-04-25T22:02:15.675864+0000","last_clean":"2024-04-25T22:02:15.675864+0000","last_became_active":"2024-04-25T22:01:14.637694+0000","last_became_peered":"2024-04-25T22:01:14.637694+0000","last_unstale":"2024-04-25T22:02:15.675864+0000","last_undegraded":"2024-04-25T22:02:15.675864+0000","last_fullsized":"2024-04-25T22:02:15.675864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.463940+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:02:16.463940+0000","last_peered":"2024-04-25T22:02:16.463940+0000","last_clean":"2024-04-25T22:02:16.463940+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:02:16.463940+0000","last_undegraded":"2024-04-25T22:02:16.463940+0000","last_fullsized":"2024-04-25T22:02:16.463940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.674680+0000","last_change":"2024-04-25T22:01:14.648196+0000","last_active":"2024-04-25T22:02:15.674680+0000","last_peered":"2024-04-25T22:02:15.674680+0000","last_clean":"2024-04-25T22:02:15.674680+0000","last_became_active":"2024-04-25T22:01:14.647509+0000","last_became_peered":"2024-04-25T22:01:14.647509+0000","last_unstale":"2024-04-25T22:02:15.674680+0000","last_undegraded":"2024-04-25T22:02:15.674680+0000","last_fullsized":"2024-04-25T22:02:15.674680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676499+0000","last_change":"2024-04-25T22:01:14.641706+0000","last_active":"2024-04-25T22:02:15.676499+0000","last_peered":"2024-04-25T22:02:15.676499+0000","last_clean":"2024-04-25T22:02:15.676499+0000","last_became_active":"2024-04-25T22:01:14.641043+0000","last_became_peered":"2024-04-25T22:01:14.641043+0000","last_unstale":"2024-04-25T22:02:15.676499+0000","last_undegraded":"2024-04-25T22:02:15.676499+0000","last_fullsized":"2024-04-25T22:02:15.676499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675690+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:02:15.675690+0000","last_peered":"2024-04-25T22:02:15.675690+0000","last_clean":"2024-04-25T22:02:15.675690+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:02:15.675690+0000","last_undegraded":"2024-04-25T22:02:15.675690+0000","last_fullsized":"2024-04-25T22:02:15.675690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676712+0000","last_change":"2024-04-25T22:01:14.635075+0000","last_active":"2024-04-25T22:02:15.676712+0000","last_peered":"2024-04-25T22:02:15.676712+0000","last_clean":"2024-04-25T22:02:15.676712+0000","last_became_active":"2024-04-25T22:01:14.630677+0000","last_became_peered":"2024-04-25T22:01:14.630677+0000","last_unstale":"2024-04-25T22:02:15.676712+0000","last_undegraded":"2024-04-25T22:02:15.676712+0000","last_fullsized":"2024-04-25T22:02:15.676712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464613+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:02:16.464613+0000","last_peered":"2024-04-25T22:02:16.464613+0000","last_clean":"2024-04-25T22:02:16.464613+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:02:16.464613+0000","last_undegraded":"2024-04-25T22:02:16.464613+0000","last_fullsized":"2024-04-25T22:02:16.464613+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466174+0000","last_change":"2024-04-25T22:01:14.648527+0000","last_active":"2024-04-25T22:02:16.466174+0000","last_peered":"2024-04-25T22:02:16.466174+0000","last_clean":"2024-04-25T22:02:16.466174+0000","last_became_active":"2024-04-25T22:01:14.645040+0000","last_became_peered":"2024-04-25T22:01:14.645040+0000","last_unstale":"2024-04-25T22:02:16.466174+0000","last_undegraded":"2024-04-25T22:02:16.466174+0000","last_fullsized":"2024-04-25T22:02:16.466174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675527+0000","last_change":"2024-04-25T22:01:13.630817+0000","last_active":"2024-04-25T22:02:15.675527+0000","last_peered":"2024-04-25T22:02:15.675527+0000","last_clean":"2024-04-25T22:02:15.675527+0000","last_became_active":"2024-04-25T22:01:13.629994+0000","last_became_peered":"2024-04-25T22:01:13.629994+0000","last_unstale":"2024-04-25T22:02:15.675527+0000","last_undegraded":"2024-04-25T22:02:15.675527+0000","last_fullsized":"2024-04-25T22:02:15.675527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.465845+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:02:16.465845+0000","last_peered":"2024-04-25T22:02:16.465845+0000","last_clean":"2024-04-25T22:02:16.465845+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:02:16.465845+0000","last_undegraded":"2024-04-25T22:02:16.465845+0000","last_fullsized":"2024-04-25T22:02:16.465845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675060+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:02:15.675060+0000","last_peered":"2024-04-25T22:02:15.675060+0000","last_clean":"2024-04-25T22:02:15.675060+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:02:15.675060+0000","last_undegraded":"2024-04-25T22:02:15.675060+0000","last_fullsized":"2024-04-25T22:02:15.675060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677623+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:02:15.677623+0000","last_peered":"2024-04-25T22:02:15.677623+0000","last_clean":"2024-04-25T22:02:15.677623+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:02:15.677623+0000","last_undegraded":"2024-04-25T22:02:15.677623+0000","last_fullsized":"2024-04-25T22:02:15.677623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675164+0000","last_change":"2024-04-25T22:01:14.633805+0000","last_active":"2024-04-25T22:02:15.675164+0000","last_peered":"2024-04-25T22:02:15.675164+0000","last_clean":"2024-04-25T22:02:15.675164+0000","last_became_active":"2024-04-25T22:01:14.633045+0000","last_became_peered":"2024-04-25T22:01:14.633045+0000","last_unstale":"2024-04-25T22:02:15.675164+0000","last_undegraded":"2024-04-25T22:02:15.675164+0000","last_fullsized":"2024-04-25T22:02:15.675164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:43.718628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677379+0000","last_change":"2024-04-25T22:01:13.631135+0000","last_active":"2024-04-25T22:02:15.677379+0000","last_peered":"2024-04-25T22:02:15.677379+0000","last_clean":"2024-04-25T22:02:15.677379+0000","last_became_active":"2024-04-25T22:01:13.630257+0000","last_became_peered":"2024-04-25T22:01:13.630257+0000","last_unstale":"2024-04-25T22:02:15.677379+0000","last_undegraded":"2024-04-25T22:02:15.677379+0000","last_fullsized":"2024-04-25T22:02:15.677379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675212+0000","last_change":"2024-04-25T22:01:14.630233+0000","last_active":"2024-04-25T22:02:15.675212+0000","last_peered":"2024-04-25T22:02:15.675212+0000","last_clean":"2024-04-25T22:02:15.675212+0000","last_became_active":"2024-04-25T22:01:14.629415+0000","last_became_peered":"2024-04-25T22:01:14.629415+0000","last_unstale":"2024-04-25T22:02:15.675212+0000","last_undegraded":"2024-04-25T22:02:15.675212+0000","last_fullsized":"2024-04-25T22:02:15.675212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:02:28.593163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676766+0000","last_change":"2024-04-25T22:01:13.633106+0000","last_active":"2024-04-25T22:02:15.676766+0000","last_peered":"2024-04-25T22:02:15.676766+0000","last_clean":"2024-04-25T22:02:15.676766+0000","last_became_active":"2024-04-25T22:01:13.631466+0000","last_became_peered":"2024-04-25T22:01:13.631466+0000","last_unstale":"2024-04-25T22:02:15.676766+0000","last_undegraded":"2024-04-25T22:02:15.676766+0000","last_fullsized":"2024-04-25T22:02:15.676766+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:23.095422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675471+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:02:15.675471+0000","last_peered":"2024-04-25T22:02:15.675471+0000","last_clean":"2024-04-25T22:02:15.675471+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:02:15.675471+0000","last_undegraded":"2024-04-25T22:02:15.675471+0000","last_fullsized":"2024-04-25T22:02:15.675471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676498+0000","last_change":"2024-04-25T22:01:13.626767+0000","last_active":"2024-04-25T22:02:15.676498+0000","last_peered":"2024-04-25T22:02:15.676498+0000","last_clean":"2024-04-25T22:02:15.676498+0000","last_became_active":"2024-04-25T22:01:13.625984+0000","last_became_peered":"2024-04-25T22:01:13.625984+0000","last_unstale":"2024-04-25T22:02:15.676498+0000","last_undegraded":"2024-04-25T22:02:15.676498+0000","last_fullsized":"2024-04-25T22:02:15.676498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464943+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:02:16.464943+0000","last_peered":"2024-04-25T22:02:16.464943+0000","last_clean":"2024-04-25T22:02:16.464943+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:02:16.464943+0000","last_undegraded":"2024-04-25T22:02:16.464943+0000","last_fullsized":"2024-04-25T22:02:16.464943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.465265+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:02:16.465265+0000","last_peered":"2024-04-25T22:02:16.465265+0000","last_clean":"2024-04-25T22:02:16.465265+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:02:16.465265+0000","last_undegraded":"2024-04-25T22:02:16.465265+0000","last_fullsized":"2024-04-25T22:02:16.465265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675925+0000","last_change":"2024-04-25T22:01:14.650077+0000","last_active":"2024-04-25T22:02:15.675925+0000","last_peered":"2024-04-25T22:02:15.675925+0000","last_clean":"2024-04-25T22:02:15.675925+0000","last_became_active":"2024-04-25T22:01:14.649315+0000","last_became_peered":"2024-04-25T22:01:14.649315+0000","last_unstale":"2024-04-25T22:02:15.675925+0000","last_undegraded":"2024-04-25T22:02:15.675925+0000","last_fullsized":"2024-04-25T22:02:15.675925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.976715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676078+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:02:15.676078+0000","last_peered":"2024-04-25T22:02:15.676078+0000","last_clean":"2024-04-25T22:02:15.676078+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:02:15.676078+0000","last_undegraded":"2024-04-25T22:02:15.676078+0000","last_fullsized":"2024-04-25T22:02:15.676078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676592+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:02:15.676592+0000","last_peered":"2024-04-25T22:02:15.676592+0000","last_clean":"2024-04-25T22:02:15.676592+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:02:15.676592+0000","last_undegraded":"2024-04-25T22:02:15.676592+0000","last_fullsized":"2024-04-25T22:02:15.676592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675621+0000","last_change":"2024-04-25T22:01:13.631439+0000","last_active":"2024-04-25T22:02:15.675621+0000","last_peered":"2024-04-25T22:02:15.675621+0000","last_clean":"2024-04-25T22:02:15.675621+0000","last_became_active":"2024-04-25T22:01:13.630812+0000","last_became_peered":"2024-04-25T22:01:13.630812+0000","last_unstale":"2024-04-25T22:02:15.675621+0000","last_undegraded":"2024-04-25T22:02:15.675621+0000","last_fullsized":"2024-04-25T22:02:15.675621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677265+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:02:15.677265+0000","last_peered":"2024-04-25T22:02:15.677265+0000","last_clean":"2024-04-25T22:02:15.677265+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:02:15.677265+0000","last_undegraded":"2024-04-25T22:02:15.677265+0000","last_fullsized":"2024-04-25T22:02:15.677265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675611+0000","last_change":"2024-04-25T22:01:13.623342+0000","last_active":"2024-04-25T22:02:15.675611+0000","last_peered":"2024-04-25T22:02:15.675611+0000","last_clean":"2024-04-25T22:02:15.675611+0000","last_became_active":"2024-04-25T22:01:13.621460+0000","last_became_peered":"2024-04-25T22:01:13.621460+0000","last_unstale":"2024-04-25T22:02:15.675611+0000","last_undegraded":"2024-04-25T22:02:15.675611+0000","last_fullsized":"2024-04-25T22:02:15.675611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466010+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:02:16.466010+0000","last_peered":"2024-04-25T22:02:16.466010+0000","last_clean":"2024-04-25T22:02:16.466010+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:02:16.466010+0000","last_undegraded":"2024-04-25T22:02:16.466010+0000","last_fullsized":"2024-04-25T22:02:16.466010+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":252,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675492+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:02:15.675492+0000","last_peered":"2024-04-25T22:02:15.675492+0000","last_clean":"2024-04-25T22:02:15.675492+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:02:15.675492+0000","last_undegraded":"2024-04-25T22:02:15.675492+0000","last_fullsized":"2024-04-25T22:02:15.675492+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676017+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:02:15.676017+0000","last_peered":"2024-04-25T22:02:15.676017+0000","last_clean":"2024-04-25T22:02:15.676017+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:02:15.676017+0000","last_undegraded":"2024-04-25T22:02:15.676017+0000","last_fullsized":"2024-04-25T22:02:15.676017+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464902+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:02:16.464902+0000","last_peered":"2024-04-25T22:02:16.464902+0000","last_clean":"2024-04-25T22:02:16.464902+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:02:16.464902+0000","last_undegraded":"2024-04-25T22:02:16.464902+0000","last_fullsized":"2024-04-25T22:02:16.464902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676635+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:02:15.676635+0000","last_peered":"2024-04-25T22:02:15.676635+0000","last_clean":"2024-04-25T22:02:15.676635+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:02:15.676635+0000","last_undegraded":"2024-04-25T22:02:15.676635+0000","last_fullsized":"2024-04-25T22:02:15.676635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675401+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:02:15.675401+0000","last_peered":"2024-04-25T22:02:15.675401+0000","last_clean":"2024-04-25T22:02:15.675401+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:02:15.675401+0000","last_undegraded":"2024-04-25T22:02:15.675401+0000","last_fullsized":"2024-04-25T22:02:15.675401+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464394+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:02:16.464394+0000","last_peered":"2024-04-25T22:02:16.464394+0000","last_clean":"2024-04-25T22:02:16.464394+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:02:16.464394+0000","last_undegraded":"2024-04-25T22:02:16.464394+0000","last_fullsized":"2024-04-25T22:02:16.464394+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677102+0000","last_change":"2024-04-25T22:01:14.645176+0000","last_active":"2024-04-25T22:02:15.677102+0000","last_peered":"2024-04-25T22:02:15.677102+0000","last_clean":"2024-04-25T22:02:15.677102+0000","last_became_active":"2024-04-25T22:01:14.642395+0000","last_became_peered":"2024-04-25T22:01:14.642395+0000","last_unstale":"2024-04-25T22:02:15.677102+0000","last_undegraded":"2024-04-25T22:02:15.677102+0000","last_fullsized":"2024-04-25T22:02:15.677102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464733+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:02:16.464733+0000","last_peered":"2024-04-25T22:02:16.464733+0000","last_clean":"2024-04-25T22:02:16.464733+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:02:16.464733+0000","last_undegraded":"2024-04-25T22:02:16.464733+0000","last_fullsized":"2024-04-25T22:02:16.464733+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675496+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:02:15.675496+0000","last_peered":"2024-04-25T22:02:15.675496+0000","last_clean":"2024-04-25T22:02:15.675496+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:02:15.675496+0000","last_undegraded":"2024-04-25T22:02:15.675496+0000","last_fullsized":"2024-04-25T22:02:15.675496+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466092+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:02:16.466092+0000","last_peered":"2024-04-25T22:02:16.466092+0000","last_clean":"2024-04-25T22:02:16.466092+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:02:16.466092+0000","last_undegraded":"2024-04-25T22:02:16.466092+0000","last_fullsized":"2024-04-25T22:02:16.466092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676418+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:02:15.676418+0000","last_peered":"2024-04-25T22:02:15.676418+0000","last_clean":"2024-04-25T22:02:15.676418+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:02:15.676418+0000","last_undegraded":"2024-04-25T22:02:15.676418+0000","last_fullsized":"2024-04-25T22:02:15.676418+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675874+0000","last_change":"2024-04-25T22:01:13.627274+0000","last_active":"2024-04-25T22:02:15.675874+0000","last_peered":"2024-04-25T22:02:15.675874+0000","last_clean":"2024-04-25T22:02:15.675874+0000","last_became_active":"2024-04-25T22:01:13.626015+0000","last_became_peered":"2024-04-25T22:01:13.626015+0000","last_unstale":"2024-04-25T22:02:15.675874+0000","last_undegraded":"2024-04-25T22:02:15.675874+0000","last_fullsized":"2024-04-25T22:02:15.675874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.465546+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:02:16.465546+0000","last_peered":"2024-04-25T22:02:16.465546+0000","last_clean":"2024-04-25T22:02:16.465546+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:02:16.465546+0000","last_undegraded":"2024-04-25T22:02:16.465546+0000","last_fullsized":"2024-04-25T22:02:16.465546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676841+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:02:15.676841+0000","last_peered":"2024-04-25T22:02:15.676841+0000","last_clean":"2024-04-25T22:02:15.676841+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:02:15.676841+0000","last_undegraded":"2024-04-25T22:02:15.676841+0000","last_fullsized":"2024-04-25T22:02:15.676841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.465850+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:02:16.465850+0000","last_peered":"2024-04-25T22:02:16.465850+0000","last_clean":"2024-04-25T22:02:16.465850+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:02:16.465850+0000","last_undegraded":"2024-04-25T22:02:16.465850+0000","last_fullsized":"2024-04-25T22:02:16.465850+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675603+0000","last_change":"2024-04-25T22:01:14.637520+0000","last_active":"2024-04-25T22:02:15.675603+0000","last_peered":"2024-04-25T22:02:15.675603+0000","last_clean":"2024-04-25T22:02:15.675603+0000","last_became_active":"2024-04-25T22:01:14.636765+0000","last_became_peered":"2024-04-25T22:01:14.636765+0000","last_unstale":"2024-04-25T22:02:15.675603+0000","last_undegraded":"2024-04-25T22:02:15.675603+0000","last_fullsized":"2024-04-25T22:02:15.675603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.465553+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:02:16.465553+0000","last_peered":"2024-04-25T22:02:16.465553+0000","last_clean":"2024-04-25T22:02:16.465553+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:02:16.465553+0000","last_undegraded":"2024-04-25T22:02:16.465553+0000","last_fullsized":"2024-04-25T22:02:16.465553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677196+0000","last_change":"2024-04-25T22:01:09.582204+0000","last_active":"2024-04-25T22:02:15.677196+0000","last_peered":"2024-04-25T22:02:15.677196+0000","last_clean":"2024-04-25T22:02:15.677196+0000","last_became_active":"2024-04-25T22:01:09.581494+0000","last_became_peered":"2024-04-25T22:01:09.581494+0000","last_unstale":"2024-04-25T22:02:15.677196+0000","last_undegraded":"2024-04-25T22:02:15.677196+0000","last_fullsized":"2024-04-25T22:02:15.677196+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:13.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675923+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:02:15.675923+0000","last_peered":"2024-04-25T22:02:15.675923+0000","last_clean":"2024-04-25T22:02:15.675923+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:02:15.675923+0000","last_undegraded":"2024-04-25T22:02:15.675923+0000","last_fullsized":"2024-04-25T22:02:15.675923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466705+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:02:16.466705+0000","last_peered":"2024-04-25T22:02:16.466705+0000","last_clean":"2024-04-25T22:02:16.466705+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:02:16.466705+0000","last_undegraded":"2024-04-25T22:02:16.466705+0000","last_fullsized":"2024-04-25T22:02:16.466705+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466359+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:02:16.466359+0000","last_peered":"2024-04-25T22:02:16.466359+0000","last_clean":"2024-04-25T22:02:16.466359+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:02:16.466359+0000","last_undegraded":"2024-04-25T22:02:16.466359+0000","last_fullsized":"2024-04-25T22:02:16.466359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464284+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:02:16.464284+0000","last_peered":"2024-04-25T22:02:16.464284+0000","last_clean":"2024-04-25T22:02:16.464284+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:02:16.464284+0000","last_undegraded":"2024-04-25T22:02:16.464284+0000","last_fullsized":"2024-04-25T22:02:16.464284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466321+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:02:16.466321+0000","last_peered":"2024-04-25T22:02:16.466321+0000","last_clean":"2024-04-25T22:02:16.466321+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:02:16.466321+0000","last_undegraded":"2024-04-25T22:02:16.466321+0000","last_fullsized":"2024-04-25T22:02:16.466321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677764+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:02:15.677764+0000","last_peered":"2024-04-25T22:02:15.677764+0000","last_clean":"2024-04-25T22:02:15.677764+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:02:15.677764+0000","last_undegraded":"2024-04-25T22:02:15.677764+0000","last_fullsized":"2024-04-25T22:02:15.677764+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675232+0000","last_change":"2024-04-25T22:01:14.632306+0000","last_active":"2024-04-25T22:02:15.675232+0000","last_peered":"2024-04-25T22:02:15.675232+0000","last_clean":"2024-04-25T22:02:15.675232+0000","last_became_active":"2024-04-25T22:01:14.631179+0000","last_became_peered":"2024-04-25T22:01:14.631179+0000","last_unstale":"2024-04-25T22:02:15.675232+0000","last_undegraded":"2024-04-25T22:02:15.675232+0000","last_fullsized":"2024-04-25T22:02:15.675232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675326+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:02:15.675326+0000","last_peered":"2024-04-25T22:02:15.675326+0000","last_clean":"2024-04-25T22:02:15.675326+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:02:15.675326+0000","last_undegraded":"2024-04-25T22:02:15.675326+0000","last_fullsized":"2024-04-25T22:02:15.675326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"23'11","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676254+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:02:15.676254+0000","last_peered":"2024-04-25T22:02:15.676254+0000","last_clean":"2024-04-25T22:02:15.676254+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:02:15.676254+0000","last_undegraded":"2024-04-25T22:02:15.676254+0000","last_fullsized":"2024-04-25T22:02:15.676254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464301+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:02:16.464301+0000","last_peered":"2024-04-25T22:02:16.464301+0000","last_clean":"2024-04-25T22:02:16.464301+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:02:16.464301+0000","last_undegraded":"2024-04-25T22:02:16.464301+0000","last_fullsized":"2024-04-25T22:02:16.464301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677069+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:02:15.677069+0000","last_peered":"2024-04-25T22:02:15.677069+0000","last_clean":"2024-04-25T22:02:15.677069+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:02:15.677069+0000","last_undegraded":"2024-04-25T22:02:15.677069+0000","last_fullsized":"2024-04-25T22:02:15.677069+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677491+0000","last_change":"2024-04-25T22:01:13.626710+0000","last_active":"2024-04-25T22:02:15.677491+0000","last_peered":"2024-04-25T22:02:15.677491+0000","last_clean":"2024-04-25T22:02:15.677491+0000","last_became_active":"2024-04-25T22:01:13.625898+0000","last_became_peered":"2024-04-25T22:01:13.625898+0000","last_unstale":"2024-04-25T22:02:15.677491+0000","last_undegraded":"2024-04-25T22:02:15.677491+0000","last_fullsized":"2024-04-25T22:02:15.677491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464048+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:02:16.464048+0000","last_peered":"2024-04-25T22:02:16.464048+0000","last_clean":"2024-04-25T22:02:16.464048+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:02:16.464048+0000","last_undegraded":"2024-04-25T22:02:16.464048+0000","last_fullsized":"2024-04-25T22:02:16.464048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466478+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:02:16.466478+0000","last_peered":"2024-04-25T22:02:16.466478+0000","last_clean":"2024-04-25T22:02:16.466478+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:02:16.466478+0000","last_undegraded":"2024-04-25T22:02:16.466478+0000","last_fullsized":"2024-04-25T22:02:16.466478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464222+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:02:16.464222+0000","last_peered":"2024-04-25T22:02:16.464222+0000","last_clean":"2024-04-25T22:02:16.464222+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:02:16.464222+0000","last_undegraded":"2024-04-25T22:02:16.464222+0000","last_fullsized":"2024-04-25T22:02:16.464222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677563+0000","last_change":"2024-04-25T22:01:14.639447+0000","last_active":"2024-04-25T22:02:15.677563+0000","last_peered":"2024-04-25T22:02:15.677563+0000","last_clean":"2024-04-25T22:02:15.677563+0000","last_became_active":"2024-04-25T22:01:14.638864+0000","last_became_peered":"2024-04-25T22:01:14.638864+0000","last_unstale":"2024-04-25T22:02:15.677563+0000","last_undegraded":"2024-04-25T22:02:15.677563+0000","last_fullsized":"2024-04-25T22:02:15.677563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464522+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:02:16.464522+0000","last_peered":"2024-04-25T22:02:16.464522+0000","last_clean":"2024-04-25T22:02:16.464522+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:02:16.464522+0000","last_undegraded":"2024-04-25T22:02:16.464522+0000","last_fullsized":"2024-04-25T22:02:16.464522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.465963+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:02:16.465963+0000","last_peered":"2024-04-25T22:02:16.465963+0000","last_clean":"2024-04-25T22:02:16.465963+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:02:16.465963+0000","last_undegraded":"2024-04-25T22:02:16.465963+0000","last_fullsized":"2024-04-25T22:02:16.465963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464307+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:02:16.464307+0000","last_peered":"2024-04-25T22:02:16.464307+0000","last_clean":"2024-04-25T22:02:16.464307+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:02:16.464307+0000","last_undegraded":"2024-04-25T22:02:16.464307+0000","last_fullsized":"2024-04-25T22:02:16.464307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676580+0000","last_change":"2024-04-25T22:01:14.637452+0000","last_active":"2024-04-25T22:02:15.676580+0000","last_peered":"2024-04-25T22:02:15.676580+0000","last_clean":"2024-04-25T22:02:15.676580+0000","last_became_active":"2024-04-25T22:01:14.636407+0000","last_became_peered":"2024-04-25T22:01:14.636407+0000","last_unstale":"2024-04-25T22:02:15.676580+0000","last_undegraded":"2024-04-25T22:02:15.676580+0000","last_fullsized":"2024-04-25T22:02:15.676580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676151+0000","last_change":"2024-04-25T22:01:13.621997+0000","last_active":"2024-04-25T22:02:15.676151+0000","last_peered":"2024-04-25T22:02:15.676151+0000","last_clean":"2024-04-25T22:02:15.676151+0000","last_became_active":"2024-04-25T22:01:13.620987+0000","last_became_peered":"2024-04-25T22:01:13.620987+0000","last_unstale":"2024-04-25T22:02:15.676151+0000","last_undegraded":"2024-04-25T22:02:15.676151+0000","last_fullsized":"2024-04-25T22:02:15.676151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676268+0000","last_change":"2024-04-25T22:01:14.650437+0000","last_active":"2024-04-25T22:02:15.676268+0000","last_peered":"2024-04-25T22:02:15.676268+0000","last_clean":"2024-04-25T22:02:15.676268+0000","last_became_active":"2024-04-25T22:01:14.648116+0000","last_became_peered":"2024-04-25T22:01:14.648116+0000","last_unstale":"2024-04-25T22:02:15.676268+0000","last_undegraded":"2024-04-25T22:02:15.676268+0000","last_fullsized":"2024-04-25T22:02:15.676268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676327+0000","last_change":"2024-04-25T22:01:13.631562+0000","last_active":"2024-04-25T22:02:15.676327+0000","last_peered":"2024-04-25T22:02:15.676327+0000","last_clean":"2024-04-25T22:02:15.676327+0000","last_became_active":"2024-04-25T22:01:13.630731+0000","last_became_peered":"2024-04-25T22:01:13.630731+0000","last_unstale":"2024-04-25T22:02:15.676327+0000","last_undegraded":"2024-04-25T22:02:15.676327+0000","last_fullsized":"2024-04-25T22:02:15.676327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675189+0000","last_change":"2024-04-25T22:01:14.654909+0000","last_active":"2024-04-25T22:02:15.675189+0000","last_peered":"2024-04-25T22:02:15.675189+0000","last_clean":"2024-04-25T22:02:15.675189+0000","last_became_active":"2024-04-25T22:01:14.653503+0000","last_became_peered":"2024-04-25T22:01:14.653503+0000","last_unstale":"2024-04-25T22:02:15.675189+0000","last_undegraded":"2024-04-25T22:02:15.675189+0000","last_fullsized":"2024-04-25T22:02:15.675189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676065+0000","last_change":"2024-04-25T22:01:13.628356+0000","last_active":"2024-04-25T22:02:15.676065+0000","last_peered":"2024-04-25T22:02:15.676065+0000","last_clean":"2024-04-25T22:02:15.676065+0000","last_became_active":"2024-04-25T22:01:13.626608+0000","last_became_peered":"2024-04-25T22:01:13.626608+0000","last_unstale":"2024-04-25T22:02:15.676065+0000","last_undegraded":"2024-04-25T22:02:15.676065+0000","last_fullsized":"2024-04-25T22:02:15.676065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675927+0000","last_change":"2024-04-25T22:01:14.648752+0000","last_active":"2024-04-25T22:02:15.675927+0000","last_peered":"2024-04-25T22:02:15.675927+0000","last_clean":"2024-04-25T22:02:15.675927+0000","last_became_active":"2024-04-25T22:01:14.647463+0000","last_became_peered":"2024-04-25T22:01:14.647463+0000","last_unstale":"2024-04-25T22:02:15.675927+0000","last_undegraded":"2024-04-25T22:02:15.675927+0000","last_fullsized":"2024-04-25T22:02:15.675927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:22.946881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676778+0000","last_change":"2024-04-25T22:01:13.630502+0000","last_active":"2024-04-25T22:02:15.676778+0000","last_peered":"2024-04-25T22:02:15.676778+0000","last_clean":"2024-04-25T22:02:15.676778+0000","last_became_active":"2024-04-25T22:01:13.629854+0000","last_became_peered":"2024-04-25T22:01:13.629854+0000","last_unstale":"2024-04-25T22:02:15.676778+0000","last_undegraded":"2024-04-25T22:02:15.676778+0000","last_fullsized":"2024-04-25T22:02:15.676778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675796+0000","last_change":"2024-04-25T22:01:14.642104+0000","last_active":"2024-04-25T22:02:15.675796+0000","last_peered":"2024-04-25T22:02:15.675796+0000","last_clean":"2024-04-25T22:02:15.675796+0000","last_became_active":"2024-04-25T22:01:14.641323+0000","last_became_peered":"2024-04-25T22:01:14.641323+0000","last_unstale":"2024-04-25T22:02:15.675796+0000","last_undegraded":"2024-04-25T22:02:15.675796+0000","last_fullsized":"2024-04-25T22:02:15.675796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466173+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:02:16.466173+0000","last_peered":"2024-04-25T22:02:16.466173+0000","last_clean":"2024-04-25T22:02:16.466173+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:02:16.466173+0000","last_undegraded":"2024-04-25T22:02:16.466173+0000","last_fullsized":"2024-04-25T22:02:16.466173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675145+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:02:15.675145+0000","last_peered":"2024-04-25T22:02:15.675145+0000","last_clean":"2024-04-25T22:02:15.675145+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:02:15.675145+0000","last_undegraded":"2024-04-25T22:02:15.675145+0000","last_fullsized":"2024-04-25T22:02:15.675145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466290+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:02:16.466290+0000","last_peered":"2024-04-25T22:02:16.466290+0000","last_clean":"2024-04-25T22:02:16.466290+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:02:16.466290+0000","last_undegraded":"2024-04-25T22:02:16.466290+0000","last_fullsized":"2024-04-25T22:02:16.466290+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738389,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":715395,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738388,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":118908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738389,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":372736,"data_stored":716011,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:02:21.214 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:02:21.220 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:21.213+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:21.280 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:21.280 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:21.294 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:21.337 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:21.333+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:21.422 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:21.418+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:21.425 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:21.425 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:21.439 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:21.523 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:21.522+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:21.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:02:21.542 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:02:21.556 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2024-04-25T22:02:20.705305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":257,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90380,"kb_used_data":1000,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025140,"statfs":{"total":289910292480,"available":289817743360,"internally_reserved":0,"allocated":1024000,"data_stored":1550314,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.124774"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677392+0000","last_change":"2024-04-25T22:01:14.641678+0000","last_active":"2024-04-25T22:02:15.677392+0000","last_peered":"2024-04-25T22:02:15.677392+0000","last_clean":"2024-04-25T22:02:15.677392+0000","last_became_active":"2024-04-25T22:01:14.640808+0000","last_became_peered":"2024-04-25T22:01:14.640808+0000","last_unstale":"2024-04-25T22:02:15.677392+0000","last_undegraded":"2024-04-25T22:02:15.677392+0000","last_fullsized":"2024-04-25T22:02:15.677392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676780+0000","last_change":"2024-04-25T22:01:14.648935+0000","last_active":"2024-04-25T22:02:15.676780+0000","last_peered":"2024-04-25T22:02:15.676780+0000","last_clean":"2024-04-25T22:02:15.676780+0000","last_became_active":"2024-04-25T22:01:14.647871+0000","last_became_peered":"2024-04-25T22:01:14.647871+0000","last_unstale":"2024-04-25T22:02:15.676780+0000","last_undegraded":"2024-04-25T22:02:15.676780+0000","last_fullsized":"2024-04-25T22:02:15.676780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676035+0000","last_change":"2024-04-25T22:01:14.647262+0000","last_active":"2024-04-25T22:02:15.676035+0000","last_peered":"2024-04-25T22:02:15.676035+0000","last_clean":"2024-04-25T22:02:15.676035+0000","last_became_active":"2024-04-25T22:01:14.645878+0000","last_became_peered":"2024-04-25T22:01:14.645878+0000","last_unstale":"2024-04-25T22:02:15.676035+0000","last_undegraded":"2024-04-25T22:02:15.676035+0000","last_fullsized":"2024-04-25T22:02:15.676035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675648+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:02:15.675648+0000","last_peered":"2024-04-25T22:02:15.675648+0000","last_clean":"2024-04-25T22:02:15.675648+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:02:15.675648+0000","last_undegraded":"2024-04-25T22:02:15.675648+0000","last_fullsized":"2024-04-25T22:02:15.675648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676042+0000","last_change":"2024-04-25T22:01:14.642505+0000","last_active":"2024-04-25T22:02:15.676042+0000","last_peered":"2024-04-25T22:02:15.676042+0000","last_clean":"2024-04-25T22:02:15.676042+0000","last_became_active":"2024-04-25T22:01:14.641574+0000","last_became_peered":"2024-04-25T22:01:14.641574+0000","last_unstale":"2024-04-25T22:02:15.676042+0000","last_undegraded":"2024-04-25T22:02:15.676042+0000","last_fullsized":"2024-04-25T22:02:15.676042+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.674992+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:02:15.674992+0000","last_peered":"2024-04-25T22:02:15.674992+0000","last_clean":"2024-04-25T22:02:15.674992+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:02:15.674992+0000","last_undegraded":"2024-04-25T22:02:15.674992+0000","last_fullsized":"2024-04-25T22:02:15.674992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.674929+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:02:15.674929+0000","last_peered":"2024-04-25T22:02:15.674929+0000","last_clean":"2024-04-25T22:02:15.674929+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:02:15.674929+0000","last_undegraded":"2024-04-25T22:02:15.674929+0000","last_fullsized":"2024-04-25T22:02:15.674929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.674387+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:02:15.674387+0000","last_peered":"2024-04-25T22:02:15.674387+0000","last_clean":"2024-04-25T22:02:15.674387+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:02:15.674387+0000","last_undegraded":"2024-04-25T22:02:15.674387+0000","last_fullsized":"2024-04-25T22:02:15.674387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.465751+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:02:16.465751+0000","last_peered":"2024-04-25T22:02:16.465751+0000","last_clean":"2024-04-25T22:02:16.465751+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:02:16.465751+0000","last_undegraded":"2024-04-25T22:02:16.465751+0000","last_fullsized":"2024-04-25T22:02:16.465751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676935+0000","last_change":"2024-04-25T22:01:14.647968+0000","last_active":"2024-04-25T22:02:15.676935+0000","last_peered":"2024-04-25T22:02:15.676935+0000","last_clean":"2024-04-25T22:02:15.676935+0000","last_became_active":"2024-04-25T22:01:14.646872+0000","last_became_peered":"2024-04-25T22:01:14.646872+0000","last_unstale":"2024-04-25T22:02:15.676935+0000","last_undegraded":"2024-04-25T22:02:15.676935+0000","last_fullsized":"2024-04-25T22:02:15.676935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676245+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:02:15.676245+0000","last_peered":"2024-04-25T22:02:15.676245+0000","last_clean":"2024-04-25T22:02:15.676245+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:02:15.676245+0000","last_undegraded":"2024-04-25T22:02:15.676245+0000","last_fullsized":"2024-04-25T22:02:15.676245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676224+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:02:15.676224+0000","last_peered":"2024-04-25T22:02:15.676224+0000","last_clean":"2024-04-25T22:02:15.676224+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:02:15.676224+0000","last_undegraded":"2024-04-25T22:02:15.676224+0000","last_fullsized":"2024-04-25T22:02:15.676224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675747+0000","last_change":"2024-04-25T22:01:14.643909+0000","last_active":"2024-04-25T22:02:15.675747+0000","last_peered":"2024-04-25T22:02:15.675747+0000","last_clean":"2024-04-25T22:02:15.675747+0000","last_became_active":"2024-04-25T22:01:14.642421+0000","last_became_peered":"2024-04-25T22:01:14.642421+0000","last_unstale":"2024-04-25T22:02:15.675747+0000","last_undegraded":"2024-04-25T22:02:15.675747+0000","last_fullsized":"2024-04-25T22:02:15.675747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675020+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:02:15.675020+0000","last_peered":"2024-04-25T22:02:15.675020+0000","last_clean":"2024-04-25T22:02:15.675020+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:02:15.675020+0000","last_undegraded":"2024-04-25T22:02:15.675020+0000","last_fullsized":"2024-04-25T22:02:15.675020+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675115+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:02:15.675115+0000","last_peered":"2024-04-25T22:02:15.675115+0000","last_clean":"2024-04-25T22:02:15.675115+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:02:15.675115+0000","last_undegraded":"2024-04-25T22:02:15.675115+0000","last_fullsized":"2024-04-25T22:02:15.675115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.674543+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:02:15.674543+0000","last_peered":"2024-04-25T22:02:15.674543+0000","last_clean":"2024-04-25T22:02:15.674543+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:02:15.674543+0000","last_undegraded":"2024-04-25T22:02:15.674543+0000","last_fullsized":"2024-04-25T22:02:15.674543+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466558+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:02:16.466558+0000","last_peered":"2024-04-25T22:02:16.466558+0000","last_clean":"2024-04-25T22:02:16.466558+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:02:16.466558+0000","last_undegraded":"2024-04-25T22:02:16.466558+0000","last_fullsized":"2024-04-25T22:02:16.466558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677392+0000","last_change":"2024-04-25T22:01:14.647317+0000","last_active":"2024-04-25T22:02:15.677392+0000","last_peered":"2024-04-25T22:02:15.677392+0000","last_clean":"2024-04-25T22:02:15.677392+0000","last_became_active":"2024-04-25T22:01:14.644027+0000","last_became_peered":"2024-04-25T22:01:14.644027+0000","last_unstale":"2024-04-25T22:02:15.677392+0000","last_undegraded":"2024-04-25T22:02:15.677392+0000","last_fullsized":"2024-04-25T22:02:15.677392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.465447+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:02:16.465447+0000","last_peered":"2024-04-25T22:02:16.465447+0000","last_clean":"2024-04-25T22:02:16.465447+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:02:16.465447+0000","last_undegraded":"2024-04-25T22:02:16.465447+0000","last_fullsized":"2024-04-25T22:02:16.465447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675774+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:02:15.675774+0000","last_peered":"2024-04-25T22:02:15.675774+0000","last_clean":"2024-04-25T22:02:15.675774+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:02:15.675774+0000","last_undegraded":"2024-04-25T22:02:15.675774+0000","last_fullsized":"2024-04-25T22:02:15.675774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675609+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:02:15.675609+0000","last_peered":"2024-04-25T22:02:15.675609+0000","last_clean":"2024-04-25T22:02:15.675609+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:02:15.675609+0000","last_undegraded":"2024-04-25T22:02:15.675609+0000","last_fullsized":"2024-04-25T22:02:15.675609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675789+0000","last_change":"2024-04-25T22:01:14.633477+0000","last_active":"2024-04-25T22:02:15.675789+0000","last_peered":"2024-04-25T22:02:15.675789+0000","last_clean":"2024-04-25T22:02:15.675789+0000","last_became_active":"2024-04-25T22:01:14.632678+0000","last_became_peered":"2024-04-25T22:01:14.632678+0000","last_unstale":"2024-04-25T22:02:15.675789+0000","last_undegraded":"2024-04-25T22:02:15.675789+0000","last_fullsized":"2024-04-25T22:02:15.675789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.463733+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:02:16.463733+0000","last_peered":"2024-04-25T22:02:16.463733+0000","last_clean":"2024-04-25T22:02:16.463733+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:02:16.463733+0000","last_undegraded":"2024-04-25T22:02:16.463733+0000","last_fullsized":"2024-04-25T22:02:16.463733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675155+0000","last_change":"2024-04-25T22:01:14.641991+0000","last_active":"2024-04-25T22:02:15.675155+0000","last_peered":"2024-04-25T22:02:15.675155+0000","last_clean":"2024-04-25T22:02:15.675155+0000","last_became_active":"2024-04-25T22:01:14.641244+0000","last_became_peered":"2024-04-25T22:01:14.641244+0000","last_unstale":"2024-04-25T22:02:15.675155+0000","last_undegraded":"2024-04-25T22:02:15.675155+0000","last_fullsized":"2024-04-25T22:02:15.675155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:03.098700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677412+0000","last_change":"2024-04-25T22:01:14.638103+0000","last_active":"2024-04-25T22:02:15.677412+0000","last_peered":"2024-04-25T22:02:15.677412+0000","last_clean":"2024-04-25T22:02:15.677412+0000","last_became_active":"2024-04-25T22:01:14.636488+0000","last_became_peered":"2024-04-25T22:01:14.636488+0000","last_unstale":"2024-04-25T22:02:15.677412+0000","last_undegraded":"2024-04-25T22:02:15.677412+0000","last_fullsized":"2024-04-25T22:02:15.677412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.465885+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:02:16.465885+0000","last_peered":"2024-04-25T22:02:16.465885+0000","last_clean":"2024-04-25T22:02:16.465885+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:02:16.465885+0000","last_undegraded":"2024-04-25T22:02:16.465885+0000","last_fullsized":"2024-04-25T22:02:16.465885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676328+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:02:15.676328+0000","last_peered":"2024-04-25T22:02:15.676328+0000","last_clean":"2024-04-25T22:02:15.676328+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:02:15.676328+0000","last_undegraded":"2024-04-25T22:02:15.676328+0000","last_fullsized":"2024-04-25T22:02:15.676328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676562+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:02:15.676562+0000","last_peered":"2024-04-25T22:02:15.676562+0000","last_clean":"2024-04-25T22:02:15.676562+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:02:15.676562+0000","last_undegraded":"2024-04-25T22:02:15.676562+0000","last_fullsized":"2024-04-25T22:02:15.676562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464969+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:02:16.464969+0000","last_peered":"2024-04-25T22:02:16.464969+0000","last_clean":"2024-04-25T22:02:16.464969+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:02:16.464969+0000","last_undegraded":"2024-04-25T22:02:16.464969+0000","last_fullsized":"2024-04-25T22:02:16.464969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675864+0000","last_change":"2024-04-25T22:01:14.638343+0000","last_active":"2024-04-25T22:02:15.675864+0000","last_peered":"2024-04-25T22:02:15.675864+0000","last_clean":"2024-04-25T22:02:15.675864+0000","last_became_active":"2024-04-25T22:01:14.637694+0000","last_became_peered":"2024-04-25T22:01:14.637694+0000","last_unstale":"2024-04-25T22:02:15.675864+0000","last_undegraded":"2024-04-25T22:02:15.675864+0000","last_fullsized":"2024-04-25T22:02:15.675864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.463940+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:02:16.463940+0000","last_peered":"2024-04-25T22:02:16.463940+0000","last_clean":"2024-04-25T22:02:16.463940+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:02:16.463940+0000","last_undegraded":"2024-04-25T22:02:16.463940+0000","last_fullsized":"2024-04-25T22:02:16.463940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.674680+0000","last_change":"2024-04-25T22:01:14.648196+0000","last_active":"2024-04-25T22:02:15.674680+0000","last_peered":"2024-04-25T22:02:15.674680+0000","last_clean":"2024-04-25T22:02:15.674680+0000","last_became_active":"2024-04-25T22:01:14.647509+0000","last_became_peered":"2024-04-25T22:01:14.647509+0000","last_unstale":"2024-04-25T22:02:15.674680+0000","last_undegraded":"2024-04-25T22:02:15.674680+0000","last_fullsized":"2024-04-25T22:02:15.674680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676499+0000","last_change":"2024-04-25T22:01:14.641706+0000","last_active":"2024-04-25T22:02:15.676499+0000","last_peered":"2024-04-25T22:02:15.676499+0000","last_clean":"2024-04-25T22:02:15.676499+0000","last_became_active":"2024-04-25T22:01:14.641043+0000","last_became_peered":"2024-04-25T22:01:14.641043+0000","last_unstale":"2024-04-25T22:02:15.676499+0000","last_undegraded":"2024-04-25T22:02:15.676499+0000","last_fullsized":"2024-04-25T22:02:15.676499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675690+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:02:15.675690+0000","last_peered":"2024-04-25T22:02:15.675690+0000","last_clean":"2024-04-25T22:02:15.675690+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:02:15.675690+0000","last_undegraded":"2024-04-25T22:02:15.675690+0000","last_fullsized":"2024-04-25T22:02:15.675690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676712+0000","last_change":"2024-04-25T22:01:14.635075+0000","last_active":"2024-04-25T22:02:15.676712+0000","last_peered":"2024-04-25T22:02:15.676712+0000","last_clean":"2024-04-25T22:02:15.676712+0000","last_became_active":"2024-04-25T22:01:14.630677+0000","last_became_peered":"2024-04-25T22:01:14.630677+0000","last_unstale":"2024-04-25T22:02:15.676712+0000","last_undegraded":"2024-04-25T22:02:15.676712+0000","last_fullsized":"2024-04-25T22:02:15.676712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464613+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:02:16.464613+0000","last_peered":"2024-04-25T22:02:16.464613+0000","last_clean":"2024-04-25T22:02:16.464613+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:02:16.464613+0000","last_undegraded":"2024-04-25T22:02:16.464613+0000","last_fullsized":"2024-04-25T22:02:16.464613+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466174+0000","last_change":"2024-04-25T22:01:14.648527+0000","last_active":"2024-04-25T22:02:16.466174+0000","last_peered":"2024-04-25T22:02:16.466174+0000","last_clean":"2024-04-25T22:02:16.466174+0000","last_became_active":"2024-04-25T22:01:14.645040+0000","last_became_peered":"2024-04-25T22:01:14.645040+0000","last_unstale":"2024-04-25T22:02:16.466174+0000","last_undegraded":"2024-04-25T22:02:16.466174+0000","last_fullsized":"2024-04-25T22:02:16.466174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675527+0000","last_change":"2024-04-25T22:01:13.630817+0000","last_active":"2024-04-25T22:02:15.675527+0000","last_peered":"2024-04-25T22:02:15.675527+0000","last_clean":"2024-04-25T22:02:15.675527+0000","last_became_active":"2024-04-25T22:01:13.629994+0000","last_became_peered":"2024-04-25T22:01:13.629994+0000","last_unstale":"2024-04-25T22:02:15.675527+0000","last_undegraded":"2024-04-25T22:02:15.675527+0000","last_fullsized":"2024-04-25T22:02:15.675527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.465845+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:02:16.465845+0000","last_peered":"2024-04-25T22:02:16.465845+0000","last_clean":"2024-04-25T22:02:16.465845+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:02:16.465845+0000","last_undegraded":"2024-04-25T22:02:16.465845+0000","last_fullsized":"2024-04-25T22:02:16.465845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675060+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:02:15.675060+0000","last_peered":"2024-04-25T22:02:15.675060+0000","last_clean":"2024-04-25T22:02:15.675060+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:02:15.675060+0000","last_undegraded":"2024-04-25T22:02:15.675060+0000","last_fullsized":"2024-04-25T22:02:15.675060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677623+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:02:15.677623+0000","last_peered":"2024-04-25T22:02:15.677623+0000","last_clean":"2024-04-25T22:02:15.677623+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:02:15.677623+0000","last_undegraded":"2024-04-25T22:02:15.677623+0000","last_fullsized":"2024-04-25T22:02:15.677623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675164+0000","last_change":"2024-04-25T22:01:14.633805+0000","last_active":"2024-04-25T22:02:15.675164+0000","last_peered":"2024-04-25T22:02:15.675164+0000","last_clean":"2024-04-25T22:02:15.675164+0000","last_became_active":"2024-04-25T22:01:14.633045+0000","last_became_peered":"2024-04-25T22:01:14.633045+0000","last_unstale":"2024-04-25T22:02:15.675164+0000","last_undegraded":"2024-04-25T22:02:15.675164+0000","last_fullsized":"2024-04-25T22:02:15.675164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:43.718628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677379+0000","last_change":"2024-04-25T22:01:13.631135+0000","last_active":"2024-04-25T22:02:15.677379+0000","last_peered":"2024-04-25T22:02:15.677379+0000","last_clean":"2024-04-25T22:02:15.677379+0000","last_became_active":"2024-04-25T22:01:13.630257+0000","last_became_peered":"2024-04-25T22:01:13.630257+0000","last_unstale":"2024-04-25T22:02:15.677379+0000","last_undegraded":"2024-04-25T22:02:15.677379+0000","last_fullsized":"2024-04-25T22:02:15.677379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675212+0000","last_change":"2024-04-25T22:01:14.630233+0000","last_active":"2024-04-25T22:02:15.675212+0000","last_peered":"2024-04-25T22:02:15.675212+0000","last_clean":"2024-04-25T22:02:15.675212+0000","last_became_active":"2024-04-25T22:01:14.629415+0000","last_became_peered":"2024-04-25T22:01:14.629415+0000","last_unstale":"2024-04-25T22:02:15.675212+0000","last_undegraded":"2024-04-25T22:02:15.675212+0000","last_fullsized":"2024-04-25T22:02:15.675212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:02:28.593163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676766+0000","last_change":"2024-04-25T22:01:13.633106+0000","last_active":"2024-04-25T22:02:15.676766+0000","last_peered":"2024-04-25T22:02:15.676766+0000","last_clean":"2024-04-25T22:02:15.676766+0000","last_became_active":"2024-04-25T22:01:13.631466+0000","last_became_peered":"2024-04-25T22:01:13.631466+0000","last_unstale":"2024-04-25T22:02:15.676766+0000","last_undegraded":"2024-04-25T22:02:15.676766+0000","last_fullsized":"2024-04-25T22:02:15.676766+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:23.095422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675471+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:02:15.675471+0000","last_peered":"2024-04-25T22:02:15.675471+0000","last_clean":"2024-04-25T22:02:15.675471+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:02:15.675471+0000","last_undegraded":"2024-04-25T22:02:15.675471+0000","last_fullsized":"2024-04-25T22:02:15.675471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676498+0000","last_change":"2024-04-25T22:01:13.626767+0000","last_active":"2024-04-25T22:02:15.676498+0000","last_peered":"2024-04-25T22:02:15.676498+0000","last_clean":"2024-04-25T22:02:15.676498+0000","last_became_active":"2024-04-25T22:01:13.625984+0000","last_became_peered":"2024-04-25T22:01:13.625984+0000","last_unstale":"2024-04-25T22:02:15.676498+0000","last_undegraded":"2024-04-25T22:02:15.676498+0000","last_fullsized":"2024-04-25T22:02:15.676498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464943+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:02:16.464943+0000","last_peered":"2024-04-25T22:02:16.464943+0000","last_clean":"2024-04-25T22:02:16.464943+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:02:16.464943+0000","last_undegraded":"2024-04-25T22:02:16.464943+0000","last_fullsized":"2024-04-25T22:02:16.464943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.465265+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:02:16.465265+0000","last_peered":"2024-04-25T22:02:16.465265+0000","last_clean":"2024-04-25T22:02:16.465265+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:02:16.465265+0000","last_undegraded":"2024-04-25T22:02:16.465265+0000","last_fullsized":"2024-04-25T22:02:16.465265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675925+0000","last_change":"2024-04-25T22:01:14.650077+0000","last_active":"2024-04-25T22:02:15.675925+0000","last_peered":"2024-04-25T22:02:15.675925+0000","last_clean":"2024-04-25T22:02:15.675925+0000","last_became_active":"2024-04-25T22:01:14.649315+0000","last_became_peered":"2024-04-25T22:01:14.649315+0000","last_unstale":"2024-04-25T22:02:15.675925+0000","last_undegraded":"2024-04-25T22:02:15.675925+0000","last_fullsized":"2024-04-25T22:02:15.675925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.976715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676078+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:02:15.676078+0000","last_peered":"2024-04-25T22:02:15.676078+0000","last_clean":"2024-04-25T22:02:15.676078+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:02:15.676078+0000","last_undegraded":"2024-04-25T22:02:15.676078+0000","last_fullsized":"2024-04-25T22:02:15.676078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676592+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:02:15.676592+0000","last_peered":"2024-04-25T22:02:15.676592+0000","last_clean":"2024-04-25T22:02:15.676592+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:02:15.676592+0000","last_undegraded":"2024-04-25T22:02:15.676592+0000","last_fullsized":"2024-04-25T22:02:15.676592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675621+0000","last_change":"2024-04-25T22:01:13.631439+0000","last_active":"2024-04-25T22:02:15.675621+0000","last_peered":"2024-04-25T22:02:15.675621+0000","last_clean":"2024-04-25T22:02:15.675621+0000","last_became_active":"2024-04-25T22:01:13.630812+0000","last_became_peered":"2024-04-25T22:01:13.630812+0000","last_unstale":"2024-04-25T22:02:15.675621+0000","last_undegraded":"2024-04-25T22:02:15.675621+0000","last_fullsized":"2024-04-25T22:02:15.675621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677265+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:02:15.677265+0000","last_peered":"2024-04-25T22:02:15.677265+0000","last_clean":"2024-04-25T22:02:15.677265+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:02:15.677265+0000","last_undegraded":"2024-04-25T22:02:15.677265+0000","last_fullsized":"2024-04-25T22:02:15.677265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675611+0000","last_change":"2024-04-25T22:01:13.623342+0000","last_active":"2024-04-25T22:02:15.675611+0000","last_peered":"2024-04-25T22:02:15.675611+0000","last_clean":"2024-04-25T22:02:15.675611+0000","last_became_active":"2024-04-25T22:01:13.621460+0000","last_became_peered":"2024-04-25T22:01:13.621460+0000","last_unstale":"2024-04-25T22:02:15.675611+0000","last_undegraded":"2024-04-25T22:02:15.675611+0000","last_fullsized":"2024-04-25T22:02:15.675611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466010+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:02:16.466010+0000","last_peered":"2024-04-25T22:02:16.466010+0000","last_clean":"2024-04-25T22:02:16.466010+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:02:16.466010+0000","last_undegraded":"2024-04-25T22:02:16.466010+0000","last_fullsized":"2024-04-25T22:02:16.466010+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":252,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675492+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:02:15.675492+0000","last_peered":"2024-04-25T22:02:15.675492+0000","last_clean":"2024-04-25T22:02:15.675492+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:02:15.675492+0000","last_undegraded":"2024-04-25T22:02:15.675492+0000","last_fullsized":"2024-04-25T22:02:15.675492+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676017+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:02:15.676017+0000","last_peered":"2024-04-25T22:02:15.676017+0000","last_clean":"2024-04-25T22:02:15.676017+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:02:15.676017+0000","last_undegraded":"2024-04-25T22:02:15.676017+0000","last_fullsized":"2024-04-25T22:02:15.676017+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464902+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:02:16.464902+0000","last_peered":"2024-04-25T22:02:16.464902+0000","last_clean":"2024-04-25T22:02:16.464902+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:02:16.464902+0000","last_undegraded":"2024-04-25T22:02:16.464902+0000","last_fullsized":"2024-04-25T22:02:16.464902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676635+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:02:15.676635+0000","last_peered":"2024-04-25T22:02:15.676635+0000","last_clean":"2024-04-25T22:02:15.676635+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:02:15.676635+0000","last_undegraded":"2024-04-25T22:02:15.676635+0000","last_fullsized":"2024-04-25T22:02:15.676635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675401+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:02:15.675401+0000","last_peered":"2024-04-25T22:02:15.675401+0000","last_clean":"2024-04-25T22:02:15.675401+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:02:15.675401+0000","last_undegraded":"2024-04-25T22:02:15.675401+0000","last_fullsized":"2024-04-25T22:02:15.675401+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464394+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:02:16.464394+0000","last_peered":"2024-04-25T22:02:16.464394+0000","last_clean":"2024-04-25T22:02:16.464394+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:02:16.464394+0000","last_undegraded":"2024-04-25T22:02:16.464394+0000","last_fullsized":"2024-04-25T22:02:16.464394+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677102+0000","last_change":"2024-04-25T22:01:14.645176+0000","last_active":"2024-04-25T22:02:15.677102+0000","last_peered":"2024-04-25T22:02:15.677102+0000","last_clean":"2024-04-25T22:02:15.677102+0000","last_became_active":"2024-04-25T22:01:14.642395+0000","last_became_peered":"2024-04-25T22:01:14.642395+0000","last_unstale":"2024-04-25T22:02:15.677102+0000","last_undegraded":"2024-04-25T22:02:15.677102+0000","last_fullsized":"2024-04-25T22:02:15.677102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464733+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:02:16.464733+0000","last_peered":"2024-04-25T22:02:16.464733+0000","last_clean":"2024-04-25T22:02:16.464733+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:02:16.464733+0000","last_undegraded":"2024-04-25T22:02:16.464733+0000","last_fullsized":"2024-04-25T22:02:16.464733+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675496+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:02:15.675496+0000","last_peered":"2024-04-25T22:02:15.675496+0000","last_clean":"2024-04-25T22:02:15.675496+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:02:15.675496+0000","last_undegraded":"2024-04-25T22:02:15.675496+0000","last_fullsized":"2024-04-25T22:02:15.675496+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466092+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:02:16.466092+0000","last_peered":"2024-04-25T22:02:16.466092+0000","last_clean":"2024-04-25T22:02:16.466092+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:02:16.466092+0000","last_undegraded":"2024-04-25T22:02:16.466092+0000","last_fullsized":"2024-04-25T22:02:16.466092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676418+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:02:15.676418+0000","last_peered":"2024-04-25T22:02:15.676418+0000","last_clean":"2024-04-25T22:02:15.676418+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:02:15.676418+0000","last_undegraded":"2024-04-25T22:02:15.676418+0000","last_fullsized":"2024-04-25T22:02:15.676418+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675874+0000","last_change":"2024-04-25T22:01:13.627274+0000","last_active":"2024-04-25T22:02:15.675874+0000","last_peered":"2024-04-25T22:02:15.675874+0000","last_clean":"2024-04-25T22:02:15.675874+0000","last_became_active":"2024-04-25T22:01:13.626015+0000","last_became_peered":"2024-04-25T22:01:13.626015+0000","last_unstale":"2024-04-25T22:02:15.675874+0000","last_undegraded":"2024-04-25T22:02:15.675874+0000","last_fullsized":"2024-04-25T22:02:15.675874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.465546+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:02:16.465546+0000","last_peered":"2024-04-25T22:02:16.465546+0000","last_clean":"2024-04-25T22:02:16.465546+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:02:16.465546+0000","last_undegraded":"2024-04-25T22:02:16.465546+0000","last_fullsized":"2024-04-25T22:02:16.465546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676841+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:02:15.676841+0000","last_peered":"2024-04-25T22:02:15.676841+0000","last_clean":"2024-04-25T22:02:15.676841+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:02:15.676841+0000","last_undegraded":"2024-04-25T22:02:15.676841+0000","last_fullsized":"2024-04-25T22:02:15.676841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.465850+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:02:16.465850+0000","last_peered":"2024-04-25T22:02:16.465850+0000","last_clean":"2024-04-25T22:02:16.465850+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:02:16.465850+0000","last_undegraded":"2024-04-25T22:02:16.465850+0000","last_fullsized":"2024-04-25T22:02:16.465850+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675603+0000","last_change":"2024-04-25T22:01:14.637520+0000","last_active":"2024-04-25T22:02:15.675603+0000","last_peered":"2024-04-25T22:02:15.675603+0000","last_clean":"2024-04-25T22:02:15.675603+0000","last_became_active":"2024-04-25T22:01:14.636765+0000","last_became_peered":"2024-04-25T22:01:14.636765+0000","last_unstale":"2024-04-25T22:02:15.675603+0000","last_undegraded":"2024-04-25T22:02:15.675603+0000","last_fullsized":"2024-04-25T22:02:15.675603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.465553+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:02:16.465553+0000","last_peered":"2024-04-25T22:02:16.465553+0000","last_clean":"2024-04-25T22:02:16.465553+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:02:16.465553+0000","last_undegraded":"2024-04-25T22:02:16.465553+0000","last_fullsized":"2024-04-25T22:02:16.465553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677196+0000","last_change":"2024-04-25T22:01:09.582204+0000","last_active":"2024-04-25T22:02:15.677196+0000","last_peered":"2024-04-25T22:02:15.677196+0000","last_clean":"2024-04-25T22:02:15.677196+0000","last_became_active":"2024-04-25T22:01:09.581494+0000","last_became_peered":"2024-04-25T22:01:09.581494+0000","last_unstale":"2024-04-25T22:02:15.677196+0000","last_undegraded":"2024-04-25T22:02:15.677196+0000","last_fullsized":"2024-04-25T22:02:15.677196+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:13.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675923+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:02:15.675923+0000","last_peered":"2024-04-25T22:02:15.675923+0000","last_clean":"2024-04-25T22:02:15.675923+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:02:15.675923+0000","last_undegraded":"2024-04-25T22:02:15.675923+0000","last_fullsized":"2024-04-25T22:02:15.675923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466705+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:02:16.466705+0000","last_peered":"2024-04-25T22:02:16.466705+0000","last_clean":"2024-04-25T22:02:16.466705+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:02:16.466705+0000","last_undegraded":"2024-04-25T22:02:16.466705+0000","last_fullsized":"2024-04-25T22:02:16.466705+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466359+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:02:16.466359+0000","last_peered":"2024-04-25T22:02:16.466359+0000","last_clean":"2024-04-25T22:02:16.466359+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:02:16.466359+0000","last_undegraded":"2024-04-25T22:02:16.466359+0000","last_fullsized":"2024-04-25T22:02:16.466359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464284+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:02:16.464284+0000","last_peered":"2024-04-25T22:02:16.464284+0000","last_clean":"2024-04-25T22:02:16.464284+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:02:16.464284+0000","last_undegraded":"2024-04-25T22:02:16.464284+0000","last_fullsized":"2024-04-25T22:02:16.464284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466321+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:02:16.466321+0000","last_peered":"2024-04-25T22:02:16.466321+0000","last_clean":"2024-04-25T22:02:16.466321+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:02:16.466321+0000","last_undegraded":"2024-04-25T22:02:16.466321+0000","last_fullsized":"2024-04-25T22:02:16.466321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677764+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:02:15.677764+0000","last_peered":"2024-04-25T22:02:15.677764+0000","last_clean":"2024-04-25T22:02:15.677764+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:02:15.677764+0000","last_undegraded":"2024-04-25T22:02:15.677764+0000","last_fullsized":"2024-04-25T22:02:15.677764+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675232+0000","last_change":"2024-04-25T22:01:14.632306+0000","last_active":"2024-04-25T22:02:15.675232+0000","last_peered":"2024-04-25T22:02:15.675232+0000","last_clean":"2024-04-25T22:02:15.675232+0000","last_became_active":"2024-04-25T22:01:14.631179+0000","last_became_peered":"2024-04-25T22:01:14.631179+0000","last_unstale":"2024-04-25T22:02:15.675232+0000","last_undegraded":"2024-04-25T22:02:15.675232+0000","last_fullsized":"2024-04-25T22:02:15.675232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675326+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:02:15.675326+0000","last_peered":"2024-04-25T22:02:15.675326+0000","last_clean":"2024-04-25T22:02:15.675326+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:02:15.675326+0000","last_undegraded":"2024-04-25T22:02:15.675326+0000","last_fullsized":"2024-04-25T22:02:15.675326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"23'11","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676254+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:02:15.676254+0000","last_peered":"2024-04-25T22:02:15.676254+0000","last_clean":"2024-04-25T22:02:15.676254+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:02:15.676254+0000","last_undegraded":"2024-04-25T22:02:15.676254+0000","last_fullsized":"2024-04-25T22:02:15.676254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464301+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:02:16.464301+0000","last_peered":"2024-04-25T22:02:16.464301+0000","last_clean":"2024-04-25T22:02:16.464301+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:02:16.464301+0000","last_undegraded":"2024-04-25T22:02:16.464301+0000","last_fullsized":"2024-04-25T22:02:16.464301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677069+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:02:15.677069+0000","last_peered":"2024-04-25T22:02:15.677069+0000","last_clean":"2024-04-25T22:02:15.677069+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:02:15.677069+0000","last_undegraded":"2024-04-25T22:02:15.677069+0000","last_fullsized":"2024-04-25T22:02:15.677069+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677491+0000","last_change":"2024-04-25T22:01:13.626710+0000","last_active":"2024-04-25T22:02:15.677491+0000","last_peered":"2024-04-25T22:02:15.677491+0000","last_clean":"2024-04-25T22:02:15.677491+0000","last_became_active":"2024-04-25T22:01:13.625898+0000","last_became_peered":"2024-04-25T22:01:13.625898+0000","last_unstale":"2024-04-25T22:02:15.677491+0000","last_undegraded":"2024-04-25T22:02:15.677491+0000","last_fullsized":"2024-04-25T22:02:15.677491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464048+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:02:16.464048+0000","last_peered":"2024-04-25T22:02:16.464048+0000","last_clean":"2024-04-25T22:02:16.464048+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:02:16.464048+0000","last_undegraded":"2024-04-25T22:02:16.464048+0000","last_fullsized":"2024-04-25T22:02:16.464048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466478+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:02:16.466478+0000","last_peered":"2024-04-25T22:02:16.466478+0000","last_clean":"2024-04-25T22:02:16.466478+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:02:16.466478+0000","last_undegraded":"2024-04-25T22:02:16.466478+0000","last_fullsized":"2024-04-25T22:02:16.466478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464222+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:02:16.464222+0000","last_peered":"2024-04-25T22:02:16.464222+0000","last_clean":"2024-04-25T22:02:16.464222+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:02:16.464222+0000","last_undegraded":"2024-04-25T22:02:16.464222+0000","last_fullsized":"2024-04-25T22:02:16.464222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.677563+0000","last_change":"2024-04-25T22:01:14.639447+0000","last_active":"2024-04-25T22:02:15.677563+0000","last_peered":"2024-04-25T22:02:15.677563+0000","last_clean":"2024-04-25T22:02:15.677563+0000","last_became_active":"2024-04-25T22:01:14.638864+0000","last_became_peered":"2024-04-25T22:01:14.638864+0000","last_unstale":"2024-04-25T22:02:15.677563+0000","last_undegraded":"2024-04-25T22:02:15.677563+0000","last_fullsized":"2024-04-25T22:02:15.677563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464522+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:02:16.464522+0000","last_peered":"2024-04-25T22:02:16.464522+0000","last_clean":"2024-04-25T22:02:16.464522+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:02:16.464522+0000","last_undegraded":"2024-04-25T22:02:16.464522+0000","last_fullsized":"2024-04-25T22:02:16.464522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.465963+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:02:16.465963+0000","last_peered":"2024-04-25T22:02:16.465963+0000","last_clean":"2024-04-25T22:02:16.465963+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:02:16.465963+0000","last_undegraded":"2024-04-25T22:02:16.465963+0000","last_fullsized":"2024-04-25T22:02:16.465963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.464307+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:02:16.464307+0000","last_peered":"2024-04-25T22:02:16.464307+0000","last_clean":"2024-04-25T22:02:16.464307+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:02:16.464307+0000","last_undegraded":"2024-04-25T22:02:16.464307+0000","last_fullsized":"2024-04-25T22:02:16.464307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676580+0000","last_change":"2024-04-25T22:01:14.637452+0000","last_active":"2024-04-25T22:02:15.676580+0000","last_peered":"2024-04-25T22:02:15.676580+0000","last_clean":"2024-04-25T22:02:15.676580+0000","last_became_active":"2024-04-25T22:01:14.636407+0000","last_became_peered":"2024-04-25T22:01:14.636407+0000","last_unstale":"2024-04-25T22:02:15.676580+0000","last_undegraded":"2024-04-25T22:02:15.676580+0000","last_fullsized":"2024-04-25T22:02:15.676580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676151+0000","last_change":"2024-04-25T22:01:13.621997+0000","last_active":"2024-04-25T22:02:15.676151+0000","last_peered":"2024-04-25T22:02:15.676151+0000","last_clean":"2024-04-25T22:02:15.676151+0000","last_became_active":"2024-04-25T22:01:13.620987+0000","last_became_peered":"2024-04-25T22:01:13.620987+0000","last_unstale":"2024-04-25T22:02:15.676151+0000","last_undegraded":"2024-04-25T22:02:15.676151+0000","last_fullsized":"2024-04-25T22:02:15.676151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676268+0000","last_change":"2024-04-25T22:01:14.650437+0000","last_active":"2024-04-25T22:02:15.676268+0000","last_peered":"2024-04-25T22:02:15.676268+0000","last_clean":"2024-04-25T22:02:15.676268+0000","last_became_active":"2024-04-25T22:01:14.648116+0000","last_became_peered":"2024-04-25T22:01:14.648116+0000","last_unstale":"2024-04-25T22:02:15.676268+0000","last_undegraded":"2024-04-25T22:02:15.676268+0000","last_fullsized":"2024-04-25T22:02:15.676268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676327+0000","last_change":"2024-04-25T22:01:13.631562+0000","last_active":"2024-04-25T22:02:15.676327+0000","last_peered":"2024-04-25T22:02:15.676327+0000","last_clean":"2024-04-25T22:02:15.676327+0000","last_became_active":"2024-04-25T22:01:13.630731+0000","last_became_peered":"2024-04-25T22:01:13.630731+0000","last_unstale":"2024-04-25T22:02:15.676327+0000","last_undegraded":"2024-04-25T22:02:15.676327+0000","last_fullsized":"2024-04-25T22:02:15.676327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675189+0000","last_change":"2024-04-25T22:01:14.654909+0000","last_active":"2024-04-25T22:02:15.675189+0000","last_peered":"2024-04-25T22:02:15.675189+0000","last_clean":"2024-04-25T22:02:15.675189+0000","last_became_active":"2024-04-25T22:01:14.653503+0000","last_became_peered":"2024-04-25T22:01:14.653503+0000","last_unstale":"2024-04-25T22:02:15.675189+0000","last_undegraded":"2024-04-25T22:02:15.675189+0000","last_fullsized":"2024-04-25T22:02:15.675189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676065+0000","last_change":"2024-04-25T22:01:13.628356+0000","last_active":"2024-04-25T22:02:15.676065+0000","last_peered":"2024-04-25T22:02:15.676065+0000","last_clean":"2024-04-25T22:02:15.676065+0000","last_became_active":"2024-04-25T22:01:13.626608+0000","last_became_peered":"2024-04-25T22:01:13.626608+0000","last_unstale":"2024-04-25T22:02:15.676065+0000","last_undegraded":"2024-04-25T22:02:15.676065+0000","last_fullsized":"2024-04-25T22:02:15.676065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675927+0000","last_change":"2024-04-25T22:01:14.648752+0000","last_active":"2024-04-25T22:02:15.675927+0000","last_peered":"2024-04-25T22:02:15.675927+0000","last_clean":"2024-04-25T22:02:15.675927+0000","last_became_active":"2024-04-25T22:01:14.647463+0000","last_became_peered":"2024-04-25T22:01:14.647463+0000","last_unstale":"2024-04-25T22:02:15.675927+0000","last_undegraded":"2024-04-25T22:02:15.675927+0000","last_fullsized":"2024-04-25T22:02:15.675927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:22.946881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.676778+0000","last_change":"2024-04-25T22:01:13.630502+0000","last_active":"2024-04-25T22:02:15.676778+0000","last_peered":"2024-04-25T22:02:15.676778+0000","last_clean":"2024-04-25T22:02:15.676778+0000","last_became_active":"2024-04-25T22:01:13.629854+0000","last_became_peered":"2024-04-25T22:01:13.629854+0000","last_unstale":"2024-04-25T22:02:15.676778+0000","last_undegraded":"2024-04-25T22:02:15.676778+0000","last_fullsized":"2024-04-25T22:02:15.676778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675796+0000","last_change":"2024-04-25T22:01:14.642104+0000","last_active":"2024-04-25T22:02:15.675796+0000","last_peered":"2024-04-25T22:02:15.675796+0000","last_clean":"2024-04-25T22:02:15.675796+0000","last_became_active":"2024-04-25T22:01:14.641323+0000","last_became_peered":"2024-04-25T22:01:14.641323+0000","last_unstale":"2024-04-25T22:02:15.675796+0000","last_undegraded":"2024-04-25T22:02:15.675796+0000","last_fullsized":"2024-04-25T22:02:15.675796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466173+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:02:16.466173+0000","last_peered":"2024-04-25T22:02:16.466173+0000","last_clean":"2024-04-25T22:02:16.466173+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:02:16.466173+0000","last_undegraded":"2024-04-25T22:02:16.466173+0000","last_fullsized":"2024-04-25T22:02:16.466173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:15.675145+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:02:15.675145+0000","last_peered":"2024-04-25T22:02:15.675145+0000","last_clean":"2024-04-25T22:02:15.675145+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:02:15.675145+0000","last_undegraded":"2024-04-25T22:02:15.675145+0000","last_fullsized":"2024-04-25T22:02:15.675145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-25T22:02:16.466290+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:02:16.466290+0000","last_peered":"2024-04-25T22:02:16.466290+0000","last_clean":"2024-04-25T22:02:16.466290+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:02:16.466290+0000","last_undegraded":"2024-04-25T22:02:16.466290+0000","last_fullsized":"2024-04-25T22:02:16.466290+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738389,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":715395,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738388,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":118908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738389,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":372736,"data_stored":716011,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:02:21.560 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T22:02:21.560 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:02:21.561 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-04-25T22:02:21.561 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-04-25T22:02:21.561 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:21.561 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:21.572 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:21.623 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:21.617+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:21.692 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:21.692 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:21.707 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:21.717 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-25T22:02:21.752 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:21.750+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:21.774 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-04-25T22:02:21.825 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:21.822+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:21.835 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:21.835 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:21.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:21.926 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:21.925+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:22.057 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:22.057 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:22.058 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-04-25T22:02:22.058 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:22.059 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:22.054+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:22.157 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:22.154+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:22.224 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:22.225 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:22.238 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:22.285 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:22.281+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:22.358 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:22.354+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:22.370 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:22.371 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:22.385 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:22.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:22.458+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:22.559 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:22.559 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:22.560 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:22.558+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:22.574 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:22.660 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:22.653+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:22.692 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:22.692 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:22.707 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:22.761 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:22.757+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:22.840 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:22.840 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:22.854 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:22.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:22.898+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:22.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:22.962+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:22.972 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:22.972 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:22.986 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:23.063 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:23.062+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:23.150 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:23.150 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:23.164 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:23.162+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:23.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:23.168 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:02:23.265 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:23.262+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:23.296 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:23.296 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:23.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:23.327 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:23.348 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:23.348 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:23.366 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:23.361+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:23.368 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:23.368 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:23.467 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:23.465+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:23.474 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:23.474 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:23.474 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:02:23.474 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:02:23.475 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:23.488 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:23.568 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:23.566+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:23.612 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:23.612 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:23.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:23.612 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:23.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.612 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:23.612 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:23.613 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.785294554000004, 2024-04-25T22:02:23.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:23.613 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.613 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:23.613 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:23.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:23.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:23.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:23.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:23.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:23.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:23.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:23.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:23.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:23.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:23.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:23.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:23.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:23.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:23.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:23.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:23.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:23.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:23.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.616 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.616 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:23.617 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:23.617 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.784563735999996, 2024-04-25T22:02:23.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:23.617 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.617 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:23.617 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:23.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:23.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:23.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:23.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:23.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:23.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:23.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:23.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:23.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:23.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:23.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:23.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:23.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:23.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:23.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:23.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:23.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:23.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:23.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.620 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.620 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:23.621 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:23.621 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.783897464999995, 2024-04-25T22:02:23.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:23.621 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.621 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:23.621 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:23.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:23.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:23.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:23.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:23.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:23.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:23.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:23.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:23.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:23.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:23.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:23.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:23.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:23.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:23.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:23.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:23.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:23.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:23.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.624 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.624 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:23.625 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:23.625 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.782997565000002, 2024-04-25T22:02:23.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:23.625 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.625 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:23.625 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:23.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:23.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:23.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:23.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:23.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:23.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.629 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:23.629 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:23.629 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.780961223999995, 2024-04-25T22:02:23.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:23.629 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.629 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.629 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:23.629 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:23.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:23.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:23.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:23.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:23.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:23.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:23.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:23.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:23.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:23.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:23.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.632 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.632 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:23.633 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:23.633 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.780497886999996, 2024-04-25T22:02:23.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:23.633 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:23.633 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:23.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:23.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:23.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:23.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:23.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:23.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:23.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:23.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:23.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:23.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:23.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:23.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:23.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:23.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:23.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:23.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:23.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:23.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:23.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.636 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.637 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:23.637 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:23.637 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.779631007999996, 2024-04-25T22:02:23.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:23.637 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.637 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:23.637 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:23.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:23.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:23.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:23.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:23.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:23.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:23.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:23.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:23.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:23.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:23.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:23.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:23.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:23.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:23.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:23.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:23.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:23.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:23.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.641 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.641 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:23.641 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:23.641 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.779179933999998, 2024-04-25T22:02:23.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:23.641 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.642 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:23.642 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:23.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:23.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:23.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:23.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:23.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:23.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:23.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:23.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:23.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:23.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:23.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:23.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:23.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:23.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:23.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:23.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:23.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:23.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:23.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.645 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.645 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:23.645 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:23.646 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.778730347999996, 2024-04-25T22:02:23.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:23.646 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.646 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:23.646 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:23.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:23.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:23.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:23.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:23.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:23.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:23.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:23.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:23.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:23.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:23.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:23.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:23.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:23.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:23.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:23.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:23.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:23.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:23.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.649 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.650 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:23.650 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:23.650 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.982073861000003, 2024-04-25T22:02:23.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:23.650 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:23.650 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:23.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:23.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:23.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:23.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:23.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:23.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:23.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:23.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:23.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:23.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:23.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:23.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:23.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:23.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:23.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:23.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:23.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:23.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:23.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:23.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:23.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:23.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:23.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:23.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:23.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:23.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:23.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:23.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.655 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:23.655 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:23.655 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.981949877999995, 2024-04-25T22:02:23.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:23.655 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.655 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:23.655 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:23.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:23.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:23.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:23.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:23.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:23.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:23.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:23.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:23.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:23.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:23.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:23.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:23.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:23.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:23.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:23.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:23.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:23.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:23.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:23.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:23.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:23.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:23.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:23.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:23.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:23.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:23.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:23.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.660 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.660 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:23.660 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:23.660 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.981875942000002, 2024-04-25T22:02:23.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:23.660 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.660 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.660 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:23.660 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:23.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:23.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:23.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:23.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:23.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:23.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:23.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:23.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:23.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:23.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:23.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:23.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:23.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:23.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:23.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:23.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:23.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:23.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:23.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:23.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:23.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:23.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:23.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:23.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:23.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:23.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:23.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:23.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.665 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.665 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.665 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:23.665 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:23.665 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.981759690000004, 2024-04-25T22:02:23.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:23.665 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.665 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.665 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:23.665 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:23.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:23.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:23.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:23.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:23.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:23.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:23.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:23.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:23.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:23.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:23.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:23.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:23.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:23.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:23.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:23.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:23.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:23.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:23.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:23.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:23.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:23.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:23.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:23.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:23.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:23.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:23.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:23.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.669 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.670 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:23.670 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:23.670 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.981596280999995, 2024-04-25T22:02:23.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:23.670 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.670 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.670 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:23.670 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:23.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:23.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:23.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:23.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:23.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:23.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:23.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:23.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:23.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:23.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:23.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:23.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:23.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:23.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:23.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:23.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:23.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:23.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:23.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:23.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:23.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:23.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:23.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:23.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:23.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:23.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:23.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:23.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.675 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.675 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:23.675 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:23.675 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.981494084999994, 2024-04-25T22:02:23.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:23.675 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.675 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.675 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:23.675 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:23.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:23.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:23.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:23.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:23.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:23.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:23.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:23.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:23.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:23.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:23.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:23.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:23.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:23.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:23.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:23.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:23.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:23.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:23.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:23.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:23.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:23.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:23.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:23.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:23.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:23.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:23.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:23.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.680 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.680 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:23.680 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:23.680 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.981415131999995, 2024-04-25T22:02:23.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:23.680 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.681 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.681 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:23.681 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:23.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:23.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:23.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:23.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:23.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:23.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:23.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:23.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:23.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:23.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:23.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:23.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:23.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:23.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:23.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:23.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:23.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:23.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:23.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:23.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:23.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:23.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:23.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:23.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:23.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:23.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:23.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:23.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.685 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.685 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:23.685 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:23.685 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.981350109000005, 2024-04-25T22:02:23.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:23.686 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.686 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:23.686 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:23.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:23.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:23.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:23.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:23.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:23.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:23.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:23.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:23.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:23.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:23.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:23.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:23.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:23.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:23.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:23.689 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.689 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.689 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.689 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:23.689 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:23.689 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.981271917000001, 2024-04-25T22:02:23.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:23.689 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.689 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.689 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:23.690 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:23.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:23.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:23.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:23.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:23.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:23.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:23.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:23.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:23.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:23.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:23.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:23.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:23.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:23.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:23.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:23.693 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.693 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.693 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.693 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:23.693 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:23.693 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.966625457000006, 2024-04-25T22:02:23.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:23.693 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.693 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:23.693 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:23.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:23.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:23.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:23.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:23.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:23.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:23.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:23.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:23.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:23.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:23.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:23.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:23.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:23.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:23.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:23.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:23.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:23.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.966465501000002, 2024-04-25T22:02:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:23.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:23.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:23.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:23.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:23.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:23.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:23.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:23.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:23.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:23.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:23.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:23.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:23.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:23.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:23.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:23.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:23.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:23.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:23.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:23.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:23.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:23.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:23.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:23.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:23.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:23.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:23.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:23.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:23.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.700 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:23.701 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:23.701 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:23.702 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:23.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:23.702+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:23.740 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:02:23.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:23.802+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:23.837 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:23.837 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:23.837 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:23.838 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:23.852 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:23.904 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:23.902+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:23.979 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:23.979 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:23.994 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:24.041 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:24.037+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:24.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:24.102+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:24.124 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:24.125 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:24.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:24.125 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:24.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.125 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:24.125 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:24.125 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 78.126819531999999, 2024-04-25T22:02:24.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:02:24.125 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.125 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.125 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.125 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:24.125 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:24.125 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:24.126 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:02:24.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.126 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:24.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:24.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:02:24.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:02:24.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:02:24.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:02:24.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:02:24.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:02:24.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:02:24.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:02:24.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:02:24.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:02:24.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:02:24.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:02:24.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:02:24.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:02:24.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:02:24.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:02:24.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:02:24.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:02:24.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:02:24.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:02:24.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:02:24.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:02:24.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.130 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.130 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:24.130 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:24.130 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 77.944756459000004, 2024-04-25T22:02:24.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:02:24.131 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.131 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.131 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.131 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:24.131 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:24.131 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:24.131 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:02:24.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.131 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:24.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:24.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:02:24.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:02:24.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:02:24.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:02:24.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:02:24.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:02:24.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:02:24.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:02:24.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:02:24.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:02:24.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:02:24.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:02:24.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:02:24.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:02:24.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:02:24.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:02:24.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:02:24.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:02:24.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:02:24.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:02:24.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:02:24.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:02:24.135 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.135 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.135 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.135 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:24.136 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:24.136 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 77.944712179000007, 2024-04-25T22:02:24.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:02:24.136 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.136 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.136 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.136 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:24.136 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:24.136 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:24.136 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:02:24.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.136 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:24.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:24.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:02:24.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:02:24.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:02:24.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:02:24.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:02:24.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:02:24.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:02:24.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:02:24.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:02:24.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:02:24.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:02:24.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:02:24.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:02:24.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:02:24.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:02:24.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:02:24.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:02:24.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:02:24.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:02:24.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:02:24.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:02:24.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:02:24.141 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.141 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.141 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.141 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:24.141 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:24.141 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 77.944655654000002, 2024-04-25T22:02:24.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:24.141 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.141 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.141 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.141 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:24.141 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:24.142 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:24.142 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:24.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.142 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:24.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:24.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:24.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:24.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:24.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:24.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:24.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:24.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:24.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:24.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:24.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:24.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:24.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:24.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:24.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:24.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:24.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:24.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:24.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:24.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:24.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:24.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:24.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:24.146 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.146 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.146 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.146 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:24.146 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:24.146 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 77.944460411999998, 2024-04-25T22:02:24.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:24.147 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.147 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.147 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.147 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:24.147 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:24.147 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:24.147 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:24.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.147 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:24.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:24.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:24.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:24.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:24.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:24.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:24.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:24.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:24.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:24.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:24.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:24.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:24.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:24.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:24.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:24.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:24.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:24.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:24.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:24.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:24.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:24.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:24.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:24.151 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.151 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.152 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.152 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:24.152 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:24.152 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 77.944398118999999, 2024-04-25T22:02:24.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:24.152 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.152 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.152 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.152 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:24.152 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:24.152 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:24.152 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:24.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.153 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:24.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:24.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:24.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:24.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:24.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:24.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:24.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:24.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:24.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:24.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:24.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:24.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:24.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:24.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:24.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:24.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:24.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:24.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:24.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:24.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:24.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:24.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:24.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:24.157 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.157 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.157 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.157 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:24.157 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:24.157 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 77.944337903000005, 2024-04-25T22:02:24.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:24.157 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.157 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.157 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.157 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:24.157 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:24.158 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:24.158 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:24.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.158 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:24.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:24.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:24.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:24.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:24.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:24.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:24.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:24.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:24.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:24.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:24.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:24.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:24.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:24.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:24.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:24.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:24.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:24.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:24.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:24.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:24.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:24.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:24.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:24.162 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.162 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.162 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.162 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:24.163 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:24.163 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 77.944148390999999, 2024-04-25T22:02:24.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:24.163 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.163 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.163 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.163 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:24.163 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:24.163 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:24.163 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:24.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.163 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:24.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:24.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:24.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:24.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:24.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:24.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:24.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:24.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:24.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:24.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:24.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:24.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:24.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:24.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:24.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:24.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:24.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:24.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:24.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:24.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:24.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:24.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:24.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:24.169 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.169 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.169 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.170 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:24.170 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:24.170 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 77.752810557000004, 2024-04-25T22:02:24.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:02:24.170 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.170 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.170 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.170 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:24.170 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:24.170 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:24.170 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:02:24.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.171 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:24.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:24.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:02:24.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:02:24.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:02:24.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:02:24.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:02:24.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:02:24.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:02:24.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:02:24.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:02:24.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:02:24.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:02:24.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:02:24.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:02:24.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:02:24.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:02:24.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:02:24.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:02:24.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:02:24.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:02:24.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:02:24.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:02:24.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:02:24.175 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.175 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.175 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.176 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:24.176 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:24.176 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 77.752772179999994, 2024-04-25T22:02:24.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:02:24.176 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.176 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.176 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.176 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:24.176 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:24.176 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:24.176 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:02:24.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.176 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:24.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:24.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:02:24.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:02:24.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:02:24.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:02:24.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:02:24.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:02:24.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:02:24.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:02:24.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:02:24.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:02:24.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:02:24.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:02:24.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:02:24.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:02:24.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:02:24.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:02:24.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:02:24.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:02:24.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:02:24.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:02:24.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:02:24.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:02:24.181 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.181 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.181 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.181 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:24.181 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:24.181 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 77.752720921000005, 2024-04-25T22:02:24.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:02:24.182 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.182 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.182 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.182 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:24.182 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:24.182 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:24.182 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:02:24.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.182 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:24.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:24.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:02:24.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:02:24.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:02:24.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:02:24.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:02:24.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:02:24.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:02:24.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:02:24.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:02:24.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:02:24.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:02:24.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:02:24.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:02:24.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:02:24.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:02:24.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:02:24.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:02:24.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:02:24.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:02:24.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:02:24.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:02:24.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:02:24.186 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.187 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.187 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.187 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:24.187 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:24.187 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 77.752572271999995, 2024-04-25T22:02:24.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:02:24.187 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.187 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.187 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.187 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:24.187 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:24.187 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:24.187 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:02:24.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.188 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:24.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:24.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:02:24.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:02:24.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:02:24.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:02:24.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:02:24.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:02:24.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:02:24.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:02:24.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:02:24.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:02:24.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:02:24.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:02:24.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:02:24.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:02:24.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:02:24.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:02:24.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:02:24.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:02:24.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:02:24.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:02:24.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:02:24.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:02:24.193 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.193 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.193 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.193 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:24.193 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:24.193 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 77.752530121999996, 2024-04-25T22:02:24.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:02:24.193 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.193 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.193 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.194 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:24.194 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:24.194 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:24.194 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:02:24.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.194 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:24.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:24.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:02:24.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:02:24.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:02:24.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:02:24.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:02:24.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:02:24.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:02:24.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:02:24.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:02:24.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:02:24.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:02:24.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:02:24.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:02:24.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:02:24.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:02:24.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:02:24.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:02:24.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:02:24.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:02:24.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:02:24.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:02:24.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:02:24.198 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.199 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.199 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.199 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:24.199 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:24.199 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 77.752492269000001, 2024-04-25T22:02:24.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:24.199 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.199 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.199 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.199 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:24.199 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:24.199 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:24.199 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:24.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.200 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:24.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:24.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:24.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:24.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:24.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:24.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:24.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:24.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:24.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:24.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:24.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:24.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:24.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 77.752282944000001, 2024-04-25T22:02:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 69.486031671999996, 2024-04-25T22:02:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:02:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:02:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:02:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:02:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:02:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:02:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:02:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:02:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:02:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:02:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:02:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:02:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:02:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:02:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:02:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:02:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:02:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:02:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:02:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:02:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:02:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:02:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 69.485997831999995, 2024-04-25T22:02:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:02:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:02:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:02:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:02:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:02:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:02:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:02:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:02:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:02:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:02:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:02:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:02:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:02:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:02:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:02:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:02:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:02:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:02:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:02:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:02:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:02:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 69.485946135999995, 2024-04-25T22:02:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:02:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:02:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:02:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:02:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:02:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:02:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:02:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:02:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:02:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:02:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:02:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:02:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:02:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:02:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:02:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:02:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:02:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:02:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:02:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:02:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:02:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:02:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:02:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 69.485801683999995, 2024-04-25T22:02:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:02:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:02:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:02:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:02:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:02:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:02:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:02:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:02:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:02:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:02:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:02:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:02:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:02:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:02:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:02:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:02:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:02:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:02:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:02:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:02:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:02:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:02:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:02:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 69.485744964000006, 2024-04-25T22:02:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:02:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:02:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:02:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:02:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:02:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:02:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:02:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:02:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:02:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:02:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:02:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:02:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:02:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:02:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:02:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:02:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:02:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:02:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:02:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:02:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:02:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:02:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:02:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:24.237 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:24.239 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:24.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:24.238+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:24.340 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:24.337+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:24.371 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:24.371 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:24.371 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:02:24.371 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:24.386 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:24.441 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:24.438+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:24.503 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:24.503 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:24.503 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:02:24.503 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:02:24.503 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:24.517 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:24.543 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:24.542+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:24.642 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:02:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:02:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:02:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 4 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:27 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:02:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.001597795999999, 2024-04-25T22:02:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013281644, 2024-04-25T22:02:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637801+0000", 2024-04-25T22:02:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1299999999999998e-07 2024-04-25T22:02:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637828+0000", 2024-04-25T22:02:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6953000000000001e-05 2024-04-25T22:02:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637873+0000", 2024-04-25T22:02:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4676999999999999e-05 2024-04-25T22:02:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637917+0000", 2024-04-25T22:02:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4815999999999999e-05 2024-04-25T22:02:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644220+0000", 2024-04-25T22:02:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063021049999999997 2024-04-25T22:02:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651082+0000", 2024-04-25T22:02:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068621799999999998 2024-04-25T22:02:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:15 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.996190184, 2024-04-25T22:02:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010973732, 2024-04-25T22:02:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643209+0000", 2024-04-25T22:02:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.003e-06 2024-04-25T22:02:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643230+0000", 2024-04-25T22:02:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0815999999999999e-05 2024-04-25T22:02:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643252+0000", 2024-04-25T22:02:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2586999999999999e-05 2024-04-25T22:02:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643271+0000", 2024-04-25T22:02:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8493000000000001e-05 2024-04-25T22:02:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644387+0000", 2024-04-25T22:02:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011160250000000001 2024-04-25T22:02:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644434+0000", 2024-04-25T22:02:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:02:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654103+0000", 2024-04-25T22:02:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096691360000000001 2024-04-25T22:02:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654181+0000", 2024-04-25T22:02:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8546000000000003e-05 2024-04-25T22:02:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.996089827999995, 2024-04-25T22:02:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088132450000000008, 2024-04-25T22:02:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643309+0000", 2024-04-25T22:02:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9600000000000008e-07 2024-04-25T22:02:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643339+0000", 2024-04-25T22:02:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9467000000000001e-05 2024-04-25T22:02:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644245+0000", 2024-04-25T22:02:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090648200000000001 2024-04-25T22:02:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644268+0000", 2024-04-25T22:02:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3017e-05 2024-04-25T22:02:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647517+0000", 2024-04-25T22:02:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032491680000000002 2024-04-25T22:02:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647561+0000", 2024-04-25T22:02:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3630000000000001e-05 2024-04-25T22:02:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652041+0000", 2024-04-25T22:02:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044804529999999997 2024-04-25T22:02:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652121+0000", 2024-04-25T22:02:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0031999999999995e-05 2024-04-25T22:02:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:34 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.994001201000003, 2024-04-25T22:02:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089225940000000007, 2024-04-25T22:02:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645398+0000", 2024-04-25T22:02:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4360000000000001e-06 2024-04-25T22:02:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645412+0000", 2024-04-25T22:02:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4283e-05 2024-04-25T22:02:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645434+0000", 2024-04-25T22:02:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1237e-05 2024-04-25T22:02:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645459+0000", 2024-04-25T22:02:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5675999999999999e-05 2024-04-25T22:02:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646081+0000", 2024-04-25T22:02:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062128900000000002 2024-04-25T22:02:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646131+0000", 2024-04-25T22:02:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0322999999999999e-05 2024-04-25T22:02:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654185+0000", 2024-04-25T22:02:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080542749999999996 2024-04-25T22:02:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654319+0000", 2024-04-25T22:02:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013407499999999999 2024-04-25T22:02:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:19 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.993899691999999, 2024-04-25T22:02:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076631340000000003, 2024-04-25T22:02:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645499+0000", 2024-04-25T22:02:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4300000000000001e-07 2024-04-25T22:02:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645509+0000", 2024-04-25T22:02:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0244000000000001e-05 2024-04-25T22:02:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645523+0000", 2024-04-25T22:02:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3315999999999999e-05 2024-04-25T22:02:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645531+0000", 2024-04-25T22:02:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.123e-06 2024-04-25T22:02:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648260+0000", 2024-04-25T22:02:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027289789999999999 2024-04-25T22:02:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648307+0000", 2024-04-25T22:02:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6969999999999999e-05 2024-04-25T22:02:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653039+0000", 2024-04-25T22:02:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047322299999999996 2024-04-25T22:02:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653161+0000", 2024-04-25T22:02:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012232899999999999 2024-04-25T22:02:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.991922031000001, 2024-04-25T22:02:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01271303, 2024-04-25T22:02:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647479+0000", 2024-04-25T22:02:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.286e-06 2024-04-25T22:02:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647494+0000", 2024-04-25T22:02:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.521e-05 2024-04-25T22:02:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647525+0000", 2024-04-25T22:02:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0403999999999999e-05 2024-04-25T22:02:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647544+0000", 2024-04-25T22:02:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8743e-05 2024-04-25T22:02:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647895+0000", 2024-04-25T22:02:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035099699999999997 2024-04-25T22:02:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648202+0000", 2024-04-25T22:02:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030758499999999998 2024-04-25T22:02:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648496+0000", 2024-04-25T22:02:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029370699999999999 2024-04-25T22:02:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654605+0000", 2024-04-25T22:02:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061095999999999998 2024-04-25T22:02:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.659959+0000", 2024-04-25T22:02:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053531680000000002 2024-04-25T22:02:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660078+0000", 2024-04-25T22:02:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011981600000000001 2024-04-25T22:02:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660189+0000", 2024-04-25T22:02:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011051400000000001 2024-04-25T22:02:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.991797938999994, 2024-04-25T22:02:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013053006000000001, 2024-04-25T22:02:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647602+0000", 2024-04-25T22:02:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.604e-06 2024-04-25T22:02:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647611+0000", 2024-04-25T22:02:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5689999999999994e-06 2024-04-25T22:02:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647634+0000", 2024-04-25T22:02:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3227e-05 2024-04-25T22:02:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647660+0000", 2024-04-25T22:02:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5829999999999998e-05 2024-04-25T22:02:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649544+0000", 2024-04-25T22:02:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001884066 2024-04-25T22:02:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649783+0000", 2024-04-25T22:02:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238411 2024-04-25T22:02:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.650794+0000", 2024-04-25T22:02:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010109920000000001 2024-04-25T22:02:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654714+0000", 2024-04-25T22:02:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039202170000000001 2024-04-25T22:02:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660403+0000", 2024-04-25T22:02:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056895940000000001 2024-04-25T22:02:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660551+0000", 2024-04-25T22:02:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014717899999999999 2024-04-25T22:02:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660653+0000", 2024-04-25T22:02:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102317 2024-04-25T22:02:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:17 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.991713759000007, 2024-04-25T22:02:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010101435000000001, 2024-04-25T22:02:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647686+0000", 2024-04-25T22:02:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-04-25T22:02:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647693+0000", 2024-04-25T22:02:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7330000000000003e-06 2024-04-25T22:02:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647711+0000", 2024-04-25T22:02:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7436e-05 2024-04-25T22:02:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647727+0000", 2024-04-25T22:02:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6232999999999999e-05 2024-04-25T22:02:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649249+0000", 2024-04-25T22:02:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015219890000000001 2024-04-25T22:02:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649533+0000", 2024-04-25T22:02:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028391799999999997 2024-04-25T22:02:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649841+0000", 2024-04-25T22:02:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030853400000000001 2024-04-25T22:02:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654622+0000", 2024-04-25T22:02:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047809630000000001 2024-04-25T22:02:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657616+0000", 2024-04-25T22:02:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029938769999999998 2024-04-25T22:02:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657724+0000", 2024-04-25T22:02:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108109 2024-04-25T22:02:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657786+0000", 2024-04-25T22:02:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1196000000000002e-05 2024-04-25T22:02:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.991525430999999, 2024-04-25T22:02:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010260877999999999, 2024-04-25T22:02:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647874+0000", 2024-04-25T22:02:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:02:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647884+0000", 2024-04-25T22:02:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.013e-05 2024-04-25T22:02:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647908+0000", 2024-04-25T22:02:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3592999999999999e-05 2024-04-25T22:02:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647926+0000", 2024-04-25T22:02:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8176999999999999e-05 2024-04-25T22:02:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651480+0000", 2024-04-25T22:02:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035540160000000001 2024-04-25T22:02:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651690+0000", 2024-04-25T22:02:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210249 2024-04-25T22:02:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651986+0000", 2024-04-25T22:02:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000296001 2024-04-25T22:02:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655696+0000", 2024-04-25T22:02:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037098410000000002 2024-04-25T22:02:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657896+0000", 2024-04-25T22:02:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022004630000000002 2024-04-25T22:02:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658035+0000", 2024-04-25T22:02:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013831499999999999 2024-04-25T22:02:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658133+0000", 2024-04-25T22:02:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8553000000000003e-05 2024-04-25T22:02:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:18 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.991446550999996, 2024-04-25T22:02:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013108712, 2024-04-25T22:02:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647953+0000", 2024-04-25T22:02:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.697e-06 2024-04-25T22:02:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647963+0000", 2024-04-25T22:02:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9259999999999995e-06 2024-04-25T22:02:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647982+0000", 2024-04-25T22:02:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-04-25T22:02:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648008+0000", 2024-04-25T22:02:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5956e-05 2024-04-25T22:02:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651686+0000", 2024-04-25T22:02:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678073 2024-04-25T22:02:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652023+0000", 2024-04-25T22:02:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033739399999999998 2024-04-25T22:02:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652348+0000", 2024-04-25T22:02:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032475000000000001 2024-04-25T22:02:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655883+0000", 2024-04-25T22:02:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035353030000000001 2024-04-25T22:02:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660791+0000", 2024-04-25T22:02:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049075330000000004 2024-04-25T22:02:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660930+0000", 2024-04-25T22:02:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000139856 2024-04-25T22:02:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661060+0000", 2024-04-25T22:02:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000129651 2024-04-25T22:02:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.991369659, 2024-04-25T22:02:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012451034, 2024-04-25T22:02:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648030+0000", 2024-04-25T22:02:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-04-25T22:02:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648036+0000", 2024-04-25T22:02:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8059999999999997e-06 2024-04-25T22:02:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648054+0000", 2024-04-25T22:02:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7744000000000002e-05 2024-04-25T22:02:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648070+0000", 2024-04-25T22:02:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-04-25T22:02:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648875+0000", 2024-04-25T22:02:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080444000000000002 2024-04-25T22:02:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649078+0000", 2024-04-25T22:02:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020391499999999999 2024-04-25T22:02:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649674+0000", 2024-04-25T22:02:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00059555299999999997 2024-04-25T22:02:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653185+0000", 2024-04-25T22:02:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035113459999999998 2024-04-25T22:02:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660251+0000", 2024-04-25T22:02:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070661350000000003 2024-04-25T22:02:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660382+0000", 2024-04-25T22:02:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013095899999999999 2024-04-25T22:02:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660479+0000", 2024-04-25T22:02:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6852e-05 2024-04-25T22:02:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:25 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.991303845999994, 2024-04-25T22:02:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012691025999999999, 2024-04-25T22:02:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648095+0000", 2024-04-25T22:02:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.424e-06 2024-04-25T22:02:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648102+0000", 2024-04-25T22:02:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2099999999999998e-06 2024-04-25T22:02:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648122+0000", 2024-04-25T22:02:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0242999999999999e-05 2024-04-25T22:02:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648138+0000", 2024-04-25T22:02:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6192999999999999e-05 2024-04-25T22:02:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651461+0000", 2024-04-25T22:02:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033225709999999999 2024-04-25T22:02:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651776+0000", 2024-04-25T22:02:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031567500000000002 2024-04-25T22:02:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660785+0000", 2024-04-25T22:02:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090087099999999996 2024-04-25T22:02:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.991241360000004, 2024-04-25T22:02:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013102702000000001, 2024-04-25T22:02:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648158+0000", 2024-04-25T22:02:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2839999999999999e-06 2024-04-25T22:02:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648163+0000", 2024-04-25T22:02:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-04-25T22:02:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648181+0000", 2024-04-25T22:02:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8484000000000001e-05 2024-04-25T22:02:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648196+0000", 2024-04-25T22:02:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4496e-05 2024-04-25T22:02:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653737+0000", 2024-04-25T22:02:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055414009999999996 2024-04-25T22:02:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653972+0000", 2024-04-25T22:02:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000234732 2024-04-25T22:02:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661259+0000", 2024-04-25T22:02:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072872689999999999 2024-04-25T22:02:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.991184540000006, 2024-04-25T22:02:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086984829999999999, 2024-04-25T22:02:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648214+0000", 2024-04-25T22:02:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-04-25T22:02:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648233+0000", 2024-04-25T22:02:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.878e-05 2024-04-25T22:02:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648252+0000", 2024-04-25T22:02:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8603000000000001e-05 2024-04-25T22:02:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648267+0000", 2024-04-25T22:02:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:02:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648846+0000", 2024-04-25T22:02:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057923000000000002 2024-04-25T22:02:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649027+0000", 2024-04-25T22:02:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181585 2024-04-25T22:02:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.656912+0000", 2024-04-25T22:02:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078844589999999999 2024-04-25T22:02:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 6 lcod 17'2)", 2024-04-25T22:02:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.979254624000006, 2024-04-25T22:02:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064966000000000004, 2024-04-25T22:02:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660144+0000", 2024-04-25T22:02:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1800000000000005e-07 2024-04-25T22:02:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660181+0000", 2024-04-25T22:02:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6408000000000001e-05 2024-04-25T22:02:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660197+0000", 2024-04-25T22:02:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6177000000000001e-05 2024-04-25T22:02:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660210+0000", 2024-04-25T22:02:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:02:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660556+0000", 2024-04-25T22:02:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034612899999999998 2024-04-25T22:02:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660793+0000", 2024-04-25T22:02:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023656799999999999 2024-04-25T22:02:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:18 3.1f e17/15 ondisk, result = 0)", 2024-04-25T22:02:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.978992851000001, 2024-04-25T22:02:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067878299999999997, 2024-04-25T22:02:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660406+0000", 2024-04-25T22:02:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2800000000000005e-07 2024-04-25T22:02:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660412+0000", 2024-04-25T22:02:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0399999999999998e-06 2024-04-25T22:02:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660429+0000", 2024-04-25T22:02:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7394e-05 2024-04-25T22:02:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660445+0000", 2024-04-25T22:02:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6069000000000001e-05 2024-04-25T22:02:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660757+0000", 2024-04-25T22:02:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031194300000000002 2024-04-25T22:02:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660776+0000", 2024-04-25T22:02:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8862999999999999e-05 2024-04-25T22:02:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661084+0000", 2024-04-25T22:02:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030754600000000001 2024-04-25T22:02:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-25T22:02:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.978928623000002, 2024-04-25T22:02:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080007600000000004, 2024-04-25T22:02:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660470+0000", 2024-04-25T22:02:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4499999999999996e-07 2024-04-25T22:02:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660475+0000", 2024-04-25T22:02:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-04-25T22:02:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660490+0000", 2024-04-25T22:02:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5274e-05 2024-04-25T22:02:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660501+0000", 2024-04-25T22:02:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0694e-05 2024-04-25T22:02:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661130+0000", 2024-04-25T22:02:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062887499999999999 2024-04-25T22:02:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661269+0000", 2024-04-25T22:02:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013955900000000001 2024-04-25T22:02:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:02:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.015196623999998, 2024-04-25T22:02:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037104880000000001, 2024-04-25T22:02:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624204+0000", 2024-04-25T22:02:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.757e-06 2024-04-25T22:02:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624233+0000", 2024-04-25T22:02:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9362000000000001e-05 2024-04-25T22:02:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624264+0000", 2024-04-25T22:02:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0843000000000003e-05 2024-04-25T22:02:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624280+0000", 2024-04-25T22:02:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5577e-05 2024-04-25T22:02:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624458+0000", 2024-04-25T22:02:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017821199999999999 2024-04-25T22:02:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624661+0000", 2024-04-25T22:02:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020283200000000001 2024-04-25T22:02:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624842+0000", 2024-04-25T22:02:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018115500000000001 2024-04-25T22:02:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.626271+0000", 2024-04-25T22:02:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001429416 2024-04-25T22:02:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627749+0000", 2024-04-25T22:02:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014778650000000001 2024-04-25T22:02:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627849+0000", 2024-04-25T22:02:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9261999999999999e-05 2024-04-25T22:02:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627912+0000", 2024-04-25T22:02:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3207000000000007e-05 2024-04-25T22:02:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-25T22:02:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 44.012499273000003, 2024-04-25T22:02:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029804620000000001, 2024-04-25T22:02:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626903+0000", 2024-04-25T22:02:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0029999999999996e-06 2024-04-25T22:02:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626921+0000", 2024-04-25T22:02:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8272999999999999e-05 2024-04-25T22:02:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626959+0000", 2024-04-25T22:02:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7843999999999999e-05 2024-04-25T22:02:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626977+0000", 2024-04-25T22:02:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7756000000000001e-05 2024-04-25T22:02:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627153+0000", 2024-04-25T22:02:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017643800000000001 2024-04-25T22:02:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627425+0000", 2024-04-25T22:02:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027207300000000001 2024-04-25T22:02:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627848+0000", 2024-04-25T22:02:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042297199999999997 2024-04-25T22:02:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629590+0000", 2024-04-25T22:02:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017416809999999999 2024-04-25T22:02:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629720+0000", 2024-04-25T22:02:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130526 2024-04-25T22:02:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629808+0000", 2024-04-25T22:02:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7449999999999998e-05 2024-04-25T22:02:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629879+0000", 2024-04-25T22:02:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1445999999999993e-05 2024-04-25T22:02:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4185.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-04-25T22:02:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.024391203, 2024-04-25T22:02:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0036257939999999999, 2024-04-25T22:02:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4185", 2024-04-25T22:02:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.44:0/2048337248", 2024-04-25T22:02:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2 2024-04-25T22:02:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615010+0000", 2024-04-25T22:02:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8059999999999999e-06 2024-04-25T22:02:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615023+0000", 2024-04-25T22:02:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3159999999999999e-05 2024-04-25T22:02:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615043+0000", 2024-04-25T22:02:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:02:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615059+0000", 2024-04-25T22:02:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5519000000000002e-05 2024-04-25T22:02:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615241+0000", 2024-04-25T22:02:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018207100000000001 2024-04-25T22:02:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:02:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615258+0000", 2024-04-25T22:02:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7278999999999998e-05 2024-04-25T22:02:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618429+0000", 2024-04-25T22:02:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003171213 2024-04-25T22:02:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618633+0000", 2024-04-25T22:02:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020343999999999999 2024-04-25T22:02:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.730 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:24.730 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:24.730 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:24.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:24.732 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-25T22:02:24.732 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:24.730+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:24.832 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:24.829+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:24.864 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:24.865 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:24.865 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:02:24.865 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:24.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:24.933 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:24.929+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:25.000 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:25.000 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:25.000 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:02:25.000 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:02:25.000 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:25.014 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:25.034 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:25.033+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:25.135 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:25.133+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:25.139 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:25.139 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:25.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:25.139 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:25.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.139 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:25.139 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:25.140 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.310699581999998, 2024-04-25T22:02:25.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:25.140 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.140 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.140 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:25.140 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:25.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:25.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:25.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:25.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:25.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:25.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:25.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:25.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:25.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:25.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:25.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:25.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:25.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:25.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:25.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:25.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:25.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:25.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:25.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.144 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.144 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:25.144 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:25.144 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.309968764000004, 2024-04-25T22:02:25.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:25.144 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.144 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.144 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:25.144 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:25.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:25.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:25.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:25.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:25.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:25.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:25.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:25.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:25.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:25.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:25.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:25.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:25.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:25.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:25.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:25.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:25.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:25.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:25.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.148 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.148 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:25.148 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:25.148 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.309302493000004, 2024-04-25T22:02:25.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:25.148 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.149 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.149 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:25.149 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:25.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:25.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:25.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:25.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:25.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:25.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:25.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:25.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:25.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:25.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:25.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:25.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:25.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:25.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:25.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:25.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:25.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:25.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:25.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.152 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.152 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:25.153 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:25.153 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.308402592999997, 2024-04-25T22:02:25.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:25.153 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.153 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.153 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:25.153 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:25.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:25.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:25.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:25.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:25.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:25.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:25.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:25.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:25.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:25.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:25.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:25.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:25.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:25.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:25.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:25.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:25.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:25.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:25.156 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.156 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.156 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.157 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:25.157 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:25.157 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.306366252000004, 2024-04-25T22:02:25.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:25.157 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.157 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.157 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:25.157 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:25.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:25.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:25.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:25.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:25.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:25.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:25.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:25.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:25.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:25.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:25.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:25.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:25.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:25.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:25.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:25.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:25.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:25.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:25.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.161 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.161 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:25.161 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:25.161 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.305902915000004, 2024-04-25T22:02:25.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:25.161 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.161 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.161 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:25.161 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:25.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:25.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:25.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:25.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:25.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:25.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:25.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:25.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:25.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:25.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:25.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:25.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:25.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:25.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:25.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:25.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:25.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:25.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:25.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.165 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.165 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:25.165 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:25.165 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.305036036000004, 2024-04-25T22:02:25.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:25.165 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.166 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.166 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:25.166 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:25.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:25.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:25.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:25.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:25.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:25.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:25.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:25.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:25.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:25.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:25.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:25.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:25.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:25.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:25.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:25.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:25.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:25.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:25.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.169 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.169 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:25.169 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:25.170 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.304584962000007, 2024-04-25T22:02:25.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:25.170 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.170 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.170 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:25.170 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:25.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:25.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:25.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:25.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:25.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:25.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:25.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:25.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:25.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:25.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:25.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:25.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:25.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:25.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:25.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:25.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:25.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:25.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:25.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.173 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.174 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.174 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:25.174 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:25.174 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.304135376000005, 2024-04-25T22:02:25.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:25.174 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.174 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.174 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:25.174 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:25.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:25.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:25.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:25.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:25.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:25.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:25.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:25.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:25.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:25.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:25.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:25.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:25.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:25.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:25.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:25.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:25.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:25.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:25.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.178 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.178 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:25.178 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:25.178 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.507478888999998, 2024-04-25T22:02:25.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:25.178 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.178 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:25.178 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:25.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:25.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:25.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:25.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:25.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:25.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:25.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:25.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:25.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:25.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:25.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:25.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:25.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:25.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:25.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:25.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:25.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:25.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:25.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:25.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:25.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:25.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:25.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:25.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:25.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:25.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:25.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:25.183 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.183 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.183 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.184 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:25.184 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:25.184 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.507354906000003, 2024-04-25T22:02:25.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:25.184 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.184 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.184 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:25.184 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:25.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:25.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:25.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:25.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:25.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:25.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:25.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:25.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:25.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:25.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:25.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:25.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:25.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:25.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:25.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:25.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:25.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:25.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:25.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:25.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:25.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:25.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:25.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:25.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:25.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:25.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:25.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:25.188 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.188 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.188 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.188 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:25.188 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:25.188 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.507280969999997, 2024-04-25T22:02:25.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:25.189 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.189 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:25.189 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:25.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:25.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.507164717999999, 2024-04-25T22:02:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:25.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:25.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:25.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:25.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:25.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:25.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:25.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:25.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:25.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:25.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:25.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.199 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:25.199 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:25.199 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.507001309000003, 2024-04-25T22:02:25.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:25.199 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.506899113000003, 2024-04-25T22:02:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.506820160000004, 2024-04-25T22:02:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.506755136999999, 2024-04-25T22:02:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.506676944999995, 2024-04-25T22:02:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.492030485000001, 2024-04-25T22:02:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 70.491870528999996, 2024-04-25T22:02:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:25.231 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:25.232 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:25.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:25.234+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:25.337 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:25.334+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:25.366 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:25.367 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:25.367 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:25.367 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:25.381 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:25.384 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:02:25.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:25.434+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:25.500 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:25.500 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:25.500 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:25.500 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:25.500 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:25.515 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:25.518 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:25.519 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:25.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:25.534+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:25.542 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:25.542 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:25.562 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:25.562 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:25.639 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:25.633+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:25.642 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:25.642 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:25.657 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:25.740 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:25.733+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:25.793 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:25.793 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:25.810 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:25.841 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:25.837+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:25.932 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:25.932 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:25.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:25.938+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:25.946 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:26.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:26.042+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:26.109 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:26.109 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:26.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:26.143 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:26.141+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:26.245 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:26.241+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:26.253 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:26.253 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:26.267 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:26.345 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:26.341+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:26.384 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:26.384 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:26.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:26.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:26.442+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:26.521 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:26.521 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:26.536 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:26.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:26.546+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:26.649 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:26.645+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:26.674 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:26.674 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:26.688 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:26.749 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:26.746+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:26.753 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:02:26.850 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:26.845+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:26.859 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:26.859 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:26.873 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:26.965 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:26.961+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:27.045 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:27.045 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:27.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:27.050+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:27.060 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:27.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:27.154+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:27.195 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:27.196 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:27.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:27.225 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:02:27.225 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:02:27.226 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-25T22:02:27.226 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-25T22:02:27.253 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:27.250+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:27.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:27.354+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:27.372 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:27.372 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:27.387 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:27.456 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:27.454+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:27.506 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:02:27.506 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-25T22:02:27.506 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 38, 2024-04-25T22:02:27.506 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "1ced109c-704f-44b1-9811-a2da74898889", 2024-04-25T22:02:27.507 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-25T22:00:52.024472+0000", 2024-04-25T22:02:27.507 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-25T22:02:24.725761+0000", 2024-04-25T22:02:27.507 INFO:teuthology.orchestra.run.smithi044.stdout: "last_up_change": "2024-04-25T22:01:03.432353+0000", 2024-04-25T22:02:27.507 INFO:teuthology.orchestra.run.smithi044.stdout: "last_in_change": "2024-04-25T22:00:53.642701+0000", 2024-04-25T22:02:27.507 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-25T22:02:27.507 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_num": 5801984, 2024-04-25T22:02:27.507 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_set": [ 2024-04-25T22:02:27.507 INFO:teuthology.orchestra.run.smithi044.stdout: "noscrub", 2024-04-25T22:02:27.507 INFO:teuthology.orchestra.run.smithi044.stdout: "pglog_hardlimit", 2024-04-25T22:02:27.507 INFO:teuthology.orchestra.run.smithi044.stdout: "purged_snapdirs", 2024-04-25T22:02:27.507 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_deletes", 2024-04-25T22:02:27.507 INFO:teuthology.orchestra.run.smithi044.stdout: "sortbitwise" 2024-04-25T22:02:27.507 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:02:27.507 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_version": 4, 2024-04-25T22:02:27.507 INFO:teuthology.orchestra.run.smithi044.stdout: "full_ratio": 0.94999998807907104, 2024-04-25T22:02:27.507 INFO:teuthology.orchestra.run.smithi044.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-25T22:02:27.508 INFO:teuthology.orchestra.run.smithi044.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-25T22:02:27.508 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_snapshot": "", 2024-04-25T22:02:27.508 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_max": 4, 2024-04-25T22:02:27.508 INFO:teuthology.orchestra.run.smithi044.stdout: "max_osd": 3, 2024-04-25T22:02:27.508 INFO:teuthology.orchestra.run.smithi044.stdout: "require_min_compat_client": "luminous", 2024-04-25T22:02:27.508 INFO:teuthology.orchestra.run.smithi044.stdout: "min_compat_client": "jewel", 2024-04-25T22:02:27.508 INFO:teuthology.orchestra.run.smithi044.stdout: "require_osd_release": "squid", 2024-04-25T22:02:27.508 INFO:teuthology.orchestra.run.smithi044.stdout: "allow_crimson": false, 2024-04-25T22:02:27.508 INFO:teuthology.orchestra.run.smithi044.stdout: "pools": [ 2024-04-25T22:02:27.508 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.508 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 1, 2024-04-25T22:02:27.508 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": ".mgr", 2024-04-25T22:02:27.508 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:03.632568+0000", 2024-04-25T22:02:27.508 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:02:27.508 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:02:27.508 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:02:27.509 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:02:27.509 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:02:27.509 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:02:27.509 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:02:27.509 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:02:27.509 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:02:27.509 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:02:27.509 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:02:27.509 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:02:27.509 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 1, 2024-04-25T22:02:27.509 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 1, 2024-04-25T22:02:27.509 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 1, 2024-04-25T22:02:27.509 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 1, 2024-04-25T22:02:27.509 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 1, 2024-04-25T22:02:27.509 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:02:27.509 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:02:27.510 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:02:27.510 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:02:27.510 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:02:27.510 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:02:27.510 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:02:27.510 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.510 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "11", 2024-04-25T22:02:27.510 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:02:27.510 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:02:27.510 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:02:27.510 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:02:27.510 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:02:27.510 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:02:27.510 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:02:27.511 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:02:27.511 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:02:27.511 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:02:27.511 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:02:27.511 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:02:27.511 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:02:27.511 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:02:27.511 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:02:27.511 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:02:27.511 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:02:27.511 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:02:27.511 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:02:27.511 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:02:27.511 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:02:27.511 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:02:27.511 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:02:27.512 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:02:27.512 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:02:27.512 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:02:27.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.512 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:02:27.512 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:02:27.512 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:02:27.512 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:02:27.512 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:02:27.512 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:02:27.512 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:02:27.512 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:02:27.512 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:02:27.512 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:02:27.512 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:02:27.513 INFO:teuthology.orchestra.run.smithi044.stdout: "options": { 2024-04-25T22:02:27.513 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_max": 32, 2024-04-25T22:02:27.513 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_min": 1 2024-04-25T22:02:27.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.513 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:02:27.513 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": {} 2024-04-25T22:02:27.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.513 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:02:27.513 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:02:27.513 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 2.9900000095367432, 2024-04-25T22:02:27.513 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 2.9900000095367432, 2024-04-25T22:02:27.513 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 0.67000001668930054, 2024-04-25T22:02:27.513 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 2, 2024-04-25T22:02:27.513 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 2, 2024-04-25T22:02:27.514 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:02:27.514 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 1, 2024-04-25T22:02:27.514 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:02:27.514 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.514 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.514 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.514 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 2, 2024-04-25T22:02:27.514 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": "rbd", 2024-04-25T22:02:27.514 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:07.995071+0000", 2024-04-25T22:02:27.514 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:02:27.514 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:02:27.514 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:02:27.514 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:02:27.514 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:02:27.515 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:02:27.515 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:02:27.515 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:02:27.515 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:02:27.515 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:02:27.515 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:02:27.515 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:02:27.515 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 8, 2024-04-25T22:02:27.515 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 8, 2024-04-25T22:02:27.515 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 8, 2024-04-25T22:02:27.515 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 8, 2024-04-25T22:02:27.515 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 8, 2024-04-25T22:02:27.515 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:02:27.515 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:02:27.515 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:02:27.515 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:02:27.515 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:02:27.516 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:02:27.516 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:02:27.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.516 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "14", 2024-04-25T22:02:27.516 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:02:27.516 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:02:27.516 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:02:27.516 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:02:27.516 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:02:27.516 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:02:27.516 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:02:27.516 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:02:27.516 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:02:27.516 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:02:27.516 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:02:27.516 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:02:27.516 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:02:27.517 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:02:27.517 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:02:27.517 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:02:27.517 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:02:27.517 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:02:27.517 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:02:27.517 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:02:27.517 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:02:27.517 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:02:27.517 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:02:27.517 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:02:27.517 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:02:27.517 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:02:27.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.517 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:02:27.517 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:02:27.517 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:02:27.518 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:02:27.518 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:02:27.518 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:02:27.518 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:02:27.518 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:02:27.518 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:02:27.518 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:02:27.518 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:02:27.518 INFO:teuthology.orchestra.run.smithi044.stdout: "options": {}, 2024-04-25T22:02:27.518 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:02:27.518 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd": {} 2024-04-25T22:02:27.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.518 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:02:27.518 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:02:27.518 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 1.5, 2024-04-25T22:02:27.519 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 1.5, 2024-04-25T22:02:27.519 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 1, 2024-04-25T22:02:27.519 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 1.5, 2024-04-25T22:02:27.519 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 1.5, 2024-04-25T22:02:27.519 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:02:27.519 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 1, 2024-04-25T22:02:27.519 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:02:27.519 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.519 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.519 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 3, 2024-04-25T22:02:27.519 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": "cephfs_metadata", 2024-04-25T22:02:27.519 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:12.514055+0000", 2024-04-25T22:02:27.519 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:02:27.519 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:02:27.519 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:02:27.520 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:02:27.520 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:02:27.520 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:02:27.520 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:02:27.520 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:02:27.520 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:02:27.520 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:02:27.520 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:02:27.520 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:02:27.520 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 32, 2024-04-25T22:02:27.520 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 32, 2024-04-25T22:02:27.520 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 32, 2024-04-25T22:02:27.520 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 32, 2024-04-25T22:02:27.520 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 32, 2024-04-25T22:02:27.520 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:02:27.520 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:02:27.520 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:02:27.521 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:02:27.521 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:02:27.521 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:02:27.521 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:02:27.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.521 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "17", 2024-04-25T22:02:27.521 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:02:27.521 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:02:27.521 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:02:27.521 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:02:27.521 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:02:27.521 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:02:27.521 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:02:27.521 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:02:27.521 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:02:27.521 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:02:27.522 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:02:27.522 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:02:27.522 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:02:27.522 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:02:27.522 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:02:27.522 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:02:27.522 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:02:27.522 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:02:27.522 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:02:27.522 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:02:27.522 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:02:27.522 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:02:27.522 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:02:27.522 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:02:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:02:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:02:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:02:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:02:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:02:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:02:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:02:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:02:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:02:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:02:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:02:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:02:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:02:27.524 INFO:teuthology.orchestra.run.smithi044.stdout: "options": { 2024-04-25T22:02:27.524 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_bias": 4, 2024-04-25T22:02:27.524 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_min": 16, 2024-04-25T22:02:27.524 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_priority": 5 2024-04-25T22:02:27.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.524 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:02:27.524 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs": { 2024-04-25T22:02:27.524 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": "cephfs" 2024-04-25T22:02:27.524 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.524 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:02:27.524 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:02:27.524 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 1.1299999952316284, 2024-04-25T22:02:27.524 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 1.1299999952316284, 2024-04-25T22:02:27.524 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 1, 2024-04-25T22:02:27.525 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-25T22:02:27.525 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-25T22:02:27.525 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:02:27.525 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 1, 2024-04-25T22:02:27.525 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:02:27.525 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.525 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.525 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 4, 2024-04-25T22:02:27.525 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": "cephfs_data", 2024-04-25T22:02:27.525 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:12.963831+0000", 2024-04-25T22:02:27.525 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:02:27.525 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:02:27.525 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:02:27.525 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:02:27.525 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:02:27.526 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:02:27.526 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:02:27.526 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:02:27.526 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:02:27.526 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:02:27.526 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:02:27.526 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:02:27.526 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 64, 2024-04-25T22:02:27.526 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 64, 2024-04-25T22:02:27.526 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 64, 2024-04-25T22:02:27.526 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 64, 2024-04-25T22:02:27.526 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 64, 2024-04-25T22:02:27.526 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:02:27.526 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:02:27.527 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:02:27.527 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:02:27.527 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:02:27.527 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:02:27.527 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:02:27.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.527 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "18", 2024-04-25T22:02:27.527 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:02:27.527 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:02:27.527 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:02:27.527 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:02:27.527 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:02:27.527 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:02:27.527 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:02:27.527 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:02:27.527 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:02:27.528 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:02:27.528 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:02:27.528 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:02:27.528 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:02:27.528 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:02:27.528 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:02:27.528 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:02:27.528 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:02:27.528 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:02:27.528 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:02:27.528 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:02:27.528 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:02:27.528 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:02:27.528 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:02:27.528 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:02:27.528 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:02:27.529 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:02:27.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.529 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:02:27.529 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:02:27.529 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:02:27.529 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:02:27.529 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:02:27.529 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:02:27.529 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:02:27.529 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:02:27.529 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:02:27.529 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:02:27.529 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:02:27.529 INFO:teuthology.orchestra.run.smithi044.stdout: "options": { 2024-04-25T22:02:27.529 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_min": 64, 2024-04-25T22:02:27.529 INFO:teuthology.orchestra.run.smithi044.stdout: "target_size_ratio": 0.89999997615814209 2024-04-25T22:02:27.529 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.530 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:02:27.530 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs": { 2024-04-25T22:02:27.530 INFO:teuthology.orchestra.run.smithi044.stdout: "data": "cephfs" 2024-04-25T22:02:27.530 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.530 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:02:27.530 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:02:27.530 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 1.1299999952316284, 2024-04-25T22:02:27.530 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 1.1299999952316284, 2024-04-25T22:02:27.530 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 1, 2024-04-25T22:02:27.530 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-25T22:02:27.530 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-25T22:02:27.530 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:02:27.530 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 1, 2024-04-25T22:02:27.530 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:02:27.531 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.531 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.531 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:02:27.531 INFO:teuthology.orchestra.run.smithi044.stdout: "osds": [ 2024-04-25T22:02:27.531 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.531 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 0, 2024-04-25T22:02:27.531 INFO:teuthology.orchestra.run.smithi044.stdout: "uuid": "098ec92c-0fd2-4231-8beb-09fccca634d9", 2024-04-25T22:02:27.531 INFO:teuthology.orchestra.run.smithi044.stdout: "up": 1, 2024-04-25T22:02:27.531 INFO:teuthology.orchestra.run.smithi044.stdout: "in": 1, 2024-04-25T22:02:27.531 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 1, 2024-04-25T22:02:27.531 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity": 1, 2024-04-25T22:02:27.531 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_begin": 0, 2024-04-25T22:02:27.531 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_end": 0, 2024-04-25T22:02:27.531 INFO:teuthology.orchestra.run.smithi044.stdout: "up_from": 8, 2024-04-25T22:02:27.531 INFO:teuthology.orchestra.run.smithi044.stdout: "up_thru": 16, 2024-04-25T22:02:27.531 INFO:teuthology.orchestra.run.smithi044.stdout: "down_at": 0, 2024-04-25T22:02:27.531 INFO:teuthology.orchestra.run.smithi044.stdout: "lost_at": 0, 2024-04-25T22:02:27.532 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-25T22:02:27.532 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:27.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.532 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:27.532 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6800", 2024-04-25T22:02:27.532 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:02:27.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.532 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.532 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:27.532 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6801", 2024-04-25T22:02:27.532 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:02:27.532 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.532 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:27.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.532 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addrs": { 2024-04-25T22:02:27.533 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:27.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.533 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:27.533 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6802", 2024-04-25T22:02:27.533 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:02:27.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.533 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:27.533 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6803", 2024-04-25T22:02:27.533 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:02:27.533 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.533 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:27.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.533 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addrs": { 2024-04-25T22:02:27.533 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:27.533 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.533 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:27.534 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6806", 2024-04-25T22:02:27.534 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:02:27.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.534 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:27.534 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6807", 2024-04-25T22:02:27.534 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:02:27.534 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.534 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:27.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.534 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addrs": { 2024-04-25T22:02:27.534 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:27.534 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.534 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:27.535 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6804", 2024-04-25T22:02:27.535 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:02:27.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.535 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.535 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:27.535 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6805", 2024-04-25T22:02:27.535 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:02:27.535 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.535 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:27.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.535 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.57:6801/2385981072", 2024-04-25T22:02:27.535 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addr": "172.21.15.57:6803/2385981072", 2024-04-25T22:02:27.535 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addr": "172.21.15.57:6807/2385981072", 2024-04-25T22:02:27.535 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addr": "172.21.15.57:6805/2385981072", 2024-04-25T22:02:27.535 INFO:teuthology.orchestra.run.smithi044.stdout: "state": [ 2024-04-25T22:02:27.535 INFO:teuthology.orchestra.run.smithi044.stdout: "exists", 2024-04-25T22:02:27.535 INFO:teuthology.orchestra.run.smithi044.stdout: "up" 2024-04-25T22:02:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 1, 2024-04-25T22:02:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: "uuid": "a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef", 2024-04-25T22:02:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: "up": 1, 2024-04-25T22:02:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: "in": 1, 2024-04-25T22:02:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 1, 2024-04-25T22:02:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity": 1, 2024-04-25T22:02:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_begin": 0, 2024-04-25T22:02:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_end": 0, 2024-04-25T22:02:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: "up_from": 8, 2024-04-25T22:02:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: "up_thru": 16, 2024-04-25T22:02:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: "down_at": 0, 2024-04-25T22:02:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: "lost_at": 0, 2024-04-25T22:02:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-25T22:02:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6800", 2024-04-25T22:02:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:02:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6801", 2024-04-25T22:02:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:02:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addrs": { 2024-04-25T22:02:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.538 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:27.538 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6802", 2024-04-25T22:02:27.538 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:02:27.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.538 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:27.538 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6803", 2024-04-25T22:02:27.538 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:02:27.538 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.538 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:27.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.538 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addrs": { 2024-04-25T22:02:27.538 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:27.538 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.538 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:27.538 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6806", 2024-04-25T22:02:27.539 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:02:27.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.539 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:27.539 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6807", 2024-04-25T22:02:27.539 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:02:27.539 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.539 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:27.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.539 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addrs": { 2024-04-25T22:02:27.539 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:27.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.539 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:27.539 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6804", 2024-04-25T22:02:27.539 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:02:27.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.540 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.540 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:27.540 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6805", 2024-04-25T22:02:27.540 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:02:27.540 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.540 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:27.540 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.540 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.79:6801/29975895", 2024-04-25T22:02:27.540 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addr": "172.21.15.79:6803/29975895", 2024-04-25T22:02:27.540 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addr": "172.21.15.79:6807/29975895", 2024-04-25T22:02:27.540 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addr": "172.21.15.79:6805/29975895", 2024-04-25T22:02:27.540 INFO:teuthology.orchestra.run.smithi044.stdout: "state": [ 2024-04-25T22:02:27.540 INFO:teuthology.orchestra.run.smithi044.stdout: "exists", 2024-04-25T22:02:27.540 INFO:teuthology.orchestra.run.smithi044.stdout: "up" 2024-04-25T22:02:27.541 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:27.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.541 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 2, 2024-04-25T22:02:27.541 INFO:teuthology.orchestra.run.smithi044.stdout: "uuid": "290ee5c1-81af-400c-b15a-f63c4794a3b0", 2024-04-25T22:02:27.541 INFO:teuthology.orchestra.run.smithi044.stdout: "up": 1, 2024-04-25T22:02:27.541 INFO:teuthology.orchestra.run.smithi044.stdout: "in": 1, 2024-04-25T22:02:27.541 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 1, 2024-04-25T22:02:27.541 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity": 1, 2024-04-25T22:02:27.541 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_begin": 0, 2024-04-25T22:02:27.541 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_end": 0, 2024-04-25T22:02:27.541 INFO:teuthology.orchestra.run.smithi044.stdout: "up_from": 8, 2024-04-25T22:02:27.541 INFO:teuthology.orchestra.run.smithi044.stdout: "up_thru": 16, 2024-04-25T22:02:27.541 INFO:teuthology.orchestra.run.smithi044.stdout: "down_at": 0, 2024-04-25T22:02:27.541 INFO:teuthology.orchestra.run.smithi044.stdout: "lost_at": 0, 2024-04-25T22:02:27.541 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-25T22:02:27.541 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:27.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.542 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:27.542 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6800", 2024-04-25T22:02:27.542 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:02:27.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.542 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:27.542 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6801", 2024-04-25T22:02:27.542 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:02:27.542 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.542 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:27.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.542 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addrs": { 2024-04-25T22:02:27.542 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:27.542 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.543 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:27.543 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6802", 2024-04-25T22:02:27.543 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:02:27.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.543 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:27.543 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6803", 2024-04-25T22:02:27.543 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:02:27.543 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.543 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:27.543 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.543 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addrs": { 2024-04-25T22:02:27.543 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:27.543 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.544 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:27.544 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6806", 2024-04-25T22:02:27.544 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:02:27.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.544 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:27.544 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6807", 2024-04-25T22:02:27.544 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:02:27.544 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.544 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:27.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.544 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addrs": { 2024-04-25T22:02:27.544 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:27.544 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.544 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:27.544 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6804", 2024-04-25T22:02:27.544 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:02:27.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.545 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.545 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:27.545 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6805", 2024-04-25T22:02:27.545 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:02:27.545 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.545 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:27.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.545 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.81:6801/3918111900", 2024-04-25T22:02:27.545 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addr": "172.21.15.81:6803/3918111900", 2024-04-25T22:02:27.545 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addr": "172.21.15.81:6807/3918111900", 2024-04-25T22:02:27.545 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addr": "172.21.15.81:6805/3918111900", 2024-04-25T22:02:27.545 INFO:teuthology.orchestra.run.smithi044.stdout: "state": [ 2024-04-25T22:02:27.545 INFO:teuthology.orchestra.run.smithi044.stdout: "exists", 2024-04-25T22:02:27.545 INFO:teuthology.orchestra.run.smithi044.stdout: "up" 2024-04-25T22:02:27.545 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:27.546 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.546 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:02:27.546 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_xinfo": [ 2024-04-25T22:02:27.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.546 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 0, 2024-04-25T22:02:27.546 INFO:teuthology.orchestra.run.smithi044.stdout: "down_stamp": "0.000000", 2024-04-25T22:02:27.546 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_probability": 0, 2024-04-25T22:02:27.546 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_interval": 0, 2024-04-25T22:02:27.546 INFO:teuthology.orchestra.run.smithi044.stdout: "features": 4540701547738038271, 2024-04-25T22:02:27.546 INFO:teuthology.orchestra.run.smithi044.stdout: "old_weight": 0, 2024-04-25T22:02:27.546 INFO:teuthology.orchestra.run.smithi044.stdout: "last_purged_snaps_scrub": "2024-04-25T22:00:59.025944+0000", 2024-04-25T22:02:27.546 INFO:teuthology.orchestra.run.smithi044.stdout: "dead_epoch": 0 2024-04-25T22:02:27.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.546 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.546 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 1, 2024-04-25T22:02:27.547 INFO:teuthology.orchestra.run.smithi044.stdout: "down_stamp": "0.000000", 2024-04-25T22:02:27.547 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_probability": 0, 2024-04-25T22:02:27.547 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_interval": 0, 2024-04-25T22:02:27.547 INFO:teuthology.orchestra.run.smithi044.stdout: "features": 4540701547738038271, 2024-04-25T22:02:27.547 INFO:teuthology.orchestra.run.smithi044.stdout: "old_weight": 0, 2024-04-25T22:02:27.547 INFO:teuthology.orchestra.run.smithi044.stdout: "last_purged_snaps_scrub": "2024-04-25T22:00:58.986080+0000", 2024-04-25T22:02:27.547 INFO:teuthology.orchestra.run.smithi044.stdout: "dead_epoch": 0 2024-04-25T22:02:27.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.547 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:27.547 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 2, 2024-04-25T22:02:27.547 INFO:teuthology.orchestra.run.smithi044.stdout: "down_stamp": "0.000000", 2024-04-25T22:02:27.547 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_probability": 0, 2024-04-25T22:02:27.547 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_interval": 0, 2024-04-25T22:02:27.547 INFO:teuthology.orchestra.run.smithi044.stdout: "features": 4540701547738038271, 2024-04-25T22:02:27.547 INFO:teuthology.orchestra.run.smithi044.stdout: "old_weight": 0, 2024-04-25T22:02:27.547 INFO:teuthology.orchestra.run.smithi044.stdout: "last_purged_snaps_scrub": "2024-04-25T22:00:58.971238+0000", 2024-04-25T22:02:27.548 INFO:teuthology.orchestra.run.smithi044.stdout: "dead_epoch": 0 2024-04-25T22:02:27.548 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.548 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:02:27.548 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_upmap": [], 2024-04-25T22:02:27.548 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_upmap_items": [], 2024-04-25T22:02:27.548 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_upmap_primaries": [], 2024-04-25T22:02:27.548 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_temp": [], 2024-04-25T22:02:27.548 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_temp": [], 2024-04-25T22:02:27.548 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklist": {}, 2024-04-25T22:02:27.548 INFO:teuthology.orchestra.run.smithi044.stdout: "range_blocklist": {}, 2024-04-25T22:02:27.548 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profiles": { 2024-04-25T22:02:27.548 INFO:teuthology.orchestra.run.smithi044.stdout: "default": { 2024-04-25T22:02:27.548 INFO:teuthology.orchestra.run.smithi044.stdout: "crush-failure-domain": "osd", 2024-04-25T22:02:27.548 INFO:teuthology.orchestra.run.smithi044.stdout: "k": "2", 2024-04-25T22:02:27.548 INFO:teuthology.orchestra.run.smithi044.stdout: "m": "1", 2024-04-25T22:02:27.549 INFO:teuthology.orchestra.run.smithi044.stdout: "plugin": "jerasure", 2024-04-25T22:02:27.549 INFO:teuthology.orchestra.run.smithi044.stdout: "technique": "reed_sol_van" 2024-04-25T22:02:27.549 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:27.549 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps_queue": [], 2024-04-25T22:02:27.549 INFO:teuthology.orchestra.run.smithi044.stdout: "new_removed_snaps": [], 2024-04-25T22:02:27.549 INFO:teuthology.orchestra.run.smithi044.stdout: "new_purged_snaps": [], 2024-04-25T22:02:27.549 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_node_flags": {}, 2024-04-25T22:02:27.549 INFO:teuthology.orchestra.run.smithi044.stdout: "device_class_flags": {}, 2024-04-25T22:02:27.549 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": { 2024-04-25T22:02:27.549 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode_enabled": false, 2024-04-25T22:02:27.549 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_bucket_count": 0, 2024-04-25T22:02:27.549 INFO:teuthology.orchestra.run.smithi044.stdout: "degraded_stretch_mode": 0, 2024-04-25T22:02:27.549 INFO:teuthology.orchestra.run.smithi044.stdout: "recovering_stretch_mode": 0, 2024-04-25T22:02:27.549 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode_bucket": 0 2024-04-25T22:02:27.549 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:27.550 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-25T22:02:27.551 INFO:tasks.thrashosds.thrasher:j is {'epoch': 38, 'fsid': '1ced109c-704f-44b1-9811-a2da74898889', 'created': '2024-04-25T22:00:52.024472+0000', 'modified': '2024-04-25T22:02:24.725761+0000', 'last_up_change': '2024-04-25T22:01:03.432353+0000', 'last_in_change': '2024-04-25T22:00:53.642701+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:01:03.632568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:01:07.995071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:01:12.514055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:01:12.963831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '098ec92c-0fd2-4231-8beb-09fccca634d9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6800', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6801', 'nonce': 2385981072}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6802', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6803', 'nonce': 2385981072}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6806', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6807', 'nonce': 2385981072}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6804', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6805', 'nonce': 2385981072}]}, 'public_addr': '172.21.15.57:6801/2385981072', 'cluster_addr': '172.21.15.57:6803/2385981072', 'heartbeat_back_addr': '172.21.15.57:6807/2385981072', 'heartbeat_front_addr': '172.21.15.57:6805/2385981072', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 29975895}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 29975895}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 29975895}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 29975895}]}, 'public_addr': '172.21.15.79:6801/29975895', 'cluster_addr': '172.21.15.79:6803/29975895', 'heartbeat_back_addr': '172.21.15.79:6807/29975895', 'heartbeat_front_addr': '172.21.15.79:6805/29975895', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '290ee5c1-81af-400c-b15a-f63c4794a3b0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6800', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6801', 'nonce': 3918111900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 3918111900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 3918111900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 3918111900}]}, 'public_addr': '172.21.15.81:6801/3918111900', 'cluster_addr': '172.21.15.81:6803/3918111900', 'heartbeat_back_addr': '172.21.15.81:6807/3918111900', 'heartbeat_front_addr': '172.21.15.81:6805/3918111900', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:00:59.025944+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:00:58.986080+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:00:58.971238+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-25T22:02:27.551 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-25T22:02:27.553 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:27.553 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:27.556 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:27.554+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:27.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:27.579 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:02:27.657 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:27.654+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:27.698 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:27.698 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:27.712 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:27.735 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:27.736 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:27.751 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-25T22:02:27.758 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:27.753+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:27.764 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:27.765 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:27.795 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:27.795 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:27.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:27.858+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:27.881 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:02:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:02:27.881 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:27.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:27.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:27.958+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:28.016 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:28.016 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:28.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.187524718000006, 2024-04-25T22:02:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.186793899999998, 2024-04-25T22:02:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.186127628999998, 2024-04-25T22:02:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.185227729000005, 2024-04-25T22:02:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.183191387999997, 2024-04-25T22:02:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.182728050999998, 2024-04-25T22:02:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.181861171999998, 2024-04-25T22:02:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.181410098000001, 2024-04-25T22:02:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.180960511999999, 2024-04-25T22:02:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.384304025000006, 2024-04-25T22:02:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.055 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.055 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:28.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:28.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:28.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:28.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:28.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:28.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:28.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.061 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.061 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:28.061 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.384180041999997, 2024-04-25T22:02:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.384106106000004, 2024-04-25T22:02:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.383989854000006, 2024-04-25T22:02:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.383826444999997, 2024-04-25T22:02:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.383724248999997, 2024-04-25T22:02:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.383645295999997, 2024-04-25T22:02:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.383580273000007, 2024-04-25T22:02:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.383502081000003, 2024-04-25T22:02:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.368855620999994, 2024-04-25T22:02:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 73.368695665000004, 2024-04-25T22:02:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:28.108 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:28.110 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:28.106+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:28.110 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:28.211 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:28.205+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:28.245 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:28.245 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:28.245 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:28.245 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:28.259 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:28.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:28.310+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:28.412 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:28.410+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:28.428 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:28.428 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:28.429 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:28.429 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:28.429 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:28.442 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:28.512 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:28.509+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:28.566 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.568252243000003, 2024-04-25T22:02:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:02:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:02:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:02:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:02:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:02:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:02:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:02:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:02:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:02:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:02:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:02:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:02:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:02:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:02:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:02:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:02:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:02:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:02:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:02:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:02:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:02:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:02:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:02:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:02:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.386189169999994, 2024-04-25T22:02:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:02:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:02:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:02:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:02:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:02:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:02:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:02:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:02:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:02:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:02:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:02:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:02:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:02:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:02:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:02:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:02:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:02:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:02:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:02:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:02:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:02:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:02:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:02:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:02:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.386144889999997, 2024-04-25T22:02:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:02:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:02:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:02:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:02:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:02:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:02:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:02:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:02:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:02:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:02:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:02:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:02:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:02:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:02:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:02:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:02:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:02:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:02:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:02:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:02:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:02:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:02:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:02:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:02:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.386088365000006, 2024-04-25T22:02:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.385893123000002, 2024-04-25T22:02:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.385830830000003, 2024-04-25T22:02:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.385770613999995, 2024-04-25T22:02:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.385581102000003, 2024-04-25T22:02:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.194243267999994, 2024-04-25T22:02:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:02:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:02:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:02:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:02:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:02:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:02:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:02:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:02:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:02:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:02:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:02:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:02:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:02:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:02:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:02:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:02:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:02:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:02:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:02:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:02:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:02:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:02:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:02:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:02:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.194204890999998, 2024-04-25T22:02:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:02:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:02:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:02:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:02:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:02:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:02:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:02:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:02:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:02:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:02:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:02:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:02:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:02:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:02:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:02:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:02:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:02:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:02:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:02:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:02:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:02:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:02:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:02:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:02:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.194153631999995, 2024-04-25T22:02:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:02:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:02:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:02:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:02:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:02:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:02:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:02:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:02:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:02:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:02:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:02:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:02:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:02:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:02:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:02:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:02:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:02:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:02:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:02:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:02:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:02:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:02:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:02:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:02:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.194004982999999, 2024-04-25T22:02:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:02:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:02:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:02:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:02:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:02:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:02:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:02:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:02:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:02:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:02:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:02:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:02:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:02:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:02:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:02:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:02:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:02:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:02:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:02:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:02:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:02:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:02:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:02:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:02:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.193962833000001, 2024-04-25T22:02:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:02:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:02:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:02:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:02:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:02:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:02:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:02:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:02:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:02:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:02:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:02:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:02:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:02:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:02:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:02:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:02:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:02:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:02:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:02:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:02:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:02:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:02:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:02:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:02:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.193924980000006, 2024-04-25T22:02:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.193715655000005, 2024-04-25T22:02:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.927464383, 2024-04-25T22:02:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:02:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:02:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:02:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:02:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:02:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:02:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:02:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:02:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:02:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:02:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:02:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:02:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:02:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:02:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:02:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:02:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:02:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:02:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:02:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:02:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:02:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:02:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.927430543, 2024-04-25T22:02:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:02:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:02:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:02:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:02:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:02:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:02:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:02:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:02:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:02:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:02:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:02:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:02:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:02:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:02:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:02:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:02:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:02:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:02:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:02:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:02:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:02:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.927378847, 2024-04-25T22:02:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:02:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:02:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:02:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:02:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:02:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:02:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:02:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:02:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:02:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:02:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:02:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:02:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:02:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:02:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:02:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:02:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:02:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:02:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:02:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:02:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:02:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:02:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:02:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.927234394999999, 2024-04-25T22:02:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:02:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:02:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:02:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:02:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:02:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:02:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:02:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:02:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:02:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:02:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:02:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:02:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:02:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:02:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:02:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:02:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:02:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:02:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:02:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:02:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:02:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:02:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:02:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.927177674999996, 2024-04-25T22:02:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:02:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:02:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:02:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:02:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:02:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:02:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:02:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:02:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:02:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:02:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:02:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:02:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:02:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:02:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:02:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:02:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:02:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:02:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:02:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:02:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:02:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:02:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:02:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:28.672 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:28.674 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:28.675 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:28.669+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:28.774 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:28.773+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:28.808 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:02:28.808 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:28.822 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:28.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:28.874+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:28.943 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:28.943 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:28.943 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:02:28.943 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:02:28.943 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:28.957 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:28.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:28.998+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:29.077 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:29.073+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:29.125 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:29.125 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:02:29.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:02:29.125 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:02:29.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.125 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 4 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:27 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:02:29.126 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:29.126 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.484939659999995, 2024-04-25T22:02:29.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013281644, 2024-04-25T22:02:29.126 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.126 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.126 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:29.126 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:29.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:29.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637801+0000", 2024-04-25T22:02:29.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1299999999999998e-07 2024-04-25T22:02:29.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637828+0000", 2024-04-25T22:02:29.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6953000000000001e-05 2024-04-25T22:02:29.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637873+0000", 2024-04-25T22:02:29.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4676999999999999e-05 2024-04-25T22:02:29.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637917+0000", 2024-04-25T22:02:29.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4815999999999999e-05 2024-04-25T22:02:29.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644220+0000", 2024-04-25T22:02:29.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063021049999999997 2024-04-25T22:02:29.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651082+0000", 2024-04-25T22:02:29.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068621799999999998 2024-04-25T22:02:29.129 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.129 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.129 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.129 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:15 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:29.129 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:29.129 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.479532047999996, 2024-04-25T22:02:29.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010973732, 2024-04-25T22:02:29.129 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.129 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.129 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.130 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:29.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:29.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643209+0000", 2024-04-25T22:02:29.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.003e-06 2024-04-25T22:02:29.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643230+0000", 2024-04-25T22:02:29.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0815999999999999e-05 2024-04-25T22:02:29.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643252+0000", 2024-04-25T22:02:29.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2586999999999999e-05 2024-04-25T22:02:29.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643271+0000", 2024-04-25T22:02:29.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8493000000000001e-05 2024-04-25T22:02:29.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644387+0000", 2024-04-25T22:02:29.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011160250000000001 2024-04-25T22:02:29.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:29.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644434+0000", 2024-04-25T22:02:29.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:02:29.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:29.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654103+0000", 2024-04-25T22:02:29.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096691360000000001 2024-04-25T22:02:29.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654181+0000", 2024-04-25T22:02:29.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8546000000000003e-05 2024-04-25T22:02:29.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.133 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.133 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:29.133 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:29.133 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.479431692000006, 2024-04-25T22:02:29.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088132450000000008, 2024-04-25T22:02:29.133 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.134 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.134 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.134 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:29.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:29.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643309+0000", 2024-04-25T22:02:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9600000000000008e-07 2024-04-25T22:02:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643339+0000", 2024-04-25T22:02:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9467000000000001e-05 2024-04-25T22:02:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644245+0000", 2024-04-25T22:02:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090648200000000001 2024-04-25T22:02:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644268+0000", 2024-04-25T22:02:29.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3017e-05 2024-04-25T22:02:29.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647517+0000", 2024-04-25T22:02:29.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032491680000000002 2024-04-25T22:02:29.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:29.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647561+0000", 2024-04-25T22:02:29.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3630000000000001e-05 2024-04-25T22:02:29.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:29.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652041+0000", 2024-04-25T22:02:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044804529999999997 2024-04-25T22:02:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652121+0000", 2024-04-25T22:02:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0031999999999995e-05 2024-04-25T22:02:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:34 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.477343064999999, 2024-04-25T22:02:29.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089225940000000007, 2024-04-25T22:02:29.138 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.138 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.138 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.138 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:29.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:29.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645398+0000", 2024-04-25T22:02:29.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4360000000000001e-06 2024-04-25T22:02:29.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645412+0000", 2024-04-25T22:02:29.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4283e-05 2024-04-25T22:02:29.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645434+0000", 2024-04-25T22:02:29.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1237e-05 2024-04-25T22:02:29.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645459+0000", 2024-04-25T22:02:29.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5675999999999999e-05 2024-04-25T22:02:29.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646081+0000", 2024-04-25T22:02:29.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062128900000000002 2024-04-25T22:02:29.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:29.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646131+0000", 2024-04-25T22:02:29.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0322999999999999e-05 2024-04-25T22:02:29.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:29.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654185+0000", 2024-04-25T22:02:29.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080542749999999996 2024-04-25T22:02:29.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654319+0000", 2024-04-25T22:02:29.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013407499999999999 2024-04-25T22:02:29.141 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.141 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.141 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.142 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:19 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:29.142 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:29.142 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.477241555999996, 2024-04-25T22:02:29.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076631340000000003, 2024-04-25T22:02:29.142 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.142 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.142 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.142 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:29.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:29.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645499+0000", 2024-04-25T22:02:29.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4300000000000001e-07 2024-04-25T22:02:29.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645509+0000", 2024-04-25T22:02:29.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0244000000000001e-05 2024-04-25T22:02:29.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645523+0000", 2024-04-25T22:02:29.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3315999999999999e-05 2024-04-25T22:02:29.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645531+0000", 2024-04-25T22:02:29.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.123e-06 2024-04-25T22:02:29.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648260+0000", 2024-04-25T22:02:29.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027289789999999999 2024-04-25T22:02:29.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:29.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648307+0000", 2024-04-25T22:02:29.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6969999999999999e-05 2024-04-25T22:02:29.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:29.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653039+0000", 2024-04-25T22:02:29.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047322299999999996 2024-04-25T22:02:29.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653161+0000", 2024-04-25T22:02:29.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012232899999999999 2024-04-25T22:02:29.149 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.149 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.149 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.149 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:29.150 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:29.150 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.475263894999998, 2024-04-25T22:02:29.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01271303, 2024-04-25T22:02:29.150 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.150 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.150 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.151 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:29.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:29.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647479+0000", 2024-04-25T22:02:29.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.286e-06 2024-04-25T22:02:29.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647494+0000", 2024-04-25T22:02:29.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.521e-05 2024-04-25T22:02:29.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647525+0000", 2024-04-25T22:02:29.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0403999999999999e-05 2024-04-25T22:02:29.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647544+0000", 2024-04-25T22:02:29.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8743e-05 2024-04-25T22:02:29.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647895+0000", 2024-04-25T22:02:29.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035099699999999997 2024-04-25T22:02:29.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:29.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648202+0000", 2024-04-25T22:02:29.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030758499999999998 2024-04-25T22:02:29.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:29.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648496+0000", 2024-04-25T22:02:29.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029370699999999999 2024-04-25T22:02:29.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:29.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654605+0000", 2024-04-25T22:02:29.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061095999999999998 2024-04-25T22:02:29.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:29.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.659959+0000", 2024-04-25T22:02:29.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053531680000000002 2024-04-25T22:02:29.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:29.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660078+0000", 2024-04-25T22:02:29.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011981600000000001 2024-04-25T22:02:29.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660189+0000", 2024-04-25T22:02:29.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011051400000000001 2024-04-25T22:02:29.156 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.156 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.156 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.156 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:29.157 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:29.157 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.475139803000005, 2024-04-25T22:02:29.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013053006000000001, 2024-04-25T22:02:29.157 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.157 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.157 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.157 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:29.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:29.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647602+0000", 2024-04-25T22:02:29.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.604e-06 2024-04-25T22:02:29.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647611+0000", 2024-04-25T22:02:29.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5689999999999994e-06 2024-04-25T22:02:29.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647634+0000", 2024-04-25T22:02:29.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3227e-05 2024-04-25T22:02:29.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647660+0000", 2024-04-25T22:02:29.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5829999999999998e-05 2024-04-25T22:02:29.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649544+0000", 2024-04-25T22:02:29.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001884066 2024-04-25T22:02:29.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:29.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649783+0000", 2024-04-25T22:02:29.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238411 2024-04-25T22:02:29.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:29.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.650794+0000", 2024-04-25T22:02:29.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010109920000000001 2024-04-25T22:02:29.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:29.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654714+0000", 2024-04-25T22:02:29.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039202170000000001 2024-04-25T22:02:29.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:29.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660403+0000", 2024-04-25T22:02:29.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056895940000000001 2024-04-25T22:02:29.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:29.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660551+0000", 2024-04-25T22:02:29.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014717899999999999 2024-04-25T22:02:29.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660653+0000", 2024-04-25T22:02:29.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102317 2024-04-25T22:02:29.161 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.162 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.162 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.162 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:17 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:29.162 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:29.162 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.475055623000003, 2024-04-25T22:02:29.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010101435000000001, 2024-04-25T22:02:29.162 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.162 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.162 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.162 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:29.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:29.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647686+0000", 2024-04-25T22:02:29.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-04-25T22:02:29.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647693+0000", 2024-04-25T22:02:29.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7330000000000003e-06 2024-04-25T22:02:29.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647711+0000", 2024-04-25T22:02:29.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7436e-05 2024-04-25T22:02:29.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647727+0000", 2024-04-25T22:02:29.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6232999999999999e-05 2024-04-25T22:02:29.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649249+0000", 2024-04-25T22:02:29.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015219890000000001 2024-04-25T22:02:29.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:29.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649533+0000", 2024-04-25T22:02:29.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028391799999999997 2024-04-25T22:02:29.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:29.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649841+0000", 2024-04-25T22:02:29.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030853400000000001 2024-04-25T22:02:29.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:29.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654622+0000", 2024-04-25T22:02:29.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047809630000000001 2024-04-25T22:02:29.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:29.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657616+0000", 2024-04-25T22:02:29.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029938769999999998 2024-04-25T22:02:29.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:29.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657724+0000", 2024-04-25T22:02:29.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108109 2024-04-25T22:02:29.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657786+0000", 2024-04-25T22:02:29.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1196000000000002e-05 2024-04-25T22:02:29.167 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.167 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.168 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.168 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:29.168 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:29.168 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.474867294999996, 2024-04-25T22:02:29.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010260877999999999, 2024-04-25T22:02:29.168 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.168 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.169 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.169 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:29.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:29.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647874+0000", 2024-04-25T22:02:29.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:02:29.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647884+0000", 2024-04-25T22:02:29.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.013e-05 2024-04-25T22:02:29.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647908+0000", 2024-04-25T22:02:29.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3592999999999999e-05 2024-04-25T22:02:29.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647926+0000", 2024-04-25T22:02:29.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8176999999999999e-05 2024-04-25T22:02:29.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651480+0000", 2024-04-25T22:02:29.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035540160000000001 2024-04-25T22:02:29.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:29.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651690+0000", 2024-04-25T22:02:29.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210249 2024-04-25T22:02:29.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:29.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651986+0000", 2024-04-25T22:02:29.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000296001 2024-04-25T22:02:29.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:29.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655696+0000", 2024-04-25T22:02:29.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037098410000000002 2024-04-25T22:02:29.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:29.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657896+0000", 2024-04-25T22:02:29.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022004630000000002 2024-04-25T22:02:29.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:29.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658035+0000", 2024-04-25T22:02:29.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013831499999999999 2024-04-25T22:02:29.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658133+0000", 2024-04-25T22:02:29.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8553000000000003e-05 2024-04-25T22:02:29.176 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.176 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.176 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.177 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:18 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:29.177 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:29.177 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.474788415000006, 2024-04-25T22:02:29.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013108712, 2024-04-25T22:02:29.177 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.177 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.177 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.177 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:29.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:29.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647953+0000", 2024-04-25T22:02:29.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.697e-06 2024-04-25T22:02:29.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647963+0000", 2024-04-25T22:02:29.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9259999999999995e-06 2024-04-25T22:02:29.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647982+0000", 2024-04-25T22:02:29.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-04-25T22:02:29.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648008+0000", 2024-04-25T22:02:29.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5956e-05 2024-04-25T22:02:29.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651686+0000", 2024-04-25T22:02:29.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678073 2024-04-25T22:02:29.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:29.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652023+0000", 2024-04-25T22:02:29.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033739399999999998 2024-04-25T22:02:29.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:29.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652348+0000", 2024-04-25T22:02:29.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032475000000000001 2024-04-25T22:02:29.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:29.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655883+0000", 2024-04-25T22:02:29.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035353030000000001 2024-04-25T22:02:29.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:29.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660791+0000", 2024-04-25T22:02:29.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049075330000000004 2024-04-25T22:02:29.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:29.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660930+0000", 2024-04-25T22:02:29.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000139856 2024-04-25T22:02:29.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661060+0000", 2024-04-25T22:02:29.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000129651 2024-04-25T22:02:29.185 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.185 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.185 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.185 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:29.185 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:29.185 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.474711522999996, 2024-04-25T22:02:29.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012451034, 2024-04-25T22:02:29.185 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.186 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.186 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.186 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:29.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:29.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648030+0000", 2024-04-25T22:02:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-04-25T22:02:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648036+0000", 2024-04-25T22:02:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8059999999999997e-06 2024-04-25T22:02:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648054+0000", 2024-04-25T22:02:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7744000000000002e-05 2024-04-25T22:02:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648070+0000", 2024-04-25T22:02:29.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-04-25T22:02:29.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648875+0000", 2024-04-25T22:02:29.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080444000000000002 2024-04-25T22:02:29.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:29.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649078+0000", 2024-04-25T22:02:29.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020391499999999999 2024-04-25T22:02:29.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:29.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649674+0000", 2024-04-25T22:02:29.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00059555299999999997 2024-04-25T22:02:29.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:29.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653185+0000", 2024-04-25T22:02:29.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035113459999999998 2024-04-25T22:02:29.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:29.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660251+0000", 2024-04-25T22:02:29.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070661350000000003 2024-04-25T22:02:29.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:29.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660382+0000", 2024-04-25T22:02:29.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013095899999999999 2024-04-25T22:02:29.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660479+0000", 2024-04-25T22:02:29.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6852e-05 2024-04-25T22:02:29.190 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.190 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.190 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.191 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:25 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:29.191 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:29.191 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.474645710000004, 2024-04-25T22:02:29.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012691025999999999, 2024-04-25T22:02:29.191 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.191 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.191 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:29.191 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:29.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:29.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648095+0000", 2024-04-25T22:02:29.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.424e-06 2024-04-25T22:02:29.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648102+0000", 2024-04-25T22:02:29.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2099999999999998e-06 2024-04-25T22:02:29.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648122+0000", 2024-04-25T22:02:29.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0242999999999999e-05 2024-04-25T22:02:29.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648138+0000", 2024-04-25T22:02:29.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6192999999999999e-05 2024-04-25T22:02:29.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651461+0000", 2024-04-25T22:02:29.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033225709999999999 2024-04-25T22:02:29.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:29.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651776+0000", 2024-04-25T22:02:29.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031567500000000002 2024-04-25T22:02:29.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660785+0000", 2024-04-25T22:02:29.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090087099999999996 2024-04-25T22:02:29.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.195 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.195 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:29.195 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:29.195 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.474583224, 2024-04-25T22:02:29.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013102702000000001, 2024-04-25T22:02:29.195 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.195 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.195 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:29.195 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:29.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:29.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648158+0000", 2024-04-25T22:02:29.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2839999999999999e-06 2024-04-25T22:02:29.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648163+0000", 2024-04-25T22:02:29.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-04-25T22:02:29.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648181+0000", 2024-04-25T22:02:29.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8484000000000001e-05 2024-04-25T22:02:29.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648196+0000", 2024-04-25T22:02:29.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4496e-05 2024-04-25T22:02:29.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653737+0000", 2024-04-25T22:02:29.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055414009999999996 2024-04-25T22:02:29.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:29.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653972+0000", 2024-04-25T22:02:29.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000234732 2024-04-25T22:02:29.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661259+0000", 2024-04-25T22:02:29.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072872689999999999 2024-04-25T22:02:29.198 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.199 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.199 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.199 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:29.199 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:29.199 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.474526404000002, 2024-04-25T22:02:29.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086984829999999999, 2024-04-25T22:02:29.199 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.199 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.199 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:29.199 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648214+0000", 2024-04-25T22:02:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-04-25T22:02:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648233+0000", 2024-04-25T22:02:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.878e-05 2024-04-25T22:02:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648252+0000", 2024-04-25T22:02:29.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8603000000000001e-05 2024-04-25T22:02:29.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648267+0000", 2024-04-25T22:02:29.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:02:29.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648846+0000", 2024-04-25T22:02:29.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057923000000000002 2024-04-25T22:02:29.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:29.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649027+0000", 2024-04-25T22:02:29.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181585 2024-04-25T22:02:29.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.656912+0000", 2024-04-25T22:02:29.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078844589999999999 2024-04-25T22:02:29.202 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.202 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.202 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.203 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 6 lcod 17'2)", 2024-04-25T22:02:29.203 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:29.203 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.462596488000003, 2024-04-25T22:02:29.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064966000000000004, 2024-04-25T22:02:29.203 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.203 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.203 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:29.203 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:29.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:29.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660144+0000", 2024-04-25T22:02:29.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1800000000000005e-07 2024-04-25T22:02:29.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660181+0000", 2024-04-25T22:02:29.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6408000000000001e-05 2024-04-25T22:02:29.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660197+0000", 2024-04-25T22:02:29.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6177000000000001e-05 2024-04-25T22:02:29.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660210+0000", 2024-04-25T22:02:29.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:02:29.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660556+0000", 2024-04-25T22:02:29.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034612899999999998 2024-04-25T22:02:29.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660793+0000", 2024-04-25T22:02:29.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023656799999999999 2024-04-25T22:02:29.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.206 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.206 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:18 3.1f e17/15 ondisk, result = 0)", 2024-04-25T22:02:29.206 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:29.206 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.462334714999997, 2024-04-25T22:02:29.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067878299999999997, 2024-04-25T22:02:29.206 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.206 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.206 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:29.206 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:29.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:29.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660406+0000", 2024-04-25T22:02:29.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2800000000000005e-07 2024-04-25T22:02:29.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660412+0000", 2024-04-25T22:02:29.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0399999999999998e-06 2024-04-25T22:02:29.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660429+0000", 2024-04-25T22:02:29.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7394e-05 2024-04-25T22:02:29.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660445+0000", 2024-04-25T22:02:29.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6069000000000001e-05 2024-04-25T22:02:29.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660757+0000", 2024-04-25T22:02:29.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031194300000000002 2024-04-25T22:02:29.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:29.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660776+0000", 2024-04-25T22:02:29.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8862999999999999e-05 2024-04-25T22:02:29.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661084+0000", 2024-04-25T22:02:29.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030754600000000001 2024-04-25T22:02:29.209 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.209 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.210 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.210 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-25T22:02:29.210 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:29.210 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.462270486999998, 2024-04-25T22:02:29.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080007600000000004, 2024-04-25T22:02:29.210 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.210 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.210 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:29.210 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:29.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:29.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660470+0000", 2024-04-25T22:02:29.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4499999999999996e-07 2024-04-25T22:02:29.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660475+0000", 2024-04-25T22:02:29.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-04-25T22:02:29.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660490+0000", 2024-04-25T22:02:29.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5274e-05 2024-04-25T22:02:29.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660501+0000", 2024-04-25T22:02:29.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0694e-05 2024-04-25T22:02:29.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661130+0000", 2024-04-25T22:02:29.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062887499999999999 2024-04-25T22:02:29.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661269+0000", 2024-04-25T22:02:29.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013955900000000001 2024-04-25T22:02:29.213 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.213 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.213 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.214 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:02:29.214 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:29.214 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 72.498538487999994, 2024-04-25T22:02:29.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037104880000000001, 2024-04-25T22:02:29.214 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.214 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.214 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.214 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:29.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:29.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624204+0000", 2024-04-25T22:02:29.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.757e-06 2024-04-25T22:02:29.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624233+0000", 2024-04-25T22:02:29.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9362000000000001e-05 2024-04-25T22:02:29.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624264+0000", 2024-04-25T22:02:29.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0843000000000003e-05 2024-04-25T22:02:29.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624280+0000", 2024-04-25T22:02:29.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5577e-05 2024-04-25T22:02:29.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624458+0000", 2024-04-25T22:02:29.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017821199999999999 2024-04-25T22:02:29.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:29.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624661+0000", 2024-04-25T22:02:29.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020283200000000001 2024-04-25T22:02:29.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:29.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624842+0000", 2024-04-25T22:02:29.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018115500000000001 2024-04-25T22:02:29.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:29.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.626271+0000", 2024-04-25T22:02:29.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001429416 2024-04-25T22:02:29.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:29.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627749+0000", 2024-04-25T22:02:29.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014778650000000001 2024-04-25T22:02:29.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:29.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627849+0000", 2024-04-25T22:02:29.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9261999999999999e-05 2024-04-25T22:02:29.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627912+0000", 2024-04-25T22:02:29.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3207000000000007e-05 2024-04-25T22:02:29.218 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.219 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.219 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.219 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-25T22:02:29.219 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:29.219 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.495841136999999, 2024-04-25T22:02:29.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029804620000000001, 2024-04-25T22:02:29.219 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.219 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.219 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.219 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:29.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:29.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626903+0000", 2024-04-25T22:02:29.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0029999999999996e-06 2024-04-25T22:02:29.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626921+0000", 2024-04-25T22:02:29.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8272999999999999e-05 2024-04-25T22:02:29.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626959+0000", 2024-04-25T22:02:29.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7843999999999999e-05 2024-04-25T22:02:29.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626977+0000", 2024-04-25T22:02:29.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7756000000000001e-05 2024-04-25T22:02:29.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627153+0000", 2024-04-25T22:02:29.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017643800000000001 2024-04-25T22:02:29.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:29.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627425+0000", 2024-04-25T22:02:29.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027207300000000001 2024-04-25T22:02:29.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:29.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627848+0000", 2024-04-25T22:02:29.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042297199999999997 2024-04-25T22:02:29.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:29.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629590+0000", 2024-04-25T22:02:29.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017416809999999999 2024-04-25T22:02:29.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:29.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629720+0000", 2024-04-25T22:02:29.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130526 2024-04-25T22:02:29.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:29.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629808+0000", 2024-04-25T22:02:29.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7449999999999998e-05 2024-04-25T22:02:29.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629879+0000", 2024-04-25T22:02:29.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1445999999999993e-05 2024-04-25T22:02:29.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.224 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.224 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4185.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-04-25T22:02:29.224 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:29.224 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.507733067, 2024-04-25T22:02:29.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0036257939999999999, 2024-04-25T22:02:29.224 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:29.224 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:29.224 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:29.224 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:29.225 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4185", 2024-04-25T22:02:29.225 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.44:0/2048337248", 2024-04-25T22:02:29.225 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2 2024-04-25T22:02:29.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.225 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:29.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:29.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:29.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:29.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:29.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:29.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:29.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615010+0000", 2024-04-25T22:02:29.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8059999999999999e-06 2024-04-25T22:02:29.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:29.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615023+0000", 2024-04-25T22:02:29.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3159999999999999e-05 2024-04-25T22:02:29.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:29.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615043+0000", 2024-04-25T22:02:29.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:02:29.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615059+0000", 2024-04-25T22:02:29.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5519000000000002e-05 2024-04-25T22:02:29.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615241+0000", 2024-04-25T22:02:29.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018207100000000001 2024-04-25T22:02:29.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:02:29.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615258+0000", 2024-04-25T22:02:29.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7278999999999998e-05 2024-04-25T22:02:29.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:29.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618429+0000", 2024-04-25T22:02:29.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003171213 2024-04-25T22:02:29.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:29.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:29.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:29.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618633+0000", 2024-04-25T22:02:29.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020343999999999999 2024-04-25T22:02:29.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.228 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:29.228 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:29.229 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:29.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:29.231 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:29.229+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:29.331 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:29.326+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:29.362 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:29.362 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:29.362 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:02:29.362 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:29.377 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:29.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:29.430+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:29.533 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:29.529+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:29.544 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:29.544 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:29.544 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:02:29.544 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:02:29.544 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:29.558 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:29.635 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:29.630+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:29.683 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.854680271000007, 2024-04-25T22:02:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.853949452999998, 2024-04-25T22:02:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.853283181999998, 2024-04-25T22:02:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.852383282000005, 2024-04-25T22:02:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.850346940999998, 2024-04-25T22:02:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.849883603999999, 2024-04-25T22:02:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.849016724999998, 2024-04-25T22:02:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.848565651000001, 2024-04-25T22:02:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.848116064999999, 2024-04-25T22:02:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.051459578000006, 2024-04-25T22:02:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.051335594999998, 2024-04-25T22:02:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.051261659000005, 2024-04-25T22:02:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.051145407000007, 2024-04-25T22:02:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.050981997999997, 2024-04-25T22:02:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.050879801999997, 2024-04-25T22:02:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.050800848999998, 2024-04-25T22:02:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.050735825999993, 2024-04-25T22:02:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.050657634000004, 2024-04-25T22:02:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.036011173999995, 2024-04-25T22:02:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.035851218000005, 2024-04-25T22:02:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:29.779 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:29.780 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:02:29.781 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:29.777+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:29.782 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:29.811 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:02:29.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:29.878+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:29.918 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:29.918 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:29.918 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:29.918 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:29.932 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:29.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:29.982+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:30.032 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:30.032 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:30.052 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:30.052 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:30.066 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:30.066 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:30.067 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:30.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:30.082+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:30.100 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:30.100 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:30.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:30.182+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:30.196 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:30.196 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:30.211 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:30.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:30.282+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:30.344 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:30.344 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:30.358 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:30.386 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:30.381+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:30.487 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:30.486+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:30.523 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:30.524 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:30.539 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:30.588 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:30.585+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:30.660 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:30.660 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:30.674 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:30.689 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:30.689+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:30.759 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-25T22:02:30.791 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:30.789+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:30.807 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:30.807 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:30.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:30.891 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:30.889+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:30.939 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:30.940 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:30.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:30.992 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:30.989+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:31.076 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:31.076 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:31.092 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:31.093 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:31.090+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:31.194 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:31.194+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:31.228 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:31.228 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:31.243 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:31.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:31.294+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:31.361 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:31.362 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:31.376 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:31.425 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:31.421+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:31.497 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:31.494+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:31.504 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:31.504 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:31.518 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:31.598 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:31.593+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:31.651 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:31.651 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:31.667 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:31.699 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:31.697+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:31.790 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:31.790 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:31.800 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:31.798+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:31.805 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:31.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:31.898+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:31.927 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:31.927 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:31.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:32.000 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:31.998+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:32.073 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:32.074 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:32.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:32.102 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:32.101+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:32.122 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:02:32.203 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:32.198+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:32.258 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:32.258 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:32.274 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:32.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:32.302+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:32.321 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:32.322 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:32.358 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:32.358 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:32.386 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:32.386 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:32.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:32.402+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:32.438 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 86.609023344999997, 2024-04-25T22:02:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.442 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 86.608292527000003, 2024-04-25T22:02:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:32.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:32.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:32.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:32.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:32.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:32.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:32.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.446 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.447 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:32.447 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:32.447 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 86.607626256000003, 2024-04-25T22:02:32.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:32.447 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.447 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.447 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.447 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:32.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:32.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:32.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:32.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:32.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:32.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:32.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:32.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.451 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.451 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:32.451 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:32.451 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 86.606726355999996, 2024-04-25T22:02:32.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:32.451 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.451 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.451 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.451 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:32.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:32.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:32.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.455 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.455 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:32.455 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:32.455 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 86.604690015000003, 2024-04-25T22:02:32.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:32.455 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.455 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.455 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.455 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:32.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:32.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:32.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:32.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:32.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:32.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:32.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:32.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:32.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:32.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:32.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:32.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:32.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:32.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:32.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:32.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:32.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:32.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:32.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.459 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.459 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:32.459 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:32.459 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 86.604226678000003, 2024-04-25T22:02:32.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:32.460 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.460 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.460 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.460 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:32.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:32.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:32.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:32.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:32.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:32.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:32.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:32.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:32.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:32.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:32.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:32.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:32.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:32.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:32.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:32.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:32.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:32.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:32.463 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.463 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.463 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.463 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:32.463 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:32.464 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 86.603359799000003, 2024-04-25T22:02:32.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:32.464 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.464 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.464 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.464 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:32.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:32.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:32.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:32.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:32.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:32.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:32.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:32.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:32.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:32.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:32.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:32.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:32.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:32.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:32.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:32.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:32.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:32.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:32.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.467 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.468 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:32.468 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:32.468 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 86.602908725000006, 2024-04-25T22:02:32.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:32.468 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.468 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.468 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.468 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:32.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:32.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:32.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:32.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:32.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:32.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:32.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:32.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:32.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:32.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:32.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:32.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:32.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:32.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:32.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:32.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:32.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:32.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:32.471 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.472 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.472 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:32.472 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:32.472 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 86.602459139000004, 2024-04-25T22:02:32.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:32.472 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.472 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.472 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.472 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:32.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:32.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:32.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:32.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:32.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:32.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:32.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:32.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:32.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:32.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:32.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:32.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:32.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:32.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:32.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:32.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:32.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:32.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:32.476 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.476 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.476 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.476 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:32.476 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:32.476 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.805802651999997, 2024-04-25T22:02:32.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:32.476 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.476 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.476 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:32.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:32.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:32.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:32.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:32.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:32.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:32.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:32.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:32.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:32.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:32.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:32.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:32.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:32.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:32.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:32.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:32.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:32.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:32.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:32.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:32.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:32.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:32.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:32.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:32.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:32.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:32.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:32.481 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.481 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.481 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.481 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:32.481 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:32.481 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.805678669000002, 2024-04-25T22:02:32.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:32.481 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.482 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.482 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.482 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:32.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:32.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:32.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:32.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:32.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:32.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:32.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:32.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:32.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:32.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:32.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:32.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:32.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:32.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:32.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:32.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:32.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:32.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:32.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:32.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:32.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:32.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:32.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:32.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:32.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:32.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:32.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:32.486 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.486 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.486 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.487 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:32.487 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:32.487 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.805604732999996, 2024-04-25T22:02:32.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:32.487 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.487 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.487 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.487 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:32.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:32.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:32.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:32.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:32.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:32.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:32.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:32.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:32.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:32.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:32.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:32.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:32.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:32.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:32.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:32.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:32.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:32.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:32.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:32.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:32.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:32.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:32.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:32.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:32.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:32.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:32.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:32.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.492 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.492 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:32.492 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:32.492 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.805488480999998, 2024-04-25T22:02:32.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:32.492 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.493 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.493 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:32.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:32.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:32.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:32.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:32.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:32.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:32.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:32.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:32.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:32.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:32.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:32.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:32.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:32.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:32.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:32.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:32.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:32.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:32.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:32.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.805325072000002, 2024-04-25T22:02:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:32.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:32.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:32.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:32.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:32.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:32.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:32.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:32.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:32.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:32.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:32.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:32.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:32.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:32.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:32.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:32.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:32.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:32.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:32.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:32.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:32.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:32.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:32.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:32.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.503 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.503 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:32.503 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:32.503 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.805222876000002, 2024-04-25T22:02:32.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:32.504 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.504 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.504 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:32.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:32.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:32.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:32.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:32.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:32.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:32.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:32.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:32.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:32.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:32.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:32.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:32.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:32.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:32.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:32.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:32.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:32.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:32.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:32.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:32.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:32.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:32.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:32.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:32.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:32.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:32.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:32.508 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.509 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.509 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.509 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:32.509 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:32.509 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.805143923000003, 2024-04-25T22:02:32.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:32.509 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.509 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.509 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:32.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:32.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:32.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:32.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:32.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:32.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:32.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:32.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:32.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:32.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:32.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:32.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:32.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:32.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:32.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:32.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:32.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:32.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:32.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:32.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:32.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:32.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:32.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:32.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:32.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:32.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:32.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:32.514 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.514 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.514 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.514 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:32.514 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:32.514 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.805078899999998, 2024-04-25T22:02:32.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:32.514 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.514 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:32.514 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:32.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:32.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:32.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:32.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:32.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:32.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:32.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:32.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:32.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:32.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:32.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:32.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:32.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:32.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:32.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:32.518 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.518 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.518 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.519 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:32.519 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:32.519 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.805000707999994, 2024-04-25T22:02:32.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:32.519 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.519 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:32.519 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:32.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:32.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:32.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:32.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:32.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:32.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:32.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:32.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:32.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:32.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:32.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:32.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:32.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:32.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:32.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:32.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.522 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.523 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.523 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:32.523 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:32.523 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.790354248, 2024-04-25T22:02:32.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:32.523 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.523 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.523 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:32.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:32.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:32.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:32.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:32.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:32.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:32.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:32.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:32.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:32.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:32.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:32.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:32.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:32.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:32.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:32.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:32.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:32.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:32.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.527 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.527 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:32.527 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:32.527 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 77.790194291999995, 2024-04-25T22:02:32.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:32.527 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:32.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:32.527 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.527 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:32.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:32.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:32.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:32.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:32.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:32.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:32.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:32.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:32.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:32.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:32.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:32.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:32.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:32.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:32.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:32.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:32.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:32.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:32.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:32.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:32.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:32.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:32.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:32.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:32.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:32.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:32.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:32.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:32.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:32.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:32.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.531 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:32.531 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:32.531 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:32.533 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:32.530+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:32.533 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:32.552 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:02:32.552 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T22:02:32.634 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:32.629+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:32.665 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:32.665 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:32.665 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:32.665 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:32.680 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:32.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:32.734+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:32.783 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:02:32.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:32.834+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:32.847 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:32.847 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:32.847 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:32.847 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:32.847 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:32.861 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:32.937 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:32.934+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:32.991 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.993181047999997, 2024-04-25T22:02:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:02:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:02:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:02:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:02:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:02:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:02:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:02:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:02:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:02:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:02:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:02:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:02:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:02:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:02:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:02:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:02:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:02:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:02:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:02:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:02:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:02:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:02:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:02:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:02:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.811117975000002, 2024-04-25T22:02:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:02:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:02:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:02:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:02:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:02:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:02:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:02:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:02:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:02:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:02:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:02:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:02:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:02:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:02:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:02:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:02:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:02:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:02:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:02:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:02:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:02:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:02:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:02:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:02:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.811073695000005, 2024-04-25T22:02:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:02:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:02:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:02:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:02:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:02:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:02:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:02:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:02:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:02:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:02:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:02:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:02:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:02:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:02:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:02:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:02:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:02:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:02:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:02:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:02:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:02:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:02:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:02:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:02:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.81101717, 2024-04-25T22:02:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.810821927999996, 2024-04-25T22:02:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.810759634999997, 2024-04-25T22:02:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.810699419000002, 2024-04-25T22:02:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.810509906999997, 2024-04-25T22:02:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:33.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:33.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:33.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:33.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:33.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:33.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:33.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:33.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:33.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:33.036 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.036 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.036 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.036 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:33.036 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:33.037 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.619172073000001, 2024-04-25T22:02:33.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:02:33.037 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:33.037 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:33.037 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.037 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:33.037 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:33.037 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:33.037 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:02:33.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.037 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:33.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:33.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:33.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:33.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:33.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:33.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:02:33.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:02:33.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:33.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:02:33.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:02:33.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:33.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:02:33.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:02:33.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:02:33.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:02:33.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:02:33.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:02:33.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:02:33.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:02:33.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:02:33.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:02:33.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:02:33.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:02:33.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:02:33.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:02:33.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:02:33.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:02:33.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:02:33.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:02:33.042 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.042 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.042 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.042 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:33.042 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:33.042 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.619133696000006, 2024-04-25T22:02:33.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:02:33.042 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:33.042 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:33.042 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.042 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:33.042 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:33.043 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:33.043 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:02:33.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.043 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:33.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:33.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:33.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:33.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:33.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:33.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:02:33.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:02:33.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:33.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:02:33.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:02:33.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:33.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:02:33.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:02:33.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:02:33.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:02:33.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:02:33.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:02:33.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:02:33.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:02:33.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:02:33.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:02:33.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:02:33.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:02:33.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:02:33.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:02:33.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:02:33.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:02:33.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:02:33.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:02:33.047 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.047 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.047 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.047 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:33.047 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:33.048 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.619082437000003, 2024-04-25T22:02:33.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:02:33.048 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:33.048 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:33.048 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.048 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:33.048 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:33.048 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:33.048 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:02:33.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.048 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:33.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:33.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:33.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:33.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:33.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:33.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:02:33.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:02:33.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:33.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:02:33.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:02:33.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:33.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:02:33.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:02:33.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:02:33.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:02:33.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:02:33.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:02:33.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:02:33.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:02:33.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:02:33.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:02:33.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:02:33.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:02:33.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:02:33.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:02:33.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:02:33.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:02:33.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:02:33.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:02:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.618933788000007, 2024-04-25T22:02:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:02:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:02:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:02:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:02:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:02:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:02:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:02:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:02:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:02:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:02:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:02:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:02:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:02:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:02:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:02:33.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:02:33.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:02:33.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:02:33.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:02:33.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:02:33.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:02:33.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:02:33.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:02:33.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:02:33.058 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.058 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.058 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.058 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:33.059 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:33.059 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.618891637999994, 2024-04-25T22:02:33.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:02:33.059 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:33.059 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:33.059 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.059 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:33.059 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:33.059 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:33.059 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:02:33.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.059 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:33.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:33.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:33.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:33.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:33.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:33.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:02:33.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:02:33.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:33.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:02:33.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:02:33.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:33.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:02:33.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:02:33.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:02:33.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:02:33.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:02:33.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:02:33.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:02:33.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:02:33.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:02:33.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:02:33.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:02:33.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:02:33.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:02:33.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:02:33.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:02:33.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:02:33.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:02:33.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:02:33.064 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.064 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.064 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.064 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:33.064 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:33.064 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.618853784999999, 2024-04-25T22:02:33.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:33.064 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:33.064 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:33.064 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.064 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:33.064 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:33.065 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:33.065 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:33.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.065 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:33.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:33.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:33.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:33.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:33.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:33.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:33.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:33.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:33.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:33.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:33.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:33.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:33.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:33.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:33.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:33.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:33.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:33.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:33.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:33.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:33.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:33.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:33.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:33.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:33.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:33.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:33.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:33.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:33.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:33.069 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.069 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.069 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.069 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:33.069 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:33.069 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.618644459999999, 2024-04-25T22:02:33.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:33.069 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:33.069 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:33.070 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.070 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:33.070 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:33.070 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:33.070 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:33.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.070 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:33.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:33.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:33.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:33.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:33.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:33.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:33.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:33.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:33.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:33.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:33.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:33.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:33.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:33.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:33.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:33.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:33.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:33.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:33.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:33.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:33.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:33.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:33.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:33.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:33.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:33.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:33.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:33.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:33.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:33.074 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.074 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.074 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.074 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:33.074 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:33.074 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 78.352393187999994, 2024-04-25T22:02:33.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:02:33.075 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:33.075 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:33.075 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.075 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:33.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:33.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:33.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:33.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:33.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:02:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:02:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:02:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:02:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:02:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:02:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:02:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:02:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:02:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:02:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:02:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:02:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:02:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:02:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:02:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:02:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:02:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:02:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:02:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:02:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:02:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 78.352359347999993, 2024-04-25T22:02:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:02:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:02:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:02:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:02:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:02:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:02:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:02:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:02:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:02:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:02:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:02:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:02:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:02:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:02:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:02:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:02:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:02:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:02:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:02:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:02:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:02:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 78.352307651999993, 2024-04-25T22:02:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:02:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:02:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:02:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:02:33.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:02:33.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:33.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:02:33.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:02:33.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:02:33.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:02:33.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:02:33.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:02:33.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:02:33.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:02:33.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:02:33.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:02:33.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:02:33.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:02:33.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:02:33.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:02:33.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:02:33.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:02:33.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:02:33.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:02:33.088 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.088 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.089 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.089 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:33.089 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:33.089 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 78.352163200000007, 2024-04-25T22:02:33.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:02:33.089 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:33.089 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:33.089 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.089 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:33.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:33.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:33.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:33.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:33.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:33.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:02:33.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:02:33.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:33.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:02:33.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:02:33.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:33.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:02:33.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:02:33.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:02:33.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:02:33.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:02:33.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:02:33.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:02:33.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:02:33.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:02:33.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:02:33.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:02:33.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:02:33.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:02:33.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:02:33.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:02:33.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:02:33.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:02:33.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:02:33.093 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.093 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.093 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.093 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:33.094 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:33.094 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 78.352106480000003, 2024-04-25T22:02:33.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:02:33.094 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:33.094 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:33.094 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.094 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:33.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:33.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:33.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:33.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:33.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:33.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:33.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:02:33.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:02:33.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:33.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:02:33.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:02:33.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:33.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:02:33.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:02:33.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:02:33.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:02:33.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:33.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:02:33.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:02:33.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:33.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:02:33.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:02:33.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:02:33.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:02:33.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:33.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:02:33.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:02:33.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:02:33.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:02:33.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:33.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:02:33.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:02:33.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:33.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:33.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:33.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:02:33.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:02:33.098 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.098 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.098 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.098 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:33.099 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:33.099 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:33.100 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:33.101 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:33.097+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:33.201 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:33.197+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:33.232 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:33.232 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:33.232 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:02:33.233 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:33.246 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:33.301 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:33.298+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:33.366 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:33.366 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:33.366 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:02:33.366 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:02:33.367 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:33.381 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:33.402 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:33.402+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:33.498 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:33.498 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:02:33.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:02:33.498 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:02:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 4 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:27 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:02:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.857986163999996, 2024-04-25T22:02:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013281644, 2024-04-25T22:02:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637801+0000", 2024-04-25T22:02:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1299999999999998e-07 2024-04-25T22:02:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637828+0000", 2024-04-25T22:02:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6953000000000001e-05 2024-04-25T22:02:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637873+0000", 2024-04-25T22:02:33.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4676999999999999e-05 2024-04-25T22:02:33.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637917+0000", 2024-04-25T22:02:33.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4815999999999999e-05 2024-04-25T22:02:33.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644220+0000", 2024-04-25T22:02:33.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063021049999999997 2024-04-25T22:02:33.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651082+0000", 2024-04-25T22:02:33.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068621799999999998 2024-04-25T22:02:33.502 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.502 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.502 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.502 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:15 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:33.502 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:33.502 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.852578551999997, 2024-04-25T22:02:33.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010973732, 2024-04-25T22:02:33.502 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.502 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643209+0000", 2024-04-25T22:02:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.003e-06 2024-04-25T22:02:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643230+0000", 2024-04-25T22:02:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0815999999999999e-05 2024-04-25T22:02:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643252+0000", 2024-04-25T22:02:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2586999999999999e-05 2024-04-25T22:02:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643271+0000", 2024-04-25T22:02:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8493000000000001e-05 2024-04-25T22:02:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644387+0000", 2024-04-25T22:02:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011160250000000001 2024-04-25T22:02:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644434+0000", 2024-04-25T22:02:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:02:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654103+0000", 2024-04-25T22:02:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096691360000000001 2024-04-25T22:02:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654181+0000", 2024-04-25T22:02:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8546000000000003e-05 2024-04-25T22:02:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.852478196000007, 2024-04-25T22:02:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088132450000000008, 2024-04-25T22:02:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643309+0000", 2024-04-25T22:02:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9600000000000008e-07 2024-04-25T22:02:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643339+0000", 2024-04-25T22:02:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9467000000000001e-05 2024-04-25T22:02:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644245+0000", 2024-04-25T22:02:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090648200000000001 2024-04-25T22:02:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644268+0000", 2024-04-25T22:02:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3017e-05 2024-04-25T22:02:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647517+0000", 2024-04-25T22:02:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032491680000000002 2024-04-25T22:02:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647561+0000", 2024-04-25T22:02:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3630000000000001e-05 2024-04-25T22:02:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652041+0000", 2024-04-25T22:02:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044804529999999997 2024-04-25T22:02:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652121+0000", 2024-04-25T22:02:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0031999999999995e-05 2024-04-25T22:02:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:34 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.850389569000001, 2024-04-25T22:02:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089225940000000007, 2024-04-25T22:02:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645398+0000", 2024-04-25T22:02:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4360000000000001e-06 2024-04-25T22:02:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645412+0000", 2024-04-25T22:02:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4283e-05 2024-04-25T22:02:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645434+0000", 2024-04-25T22:02:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1237e-05 2024-04-25T22:02:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645459+0000", 2024-04-25T22:02:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5675999999999999e-05 2024-04-25T22:02:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646081+0000", 2024-04-25T22:02:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062128900000000002 2024-04-25T22:02:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646131+0000", 2024-04-25T22:02:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0322999999999999e-05 2024-04-25T22:02:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654185+0000", 2024-04-25T22:02:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080542749999999996 2024-04-25T22:02:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654319+0000", 2024-04-25T22:02:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013407499999999999 2024-04-25T22:02:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.515 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:19 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:33.515 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:33.515 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.850288059999997, 2024-04-25T22:02:33.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076631340000000003, 2024-04-25T22:02:33.515 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.515 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.515 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.515 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:33.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:33.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645499+0000", 2024-04-25T22:02:33.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4300000000000001e-07 2024-04-25T22:02:33.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645509+0000", 2024-04-25T22:02:33.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0244000000000001e-05 2024-04-25T22:02:33.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645523+0000", 2024-04-25T22:02:33.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3315999999999999e-05 2024-04-25T22:02:33.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645531+0000", 2024-04-25T22:02:33.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.123e-06 2024-04-25T22:02:33.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648260+0000", 2024-04-25T22:02:33.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027289789999999999 2024-04-25T22:02:33.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:33.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648307+0000", 2024-04-25T22:02:33.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6969999999999999e-05 2024-04-25T22:02:33.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:33.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653039+0000", 2024-04-25T22:02:33.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047322299999999996 2024-04-25T22:02:33.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653161+0000", 2024-04-25T22:02:33.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012232899999999999 2024-04-25T22:02:33.519 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.519 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.519 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.519 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:33.519 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:33.519 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.848310398999999, 2024-04-25T22:02:33.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01271303, 2024-04-25T22:02:33.519 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.519 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.519 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.519 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647479+0000", 2024-04-25T22:02:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.286e-06 2024-04-25T22:02:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647494+0000", 2024-04-25T22:02:33.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.521e-05 2024-04-25T22:02:33.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647525+0000", 2024-04-25T22:02:33.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0403999999999999e-05 2024-04-25T22:02:33.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647544+0000", 2024-04-25T22:02:33.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8743e-05 2024-04-25T22:02:33.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647895+0000", 2024-04-25T22:02:33.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035099699999999997 2024-04-25T22:02:33.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:33.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648202+0000", 2024-04-25T22:02:33.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030758499999999998 2024-04-25T22:02:33.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:33.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648496+0000", 2024-04-25T22:02:33.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029370699999999999 2024-04-25T22:02:33.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654605+0000", 2024-04-25T22:02:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061095999999999998 2024-04-25T22:02:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.659959+0000", 2024-04-25T22:02:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053531680000000002 2024-04-25T22:02:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660078+0000", 2024-04-25T22:02:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011981600000000001 2024-04-25T22:02:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660189+0000", 2024-04-25T22:02:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011051400000000001 2024-04-25T22:02:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.848186307000006, 2024-04-25T22:02:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013053006000000001, 2024-04-25T22:02:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647602+0000", 2024-04-25T22:02:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.604e-06 2024-04-25T22:02:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647611+0000", 2024-04-25T22:02:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5689999999999994e-06 2024-04-25T22:02:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647634+0000", 2024-04-25T22:02:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3227e-05 2024-04-25T22:02:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647660+0000", 2024-04-25T22:02:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5829999999999998e-05 2024-04-25T22:02:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649544+0000", 2024-04-25T22:02:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001884066 2024-04-25T22:02:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649783+0000", 2024-04-25T22:02:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238411 2024-04-25T22:02:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.650794+0000", 2024-04-25T22:02:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010109920000000001 2024-04-25T22:02:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654714+0000", 2024-04-25T22:02:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039202170000000001 2024-04-25T22:02:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660403+0000", 2024-04-25T22:02:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056895940000000001 2024-04-25T22:02:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660551+0000", 2024-04-25T22:02:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014717899999999999 2024-04-25T22:02:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660653+0000", 2024-04-25T22:02:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102317 2024-04-25T22:02:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:17 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.848102127000004, 2024-04-25T22:02:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010101435000000001, 2024-04-25T22:02:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647686+0000", 2024-04-25T22:02:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-04-25T22:02:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647693+0000", 2024-04-25T22:02:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7330000000000003e-06 2024-04-25T22:02:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647711+0000", 2024-04-25T22:02:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7436e-05 2024-04-25T22:02:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647727+0000", 2024-04-25T22:02:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6232999999999999e-05 2024-04-25T22:02:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649249+0000", 2024-04-25T22:02:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015219890000000001 2024-04-25T22:02:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649533+0000", 2024-04-25T22:02:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028391799999999997 2024-04-25T22:02:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649841+0000", 2024-04-25T22:02:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030853400000000001 2024-04-25T22:02:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654622+0000", 2024-04-25T22:02:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047809630000000001 2024-04-25T22:02:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657616+0000", 2024-04-25T22:02:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029938769999999998 2024-04-25T22:02:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657724+0000", 2024-04-25T22:02:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108109 2024-04-25T22:02:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657786+0000", 2024-04-25T22:02:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1196000000000002e-05 2024-04-25T22:02:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.847913798999997, 2024-04-25T22:02:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010260877999999999, 2024-04-25T22:02:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647874+0000", 2024-04-25T22:02:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:02:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647884+0000", 2024-04-25T22:02:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.013e-05 2024-04-25T22:02:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647908+0000", 2024-04-25T22:02:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3592999999999999e-05 2024-04-25T22:02:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647926+0000", 2024-04-25T22:02:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8176999999999999e-05 2024-04-25T22:02:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651480+0000", 2024-04-25T22:02:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035540160000000001 2024-04-25T22:02:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651690+0000", 2024-04-25T22:02:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210249 2024-04-25T22:02:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651986+0000", 2024-04-25T22:02:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000296001 2024-04-25T22:02:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655696+0000", 2024-04-25T22:02:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037098410000000002 2024-04-25T22:02:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657896+0000", 2024-04-25T22:02:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022004630000000002 2024-04-25T22:02:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658035+0000", 2024-04-25T22:02:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013831499999999999 2024-04-25T22:02:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658133+0000", 2024-04-25T22:02:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8553000000000003e-05 2024-04-25T22:02:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:18 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.847834918999993, 2024-04-25T22:02:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013108712, 2024-04-25T22:02:33.540 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.540 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.540 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.540 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:33.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:33.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647953+0000", 2024-04-25T22:02:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.697e-06 2024-04-25T22:02:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647963+0000", 2024-04-25T22:02:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9259999999999995e-06 2024-04-25T22:02:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647982+0000", 2024-04-25T22:02:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-04-25T22:02:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648008+0000", 2024-04-25T22:02:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5956e-05 2024-04-25T22:02:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651686+0000", 2024-04-25T22:02:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678073 2024-04-25T22:02:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652023+0000", 2024-04-25T22:02:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033739399999999998 2024-04-25T22:02:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652348+0000", 2024-04-25T22:02:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032475000000000001 2024-04-25T22:02:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655883+0000", 2024-04-25T22:02:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035353030000000001 2024-04-25T22:02:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660791+0000", 2024-04-25T22:02:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049075330000000004 2024-04-25T22:02:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660930+0000", 2024-04-25T22:02:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000139856 2024-04-25T22:02:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661060+0000", 2024-04-25T22:02:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000129651 2024-04-25T22:02:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.847758026999998, 2024-04-25T22:02:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012451034, 2024-04-25T22:02:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648030+0000", 2024-04-25T22:02:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-04-25T22:02:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648036+0000", 2024-04-25T22:02:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8059999999999997e-06 2024-04-25T22:02:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648054+0000", 2024-04-25T22:02:33.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7744000000000002e-05 2024-04-25T22:02:33.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648070+0000", 2024-04-25T22:02:33.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-04-25T22:02:33.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648875+0000", 2024-04-25T22:02:33.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080444000000000002 2024-04-25T22:02:33.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:33.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649078+0000", 2024-04-25T22:02:33.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020391499999999999 2024-04-25T22:02:33.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:33.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649674+0000", 2024-04-25T22:02:33.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00059555299999999997 2024-04-25T22:02:33.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:33.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653185+0000", 2024-04-25T22:02:33.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035113459999999998 2024-04-25T22:02:33.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660251+0000", 2024-04-25T22:02:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070661350000000003 2024-04-25T22:02:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660382+0000", 2024-04-25T22:02:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013095899999999999 2024-04-25T22:02:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660479+0000", 2024-04-25T22:02:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6852e-05 2024-04-25T22:02:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:25 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.847692214000006, 2024-04-25T22:02:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012691025999999999, 2024-04-25T22:02:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648095+0000", 2024-04-25T22:02:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.424e-06 2024-04-25T22:02:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648102+0000", 2024-04-25T22:02:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2099999999999998e-06 2024-04-25T22:02:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648122+0000", 2024-04-25T22:02:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0242999999999999e-05 2024-04-25T22:02:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648138+0000", 2024-04-25T22:02:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6192999999999999e-05 2024-04-25T22:02:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651461+0000", 2024-04-25T22:02:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033225709999999999 2024-04-25T22:02:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651776+0000", 2024-04-25T22:02:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031567500000000002 2024-04-25T22:02:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660785+0000", 2024-04-25T22:02:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090087099999999996 2024-04-25T22:02:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.847629728000001, 2024-04-25T22:02:33.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013102702000000001, 2024-04-25T22:02:33.554 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.554 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.554 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:33.554 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:33.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:33.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648158+0000", 2024-04-25T22:02:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2839999999999999e-06 2024-04-25T22:02:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648163+0000", 2024-04-25T22:02:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-04-25T22:02:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648181+0000", 2024-04-25T22:02:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8484000000000001e-05 2024-04-25T22:02:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648196+0000", 2024-04-25T22:02:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4496e-05 2024-04-25T22:02:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653737+0000", 2024-04-25T22:02:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055414009999999996 2024-04-25T22:02:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653972+0000", 2024-04-25T22:02:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000234732 2024-04-25T22:02:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661259+0000", 2024-04-25T22:02:33.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072872689999999999 2024-04-25T22:02:33.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.557 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.557 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:33.557 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:33.557 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.847572908000004, 2024-04-25T22:02:33.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086984829999999999, 2024-04-25T22:02:33.557 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.558 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.558 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:33.558 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:33.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:33.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648214+0000", 2024-04-25T22:02:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-04-25T22:02:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648233+0000", 2024-04-25T22:02:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.878e-05 2024-04-25T22:02:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648252+0000", 2024-04-25T22:02:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8603000000000001e-05 2024-04-25T22:02:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648267+0000", 2024-04-25T22:02:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:02:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648846+0000", 2024-04-25T22:02:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057923000000000002 2024-04-25T22:02:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649027+0000", 2024-04-25T22:02:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181585 2024-04-25T22:02:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.656912+0000", 2024-04-25T22:02:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078844589999999999 2024-04-25T22:02:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 6 lcod 17'2)", 2024-04-25T22:02:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.835642992000004, 2024-04-25T22:02:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064966000000000004, 2024-04-25T22:02:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660144+0000", 2024-04-25T22:02:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1800000000000005e-07 2024-04-25T22:02:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660181+0000", 2024-04-25T22:02:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6408000000000001e-05 2024-04-25T22:02:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660197+0000", 2024-04-25T22:02:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6177000000000001e-05 2024-04-25T22:02:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660210+0000", 2024-04-25T22:02:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:02:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660556+0000", 2024-04-25T22:02:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034612899999999998 2024-04-25T22:02:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660793+0000", 2024-04-25T22:02:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023656799999999999 2024-04-25T22:02:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:18 3.1f e17/15 ondisk, result = 0)", 2024-04-25T22:02:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.835381218999999, 2024-04-25T22:02:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067878299999999997, 2024-04-25T22:02:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660406+0000", 2024-04-25T22:02:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2800000000000005e-07 2024-04-25T22:02:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660412+0000", 2024-04-25T22:02:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0399999999999998e-06 2024-04-25T22:02:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660429+0000", 2024-04-25T22:02:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7394e-05 2024-04-25T22:02:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660445+0000", 2024-04-25T22:02:33.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6069000000000001e-05 2024-04-25T22:02:33.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660757+0000", 2024-04-25T22:02:33.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031194300000000002 2024-04-25T22:02:33.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:33.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660776+0000", 2024-04-25T22:02:33.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8862999999999999e-05 2024-04-25T22:02:33.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661084+0000", 2024-04-25T22:02:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030754600000000001 2024-04-25T22:02:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-25T22:02:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.835316990999999, 2024-04-25T22:02:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080007600000000004, 2024-04-25T22:02:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660470+0000", 2024-04-25T22:02:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4499999999999996e-07 2024-04-25T22:02:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660475+0000", 2024-04-25T22:02:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-04-25T22:02:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660490+0000", 2024-04-25T22:02:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5274e-05 2024-04-25T22:02:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660501+0000", 2024-04-25T22:02:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0694e-05 2024-04-25T22:02:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661130+0000", 2024-04-25T22:02:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062887499999999999 2024-04-25T22:02:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661269+0000", 2024-04-25T22:02:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013955900000000001 2024-04-25T22:02:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:02:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.871584991999995, 2024-04-25T22:02:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037104880000000001, 2024-04-25T22:02:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624204+0000", 2024-04-25T22:02:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.757e-06 2024-04-25T22:02:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624233+0000", 2024-04-25T22:02:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9362000000000001e-05 2024-04-25T22:02:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624264+0000", 2024-04-25T22:02:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0843000000000003e-05 2024-04-25T22:02:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624280+0000", 2024-04-25T22:02:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5577e-05 2024-04-25T22:02:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624458+0000", 2024-04-25T22:02:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017821199999999999 2024-04-25T22:02:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624661+0000", 2024-04-25T22:02:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020283200000000001 2024-04-25T22:02:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624842+0000", 2024-04-25T22:02:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018115500000000001 2024-04-25T22:02:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.626271+0000", 2024-04-25T22:02:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001429416 2024-04-25T22:02:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627749+0000", 2024-04-25T22:02:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014778650000000001 2024-04-25T22:02:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627849+0000", 2024-04-25T22:02:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9261999999999999e-05 2024-04-25T22:02:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627912+0000", 2024-04-25T22:02:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3207000000000007e-05 2024-04-25T22:02:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-25T22:02:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.868887641000001, 2024-04-25T22:02:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029804620000000001, 2024-04-25T22:02:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626903+0000", 2024-04-25T22:02:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0029999999999996e-06 2024-04-25T22:02:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626921+0000", 2024-04-25T22:02:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8272999999999999e-05 2024-04-25T22:02:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626959+0000", 2024-04-25T22:02:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7843999999999999e-05 2024-04-25T22:02:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626977+0000", 2024-04-25T22:02:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7756000000000001e-05 2024-04-25T22:02:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627153+0000", 2024-04-25T22:02:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017643800000000001 2024-04-25T22:02:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627425+0000", 2024-04-25T22:02:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027207300000000001 2024-04-25T22:02:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627848+0000", 2024-04-25T22:02:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042297199999999997 2024-04-25T22:02:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629590+0000", 2024-04-25T22:02:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017416809999999999 2024-04-25T22:02:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629720+0000", 2024-04-25T22:02:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130526 2024-04-25T22:02:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629808+0000", 2024-04-25T22:02:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7449999999999998e-05 2024-04-25T22:02:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629879+0000", 2024-04-25T22:02:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1445999999999993e-05 2024-04-25T22:02:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4185.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-04-25T22:02:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.880779570999998, 2024-04-25T22:02:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0036257939999999999, 2024-04-25T22:02:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4185", 2024-04-25T22:02:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.44:0/2048337248", 2024-04-25T22:02:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2 2024-04-25T22:02:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615010+0000", 2024-04-25T22:02:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8059999999999999e-06 2024-04-25T22:02:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615023+0000", 2024-04-25T22:02:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3159999999999999e-05 2024-04-25T22:02:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615043+0000", 2024-04-25T22:02:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:02:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615059+0000", 2024-04-25T22:02:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5519000000000002e-05 2024-04-25T22:02:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615241+0000", 2024-04-25T22:02:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018207100000000001 2024-04-25T22:02:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:02:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615258+0000", 2024-04-25T22:02:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7278999999999998e-05 2024-04-25T22:02:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618429+0000", 2024-04-25T22:02:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003171213 2024-04-25T22:02:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618633+0000", 2024-04-25T22:02:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020343999999999999 2024-04-25T22:02:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:33.588 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:33.590 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:33.590 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:33.586+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:33.691 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:33.685+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:33.721 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:33.722 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:33.722 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:02:33.722 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:33.737 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:33.760 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-25T22:02:33.763 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T22:02:33.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:33.790+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:33.795 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T22:02:33.860 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:33.860 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:33.860 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:02:33.860 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:02:33.860 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:33.875 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:33.893 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:33.889+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:33.994 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:33.993+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:33.996 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:33.996 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:33.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:33.996 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.167136464999999, 2024-04-25T22:02:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.166405647000005, 2024-04-25T22:02:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.165739376000005, 2024-04-25T22:02:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.164839475999997, 2024-04-25T22:02:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.162803135000004, 2024-04-25T22:02:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.162339798000005, 2024-04-25T22:02:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.161472919000005, 2024-04-25T22:02:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.161021844999993, 2024-04-25T22:02:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.160572259000006, 2024-04-25T22:02:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.363915771999999, 2024-04-25T22:02:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.363791789000004, 2024-04-25T22:02:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.363717852999997, 2024-04-25T22:02:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.363601600999999, 2024-04-25T22:02:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.363438192000004, 2024-04-25T22:02:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.363335996000004, 2024-04-25T22:02:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.363257043000004, 2024-04-25T22:02:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:34.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:34.085 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.085 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.085 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.085 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:34.085 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:34.085 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.36319202, 2024-04-25T22:02:34.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:34.085 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.085 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.085 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:34.086 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:34.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:34.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:34.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:34.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:34.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:34.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:34.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:34.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:34.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:34.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:34.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:34.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:34.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:34.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:34.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:34.089 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.089 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.089 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.089 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:34.089 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:34.089 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.363113827999996, 2024-04-25T22:02:34.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:34.090 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.090 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.090 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:34.090 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:34.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:34.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:34.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:34.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:34.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:34.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:34.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:34.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:34.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:34.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:34.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:34.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:34.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:34.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:34.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:34.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.093 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.094 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.094 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:34.094 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:34.094 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.348467368000001, 2024-04-25T22:02:34.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:34.094 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.094 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.094 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.094 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:34.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:34.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:34.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:34.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:34.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:34.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:34.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:34.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:34.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:34.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:34.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:34.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:34.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:34.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:34.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:34.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:34.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:34.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:34.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.099 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.099 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:34.099 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:34.099 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.348307411999997, 2024-04-25T22:02:34.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:34.099 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:34.099 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:34.099 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.099 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:34.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:34.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:34.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:34.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:34.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:34.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:34.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:34.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:34.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:34.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:34.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:34.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:34.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:34.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:34.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:34.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:34.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:34.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:34.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:34.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:34.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:34.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:34.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:34.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:34.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:34.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:34.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:34.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:34.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:34.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:34.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.104 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:34.104 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:34.104 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:34.106 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:34.106 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:34.101+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:34.206 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:34.202+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:34.242 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:34.242 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:34.242 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:34.242 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:34.258 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:34.307 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:34.306+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:34.384 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:34.384 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:34.384 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:34.384 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:34.384 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:34.398 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:34.407 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:02:34.407 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:34.402+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:34.508 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:34.501+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:34.532 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:34.532 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:34.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:34.532 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:34.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.534089191999996, 2024-04-25T22:02:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:02:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:02:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:02:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:02:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:02:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:02:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:02:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:02:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:02:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:02:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:02:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:02:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:02:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:02:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:02:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:02:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:02:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:02:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:02:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:02:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:02:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:02:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:02:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:02:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.352026119000001, 2024-04-25T22:02:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:02:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:02:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:02:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:02:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:02:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:02:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:02:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:02:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:02:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:02:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:02:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:02:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:02:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:02:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:02:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:02:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:02:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:02:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:02:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:02:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:02:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:02:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:02:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:02:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.351981839000004, 2024-04-25T22:02:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:02:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:02:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:02:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:02:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:02:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:02:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:02:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:02:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:02:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:02:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:02:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:02:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:02:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:02:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:02:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:02:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:02:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:02:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:02:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:02:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:02:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:02:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:02:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:02:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.351925313999999, 2024-04-25T22:02:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.351730071999995, 2024-04-25T22:02:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.351667778999996, 2024-04-25T22:02:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:34.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:34.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:34.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:34.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:34.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:34.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:34.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:34.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:34.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:34.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:34.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:34.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:34.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:34.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:34.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:34.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:34.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:34.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:34.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:34.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:34.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:34.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:34.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:34.567 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.567 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.567 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.567 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:34.567 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:34.567 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.351607563000002, 2024-04-25T22:02:34.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:34.568 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.568 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.568 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.568 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:34.568 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:34.568 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:34.568 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:34.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.568 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:34.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:34.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:34.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:34.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:34.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:34.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:34.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:34.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:34.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:34.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:34.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:34.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:34.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:34.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:34.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:34.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:34.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:34.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:34.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:34.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:34.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:34.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:34.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:34.573 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.573 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.573 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.573 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:34.573 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:34.573 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.351418050999996, 2024-04-25T22:02:34.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:34.573 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.573 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.573 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.574 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:34.574 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:34.574 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:34.574 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:34.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.574 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:34.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:34.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:34.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:34.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:34.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:34.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:34.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:34.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:34.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:34.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:34.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:34.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:34.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:34.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:34.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:34.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:34.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:34.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:34.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:34.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:34.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:34.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:34.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:34.578 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.579 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.579 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.579 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:34.579 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:34.579 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.160080217000001, 2024-04-25T22:02:34.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:02:34.579 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.579 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.579 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.579 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:34.579 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:34.579 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:34.579 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:02:34.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.580 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:34.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:34.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:02:34.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:02:34.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:02:34.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:02:34.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:02:34.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:02:34.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:02:34.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:02:34.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:02:34.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:02:34.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:02:34.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:02:34.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:02:34.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:02:34.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:02:34.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:02:34.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:02:34.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:02:34.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:02:34.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:02:34.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:02:34.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:02:34.584 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.584 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.584 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.584 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:34.585 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:34.585 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.160041840000005, 2024-04-25T22:02:34.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:02:34.585 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.585 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.585 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.585 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:34.585 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:34.585 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:34.585 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:02:34.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.585 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:34.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:34.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:02:34.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:02:34.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:02:34.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:02:34.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:02:34.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:02:34.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:02:34.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:02:34.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:02:34.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:02:34.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:02:34.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:02:34.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:02:34.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:02:34.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:02:34.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:02:34.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:02:34.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:02:34.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:02:34.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:02:34.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:02:34.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:02:34.590 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.590 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.590 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.590 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:34.590 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:34.590 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.159990581000002, 2024-04-25T22:02:34.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:02:34.591 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.591 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.591 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.591 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:34.591 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:34.591 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:34.591 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:02:34.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.591 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:34.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:34.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:02:34.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:02:34.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:02:34.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:02:34.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:02:34.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:02:34.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:02:34.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:02:34.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:02:34.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:02:34.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:02:34.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:02:34.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:02:34.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:02:34.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:02:34.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:02:34.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:02:34.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:02:34.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:02:34.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:02:34.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:02:34.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:02:34.596 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.596 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.596 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.596 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:34.596 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:34.596 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.159841932000006, 2024-04-25T22:02:34.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:02:34.596 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.596 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.597 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.597 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:34.597 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:34.597 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:34.597 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:02:34.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.597 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:34.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:34.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:02:34.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:02:34.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:02:34.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:02:34.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:02:34.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:02:34.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:02:34.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:02:34.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:02:34.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:02:34.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:02:34.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:02:34.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:02:34.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:02:34.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:02:34.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:02:34.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:02:34.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:02:34.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:02:34.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:02:34.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:02:34.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:02:34.601 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.159799781999993, 2024-04-25T22:02:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:02:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:34.603 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:02:34.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.603 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:34.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:34.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:02:34.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:02:34.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:02:34.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:02:34.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:02:34.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:02:34.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:02:34.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:02:34.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:02:34.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:02:34.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:02:34.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:02:34.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:02:34.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:02:34.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:02:34.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:02:34.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:02:34.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:02:34.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:02:34.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:02:34.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:02:34.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:02:34.610 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.610 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.610 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.610 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:34.610 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:34.610 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.159761928999998, 2024-04-25T22:02:34.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:34.610 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.610 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.610 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.610 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:34.610 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:34.611 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:34.611 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:34.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.611 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:34.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:34.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:34.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:34.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:34.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:34.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:34.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:34.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:34.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:34.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:34.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:34.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:34.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:34.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:34.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:34.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:34.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:34.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:34.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:34.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:34.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:34.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:34.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:34.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.615 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.616 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:34.616 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:34.616 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.159552603999998, 2024-04-25T22:02:34.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:34.616 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.616 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.616 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.616 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:34.616 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:34.616 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:34.616 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:34.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.616 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:34.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:34.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:34.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:34.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:34.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:34.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:34.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:34.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:34.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:34.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:34.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:34.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:34.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:34.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:34.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:34.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:34.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:34.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:34.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:34.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:34.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:34.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:34.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:34.621 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.621 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.621 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.621 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:34.621 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:34.621 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 79.893301331999993, 2024-04-25T22:02:34.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:02:34.621 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.622 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.622 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.622 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:34.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:34.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:02:34.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:34.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:02:34.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:02:34.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:02:34.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:02:34.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:02:34.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:02:34.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:02:34.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:02:34.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:02:34.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:02:34.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:02:34.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:02:34.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:02:34.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:02:34.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:02:34.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:02:34.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:02:34.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:02:34.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:02:34.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:02:34.626 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.626 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.626 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.626 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:34.627 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:34.627 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 79.893267492000007, 2024-04-25T22:02:34.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:02:34.627 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.627 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.627 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.627 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:34.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:34.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:34.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:02:34.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:02:34.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:02:34.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:02:34.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:02:34.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:02:34.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:02:34.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:02:34.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:02:34.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:02:34.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:02:34.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:02:34.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:02:34.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:02:34.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:02:34.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:34.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:02:34.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:02:34.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:02:34.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:02:34.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:02:34.631 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.632 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.632 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.632 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:34.632 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:34.632 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 79.893215796000007, 2024-04-25T22:02:34.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:02:34.632 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.632 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.632 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.632 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:34.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:34.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:02:34.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:02:34.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:02:34.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:02:34.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:02:34.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:02:34.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:02:34.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:02:34.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:02:34.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:02:34.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:02:34.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:02:34.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:02:34.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:02:34.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:02:34.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:02:34.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:02:34.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:02:34.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:02:34.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:02:34.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:02:34.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:02:34.637 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.637 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.637 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.637 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:34.637 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:34.637 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 79.893071344000006, 2024-04-25T22:02:34.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:02:34.638 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.638 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.638 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.638 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:34.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:34.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:02:34.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:02:34.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:02:34.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:02:34.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:02:34.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:02:34.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:02:34.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:02:34.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:02:34.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:02:34.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:02:34.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:02:34.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:02:34.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:02:34.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:02:34.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:02:34.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:02:34.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:02:34.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:02:34.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:02:34.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:02:34.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:02:34.642 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.642 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.642 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 79.893014624000003, 2024-04-25T22:02:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:02:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:34.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:34.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:34.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:34.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:02:34.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:02:34.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:34.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:02:34.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:02:34.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:34.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:02:34.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:02:34.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:34.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:02:34.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:02:34.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:34.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:02:34.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:02:34.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:34.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:02:34.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:02:34.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:34.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:02:34.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:02:34.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:34.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:02:34.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:02:34.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:34.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:02:34.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:02:34.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:34.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:02:34.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:02:34.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:34.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:34.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:34.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:02:34.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:02:34.648 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.648 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.648 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.648 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:34.648 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:34.648 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:34.649 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:34.650 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:34.650 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:34.650 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:34.651 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:34.651 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:34.646+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:34.676 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:34.676 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:34.750 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:34.749+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:34.767 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T22:02:34.782 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:34.782 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:34.794 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T22:02:34.796 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:34.851 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:34.849+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:34.918 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:34.918 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:34.931 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:34.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:34.974+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:35.049 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:35.049 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:35.056 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:35.049+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:35.063 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:35.154 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:35.149+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:35.192 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:35.193 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:35.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:35.255 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:35.250+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:35.330 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:35.330 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:35.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:35.356 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:35.353+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:35.457 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:35.453+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:35.511 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:35.511 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:35.525 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:35.569 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:35.565+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:35.658 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:35.653+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:35.661 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:35.662 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:35.676 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:35.761 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:35.757+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:35.773 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T22:02:35.792 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:02:35.801 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T22:02:35.802 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:02:35.843 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:35.844 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:35.859 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:35.861 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:35.858+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:35.961 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:35.957+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:36.029 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:36.029 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:36.044 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:36.062 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:36.057+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:36.163 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:36.161+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:36.176 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:36.177 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:36.191 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:36.264 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:36.261+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:36.308 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:36.308 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:36.322 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:36.349 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:02:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:02:36.365 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:36.361+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:36.375 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-04-25T22:02:35.779793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":257,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90540,"kb_used_data":1160,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024980,"statfs":{"total":289910292480,"available":289817579520,"internally_reserved":0,"allocated":1187840,"data_stored":1634626,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.021192"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763648+0000","last_change":"2024-04-25T22:01:14.641678+0000","last_active":"2024-04-25T22:02:30.763648+0000","last_peered":"2024-04-25T22:02:30.763648+0000","last_clean":"2024-04-25T22:02:30.763648+0000","last_became_active":"2024-04-25T22:01:14.640808+0000","last_became_peered":"2024-04-25T22:01:14.640808+0000","last_unstale":"2024-04-25T22:02:30.763648+0000","last_undegraded":"2024-04-25T22:02:30.763648+0000","last_fullsized":"2024-04-25T22:02:30.763648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762797+0000","last_change":"2024-04-25T22:01:14.648935+0000","last_active":"2024-04-25T22:02:30.762797+0000","last_peered":"2024-04-25T22:02:30.762797+0000","last_clean":"2024-04-25T22:02:30.762797+0000","last_became_active":"2024-04-25T22:01:14.647871+0000","last_became_peered":"2024-04-25T22:01:14.647871+0000","last_unstale":"2024-04-25T22:02:30.762797+0000","last_undegraded":"2024-04-25T22:02:30.762797+0000","last_fullsized":"2024-04-25T22:02:30.762797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764724+0000","last_change":"2024-04-25T22:01:14.647262+0000","last_active":"2024-04-25T22:02:30.764724+0000","last_peered":"2024-04-25T22:02:30.764724+0000","last_clean":"2024-04-25T22:02:30.764724+0000","last_became_active":"2024-04-25T22:01:14.645878+0000","last_became_peered":"2024-04-25T22:01:14.645878+0000","last_unstale":"2024-04-25T22:02:30.764724+0000","last_undegraded":"2024-04-25T22:02:30.764724+0000","last_fullsized":"2024-04-25T22:02:30.764724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764287+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:02:30.764287+0000","last_peered":"2024-04-25T22:02:30.764287+0000","last_clean":"2024-04-25T22:02:30.764287+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:02:30.764287+0000","last_undegraded":"2024-04-25T22:02:30.764287+0000","last_fullsized":"2024-04-25T22:02:30.764287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762328+0000","last_change":"2024-04-25T22:01:14.642505+0000","last_active":"2024-04-25T22:02:30.762328+0000","last_peered":"2024-04-25T22:02:30.762328+0000","last_clean":"2024-04-25T22:02:30.762328+0000","last_became_active":"2024-04-25T22:01:14.641574+0000","last_became_peered":"2024-04-25T22:01:14.641574+0000","last_unstale":"2024-04-25T22:02:30.762328+0000","last_undegraded":"2024-04-25T22:02:30.762328+0000","last_fullsized":"2024-04-25T22:02:30.762328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763601+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:02:30.763601+0000","last_peered":"2024-04-25T22:02:30.763601+0000","last_clean":"2024-04-25T22:02:30.763601+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:02:30.763601+0000","last_undegraded":"2024-04-25T22:02:30.763601+0000","last_fullsized":"2024-04-25T22:02:30.763601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763709+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:02:30.763709+0000","last_peered":"2024-04-25T22:02:30.763709+0000","last_clean":"2024-04-25T22:02:30.763709+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:02:30.763709+0000","last_undegraded":"2024-04-25T22:02:30.763709+0000","last_fullsized":"2024-04-25T22:02:30.763709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763026+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:02:30.763026+0000","last_peered":"2024-04-25T22:02:30.763026+0000","last_clean":"2024-04-25T22:02:30.763026+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:02:30.763026+0000","last_undegraded":"2024-04-25T22:02:30.763026+0000","last_fullsized":"2024-04-25T22:02:30.763026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366628+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:02:33.366628+0000","last_peered":"2024-04-25T22:02:33.366628+0000","last_clean":"2024-04-25T22:02:33.366628+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:02:33.366628+0000","last_undegraded":"2024-04-25T22:02:33.366628+0000","last_fullsized":"2024-04-25T22:02:33.366628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763230+0000","last_change":"2024-04-25T22:01:14.647968+0000","last_active":"2024-04-25T22:02:30.763230+0000","last_peered":"2024-04-25T22:02:30.763230+0000","last_clean":"2024-04-25T22:02:30.763230+0000","last_became_active":"2024-04-25T22:01:14.646872+0000","last_became_peered":"2024-04-25T22:01:14.646872+0000","last_unstale":"2024-04-25T22:02:30.763230+0000","last_undegraded":"2024-04-25T22:02:30.763230+0000","last_fullsized":"2024-04-25T22:02:30.763230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764992+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:02:30.764992+0000","last_peered":"2024-04-25T22:02:30.764992+0000","last_clean":"2024-04-25T22:02:30.764992+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:02:30.764992+0000","last_undegraded":"2024-04-25T22:02:30.764992+0000","last_fullsized":"2024-04-25T22:02:30.764992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762778+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:02:30.762778+0000","last_peered":"2024-04-25T22:02:30.762778+0000","last_clean":"2024-04-25T22:02:30.762778+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:02:30.762778+0000","last_undegraded":"2024-04-25T22:02:30.762778+0000","last_fullsized":"2024-04-25T22:02:30.762778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762184+0000","last_change":"2024-04-25T22:01:14.643909+0000","last_active":"2024-04-25T22:02:30.762184+0000","last_peered":"2024-04-25T22:02:30.762184+0000","last_clean":"2024-04-25T22:02:30.762184+0000","last_became_active":"2024-04-25T22:01:14.642421+0000","last_became_peered":"2024-04-25T22:01:14.642421+0000","last_unstale":"2024-04-25T22:02:30.762184+0000","last_undegraded":"2024-04-25T22:02:30.762184+0000","last_fullsized":"2024-04-25T22:02:30.762184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763937+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:02:30.763937+0000","last_peered":"2024-04-25T22:02:30.763937+0000","last_clean":"2024-04-25T22:02:30.763937+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:02:30.763937+0000","last_undegraded":"2024-04-25T22:02:30.763937+0000","last_fullsized":"2024-04-25T22:02:30.763937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763792+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:02:30.763792+0000","last_peered":"2024-04-25T22:02:30.763792+0000","last_clean":"2024-04-25T22:02:30.763792+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:02:30.763792+0000","last_undegraded":"2024-04-25T22:02:30.763792+0000","last_fullsized":"2024-04-25T22:02:30.763792+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763086+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:02:30.763086+0000","last_peered":"2024-04-25T22:02:30.763086+0000","last_clean":"2024-04-25T22:02:30.763086+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:02:30.763086+0000","last_undegraded":"2024-04-25T22:02:30.763086+0000","last_fullsized":"2024-04-25T22:02:30.763086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.367073+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:02:33.367073+0000","last_peered":"2024-04-25T22:02:33.367073+0000","last_clean":"2024-04-25T22:02:33.367073+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:02:33.367073+0000","last_undegraded":"2024-04-25T22:02:33.367073+0000","last_fullsized":"2024-04-25T22:02:33.367073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763169+0000","last_change":"2024-04-25T22:01:14.647317+0000","last_active":"2024-04-25T22:02:30.763169+0000","last_peered":"2024-04-25T22:02:30.763169+0000","last_clean":"2024-04-25T22:02:30.763169+0000","last_became_active":"2024-04-25T22:01:14.644027+0000","last_became_peered":"2024-04-25T22:01:14.644027+0000","last_unstale":"2024-04-25T22:02:30.763169+0000","last_undegraded":"2024-04-25T22:02:30.763169+0000","last_fullsized":"2024-04-25T22:02:30.763169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366389+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:02:33.366389+0000","last_peered":"2024-04-25T22:02:33.366389+0000","last_clean":"2024-04-25T22:02:33.366389+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:02:33.366389+0000","last_undegraded":"2024-04-25T22:02:33.366389+0000","last_fullsized":"2024-04-25T22:02:33.366389+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764310+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:02:30.764310+0000","last_peered":"2024-04-25T22:02:30.764310+0000","last_clean":"2024-04-25T22:02:30.764310+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:02:30.764310+0000","last_undegraded":"2024-04-25T22:02:30.764310+0000","last_fullsized":"2024-04-25T22:02:30.764310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764413+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:02:30.764413+0000","last_peered":"2024-04-25T22:02:30.764413+0000","last_clean":"2024-04-25T22:02:30.764413+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:02:30.764413+0000","last_undegraded":"2024-04-25T22:02:30.764413+0000","last_fullsized":"2024-04-25T22:02:30.764413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.761724+0000","last_change":"2024-04-25T22:01:14.633477+0000","last_active":"2024-04-25T22:02:30.761724+0000","last_peered":"2024-04-25T22:02:30.761724+0000","last_clean":"2024-04-25T22:02:30.761724+0000","last_became_active":"2024-04-25T22:01:14.632678+0000","last_became_peered":"2024-04-25T22:01:14.632678+0000","last_unstale":"2024-04-25T22:02:30.761724+0000","last_undegraded":"2024-04-25T22:02:30.761724+0000","last_fullsized":"2024-04-25T22:02:30.761724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.364956+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:02:33.364956+0000","last_peered":"2024-04-25T22:02:33.364956+0000","last_clean":"2024-04-25T22:02:33.364956+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:02:33.364956+0000","last_undegraded":"2024-04-25T22:02:33.364956+0000","last_fullsized":"2024-04-25T22:02:33.364956+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.761853+0000","last_change":"2024-04-25T22:01:14.641991+0000","last_active":"2024-04-25T22:02:30.761853+0000","last_peered":"2024-04-25T22:02:30.761853+0000","last_clean":"2024-04-25T22:02:30.761853+0000","last_became_active":"2024-04-25T22:01:14.641244+0000","last_became_peered":"2024-04-25T22:01:14.641244+0000","last_unstale":"2024-04-25T22:02:30.761853+0000","last_undegraded":"2024-04-25T22:02:30.761853+0000","last_fullsized":"2024-04-25T22:02:30.761853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:03.098700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763809+0000","last_change":"2024-04-25T22:01:14.638103+0000","last_active":"2024-04-25T22:02:30.763809+0000","last_peered":"2024-04-25T22:02:30.763809+0000","last_clean":"2024-04-25T22:02:30.763809+0000","last_became_active":"2024-04-25T22:01:14.636488+0000","last_became_peered":"2024-04-25T22:01:14.636488+0000","last_unstale":"2024-04-25T22:02:30.763809+0000","last_undegraded":"2024-04-25T22:02:30.763809+0000","last_fullsized":"2024-04-25T22:02:30.763809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366644+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:02:33.366644+0000","last_peered":"2024-04-25T22:02:33.366644+0000","last_clean":"2024-04-25T22:02:33.366644+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:02:33.366644+0000","last_undegraded":"2024-04-25T22:02:33.366644+0000","last_fullsized":"2024-04-25T22:02:33.366644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765276+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:02:30.765276+0000","last_peered":"2024-04-25T22:02:30.765276+0000","last_clean":"2024-04-25T22:02:30.765276+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:02:30.765276+0000","last_undegraded":"2024-04-25T22:02:30.765276+0000","last_fullsized":"2024-04-25T22:02:30.765276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763594+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:02:30.763594+0000","last_peered":"2024-04-25T22:02:30.763594+0000","last_clean":"2024-04-25T22:02:30.763594+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:02:30.763594+0000","last_undegraded":"2024-04-25T22:02:30.763594+0000","last_fullsized":"2024-04-25T22:02:30.763594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365891+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:02:33.365891+0000","last_peered":"2024-04-25T22:02:33.365891+0000","last_clean":"2024-04-25T22:02:33.365891+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:02:33.365891+0000","last_undegraded":"2024-04-25T22:02:33.365891+0000","last_fullsized":"2024-04-25T22:02:33.365891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.761995+0000","last_change":"2024-04-25T22:01:14.638343+0000","last_active":"2024-04-25T22:02:30.761995+0000","last_peered":"2024-04-25T22:02:30.761995+0000","last_clean":"2024-04-25T22:02:30.761995+0000","last_became_active":"2024-04-25T22:01:14.637694+0000","last_became_peered":"2024-04-25T22:01:14.637694+0000","last_unstale":"2024-04-25T22:02:30.761995+0000","last_undegraded":"2024-04-25T22:02:30.761995+0000","last_fullsized":"2024-04-25T22:02:30.761995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.364997+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:02:33.364997+0000","last_peered":"2024-04-25T22:02:33.364997+0000","last_clean":"2024-04-25T22:02:33.364997+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:02:33.364997+0000","last_undegraded":"2024-04-25T22:02:33.364997+0000","last_fullsized":"2024-04-25T22:02:33.364997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763314+0000","last_change":"2024-04-25T22:01:14.648196+0000","last_active":"2024-04-25T22:02:30.763314+0000","last_peered":"2024-04-25T22:02:30.763314+0000","last_clean":"2024-04-25T22:02:30.763314+0000","last_became_active":"2024-04-25T22:01:14.647509+0000","last_became_peered":"2024-04-25T22:01:14.647509+0000","last_unstale":"2024-04-25T22:02:30.763314+0000","last_undegraded":"2024-04-25T22:02:30.763314+0000","last_fullsized":"2024-04-25T22:02:30.763314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763029+0000","last_change":"2024-04-25T22:01:14.641706+0000","last_active":"2024-04-25T22:02:30.763029+0000","last_peered":"2024-04-25T22:02:30.763029+0000","last_clean":"2024-04-25T22:02:30.763029+0000","last_became_active":"2024-04-25T22:01:14.641043+0000","last_became_peered":"2024-04-25T22:01:14.641043+0000","last_unstale":"2024-04-25T22:02:30.763029+0000","last_undegraded":"2024-04-25T22:02:30.763029+0000","last_fullsized":"2024-04-25T22:02:30.763029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764427+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:02:30.764427+0000","last_peered":"2024-04-25T22:02:30.764427+0000","last_clean":"2024-04-25T22:02:30.764427+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:02:30.764427+0000","last_undegraded":"2024-04-25T22:02:30.764427+0000","last_fullsized":"2024-04-25T22:02:30.764427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763011+0000","last_change":"2024-04-25T22:01:14.635075+0000","last_active":"2024-04-25T22:02:30.763011+0000","last_peered":"2024-04-25T22:02:30.763011+0000","last_clean":"2024-04-25T22:02:30.763011+0000","last_became_active":"2024-04-25T22:01:14.630677+0000","last_became_peered":"2024-04-25T22:01:14.630677+0000","last_unstale":"2024-04-25T22:02:30.763011+0000","last_undegraded":"2024-04-25T22:02:30.763011+0000","last_fullsized":"2024-04-25T22:02:30.763011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365642+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:02:33.365642+0000","last_peered":"2024-04-25T22:02:33.365642+0000","last_clean":"2024-04-25T22:02:33.365642+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:02:33.365642+0000","last_undegraded":"2024-04-25T22:02:33.365642+0000","last_fullsized":"2024-04-25T22:02:33.365642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366902+0000","last_change":"2024-04-25T22:01:14.648527+0000","last_active":"2024-04-25T22:02:33.366902+0000","last_peered":"2024-04-25T22:02:33.366902+0000","last_clean":"2024-04-25T22:02:33.366902+0000","last_became_active":"2024-04-25T22:01:14.645040+0000","last_became_peered":"2024-04-25T22:01:14.645040+0000","last_unstale":"2024-04-25T22:02:33.366902+0000","last_undegraded":"2024-04-25T22:02:33.366902+0000","last_fullsized":"2024-04-25T22:02:33.366902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762061+0000","last_change":"2024-04-25T22:01:13.630817+0000","last_active":"2024-04-25T22:02:30.762061+0000","last_peered":"2024-04-25T22:02:30.762061+0000","last_clean":"2024-04-25T22:02:30.762061+0000","last_became_active":"2024-04-25T22:01:13.629994+0000","last_became_peered":"2024-04-25T22:01:13.629994+0000","last_unstale":"2024-04-25T22:02:30.762061+0000","last_undegraded":"2024-04-25T22:02:30.762061+0000","last_fullsized":"2024-04-25T22:02:30.762061+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366761+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:02:33.366761+0000","last_peered":"2024-04-25T22:02:33.366761+0000","last_clean":"2024-04-25T22:02:33.366761+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:02:33.366761+0000","last_undegraded":"2024-04-25T22:02:33.366761+0000","last_fullsized":"2024-04-25T22:02:33.366761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":66,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763379+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:02:30.763379+0000","last_peered":"2024-04-25T22:02:30.763379+0000","last_clean":"2024-04-25T22:02:30.763379+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:02:30.763379+0000","last_undegraded":"2024-04-25T22:02:30.763379+0000","last_fullsized":"2024-04-25T22:02:30.763379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765722+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:02:30.765722+0000","last_peered":"2024-04-25T22:02:30.765722+0000","last_clean":"2024-04-25T22:02:30.765722+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:02:30.765722+0000","last_undegraded":"2024-04-25T22:02:30.765722+0000","last_fullsized":"2024-04-25T22:02:30.765722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.761749+0000","last_change":"2024-04-25T22:01:14.633805+0000","last_active":"2024-04-25T22:02:30.761749+0000","last_peered":"2024-04-25T22:02:30.761749+0000","last_clean":"2024-04-25T22:02:30.761749+0000","last_became_active":"2024-04-25T22:01:14.633045+0000","last_became_peered":"2024-04-25T22:01:14.633045+0000","last_unstale":"2024-04-25T22:02:30.761749+0000","last_undegraded":"2024-04-25T22:02:30.761749+0000","last_fullsized":"2024-04-25T22:02:30.761749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:43.718628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763616+0000","last_change":"2024-04-25T22:01:13.631135+0000","last_active":"2024-04-25T22:02:30.763616+0000","last_peered":"2024-04-25T22:02:30.763616+0000","last_clean":"2024-04-25T22:02:30.763616+0000","last_became_active":"2024-04-25T22:01:13.630257+0000","last_became_peered":"2024-04-25T22:01:13.630257+0000","last_unstale":"2024-04-25T22:02:30.763616+0000","last_undegraded":"2024-04-25T22:02:30.763616+0000","last_fullsized":"2024-04-25T22:02:30.763616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.761733+0000","last_change":"2024-04-25T22:01:14.630233+0000","last_active":"2024-04-25T22:02:30.761733+0000","last_peered":"2024-04-25T22:02:30.761733+0000","last_clean":"2024-04-25T22:02:30.761733+0000","last_became_active":"2024-04-25T22:01:14.629415+0000","last_became_peered":"2024-04-25T22:01:14.629415+0000","last_unstale":"2024-04-25T22:02:30.761733+0000","last_undegraded":"2024-04-25T22:02:30.761733+0000","last_fullsized":"2024-04-25T22:02:30.761733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:02:28.593163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765746+0000","last_change":"2024-04-25T22:01:13.633106+0000","last_active":"2024-04-25T22:02:30.765746+0000","last_peered":"2024-04-25T22:02:30.765746+0000","last_clean":"2024-04-25T22:02:30.765746+0000","last_became_active":"2024-04-25T22:01:13.631466+0000","last_became_peered":"2024-04-25T22:01:13.631466+0000","last_unstale":"2024-04-25T22:02:30.765746+0000","last_undegraded":"2024-04-25T22:02:30.765746+0000","last_fullsized":"2024-04-25T22:02:30.765746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:23.095422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764130+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:02:30.764130+0000","last_peered":"2024-04-25T22:02:30.764130+0000","last_clean":"2024-04-25T22:02:30.764130+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:02:30.764130+0000","last_undegraded":"2024-04-25T22:02:30.764130+0000","last_fullsized":"2024-04-25T22:02:30.764130+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765226+0000","last_change":"2024-04-25T22:01:13.626767+0000","last_active":"2024-04-25T22:02:30.765226+0000","last_peered":"2024-04-25T22:02:30.765226+0000","last_clean":"2024-04-25T22:02:30.765226+0000","last_became_active":"2024-04-25T22:01:13.625984+0000","last_became_peered":"2024-04-25T22:01:13.625984+0000","last_unstale":"2024-04-25T22:02:30.765226+0000","last_undegraded":"2024-04-25T22:02:30.765226+0000","last_fullsized":"2024-04-25T22:02:30.765226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365955+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:02:33.365955+0000","last_peered":"2024-04-25T22:02:33.365955+0000","last_clean":"2024-04-25T22:02:33.365955+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:02:33.365955+0000","last_undegraded":"2024-04-25T22:02:33.365955+0000","last_fullsized":"2024-04-25T22:02:33.365955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366629+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:02:33.366629+0000","last_peered":"2024-04-25T22:02:33.366629+0000","last_clean":"2024-04-25T22:02:33.366629+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:02:33.366629+0000","last_undegraded":"2024-04-25T22:02:33.366629+0000","last_fullsized":"2024-04-25T22:02:33.366629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764573+0000","last_change":"2024-04-25T22:01:14.650077+0000","last_active":"2024-04-25T22:02:30.764573+0000","last_peered":"2024-04-25T22:02:30.764573+0000","last_clean":"2024-04-25T22:02:30.764573+0000","last_became_active":"2024-04-25T22:01:14.649315+0000","last_became_peered":"2024-04-25T22:01:14.649315+0000","last_unstale":"2024-04-25T22:02:30.764573+0000","last_undegraded":"2024-04-25T22:02:30.764573+0000","last_fullsized":"2024-04-25T22:02:30.764573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.976715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764425+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:02:30.764425+0000","last_peered":"2024-04-25T22:02:30.764425+0000","last_clean":"2024-04-25T22:02:30.764425+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:02:30.764425+0000","last_undegraded":"2024-04-25T22:02:30.764425+0000","last_fullsized":"2024-04-25T22:02:30.764425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765521+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:02:30.765521+0000","last_peered":"2024-04-25T22:02:30.765521+0000","last_clean":"2024-04-25T22:02:30.765521+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:02:30.765521+0000","last_undegraded":"2024-04-25T22:02:30.765521+0000","last_fullsized":"2024-04-25T22:02:30.765521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762084+0000","last_change":"2024-04-25T22:01:13.631439+0000","last_active":"2024-04-25T22:02:30.762084+0000","last_peered":"2024-04-25T22:02:30.762084+0000","last_clean":"2024-04-25T22:02:30.762084+0000","last_became_active":"2024-04-25T22:01:13.630812+0000","last_became_peered":"2024-04-25T22:01:13.630812+0000","last_unstale":"2024-04-25T22:02:30.762084+0000","last_undegraded":"2024-04-25T22:02:30.762084+0000","last_fullsized":"2024-04-25T22:02:30.762084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765409+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:02:30.765409+0000","last_peered":"2024-04-25T22:02:30.765409+0000","last_clean":"2024-04-25T22:02:30.765409+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:02:30.765409+0000","last_undegraded":"2024-04-25T22:02:30.765409+0000","last_fullsized":"2024-04-25T22:02:30.765409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762027+0000","last_change":"2024-04-25T22:01:13.623342+0000","last_active":"2024-04-25T22:02:30.762027+0000","last_peered":"2024-04-25T22:02:30.762027+0000","last_clean":"2024-04-25T22:02:30.762027+0000","last_became_active":"2024-04-25T22:01:13.621460+0000","last_became_peered":"2024-04-25T22:01:13.621460+0000","last_unstale":"2024-04-25T22:02:30.762027+0000","last_undegraded":"2024-04-25T22:02:30.762027+0000","last_fullsized":"2024-04-25T22:02:30.762027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366860+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:02:33.366860+0000","last_peered":"2024-04-25T22:02:33.366860+0000","last_clean":"2024-04-25T22:02:33.366860+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:02:33.366860+0000","last_undegraded":"2024-04-25T22:02:33.366860+0000","last_fullsized":"2024-04-25T22:02:33.366860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":266,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763869+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:02:30.763869+0000","last_peered":"2024-04-25T22:02:30.763869+0000","last_clean":"2024-04-25T22:02:30.763869+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:02:30.763869+0000","last_undegraded":"2024-04-25T22:02:30.763869+0000","last_fullsized":"2024-04-25T22:02:30.763869+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764809+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:02:30.764809+0000","last_peered":"2024-04-25T22:02:30.764809+0000","last_clean":"2024-04-25T22:02:30.764809+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:02:30.764809+0000","last_undegraded":"2024-04-25T22:02:30.764809+0000","last_fullsized":"2024-04-25T22:02:30.764809+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366082+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:02:33.366082+0000","last_peered":"2024-04-25T22:02:33.366082+0000","last_clean":"2024-04-25T22:02:33.366082+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:02:33.366082+0000","last_undegraded":"2024-04-25T22:02:33.366082+0000","last_fullsized":"2024-04-25T22:02:33.366082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765537+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:02:30.765537+0000","last_peered":"2024-04-25T22:02:30.765537+0000","last_clean":"2024-04-25T22:02:30.765537+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:02:30.765537+0000","last_undegraded":"2024-04-25T22:02:30.765537+0000","last_fullsized":"2024-04-25T22:02:30.765537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763687+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:02:30.763687+0000","last_peered":"2024-04-25T22:02:30.763687+0000","last_clean":"2024-04-25T22:02:30.763687+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:02:30.763687+0000","last_undegraded":"2024-04-25T22:02:30.763687+0000","last_fullsized":"2024-04-25T22:02:30.763687+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365459+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:02:33.365459+0000","last_peered":"2024-04-25T22:02:33.365459+0000","last_clean":"2024-04-25T22:02:33.365459+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:02:33.365459+0000","last_undegraded":"2024-04-25T22:02:33.365459+0000","last_fullsized":"2024-04-25T22:02:33.365459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762959+0000","last_change":"2024-04-25T22:01:14.645176+0000","last_active":"2024-04-25T22:02:30.762959+0000","last_peered":"2024-04-25T22:02:30.762959+0000","last_clean":"2024-04-25T22:02:30.762959+0000","last_became_active":"2024-04-25T22:01:14.642395+0000","last_became_peered":"2024-04-25T22:01:14.642395+0000","last_unstale":"2024-04-25T22:02:30.762959+0000","last_undegraded":"2024-04-25T22:02:30.762959+0000","last_fullsized":"2024-04-25T22:02:30.762959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365603+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:02:33.365603+0000","last_peered":"2024-04-25T22:02:33.365603+0000","last_clean":"2024-04-25T22:02:33.365603+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:02:33.365603+0000","last_undegraded":"2024-04-25T22:02:33.365603+0000","last_fullsized":"2024-04-25T22:02:33.365603+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762094+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:02:30.762094+0000","last_peered":"2024-04-25T22:02:30.762094+0000","last_clean":"2024-04-25T22:02:30.762094+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:02:30.762094+0000","last_undegraded":"2024-04-25T22:02:30.762094+0000","last_fullsized":"2024-04-25T22:02:30.762094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366872+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:02:33.366872+0000","last_peered":"2024-04-25T22:02:33.366872+0000","last_clean":"2024-04-25T22:02:33.366872+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:02:33.366872+0000","last_undegraded":"2024-04-25T22:02:33.366872+0000","last_fullsized":"2024-04-25T22:02:33.366872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764498+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:02:30.764498+0000","last_peered":"2024-04-25T22:02:30.764498+0000","last_clean":"2024-04-25T22:02:30.764498+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:02:30.764498+0000","last_undegraded":"2024-04-25T22:02:30.764498+0000","last_fullsized":"2024-04-25T22:02:30.764498+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764691+0000","last_change":"2024-04-25T22:01:13.627274+0000","last_active":"2024-04-25T22:02:30.764691+0000","last_peered":"2024-04-25T22:02:30.764691+0000","last_clean":"2024-04-25T22:02:30.764691+0000","last_became_active":"2024-04-25T22:01:13.626015+0000","last_became_peered":"2024-04-25T22:01:13.626015+0000","last_unstale":"2024-04-25T22:02:30.764691+0000","last_undegraded":"2024-04-25T22:02:30.764691+0000","last_fullsized":"2024-04-25T22:02:30.764691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366183+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:02:33.366183+0000","last_peered":"2024-04-25T22:02:33.366183+0000","last_clean":"2024-04-25T22:02:33.366183+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:02:33.366183+0000","last_undegraded":"2024-04-25T22:02:33.366183+0000","last_fullsized":"2024-04-25T22:02:33.366183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765827+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:02:30.765827+0000","last_peered":"2024-04-25T22:02:30.765827+0000","last_clean":"2024-04-25T22:02:30.765827+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:02:30.765827+0000","last_undegraded":"2024-04-25T22:02:30.765827+0000","last_fullsized":"2024-04-25T22:02:30.765827+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366427+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:02:33.366427+0000","last_peered":"2024-04-25T22:02:33.366427+0000","last_clean":"2024-04-25T22:02:33.366427+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:02:33.366427+0000","last_undegraded":"2024-04-25T22:02:33.366427+0000","last_fullsized":"2024-04-25T22:02:33.366427+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.761789+0000","last_change":"2024-04-25T22:01:14.637520+0000","last_active":"2024-04-25T22:02:30.761789+0000","last_peered":"2024-04-25T22:02:30.761789+0000","last_clean":"2024-04-25T22:02:30.761789+0000","last_became_active":"2024-04-25T22:01:14.636765+0000","last_became_peered":"2024-04-25T22:01:14.636765+0000","last_unstale":"2024-04-25T22:02:30.761789+0000","last_undegraded":"2024-04-25T22:02:30.761789+0000","last_fullsized":"2024-04-25T22:02:30.761789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366288+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:02:33.366288+0000","last_peered":"2024-04-25T22:02:33.366288+0000","last_clean":"2024-04-25T22:02:33.366288+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:02:33.366288+0000","last_undegraded":"2024-04-25T22:02:33.366288+0000","last_fullsized":"2024-04-25T22:02:33.366288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763851+0000","last_change":"2024-04-25T22:01:09.582204+0000","last_active":"2024-04-25T22:02:30.763851+0000","last_peered":"2024-04-25T22:02:30.763851+0000","last_clean":"2024-04-25T22:02:30.763851+0000","last_became_active":"2024-04-25T22:01:09.581494+0000","last_became_peered":"2024-04-25T22:01:09.581494+0000","last_unstale":"2024-04-25T22:02:30.763851+0000","last_undegraded":"2024-04-25T22:02:30.763851+0000","last_fullsized":"2024-04-25T22:02:30.763851+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:13.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762204+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:02:30.762204+0000","last_peered":"2024-04-25T22:02:30.762204+0000","last_clean":"2024-04-25T22:02:30.762204+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:02:30.762204+0000","last_undegraded":"2024-04-25T22:02:30.762204+0000","last_fullsized":"2024-04-25T22:02:30.762204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.367075+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:02:33.367075+0000","last_peered":"2024-04-25T22:02:33.367075+0000","last_clean":"2024-04-25T22:02:33.367075+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:02:33.367075+0000","last_undegraded":"2024-04-25T22:02:33.367075+0000","last_fullsized":"2024-04-25T22:02:33.367075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.367002+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:02:33.367002+0000","last_peered":"2024-04-25T22:02:33.367002+0000","last_clean":"2024-04-25T22:02:33.367002+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:02:33.367002+0000","last_undegraded":"2024-04-25T22:02:33.367002+0000","last_fullsized":"2024-04-25T22:02:33.367002+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365672+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:02:33.365672+0000","last_peered":"2024-04-25T22:02:33.365672+0000","last_clean":"2024-04-25T22:02:33.365672+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:02:33.365672+0000","last_undegraded":"2024-04-25T22:02:33.365672+0000","last_fullsized":"2024-04-25T22:02:33.365672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":61,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366972+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:02:33.366972+0000","last_peered":"2024-04-25T22:02:33.366972+0000","last_clean":"2024-04-25T22:02:33.366972+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:02:33.366972+0000","last_undegraded":"2024-04-25T22:02:33.366972+0000","last_fullsized":"2024-04-25T22:02:33.366972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765845+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:02:30.765845+0000","last_peered":"2024-04-25T22:02:30.765845+0000","last_clean":"2024-04-25T22:02:30.765845+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:02:30.765845+0000","last_undegraded":"2024-04-25T22:02:30.765845+0000","last_fullsized":"2024-04-25T22:02:30.765845+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.761749+0000","last_change":"2024-04-25T22:01:14.632306+0000","last_active":"2024-04-25T22:02:30.761749+0000","last_peered":"2024-04-25T22:02:30.761749+0000","last_clean":"2024-04-25T22:02:30.761749+0000","last_became_active":"2024-04-25T22:01:14.631179+0000","last_became_peered":"2024-04-25T22:01:14.631179+0000","last_unstale":"2024-04-25T22:02:30.761749+0000","last_undegraded":"2024-04-25T22:02:30.761749+0000","last_fullsized":"2024-04-25T22:02:30.761749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764080+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:02:30.764080+0000","last_peered":"2024-04-25T22:02:30.764080+0000","last_clean":"2024-04-25T22:02:30.764080+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:02:30.764080+0000","last_undegraded":"2024-04-25T22:02:30.764080+0000","last_fullsized":"2024-04-25T22:02:30.764080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"23'11","reported_seq":69,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764877+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:02:30.764877+0000","last_peered":"2024-04-25T22:02:30.764877+0000","last_clean":"2024-04-25T22:02:30.764877+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:02:30.764877+0000","last_undegraded":"2024-04-25T22:02:30.764877+0000","last_fullsized":"2024-04-25T22:02:30.764877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365630+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:02:33.365630+0000","last_peered":"2024-04-25T22:02:33.365630+0000","last_clean":"2024-04-25T22:02:33.365630+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:02:33.365630+0000","last_undegraded":"2024-04-25T22:02:33.365630+0000","last_fullsized":"2024-04-25T22:02:33.365630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":61,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763626+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:02:30.763626+0000","last_peered":"2024-04-25T22:02:30.763626+0000","last_clean":"2024-04-25T22:02:30.763626+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:02:30.763626+0000","last_undegraded":"2024-04-25T22:02:30.763626+0000","last_fullsized":"2024-04-25T22:02:30.763626+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765704+0000","last_change":"2024-04-25T22:01:13.626710+0000","last_active":"2024-04-25T22:02:30.765704+0000","last_peered":"2024-04-25T22:02:30.765704+0000","last_clean":"2024-04-25T22:02:30.765704+0000","last_became_active":"2024-04-25T22:01:13.625898+0000","last_became_peered":"2024-04-25T22:01:13.625898+0000","last_unstale":"2024-04-25T22:02:30.765704+0000","last_undegraded":"2024-04-25T22:02:30.765704+0000","last_fullsized":"2024-04-25T22:02:30.765704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365102+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:02:33.365102+0000","last_peered":"2024-04-25T22:02:33.365102+0000","last_clean":"2024-04-25T22:02:33.365102+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:02:33.365102+0000","last_undegraded":"2024-04-25T22:02:33.365102+0000","last_fullsized":"2024-04-25T22:02:33.365102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.367017+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:02:33.367017+0000","last_peered":"2024-04-25T22:02:33.367017+0000","last_clean":"2024-04-25T22:02:33.367017+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:02:33.367017+0000","last_undegraded":"2024-04-25T22:02:33.367017+0000","last_fullsized":"2024-04-25T22:02:33.367017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365421+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:02:33.365421+0000","last_peered":"2024-04-25T22:02:33.365421+0000","last_clean":"2024-04-25T22:02:33.365421+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:02:33.365421+0000","last_undegraded":"2024-04-25T22:02:33.365421+0000","last_fullsized":"2024-04-25T22:02:33.365421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763844+0000","last_change":"2024-04-25T22:01:14.639447+0000","last_active":"2024-04-25T22:02:30.763844+0000","last_peered":"2024-04-25T22:02:30.763844+0000","last_clean":"2024-04-25T22:02:30.763844+0000","last_became_active":"2024-04-25T22:01:14.638864+0000","last_became_peered":"2024-04-25T22:01:14.638864+0000","last_unstale":"2024-04-25T22:02:30.763844+0000","last_undegraded":"2024-04-25T22:02:30.763844+0000","last_fullsized":"2024-04-25T22:02:30.763844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365952+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:02:33.365952+0000","last_peered":"2024-04-25T22:02:33.365952+0000","last_clean":"2024-04-25T22:02:33.365952+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:02:33.365952+0000","last_undegraded":"2024-04-25T22:02:33.365952+0000","last_fullsized":"2024-04-25T22:02:33.365952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366531+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:02:33.366531+0000","last_peered":"2024-04-25T22:02:33.366531+0000","last_clean":"2024-04-25T22:02:33.366531+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:02:33.366531+0000","last_undegraded":"2024-04-25T22:02:33.366531+0000","last_fullsized":"2024-04-25T22:02:33.366531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365243+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:02:33.365243+0000","last_peered":"2024-04-25T22:02:33.365243+0000","last_clean":"2024-04-25T22:02:33.365243+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:02:33.365243+0000","last_undegraded":"2024-04-25T22:02:33.365243+0000","last_fullsized":"2024-04-25T22:02:33.365243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762994+0000","last_change":"2024-04-25T22:01:14.637452+0000","last_active":"2024-04-25T22:02:30.762994+0000","last_peered":"2024-04-25T22:02:30.762994+0000","last_clean":"2024-04-25T22:02:30.762994+0000","last_became_active":"2024-04-25T22:01:14.636407+0000","last_became_peered":"2024-04-25T22:01:14.636407+0000","last_unstale":"2024-04-25T22:02:30.762994+0000","last_undegraded":"2024-04-25T22:02:30.762994+0000","last_fullsized":"2024-04-25T22:02:30.762994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762084+0000","last_change":"2024-04-25T22:01:13.621997+0000","last_active":"2024-04-25T22:02:30.762084+0000","last_peered":"2024-04-25T22:02:30.762084+0000","last_clean":"2024-04-25T22:02:30.762084+0000","last_became_active":"2024-04-25T22:01:13.620987+0000","last_became_peered":"2024-04-25T22:01:13.620987+0000","last_unstale":"2024-04-25T22:02:30.762084+0000","last_undegraded":"2024-04-25T22:02:30.762084+0000","last_fullsized":"2024-04-25T22:02:30.762084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763036+0000","last_change":"2024-04-25T22:01:14.650437+0000","last_active":"2024-04-25T22:02:30.763036+0000","last_peered":"2024-04-25T22:02:30.763036+0000","last_clean":"2024-04-25T22:02:30.763036+0000","last_became_active":"2024-04-25T22:01:14.648116+0000","last_became_peered":"2024-04-25T22:01:14.648116+0000","last_unstale":"2024-04-25T22:02:30.763036+0000","last_undegraded":"2024-04-25T22:02:30.763036+0000","last_fullsized":"2024-04-25T22:02:30.763036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762490+0000","last_change":"2024-04-25T22:01:13.631562+0000","last_active":"2024-04-25T22:02:30.762490+0000","last_peered":"2024-04-25T22:02:30.762490+0000","last_clean":"2024-04-25T22:02:30.762490+0000","last_became_active":"2024-04-25T22:01:13.630731+0000","last_became_peered":"2024-04-25T22:01:13.630731+0000","last_unstale":"2024-04-25T22:02:30.762490+0000","last_undegraded":"2024-04-25T22:02:30.762490+0000","last_fullsized":"2024-04-25T22:02:30.762490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763896+0000","last_change":"2024-04-25T22:01:14.654909+0000","last_active":"2024-04-25T22:02:30.763896+0000","last_peered":"2024-04-25T22:02:30.763896+0000","last_clean":"2024-04-25T22:02:30.763896+0000","last_became_active":"2024-04-25T22:01:14.653503+0000","last_became_peered":"2024-04-25T22:01:14.653503+0000","last_unstale":"2024-04-25T22:02:30.763896+0000","last_undegraded":"2024-04-25T22:02:30.763896+0000","last_fullsized":"2024-04-25T22:02:30.763896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764860+0000","last_change":"2024-04-25T22:01:13.628356+0000","last_active":"2024-04-25T22:02:30.764860+0000","last_peered":"2024-04-25T22:02:30.764860+0000","last_clean":"2024-04-25T22:02:30.764860+0000","last_became_active":"2024-04-25T22:01:13.626608+0000","last_became_peered":"2024-04-25T22:01:13.626608+0000","last_unstale":"2024-04-25T22:02:30.764860+0000","last_undegraded":"2024-04-25T22:02:30.764860+0000","last_fullsized":"2024-04-25T22:02:30.764860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764288+0000","last_change":"2024-04-25T22:01:14.648752+0000","last_active":"2024-04-25T22:02:30.764288+0000","last_peered":"2024-04-25T22:02:30.764288+0000","last_clean":"2024-04-25T22:02:30.764288+0000","last_became_active":"2024-04-25T22:01:14.647463+0000","last_became_peered":"2024-04-25T22:01:14.647463+0000","last_unstale":"2024-04-25T22:02:30.764288+0000","last_undegraded":"2024-04-25T22:02:30.764288+0000","last_fullsized":"2024-04-25T22:02:30.764288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:22.946881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763430+0000","last_change":"2024-04-25T22:01:13.630502+0000","last_active":"2024-04-25T22:02:30.763430+0000","last_peered":"2024-04-25T22:02:30.763430+0000","last_clean":"2024-04-25T22:02:30.763430+0000","last_became_active":"2024-04-25T22:01:13.629854+0000","last_became_peered":"2024-04-25T22:01:13.629854+0000","last_unstale":"2024-04-25T22:02:30.763430+0000","last_undegraded":"2024-04-25T22:02:30.763430+0000","last_fullsized":"2024-04-25T22:02:30.763430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762344+0000","last_change":"2024-04-25T22:01:14.642104+0000","last_active":"2024-04-25T22:02:30.762344+0000","last_peered":"2024-04-25T22:02:30.762344+0000","last_clean":"2024-04-25T22:02:30.762344+0000","last_became_active":"2024-04-25T22:01:14.641323+0000","last_became_peered":"2024-04-25T22:01:14.641323+0000","last_unstale":"2024-04-25T22:02:30.762344+0000","last_undegraded":"2024-04-25T22:02:30.762344+0000","last_fullsized":"2024-04-25T22:02:30.762344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366840+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:02:33.366840+0000","last_peered":"2024-04-25T22:02:33.366840+0000","last_clean":"2024-04-25T22:02:33.366840+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:02:33.366840+0000","last_undegraded":"2024-04-25T22:02:33.366840+0000","last_fullsized":"2024-04-25T22:02:33.366840+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763573+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:02:30.763573+0000","last_peered":"2024-04-25T22:02:30.763573+0000","last_clean":"2024-04-25T22:02:30.763573+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:02:30.763573+0000","last_undegraded":"2024-04-25T22:02:30.763573+0000","last_fullsized":"2024-04-25T22:02:30.763573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366948+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:02:33.366948+0000","last_peered":"2024-04-25T22:02:33.366948+0000","last_clean":"2024-04-25T22:02:33.366948+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:02:33.366948+0000","last_undegraded":"2024-04-25T22:02:33.366948+0000","last_fullsized":"2024-04-25T22:02:33.366948+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738392,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":421888,"data_stored":744903,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738391,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":144204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738392,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":745519,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:02:36.380 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:02:36.438 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:36.438 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:36.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:36.465 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:36.465+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:36.567 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:36.561+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:36.582 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:36.582 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:36.596 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:36.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:36.666+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:36.698 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:02:36.718 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:36.718 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:36.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:36.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:36.766+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:36.786 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-25T22:02:36.851 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:36.851 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:36.865 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:36.869 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:36.865+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:36.900 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:36.900 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:36.921 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:02:36.922 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:02:36.934 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:36.934 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:36.943 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-04-25T22:02:36.789857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":257,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90540,"kb_used_data":1160,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024980,"statfs":{"total":289910292480,"available":289817579520,"internally_reserved":0,"allocated":1187840,"data_stored":1634626,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.205415"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763648+0000","last_change":"2024-04-25T22:01:14.641678+0000","last_active":"2024-04-25T22:02:30.763648+0000","last_peered":"2024-04-25T22:02:30.763648+0000","last_clean":"2024-04-25T22:02:30.763648+0000","last_became_active":"2024-04-25T22:01:14.640808+0000","last_became_peered":"2024-04-25T22:01:14.640808+0000","last_unstale":"2024-04-25T22:02:30.763648+0000","last_undegraded":"2024-04-25T22:02:30.763648+0000","last_fullsized":"2024-04-25T22:02:30.763648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762797+0000","last_change":"2024-04-25T22:01:14.648935+0000","last_active":"2024-04-25T22:02:30.762797+0000","last_peered":"2024-04-25T22:02:30.762797+0000","last_clean":"2024-04-25T22:02:30.762797+0000","last_became_active":"2024-04-25T22:01:14.647871+0000","last_became_peered":"2024-04-25T22:01:14.647871+0000","last_unstale":"2024-04-25T22:02:30.762797+0000","last_undegraded":"2024-04-25T22:02:30.762797+0000","last_fullsized":"2024-04-25T22:02:30.762797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764724+0000","last_change":"2024-04-25T22:01:14.647262+0000","last_active":"2024-04-25T22:02:30.764724+0000","last_peered":"2024-04-25T22:02:30.764724+0000","last_clean":"2024-04-25T22:02:30.764724+0000","last_became_active":"2024-04-25T22:01:14.645878+0000","last_became_peered":"2024-04-25T22:01:14.645878+0000","last_unstale":"2024-04-25T22:02:30.764724+0000","last_undegraded":"2024-04-25T22:02:30.764724+0000","last_fullsized":"2024-04-25T22:02:30.764724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764287+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:02:30.764287+0000","last_peered":"2024-04-25T22:02:30.764287+0000","last_clean":"2024-04-25T22:02:30.764287+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:02:30.764287+0000","last_undegraded":"2024-04-25T22:02:30.764287+0000","last_fullsized":"2024-04-25T22:02:30.764287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762328+0000","last_change":"2024-04-25T22:01:14.642505+0000","last_active":"2024-04-25T22:02:30.762328+0000","last_peered":"2024-04-25T22:02:30.762328+0000","last_clean":"2024-04-25T22:02:30.762328+0000","last_became_active":"2024-04-25T22:01:14.641574+0000","last_became_peered":"2024-04-25T22:01:14.641574+0000","last_unstale":"2024-04-25T22:02:30.762328+0000","last_undegraded":"2024-04-25T22:02:30.762328+0000","last_fullsized":"2024-04-25T22:02:30.762328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763601+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:02:30.763601+0000","last_peered":"2024-04-25T22:02:30.763601+0000","last_clean":"2024-04-25T22:02:30.763601+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:02:30.763601+0000","last_undegraded":"2024-04-25T22:02:30.763601+0000","last_fullsized":"2024-04-25T22:02:30.763601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763709+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:02:30.763709+0000","last_peered":"2024-04-25T22:02:30.763709+0000","last_clean":"2024-04-25T22:02:30.763709+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:02:30.763709+0000","last_undegraded":"2024-04-25T22:02:30.763709+0000","last_fullsized":"2024-04-25T22:02:30.763709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763026+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:02:30.763026+0000","last_peered":"2024-04-25T22:02:30.763026+0000","last_clean":"2024-04-25T22:02:30.763026+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:02:30.763026+0000","last_undegraded":"2024-04-25T22:02:30.763026+0000","last_fullsized":"2024-04-25T22:02:30.763026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366628+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:02:33.366628+0000","last_peered":"2024-04-25T22:02:33.366628+0000","last_clean":"2024-04-25T22:02:33.366628+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:02:33.366628+0000","last_undegraded":"2024-04-25T22:02:33.366628+0000","last_fullsized":"2024-04-25T22:02:33.366628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763230+0000","last_change":"2024-04-25T22:01:14.647968+0000","last_active":"2024-04-25T22:02:30.763230+0000","last_peered":"2024-04-25T22:02:30.763230+0000","last_clean":"2024-04-25T22:02:30.763230+0000","last_became_active":"2024-04-25T22:01:14.646872+0000","last_became_peered":"2024-04-25T22:01:14.646872+0000","last_unstale":"2024-04-25T22:02:30.763230+0000","last_undegraded":"2024-04-25T22:02:30.763230+0000","last_fullsized":"2024-04-25T22:02:30.763230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764992+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:02:30.764992+0000","last_peered":"2024-04-25T22:02:30.764992+0000","last_clean":"2024-04-25T22:02:30.764992+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:02:30.764992+0000","last_undegraded":"2024-04-25T22:02:30.764992+0000","last_fullsized":"2024-04-25T22:02:30.764992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762778+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:02:30.762778+0000","last_peered":"2024-04-25T22:02:30.762778+0000","last_clean":"2024-04-25T22:02:30.762778+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:02:30.762778+0000","last_undegraded":"2024-04-25T22:02:30.762778+0000","last_fullsized":"2024-04-25T22:02:30.762778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762184+0000","last_change":"2024-04-25T22:01:14.643909+0000","last_active":"2024-04-25T22:02:30.762184+0000","last_peered":"2024-04-25T22:02:30.762184+0000","last_clean":"2024-04-25T22:02:30.762184+0000","last_became_active":"2024-04-25T22:01:14.642421+0000","last_became_peered":"2024-04-25T22:01:14.642421+0000","last_unstale":"2024-04-25T22:02:30.762184+0000","last_undegraded":"2024-04-25T22:02:30.762184+0000","last_fullsized":"2024-04-25T22:02:30.762184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763937+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:02:30.763937+0000","last_peered":"2024-04-25T22:02:30.763937+0000","last_clean":"2024-04-25T22:02:30.763937+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:02:30.763937+0000","last_undegraded":"2024-04-25T22:02:30.763937+0000","last_fullsized":"2024-04-25T22:02:30.763937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763792+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:02:30.763792+0000","last_peered":"2024-04-25T22:02:30.763792+0000","last_clean":"2024-04-25T22:02:30.763792+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:02:30.763792+0000","last_undegraded":"2024-04-25T22:02:30.763792+0000","last_fullsized":"2024-04-25T22:02:30.763792+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763086+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:02:30.763086+0000","last_peered":"2024-04-25T22:02:30.763086+0000","last_clean":"2024-04-25T22:02:30.763086+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:02:30.763086+0000","last_undegraded":"2024-04-25T22:02:30.763086+0000","last_fullsized":"2024-04-25T22:02:30.763086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.367073+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:02:33.367073+0000","last_peered":"2024-04-25T22:02:33.367073+0000","last_clean":"2024-04-25T22:02:33.367073+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:02:33.367073+0000","last_undegraded":"2024-04-25T22:02:33.367073+0000","last_fullsized":"2024-04-25T22:02:33.367073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763169+0000","last_change":"2024-04-25T22:01:14.647317+0000","last_active":"2024-04-25T22:02:30.763169+0000","last_peered":"2024-04-25T22:02:30.763169+0000","last_clean":"2024-04-25T22:02:30.763169+0000","last_became_active":"2024-04-25T22:01:14.644027+0000","last_became_peered":"2024-04-25T22:01:14.644027+0000","last_unstale":"2024-04-25T22:02:30.763169+0000","last_undegraded":"2024-04-25T22:02:30.763169+0000","last_fullsized":"2024-04-25T22:02:30.763169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366389+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:02:33.366389+0000","last_peered":"2024-04-25T22:02:33.366389+0000","last_clean":"2024-04-25T22:02:33.366389+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:02:33.366389+0000","last_undegraded":"2024-04-25T22:02:33.366389+0000","last_fullsized":"2024-04-25T22:02:33.366389+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764310+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:02:30.764310+0000","last_peered":"2024-04-25T22:02:30.764310+0000","last_clean":"2024-04-25T22:02:30.764310+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:02:30.764310+0000","last_undegraded":"2024-04-25T22:02:30.764310+0000","last_fullsized":"2024-04-25T22:02:30.764310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764413+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:02:30.764413+0000","last_peered":"2024-04-25T22:02:30.764413+0000","last_clean":"2024-04-25T22:02:30.764413+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:02:30.764413+0000","last_undegraded":"2024-04-25T22:02:30.764413+0000","last_fullsized":"2024-04-25T22:02:30.764413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.761724+0000","last_change":"2024-04-25T22:01:14.633477+0000","last_active":"2024-04-25T22:02:30.761724+0000","last_peered":"2024-04-25T22:02:30.761724+0000","last_clean":"2024-04-25T22:02:30.761724+0000","last_became_active":"2024-04-25T22:01:14.632678+0000","last_became_peered":"2024-04-25T22:01:14.632678+0000","last_unstale":"2024-04-25T22:02:30.761724+0000","last_undegraded":"2024-04-25T22:02:30.761724+0000","last_fullsized":"2024-04-25T22:02:30.761724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.364956+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:02:33.364956+0000","last_peered":"2024-04-25T22:02:33.364956+0000","last_clean":"2024-04-25T22:02:33.364956+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:02:33.364956+0000","last_undegraded":"2024-04-25T22:02:33.364956+0000","last_fullsized":"2024-04-25T22:02:33.364956+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.761853+0000","last_change":"2024-04-25T22:01:14.641991+0000","last_active":"2024-04-25T22:02:30.761853+0000","last_peered":"2024-04-25T22:02:30.761853+0000","last_clean":"2024-04-25T22:02:30.761853+0000","last_became_active":"2024-04-25T22:01:14.641244+0000","last_became_peered":"2024-04-25T22:01:14.641244+0000","last_unstale":"2024-04-25T22:02:30.761853+0000","last_undegraded":"2024-04-25T22:02:30.761853+0000","last_fullsized":"2024-04-25T22:02:30.761853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:03.098700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763809+0000","last_change":"2024-04-25T22:01:14.638103+0000","last_active":"2024-04-25T22:02:30.763809+0000","last_peered":"2024-04-25T22:02:30.763809+0000","last_clean":"2024-04-25T22:02:30.763809+0000","last_became_active":"2024-04-25T22:01:14.636488+0000","last_became_peered":"2024-04-25T22:01:14.636488+0000","last_unstale":"2024-04-25T22:02:30.763809+0000","last_undegraded":"2024-04-25T22:02:30.763809+0000","last_fullsized":"2024-04-25T22:02:30.763809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366644+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:02:33.366644+0000","last_peered":"2024-04-25T22:02:33.366644+0000","last_clean":"2024-04-25T22:02:33.366644+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:02:33.366644+0000","last_undegraded":"2024-04-25T22:02:33.366644+0000","last_fullsized":"2024-04-25T22:02:33.366644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765276+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:02:30.765276+0000","last_peered":"2024-04-25T22:02:30.765276+0000","last_clean":"2024-04-25T22:02:30.765276+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:02:30.765276+0000","last_undegraded":"2024-04-25T22:02:30.765276+0000","last_fullsized":"2024-04-25T22:02:30.765276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763594+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:02:30.763594+0000","last_peered":"2024-04-25T22:02:30.763594+0000","last_clean":"2024-04-25T22:02:30.763594+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:02:30.763594+0000","last_undegraded":"2024-04-25T22:02:30.763594+0000","last_fullsized":"2024-04-25T22:02:30.763594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365891+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:02:33.365891+0000","last_peered":"2024-04-25T22:02:33.365891+0000","last_clean":"2024-04-25T22:02:33.365891+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:02:33.365891+0000","last_undegraded":"2024-04-25T22:02:33.365891+0000","last_fullsized":"2024-04-25T22:02:33.365891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.761995+0000","last_change":"2024-04-25T22:01:14.638343+0000","last_active":"2024-04-25T22:02:30.761995+0000","last_peered":"2024-04-25T22:02:30.761995+0000","last_clean":"2024-04-25T22:02:30.761995+0000","last_became_active":"2024-04-25T22:01:14.637694+0000","last_became_peered":"2024-04-25T22:01:14.637694+0000","last_unstale":"2024-04-25T22:02:30.761995+0000","last_undegraded":"2024-04-25T22:02:30.761995+0000","last_fullsized":"2024-04-25T22:02:30.761995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.364997+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:02:33.364997+0000","last_peered":"2024-04-25T22:02:33.364997+0000","last_clean":"2024-04-25T22:02:33.364997+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:02:33.364997+0000","last_undegraded":"2024-04-25T22:02:33.364997+0000","last_fullsized":"2024-04-25T22:02:33.364997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763314+0000","last_change":"2024-04-25T22:01:14.648196+0000","last_active":"2024-04-25T22:02:30.763314+0000","last_peered":"2024-04-25T22:02:30.763314+0000","last_clean":"2024-04-25T22:02:30.763314+0000","last_became_active":"2024-04-25T22:01:14.647509+0000","last_became_peered":"2024-04-25T22:01:14.647509+0000","last_unstale":"2024-04-25T22:02:30.763314+0000","last_undegraded":"2024-04-25T22:02:30.763314+0000","last_fullsized":"2024-04-25T22:02:30.763314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763029+0000","last_change":"2024-04-25T22:01:14.641706+0000","last_active":"2024-04-25T22:02:30.763029+0000","last_peered":"2024-04-25T22:02:30.763029+0000","last_clean":"2024-04-25T22:02:30.763029+0000","last_became_active":"2024-04-25T22:01:14.641043+0000","last_became_peered":"2024-04-25T22:01:14.641043+0000","last_unstale":"2024-04-25T22:02:30.763029+0000","last_undegraded":"2024-04-25T22:02:30.763029+0000","last_fullsized":"2024-04-25T22:02:30.763029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764427+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:02:30.764427+0000","last_peered":"2024-04-25T22:02:30.764427+0000","last_clean":"2024-04-25T22:02:30.764427+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:02:30.764427+0000","last_undegraded":"2024-04-25T22:02:30.764427+0000","last_fullsized":"2024-04-25T22:02:30.764427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763011+0000","last_change":"2024-04-25T22:01:14.635075+0000","last_active":"2024-04-25T22:02:30.763011+0000","last_peered":"2024-04-25T22:02:30.763011+0000","last_clean":"2024-04-25T22:02:30.763011+0000","last_became_active":"2024-04-25T22:01:14.630677+0000","last_became_peered":"2024-04-25T22:01:14.630677+0000","last_unstale":"2024-04-25T22:02:30.763011+0000","last_undegraded":"2024-04-25T22:02:30.763011+0000","last_fullsized":"2024-04-25T22:02:30.763011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365642+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:02:33.365642+0000","last_peered":"2024-04-25T22:02:33.365642+0000","last_clean":"2024-04-25T22:02:33.365642+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:02:33.365642+0000","last_undegraded":"2024-04-25T22:02:33.365642+0000","last_fullsized":"2024-04-25T22:02:33.365642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366902+0000","last_change":"2024-04-25T22:01:14.648527+0000","last_active":"2024-04-25T22:02:33.366902+0000","last_peered":"2024-04-25T22:02:33.366902+0000","last_clean":"2024-04-25T22:02:33.366902+0000","last_became_active":"2024-04-25T22:01:14.645040+0000","last_became_peered":"2024-04-25T22:01:14.645040+0000","last_unstale":"2024-04-25T22:02:33.366902+0000","last_undegraded":"2024-04-25T22:02:33.366902+0000","last_fullsized":"2024-04-25T22:02:33.366902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762061+0000","last_change":"2024-04-25T22:01:13.630817+0000","last_active":"2024-04-25T22:02:30.762061+0000","last_peered":"2024-04-25T22:02:30.762061+0000","last_clean":"2024-04-25T22:02:30.762061+0000","last_became_active":"2024-04-25T22:01:13.629994+0000","last_became_peered":"2024-04-25T22:01:13.629994+0000","last_unstale":"2024-04-25T22:02:30.762061+0000","last_undegraded":"2024-04-25T22:02:30.762061+0000","last_fullsized":"2024-04-25T22:02:30.762061+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366761+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:02:33.366761+0000","last_peered":"2024-04-25T22:02:33.366761+0000","last_clean":"2024-04-25T22:02:33.366761+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:02:33.366761+0000","last_undegraded":"2024-04-25T22:02:33.366761+0000","last_fullsized":"2024-04-25T22:02:33.366761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":66,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763379+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:02:30.763379+0000","last_peered":"2024-04-25T22:02:30.763379+0000","last_clean":"2024-04-25T22:02:30.763379+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:02:30.763379+0000","last_undegraded":"2024-04-25T22:02:30.763379+0000","last_fullsized":"2024-04-25T22:02:30.763379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765722+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:02:30.765722+0000","last_peered":"2024-04-25T22:02:30.765722+0000","last_clean":"2024-04-25T22:02:30.765722+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:02:30.765722+0000","last_undegraded":"2024-04-25T22:02:30.765722+0000","last_fullsized":"2024-04-25T22:02:30.765722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.761749+0000","last_change":"2024-04-25T22:01:14.633805+0000","last_active":"2024-04-25T22:02:30.761749+0000","last_peered":"2024-04-25T22:02:30.761749+0000","last_clean":"2024-04-25T22:02:30.761749+0000","last_became_active":"2024-04-25T22:01:14.633045+0000","last_became_peered":"2024-04-25T22:01:14.633045+0000","last_unstale":"2024-04-25T22:02:30.761749+0000","last_undegraded":"2024-04-25T22:02:30.761749+0000","last_fullsized":"2024-04-25T22:02:30.761749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:43.718628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763616+0000","last_change":"2024-04-25T22:01:13.631135+0000","last_active":"2024-04-25T22:02:30.763616+0000","last_peered":"2024-04-25T22:02:30.763616+0000","last_clean":"2024-04-25T22:02:30.763616+0000","last_became_active":"2024-04-25T22:01:13.630257+0000","last_became_peered":"2024-04-25T22:01:13.630257+0000","last_unstale":"2024-04-25T22:02:30.763616+0000","last_undegraded":"2024-04-25T22:02:30.763616+0000","last_fullsized":"2024-04-25T22:02:30.763616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.761733+0000","last_change":"2024-04-25T22:01:14.630233+0000","last_active":"2024-04-25T22:02:30.761733+0000","last_peered":"2024-04-25T22:02:30.761733+0000","last_clean":"2024-04-25T22:02:30.761733+0000","last_became_active":"2024-04-25T22:01:14.629415+0000","last_became_peered":"2024-04-25T22:01:14.629415+0000","last_unstale":"2024-04-25T22:02:30.761733+0000","last_undegraded":"2024-04-25T22:02:30.761733+0000","last_fullsized":"2024-04-25T22:02:30.761733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:02:28.593163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765746+0000","last_change":"2024-04-25T22:01:13.633106+0000","last_active":"2024-04-25T22:02:30.765746+0000","last_peered":"2024-04-25T22:02:30.765746+0000","last_clean":"2024-04-25T22:02:30.765746+0000","last_became_active":"2024-04-25T22:01:13.631466+0000","last_became_peered":"2024-04-25T22:01:13.631466+0000","last_unstale":"2024-04-25T22:02:30.765746+0000","last_undegraded":"2024-04-25T22:02:30.765746+0000","last_fullsized":"2024-04-25T22:02:30.765746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:23.095422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764130+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:02:30.764130+0000","last_peered":"2024-04-25T22:02:30.764130+0000","last_clean":"2024-04-25T22:02:30.764130+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:02:30.764130+0000","last_undegraded":"2024-04-25T22:02:30.764130+0000","last_fullsized":"2024-04-25T22:02:30.764130+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765226+0000","last_change":"2024-04-25T22:01:13.626767+0000","last_active":"2024-04-25T22:02:30.765226+0000","last_peered":"2024-04-25T22:02:30.765226+0000","last_clean":"2024-04-25T22:02:30.765226+0000","last_became_active":"2024-04-25T22:01:13.625984+0000","last_became_peered":"2024-04-25T22:01:13.625984+0000","last_unstale":"2024-04-25T22:02:30.765226+0000","last_undegraded":"2024-04-25T22:02:30.765226+0000","last_fullsized":"2024-04-25T22:02:30.765226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365955+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:02:33.365955+0000","last_peered":"2024-04-25T22:02:33.365955+0000","last_clean":"2024-04-25T22:02:33.365955+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:02:33.365955+0000","last_undegraded":"2024-04-25T22:02:33.365955+0000","last_fullsized":"2024-04-25T22:02:33.365955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366629+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:02:33.366629+0000","last_peered":"2024-04-25T22:02:33.366629+0000","last_clean":"2024-04-25T22:02:33.366629+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:02:33.366629+0000","last_undegraded":"2024-04-25T22:02:33.366629+0000","last_fullsized":"2024-04-25T22:02:33.366629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764573+0000","last_change":"2024-04-25T22:01:14.650077+0000","last_active":"2024-04-25T22:02:30.764573+0000","last_peered":"2024-04-25T22:02:30.764573+0000","last_clean":"2024-04-25T22:02:30.764573+0000","last_became_active":"2024-04-25T22:01:14.649315+0000","last_became_peered":"2024-04-25T22:01:14.649315+0000","last_unstale":"2024-04-25T22:02:30.764573+0000","last_undegraded":"2024-04-25T22:02:30.764573+0000","last_fullsized":"2024-04-25T22:02:30.764573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.976715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764425+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:02:30.764425+0000","last_peered":"2024-04-25T22:02:30.764425+0000","last_clean":"2024-04-25T22:02:30.764425+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:02:30.764425+0000","last_undegraded":"2024-04-25T22:02:30.764425+0000","last_fullsized":"2024-04-25T22:02:30.764425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765521+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:02:30.765521+0000","last_peered":"2024-04-25T22:02:30.765521+0000","last_clean":"2024-04-25T22:02:30.765521+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:02:30.765521+0000","last_undegraded":"2024-04-25T22:02:30.765521+0000","last_fullsized":"2024-04-25T22:02:30.765521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762084+0000","last_change":"2024-04-25T22:01:13.631439+0000","last_active":"2024-04-25T22:02:30.762084+0000","last_peered":"2024-04-25T22:02:30.762084+0000","last_clean":"2024-04-25T22:02:30.762084+0000","last_became_active":"2024-04-25T22:01:13.630812+0000","last_became_peered":"2024-04-25T22:01:13.630812+0000","last_unstale":"2024-04-25T22:02:30.762084+0000","last_undegraded":"2024-04-25T22:02:30.762084+0000","last_fullsized":"2024-04-25T22:02:30.762084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765409+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:02:30.765409+0000","last_peered":"2024-04-25T22:02:30.765409+0000","last_clean":"2024-04-25T22:02:30.765409+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:02:30.765409+0000","last_undegraded":"2024-04-25T22:02:30.765409+0000","last_fullsized":"2024-04-25T22:02:30.765409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762027+0000","last_change":"2024-04-25T22:01:13.623342+0000","last_active":"2024-04-25T22:02:30.762027+0000","last_peered":"2024-04-25T22:02:30.762027+0000","last_clean":"2024-04-25T22:02:30.762027+0000","last_became_active":"2024-04-25T22:01:13.621460+0000","last_became_peered":"2024-04-25T22:01:13.621460+0000","last_unstale":"2024-04-25T22:02:30.762027+0000","last_undegraded":"2024-04-25T22:02:30.762027+0000","last_fullsized":"2024-04-25T22:02:30.762027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366860+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:02:33.366860+0000","last_peered":"2024-04-25T22:02:33.366860+0000","last_clean":"2024-04-25T22:02:33.366860+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:02:33.366860+0000","last_undegraded":"2024-04-25T22:02:33.366860+0000","last_fullsized":"2024-04-25T22:02:33.366860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":266,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763869+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:02:30.763869+0000","last_peered":"2024-04-25T22:02:30.763869+0000","last_clean":"2024-04-25T22:02:30.763869+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:02:30.763869+0000","last_undegraded":"2024-04-25T22:02:30.763869+0000","last_fullsized":"2024-04-25T22:02:30.763869+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764809+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:02:30.764809+0000","last_peered":"2024-04-25T22:02:30.764809+0000","last_clean":"2024-04-25T22:02:30.764809+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:02:30.764809+0000","last_undegraded":"2024-04-25T22:02:30.764809+0000","last_fullsized":"2024-04-25T22:02:30.764809+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366082+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:02:33.366082+0000","last_peered":"2024-04-25T22:02:33.366082+0000","last_clean":"2024-04-25T22:02:33.366082+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:02:33.366082+0000","last_undegraded":"2024-04-25T22:02:33.366082+0000","last_fullsized":"2024-04-25T22:02:33.366082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765537+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:02:30.765537+0000","last_peered":"2024-04-25T22:02:30.765537+0000","last_clean":"2024-04-25T22:02:30.765537+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:02:30.765537+0000","last_undegraded":"2024-04-25T22:02:30.765537+0000","last_fullsized":"2024-04-25T22:02:30.765537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763687+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:02:30.763687+0000","last_peered":"2024-04-25T22:02:30.763687+0000","last_clean":"2024-04-25T22:02:30.763687+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:02:30.763687+0000","last_undegraded":"2024-04-25T22:02:30.763687+0000","last_fullsized":"2024-04-25T22:02:30.763687+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365459+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:02:33.365459+0000","last_peered":"2024-04-25T22:02:33.365459+0000","last_clean":"2024-04-25T22:02:33.365459+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:02:33.365459+0000","last_undegraded":"2024-04-25T22:02:33.365459+0000","last_fullsized":"2024-04-25T22:02:33.365459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762959+0000","last_change":"2024-04-25T22:01:14.645176+0000","last_active":"2024-04-25T22:02:30.762959+0000","last_peered":"2024-04-25T22:02:30.762959+0000","last_clean":"2024-04-25T22:02:30.762959+0000","last_became_active":"2024-04-25T22:01:14.642395+0000","last_became_peered":"2024-04-25T22:01:14.642395+0000","last_unstale":"2024-04-25T22:02:30.762959+0000","last_undegraded":"2024-04-25T22:02:30.762959+0000","last_fullsized":"2024-04-25T22:02:30.762959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365603+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:02:33.365603+0000","last_peered":"2024-04-25T22:02:33.365603+0000","last_clean":"2024-04-25T22:02:33.365603+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:02:33.365603+0000","last_undegraded":"2024-04-25T22:02:33.365603+0000","last_fullsized":"2024-04-25T22:02:33.365603+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762094+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:02:30.762094+0000","last_peered":"2024-04-25T22:02:30.762094+0000","last_clean":"2024-04-25T22:02:30.762094+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:02:30.762094+0000","last_undegraded":"2024-04-25T22:02:30.762094+0000","last_fullsized":"2024-04-25T22:02:30.762094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366872+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:02:33.366872+0000","last_peered":"2024-04-25T22:02:33.366872+0000","last_clean":"2024-04-25T22:02:33.366872+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:02:33.366872+0000","last_undegraded":"2024-04-25T22:02:33.366872+0000","last_fullsized":"2024-04-25T22:02:33.366872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764498+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:02:30.764498+0000","last_peered":"2024-04-25T22:02:30.764498+0000","last_clean":"2024-04-25T22:02:30.764498+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:02:30.764498+0000","last_undegraded":"2024-04-25T22:02:30.764498+0000","last_fullsized":"2024-04-25T22:02:30.764498+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764691+0000","last_change":"2024-04-25T22:01:13.627274+0000","last_active":"2024-04-25T22:02:30.764691+0000","last_peered":"2024-04-25T22:02:30.764691+0000","last_clean":"2024-04-25T22:02:30.764691+0000","last_became_active":"2024-04-25T22:01:13.626015+0000","last_became_peered":"2024-04-25T22:01:13.626015+0000","last_unstale":"2024-04-25T22:02:30.764691+0000","last_undegraded":"2024-04-25T22:02:30.764691+0000","last_fullsized":"2024-04-25T22:02:30.764691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366183+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:02:33.366183+0000","last_peered":"2024-04-25T22:02:33.366183+0000","last_clean":"2024-04-25T22:02:33.366183+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:02:33.366183+0000","last_undegraded":"2024-04-25T22:02:33.366183+0000","last_fullsized":"2024-04-25T22:02:33.366183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765827+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:02:30.765827+0000","last_peered":"2024-04-25T22:02:30.765827+0000","last_clean":"2024-04-25T22:02:30.765827+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:02:30.765827+0000","last_undegraded":"2024-04-25T22:02:30.765827+0000","last_fullsized":"2024-04-25T22:02:30.765827+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366427+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:02:33.366427+0000","last_peered":"2024-04-25T22:02:33.366427+0000","last_clean":"2024-04-25T22:02:33.366427+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:02:33.366427+0000","last_undegraded":"2024-04-25T22:02:33.366427+0000","last_fullsized":"2024-04-25T22:02:33.366427+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.761789+0000","last_change":"2024-04-25T22:01:14.637520+0000","last_active":"2024-04-25T22:02:30.761789+0000","last_peered":"2024-04-25T22:02:30.761789+0000","last_clean":"2024-04-25T22:02:30.761789+0000","last_became_active":"2024-04-25T22:01:14.636765+0000","last_became_peered":"2024-04-25T22:01:14.636765+0000","last_unstale":"2024-04-25T22:02:30.761789+0000","last_undegraded":"2024-04-25T22:02:30.761789+0000","last_fullsized":"2024-04-25T22:02:30.761789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366288+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:02:33.366288+0000","last_peered":"2024-04-25T22:02:33.366288+0000","last_clean":"2024-04-25T22:02:33.366288+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:02:33.366288+0000","last_undegraded":"2024-04-25T22:02:33.366288+0000","last_fullsized":"2024-04-25T22:02:33.366288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763851+0000","last_change":"2024-04-25T22:01:09.582204+0000","last_active":"2024-04-25T22:02:30.763851+0000","last_peered":"2024-04-25T22:02:30.763851+0000","last_clean":"2024-04-25T22:02:30.763851+0000","last_became_active":"2024-04-25T22:01:09.581494+0000","last_became_peered":"2024-04-25T22:01:09.581494+0000","last_unstale":"2024-04-25T22:02:30.763851+0000","last_undegraded":"2024-04-25T22:02:30.763851+0000","last_fullsized":"2024-04-25T22:02:30.763851+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:13.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762204+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:02:30.762204+0000","last_peered":"2024-04-25T22:02:30.762204+0000","last_clean":"2024-04-25T22:02:30.762204+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:02:30.762204+0000","last_undegraded":"2024-04-25T22:02:30.762204+0000","last_fullsized":"2024-04-25T22:02:30.762204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.367075+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:02:33.367075+0000","last_peered":"2024-04-25T22:02:33.367075+0000","last_clean":"2024-04-25T22:02:33.367075+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:02:33.367075+0000","last_undegraded":"2024-04-25T22:02:33.367075+0000","last_fullsized":"2024-04-25T22:02:33.367075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.367002+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:02:33.367002+0000","last_peered":"2024-04-25T22:02:33.367002+0000","last_clean":"2024-04-25T22:02:33.367002+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:02:33.367002+0000","last_undegraded":"2024-04-25T22:02:33.367002+0000","last_fullsized":"2024-04-25T22:02:33.367002+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365672+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:02:33.365672+0000","last_peered":"2024-04-25T22:02:33.365672+0000","last_clean":"2024-04-25T22:02:33.365672+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:02:33.365672+0000","last_undegraded":"2024-04-25T22:02:33.365672+0000","last_fullsized":"2024-04-25T22:02:33.365672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":61,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366972+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:02:33.366972+0000","last_peered":"2024-04-25T22:02:33.366972+0000","last_clean":"2024-04-25T22:02:33.366972+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:02:33.366972+0000","last_undegraded":"2024-04-25T22:02:33.366972+0000","last_fullsized":"2024-04-25T22:02:33.366972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765845+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:02:30.765845+0000","last_peered":"2024-04-25T22:02:30.765845+0000","last_clean":"2024-04-25T22:02:30.765845+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:02:30.765845+0000","last_undegraded":"2024-04-25T22:02:30.765845+0000","last_fullsized":"2024-04-25T22:02:30.765845+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.761749+0000","last_change":"2024-04-25T22:01:14.632306+0000","last_active":"2024-04-25T22:02:30.761749+0000","last_peered":"2024-04-25T22:02:30.761749+0000","last_clean":"2024-04-25T22:02:30.761749+0000","last_became_active":"2024-04-25T22:01:14.631179+0000","last_became_peered":"2024-04-25T22:01:14.631179+0000","last_unstale":"2024-04-25T22:02:30.761749+0000","last_undegraded":"2024-04-25T22:02:30.761749+0000","last_fullsized":"2024-04-25T22:02:30.761749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764080+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:02:30.764080+0000","last_peered":"2024-04-25T22:02:30.764080+0000","last_clean":"2024-04-25T22:02:30.764080+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:02:30.764080+0000","last_undegraded":"2024-04-25T22:02:30.764080+0000","last_fullsized":"2024-04-25T22:02:30.764080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"23'11","reported_seq":69,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764877+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:02:30.764877+0000","last_peered":"2024-04-25T22:02:30.764877+0000","last_clean":"2024-04-25T22:02:30.764877+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:02:30.764877+0000","last_undegraded":"2024-04-25T22:02:30.764877+0000","last_fullsized":"2024-04-25T22:02:30.764877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365630+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:02:33.365630+0000","last_peered":"2024-04-25T22:02:33.365630+0000","last_clean":"2024-04-25T22:02:33.365630+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:02:33.365630+0000","last_undegraded":"2024-04-25T22:02:33.365630+0000","last_fullsized":"2024-04-25T22:02:33.365630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":61,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763626+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:02:30.763626+0000","last_peered":"2024-04-25T22:02:30.763626+0000","last_clean":"2024-04-25T22:02:30.763626+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:02:30.763626+0000","last_undegraded":"2024-04-25T22:02:30.763626+0000","last_fullsized":"2024-04-25T22:02:30.763626+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.765704+0000","last_change":"2024-04-25T22:01:13.626710+0000","last_active":"2024-04-25T22:02:30.765704+0000","last_peered":"2024-04-25T22:02:30.765704+0000","last_clean":"2024-04-25T22:02:30.765704+0000","last_became_active":"2024-04-25T22:01:13.625898+0000","last_became_peered":"2024-04-25T22:01:13.625898+0000","last_unstale":"2024-04-25T22:02:30.765704+0000","last_undegraded":"2024-04-25T22:02:30.765704+0000","last_fullsized":"2024-04-25T22:02:30.765704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365102+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:02:33.365102+0000","last_peered":"2024-04-25T22:02:33.365102+0000","last_clean":"2024-04-25T22:02:33.365102+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:02:33.365102+0000","last_undegraded":"2024-04-25T22:02:33.365102+0000","last_fullsized":"2024-04-25T22:02:33.365102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.367017+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:02:33.367017+0000","last_peered":"2024-04-25T22:02:33.367017+0000","last_clean":"2024-04-25T22:02:33.367017+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:02:33.367017+0000","last_undegraded":"2024-04-25T22:02:33.367017+0000","last_fullsized":"2024-04-25T22:02:33.367017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365421+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:02:33.365421+0000","last_peered":"2024-04-25T22:02:33.365421+0000","last_clean":"2024-04-25T22:02:33.365421+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:02:33.365421+0000","last_undegraded":"2024-04-25T22:02:33.365421+0000","last_fullsized":"2024-04-25T22:02:33.365421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763844+0000","last_change":"2024-04-25T22:01:14.639447+0000","last_active":"2024-04-25T22:02:30.763844+0000","last_peered":"2024-04-25T22:02:30.763844+0000","last_clean":"2024-04-25T22:02:30.763844+0000","last_became_active":"2024-04-25T22:01:14.638864+0000","last_became_peered":"2024-04-25T22:01:14.638864+0000","last_unstale":"2024-04-25T22:02:30.763844+0000","last_undegraded":"2024-04-25T22:02:30.763844+0000","last_fullsized":"2024-04-25T22:02:30.763844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365952+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:02:33.365952+0000","last_peered":"2024-04-25T22:02:33.365952+0000","last_clean":"2024-04-25T22:02:33.365952+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:02:33.365952+0000","last_undegraded":"2024-04-25T22:02:33.365952+0000","last_fullsized":"2024-04-25T22:02:33.365952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366531+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:02:33.366531+0000","last_peered":"2024-04-25T22:02:33.366531+0000","last_clean":"2024-04-25T22:02:33.366531+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:02:33.366531+0000","last_undegraded":"2024-04-25T22:02:33.366531+0000","last_fullsized":"2024-04-25T22:02:33.366531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.365243+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:02:33.365243+0000","last_peered":"2024-04-25T22:02:33.365243+0000","last_clean":"2024-04-25T22:02:33.365243+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:02:33.365243+0000","last_undegraded":"2024-04-25T22:02:33.365243+0000","last_fullsized":"2024-04-25T22:02:33.365243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762994+0000","last_change":"2024-04-25T22:01:14.637452+0000","last_active":"2024-04-25T22:02:30.762994+0000","last_peered":"2024-04-25T22:02:30.762994+0000","last_clean":"2024-04-25T22:02:30.762994+0000","last_became_active":"2024-04-25T22:01:14.636407+0000","last_became_peered":"2024-04-25T22:01:14.636407+0000","last_unstale":"2024-04-25T22:02:30.762994+0000","last_undegraded":"2024-04-25T22:02:30.762994+0000","last_fullsized":"2024-04-25T22:02:30.762994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762084+0000","last_change":"2024-04-25T22:01:13.621997+0000","last_active":"2024-04-25T22:02:30.762084+0000","last_peered":"2024-04-25T22:02:30.762084+0000","last_clean":"2024-04-25T22:02:30.762084+0000","last_became_active":"2024-04-25T22:01:13.620987+0000","last_became_peered":"2024-04-25T22:01:13.620987+0000","last_unstale":"2024-04-25T22:02:30.762084+0000","last_undegraded":"2024-04-25T22:02:30.762084+0000","last_fullsized":"2024-04-25T22:02:30.762084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763036+0000","last_change":"2024-04-25T22:01:14.650437+0000","last_active":"2024-04-25T22:02:30.763036+0000","last_peered":"2024-04-25T22:02:30.763036+0000","last_clean":"2024-04-25T22:02:30.763036+0000","last_became_active":"2024-04-25T22:01:14.648116+0000","last_became_peered":"2024-04-25T22:01:14.648116+0000","last_unstale":"2024-04-25T22:02:30.763036+0000","last_undegraded":"2024-04-25T22:02:30.763036+0000","last_fullsized":"2024-04-25T22:02:30.763036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762490+0000","last_change":"2024-04-25T22:01:13.631562+0000","last_active":"2024-04-25T22:02:30.762490+0000","last_peered":"2024-04-25T22:02:30.762490+0000","last_clean":"2024-04-25T22:02:30.762490+0000","last_became_active":"2024-04-25T22:01:13.630731+0000","last_became_peered":"2024-04-25T22:01:13.630731+0000","last_unstale":"2024-04-25T22:02:30.762490+0000","last_undegraded":"2024-04-25T22:02:30.762490+0000","last_fullsized":"2024-04-25T22:02:30.762490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763896+0000","last_change":"2024-04-25T22:01:14.654909+0000","last_active":"2024-04-25T22:02:30.763896+0000","last_peered":"2024-04-25T22:02:30.763896+0000","last_clean":"2024-04-25T22:02:30.763896+0000","last_became_active":"2024-04-25T22:01:14.653503+0000","last_became_peered":"2024-04-25T22:01:14.653503+0000","last_unstale":"2024-04-25T22:02:30.763896+0000","last_undegraded":"2024-04-25T22:02:30.763896+0000","last_fullsized":"2024-04-25T22:02:30.763896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764860+0000","last_change":"2024-04-25T22:01:13.628356+0000","last_active":"2024-04-25T22:02:30.764860+0000","last_peered":"2024-04-25T22:02:30.764860+0000","last_clean":"2024-04-25T22:02:30.764860+0000","last_became_active":"2024-04-25T22:01:13.626608+0000","last_became_peered":"2024-04-25T22:01:13.626608+0000","last_unstale":"2024-04-25T22:02:30.764860+0000","last_undegraded":"2024-04-25T22:02:30.764860+0000","last_fullsized":"2024-04-25T22:02:30.764860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.764288+0000","last_change":"2024-04-25T22:01:14.648752+0000","last_active":"2024-04-25T22:02:30.764288+0000","last_peered":"2024-04-25T22:02:30.764288+0000","last_clean":"2024-04-25T22:02:30.764288+0000","last_became_active":"2024-04-25T22:01:14.647463+0000","last_became_peered":"2024-04-25T22:01:14.647463+0000","last_unstale":"2024-04-25T22:02:30.764288+0000","last_undegraded":"2024-04-25T22:02:30.764288+0000","last_fullsized":"2024-04-25T22:02:30.764288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:22.946881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763430+0000","last_change":"2024-04-25T22:01:13.630502+0000","last_active":"2024-04-25T22:02:30.763430+0000","last_peered":"2024-04-25T22:02:30.763430+0000","last_clean":"2024-04-25T22:02:30.763430+0000","last_became_active":"2024-04-25T22:01:13.629854+0000","last_became_peered":"2024-04-25T22:01:13.629854+0000","last_unstale":"2024-04-25T22:02:30.763430+0000","last_undegraded":"2024-04-25T22:02:30.763430+0000","last_fullsized":"2024-04-25T22:02:30.763430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.762344+0000","last_change":"2024-04-25T22:01:14.642104+0000","last_active":"2024-04-25T22:02:30.762344+0000","last_peered":"2024-04-25T22:02:30.762344+0000","last_clean":"2024-04-25T22:02:30.762344+0000","last_became_active":"2024-04-25T22:01:14.641323+0000","last_became_peered":"2024-04-25T22:01:14.641323+0000","last_unstale":"2024-04-25T22:02:30.762344+0000","last_undegraded":"2024-04-25T22:02:30.762344+0000","last_fullsized":"2024-04-25T22:02:30.762344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366840+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:02:33.366840+0000","last_peered":"2024-04-25T22:02:33.366840+0000","last_clean":"2024-04-25T22:02:33.366840+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:02:33.366840+0000","last_undegraded":"2024-04-25T22:02:33.366840+0000","last_fullsized":"2024-04-25T22:02:33.366840+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:30.763573+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:02:30.763573+0000","last_peered":"2024-04-25T22:02:30.763573+0000","last_clean":"2024-04-25T22:02:30.763573+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:02:30.763573+0000","last_undegraded":"2024-04-25T22:02:30.763573+0000","last_fullsized":"2024-04-25T22:02:30.763573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T22:02:33.366948+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:02:33.366948+0000","last_peered":"2024-04-25T22:02:33.366948+0000","last_clean":"2024-04-25T22:02:33.366948+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:02:33.366948+0000","last_undegraded":"2024-04-25T22:02:33.366948+0000","last_fullsized":"2024-04-25T22:02:33.366948+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738392,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":421888,"data_stored":744903,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738391,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":144204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738392,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":745519,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:02:36.947 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T22:02:36.947 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:02:36.947 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-25T22:02:36.947 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-25T22:02:36.947 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-25T22:02:36.947 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-25T22:02:36.967 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:36.967 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:36.970 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:36.965+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:36.999 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:36.999 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:36.999 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:36.999 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:37.013 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:37.070 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:37.065+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:37.075 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:37.076 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "" 2024-04-25T22:02:37.076 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:37.133 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:37.133 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:37.133 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:37.133 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:37.133 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:37.148 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:37.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:37.170+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:37.273 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:37.269+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:37.322 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:37.322 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:37.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:37.322 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:37.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.322 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:37.322 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:37.322 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.323807891000001, 2024-04-25T22:02:37.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:02:37.323 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.323 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.323 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.323 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:37.323 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:37.323 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:37.323 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:02:37.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.323 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:37.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:37.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:02:37.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:02:37.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:02:37.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:02:37.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:02:37.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:02:37.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:02:37.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:02:37.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:02:37.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:02:37.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:02:37.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:02:37.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:02:37.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:02:37.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:02:37.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:02:37.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:02:37.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:02:37.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:02:37.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:02:37.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:02:37.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:02:37.328 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.328 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.328 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.328 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:37.328 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:37.328 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.141744818000006, 2024-04-25T22:02:37.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:02:37.328 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.328 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.328 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.328 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:37.329 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:37.329 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:37.329 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:02:37.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.329 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:37.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:37.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:02:37.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:02:37.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:02:37.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:02:37.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:02:37.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:02:37.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:02:37.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:02:37.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:02:37.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:02:37.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:02:37.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:02:37.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:02:37.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:02:37.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:02:37.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:02:37.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:02:37.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:02:37.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:02:37.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:02:37.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:02:37.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:02:37.333 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.333 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.333 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.334 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:37.334 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:37.334 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.141700537999995, 2024-04-25T22:02:37.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:02:37.334 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.334 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.334 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.334 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:37.334 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:37.334 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:37.334 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:02:37.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.334 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:37.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:37.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:02:37.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:02:37.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:02:37.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:02:37.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:02:37.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:02:37.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:02:37.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:02:37.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:02:37.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:02:37.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:02:37.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:02:37.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:02:37.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:02:37.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:02:37.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:02:37.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:02:37.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:02:37.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:02:37.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:02:37.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:02:37.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:02:37.339 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.339 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.339 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.339 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:37.339 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:37.339 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.141644013000004, 2024-04-25T22:02:37.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:37.340 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.340 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.340 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.340 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:37.340 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:37.340 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:37.340 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:37.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.340 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:37.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:37.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:37.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:37.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:37.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:37.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:37.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:37.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:37.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:37.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:37.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:37.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:37.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:37.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:37.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:37.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:37.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:37.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:37.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:37.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:37.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:37.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:37.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:37.345 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.345 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.345 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.345 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:37.345 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:37.345 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.141448771, 2024-04-25T22:02:37.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:37.345 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.345 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.345 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.345 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:37.346 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:37.346 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:37.346 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:37.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.346 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:37.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:37.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:37.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:37.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:37.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:37.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:37.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:37.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:37.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:37.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:37.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:37.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:37.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:37.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:37.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:37.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:37.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:37.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:37.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:37.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:37.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:37.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:37.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:37.350 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.350 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.350 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.350 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:37.350 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:37.351 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.141386478000001, 2024-04-25T22:02:37.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:37.351 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.351 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.351 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.351 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:37.351 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:37.351 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:37.351 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:37.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.351 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:37.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:37.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:37.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:37.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:37.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:37.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:37.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:37.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:37.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:37.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:37.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:37.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:37.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:37.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:37.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:37.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:37.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:37.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:37.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:37.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:37.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:37.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:37.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:37.355 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.355 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.356 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.356 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:37.356 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:37.356 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.141326262000007, 2024-04-25T22:02:37.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:37.356 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.356 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.356 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.356 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:37.356 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:37.356 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:37.356 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:37.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.356 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:37.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:37.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:37.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:37.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:37.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:37.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:37.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:37.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:37.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:37.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:37.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:37.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:37.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:37.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:37.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:37.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:37.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:37.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:37.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:37.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:37.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:37.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:37.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:37.361 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.361 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.361 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.361 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:37.361 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:37.361 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.141136750000001, 2024-04-25T22:02:37.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:37.361 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.361 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.361 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.362 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:37.362 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:37.362 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:37.362 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:37.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.362 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:37.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:37.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:37.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:37.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:37.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:37.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:37.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:37.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:37.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:37.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:37.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:37.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:37.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:37.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:37.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:37.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:37.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:37.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:37.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:37.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:37.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:37.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:37.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:37.366 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.366 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.367 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.367 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:37.367 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:37.367 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 90.949798916000006, 2024-04-25T22:02:37.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:02:37.367 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.367 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.367 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.367 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:37.367 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:37.367 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:37.367 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:02:37.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.367 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:37.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:37.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:02:37.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:02:37.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:02:37.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:02:37.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:02:37.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:02:37.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:02:37.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:02:37.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:02:37.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:02:37.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:02:37.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:02:37.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:02:37.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:02:37.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:02:37.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:02:37.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:02:37.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:02:37.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:02:37.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:02:37.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:02:37.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:02:37.372 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.372 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.372 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.372 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:37.372 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:37.372 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 90.949760538999996, 2024-04-25T22:02:37.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:02:37.372 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.372 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.372 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.373 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:37.373 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:37.373 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:37.373 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:02:37.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.373 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:37.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:37.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:02:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:02:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:02:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:02:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:02:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:02:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:02:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:02:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:02:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:02:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:02:37.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:02:37.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:02:37.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:02:37.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:02:37.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:02:37.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:02:37.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:02:37.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:02:37.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:02:37.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:02:37.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:02:37.377 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.377 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.377 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.378 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:37.378 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:37.378 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 90.949709279999993, 2024-04-25T22:02:37.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:02:37.378 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.378 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.378 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.378 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:37.378 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:37.378 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:37.378 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:02:37.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.378 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:37.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:37.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:02:37.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:02:37.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:02:37.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:02:37.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:02:37.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:02:37.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:02:37.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:02:37.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:02:37.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:02:37.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:02:37.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:02:37.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:02:37.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:02:37.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:02:37.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:02:37.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:02:37.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:02:37.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:02:37.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:02:37.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:02:37.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:02:37.383 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.383 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.383 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.383 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:37.383 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:37.383 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 90.949560630999997, 2024-04-25T22:02:37.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:02:37.383 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.383 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.384 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.384 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:37.384 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:37.384 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:37.384 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:02:37.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.384 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:37.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:37.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:02:37.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:02:37.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:02:37.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:02:37.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:02:37.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:02:37.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:02:37.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:02:37.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:02:37.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:02:37.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:02:37.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:02:37.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:02:37.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:02:37.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:02:37.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:02:37.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:02:37.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:02:37.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:02:37.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:02:37.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:02:37.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:02:37.388 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.388 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.388 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.389 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:37.389 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:37.389 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 90.949518480999998, 2024-04-25T22:02:37.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:02:37.389 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.389 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.389 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.389 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:37.389 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:37.389 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:37.389 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:02:37.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.389 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:37.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:37.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:02:37.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:02:37.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:02:37.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:02:37.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:02:37.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:02:37.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:02:37.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:02:37.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:02:37.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:02:37.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:02:37.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:02:37.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:02:37.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:02:37.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:02:37.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:02:37.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:02:37.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:02:37.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:02:37.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:02:37.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:02:37.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:02:37.394 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.394 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.394 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.394 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:37.394 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:37.394 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 90.949480628000003, 2024-04-25T22:02:37.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:37.394 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.394 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.394 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.395 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:37.395 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:37.395 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:37.395 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:37.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.395 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:37.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:37.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:37.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:37.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:37.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:37.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:37.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:37.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:37.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:37.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:37.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:37.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:37.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:37.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:37.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:37.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:37.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:37.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:37.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:37.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:37.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:37.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:37.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:37.399 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.399 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.399 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.400 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:37.400 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:37.400 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 90.949271303000003, 2024-04-25T22:02:37.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:37.400 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.400 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.400 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.400 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:37.400 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:37.400 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:37.400 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:37.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.400 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:37.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:37.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:37.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:37.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:37.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:37.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:37.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:37.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:37.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:37.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:37.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:37.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:37.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:37.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:37.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:37.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:37.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:37.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:37.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:37.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:37.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.683020030999998, 2024-04-25T22:02:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:02:37.405 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.406 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.406 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.406 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:37.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:37.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:02:37.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:37.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:02:37.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:02:37.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:02:37.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:02:37.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:02:37.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:02:37.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:02:37.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:02:37.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:02:37.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:02:37.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:02:37.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:02:37.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:02:37.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:02:37.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:02:37.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:02:37.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:02:37.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:02:37.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:02:37.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:02:37.410 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.410 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.410 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.410 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:37.410 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:37.410 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.682986190999998, 2024-04-25T22:02:37.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:02:37.410 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.411 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.411 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.411 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:37.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:37.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:37.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:02:37.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:02:37.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:02:37.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:02:37.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:02:37.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:02:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:02:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:02:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:02:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:02:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:02:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:02:37.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:02:37.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:02:37.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:02:37.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:37.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:02:37.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:02:37.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:02:37.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:02:37.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:02:37.415 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.415 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.415 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.415 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:37.415 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:37.416 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.682934494999998, 2024-04-25T22:02:37.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:02:37.416 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.416 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.416 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.416 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:37.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:37.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:02:37.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:02:37.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:02:37.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:02:37.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:02:37.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:02:37.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:02:37.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:02:37.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:02:37.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:02:37.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:02:37.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:02:37.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:02:37.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:02:37.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:02:37.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:02:37.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:02:37.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:02:37.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:02:37.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:02:37.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:02:37.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:02:37.420 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.420 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.420 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.421 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:37.421 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:37.421 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.682790042999997, 2024-04-25T22:02:37.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:02:37.421 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.421 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.421 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.421 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:37.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:37.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:02:37.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:02:37.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:02:37.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:02:37.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:02:37.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:02:37.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:02:37.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:02:37.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:02:37.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:02:37.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:02:37.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:02:37.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:02:37.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:02:37.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:02:37.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:02:37.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:02:37.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:02:37.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:02:37.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:02:37.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:02:37.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:02:37.425 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.425 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.425 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.426 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:37.426 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:37.426 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.682733322999994, 2024-04-25T22:02:37.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:02:37.426 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:37.426 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:37.426 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.426 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:37.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:37.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:37.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:37.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:37.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:37.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:37.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:02:37.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:02:37.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:37.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:02:37.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:02:37.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:37.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:02:37.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:02:37.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:02:37.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:02:37.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:37.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:02:37.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:02:37.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:37.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:02:37.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:02:37.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:02:37.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:02:37.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:37.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:02:37.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:02:37.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:02:37.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:02:37.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:37.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:02:37.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:02:37.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:37.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:37.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:37.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:02:37.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:02:37.431 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.431 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.431 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.431 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:37.431 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:37.431 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:37.432 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:37.433 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:37.429+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:37.533 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:37.529+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:37.561 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:37.561 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:37.561 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:02:37.562 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:37.575 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:37.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:37.630+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:37.695 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:37.695 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:37.695 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:02:37.695 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:02:37.696 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:37.708 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:37.735 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:37.733+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:37.836 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:37.833+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:37.862 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:37.862 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:02:37.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:02:37.862 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:02:37.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.863 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 4 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:27 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:02:37.863 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:37.863 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.223110489999996, 2024-04-25T22:02:37.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013281644, 2024-04-25T22:02:37.863 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.863 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.863 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:37.863 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:37.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:37.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637801+0000", 2024-04-25T22:02:37.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1299999999999998e-07 2024-04-25T22:02:37.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637828+0000", 2024-04-25T22:02:37.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6953000000000001e-05 2024-04-25T22:02:37.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637873+0000", 2024-04-25T22:02:37.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4676999999999999e-05 2024-04-25T22:02:37.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637917+0000", 2024-04-25T22:02:37.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4815999999999999e-05 2024-04-25T22:02:37.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644220+0000", 2024-04-25T22:02:37.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063021049999999997 2024-04-25T22:02:37.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651082+0000", 2024-04-25T22:02:37.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068621799999999998 2024-04-25T22:02:37.866 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.866 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.866 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.866 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:15 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:37.866 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:37.866 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.217702877999997, 2024-04-25T22:02:37.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010973732, 2024-04-25T22:02:37.867 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.867 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.867 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.867 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:37.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:37.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643209+0000", 2024-04-25T22:02:37.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.003e-06 2024-04-25T22:02:37.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643230+0000", 2024-04-25T22:02:37.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0815999999999999e-05 2024-04-25T22:02:37.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643252+0000", 2024-04-25T22:02:37.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2586999999999999e-05 2024-04-25T22:02:37.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643271+0000", 2024-04-25T22:02:37.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8493000000000001e-05 2024-04-25T22:02:37.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644387+0000", 2024-04-25T22:02:37.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011160250000000001 2024-04-25T22:02:37.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:37.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644434+0000", 2024-04-25T22:02:37.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:02:37.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:37.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654103+0000", 2024-04-25T22:02:37.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096691360000000001 2024-04-25T22:02:37.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654181+0000", 2024-04-25T22:02:37.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8546000000000003e-05 2024-04-25T22:02:37.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.870 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.871 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:37.871 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:37.871 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.217602522000007, 2024-04-25T22:02:37.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088132450000000008, 2024-04-25T22:02:37.871 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.871 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.871 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.871 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:37.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:37.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643309+0000", 2024-04-25T22:02:37.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9600000000000008e-07 2024-04-25T22:02:37.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643339+0000", 2024-04-25T22:02:37.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9467000000000001e-05 2024-04-25T22:02:37.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644245+0000", 2024-04-25T22:02:37.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090648200000000001 2024-04-25T22:02:37.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644268+0000", 2024-04-25T22:02:37.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3017e-05 2024-04-25T22:02:37.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647517+0000", 2024-04-25T22:02:37.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032491680000000002 2024-04-25T22:02:37.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:37.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647561+0000", 2024-04-25T22:02:37.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3630000000000001e-05 2024-04-25T22:02:37.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:37.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652041+0000", 2024-04-25T22:02:37.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044804529999999997 2024-04-25T22:02:37.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652121+0000", 2024-04-25T22:02:37.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0031999999999995e-05 2024-04-25T22:02:37.874 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.875 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.875 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.875 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:34 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:37.878 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:37.878 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.215513895000001, 2024-04-25T22:02:37.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089225940000000007, 2024-04-25T22:02:37.878 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.878 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.878 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.878 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:37.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:37.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645398+0000", 2024-04-25T22:02:37.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4360000000000001e-06 2024-04-25T22:02:37.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645412+0000", 2024-04-25T22:02:37.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4283e-05 2024-04-25T22:02:37.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645434+0000", 2024-04-25T22:02:37.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1237e-05 2024-04-25T22:02:37.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645459+0000", 2024-04-25T22:02:37.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5675999999999999e-05 2024-04-25T22:02:37.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646081+0000", 2024-04-25T22:02:37.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062128900000000002 2024-04-25T22:02:37.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:37.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646131+0000", 2024-04-25T22:02:37.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0322999999999999e-05 2024-04-25T22:02:37.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:37.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654185+0000", 2024-04-25T22:02:37.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080542749999999996 2024-04-25T22:02:37.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654319+0000", 2024-04-25T22:02:37.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013407499999999999 2024-04-25T22:02:37.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.882 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.882 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:19 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:37.882 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:37.882 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.215412385999997, 2024-04-25T22:02:37.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076631340000000003, 2024-04-25T22:02:37.882 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.882 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.882 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.882 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:37.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:37.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645499+0000", 2024-04-25T22:02:37.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4300000000000001e-07 2024-04-25T22:02:37.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645509+0000", 2024-04-25T22:02:37.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0244000000000001e-05 2024-04-25T22:02:37.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645523+0000", 2024-04-25T22:02:37.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3315999999999999e-05 2024-04-25T22:02:37.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645531+0000", 2024-04-25T22:02:37.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.123e-06 2024-04-25T22:02:37.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648260+0000", 2024-04-25T22:02:37.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027289789999999999 2024-04-25T22:02:37.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:37.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648307+0000", 2024-04-25T22:02:37.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6969999999999999e-05 2024-04-25T22:02:37.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:37.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653039+0000", 2024-04-25T22:02:37.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047322299999999996 2024-04-25T22:02:37.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653161+0000", 2024-04-25T22:02:37.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012232899999999999 2024-04-25T22:02:37.886 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.886 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.886 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.886 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:37.886 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:37.887 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.213434724999999, 2024-04-25T22:02:37.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01271303, 2024-04-25T22:02:37.887 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.887 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.887 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.887 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:37.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:37.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647479+0000", 2024-04-25T22:02:37.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.286e-06 2024-04-25T22:02:37.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647494+0000", 2024-04-25T22:02:37.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.521e-05 2024-04-25T22:02:37.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647525+0000", 2024-04-25T22:02:37.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0403999999999999e-05 2024-04-25T22:02:37.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647544+0000", 2024-04-25T22:02:37.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8743e-05 2024-04-25T22:02:37.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647895+0000", 2024-04-25T22:02:37.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035099699999999997 2024-04-25T22:02:37.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:37.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648202+0000", 2024-04-25T22:02:37.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030758499999999998 2024-04-25T22:02:37.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:37.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648496+0000", 2024-04-25T22:02:37.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029370699999999999 2024-04-25T22:02:37.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:37.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654605+0000", 2024-04-25T22:02:37.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061095999999999998 2024-04-25T22:02:37.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.659959+0000", 2024-04-25T22:02:37.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053531680000000002 2024-04-25T22:02:37.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:37.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660078+0000", 2024-04-25T22:02:37.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011981600000000001 2024-04-25T22:02:37.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660189+0000", 2024-04-25T22:02:37.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011051400000000001 2024-04-25T22:02:37.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.891 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.892 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:37.892 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:37.892 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.213310633000006, 2024-04-25T22:02:37.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013053006000000001, 2024-04-25T22:02:37.892 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.892 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.892 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.892 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:37.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:37.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647602+0000", 2024-04-25T22:02:37.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.604e-06 2024-04-25T22:02:37.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647611+0000", 2024-04-25T22:02:37.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5689999999999994e-06 2024-04-25T22:02:37.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647634+0000", 2024-04-25T22:02:37.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3227e-05 2024-04-25T22:02:37.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647660+0000", 2024-04-25T22:02:37.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5829999999999998e-05 2024-04-25T22:02:37.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649544+0000", 2024-04-25T22:02:37.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001884066 2024-04-25T22:02:37.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:37.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649783+0000", 2024-04-25T22:02:37.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238411 2024-04-25T22:02:37.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:37.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.650794+0000", 2024-04-25T22:02:37.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010109920000000001 2024-04-25T22:02:37.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:37.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654714+0000", 2024-04-25T22:02:37.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039202170000000001 2024-04-25T22:02:37.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660403+0000", 2024-04-25T22:02:37.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056895940000000001 2024-04-25T22:02:37.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:37.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660551+0000", 2024-04-25T22:02:37.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014717899999999999 2024-04-25T22:02:37.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660653+0000", 2024-04-25T22:02:37.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102317 2024-04-25T22:02:37.897 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.897 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.897 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.897 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:17 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:37.897 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:37.897 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.213226453000004, 2024-04-25T22:02:37.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010101435000000001, 2024-04-25T22:02:37.897 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.897 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.897 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.897 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:37.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:37.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647686+0000", 2024-04-25T22:02:37.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-04-25T22:02:37.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647693+0000", 2024-04-25T22:02:37.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7330000000000003e-06 2024-04-25T22:02:37.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647711+0000", 2024-04-25T22:02:37.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7436e-05 2024-04-25T22:02:37.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647727+0000", 2024-04-25T22:02:37.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6232999999999999e-05 2024-04-25T22:02:37.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649249+0000", 2024-04-25T22:02:37.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015219890000000001 2024-04-25T22:02:37.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:37.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649533+0000", 2024-04-25T22:02:37.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028391799999999997 2024-04-25T22:02:37.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649841+0000", 2024-04-25T22:02:37.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030853400000000001 2024-04-25T22:02:37.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:37.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654622+0000", 2024-04-25T22:02:37.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047809630000000001 2024-04-25T22:02:37.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657616+0000", 2024-04-25T22:02:37.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029938769999999998 2024-04-25T22:02:37.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:37.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657724+0000", 2024-04-25T22:02:37.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108109 2024-04-25T22:02:37.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657786+0000", 2024-04-25T22:02:37.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1196000000000002e-05 2024-04-25T22:02:37.902 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.902 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.902 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.902 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:37.902 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:37.902 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.213038124999997, 2024-04-25T22:02:37.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010260877999999999, 2024-04-25T22:02:37.902 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.903 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.903 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.903 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:37.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:37.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647874+0000", 2024-04-25T22:02:37.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:02:37.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647884+0000", 2024-04-25T22:02:37.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.013e-05 2024-04-25T22:02:37.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647908+0000", 2024-04-25T22:02:37.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3592999999999999e-05 2024-04-25T22:02:37.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647926+0000", 2024-04-25T22:02:37.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8176999999999999e-05 2024-04-25T22:02:37.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651480+0000", 2024-04-25T22:02:37.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035540160000000001 2024-04-25T22:02:37.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:37.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651690+0000", 2024-04-25T22:02:37.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210249 2024-04-25T22:02:37.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:37.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651986+0000", 2024-04-25T22:02:37.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000296001 2024-04-25T22:02:37.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:37.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655696+0000", 2024-04-25T22:02:37.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037098410000000002 2024-04-25T22:02:37.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657896+0000", 2024-04-25T22:02:37.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022004630000000002 2024-04-25T22:02:37.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:37.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658035+0000", 2024-04-25T22:02:37.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013831499999999999 2024-04-25T22:02:37.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658133+0000", 2024-04-25T22:02:37.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8553000000000003e-05 2024-04-25T22:02:37.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.907 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.907 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:18 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:37.907 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:37.908 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.212959244999993, 2024-04-25T22:02:37.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013108712, 2024-04-25T22:02:37.908 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.908 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.908 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.908 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:37.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:37.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647953+0000", 2024-04-25T22:02:37.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.697e-06 2024-04-25T22:02:37.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647963+0000", 2024-04-25T22:02:37.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9259999999999995e-06 2024-04-25T22:02:37.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647982+0000", 2024-04-25T22:02:37.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-04-25T22:02:37.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648008+0000", 2024-04-25T22:02:37.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5956e-05 2024-04-25T22:02:37.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651686+0000", 2024-04-25T22:02:37.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678073 2024-04-25T22:02:37.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:37.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652023+0000", 2024-04-25T22:02:37.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033739399999999998 2024-04-25T22:02:37.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:37.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652348+0000", 2024-04-25T22:02:37.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032475000000000001 2024-04-25T22:02:37.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:37.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655883+0000", 2024-04-25T22:02:37.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035353030000000001 2024-04-25T22:02:37.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660791+0000", 2024-04-25T22:02:37.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049075330000000004 2024-04-25T22:02:37.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:37.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660930+0000", 2024-04-25T22:02:37.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000139856 2024-04-25T22:02:37.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661060+0000", 2024-04-25T22:02:37.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000129651 2024-04-25T22:02:37.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.913 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.913 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:37.913 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:37.913 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.212882352999998, 2024-04-25T22:02:37.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012451034, 2024-04-25T22:02:37.913 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.913 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.913 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.913 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:37.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:37.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648030+0000", 2024-04-25T22:02:37.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-04-25T22:02:37.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648036+0000", 2024-04-25T22:02:37.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8059999999999997e-06 2024-04-25T22:02:37.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648054+0000", 2024-04-25T22:02:37.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7744000000000002e-05 2024-04-25T22:02:37.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648070+0000", 2024-04-25T22:02:37.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-04-25T22:02:37.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648875+0000", 2024-04-25T22:02:37.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080444000000000002 2024-04-25T22:02:37.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:37.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649078+0000", 2024-04-25T22:02:37.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020391499999999999 2024-04-25T22:02:37.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:37.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649674+0000", 2024-04-25T22:02:37.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00059555299999999997 2024-04-25T22:02:37.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:37.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653185+0000", 2024-04-25T22:02:37.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035113459999999998 2024-04-25T22:02:37.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660251+0000", 2024-04-25T22:02:37.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070661350000000003 2024-04-25T22:02:37.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:37.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660382+0000", 2024-04-25T22:02:37.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013095899999999999 2024-04-25T22:02:37.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660479+0000", 2024-04-25T22:02:37.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6852e-05 2024-04-25T22:02:37.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.918 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.918 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:25 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:37.918 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:37.919 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.212816540000006, 2024-04-25T22:02:37.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012691025999999999, 2024-04-25T22:02:37.919 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.919 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.919 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:37.919 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:37.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:37.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648095+0000", 2024-04-25T22:02:37.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.424e-06 2024-04-25T22:02:37.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648102+0000", 2024-04-25T22:02:37.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2099999999999998e-06 2024-04-25T22:02:37.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648122+0000", 2024-04-25T22:02:37.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0242999999999999e-05 2024-04-25T22:02:37.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648138+0000", 2024-04-25T22:02:37.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6192999999999999e-05 2024-04-25T22:02:37.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651461+0000", 2024-04-25T22:02:37.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033225709999999999 2024-04-25T22:02:37.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:37.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651776+0000", 2024-04-25T22:02:37.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031567500000000002 2024-04-25T22:02:37.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660785+0000", 2024-04-25T22:02:37.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090087099999999996 2024-04-25T22:02:37.922 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.922 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.922 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.922 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:37.922 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:37.922 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.212754054000001, 2024-04-25T22:02:37.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013102702000000001, 2024-04-25T22:02:37.923 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.923 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.923 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:37.923 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:37.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:37.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648158+0000", 2024-04-25T22:02:37.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2839999999999999e-06 2024-04-25T22:02:37.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648163+0000", 2024-04-25T22:02:37.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-04-25T22:02:37.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648181+0000", 2024-04-25T22:02:37.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8484000000000001e-05 2024-04-25T22:02:37.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648196+0000", 2024-04-25T22:02:37.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4496e-05 2024-04-25T22:02:37.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653737+0000", 2024-04-25T22:02:37.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055414009999999996 2024-04-25T22:02:37.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:37.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653972+0000", 2024-04-25T22:02:37.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000234732 2024-04-25T22:02:37.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661259+0000", 2024-04-25T22:02:37.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072872689999999999 2024-04-25T22:02:37.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.926 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.926 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:37.926 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:37.926 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.212697234000004, 2024-04-25T22:02:37.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086984829999999999, 2024-04-25T22:02:37.926 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.926 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648214+0000", 2024-04-25T22:02:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-04-25T22:02:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648233+0000", 2024-04-25T22:02:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.878e-05 2024-04-25T22:02:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648252+0000", 2024-04-25T22:02:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8603000000000001e-05 2024-04-25T22:02:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648267+0000", 2024-04-25T22:02:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:02:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648846+0000", 2024-04-25T22:02:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057923000000000002 2024-04-25T22:02:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649027+0000", 2024-04-25T22:02:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181585 2024-04-25T22:02:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.656912+0000", 2024-04-25T22:02:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078844589999999999 2024-04-25T22:02:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 6 lcod 17'2)", 2024-04-25T22:02:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.200767318000004, 2024-04-25T22:02:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064966000000000004, 2024-04-25T22:02:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660144+0000", 2024-04-25T22:02:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1800000000000005e-07 2024-04-25T22:02:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660181+0000", 2024-04-25T22:02:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6408000000000001e-05 2024-04-25T22:02:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660197+0000", 2024-04-25T22:02:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6177000000000001e-05 2024-04-25T22:02:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660210+0000", 2024-04-25T22:02:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:02:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660556+0000", 2024-04-25T22:02:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034612899999999998 2024-04-25T22:02:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660793+0000", 2024-04-25T22:02:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023656799999999999 2024-04-25T22:02:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:18 3.1f e17/15 ondisk, result = 0)", 2024-04-25T22:02:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.200505544999999, 2024-04-25T22:02:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067878299999999997, 2024-04-25T22:02:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660406+0000", 2024-04-25T22:02:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2800000000000005e-07 2024-04-25T22:02:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660412+0000", 2024-04-25T22:02:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0399999999999998e-06 2024-04-25T22:02:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660429+0000", 2024-04-25T22:02:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7394e-05 2024-04-25T22:02:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660445+0000", 2024-04-25T22:02:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6069000000000001e-05 2024-04-25T22:02:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660757+0000", 2024-04-25T22:02:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031194300000000002 2024-04-25T22:02:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660776+0000", 2024-04-25T22:02:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8862999999999999e-05 2024-04-25T22:02:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661084+0000", 2024-04-25T22:02:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030754600000000001 2024-04-25T22:02:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-25T22:02:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.200441316999999, 2024-04-25T22:02:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080007600000000004, 2024-04-25T22:02:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660470+0000", 2024-04-25T22:02:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4499999999999996e-07 2024-04-25T22:02:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660475+0000", 2024-04-25T22:02:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-04-25T22:02:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660490+0000", 2024-04-25T22:02:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5274e-05 2024-04-25T22:02:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660501+0000", 2024-04-25T22:02:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0694e-05 2024-04-25T22:02:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661130+0000", 2024-04-25T22:02:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062887499999999999 2024-04-25T22:02:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661269+0000", 2024-04-25T22:02:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013955900000000001 2024-04-25T22:02:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:02:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 81.236709317999996, 2024-04-25T22:02:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037104880000000001, 2024-04-25T22:02:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624204+0000", 2024-04-25T22:02:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.757e-06 2024-04-25T22:02:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624233+0000", 2024-04-25T22:02:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9362000000000001e-05 2024-04-25T22:02:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624264+0000", 2024-04-25T22:02:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0843000000000003e-05 2024-04-25T22:02:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624280+0000", 2024-04-25T22:02:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5577e-05 2024-04-25T22:02:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624458+0000", 2024-04-25T22:02:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017821199999999999 2024-04-25T22:02:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624661+0000", 2024-04-25T22:02:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020283200000000001 2024-04-25T22:02:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624842+0000", 2024-04-25T22:02:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018115500000000001 2024-04-25T22:02:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.626271+0000", 2024-04-25T22:02:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001429416 2024-04-25T22:02:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627749+0000", 2024-04-25T22:02:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014778650000000001 2024-04-25T22:02:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627849+0000", 2024-04-25T22:02:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9261999999999999e-05 2024-04-25T22:02:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627912+0000", 2024-04-25T22:02:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3207000000000007e-05 2024-04-25T22:02:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-25T22:02:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.234011967000001, 2024-04-25T22:02:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029804620000000001, 2024-04-25T22:02:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626903+0000", 2024-04-25T22:02:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0029999999999996e-06 2024-04-25T22:02:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626921+0000", 2024-04-25T22:02:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8272999999999999e-05 2024-04-25T22:02:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626959+0000", 2024-04-25T22:02:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7843999999999999e-05 2024-04-25T22:02:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626977+0000", 2024-04-25T22:02:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7756000000000001e-05 2024-04-25T22:02:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627153+0000", 2024-04-25T22:02:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017643800000000001 2024-04-25T22:02:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627425+0000", 2024-04-25T22:02:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027207300000000001 2024-04-25T22:02:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627848+0000", 2024-04-25T22:02:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042297199999999997 2024-04-25T22:02:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629590+0000", 2024-04-25T22:02:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017416809999999999 2024-04-25T22:02:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629720+0000", 2024-04-25T22:02:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130526 2024-04-25T22:02:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629808+0000", 2024-04-25T22:02:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7449999999999998e-05 2024-04-25T22:02:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629879+0000", 2024-04-25T22:02:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1445999999999993e-05 2024-04-25T22:02:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4185.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-04-25T22:02:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 40.245903896999998, 2024-04-25T22:02:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0036257939999999999, 2024-04-25T22:02:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4185", 2024-04-25T22:02:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.44:0/2048337248", 2024-04-25T22:02:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2 2024-04-25T22:02:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615010+0000", 2024-04-25T22:02:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8059999999999999e-06 2024-04-25T22:02:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615023+0000", 2024-04-25T22:02:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3159999999999999e-05 2024-04-25T22:02:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615043+0000", 2024-04-25T22:02:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:02:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615059+0000", 2024-04-25T22:02:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5519000000000002e-05 2024-04-25T22:02:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615241+0000", 2024-04-25T22:02:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018207100000000001 2024-04-25T22:02:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:02:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615258+0000", 2024-04-25T22:02:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7278999999999998e-05 2024-04-25T22:02:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618429+0000", 2024-04-25T22:02:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003171213 2024-04-25T22:02:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618633+0000", 2024-04-25T22:02:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020343999999999999 2024-04-25T22:02:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:37.954 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:37.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:37.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:37.954+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:38.057 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:38.054+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:38.087 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:38.087 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:38.088 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:02:38.088 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:38.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:38.158 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:38.157+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:38.222 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:38.223 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:38.223 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:02:38.223 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:02:38.223 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:38.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:38.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:38.254+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:38.358 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:38.358 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:38.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:38.358 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:38.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.358 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:38.358 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:38.358 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.528781292000005, 2024-04-25T22:02:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.528050473999997, 2024-04-25T22:02:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.363 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.527384202999997, 2024-04-25T22:02:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:38.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:38.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.526484303000004, 2024-04-25T22:02:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:38.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:38.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.374 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.524447961999996, 2024-04-25T22:02:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.379 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:38.379 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:38.379 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.523984624999997, 2024-04-25T22:02:38.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:38.379 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.379 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.379 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:38.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:38.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:38.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:38.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:38.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:38.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:38.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:38.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:38.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:38.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:38.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:38.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:38.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:38.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:38.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:38.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:38.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:38.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:38.382 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.382 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.382 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.383 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:38.383 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:38.383 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.523117745999997, 2024-04-25T22:02:38.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:38.383 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.383 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.383 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.383 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:38.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:38.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:38.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:38.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:38.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:38.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:38.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:38.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:38.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:38.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:38.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:38.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:38.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:38.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:38.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:38.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:38.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:38.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:38.387 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.387 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.387 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.387 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:38.387 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:38.387 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.522666672, 2024-04-25T22:02:38.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:38.387 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.387 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.387 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.388 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:38.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:38.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:38.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:38.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:38.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:38.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:38.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:38.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:38.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:38.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:38.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:38.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:38.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:38.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:38.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:38.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:38.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:38.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:38.391 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.391 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.391 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.391 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:38.391 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:38.391 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.522217085999998, 2024-04-25T22:02:38.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:38.391 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.392 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.392 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.392 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:38.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:38.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:38.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:38.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:38.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:38.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:38.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:38.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:38.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:38.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:38.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:38.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:38.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:38.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:38.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:38.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:38.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:38.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:38.395 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.395 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.396 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.396 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:38.396 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:38.396 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.725560599000005, 2024-04-25T22:02:38.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:38.396 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.396 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.396 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.396 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:38.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:38.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:38.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:38.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:38.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:38.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:38.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:38.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:38.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:38.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:38.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:38.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:38.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:38.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:38.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:38.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:38.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:38.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:38.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:38.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:38.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:38.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:38.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:38.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:38.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:38.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:38.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:38.400 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.401 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.401 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.401 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:38.401 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:38.401 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.725436615999996, 2024-04-25T22:02:38.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:38.401 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.401 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.401 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.401 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:38.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:38.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:38.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:38.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:38.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:38.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:38.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:38.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:38.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:38.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:38.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:38.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:38.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:38.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:38.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:38.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:38.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:38.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:38.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:38.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:38.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:38.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:38.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:38.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:38.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:38.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:38.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:38.405 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.405 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.405 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.405 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:38.406 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:38.406 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.725362680000003, 2024-04-25T22:02:38.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:38.406 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.406 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.406 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:38.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:38.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:38.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:38.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:38.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:38.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:38.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:38.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:38.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:38.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:38.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:38.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:38.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:38.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:38.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:38.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:38.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:38.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:38.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:38.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:38.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:38.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:38.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:38.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:38.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:38.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:38.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:38.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.410 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.411 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:38.411 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:38.411 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.725246428000005, 2024-04-25T22:02:38.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:38.411 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.411 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.411 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:38.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:38.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:38.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:38.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:38.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:38.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:38.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:38.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:38.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:38.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:38.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:38.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:38.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:38.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:38.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:38.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:38.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:38.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:38.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:38.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:38.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:38.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:38.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:38.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:38.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:38.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:38.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:38.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.415 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:38.416 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:38.416 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.725083018999996, 2024-04-25T22:02:38.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:38.416 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.416 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.416 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.416 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:38.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:38.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:38.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:38.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:38.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:38.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:38.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:38.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:38.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:38.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:38.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:38.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:38.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:38.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:38.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:38.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:38.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:38.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:38.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:38.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:38.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:38.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:38.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:38.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:38.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:38.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:38.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:38.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.421 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.422 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.422 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:38.422 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:38.422 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.724980822999996, 2024-04-25T22:02:38.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:38.422 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.422 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.422 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.422 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:38.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:38.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:38.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:38.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:38.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:38.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:38.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:38.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:38.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:38.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:38.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:38.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:38.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:38.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:38.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:38.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:38.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:38.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:38.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:38.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:38.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:38.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:38.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:38.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:38.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:38.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:38.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:38.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.427 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.428 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:38.428 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:38.428 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.724901869999997, 2024-04-25T22:02:38.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:38.428 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.428 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.428 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:38.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:38.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:38.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:38.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:38.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:38.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:38.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:38.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:38.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:38.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:38.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:38.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:38.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:38.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:38.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:38.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:38.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:38.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:38.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:38.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:38.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:38.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:38.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:38.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:38.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:38.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:38.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:38.438 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.438 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.438 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.438 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:38.439 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:38.439 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.724836847000006, 2024-04-25T22:02:38.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:38.439 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.439 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.439 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:38.439 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:38.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:38.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:38.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:38.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:38.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:38.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:38.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:38.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:38.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:38.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:38.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:38.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:38.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:38.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:38.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:38.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.442 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.443 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:38.443 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:38.443 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.724758655000002, 2024-04-25T22:02:38.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:38.443 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.443 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.443 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:38.443 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:38.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:38.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:38.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:38.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:38.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:38.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:38.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:38.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:38.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:38.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:38.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:38.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:38.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:38.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:38.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:38.447 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.447 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.447 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.447 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:38.447 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:38.447 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.710112194999994, 2024-04-25T22:02:38.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:38.448 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.448 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.448 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.448 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:38.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:38.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:38.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:38.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:38.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:38.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:38.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:38.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:38.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:38.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:38.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:38.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:38.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:38.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:38.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:38.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:38.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:38.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:38.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.451 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.452 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:38.452 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:38.452 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.709952239000003, 2024-04-25T22:02:38.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:38.452 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:38.452 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:38.452 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.452 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:38.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:38.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:38.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:38.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:38.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:38.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:38.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:38.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:38.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:38.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:38.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:38.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:38.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:38.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:38.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:38.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:38.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:38.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:38.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:38.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:38.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:38.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:38.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:38.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:38.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:38.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:38.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:38.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:38.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:38.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:38.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.456 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:38.456 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:38.456 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:38.457 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:38.453+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:38.458 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:38.558 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:38.553+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:38.593 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:38.593 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:38.593 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:38.594 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:38.608 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:38.695 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:38.689+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:38.759 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:38.753+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:38.777 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:38.777 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:38.778 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:38.778 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:38.778 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:38.792 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:38.818 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:02:38.881 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:38.877+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:38.963 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:38.957+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:38.965 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:38.966 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:38.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:38.966 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:38.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.966 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:38.967 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:38.967 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 92.966351939999996, 2024-04-25T22:02:38.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:02:38.967 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:38.967 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:38.967 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.968 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:38.968 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:38.968 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:38.968 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:02:38.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.968 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:38.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:38.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:38.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:38.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:38.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:38.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:38.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:38.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:02:38.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:02:38.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:38.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:02:38.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:02:38.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:38.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:02:38.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:02:38.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:02:38.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:02:38.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:38.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:02:38.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:02:38.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:38.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:02:38.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:02:38.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:38.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:02:38.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:02:38.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:38.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:02:38.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:02:38.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:38.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:02:38.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:02:38.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:38.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:02:38.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:02:38.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:38.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:02:38.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:02:38.980 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:38.980 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:38.980 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:38.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.980 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:38.981 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:38.981 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 92.784288867000001, 2024-04-25T22:02:38.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:02:38.981 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:38.981 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:38.981 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.981 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:38.982 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:38.982 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:38.982 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:02:38.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.982 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:38.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:38.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:38.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:38.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:38.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:38.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:38.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:38.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:02:38.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:02:38.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:38.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:02:38.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:02:38.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:38.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:02:38.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:02:38.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:02:38.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:02:38.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:38.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:02:38.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:02:38.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:38.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:02:38.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:02:38.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:02:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:02:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:02:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:02:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:02:38.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:02:38.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:38.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:02:38.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:02:38.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:38.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:02:38.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:02:38.988 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:38.988 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:38.988 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:38.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.989 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:38.989 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:38.989 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 92.784244587000003, 2024-04-25T22:02:38.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:02:38.989 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:38.989 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:38.989 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.989 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:38.989 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:38.989 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:38.989 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:02:38.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.989 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:38.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:38.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:38.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:38.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:38.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:38.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:38.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:38.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:02:38.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:02:38.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:38.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:02:38.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:02:38.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:38.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:02:38.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:02:38.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:02:38.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:02:38.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:38.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:02:38.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:02:38.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:38.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:02:38.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:02:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:02:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:02:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:02:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:02:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:38.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:02:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:02:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:02:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:02:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:02:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:02:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:38.994 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 92.784188061999998, 2024-04-25T22:02:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:38.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:38.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:38.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:38.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.000 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 92.783992819999995, 2024-04-25T22:02:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:39.001 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:39.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:39.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:39.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:39.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:39.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:39.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:39.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:39.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:39.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:39.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:39.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:39.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:39.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:39.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:39.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:39.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:39.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:39.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:39.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:39.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:39.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:39.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:39.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:39.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:39.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:39.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:39.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:39.007 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.007 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:39.007 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.008 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:39.008 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:39.008 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 92.783930526999995, 2024-04-25T22:02:39.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:39.008 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:39.008 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:39.009 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:39.009 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:39.009 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:39.009 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:39.009 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:39.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.009 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:39.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:39.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:39.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:39.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:39.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:39.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:39.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:39.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:39.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:39.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:39.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:39.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:39.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:39.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:39.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:39.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:39.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:39.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:39.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:39.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:39.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:39.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:39.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:39.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:39.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:39.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:39.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:39.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:39.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:39.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:39.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:39.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:39.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:39.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:39.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:39.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:39.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:39.018 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.018 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:39.018 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.019 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:39.019 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:39.019 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 92.783870311000001, 2024-04-25T22:02:39.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:39.019 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:39.019 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:39.019 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:39.019 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:39.019 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:39.019 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:39.019 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:39.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.019 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:39.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:39.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:39.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:39.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:39.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:39.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:39.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:39.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:39.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:39.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:39.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:39.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:39.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:39.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:39.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:39.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:39.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:39.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:39.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:39.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:39.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:39.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:39.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:39.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:39.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:39.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:39.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:39.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:39.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:39.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:39.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:39.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:39.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:39.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:39.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:39.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:39.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:39.024 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.024 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:39.024 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.024 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:39.024 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:39.024 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 92.783680798999995, 2024-04-25T22:02:39.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:39.024 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:39.024 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:39.025 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:39.025 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:39.025 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:39.025 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:39.025 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:39.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.025 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:39.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:39.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:39.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:39.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:39.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:39.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:39.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:39.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:39.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:39.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:39.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:39.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:39.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:39.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:39.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:39.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:39.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:39.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:39.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:39.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:39.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:39.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:39.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:39.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:39.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:39.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:39.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:39.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:39.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:39.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:39.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:39.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:39.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:39.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:39.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:39.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:39.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:39.030 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.030 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:39.030 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.030 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:39.030 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:39.030 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 92.592342965, 2024-04-25T22:02:39.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:02:39.031 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:39.031 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:39.031 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:39.031 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:39.031 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:39.031 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:39.031 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:02:39.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.032 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:39.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:39.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:39.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:39.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:39.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:39.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:02:39.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:02:39.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:39.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:02:39.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:02:39.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:39.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:02:39.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:02:39.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:39.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:02:39.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:02:39.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:39.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:02:39.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:02:39.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:39.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:02:39.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:02:39.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:39.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:02:39.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:02:39.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:39.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:02:39.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:02:39.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:39.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:02:39.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:02:39.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:39.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:02:39.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:02:39.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:39.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:02:39.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:02:39.039 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.039 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:39.039 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.040 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:39.040 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:39.040 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 92.592304588000005, 2024-04-25T22:02:39.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:02:39.040 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:39.040 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:39.040 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:39.041 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:39.041 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:39.041 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:39.041 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:02:39.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.041 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:39.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:39.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:39.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:39.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:39.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:39.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:02:39.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:02:39.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:39.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:02:39.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:02:39.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:39.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:02:39.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:02:39.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:39.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:02:39.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:02:39.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:39.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:02:39.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:02:39.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:39.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:02:39.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:02:39.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:39.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:02:39.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:02:39.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:39.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:02:39.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:02:39.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:39.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:02:39.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:02:39.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:39.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:02:39.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:02:39.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:39.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:02:39.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:02:39.047 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.047 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:39.047 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.047 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:39.047 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:39.047 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 92.592253329000002, 2024-04-25T22:02:39.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:02:39.047 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:39.047 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:39.048 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:39.048 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:39.048 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:39.048 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:39.048 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:02:39.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.048 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:39.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:39.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:39.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:39.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:39.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:39.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:02:39.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:02:39.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:39.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:02:39.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:02:39.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:39.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:02:39.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:02:39.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:39.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:02:39.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:02:39.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:39.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:02:39.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:02:39.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:39.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:02:39.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:02:39.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:39.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:02:39.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:02:39.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:39.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:02:39.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:02:39.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:39.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:02:39.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:02:39.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:39.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:02:39.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:02:39.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:39.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:02:39.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:02:39.052 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.053 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:39.053 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.053 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:39.053 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:39.053 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 92.592104680000006, 2024-04-25T22:02:39.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:02:39.053 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:39.053 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:39.053 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:39.053 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:39.053 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:39.053 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:39.053 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:02:39.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.054 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:39.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:39.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:39.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:39.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:39.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:39.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:02:39.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:02:39.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:39.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:02:39.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:02:39.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:39.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:02:39.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:02:39.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:39.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:02:39.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:02:39.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:39.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:02:39.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:02:39.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:39.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:02:39.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:02:39.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:39.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:02:39.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:02:39.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:39.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:02:39.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:02:39.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:39.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:02:39.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:02:39.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:39.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:02:39.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:02:39.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:39.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:02:39.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:02:39.058 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.058 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:39.058 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.058 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:39.058 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:39.058 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 92.592062530000007, 2024-04-25T22:02:39.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:02:39.058 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:39.059 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:39.059 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:39.059 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:39.059 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:39.059 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:39.059 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:02:39.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.059 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:39.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:39.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:39.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:39.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:39.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:39.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:02:39.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:02:39.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:39.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:02:39.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:02:39.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:39.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:02:39.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:02:39.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:39.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:02:39.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:02:39.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:39.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:02:39.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:02:39.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:39.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:02:39.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:02:39.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:39.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:02:39.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:02:39.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:39.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:02:39.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:02:39.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:39.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:02:39.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:02:39.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:39.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:02:39.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:02:39.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:39.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:02:39.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:02:39.064 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.064 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:39.064 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.064 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:39.064 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:39.064 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 92.592024676999998, 2024-04-25T22:02:39.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:39.064 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:39.064 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:39.064 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:39.064 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:39.065 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:39.065 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:39.065 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:39.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.065 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:39.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:39.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:39.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:39.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:39.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:39.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:39.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:39.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:39.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:39.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:39.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:39.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:39.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:39.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:39.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:39.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:39.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:39.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:39.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:39.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:39.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:39.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:39.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:39.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:39.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:39.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:39.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:39.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:39.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:39.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:39.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:39.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:39.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:39.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:39.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:39.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:39.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:39.069 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.069 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:39.070 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.070 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:39.070 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:39.070 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 92.591815351999998, 2024-04-25T22:02:39.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:39.070 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:39.070 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:39.070 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:39.070 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:39.070 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:39.070 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:39.070 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:39.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.071 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:39.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:39.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:39.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:39.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:39.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:39.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:39.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:39.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:39.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:39.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:39.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:39.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:39.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:39.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:39.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:39.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:39.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:39.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:39.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:39.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:39.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:39.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:39.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:39.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:39.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:39.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:39.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:39.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:39.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:39.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:39.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:39.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:39.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:39.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:39.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:39.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:39.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:39.075 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.075 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:39.075 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.076 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:39.076 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:39.076 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.325564080000007, 2024-04-25T22:02:39.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:02:39.076 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:39.076 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:39.076 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:39.076 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:39.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:39.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:39.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:39.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:39.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:39.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:02:39.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:39.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:39.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:02:39.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:02:39.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:39.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:02:39.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:02:39.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:39.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:02:39.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:02:39.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:39.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:02:39.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:02:39.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:39.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:02:39.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:02:39.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:39.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:02:39.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:02:39.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:39.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:02:39.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:02:39.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:39.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:02:39.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:02:39.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:39.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:02:39.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:02:39.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:39.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:02:39.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:02:39.083 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.083 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:39.083 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.083 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:39.083 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:39.083 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.325530240000006, 2024-04-25T22:02:39.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:02:39.084 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:39.084 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:39.084 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:39.084 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:39.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:39.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:39.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:39.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:39.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:39.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:39.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:02:39.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:39.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:02:39.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:02:39.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:39.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:02:39.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:02:39.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:39.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:02:39.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:02:39.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:39.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:02:39.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:02:39.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:39.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:02:39.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:02:39.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:39.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:02:39.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:02:39.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:39.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:02:39.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:02:39.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:39.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:39.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:02:39.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:39.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:02:39.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:02:39.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:39.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:02:39.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:02:39.088 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.088 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:39.088 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.089 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:39.089 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:39.089 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.325478544000006, 2024-04-25T22:02:39.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:02:39.089 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:39.089 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:39.089 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:39.089 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:39.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:39.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:39.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:39.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:39.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:39.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:02:39.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:02:39.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:39.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:02:39.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:02:39.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:39.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:02:39.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:02:39.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:39.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:02:39.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:02:39.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:39.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:02:39.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:02:39.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:39.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:02:39.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:02:39.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:39.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:02:39.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:02:39.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:39.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:02:39.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:02:39.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:39.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:02:39.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:02:39.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:39.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:02:39.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:02:39.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:39.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:02:39.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:02:39.094 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.094 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:39.094 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.094 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:39.094 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:39.094 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.325334092000006, 2024-04-25T22:02:39.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:02:39.095 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:39.095 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:39.095 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:39.095 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:39.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:39.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:39.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:39.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:39.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:39.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:02:39.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:02:39.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:39.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:02:39.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:02:39.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:39.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:02:39.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:02:39.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:39.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:02:39.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:02:39.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:39.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:02:39.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:02:39.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:39.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:02:39.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:02:39.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:39.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:02:39.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:02:39.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:39.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:02:39.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:02:39.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:39.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:02:39.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:02:39.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:39.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:02:39.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:02:39.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:39.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:02:39.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:02:39.103 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.104 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:39.104 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.104 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:39.104 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:39.104 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.325277372000002, 2024-04-25T22:02:39.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:02:39.104 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:39.104 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:39.104 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:39.104 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:39.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:39.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:39.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:39.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:39.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:39.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:39.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:02:39.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:02:39.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:39.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:02:39.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:02:39.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:39.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:02:39.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:02:39.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:39.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:02:39.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:02:39.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:39.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:02:39.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:02:39.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:39.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:02:39.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:02:39.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:39.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:02:39.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:02:39.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:39.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:02:39.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:02:39.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:39.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:02:39.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:02:39.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:39.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:02:39.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:02:39.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:39.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:39.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:39.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:02:39.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:02:39.109 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.109 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:39.109 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.109 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:39.109 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:39.109 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:39.109 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:02:39.111 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:39.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:39.110+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:39.212 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:39.209+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:39.244 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:39.244 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:39.244 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:02:39.244 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:39.258 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:39.311 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:39.311 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:39.313 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:39.309+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:39.341 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:39.341 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:39.374 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:39.374 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:39.380 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:39.380 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:39.395 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:39.414 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:39.413+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:39.511 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:39.513 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:39.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:39.510+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:39.526 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:39.615 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:39.609+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:39.660 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:39.660 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:39.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:39.724 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:39.721+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:39.798 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:39.798 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:39.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:39.815 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-25T22:02:39.856 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:39.853+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:39.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:39.914+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:39.978 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:39.978 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:39.992 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:40.037 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:40.033+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:40.119 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:40.113+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:40.125 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:40.125 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:40.140 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:40.221 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:40.217+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:40.300 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:40.301 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:40.316 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:40.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:40.318+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:40.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:40.422+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:40.437 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:40.437 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:40.453 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:40.523 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:40.517+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:40.584 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:40.584 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:40.598 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:40.624 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:40.617+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:40.721 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:40.721 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:40.725 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:40.721+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:40.735 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:40.826 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:40.825+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:40.858 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:40.858 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:40.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:40.927 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:40.921+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:41.003 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:41.004 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:41.018 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:41.060 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:41.057+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:41.128 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:41.125+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:41.181 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:41.181 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:41.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:41.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:41.226+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:41.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:41.326+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:41.358 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:41.359 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:41.373 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:41.395 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:02:41.430 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:41.425+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:41.507 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:41.507 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:41.521 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:41.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:41.530+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:41.590 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:41.591 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:41.624 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:41.624 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:41.632 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:41.625+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:41.642 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:41.642 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:41.657 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:41.657 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:41.657 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:41.745 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:41.741+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:41.831 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:41.831 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:41.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:41.831 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:41.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.831 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:41.832 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:41.832 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.832610537999997, 2024-04-25T22:02:41.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:02:41.832 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.832 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.832 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.832 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:41.832 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:41.832 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:41.832 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:02:41.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.832 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:02:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:02:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:02:41.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:02:41.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:02:41.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:02:41.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:02:41.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:02:41.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:02:41.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:02:41.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:02:41.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:02:41.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:02:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:02:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:02:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:02:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:02:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:02:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:02:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:02:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:02:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:02:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:41.837 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.650547465000002, 2024-04-25T22:02:41.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:02:41.838 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.838 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.838 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.838 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:41.838 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:41.838 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:41.838 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:02:41.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.838 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:02:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:02:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:02:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:02:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:02:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:02:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:02:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:02:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:02:41.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:02:41.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:02:41.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:02:41.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:02:41.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:02:41.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:02:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:02:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:02:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:02:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:02:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:02:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:02:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:02:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.650503185000005, 2024-04-25T22:02:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:02:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.843 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:02:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:41.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:02:41.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:02:41.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:02:41.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:02:41.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:02:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:02:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:02:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:02:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:02:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:02:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:02:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:02:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:02:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:02:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:02:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:02:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:02:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:02:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:02:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:02:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:02:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:02:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.848 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.65044666, 2024-04-25T22:02:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.849 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:41.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:41.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:41.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:41.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.650251417999996, 2024-04-25T22:02:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:41.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:41.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:41.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:41.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:41.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:41.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:41.860 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.860 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.860 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.860 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:41.860 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:41.860 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.650189124999997, 2024-04-25T22:02:41.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:41.860 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.860 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.860 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.860 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:41.861 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:41.861 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:41.861 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:41.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.861 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:41.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:41.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:41.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:41.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:41.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:41.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:41.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:41.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:41.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:41.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:41.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:41.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:41.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:41.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:41.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:41.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:41.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:41.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:41.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:41.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:41.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:41.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:41.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:41.865 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.865 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.866 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.866 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:41.866 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:41.866 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.650128909000003, 2024-04-25T22:02:41.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:41.866 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.866 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.866 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.866 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:41.867 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:41.867 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:41.867 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:41.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.867 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:41.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:41.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:41.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:41.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:41.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:41.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:41.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:41.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:41.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:41.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:41.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:41.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:41.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:41.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:41.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:41.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:41.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:41.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:41.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:41.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:41.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:41.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:41.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:41.871 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.871 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.872 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.872 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:41.872 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:41.872 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.649939396999997, 2024-04-25T22:02:41.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:41.872 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.872 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.872 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.872 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:41.872 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:41.872 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:41.872 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:41.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.873 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:41.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:41.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:41.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:41.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:41.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:41.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:41.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:41.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:41.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:41.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:41.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:41.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:41.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:41.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:41.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:41.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:41.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:41.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:41.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:41.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:41.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:41.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:41.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:41.877 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.877 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.877 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.877 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:41.877 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:41.877 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.458601563000002, 2024-04-25T22:02:41.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:02:41.878 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.878 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.878 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.878 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:41.878 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:41.878 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:41.878 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:02:41.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.878 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:41.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:41.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:02:41.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:02:41.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:02:41.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:02:41.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:02:41.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:02:41.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:02:41.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:02:41.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:02:41.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:02:41.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:02:41.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:02:41.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:02:41.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:02:41.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:02:41.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:02:41.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:02:41.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:02:41.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:02:41.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:02:41.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:02:41.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:02:41.882 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.882 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.883 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.883 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:41.883 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:41.883 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.458563186000006, 2024-04-25T22:02:41.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:02:41.883 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.883 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.883 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.883 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:41.883 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:41.883 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:41.883 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:02:41.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.883 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:41.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:41.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:02:41.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:02:41.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:02:41.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:02:41.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:02:41.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:02:41.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:02:41.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:02:41.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:02:41.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:02:41.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:02:41.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:02:41.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:02:41.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:02:41.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:02:41.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:02:41.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:02:41.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:02:41.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:02:41.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:02:41.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:02:41.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:02:41.888 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.888 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.888 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.888 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:41.888 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:41.888 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.458511927000004, 2024-04-25T22:02:41.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:02:41.888 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.889 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.889 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.889 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:41.889 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:41.889 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:41.889 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:02:41.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.889 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:41.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:41.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:02:41.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:02:41.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:02:41.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:02:41.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:02:41.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:02:41.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:02:41.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:02:41.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:02:41.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:02:41.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:02:41.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:02:41.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:02:41.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:02:41.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:02:41.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:02:41.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:02:41.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:02:41.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:02:41.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:02:41.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:02:41.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:02:41.893 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.894 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.894 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.894 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:41.894 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:41.894 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.458363277999993, 2024-04-25T22:02:41.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:02:41.894 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.894 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.894 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.894 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:41.894 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:41.895 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:41.895 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:02:41.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.895 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:41.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:41.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:02:41.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:02:41.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:02:41.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:02:41.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:02:41.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:02:41.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:02:41.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:02:41.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:02:41.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:02:41.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:02:41.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:02:41.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:02:41.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:02:41.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:02:41.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:02:41.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:02:41.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:02:41.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:02:41.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:02:41.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:02:41.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:02:41.899 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.899 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.899 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.900 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:41.900 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:41.900 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.458321127999994, 2024-04-25T22:02:41.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:02:41.900 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.900 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.900 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.900 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:41.900 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:41.900 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:41.900 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:02:41.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.900 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:41.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:41.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:02:41.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:02:41.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:02:41.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:02:41.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:02:41.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:02:41.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:02:41.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:02:41.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:02:41.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:02:41.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:02:41.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:02:41.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:02:41.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:02:41.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:02:41.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:02:41.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:02:41.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:02:41.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:02:41.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:02:41.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:02:41.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:02:41.905 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.905 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.905 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.905 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:41.905 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:41.905 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.458283274999999, 2024-04-25T22:02:41.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:41.905 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.905 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.906 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.906 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:41.906 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:41.906 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:41.906 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:41.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.906 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:41.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:41.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:41.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:41.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:41.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:41.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:41.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:41.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:41.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:41.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:41.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:41.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:41.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:41.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:41.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:41.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:41.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:41.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:41.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:41.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:41.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:41.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:41.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:41.910 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.910 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.910 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.911 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:41.911 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:41.911 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.458073949999999, 2024-04-25T22:02:41.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:41.911 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.911 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.911 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.911 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:41.911 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:41.911 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:41.911 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:41.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.911 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:41.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:41.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:41.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:41.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:41.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:41.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:41.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:41.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:41.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:41.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:41.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:41.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:41.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:41.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:41.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:41.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:41.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:41.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:41.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:41.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:41.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:41.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:41.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:41.916 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.916 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.916 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.916 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:41.916 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:41.916 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 87.191822677999994, 2024-04-25T22:02:41.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:02:41.916 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.917 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.917 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.917 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:41.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:41.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:02:41.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:41.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:02:41.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:02:41.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:02:41.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:02:41.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:02:41.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:02:41.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:02:41.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:02:41.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:02:41.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:02:41.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:02:41.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:02:41.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:02:41.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:02:41.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:02:41.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:02:41.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:02:41.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:02:41.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:02:41.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:02:41.921 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.921 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.921 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.921 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:41.922 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:41.922 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 87.191788837999994, 2024-04-25T22:02:41.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:02:41.922 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.922 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.922 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.922 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:41.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:41.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:41.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:02:41.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:02:41.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:02:41.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:02:41.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:02:41.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:02:41.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:02:41.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:02:41.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:02:41.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:02:41.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:02:41.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:02:41.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:02:41.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:02:41.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:02:41.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:41.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:02:41.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:02:41.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:02:41.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:02:41.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:02:41.926 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.926 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.927 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.927 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:41.927 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:41.927 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 87.191737141999994, 2024-04-25T22:02:41.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:02:41.927 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.927 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.927 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.927 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:41.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:41.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:02:41.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:02:41.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:02:41.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:02:41.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:02:41.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:02:41.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:02:41.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:02:41.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:02:41.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:02:41.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:02:41.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:02:41.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:02:41.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:02:41.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:02:41.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:02:41.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:02:41.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:02:41.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:02:41.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:02:41.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:02:41.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:02:41.932 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.932 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.932 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.932 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:41.932 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:41.932 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 87.191592689999993, 2024-04-25T22:02:41.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:02:41.932 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.933 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.933 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.933 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:41.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:41.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:02:41.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:02:41.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:02:41.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:02:41.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:02:41.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:02:41.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:02:41.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:02:41.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:02:41.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:02:41.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:02:41.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:02:41.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:02:41.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:02:41.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:02:41.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:02:41.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:02:41.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:02:41.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:02:41.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:02:41.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:02:41.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:02:41.937 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.938 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.938 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.938 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:41.938 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:41.938 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 87.191535970000004, 2024-04-25T22:02:41.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:02:41.938 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:41.938 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:41.938 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:41.938 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:41.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:41.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:41.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:41.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:41.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:41.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:41.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:02:41.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:02:41.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:41.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:02:41.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:02:41.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:41.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:02:41.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:02:41.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:41.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:02:41.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:02:41.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:41.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:02:41.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:02:41.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:41.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:02:41.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:02:41.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:41.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:02:41.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:02:41.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:41.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:02:41.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:02:41.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:41.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:02:41.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:02:41.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:41.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:02:41.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:02:41.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:41.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:41.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:41.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:02:41.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:02:41.943 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.943 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.943 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.943 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:41.943 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:41.943 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:41.944 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:02:41.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:41.942+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:41.946 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:42.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:42.042+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:42.078 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:42.078 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:42.078 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:02:42.078 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:42.090 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:02:42.090 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:02:42.090 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-25T22:02:42.090 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.665007 2024-04-25T22:02:42.090 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.6650065855759925 2024-04-25T22:02:42.092 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:42.146 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:42.145+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:42.247 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:42.245+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:42.258 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:42.259 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:42.259 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:02:42.259 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:02:42.259 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:42.274 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:42.348 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:42.345+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:42.395 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:02:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:02:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:02:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 4 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:27 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:02:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.754320473000007, 2024-04-25T22:02:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013281644, 2024-04-25T22:02:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637801+0000", 2024-04-25T22:02:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1299999999999998e-07 2024-04-25T22:02:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637828+0000", 2024-04-25T22:02:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6953000000000001e-05 2024-04-25T22:02:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637873+0000", 2024-04-25T22:02:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4676999999999999e-05 2024-04-25T22:02:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637917+0000", 2024-04-25T22:02:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4815999999999999e-05 2024-04-25T22:02:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644220+0000", 2024-04-25T22:02:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063021049999999997 2024-04-25T22:02:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651082+0000", 2024-04-25T22:02:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068621799999999998 2024-04-25T22:02:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:15 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.748912860999994, 2024-04-25T22:02:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010973732, 2024-04-25T22:02:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643209+0000", 2024-04-25T22:02:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.003e-06 2024-04-25T22:02:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643230+0000", 2024-04-25T22:02:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0815999999999999e-05 2024-04-25T22:02:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643252+0000", 2024-04-25T22:02:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2586999999999999e-05 2024-04-25T22:02:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643271+0000", 2024-04-25T22:02:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8493000000000001e-05 2024-04-25T22:02:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644387+0000", 2024-04-25T22:02:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011160250000000001 2024-04-25T22:02:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644434+0000", 2024-04-25T22:02:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:02:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654103+0000", 2024-04-25T22:02:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096691360000000001 2024-04-25T22:02:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654181+0000", 2024-04-25T22:02:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8546000000000003e-05 2024-04-25T22:02:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.748812505000004, 2024-04-25T22:02:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088132450000000008, 2024-04-25T22:02:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643309+0000", 2024-04-25T22:02:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9600000000000008e-07 2024-04-25T22:02:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643339+0000", 2024-04-25T22:02:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9467000000000001e-05 2024-04-25T22:02:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644245+0000", 2024-04-25T22:02:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090648200000000001 2024-04-25T22:02:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644268+0000", 2024-04-25T22:02:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3017e-05 2024-04-25T22:02:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647517+0000", 2024-04-25T22:02:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032491680000000002 2024-04-25T22:02:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647561+0000", 2024-04-25T22:02:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3630000000000001e-05 2024-04-25T22:02:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652041+0000", 2024-04-25T22:02:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044804529999999997 2024-04-25T22:02:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652121+0000", 2024-04-25T22:02:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0031999999999995e-05 2024-04-25T22:02:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:34 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.746723877999997, 2024-04-25T22:02:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089225940000000007, 2024-04-25T22:02:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645398+0000", 2024-04-25T22:02:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4360000000000001e-06 2024-04-25T22:02:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645412+0000", 2024-04-25T22:02:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4283e-05 2024-04-25T22:02:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645434+0000", 2024-04-25T22:02:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1237e-05 2024-04-25T22:02:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645459+0000", 2024-04-25T22:02:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5675999999999999e-05 2024-04-25T22:02:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646081+0000", 2024-04-25T22:02:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062128900000000002 2024-04-25T22:02:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646131+0000", 2024-04-25T22:02:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0322999999999999e-05 2024-04-25T22:02:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654185+0000", 2024-04-25T22:02:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080542749999999996 2024-04-25T22:02:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654319+0000", 2024-04-25T22:02:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013407499999999999 2024-04-25T22:02:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:19 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.746622368999994, 2024-04-25T22:02:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076631340000000003, 2024-04-25T22:02:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645499+0000", 2024-04-25T22:02:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4300000000000001e-07 2024-04-25T22:02:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645509+0000", 2024-04-25T22:02:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0244000000000001e-05 2024-04-25T22:02:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645523+0000", 2024-04-25T22:02:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3315999999999999e-05 2024-04-25T22:02:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645531+0000", 2024-04-25T22:02:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.123e-06 2024-04-25T22:02:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648260+0000", 2024-04-25T22:02:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027289789999999999 2024-04-25T22:02:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648307+0000", 2024-04-25T22:02:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6969999999999999e-05 2024-04-25T22:02:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653039+0000", 2024-04-25T22:02:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047322299999999996 2024-04-25T22:02:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653161+0000", 2024-04-25T22:02:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012232899999999999 2024-04-25T22:02:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.744644707999996, 2024-04-25T22:02:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01271303, 2024-04-25T22:02:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647479+0000", 2024-04-25T22:02:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.286e-06 2024-04-25T22:02:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647494+0000", 2024-04-25T22:02:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.521e-05 2024-04-25T22:02:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647525+0000", 2024-04-25T22:02:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0403999999999999e-05 2024-04-25T22:02:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647544+0000", 2024-04-25T22:02:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8743e-05 2024-04-25T22:02:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647895+0000", 2024-04-25T22:02:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035099699999999997 2024-04-25T22:02:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648202+0000", 2024-04-25T22:02:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030758499999999998 2024-04-25T22:02:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648496+0000", 2024-04-25T22:02:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029370699999999999 2024-04-25T22:02:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654605+0000", 2024-04-25T22:02:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061095999999999998 2024-04-25T22:02:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.659959+0000", 2024-04-25T22:02:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053531680000000002 2024-04-25T22:02:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660078+0000", 2024-04-25T22:02:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011981600000000001 2024-04-25T22:02:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660189+0000", 2024-04-25T22:02:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011051400000000001 2024-04-25T22:02:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.744520616000003, 2024-04-25T22:02:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013053006000000001, 2024-04-25T22:02:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647602+0000", 2024-04-25T22:02:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.604e-06 2024-04-25T22:02:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647611+0000", 2024-04-25T22:02:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5689999999999994e-06 2024-04-25T22:02:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647634+0000", 2024-04-25T22:02:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3227e-05 2024-04-25T22:02:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647660+0000", 2024-04-25T22:02:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5829999999999998e-05 2024-04-25T22:02:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649544+0000", 2024-04-25T22:02:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001884066 2024-04-25T22:02:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649783+0000", 2024-04-25T22:02:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238411 2024-04-25T22:02:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.650794+0000", 2024-04-25T22:02:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010109920000000001 2024-04-25T22:02:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654714+0000", 2024-04-25T22:02:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039202170000000001 2024-04-25T22:02:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660403+0000", 2024-04-25T22:02:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056895940000000001 2024-04-25T22:02:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660551+0000", 2024-04-25T22:02:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014717899999999999 2024-04-25T22:02:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660653+0000", 2024-04-25T22:02:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102317 2024-04-25T22:02:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:17 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.744436436000001, 2024-04-25T22:02:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010101435000000001, 2024-04-25T22:02:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647686+0000", 2024-04-25T22:02:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-04-25T22:02:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647693+0000", 2024-04-25T22:02:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7330000000000003e-06 2024-04-25T22:02:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647711+0000", 2024-04-25T22:02:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7436e-05 2024-04-25T22:02:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647727+0000", 2024-04-25T22:02:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6232999999999999e-05 2024-04-25T22:02:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649249+0000", 2024-04-25T22:02:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015219890000000001 2024-04-25T22:02:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649533+0000", 2024-04-25T22:02:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028391799999999997 2024-04-25T22:02:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649841+0000", 2024-04-25T22:02:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030853400000000001 2024-04-25T22:02:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654622+0000", 2024-04-25T22:02:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047809630000000001 2024-04-25T22:02:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657616+0000", 2024-04-25T22:02:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029938769999999998 2024-04-25T22:02:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657724+0000", 2024-04-25T22:02:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108109 2024-04-25T22:02:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657786+0000", 2024-04-25T22:02:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1196000000000002e-05 2024-04-25T22:02:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.744248107999994, 2024-04-25T22:02:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010260877999999999, 2024-04-25T22:02:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647874+0000", 2024-04-25T22:02:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:02:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647884+0000", 2024-04-25T22:02:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.013e-05 2024-04-25T22:02:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647908+0000", 2024-04-25T22:02:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3592999999999999e-05 2024-04-25T22:02:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647926+0000", 2024-04-25T22:02:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8176999999999999e-05 2024-04-25T22:02:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651480+0000", 2024-04-25T22:02:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035540160000000001 2024-04-25T22:02:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651690+0000", 2024-04-25T22:02:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210249 2024-04-25T22:02:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651986+0000", 2024-04-25T22:02:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000296001 2024-04-25T22:02:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655696+0000", 2024-04-25T22:02:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037098410000000002 2024-04-25T22:02:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657896+0000", 2024-04-25T22:02:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022004630000000002 2024-04-25T22:02:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658035+0000", 2024-04-25T22:02:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013831499999999999 2024-04-25T22:02:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658133+0000", 2024-04-25T22:02:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8553000000000003e-05 2024-04-25T22:02:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:18 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.744169228000004, 2024-04-25T22:02:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013108712, 2024-04-25T22:02:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647953+0000", 2024-04-25T22:02:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.697e-06 2024-04-25T22:02:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647963+0000", 2024-04-25T22:02:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9259999999999995e-06 2024-04-25T22:02:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647982+0000", 2024-04-25T22:02:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-04-25T22:02:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648008+0000", 2024-04-25T22:02:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5956e-05 2024-04-25T22:02:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651686+0000", 2024-04-25T22:02:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678073 2024-04-25T22:02:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652023+0000", 2024-04-25T22:02:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033739399999999998 2024-04-25T22:02:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652348+0000", 2024-04-25T22:02:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032475000000000001 2024-04-25T22:02:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655883+0000", 2024-04-25T22:02:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035353030000000001 2024-04-25T22:02:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660791+0000", 2024-04-25T22:02:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049075330000000004 2024-04-25T22:02:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660930+0000", 2024-04-25T22:02:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000139856 2024-04-25T22:02:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661060+0000", 2024-04-25T22:02:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000129651 2024-04-25T22:02:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.744092335999994, 2024-04-25T22:02:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012451034, 2024-04-25T22:02:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648030+0000", 2024-04-25T22:02:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-04-25T22:02:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648036+0000", 2024-04-25T22:02:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8059999999999997e-06 2024-04-25T22:02:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648054+0000", 2024-04-25T22:02:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7744000000000002e-05 2024-04-25T22:02:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648070+0000", 2024-04-25T22:02:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-04-25T22:02:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648875+0000", 2024-04-25T22:02:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080444000000000002 2024-04-25T22:02:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649078+0000", 2024-04-25T22:02:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020391499999999999 2024-04-25T22:02:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649674+0000", 2024-04-25T22:02:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00059555299999999997 2024-04-25T22:02:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653185+0000", 2024-04-25T22:02:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035113459999999998 2024-04-25T22:02:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660251+0000", 2024-04-25T22:02:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070661350000000003 2024-04-25T22:02:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660382+0000", 2024-04-25T22:02:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013095899999999999 2024-04-25T22:02:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660479+0000", 2024-04-25T22:02:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6852e-05 2024-04-25T22:02:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:25 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.744026523000002, 2024-04-25T22:02:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012691025999999999, 2024-04-25T22:02:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648095+0000", 2024-04-25T22:02:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.424e-06 2024-04-25T22:02:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648102+0000", 2024-04-25T22:02:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2099999999999998e-06 2024-04-25T22:02:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648122+0000", 2024-04-25T22:02:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0242999999999999e-05 2024-04-25T22:02:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648138+0000", 2024-04-25T22:02:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6192999999999999e-05 2024-04-25T22:02:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651461+0000", 2024-04-25T22:02:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033225709999999999 2024-04-25T22:02:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651776+0000", 2024-04-25T22:02:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031567500000000002 2024-04-25T22:02:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660785+0000", 2024-04-25T22:02:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090087099999999996 2024-04-25T22:02:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.743964036999998, 2024-04-25T22:02:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013102702000000001, 2024-04-25T22:02:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648158+0000", 2024-04-25T22:02:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2839999999999999e-06 2024-04-25T22:02:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648163+0000", 2024-04-25T22:02:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-04-25T22:02:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648181+0000", 2024-04-25T22:02:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8484000000000001e-05 2024-04-25T22:02:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648196+0000", 2024-04-25T22:02:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4496e-05 2024-04-25T22:02:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653737+0000", 2024-04-25T22:02:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055414009999999996 2024-04-25T22:02:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653972+0000", 2024-04-25T22:02:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000234732 2024-04-25T22:02:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661259+0000", 2024-04-25T22:02:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072872689999999999 2024-04-25T22:02:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.743907217, 2024-04-25T22:02:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086984829999999999, 2024-04-25T22:02:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648214+0000", 2024-04-25T22:02:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-04-25T22:02:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648233+0000", 2024-04-25T22:02:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.878e-05 2024-04-25T22:02:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648252+0000", 2024-04-25T22:02:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8603000000000001e-05 2024-04-25T22:02:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648267+0000", 2024-04-25T22:02:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:02:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648846+0000", 2024-04-25T22:02:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057923000000000002 2024-04-25T22:02:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649027+0000", 2024-04-25T22:02:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181585 2024-04-25T22:02:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.656912+0000", 2024-04-25T22:02:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078844589999999999 2024-04-25T22:02:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 6 lcod 17'2)", 2024-04-25T22:02:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.731977301000001, 2024-04-25T22:02:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064966000000000004, 2024-04-25T22:02:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660144+0000", 2024-04-25T22:02:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1800000000000005e-07 2024-04-25T22:02:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660181+0000", 2024-04-25T22:02:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6408000000000001e-05 2024-04-25T22:02:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660197+0000", 2024-04-25T22:02:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6177000000000001e-05 2024-04-25T22:02:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660210+0000", 2024-04-25T22:02:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:02:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660556+0000", 2024-04-25T22:02:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034612899999999998 2024-04-25T22:02:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660793+0000", 2024-04-25T22:02:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023656799999999999 2024-04-25T22:02:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:18 3.1f e17/15 ondisk, result = 0)", 2024-04-25T22:02:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.731715527999995, 2024-04-25T22:02:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067878299999999997, 2024-04-25T22:02:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660406+0000", 2024-04-25T22:02:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2800000000000005e-07 2024-04-25T22:02:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660412+0000", 2024-04-25T22:02:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0399999999999998e-06 2024-04-25T22:02:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660429+0000", 2024-04-25T22:02:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7394e-05 2024-04-25T22:02:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660445+0000", 2024-04-25T22:02:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6069000000000001e-05 2024-04-25T22:02:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660757+0000", 2024-04-25T22:02:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031194300000000002 2024-04-25T22:02:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660776+0000", 2024-04-25T22:02:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8862999999999999e-05 2024-04-25T22:02:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661084+0000", 2024-04-25T22:02:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030754600000000001 2024-04-25T22:02:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-25T22:02:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.731651299999996, 2024-04-25T22:02:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080007600000000004, 2024-04-25T22:02:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660470+0000", 2024-04-25T22:02:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4499999999999996e-07 2024-04-25T22:02:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660475+0000", 2024-04-25T22:02:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-04-25T22:02:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660490+0000", 2024-04-25T22:02:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5274e-05 2024-04-25T22:02:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660501+0000", 2024-04-25T22:02:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0694e-05 2024-04-25T22:02:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661130+0000", 2024-04-25T22:02:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062887499999999999 2024-04-25T22:02:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661269+0000", 2024-04-25T22:02:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013955900000000001 2024-04-25T22:02:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:02:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.767919301000006, 2024-04-25T22:02:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037104880000000001, 2024-04-25T22:02:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:42.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:42.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624204+0000", 2024-04-25T22:02:42.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.757e-06 2024-04-25T22:02:42.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624233+0000", 2024-04-25T22:02:42.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9362000000000001e-05 2024-04-25T22:02:42.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624264+0000", 2024-04-25T22:02:42.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0843000000000003e-05 2024-04-25T22:02:42.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624280+0000", 2024-04-25T22:02:42.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5577e-05 2024-04-25T22:02:42.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624458+0000", 2024-04-25T22:02:42.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017821199999999999 2024-04-25T22:02:42.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:42.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624661+0000", 2024-04-25T22:02:42.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020283200000000001 2024-04-25T22:02:42.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:42.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624842+0000", 2024-04-25T22:02:42.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018115500000000001 2024-04-25T22:02:42.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:42.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.626271+0000", 2024-04-25T22:02:42.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001429416 2024-04-25T22:02:42.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:42.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627749+0000", 2024-04-25T22:02:42.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014778650000000001 2024-04-25T22:02:42.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:42.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627849+0000", 2024-04-25T22:02:42.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9261999999999999e-05 2024-04-25T22:02:42.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627912+0000", 2024-04-25T22:02:42.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3207000000000007e-05 2024-04-25T22:02:42.480 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.480 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.480 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.480 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-25T22:02:42.480 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:42.480 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.765221949999997, 2024-04-25T22:02:42.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029804620000000001, 2024-04-25T22:02:42.480 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.480 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.481 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.481 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:42.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:42.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626903+0000", 2024-04-25T22:02:42.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0029999999999996e-06 2024-04-25T22:02:42.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626921+0000", 2024-04-25T22:02:42.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8272999999999999e-05 2024-04-25T22:02:42.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626959+0000", 2024-04-25T22:02:42.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7843999999999999e-05 2024-04-25T22:02:42.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626977+0000", 2024-04-25T22:02:42.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7756000000000001e-05 2024-04-25T22:02:42.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627153+0000", 2024-04-25T22:02:42.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017643800000000001 2024-04-25T22:02:42.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:42.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627425+0000", 2024-04-25T22:02:42.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027207300000000001 2024-04-25T22:02:42.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:42.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627848+0000", 2024-04-25T22:02:42.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042297199999999997 2024-04-25T22:02:42.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:42.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629590+0000", 2024-04-25T22:02:42.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017416809999999999 2024-04-25T22:02:42.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:42.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629720+0000", 2024-04-25T22:02:42.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130526 2024-04-25T22:02:42.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:42.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629808+0000", 2024-04-25T22:02:42.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7449999999999998e-05 2024-04-25T22:02:42.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629879+0000", 2024-04-25T22:02:42.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1445999999999993e-05 2024-04-25T22:02:42.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.486 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.486 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4185.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-04-25T22:02:42.486 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:42.486 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 44.777113880000002, 2024-04-25T22:02:42.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0036257939999999999, 2024-04-25T22:02:42.487 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:42.487 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:42.487 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:42.487 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:42.487 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4185", 2024-04-25T22:02:42.487 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.44:0/2048337248", 2024-04-25T22:02:42.487 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2 2024-04-25T22:02:42.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.487 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:42.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:42.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:42.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:42.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:42.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:42.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:42.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615010+0000", 2024-04-25T22:02:42.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8059999999999999e-06 2024-04-25T22:02:42.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:42.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615023+0000", 2024-04-25T22:02:42.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3159999999999999e-05 2024-04-25T22:02:42.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:42.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615043+0000", 2024-04-25T22:02:42.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:02:42.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615059+0000", 2024-04-25T22:02:42.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5519000000000002e-05 2024-04-25T22:02:42.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615241+0000", 2024-04-25T22:02:42.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018207100000000001 2024-04-25T22:02:42.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:02:42.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615258+0000", 2024-04-25T22:02:42.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7278999999999998e-05 2024-04-25T22:02:42.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:42.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618429+0000", 2024-04-25T22:02:42.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003171213 2024-04-25T22:02:42.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:42.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:42.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:42.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618633+0000", 2024-04-25T22:02:42.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020343999999999999 2024-04-25T22:02:42.491 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.491 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.491 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.491 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:42.491 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:42.491 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:42.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:42.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:42.490+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:42.593 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:42.589+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:42.624 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:02:42.625 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:42.639 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:42.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:42.690+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:42.760 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:02:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:02:42.761 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:42.776 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:42.795 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:42.793+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:42.825 INFO:teuthology.orchestra.run.smithi044.stderr:set osd.0 primary-affinity to 0.665007 (8435812) 2024-04-25T22:02:42.832 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-25T22:02:42.895 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:42.889+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:42.900 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:42.900 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:42.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:42.900 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:42.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.072555770999998, 2024-04-25T22:02:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.071824953000004, 2024-04-25T22:02:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.071158682000004, 2024-04-25T22:02:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.070258781999996, 2024-04-25T22:02:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.068222441000003, 2024-04-25T22:02:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.067759104000004, 2024-04-25T22:02:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.066892225000004, 2024-04-25T22:02:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.066441151000006, 2024-04-25T22:02:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.065991565000004, 2024-04-25T22:02:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.269335077999997, 2024-04-25T22:02:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.269211095000003, 2024-04-25T22:02:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.269137158999996, 2024-04-25T22:02:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.269020906999998, 2024-04-25T22:02:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.268857498000003, 2024-04-25T22:02:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.268755302000002, 2024-04-25T22:02:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.268676349000003, 2024-04-25T22:02:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.268611325999998, 2024-04-25T22:02:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.268533133999995, 2024-04-25T22:02:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.253886674, 2024-04-25T22:02:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.253726717999996, 2024-04-25T22:02:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:42.994 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:42.996 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:42.993+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:42.996 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:43.097 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:43.089+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:43.129 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:43.130 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:43.130 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:43.130 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:43.144 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:43.229 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:43.225+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:43.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:43.294+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:43.313 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:43.313 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:43.313 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:43.313 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:43.313 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:43.328 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:43.400 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:43.397+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:43.501 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:43.501 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:43.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:43.501 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:43.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.502 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:43.502 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:43.502 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.503328784000004, 2024-04-25T22:02:43.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:02:43.502 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.502 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.502 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.502 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:43.502 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:43.502 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:43.502 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:02:43.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.503 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:43.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:43.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:02:43.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:02:43.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:02:43.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:02:43.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:02:43.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:02:43.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:02:43.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:02:43.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:02:43.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:02:43.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:02:43.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:02:43.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:02:43.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:02:43.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:02:43.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:02:43.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:02:43.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:02:43.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:02:43.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:02:43.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:02:43.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:02:43.507 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.507 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.507 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.507 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:43.507 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:43.507 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.321265710999995, 2024-04-25T22:02:43.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:02:43.507 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.507 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.507 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.508 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:43.508 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:43.508 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:43.508 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:02:43.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.508 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:43.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:43.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:02:43.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:02:43.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:02:43.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:02:43.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:02:43.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:02:43.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:02:43.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:02:43.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:02:43.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:02:43.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:02:43.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:02:43.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:02:43.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:02:43.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:02:43.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:02:43.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:02:43.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:02:43.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:02:43.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:02:43.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:02:43.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:02:43.512 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.512 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.512 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.512 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:43.513 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:43.513 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.321221430999998, 2024-04-25T22:02:43.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:02:43.513 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.513 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.513 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.513 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:43.513 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:43.513 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:43.513 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:02:43.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.513 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:43.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:43.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:02:43.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:02:43.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:02:43.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:02:43.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:02:43.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:02:43.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:02:43.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:02:43.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:02:43.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:02:43.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:02:43.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:02:43.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:02:43.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:02:43.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:02:43.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:02:43.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:02:43.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:02:43.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:02:43.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:02:43.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:02:43.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:02:43.518 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.518 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.518 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.519 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:43.519 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:43.519 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.321164906000007, 2024-04-25T22:02:43.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:43.519 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.519 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.519 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.519 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:43.519 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:43.519 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:43.519 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:43.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.519 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:43.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:43.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:43.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:43.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:43.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:43.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:43.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:43.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:43.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:43.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:43.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:43.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:43.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:43.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:43.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:43.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:43.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:43.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:43.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:43.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:43.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:43.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:43.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:43.524 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.524 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.524 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.524 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:43.524 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:43.524 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.320969664000003, 2024-04-25T22:02:43.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:43.525 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.525 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.525 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.525 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:43.525 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:43.525 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:43.525 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:43.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.525 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:43.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:43.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:43.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:43.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:43.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:43.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:43.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:43.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:43.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:43.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:43.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:43.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:43.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:43.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:43.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:43.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:43.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:43.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:43.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:43.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:43.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:43.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:43.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:43.530 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.530 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.530 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.530 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:43.531 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:43.531 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.320907371000004, 2024-04-25T22:02:43.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:43.531 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.531 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.531 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.531 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:43.531 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:43.531 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:43.531 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:43.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.531 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:43.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:43.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:43.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:43.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:43.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:43.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:43.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:43.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:43.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:43.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:43.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:43.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:43.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:43.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:43.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:43.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:43.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:43.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:43.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:43.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:43.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:43.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:43.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:43.536 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.536 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.536 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.537 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:43.537 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:43.537 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.320847154999996, 2024-04-25T22:02:43.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:43.537 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.537 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.537 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.537 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:43.537 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:43.537 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:43.537 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:43.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.537 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:43.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:43.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:43.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:43.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:43.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:43.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:43.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:43.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:43.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:43.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:43.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:43.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:43.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:43.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:43.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:43.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:43.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:43.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:43.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:43.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:43.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:43.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:43.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:43.542 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.542 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.542 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.543 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:43.543 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:43.543 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.320657643000004, 2024-04-25T22:02:43.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:43.543 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.543 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.543 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.543 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:43.543 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:43.543 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:43.543 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:43.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.543 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:43.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:43.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:43.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:43.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:43.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:43.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:43.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:43.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:43.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:43.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:43.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:43.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:43.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:43.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:43.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:43.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:43.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:43.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:43.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:43.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:43.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:43.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:43.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:43.548 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.548 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.548 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.548 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:43.548 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:43.548 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.129319808999995, 2024-04-25T22:02:43.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:02:43.548 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.549 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.549 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.549 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:43.549 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:43.549 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:43.549 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:02:43.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.549 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:43.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:43.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:02:43.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:02:43.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:02:43.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:02:43.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:02:43.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:02:43.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:02:43.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:02:43.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:02:43.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:02:43.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:02:43.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:02:43.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:02:43.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:02:43.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:02:43.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:02:43.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:02:43.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:02:43.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:02:43.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:02:43.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:02:43.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:02:43.553 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.553 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.553 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.554 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:43.554 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:43.554 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.129281431999999, 2024-04-25T22:02:43.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:02:43.554 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.554 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.554 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.554 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:43.554 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:43.554 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:43.554 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:02:43.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.554 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:43.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.555 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:43.497+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:43.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:43.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:02:43.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:02:43.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:02:43.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:02:43.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:02:43.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:02:43.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:02:43.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:02:43.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:02:43.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:02:43.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:02:43.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:02:43.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:02:43.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:02:43.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:02:43.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:02:43.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:02:43.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:02:43.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:02:43.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:02:43.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:02:43.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:02:43.560 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.560 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.560 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.560 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:43.560 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:43.560 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.129230172999996, 2024-04-25T22:02:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:02:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:02:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:02:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:02:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:02:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:02:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:02:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:02:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:02:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:02:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:02:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:02:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:02:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:02:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:02:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:02:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:02:43.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:02:43.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:02:43.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:02:43.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:02:43.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:02:43.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:02:43.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:02:43.566 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.566 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.566 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.566 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:43.566 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:43.566 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.129081524, 2024-04-25T22:02:43.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:02:43.567 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.567 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.567 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.567 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:43.567 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:43.567 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:43.567 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:02:43.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.567 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:43.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:43.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:02:43.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:02:43.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:02:43.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:02:43.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:02:43.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:02:43.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:02:43.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:02:43.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:02:43.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:02:43.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:02:43.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:02:43.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:02:43.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:02:43.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:02:43.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:02:43.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:02:43.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:02:43.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:02:43.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:02:43.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:02:43.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:02:43.572 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.572 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.572 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.572 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:43.572 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:43.572 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.129039374000001, 2024-04-25T22:02:43.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:02:43.572 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.572 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.573 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.573 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:43.573 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:43.573 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:43.573 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:02:43.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.573 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:43.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:43.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:02:43.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:02:43.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:02:43.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:02:43.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:02:43.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:02:43.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:02:43.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:02:43.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:02:43.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:02:43.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:02:43.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:02:43.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:02:43.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:02:43.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:02:43.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:02:43.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:02:43.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:02:43.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:02:43.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:02:43.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:02:43.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:02:43.577 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.577 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.577 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.578 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:43.578 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:43.578 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.129001521000006, 2024-04-25T22:02:43.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:43.578 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.578 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.578 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.578 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:43.578 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:43.578 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:43.578 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:43.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.578 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:43.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:43.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:43.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:43.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:43.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:43.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:43.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:43.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:43.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:43.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:43.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:43.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:43.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:43.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:43.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:43.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:43.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:43.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:43.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:43.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:43.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:43.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:43.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:43.583 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.583 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.583 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.583 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:43.583 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:43.583 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.128792196000006, 2024-04-25T22:02:43.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:43.583 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.583 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.583 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.583 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:43.583 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:43.583 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:43.584 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:43.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.584 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:43.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:43.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:43.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:43.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:43.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:43.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:43.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:43.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:43.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:43.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:43.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:43.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:43.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:43.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:43.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:43.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:43.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:43.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:43.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:43.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:43.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:43.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:43.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:43.588 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.588 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.588 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.589 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:43.589 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:43.589 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.862540924000001, 2024-04-25T22:02:43.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:02:43.589 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.589 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.589 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.589 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:43.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:43.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:02:43.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:43.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:02:43.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:02:43.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:02:43.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:02:43.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:02:43.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:02:43.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:02:43.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:02:43.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:02:43.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:02:43.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:02:43.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:02:43.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:02:43.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:02:43.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:02:43.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:02:43.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:02:43.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:02:43.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:02:43.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:02:43.594 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.594 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.594 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.594 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:43.594 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:43.594 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.862507084000001, 2024-04-25T22:02:43.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:02:43.594 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.594 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.594 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.594 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:43.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:43.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:43.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:02:43.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:02:43.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:02:43.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:02:43.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:02:43.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:02:43.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:02:43.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:02:43.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:02:43.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:02:43.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:02:43.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:02:43.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:02:43.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:02:43.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:02:43.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:43.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:02:43.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:02:43.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:02:43.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:02:43.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:02:43.599 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.599 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.599 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.599 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:43.599 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:43.599 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.862455388000001, 2024-04-25T22:02:43.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:02:43.600 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.600 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.600 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.600 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:43.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:43.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:02:43.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:02:43.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:02:43.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:02:43.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:02:43.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:02:43.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:02:43.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:02:43.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:02:43.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:02:43.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:02:43.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:02:43.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:02:43.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:02:43.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:02:43.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:02:43.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:02:43.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:02:43.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:02:43.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:02:43.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:02:43.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:02:43.604 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.604 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.604 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.604 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:43.604 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:43.604 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.862310936, 2024-04-25T22:02:43.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:02:43.605 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.605 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.605 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.605 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:43.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:43.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:02:43.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:02:43.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:02:43.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:02:43.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:02:43.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:02:43.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:02:43.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:02:43.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:02:43.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:02:43.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:02:43.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:02:43.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:02:43.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:02:43.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:02:43.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:02:43.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:02:43.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:02:43.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:02:43.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:02:43.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:02:43.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:02:43.609 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.610 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.610 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.610 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:43.610 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:43.610 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.862254215999997, 2024-04-25T22:02:43.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:02:43.610 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:43.610 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:43.610 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:43.610 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:43.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:43.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:43.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:43.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:43.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:43.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:43.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:02:43.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:02:43.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:43.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:02:43.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:02:43.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:43.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:02:43.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:02:43.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:43.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:02:43.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:02:43.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:43.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:02:43.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:02:43.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:43.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:02:43.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:02:43.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:43.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:02:43.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:02:43.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:43.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:02:43.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:02:43.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:43.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:02:43.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:02:43.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:43.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:02:43.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:02:43.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:43.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:43.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:43.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:02:43.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:02:43.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.615 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:43.615 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:43.615 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:43.616 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:43.617 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:43.613+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:43.677 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:02:43.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:43.714+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:43.746 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:43.746 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:43.747 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:02:43.747 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:43.761 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:43.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:43.846+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:43.885 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:43.886 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:43.920 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:43.920 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:43.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:43.918+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:43.930 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:43.930 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:43.944 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:43.953 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:43.954 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:44.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:44.030+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:44.104 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:44.104 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:44.118 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:44.164 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:44.161+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:44.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:44.218+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:44.248 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:44.249 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:44.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:44.324 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:44.321+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:44.425 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:44.421+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:44.426 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:44.427 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:44.441 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:44.526 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:44.525+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:44.608 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:44.608 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:44.623 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:44.627 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:44.621+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:44.728 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:44.721+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:44.758 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:44.758 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:44.774 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:44.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:44.830+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:44.859 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:02:44.899 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:44.900 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:44.914 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:44.961 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:44.957+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:45.032 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:45.029+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:45.034 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:45.034 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:45.049 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:45.134 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:45.133+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:45.182 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:45.182 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:45.197 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:45.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:45.242+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:45.320 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:45.320 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:45.335 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:45.336 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:45.333+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:45.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:45.434+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:45.503 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:45.504 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:45.518 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:45.537 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:45.533+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:45.637 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:45.633+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:45.650 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:45.650 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:45.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:45.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:45.734+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:45.787 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:45.787 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:45.803 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:45.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:45.838+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:45.842 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-25T22:02:45.925 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:45.926 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:45.940 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:45.933+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:45.940 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:45.975 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:02:46.040 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:46.033+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:46.075 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:46.075 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:46.089 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:46.141 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:46.137+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:46.172 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:46.172 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:46.206 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:46.206 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:46.209 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:46.209 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:46.209 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:46.209 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:46.209 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:46.223 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:46.239 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:46.239 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:46.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:46.238+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:46.343 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:46.342+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:46.398 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.399765045, 2024-04-25T22:02:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:02:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:02:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:02:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:02:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:02:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:02:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:02:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:02:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:02:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:02:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:02:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:02:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:02:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:02:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:02:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:02:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:02:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:02:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:02:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:02:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:02:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:02:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:02:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:02:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.217701972, 2024-04-25T22:02:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:02:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:02:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:02:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:02:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:02:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:02:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:02:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:02:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:02:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:02:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:02:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:02:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:02:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:02:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:02:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:02:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:02:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:02:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:02:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:02:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:02:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:02:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:02:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:02:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.217657692, 2024-04-25T22:02:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:02:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:02:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:02:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:02:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:02:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:02:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:02:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:02:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:02:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:02:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:02:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:02:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:02:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:02:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:02:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:02:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:02:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:02:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:02:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:02:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:02:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:02:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:02:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:02:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.217601167, 2024-04-25T22:02:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.21740592499999, 2024-04-25T22:02:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.217343632, 2024-04-25T22:02:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.217283416, 2024-04-25T22:02:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.217093904, 2024-04-25T22:02:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.02575607, 2024-04-25T22:02:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:02:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:02:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:02:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:02:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:02:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:02:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:02:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:02:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:02:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:02:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:02:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:02:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:02:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:02:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:02:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:02:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:02:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:02:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:02:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:02:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:02:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:02:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:02:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:02:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.025717693, 2024-04-25T22:02:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:02:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:02:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:02:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:02:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:02:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:02:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:02:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:02:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:02:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:02:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:02:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:02:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:02:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:02:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:02:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:02:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:02:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:02:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:02:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:02:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:02:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:02:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:02:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:02:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.025666434, 2024-04-25T22:02:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:02:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:02:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:02:46.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:02:46.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:02:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:02:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:02:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:02:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:02:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:02:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:02:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:02:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:02:46.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:02:46.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:02:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:02:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:02:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:02:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:02:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:02:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:02:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:02:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:02:46.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:02:46.470 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.470 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.470 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.02551778500001, 2024-04-25T22:02:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:02:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:02:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:02:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:02:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:02:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:02:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:02:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:02:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:02:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:02:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:02:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:02:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:02:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:02:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:02:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:02:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:02:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:02:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:02:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:02:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:02:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:02:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:02:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:02:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.02547563500001, 2024-04-25T22:02:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:02:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:02:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:02:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:02:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:02:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:02:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:02:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:02:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:02:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:02:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:02:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:02:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:02:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:02:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:02:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:02:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:02:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:02:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:02:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:02:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:02:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:02:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:02:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:02:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.025437782, 2024-04-25T22:02:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.025228457, 2024-04-25T22:02:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.758977185000006, 2024-04-25T22:02:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:02:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:02:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:02:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:02:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:02:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:02:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:02:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:02:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:02:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:02:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:02:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:02:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:02:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:02:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:02:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:02:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:02:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:02:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:02:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:02:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:02:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:02:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.758943345000006, 2024-04-25T22:02:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:02:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:02:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:02:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:02:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:02:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:02:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:02:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:02:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:02:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:02:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:02:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:02:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:02:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:02:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:02:46.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:02:46.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:46.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:02:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:02:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:02:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:02:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:02:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.758891649000006, 2024-04-25T22:02:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:02:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:02:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:02:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:02:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:02:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:02:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:02:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:02:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:02:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:02:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:02:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:02:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:02:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:02:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:02:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:02:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:02:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:02:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:02:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:02:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:02:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:02:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:02:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.758747197000005, 2024-04-25T22:02:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:02:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:02:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:02:46.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:02:46.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:02:46.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:02:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:02:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:02:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:02:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:02:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:02:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:02:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:02:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:02:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:02:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:02:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:02:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:02:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:02:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:02:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:02:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:02:46.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:02:46.517 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.517 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.517 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.517 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:46.517 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:46.518 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.758690477000002, 2024-04-25T22:02:46.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:02:46.518 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:46.518 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:46.518 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:46.518 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:46.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:46.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:46.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:46.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:02:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:02:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:02:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:02:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:02:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:02:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:02:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:02:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:02:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:02:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:02:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:02:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:02:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:02:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:02:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:02:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:02:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:02:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:02:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:02:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:46.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:46.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:46.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:02:46.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:02:46.524 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.524 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.524 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.524 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:46.524 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:46.524 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:46.526 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:46.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:46.526+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:46.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:46.622+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:46.657 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:02:46.657 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:46.671 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:46.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:46.758+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:46.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:46.826+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:46.838 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:46.839 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:46.839 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:02:46.839 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:02:46.839 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:46.853 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:46.929 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:46.925+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:47.019 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:02:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:02:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:02:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 4 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:27 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:02:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 92.378654554999997, 2024-04-25T22:02:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013281644, 2024-04-25T22:02:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637801+0000", 2024-04-25T22:02:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1299999999999998e-07 2024-04-25T22:02:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637828+0000", 2024-04-25T22:02:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6953000000000001e-05 2024-04-25T22:02:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637873+0000", 2024-04-25T22:02:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4676999999999999e-05 2024-04-25T22:02:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637917+0000", 2024-04-25T22:02:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4815999999999999e-05 2024-04-25T22:02:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644220+0000", 2024-04-25T22:02:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063021049999999997 2024-04-25T22:02:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651082+0000", 2024-04-25T22:02:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068621799999999998 2024-04-25T22:02:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:15 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 92.373246942999998, 2024-04-25T22:02:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010973732, 2024-04-25T22:02:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643209+0000", 2024-04-25T22:02:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.003e-06 2024-04-25T22:02:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643230+0000", 2024-04-25T22:02:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0815999999999999e-05 2024-04-25T22:02:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643252+0000", 2024-04-25T22:02:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2586999999999999e-05 2024-04-25T22:02:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643271+0000", 2024-04-25T22:02:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8493000000000001e-05 2024-04-25T22:02:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644387+0000", 2024-04-25T22:02:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011160250000000001 2024-04-25T22:02:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644434+0000", 2024-04-25T22:02:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:02:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654103+0000", 2024-04-25T22:02:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096691360000000001 2024-04-25T22:02:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654181+0000", 2024-04-25T22:02:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8546000000000003e-05 2024-04-25T22:02:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 92.373146586999994, 2024-04-25T22:02:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088132450000000008, 2024-04-25T22:02:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643309+0000", 2024-04-25T22:02:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9600000000000008e-07 2024-04-25T22:02:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643339+0000", 2024-04-25T22:02:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9467000000000001e-05 2024-04-25T22:02:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644245+0000", 2024-04-25T22:02:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090648200000000001 2024-04-25T22:02:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644268+0000", 2024-04-25T22:02:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3017e-05 2024-04-25T22:02:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647517+0000", 2024-04-25T22:02:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032491680000000002 2024-04-25T22:02:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647561+0000", 2024-04-25T22:02:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3630000000000001e-05 2024-04-25T22:02:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652041+0000", 2024-04-25T22:02:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044804529999999997 2024-04-25T22:02:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652121+0000", 2024-04-25T22:02:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0031999999999995e-05 2024-04-25T22:02:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:34 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 92.371057960000002, 2024-04-25T22:02:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089225940000000007, 2024-04-25T22:02:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645398+0000", 2024-04-25T22:02:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4360000000000001e-06 2024-04-25T22:02:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645412+0000", 2024-04-25T22:02:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4283e-05 2024-04-25T22:02:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645434+0000", 2024-04-25T22:02:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1237e-05 2024-04-25T22:02:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645459+0000", 2024-04-25T22:02:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5675999999999999e-05 2024-04-25T22:02:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646081+0000", 2024-04-25T22:02:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062128900000000002 2024-04-25T22:02:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646131+0000", 2024-04-25T22:02:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0322999999999999e-05 2024-04-25T22:02:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654185+0000", 2024-04-25T22:02:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080542749999999996 2024-04-25T22:02:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654319+0000", 2024-04-25T22:02:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013407499999999999 2024-04-25T22:02:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:19 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 92.370956450999998, 2024-04-25T22:02:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076631340000000003, 2024-04-25T22:02:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645499+0000", 2024-04-25T22:02:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4300000000000001e-07 2024-04-25T22:02:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645509+0000", 2024-04-25T22:02:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0244000000000001e-05 2024-04-25T22:02:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645523+0000", 2024-04-25T22:02:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3315999999999999e-05 2024-04-25T22:02:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645531+0000", 2024-04-25T22:02:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.123e-06 2024-04-25T22:02:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648260+0000", 2024-04-25T22:02:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027289789999999999 2024-04-25T22:02:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648307+0000", 2024-04-25T22:02:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6969999999999999e-05 2024-04-25T22:02:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653039+0000", 2024-04-25T22:02:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047322299999999996 2024-04-25T22:02:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653161+0000", 2024-04-25T22:02:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012232899999999999 2024-04-25T22:02:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 92.36897879, 2024-04-25T22:02:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01271303, 2024-04-25T22:02:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647479+0000", 2024-04-25T22:02:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.286e-06 2024-04-25T22:02:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647494+0000", 2024-04-25T22:02:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.521e-05 2024-04-25T22:02:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647525+0000", 2024-04-25T22:02:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0403999999999999e-05 2024-04-25T22:02:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647544+0000", 2024-04-25T22:02:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8743e-05 2024-04-25T22:02:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647895+0000", 2024-04-25T22:02:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035099699999999997 2024-04-25T22:02:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648202+0000", 2024-04-25T22:02:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030758499999999998 2024-04-25T22:02:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648496+0000", 2024-04-25T22:02:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029370699999999999 2024-04-25T22:02:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654605+0000", 2024-04-25T22:02:47.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061095999999999998 2024-04-25T22:02:47.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:47.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.659959+0000", 2024-04-25T22:02:47.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053531680000000002 2024-04-25T22:02:47.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:47.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660078+0000", 2024-04-25T22:02:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011981600000000001 2024-04-25T22:02:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660189+0000", 2024-04-25T22:02:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011051400000000001 2024-04-25T22:02:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 92.368854698000007, 2024-04-25T22:02:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013053006000000001, 2024-04-25T22:02:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647602+0000", 2024-04-25T22:02:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.604e-06 2024-04-25T22:02:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647611+0000", 2024-04-25T22:02:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5689999999999994e-06 2024-04-25T22:02:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647634+0000", 2024-04-25T22:02:47.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3227e-05 2024-04-25T22:02:47.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647660+0000", 2024-04-25T22:02:47.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5829999999999998e-05 2024-04-25T22:02:47.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649544+0000", 2024-04-25T22:02:47.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001884066 2024-04-25T22:02:47.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:47.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649783+0000", 2024-04-25T22:02:47.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238411 2024-04-25T22:02:47.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:47.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.650794+0000", 2024-04-25T22:02:47.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010109920000000001 2024-04-25T22:02:47.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654714+0000", 2024-04-25T22:02:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039202170000000001 2024-04-25T22:02:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660403+0000", 2024-04-25T22:02:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056895940000000001 2024-04-25T22:02:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660551+0000", 2024-04-25T22:02:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014717899999999999 2024-04-25T22:02:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660653+0000", 2024-04-25T22:02:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102317 2024-04-25T22:02:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:17 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 92.368770518000005, 2024-04-25T22:02:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010101435000000001, 2024-04-25T22:02:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:47.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:47.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647686+0000", 2024-04-25T22:02:47.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-04-25T22:02:47.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647693+0000", 2024-04-25T22:02:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7330000000000003e-06 2024-04-25T22:02:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647711+0000", 2024-04-25T22:02:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7436e-05 2024-04-25T22:02:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647727+0000", 2024-04-25T22:02:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6232999999999999e-05 2024-04-25T22:02:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649249+0000", 2024-04-25T22:02:47.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015219890000000001 2024-04-25T22:02:47.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:47.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649533+0000", 2024-04-25T22:02:47.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028391799999999997 2024-04-25T22:02:47.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:47.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649841+0000", 2024-04-25T22:02:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030853400000000001 2024-04-25T22:02:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654622+0000", 2024-04-25T22:02:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047809630000000001 2024-04-25T22:02:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657616+0000", 2024-04-25T22:02:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029938769999999998 2024-04-25T22:02:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657724+0000", 2024-04-25T22:02:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108109 2024-04-25T22:02:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657786+0000", 2024-04-25T22:02:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1196000000000002e-05 2024-04-25T22:02:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 92.368582189999998, 2024-04-25T22:02:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010260877999999999, 2024-04-25T22:02:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647874+0000", 2024-04-25T22:02:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:02:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647884+0000", 2024-04-25T22:02:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.013e-05 2024-04-25T22:02:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647908+0000", 2024-04-25T22:02:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3592999999999999e-05 2024-04-25T22:02:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647926+0000", 2024-04-25T22:02:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8176999999999999e-05 2024-04-25T22:02:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651480+0000", 2024-04-25T22:02:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035540160000000001 2024-04-25T22:02:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651690+0000", 2024-04-25T22:02:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210249 2024-04-25T22:02:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651986+0000", 2024-04-25T22:02:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000296001 2024-04-25T22:02:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655696+0000", 2024-04-25T22:02:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037098410000000002 2024-04-25T22:02:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657896+0000", 2024-04-25T22:02:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022004630000000002 2024-04-25T22:02:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658035+0000", 2024-04-25T22:02:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013831499999999999 2024-04-25T22:02:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658133+0000", 2024-04-25T22:02:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8553000000000003e-05 2024-04-25T22:02:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:18 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 92.368503309999994, 2024-04-25T22:02:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013108712, 2024-04-25T22:02:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647953+0000", 2024-04-25T22:02:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.697e-06 2024-04-25T22:02:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647963+0000", 2024-04-25T22:02:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9259999999999995e-06 2024-04-25T22:02:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647982+0000", 2024-04-25T22:02:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-04-25T22:02:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648008+0000", 2024-04-25T22:02:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5956e-05 2024-04-25T22:02:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651686+0000", 2024-04-25T22:02:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678073 2024-04-25T22:02:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:47.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652023+0000", 2024-04-25T22:02:47.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033739399999999998 2024-04-25T22:02:47.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:47.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652348+0000", 2024-04-25T22:02:47.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032475000000000001 2024-04-25T22:02:47.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:47.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655883+0000", 2024-04-25T22:02:47.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035353030000000001 2024-04-25T22:02:47.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:47.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660791+0000", 2024-04-25T22:02:47.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049075330000000004 2024-04-25T22:02:47.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:47.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660930+0000", 2024-04-25T22:02:47.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000139856 2024-04-25T22:02:47.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661060+0000", 2024-04-25T22:02:47.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000129651 2024-04-25T22:02:47.069 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.069 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.069 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.070 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:47.070 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:47.070 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 92.368426417999999, 2024-04-25T22:02:47.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012451034, 2024-04-25T22:02:47.070 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.070 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.070 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648030+0000", 2024-04-25T22:02:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-04-25T22:02:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648036+0000", 2024-04-25T22:02:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8059999999999997e-06 2024-04-25T22:02:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648054+0000", 2024-04-25T22:02:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7744000000000002e-05 2024-04-25T22:02:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648070+0000", 2024-04-25T22:02:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-04-25T22:02:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648875+0000", 2024-04-25T22:02:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080444000000000002 2024-04-25T22:02:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649078+0000", 2024-04-25T22:02:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020391499999999999 2024-04-25T22:02:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649674+0000", 2024-04-25T22:02:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00059555299999999997 2024-04-25T22:02:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653185+0000", 2024-04-25T22:02:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035113459999999998 2024-04-25T22:02:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660251+0000", 2024-04-25T22:02:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070661350000000003 2024-04-25T22:02:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660382+0000", 2024-04-25T22:02:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013095899999999999 2024-04-25T22:02:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660479+0000", 2024-04-25T22:02:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6852e-05 2024-04-25T22:02:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:25 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 92.368360605000007, 2024-04-25T22:02:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012691025999999999, 2024-04-25T22:02:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648095+0000", 2024-04-25T22:02:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.424e-06 2024-04-25T22:02:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648102+0000", 2024-04-25T22:02:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2099999999999998e-06 2024-04-25T22:02:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648122+0000", 2024-04-25T22:02:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0242999999999999e-05 2024-04-25T22:02:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648138+0000", 2024-04-25T22:02:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6192999999999999e-05 2024-04-25T22:02:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651461+0000", 2024-04-25T22:02:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033225709999999999 2024-04-25T22:02:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651776+0000", 2024-04-25T22:02:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031567500000000002 2024-04-25T22:02:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660785+0000", 2024-04-25T22:02:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090087099999999996 2024-04-25T22:02:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 92.368298119000002, 2024-04-25T22:02:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013102702000000001, 2024-04-25T22:02:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648158+0000", 2024-04-25T22:02:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2839999999999999e-06 2024-04-25T22:02:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648163+0000", 2024-04-25T22:02:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-04-25T22:02:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648181+0000", 2024-04-25T22:02:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8484000000000001e-05 2024-04-25T22:02:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648196+0000", 2024-04-25T22:02:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4496e-05 2024-04-25T22:02:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653737+0000", 2024-04-25T22:02:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055414009999999996 2024-04-25T22:02:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653972+0000", 2024-04-25T22:02:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000234732 2024-04-25T22:02:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661259+0000", 2024-04-25T22:02:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072872689999999999 2024-04-25T22:02:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 92.368241299000005, 2024-04-25T22:02:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086984829999999999, 2024-04-25T22:02:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648214+0000", 2024-04-25T22:02:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-04-25T22:02:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648233+0000", 2024-04-25T22:02:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.878e-05 2024-04-25T22:02:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648252+0000", 2024-04-25T22:02:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8603000000000001e-05 2024-04-25T22:02:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648267+0000", 2024-04-25T22:02:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:02:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648846+0000", 2024-04-25T22:02:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057923000000000002 2024-04-25T22:02:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649027+0000", 2024-04-25T22:02:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181585 2024-04-25T22:02:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.656912+0000", 2024-04-25T22:02:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078844589999999999 2024-04-25T22:02:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 6 lcod 17'2)", 2024-04-25T22:02:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 92.356311383000005, 2024-04-25T22:02:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064966000000000004, 2024-04-25T22:02:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:47.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660144+0000", 2024-04-25T22:02:47.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1800000000000005e-07 2024-04-25T22:02:47.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660181+0000", 2024-04-25T22:02:47.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6408000000000001e-05 2024-04-25T22:02:47.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660197+0000", 2024-04-25T22:02:47.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6177000000000001e-05 2024-04-25T22:02:47.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660210+0000", 2024-04-25T22:02:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:02:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660556+0000", 2024-04-25T22:02:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034612899999999998 2024-04-25T22:02:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660793+0000", 2024-04-25T22:02:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023656799999999999 2024-04-25T22:02:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:18 3.1f e17/15 ondisk, result = 0)", 2024-04-25T22:02:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 92.356049609999999, 2024-04-25T22:02:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067878299999999997, 2024-04-25T22:02:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660406+0000", 2024-04-25T22:02:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2800000000000005e-07 2024-04-25T22:02:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660412+0000", 2024-04-25T22:02:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0399999999999998e-06 2024-04-25T22:02:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660429+0000", 2024-04-25T22:02:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7394e-05 2024-04-25T22:02:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660445+0000", 2024-04-25T22:02:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6069000000000001e-05 2024-04-25T22:02:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660757+0000", 2024-04-25T22:02:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031194300000000002 2024-04-25T22:02:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660776+0000", 2024-04-25T22:02:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8862999999999999e-05 2024-04-25T22:02:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661084+0000", 2024-04-25T22:02:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030754600000000001 2024-04-25T22:02:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-25T22:02:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 92.355985382, 2024-04-25T22:02:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080007600000000004, 2024-04-25T22:02:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660470+0000", 2024-04-25T22:02:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4499999999999996e-07 2024-04-25T22:02:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660475+0000", 2024-04-25T22:02:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-04-25T22:02:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660490+0000", 2024-04-25T22:02:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5274e-05 2024-04-25T22:02:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660501+0000", 2024-04-25T22:02:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0694e-05 2024-04-25T22:02:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661130+0000", 2024-04-25T22:02:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062887499999999999 2024-04-25T22:02:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661269+0000", 2024-04-25T22:02:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013955900000000001 2024-04-25T22:02:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:02:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 90.392253382999996, 2024-04-25T22:02:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037104880000000001, 2024-04-25T22:02:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:47.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624204+0000", 2024-04-25T22:02:47.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.757e-06 2024-04-25T22:02:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624233+0000", 2024-04-25T22:02:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9362000000000001e-05 2024-04-25T22:02:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624264+0000", 2024-04-25T22:02:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0843000000000003e-05 2024-04-25T22:02:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624280+0000", 2024-04-25T22:02:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5577e-05 2024-04-25T22:02:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624458+0000", 2024-04-25T22:02:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017821199999999999 2024-04-25T22:02:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624661+0000", 2024-04-25T22:02:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020283200000000001 2024-04-25T22:02:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624842+0000", 2024-04-25T22:02:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018115500000000001 2024-04-25T22:02:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.626271+0000", 2024-04-25T22:02:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001429416 2024-04-25T22:02:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627749+0000", 2024-04-25T22:02:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014778650000000001 2024-04-25T22:02:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627849+0000", 2024-04-25T22:02:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9261999999999999e-05 2024-04-25T22:02:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627912+0000", 2024-04-25T22:02:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3207000000000007e-05 2024-04-25T22:02:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-25T22:02:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.389556032000002, 2024-04-25T22:02:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029804620000000001, 2024-04-25T22:02:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626903+0000", 2024-04-25T22:02:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0029999999999996e-06 2024-04-25T22:02:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626921+0000", 2024-04-25T22:02:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8272999999999999e-05 2024-04-25T22:02:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626959+0000", 2024-04-25T22:02:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7843999999999999e-05 2024-04-25T22:02:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626977+0000", 2024-04-25T22:02:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7756000000000001e-05 2024-04-25T22:02:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627153+0000", 2024-04-25T22:02:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017643800000000001 2024-04-25T22:02:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627425+0000", 2024-04-25T22:02:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027207300000000001 2024-04-25T22:02:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627848+0000", 2024-04-25T22:02:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042297199999999997 2024-04-25T22:02:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629590+0000", 2024-04-25T22:02:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017416809999999999 2024-04-25T22:02:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629720+0000", 2024-04-25T22:02:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130526 2024-04-25T22:02:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629808+0000", 2024-04-25T22:02:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7449999999999998e-05 2024-04-25T22:02:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629879+0000", 2024-04-25T22:02:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1445999999999993e-05 2024-04-25T22:02:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4185.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-04-25T22:02:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 49.401447961999999, 2024-04-25T22:02:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0036257939999999999, 2024-04-25T22:02:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4185", 2024-04-25T22:02:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.44:0/2048337248", 2024-04-25T22:02:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2 2024-04-25T22:02:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615010+0000", 2024-04-25T22:02:47.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8059999999999999e-06 2024-04-25T22:02:47.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:47.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615023+0000", 2024-04-25T22:02:47.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3159999999999999e-05 2024-04-25T22:02:47.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615043+0000", 2024-04-25T22:02:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:02:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615059+0000", 2024-04-25T22:02:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5519000000000002e-05 2024-04-25T22:02:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615241+0000", 2024-04-25T22:02:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018207100000000001 2024-04-25T22:02:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:02:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615258+0000", 2024-04-25T22:02:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7278999999999998e-05 2024-04-25T22:02:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618429+0000", 2024-04-25T22:02:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003171213 2024-04-25T22:02:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618633+0000", 2024-04-25T22:02:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020343999999999999 2024-04-25T22:02:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:47.113 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:47.113 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:47.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:47.115 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:47.113+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:47.215 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:47.209+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:47.246 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:47.246 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:47.247 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:02:47.247 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:47.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:47.316 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:47.313+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:47.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:47.414+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:47.427 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:02:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:02:47.428 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:47.442 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:47.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:47.518+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:47.567 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:47.567 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:47.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:47.567 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:47.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.567 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:47.567 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:47.567 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.737777118, 2024-04-25T22:02:47.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:47.568 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.568 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.568 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:47.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:47.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:47.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:47.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:47.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:47.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:47.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:47.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:47.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:47.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:47.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:47.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:47.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:47.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:47.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:47.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:47.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:47.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:47.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.571 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.572 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.572 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:47.572 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:47.572 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.7370463, 2024-04-25T22:02:47.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:47.572 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.572 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.572 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.572 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:47.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:47.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:47.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:47.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:47.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:47.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:47.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:47.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:47.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:47.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:47.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:47.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:47.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:47.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:47.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:47.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:47.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:47.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:47.576 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.576 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.576 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.577 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:47.577 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:47.577 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.736380029, 2024-04-25T22:02:47.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:47.577 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.577 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.577 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:47.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:47.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:47.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:47.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:47.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:47.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:47.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:47.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:47.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:47.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:47.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:47.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:47.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:47.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:47.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:47.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:47.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:47.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:47.580 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.580 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.581 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:47.581 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:47.581 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.735480129, 2024-04-25T22:02:47.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:47.581 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.581 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.581 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.581 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:47.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:47.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:47.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:47.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:47.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:47.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:47.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:47.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:47.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:47.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:47.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:47.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:47.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:47.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:47.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:47.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:47.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:47.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:47.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.585 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.585 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:47.585 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:47.585 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.733443788, 2024-04-25T22:02:47.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:47.585 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.585 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.585 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:47.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:47.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:47.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:47.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:47.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:47.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:47.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:47.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:47.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:47.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:47.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:47.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:47.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:47.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:47.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:47.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:47.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:47.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:47.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.589 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.589 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:47.589 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:47.589 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.732980451, 2024-04-25T22:02:47.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:47.589 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.590 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.590 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:47.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:47.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:47.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:47.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:47.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:47.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:47.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:47.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:47.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:47.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:47.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:47.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.732113572, 2024-04-25T22:02:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.73166249800001, 2024-04-25T22:02:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.604 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:47.604 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:47.604 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.731212912, 2024-04-25T22:02:47.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:47.604 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.604 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:47.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:47.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:47.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:47.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:47.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:47.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:47.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:47.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:47.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:47.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:47.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:47.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:47.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:47.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:47.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:47.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:47.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:47.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:47.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.608 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.608 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:47.608 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:47.608 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.934556424999997, 2024-04-25T22:02:47.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:47.609 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.609 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.609 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:47.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:47.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:47.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:47.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:47.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:47.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:47.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:47.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:47.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:47.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:47.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:47.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:47.613 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.613 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.613 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.614 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:47.614 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:47.614 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.934432442000002, 2024-04-25T22:02:47.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:47.614 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.614 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.614 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.614 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:47.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:47.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:47.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:47.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:47.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:47.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:47.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:47.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:47.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:47.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:47.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:47.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:47.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:47.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:47.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:47.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:47.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:47.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:47.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:47.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:47.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:47.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:47.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:47.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:47.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:47.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:47.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:47.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.619 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.619 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:47.619 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:47.619 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.934358505999995, 2024-04-25T22:02:47.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:47.619 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.619 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.619 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.619 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:47.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:47.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:47.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:47.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:47.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:47.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:47.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:47.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:47.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:47.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:47.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:47.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:47.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:47.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:47.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:47.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:47.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:47.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:47.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:47.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:47.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:47.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:47.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:47.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:47.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:47.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:47.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:47.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.624 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.624 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:47.625 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:47.625 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.934242253999997, 2024-04-25T22:02:47.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:47.625 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.625 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.625 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:47.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:47.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:47.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:47.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:47.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:47.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:47.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:47.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:47.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:47.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:47.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:47.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:47.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:47.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:47.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:47.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:47.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:47.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:47.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:47.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:47.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:47.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:47.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:47.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:47.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:47.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:47.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:47.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.630 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.630 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:47.630 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:47.630 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.934078845000002, 2024-04-25T22:02:47.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:47.630 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.630 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.630 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:47.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:47.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:47.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:47.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:47.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:47.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:47.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:47.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:47.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:47.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:47.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:47.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:47.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:47.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:47.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:47.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:47.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:47.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:47.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:47.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:47.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:47.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:47.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:47.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:47.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:47.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:47.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:47.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.635 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.635 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:47.635 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:47.635 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.933976649000002, 2024-04-25T22:02:47.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:47.635 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.635 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.635 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:47.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:47.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:47.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:47.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:47.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:47.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:47.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:47.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:47.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:47.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:47.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:47.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:47.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:47.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:47.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:47.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:47.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:47.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:47.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:47.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:47.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:47.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:47.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:47.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:47.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:47.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:47.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:47.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.641 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.641 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:47.641 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:47.641 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.933897696000002, 2024-04-25T22:02:47.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:47.641 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.642 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.642 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:47.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:47.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:47.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:47.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:47.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:47.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:47.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:47.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:47.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:47.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:47.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:47.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:47.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:47.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:47.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:47.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:47.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:47.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:47.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:47.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:47.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:47.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:47.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:47.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:47.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:47.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:47.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:47.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.647 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.647 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:47.647 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:47.647 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.933832672999998, 2024-04-25T22:02:47.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:47.647 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.647 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.647 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:47.647 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:47.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:47.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:47.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:47.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:47.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:47.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:47.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:47.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:47.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:47.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:47.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:47.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:47.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:47.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:47.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:47.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.651 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.651 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.651 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:47.651 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:47.651 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.933754480999994, 2024-04-25T22:02:47.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:47.651 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.651 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:47.651 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:47.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:47.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:47.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:47.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:47.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:47.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:47.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:47.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:47.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:47.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:47.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:47.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:47.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:47.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:47.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:47.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.655 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:47.655 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:47.655 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.919108021, 2024-04-25T22:02:47.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:47.655 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.655 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.655 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:47.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:47.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:47.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:47.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:47.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:47.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:47.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:47.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:47.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:47.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:47.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:47.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:47.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:47.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:47.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:47.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:47.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:47.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:47.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.659 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.659 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:47.659 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:47.659 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.918948064999995, 2024-04-25T22:02:47.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:47.659 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:47.660 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:47.660 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:47.660 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:47.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:47.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:47.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:47.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:47.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:47.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:47.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:47.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:47.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:47.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:47.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:47.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:47.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:47.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:47.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:47.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:47.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:47.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:47.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:47.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:47.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:47.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:47.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:47.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:47.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:47.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:47.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:47.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:47.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:47.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:47.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:47.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.663 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:47.663 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:47.663 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:47.665 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:47.661+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:47.665 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:47.765 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:47.761+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:47.801 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:47.801 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:47.801 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:47.801 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:47.817 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:47.856 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:02:47.856 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:02:47.856 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-25T22:02:47.856 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.000000 2024-04-25T22:02:47.856 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0 2024-04-25T22:02:47.866 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:47.861+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:47.869 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:02:47.943 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:47.943 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:47.943 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:47.943 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:47.943 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:47.957 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:47.967 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:47.965+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:48.067 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:48.065+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:48.135 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:48.135 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:48.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:48.135 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:48.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.135 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:48.135 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:48.135 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 102.13852684699999, 2024-04-25T22:02:48.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:02:48.135 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.135 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.136 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.136 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:48.136 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:48.136 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:48.136 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:02:48.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.136 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:48.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:48.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:02:48.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:02:48.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:02:48.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:02:48.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:02:48.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:02:48.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:02:48.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:02:48.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:02:48.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:02:48.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:02:48.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:02:48.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:02:48.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:02:48.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:02:48.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:02:48.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:02:48.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:02:48.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:02:48.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:02:48.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:02:48.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:02:48.141 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.141 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.141 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.141 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:48.141 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:48.141 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.956463774, 2024-04-25T22:02:48.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:02:48.141 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.142 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.142 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.142 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:48.142 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:48.142 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:48.142 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:02:48.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.142 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:48.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:48.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:02:48.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:02:48.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:02:48.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:02:48.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:02:48.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:02:48.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:02:48.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:02:48.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:02:48.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:02:48.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:02:48.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:02:48.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:02:48.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:02:48.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:02:48.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:02:48.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:02:48.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:02:48.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:02:48.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:02:48.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:02:48.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:02:48.147 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.147 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.147 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.147 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:48.147 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:48.147 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.956419494, 2024-04-25T22:02:48.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:02:48.147 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.147 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.147 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.147 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:48.148 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:48.148 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:48.148 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:02:48.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.148 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:48.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:48.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:02:48.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:02:48.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:02:48.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:02:48.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:02:48.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:02:48.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:02:48.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:02:48.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:02:48.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:02:48.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:02:48.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:02:48.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:02:48.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:02:48.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:02:48.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:02:48.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:02:48.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:02:48.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:02:48.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:02:48.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:02:48.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:02:48.152 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.152 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.152 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.152 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:48.153 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:48.153 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.956362969, 2024-04-25T22:02:48.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:48.153 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.153 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.153 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.153 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:48.153 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:48.153 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:48.153 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:48.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.153 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:48.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:48.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:48.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:48.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:48.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:48.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:48.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:48.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:48.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:48.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:48.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:48.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:48.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:48.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:48.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:48.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:48.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:48.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:48.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:48.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:48.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:48.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:48.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:48.157 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.157 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.157 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.158 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:48.158 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:48.158 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.95616772699999, 2024-04-25T22:02:48.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:48.158 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.158 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.158 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.158 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:48.158 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:48.158 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:48.158 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:48.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.158 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:48.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:48.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:48.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:48.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:48.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:48.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:48.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:48.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:48.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:48.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:48.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:48.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:48.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:48.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:48.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:48.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:48.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:48.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:48.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:48.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:48.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:48.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:48.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:48.163 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.163 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.163 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.163 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:48.163 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:48.163 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.95610543399999, 2024-04-25T22:02:48.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:48.164 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.164 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.164 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.164 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:48.164 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:48.164 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:48.164 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:48.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.164 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:48.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:48.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:48.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:48.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:48.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:48.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:48.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:48.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:48.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:48.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:48.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:48.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:48.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:48.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:48.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:48.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:48.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:48.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:48.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:48.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:48.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:48.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:48.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:48.168 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.168 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.168 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.169 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:48.169 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:48.169 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.956045218, 2024-04-25T22:02:48.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:48.169 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.169 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.169 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.169 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:48.169 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:48.169 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:48.169 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:48.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.169 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:48.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:48.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:48.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:48.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:48.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:48.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:48.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:48.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:48.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:48.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:48.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:48.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:48.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:48.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:48.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:48.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:48.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:48.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:48.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:48.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:48.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:48.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:48.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:48.174 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.174 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.174 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.174 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:48.174 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:48.174 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.95585570599999, 2024-04-25T22:02:48.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:48.174 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.174 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.174 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.174 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:48.174 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:48.175 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:48.175 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:48.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.175 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:48.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:48.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:48.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:48.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:48.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:48.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:48.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:48.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:48.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:48.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:48.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:48.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:48.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:48.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:48.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:48.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:48.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:48.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:48.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:48.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:48.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:48.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:48.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:48.179 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.179 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.179 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.179 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:48.179 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:48.179 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.764517872, 2024-04-25T22:02:48.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:02:48.179 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.179 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.180 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.180 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:48.180 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:48.180 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:48.180 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:02:48.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.180 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:48.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:48.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:02:48.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:02:48.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:02:48.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:02:48.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:02:48.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:02:48.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:02:48.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:02:48.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:02:48.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:02:48.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:02:48.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:02:48.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:02:48.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:02:48.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:02:48.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:02:48.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:02:48.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:02:48.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:02:48.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:02:48.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:02:48.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:02:48.184 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.184 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.184 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.185 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:48.185 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:48.185 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.764479495, 2024-04-25T22:02:48.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:02:48.185 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.185 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.185 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.185 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:48.185 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:48.185 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:48.185 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:02:48.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.185 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:48.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:48.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:02:48.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:02:48.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:02:48.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:02:48.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:02:48.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:02:48.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:02:48.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:02:48.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:02:48.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:02:48.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:02:48.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:02:48.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:02:48.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:02:48.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:02:48.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:02:48.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:02:48.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:02:48.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:02:48.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:02:48.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:02:48.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:02:48.190 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.190 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.190 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.190 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:48.190 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:48.190 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.764428236, 2024-04-25T22:02:48.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:02:48.190 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.190 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.190 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.191 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:48.191 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:48.191 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:48.191 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:02:48.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.191 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:48.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:48.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:02:48.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:02:48.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:02:48.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:02:48.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:02:48.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:02:48.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:02:48.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:02:48.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:02:48.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:02:48.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:02:48.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:02:48.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:02:48.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:02:48.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:02:48.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:02:48.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:02:48.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:02:48.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:02:48.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:02:48.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:02:48.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:02:48.195 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.195 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.195 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.195 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:48.195 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:48.196 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.764279587, 2024-04-25T22:02:48.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:02:48.196 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.196 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.196 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.196 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:48.196 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:48.196 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:48.196 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:02:48.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.196 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:48.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:48.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:02:48.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:02:48.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:02:48.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:02:48.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:02:48.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:02:48.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:02:48.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:02:48.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:02:48.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:02:48.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:02:48.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:02:48.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:02:48.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:02:48.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:02:48.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:02:48.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:02:48.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:02:48.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:02:48.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:02:48.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:02:48.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:02:48.201 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.201 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.201 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.201 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:48.201 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:48.201 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.76423743700001, 2024-04-25T22:02:48.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:02:48.201 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.201 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.201 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.201 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:48.202 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:48.202 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:48.202 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:02:48.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.202 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:48.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:48.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:02:48.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:02:48.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:02:48.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:02:48.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:02:48.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:02:48.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:02:48.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:02:48.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:02:48.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:02:48.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:02:48.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:02:48.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:02:48.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:02:48.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:02:48.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:02:48.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:02:48.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:02:48.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:02:48.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:02:48.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:02:48.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:02:48.206 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.206 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.206 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.207 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:48.207 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:48.207 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.764199584, 2024-04-25T22:02:48.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:48.207 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.207 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.207 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.207 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:48.207 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:48.207 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:48.207 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:48.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.207 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:48.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:48.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:48.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:48.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:48.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:48.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:48.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:48.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:48.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:48.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:48.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:48.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:48.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:48.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:48.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:48.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:48.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:48.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:48.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:48.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:48.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:48.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:48.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:48.212 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.212 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.212 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.212 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:48.212 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:48.212 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.763990259, 2024-04-25T22:02:48.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:48.212 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.212 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.213 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.213 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:48.213 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:48.213 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:48.213 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:48.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.213 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:48.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:48.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:48.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:48.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:48.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:48.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:48.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:48.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:48.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:48.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:48.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:48.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:48.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:48.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:48.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:48.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:48.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:48.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:48.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:48.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:48.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:48.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:48.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:48.217 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.217 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.217 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.218 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:48.218 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:48.218 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.497738987000005, 2024-04-25T22:02:48.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:02:48.218 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.218 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.218 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.218 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:48.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:48.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:02:48.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:48.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:02:48.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:02:48.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:02:48.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:02:48.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:02:48.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:02:48.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:02:48.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:02:48.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:02:48.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:02:48.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:02:48.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:02:48.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:02:48.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:02:48.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:02:48.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:02:48.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:02:48.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:02:48.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:02:48.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:02:48.223 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.223 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.223 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.223 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:48.223 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:48.223 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.497705147000005, 2024-04-25T22:02:48.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:02:48.223 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.223 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.223 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.223 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:02:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:02:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:02:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:02:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:02:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:02:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:02:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:02:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:02:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:02:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:02:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:02:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:02:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:02:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:02:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:02:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:02:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:02:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:02:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:02:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.497653451000005, 2024-04-25T22:02:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:02:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:02:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:02:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:02:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:02:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:02:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:02:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:02:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:02:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:02:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:02:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:02:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:02:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:02:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:02:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:02:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:02:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:02:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:02:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:02:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:02:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:02:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:02:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.497508999000004, 2024-04-25T22:02:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:02:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:02:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:02:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:02:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:02:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:02:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:02:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:02:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:02:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:02:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:02:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:02:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:02:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:02:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:02:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:02:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:02:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:02:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:02:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:02:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:02:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:02:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:02:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.497452279000001, 2024-04-25T22:02:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:02:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:02:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:02:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:02:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:02:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:02:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:02:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:02:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:02:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:02:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:02:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:02:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:02:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:02:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:02:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:02:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:02:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:02:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:02:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:02:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:02:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:02:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:02:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:48.245 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:48.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:48.248 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:48.245+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:48.261 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:02:48.348 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:48.345+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:48.378 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:48.378 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:48.378 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:02:48.378 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:48.392 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:48.411 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:48.411 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:48.428 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:48.428 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:48.448 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:48.449 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:48.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:48.446+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:48.516 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:48.519 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:48.530 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:48.571 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:48.570+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:48.650 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:48.645+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:48.694 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:48.694 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:48.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:48.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:48.746+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:48.840 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:48.840 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:48.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:48.850+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:48.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:48.862 INFO:teuthology.orchestra.run.smithi044.stderr:set osd.2 primary-affinity to 0 (802) 2024-04-25T22:02:48.863 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-25T22:02:48.953 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:48.949+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:48.980 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:48.980 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:48.994 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:49.054 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:49.053+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:49.117 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:49.117 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:49.131 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:49.177 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:49.173+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:49.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:49.254+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:49.266 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:49.266 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:49.281 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:49.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:49.354+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:49.454 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:49.454 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:49.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:49.454+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:49.468 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:49.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:49.558+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:49.589 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:49.589 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:49.605 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:49.658 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:49.657+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:49.736 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:49.736 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:49.750 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:49.759 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:49.757+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:49.861 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:49.857+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:49.873 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:49.873 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:49.891 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:49.962 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:49.961+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:50.012 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:50.012 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:50.031 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:50.063 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:50.061+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:50.149 INFO:tasks.workunit.client.0.smithi044.stderr:Updating files: 97% (12204/12492) Updating files: 98% (12243/12492) Updating files: 99% (12368/12492) Updating files: 100% (12492/12492) Updating files: 100% (12492/12492), done. 2024-04-25T22:02:50.161 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:50.161 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:50.163 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:50.157+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:50.175 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:50.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:50.262+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:50.333 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:50.333 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:50.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:50.365 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:50.361+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:50.433 INFO:tasks.workunit.client.0.smithi044.stderr:Note: switching to 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a'. 2024-04-25T22:02:50.433 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-25T22:02:50.433 INFO:tasks.workunit.client.0.smithi044.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T22:02:50.434 INFO:tasks.workunit.client.0.smithi044.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T22:02:50.434 INFO:tasks.workunit.client.0.smithi044.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T22:02:50.434 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-25T22:02:50.434 INFO:tasks.workunit.client.0.smithi044.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T22:02:50.434 INFO:tasks.workunit.client.0.smithi044.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T22:02:50.434 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-25T22:02:50.434 INFO:tasks.workunit.client.0.smithi044.stderr: git switch -c 2024-04-25T22:02:50.434 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-25T22:02:50.434 INFO:tasks.workunit.client.0.smithi044.stderr:Or undo this operation with: 2024-04-25T22:02:50.434 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-25T22:02:50.434 INFO:tasks.workunit.client.0.smithi044.stderr: git switch - 2024-04-25T22:02:50.434 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-25T22:02:50.435 INFO:tasks.workunit.client.0.smithi044.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T22:02:50.435 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-04-25T22:02:50.435 INFO:tasks.workunit.client.0.smithi044.stderr:HEAD is now at b22e2ebdeb2 Merge pull request #57078 from adk3798/squid-cephadm-no-downgrade 2024-04-25T22:02:50.438 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T22:02:50.444 INFO:tasks.workunit.client.0.smithi044.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T22:02:50.448 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T22:02:50.448 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T22:02:50.464 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:02:50.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:50.462+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:50.471 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:50.471 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:50.487 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:50.567 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:50.561+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:50.598 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:50.598 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:50.619 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:50.619 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:50.624 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:50.624 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:50.624 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:02:50.624 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:50.639 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:50.639 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:50.640 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:50.667 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:50.661+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:50.768 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:50.761+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:50.813 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:50.813 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:50.813 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:50.813 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:50.813 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:50.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:50.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:50.866+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:50.889 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:02:50.969 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:50.965+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:51.003 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 105.005190654, 2024-04-25T22:02:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023530901999999999, 2024-04-25T22:02:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 141 2024-04-25T22:02:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994036+0000", 2024-04-25T22:02:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994037+0000", 2024-04-25T22:02:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-06 2024-04-25T22:02:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994044+0000", 2024-04-25T22:02:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-25T22:02:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994054+0000", 2024-04-25T22:02:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.04e-05 2024-04-25T22:02:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:05.994064+0000", 2024-04-25T22:02:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-25T22:02:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015072+0000", 2024-04-25T22:02:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021007725000000001 2024-04-25T22:02:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015193+0000", 2024-04-25T22:02:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012061900000000001 2024-04-25T22:02:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.015388+0000", 2024-04-25T22:02:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019556200000000001 2024-04-25T22:02:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017311+0000", 2024-04-25T22:02:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001922551 2024-04-25T22:02:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017437+0000", 2024-04-25T22:02:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012640899999999999 2024-04-25T22:02:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017506+0000", 2024-04-25T22:02:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8930000000000006e-05 2024-04-25T22:02:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.017567+0000", 2024-04-25T22:02:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0819000000000002e-05 2024-04-25T22:02:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.82312758099999, 2024-04-25T22:02:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023619393999999998, 2024-04-25T22:02:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 159 2024-04-25T22:02:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176099+0000", 2024-04-25T22:02:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176100+0000", 2024-04-25T22:02:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:02:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176108+0000", 2024-04-25T22:02:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6939999999999995e-06 2024-04-25T22:02:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176120+0000", 2024-04-25T22:02:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2016e-05 2024-04-25T22:02:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176128+0000", 2024-04-25T22:02:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3340000000000002e-06 2024-04-25T22:02:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190624+0000", 2024-04-25T22:02:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014495865 2024-04-25T22:02:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.190840+0000", 2024-04-25T22:02:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216405 2024-04-25T22:02:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.191191+0000", 2024-04-25T22:02:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035099000000000003 2024-04-25T22:02:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196176+0000", 2024-04-25T22:02:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049841720000000003 2024-04-25T22:02:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199574+0000", 2024-04-25T22:02:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033986870000000001 2024-04-25T22:02:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199655+0000", 2024-04-25T22:02:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0928999999999997e-05 2024-04-25T22:02:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199719+0000", 2024-04-25T22:02:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3346e-05 2024-04-25T22:02:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.823083301, 2024-04-25T22:02:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023787196, 2024-04-25T22:02:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 160 2024-04-25T22:02:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176143+0000", 2024-04-25T22:02:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176144+0000", 2024-04-25T22:02:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:02:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176150+0000", 2024-04-25T22:02:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5899999999999998e-06 2024-04-25T22:02:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176159+0000", 2024-04-25T22:02:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5529999999999998e-06 2024-04-25T22:02:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176167+0000", 2024-04-25T22:02:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:02:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192403+0000", 2024-04-25T22:02:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016235741000000001 2024-04-25T22:02:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192633+0000", 2024-04-25T22:02:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000230788 2024-04-25T22:02:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.192886+0000", 2024-04-25T22:02:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025278099999999999 2024-04-25T22:02:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196337+0000", 2024-04-25T22:02:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034511490000000001 2024-04-25T22:02:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199732+0000", 2024-04-25T22:02:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003394846 2024-04-25T22:02:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199806+0000", 2024-04-25T22:02:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3375999999999997e-05 2024-04-25T22:02:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199931+0000", 2024-04-25T22:02:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012505599999999999 2024-04-25T22:02:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.82302677600001, 2024-04-25T22:02:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.822831534, 2024-04-25T22:02:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.822769241, 2024-04-25T22:02:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.82270902499999, 2024-04-25T22:02:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.822519513, 2024-04-25T22:02:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.63118167899999, 2024-04-25T22:02:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025968402000000002, 2024-04-25T22:02:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 183 2024-04-25T22:02:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368045+0000", 2024-04-25T22:02:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368046+0000", 2024-04-25T22:02:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4e-07 2024-04-25T22:02:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368052+0000", 2024-04-25T22:02:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0469999999999999e-06 2024-04-25T22:02:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368064+0000", 2024-04-25T22:02:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2024-04-25T22:02:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368072+0000", 2024-04-25T22:02:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6499999999999996e-06 2024-04-25T22:02:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378287+0000", 2024-04-25T22:02:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010215007 2024-04-25T22:02:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378564+0000", 2024-04-25T22:02:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027735800000000001 2024-04-25T22:02:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.378917+0000", 2024-04-25T22:02:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035284100000000001 2024-04-25T22:02:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384678+0000", 2024-04-25T22:02:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057617629999999996 2024-04-25T22:02:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393722+0000", 2024-04-25T22:02:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090433059999999992 2024-04-25T22:02:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.393893+0000", 2024-04-25T22:02:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017162899999999999 2024-04-25T22:02:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394013+0000", 2024-04-25T22:02:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012004499999999999 2024-04-25T22:02:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.631143302, 2024-04-25T22:02:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026177327, 2024-04-25T22:02:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 184 2024-04-25T22:02:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368083+0000", 2024-04-25T22:02:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368084+0000", 2024-04-25T22:02:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9999999999999997e-07 2024-04-25T22:02:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368090+0000", 2024-04-25T22:02:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:02:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368099+0000", 2024-04-25T22:02:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5570000000000001e-06 2024-04-25T22:02:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368107+0000", 2024-04-25T22:02:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3470000000000001e-06 2024-04-25T22:02:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379823+0000", 2024-04-25T22:02:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011716794000000001 2024-04-25T22:02:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.379969+0000", 2024-04-25T22:02:51.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-25T22:02:51.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380174+0000", 2024-04-25T22:02:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020481199999999999 2024-04-25T22:02:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.384791+0000", 2024-04-25T22:02:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046169749999999997 2024-04-25T22:02:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394038+0000", 2024-04-25T22:02:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0092475119999999994 2024-04-25T22:02:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394197+0000", 2024-04-25T22:02:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015916899999999999 2024-04-25T22:02:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394261+0000", 2024-04-25T22:02:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3535999999999996e-05 2024-04-25T22:02:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.631092043, 2024-04-25T22:02:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026292466, 2024-04-25T22:02:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 185 2024-04-25T22:02:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368135+0000", 2024-04-25T22:02:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368136+0000", 2024-04-25T22:02:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:02:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368242+0000", 2024-04-25T22:02:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010673 2024-04-25T22:02:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368255+0000", 2024-04-25T22:02:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2965999999999999e-05 2024-04-25T22:02:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368266+0000", 2024-04-25T22:02:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0869999999999999e-05 2024-04-25T22:02:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.380970+0000", 2024-04-25T22:02:51.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012704247 2024-04-25T22:02:51.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381091+0000", 2024-04-25T22:02:51.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012088500000000001 2024-04-25T22:02:51.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.381322+0000", 2024-04-25T22:02:51.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023027200000000001 2024-04-25T22:02:51.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386858+0000", 2024-04-25T22:02:51.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055362179999999999 2024-04-25T22:02:51.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394283+0000", 2024-04-25T22:02:51.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074255600000000003 2024-04-25T22:02:51.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394345+0000", 2024-04-25T22:02:51.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2021999999999997e-05 2024-04-25T22:02:51.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394427+0000", 2024-04-25T22:02:51.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1723000000000003e-05 2024-04-25T22:02:51.090 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.090 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.090 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.090 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:51.090 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:51.090 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.630943394, 2024-04-25T22:02:51.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026604104, 2024-04-25T22:02:51.090 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.090 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.090 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.091 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:51.091 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:51.091 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:51.091 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 186 2024-04-25T22:02:51.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.091 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:51.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368283+0000", 2024-04-25T22:02:51.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368284+0000", 2024-04-25T22:02:51.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:02:51.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368292+0000", 2024-04-25T22:02:51.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2024-04-25T22:02:51.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368305+0000", 2024-04-25T22:02:51.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3193999999999999e-05 2024-04-25T22:02:51.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368313+0000", 2024-04-25T22:02:51.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0960000000000001e-06 2024-04-25T22:02:51.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385109+0000", 2024-04-25T22:02:51.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016795607000000001 2024-04-25T22:02:51.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385375+0000", 2024-04-25T22:02:51.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026663799999999998 2024-04-25T22:02:51.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.385763+0000", 2024-04-25T22:02:51.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038791999999999999 2024-04-25T22:02:51.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394559+0000", 2024-04-25T22:02:51.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087961919999999996 2024-04-25T22:02:51.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394761+0000", 2024-04-25T22:02:51.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000202012 2024-04-25T22:02:51.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394831+0000", 2024-04-25T22:02:51.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9944999999999995e-05 2024-04-25T22:02:51.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394887+0000", 2024-04-25T22:02:51.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6203999999999999e-05 2024-04-25T22:02:51.095 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.095 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.095 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.096 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:51.096 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:51.096 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.630901244, 2024-04-25T22:02:51.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026691076000000001, 2024-04-25T22:02:51.096 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.096 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.096 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.096 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:51.096 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:51.096 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:51.096 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 187 2024-04-25T22:02:51.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.096 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:51.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368325+0000", 2024-04-25T22:02:51.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368326+0000", 2024-04-25T22:02:51.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1600000000000001e-07 2024-04-25T22:02:51.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368332+0000", 2024-04-25T22:02:51.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4439999999999999e-06 2024-04-25T22:02:51.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368342+0000", 2024-04-25T22:02:51.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.004e-05 2024-04-25T22:02:51.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368351+0000", 2024-04-25T22:02:51.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3859999999999996e-06 2024-04-25T22:02:51.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.386991+0000", 2024-04-25T22:02:51.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018639981999999999 2024-04-25T22:02:51.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387165+0000", 2024-04-25T22:02:51.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017428800000000001 2024-04-25T22:02:51.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.387532+0000", 2024-04-25T22:02:51.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036615299999999998 2024-04-25T22:02:51.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394741+0000", 2024-04-25T22:02:51.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072090519999999996 2024-04-25T22:02:51.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394900+0000", 2024-04-25T22:02:51.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015930299999999999 2024-04-25T22:02:51.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.394971+0000", 2024-04-25T22:02:51.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1194999999999999e-05 2024-04-25T22:02:51.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395017+0000", 2024-04-25T22:02:51.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5516999999999998e-05 2024-04-25T22:02:51.101 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.101 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.101 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.101 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:51.101 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:51.101 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.63086339100001, 2024-04-25T22:02:51.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:51.101 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.101 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.101 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.102 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:51.102 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:51.102 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:51.102 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:51.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.102 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:51.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:51.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:51.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:51.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:51.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:51.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:51.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:51.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:51.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:51.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:51.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:51.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:51.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:51.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:51.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:51.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:51.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:51.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:51.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:51.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:51.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:51.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:51.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:51.106 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.106 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.107 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.107 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:51.107 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:51.107 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.63065406600001, 2024-04-25T22:02:51.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:51.107 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.107 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.107 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.107 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:51.107 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:51.107 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:51.107 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:51.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.108 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:51.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:51.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:51.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:51.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:51.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:51.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:51.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:51.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:51.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:51.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:51.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:51.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:51.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:51.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:51.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:51.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:51.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:51.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:51.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:51.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:51.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:51.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:51.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:51.112 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.112 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.112 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.112 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:51.112 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:51.112 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 96.364402794, 2024-04-25T22:02:51.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023449876000000001, 2024-04-25T22:02:51.113 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.113 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.113 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.113 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:51.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634824+0000", 2024-04-25T22:02:51.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634825+0000", 2024-04-25T22:02:51.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:51.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634830+0000", 2024-04-25T22:02:51.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5400000000000003e-06 2024-04-25T22:02:51.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634840+0000", 2024-04-25T22:02:51.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5470000000000002e-06 2024-04-25T22:02:51.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634847+0000", 2024-04-25T22:02:51.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5229999999999998e-06 2024-04-25T22:02:51.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639094+0000", 2024-04-25T22:02:51.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042469719999999999 2024-04-25T22:02:51.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639215+0000", 2024-04-25T22:02:51.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120463 2024-04-25T22:02:51.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639468+0000", 2024-04-25T22:02:51.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025311099999999998 2024-04-25T22:02:51.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643153+0000", 2024-04-25T22:02:51.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003685294 2024-04-25T22:02:51.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658142+0000", 2024-04-25T22:02:51.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014989100999999999 2024-04-25T22:02:51.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658218+0000", 2024-04-25T22:02:51.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5235999999999996e-05 2024-04-25T22:02:51.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658274+0000", 2024-04-25T22:02:51.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6196000000000002e-05 2024-04-25T22:02:51.117 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.117 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.117 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.117 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:51.117 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:51.117 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 96.364368954, 2024-04-25T22:02:51.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023807445999999999, 2024-04-25T22:02:51.118 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.118 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.118 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.118 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:51.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:51.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634858+0000", 2024-04-25T22:02:51.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:02:51.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634879+0000", 2024-04-25T22:02:51.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0455999999999999e-05 2024-04-25T22:02:51.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634890+0000", 2024-04-25T22:02:51.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0654e-05 2024-04-25T22:02:51.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634897+0000", 2024-04-25T22:02:51.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8259999999999993e-06 2024-04-25T22:02:51.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.639963+0000", 2024-04-25T22:02:51.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050658459999999997 2024-04-25T22:02:51.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640154+0000", 2024-04-25T22:02:51.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019070099999999999 2024-04-25T22:02:51.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640348+0000", 2024-04-25T22:02:51.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019395600000000001 2024-04-25T22:02:51.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643165+0000", 2024-04-25T22:02:51.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028172700000000002 2024-04-25T22:02:51.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:51.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015225646000000001 2024-04-25T22:02:51.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658542+0000", 2024-04-25T22:02:51.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000150755 2024-04-25T22:02:51.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658665+0000", 2024-04-25T22:02:51.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012364599999999999 2024-04-25T22:02:51.122 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.122 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.122 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.123 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:51.123 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:51.123 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 96.364317258, 2024-04-25T22:02:51.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024136273, 2024-04-25T22:02:51.123 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.123 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.123 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.123 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:51.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634909+0000", 2024-04-25T22:02:51.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634910+0000", 2024-04-25T22:02:51.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9599999999999999e-07 2024-04-25T22:02:51.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634945+0000", 2024-04-25T22:02:51.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5233e-05 2024-04-25T22:02:51.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634957+0000", 2024-04-25T22:02:51.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-25T22:02:51.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.634965+0000", 2024-04-25T22:02:51.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-25T22:02:51.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640799+0000", 2024-04-25T22:02:51.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058339029999999997 2024-04-25T22:02:51.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.640992+0000", 2024-04-25T22:02:51.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000193289 2024-04-25T22:02:51.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641226+0000", 2024-04-25T22:02:51.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023352799999999999 2024-04-25T22:02:51.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.643172+0000", 2024-04-25T22:02:51.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019469070000000001 2024-04-25T22:02:51.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658792+0000", 2024-04-25T22:02:51.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015619116000000001 2024-04-25T22:02:51.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.658940+0000", 2024-04-25T22:02:51.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014845900000000001 2024-04-25T22:02:51.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659046+0000", 2024-04-25T22:02:51.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105682 2024-04-25T22:02:51.127 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.127 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.128 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.128 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:51.128 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:51.128 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 96.364172805999999, 2024-04-25T22:02:51.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02421359, 2024-04-25T22:02:51.128 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.128 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.128 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.128 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:51.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635054+0000", 2024-04-25T22:02:51.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635055+0000", 2024-04-25T22:02:51.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:02:51.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635068+0000", 2024-04-25T22:02:51.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:02:51.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635085+0000", 2024-04-25T22:02:51.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7093999999999999e-05 2024-04-25T22:02:51.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635098+0000", 2024-04-25T22:02:51.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2893e-05 2024-04-25T22:02:51.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641760+0000", 2024-04-25T22:02:51.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066627090000000002 2024-04-25T22:02:51.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.641875+0000", 2024-04-25T22:02:51.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011442600000000001 2024-04-25T22:02:51.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642070+0000", 2024-04-25T22:02:51.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019489600000000001 2024-04-25T22:02:51.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.645009+0000", 2024-04-25T22:02:51.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029394690000000001 2024-04-25T22:02:51.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659136+0000", 2024-04-25T22:02:51.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014127041 2024-04-25T22:02:51.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659214+0000", 2024-04-25T22:02:51.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7403000000000004e-05 2024-04-25T22:02:51.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659268+0000", 2024-04-25T22:02:51.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3853000000000001e-05 2024-04-25T22:02:51.133 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.133 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.133 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.133 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:51.133 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:51.133 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 96.364116085999996, 2024-04-25T22:02:51.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024349981999999999, 2024-04-25T22:02:51.133 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:51.133 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:51.133 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.133 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:51.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:51.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:51.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:51.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635111+0000", 2024-04-25T22:02:51.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:51.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:51.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635112+0000", 2024-04-25T22:02:51.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:02:51.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:51.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635117+0000", 2024-04-25T22:02:51.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4299999999999997e-06 2024-04-25T22:02:51.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:51.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635126+0000", 2024-04-25T22:02:51.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.363e-06 2024-04-25T22:02:51.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.635138+0000", 2024-04-25T22:02:51.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.118e-05 2024-04-25T22:02:51.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:51.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642493+0000", 2024-04-25T22:02:51.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073557700000000002 2024-04-25T22:02:51.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:51.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642602+0000", 2024-04-25T22:02:51.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109156 2024-04-25T22:02:51.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.642763+0000", 2024-04-25T22:02:51.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016089899999999999 2024-04-25T22:02:51.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:51.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.647324+0000", 2024-04-25T22:02:51.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045609559999999997 2024-04-25T22:02:51.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659337+0000", 2024-04-25T22:02:51.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012012851999999999 2024-04-25T22:02:51.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:51.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659409+0000", 2024-04-25T22:02:51.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2189999999999998e-05 2024-04-25T22:02:51.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:51.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:51.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:51.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:14.659461+0000", 2024-04-25T22:02:51.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1313000000000002e-05 2024-04-25T22:02:51.138 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.138 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.138 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.138 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:51.138 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:51.138 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:51.139 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:51.140 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:51.137+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:51.177 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T22:02:51.241 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:51.237+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:51.258 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T22:02:51.271 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:51.271 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:51.271 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:02:51.271 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:51.285 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:51.308 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T22:02:51.309 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T22:02:51.309 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T22:02:51.342 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:51.337+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:51.357 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T22:02:51.361 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T22:02:51.361 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T22:02:51.366 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-25T22:02:51.367 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-25T22:02:51.368 DEBUG:teuthology.orchestra.run.smithi044:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b22e2ebdeb24376882b7bda2a7329c8cccc2276a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-25T22:02:51.407 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:51.408 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:51.408 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:02:51.408 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:02:51.408 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:51.421 INFO:tasks.workunit.client.0.smithi044.stderr:+ mkdir -p fsstress 2024-04-25T22:02:51.422 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:51.423 INFO:tasks.workunit.client.0.smithi044.stderr:+ pushd fsstress 2024-04-25T22:02:51.424 INFO:tasks.workunit.client.0.smithi044.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T22:02:51.424 INFO:tasks.workunit.client.0.smithi044.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-25T22:02:51.442 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:51.437+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:51.543 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:51.537+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:51.547 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:02:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:02:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:02:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 4 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:27 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:02:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.908691989999994, 2024-04-25T22:02:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013281644, 2024-04-25T22:02:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637800+0000", 2024-04-25T22:02:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637801+0000", 2024-04-25T22:02:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1299999999999998e-07 2024-04-25T22:02:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637828+0000", 2024-04-25T22:02:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6953000000000001e-05 2024-04-25T22:02:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637873+0000", 2024-04-25T22:02:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4676999999999999e-05 2024-04-25T22:02:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.637917+0000", 2024-04-25T22:02:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4815999999999999e-05 2024-04-25T22:02:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644220+0000", 2024-04-25T22:02:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063021049999999997 2024-04-25T22:02:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651082+0000", 2024-04-25T22:02:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068621799999999998 2024-04-25T22:02:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:15 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.903284377999995, 2024-04-25T22:02:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010973732, 2024-04-25T22:02:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643208+0000", 2024-04-25T22:02:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643209+0000", 2024-04-25T22:02:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.003e-06 2024-04-25T22:02:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643230+0000", 2024-04-25T22:02:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0815999999999999e-05 2024-04-25T22:02:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643252+0000", 2024-04-25T22:02:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2586999999999999e-05 2024-04-25T22:02:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643271+0000", 2024-04-25T22:02:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8493000000000001e-05 2024-04-25T22:02:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644387+0000", 2024-04-25T22:02:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011160250000000001 2024-04-25T22:02:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644434+0000", 2024-04-25T22:02:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:02:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654103+0000", 2024-04-25T22:02:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096691360000000001 2024-04-25T22:02:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654181+0000", 2024-04-25T22:02:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8546000000000003e-05 2024-04-25T22:02:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:37 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-25T22:02:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.903184022000005, 2024-04-25T22:02:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088132450000000008, 2024-04-25T22:02:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643308+0000", 2024-04-25T22:02:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643309+0000", 2024-04-25T22:02:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9600000000000008e-07 2024-04-25T22:02:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.643339+0000", 2024-04-25T22:02:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9467000000000001e-05 2024-04-25T22:02:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644245+0000", 2024-04-25T22:02:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090648200000000001 2024-04-25T22:02:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.644268+0000", 2024-04-25T22:02:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3017e-05 2024-04-25T22:02:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647517+0000", 2024-04-25T22:02:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032491680000000002 2024-04-25T22:02:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647561+0000", 2024-04-25T22:02:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3630000000000001e-05 2024-04-25T22:02:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652041+0000", 2024-04-25T22:02:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044804529999999997 2024-04-25T22:02:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652121+0000", 2024-04-25T22:02:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0031999999999995e-05 2024-04-25T22:02:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:34 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.901095394999999, 2024-04-25T22:02:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089225940000000007, 2024-04-25T22:02:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645397+0000", 2024-04-25T22:02:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645398+0000", 2024-04-25T22:02:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4360000000000001e-06 2024-04-25T22:02:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645412+0000", 2024-04-25T22:02:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4283e-05 2024-04-25T22:02:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645434+0000", 2024-04-25T22:02:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1237e-05 2024-04-25T22:02:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645459+0000", 2024-04-25T22:02:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5675999999999999e-05 2024-04-25T22:02:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646081+0000", 2024-04-25T22:02:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062128900000000002 2024-04-25T22:02:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.646131+0000", 2024-04-25T22:02:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0322999999999999e-05 2024-04-25T22:02:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654185+0000", 2024-04-25T22:02:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080542749999999996 2024-04-25T22:02:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654319+0000", 2024-04-25T22:02:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013407499999999999 2024-04-25T22:02:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:19 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-25T22:02:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.900993885999995, 2024-04-25T22:02:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076631340000000003, 2024-04-25T22:02:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645498+0000", 2024-04-25T22:02:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645499+0000", 2024-04-25T22:02:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4300000000000001e-07 2024-04-25T22:02:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645509+0000", 2024-04-25T22:02:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0244000000000001e-05 2024-04-25T22:02:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645523+0000", 2024-04-25T22:02:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3315999999999999e-05 2024-04-25T22:02:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.645531+0000", 2024-04-25T22:02:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.123e-06 2024-04-25T22:02:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648260+0000", 2024-04-25T22:02:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027289789999999999 2024-04-25T22:02:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648307+0000", 2024-04-25T22:02:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6969999999999999e-05 2024-04-25T22:02:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653039+0000", 2024-04-25T22:02:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047322299999999996 2024-04-25T22:02:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653161+0000", 2024-04-25T22:02:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012232899999999999 2024-04-25T22:02:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.899016224999997, 2024-04-25T22:02:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01271303, 2024-04-25T22:02:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647476+0000", 2024-04-25T22:02:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647479+0000", 2024-04-25T22:02:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.286e-06 2024-04-25T22:02:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647494+0000", 2024-04-25T22:02:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.521e-05 2024-04-25T22:02:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647525+0000", 2024-04-25T22:02:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0403999999999999e-05 2024-04-25T22:02:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647544+0000", 2024-04-25T22:02:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8743e-05 2024-04-25T22:02:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647895+0000", 2024-04-25T22:02:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035099699999999997 2024-04-25T22:02:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648202+0000", 2024-04-25T22:02:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030758499999999998 2024-04-25T22:02:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648496+0000", 2024-04-25T22:02:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029370699999999999 2024-04-25T22:02:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654605+0000", 2024-04-25T22:02:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061095999999999998 2024-04-25T22:02:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.659959+0000", 2024-04-25T22:02:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053531680000000002 2024-04-25T22:02:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660078+0000", 2024-04-25T22:02:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011981600000000001 2024-04-25T22:02:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660189+0000", 2024-04-25T22:02:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011051400000000001 2024-04-25T22:02:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.898892133000004, 2024-04-25T22:02:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013053006000000001, 2024-04-25T22:02:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647600+0000", 2024-04-25T22:02:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647602+0000", 2024-04-25T22:02:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.604e-06 2024-04-25T22:02:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647611+0000", 2024-04-25T22:02:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5689999999999994e-06 2024-04-25T22:02:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647634+0000", 2024-04-25T22:02:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3227e-05 2024-04-25T22:02:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647660+0000", 2024-04-25T22:02:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5829999999999998e-05 2024-04-25T22:02:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649544+0000", 2024-04-25T22:02:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001884066 2024-04-25T22:02:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649783+0000", 2024-04-25T22:02:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238411 2024-04-25T22:02:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.650794+0000", 2024-04-25T22:02:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010109920000000001 2024-04-25T22:02:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654714+0000", 2024-04-25T22:02:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039202170000000001 2024-04-25T22:02:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660403+0000", 2024-04-25T22:02:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056895940000000001 2024-04-25T22:02:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660551+0000", 2024-04-25T22:02:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014717899999999999 2024-04-25T22:02:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660653+0000", 2024-04-25T22:02:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102317 2024-04-25T22:02:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:17 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.898807953000002, 2024-04-25T22:02:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010101435000000001, 2024-04-25T22:02:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647684+0000", 2024-04-25T22:02:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647686+0000", 2024-04-25T22:02:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-04-25T22:02:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647693+0000", 2024-04-25T22:02:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7330000000000003e-06 2024-04-25T22:02:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647711+0000", 2024-04-25T22:02:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7436e-05 2024-04-25T22:02:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647727+0000", 2024-04-25T22:02:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6232999999999999e-05 2024-04-25T22:02:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649249+0000", 2024-04-25T22:02:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015219890000000001 2024-04-25T22:02:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649533+0000", 2024-04-25T22:02:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028391799999999997 2024-04-25T22:02:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649841+0000", 2024-04-25T22:02:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030853400000000001 2024-04-25T22:02:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.654622+0000", 2024-04-25T22:02:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047809630000000001 2024-04-25T22:02:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657616+0000", 2024-04-25T22:02:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029938769999999998 2024-04-25T22:02:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657724+0000", 2024-04-25T22:02:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000108109 2024-04-25T22:02:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657786+0000", 2024-04-25T22:02:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1196000000000002e-05 2024-04-25T22:02:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.898619624999995, 2024-04-25T22:02:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010260877999999999, 2024-04-25T22:02:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647872+0000", 2024-04-25T22:02:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647874+0000", 2024-04-25T22:02:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:02:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647884+0000", 2024-04-25T22:02:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.013e-05 2024-04-25T22:02:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647908+0000", 2024-04-25T22:02:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3592999999999999e-05 2024-04-25T22:02:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647926+0000", 2024-04-25T22:02:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8176999999999999e-05 2024-04-25T22:02:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651480+0000", 2024-04-25T22:02:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035540160000000001 2024-04-25T22:02:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651690+0000", 2024-04-25T22:02:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000210249 2024-04-25T22:02:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651986+0000", 2024-04-25T22:02:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000296001 2024-04-25T22:02:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655696+0000", 2024-04-25T22:02:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037098410000000002 2024-04-25T22:02:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.657896+0000", 2024-04-25T22:02:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022004630000000002 2024-04-25T22:02:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658035+0000", 2024-04-25T22:02:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013831499999999999 2024-04-25T22:02:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.658133+0000", 2024-04-25T22:02:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8553000000000003e-05 2024-04-25T22:02:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:18 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.898540745000005, 2024-04-25T22:02:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013108712, 2024-04-25T22:02:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647951+0000", 2024-04-25T22:02:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647953+0000", 2024-04-25T22:02:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.697e-06 2024-04-25T22:02:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647963+0000", 2024-04-25T22:02:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9259999999999995e-06 2024-04-25T22:02:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.647982+0000", 2024-04-25T22:02:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8573e-05 2024-04-25T22:02:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648008+0000", 2024-04-25T22:02:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5956e-05 2024-04-25T22:02:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651686+0000", 2024-04-25T22:02:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678073 2024-04-25T22:02:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652023+0000", 2024-04-25T22:02:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033739399999999998 2024-04-25T22:02:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.652348+0000", 2024-04-25T22:02:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032475000000000001 2024-04-25T22:02:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.655883+0000", 2024-04-25T22:02:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035353030000000001 2024-04-25T22:02:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660791+0000", 2024-04-25T22:02:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049075330000000004 2024-04-25T22:02:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660930+0000", 2024-04-25T22:02:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000139856 2024-04-25T22:02:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661060+0000", 2024-04-25T22:02:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000129651 2024-04-25T22:02:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:20 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.898463852999996, 2024-04-25T22:02:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012451034, 2024-04-25T22:02:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648028+0000", 2024-04-25T22:02:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648030+0000", 2024-04-25T22:02:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-04-25T22:02:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648036+0000", 2024-04-25T22:02:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8059999999999997e-06 2024-04-25T22:02:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648054+0000", 2024-04-25T22:02:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7744000000000002e-05 2024-04-25T22:02:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648070+0000", 2024-04-25T22:02:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-04-25T22:02:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648875+0000", 2024-04-25T22:02:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080444000000000002 2024-04-25T22:02:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649078+0000", 2024-04-25T22:02:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020391499999999999 2024-04-25T22:02:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649674+0000", 2024-04-25T22:02:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00059555299999999997 2024-04-25T22:02:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653185+0000", 2024-04-25T22:02:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035113459999999998 2024-04-25T22:02:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660251+0000", 2024-04-25T22:02:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070661350000000003 2024-04-25T22:02:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660382+0000", 2024-04-25T22:02:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013095899999999999 2024-04-25T22:02:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660479+0000", 2024-04-25T22:02:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6852e-05 2024-04-25T22:02:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:25 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.898398040000004, 2024-04-25T22:02:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012691025999999999, 2024-04-25T22:02:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648094+0000", 2024-04-25T22:02:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648095+0000", 2024-04-25T22:02:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.424e-06 2024-04-25T22:02:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648102+0000", 2024-04-25T22:02:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2099999999999998e-06 2024-04-25T22:02:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648122+0000", 2024-04-25T22:02:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0242999999999999e-05 2024-04-25T22:02:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648138+0000", 2024-04-25T22:02:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6192999999999999e-05 2024-04-25T22:02:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651461+0000", 2024-04-25T22:02:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033225709999999999 2024-04-25T22:02:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.651776+0000", 2024-04-25T22:02:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031567500000000002 2024-04-25T22:02:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660785+0000", 2024-04-25T22:02:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090087099999999996 2024-04-25T22:02:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.898335553999999, 2024-04-25T22:02:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013102702000000001, 2024-04-25T22:02:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648157+0000", 2024-04-25T22:02:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648158+0000", 2024-04-25T22:02:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2839999999999999e-06 2024-04-25T22:02:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648163+0000", 2024-04-25T22:02:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-04-25T22:02:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648181+0000", 2024-04-25T22:02:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8484000000000001e-05 2024-04-25T22:02:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648196+0000", 2024-04-25T22:02:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4496e-05 2024-04-25T22:02:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653737+0000", 2024-04-25T22:02:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055414009999999996 2024-04-25T22:02:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.653972+0000", 2024-04-25T22:02:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000234732 2024-04-25T22:02:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661259+0000", 2024-04-25T22:02:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072872689999999999 2024-04-25T22:02:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:28 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.898278734000002, 2024-04-25T22:02:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086984829999999999, 2024-04-25T22:02:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648213+0000", 2024-04-25T22:02:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648214+0000", 2024-04-25T22:02:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-04-25T22:02:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648233+0000", 2024-04-25T22:02:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.878e-05 2024-04-25T22:02:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648252+0000", 2024-04-25T22:02:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8603000000000001e-05 2024-04-25T22:02:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648267+0000", 2024-04-25T22:02:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:02:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.648846+0000", 2024-04-25T22:02:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057923000000000002 2024-04-25T22:02:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.649027+0000", 2024-04-25T22:02:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181585 2024-04-25T22:02:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.656912+0000", 2024-04-25T22:02:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078844589999999999 2024-04-25T22:02:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.b epoch 17/15 rep_tid 6 lcod 17'2)", 2024-04-25T22:02:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.886348818000002, 2024-04-25T22:02:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064966000000000004, 2024-04-25T22:02:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660143+0000", 2024-04-25T22:02:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660144+0000", 2024-04-25T22:02:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1800000000000005e-07 2024-04-25T22:02:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660181+0000", 2024-04-25T22:02:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6408000000000001e-05 2024-04-25T22:02:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660197+0000", 2024-04-25T22:02:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6177000000000001e-05 2024-04-25T22:02:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660210+0000", 2024-04-25T22:02:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:02:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660556+0000", 2024-04-25T22:02:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034612899999999998 2024-04-25T22:02:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660793+0000", 2024-04-25T22:02:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023656799999999999 2024-04-25T22:02:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(mds.0.3:18 3.1f e17/15 ondisk, result = 0)", 2024-04-25T22:02:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.886087044999996, 2024-04-25T22:02:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067878299999999997, 2024-04-25T22:02:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660405+0000", 2024-04-25T22:02:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660406+0000", 2024-04-25T22:02:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2800000000000005e-07 2024-04-25T22:02:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660412+0000", 2024-04-25T22:02:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0399999999999998e-06 2024-04-25T22:02:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660429+0000", 2024-04-25T22:02:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7394e-05 2024-04-25T22:02:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660445+0000", 2024-04-25T22:02:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6069000000000001e-05 2024-04-25T22:02:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660757+0000", 2024-04-25T22:02:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031194300000000002 2024-04-25T22:02:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660776+0000", 2024-04-25T22:02:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8862999999999999e-05 2024-04-25T22:02:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661084+0000", 2024-04-25T22:02:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030754600000000001 2024-04-25T22:02:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-25T22:02:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 96.886022816999997, 2024-04-25T22:02:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00080007600000000004, 2024-04-25T22:02:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660469+0000", 2024-04-25T22:02:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660470+0000", 2024-04-25T22:02:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4499999999999996e-07 2024-04-25T22:02:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660475+0000", 2024-04-25T22:02:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-04-25T22:02:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660490+0000", 2024-04-25T22:02:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5274e-05 2024-04-25T22:02:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.660501+0000", 2024-04-25T22:02:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0694e-05 2024-04-25T22:02:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661130+0000", 2024-04-25T22:02:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00062887499999999999 2024-04-25T22:02:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:14.661269+0000", 2024-04-25T22:02:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013955900000000001 2024-04-25T22:02:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.625 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:02:51.625 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:51.625 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 94.922290817999993, 2024-04-25T22:02:51.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037104880000000001, 2024-04-25T22:02:51.625 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.625 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.625 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.625 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:51.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624201+0000", 2024-04-25T22:02:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624204+0000", 2024-04-25T22:02:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.757e-06 2024-04-25T22:02:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624233+0000", 2024-04-25T22:02:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9362000000000001e-05 2024-04-25T22:02:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624264+0000", 2024-04-25T22:02:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0843000000000003e-05 2024-04-25T22:02:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624280+0000", 2024-04-25T22:02:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5577e-05 2024-04-25T22:02:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624458+0000", 2024-04-25T22:02:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017821199999999999 2024-04-25T22:02:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624661+0000", 2024-04-25T22:02:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020283200000000001 2024-04-25T22:02:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.624842+0000", 2024-04-25T22:02:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018115500000000001 2024-04-25T22:02:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.626271+0000", 2024-04-25T22:02:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001429416 2024-04-25T22:02:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627749+0000", 2024-04-25T22:02:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014778650000000001 2024-04-25T22:02:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627849+0000", 2024-04-25T22:02:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9261999999999999e-05 2024-04-25T22:02:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:16.627912+0000", 2024-04-25T22:02:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3207000000000007e-05 2024-04-25T22:02:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-25T22:02:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.919593466999999, 2024-04-25T22:02:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029804620000000001, 2024-04-25T22:02:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626899+0000", 2024-04-25T22:02:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626903+0000", 2024-04-25T22:02:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0029999999999996e-06 2024-04-25T22:02:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626921+0000", 2024-04-25T22:02:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8272999999999999e-05 2024-04-25T22:02:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626959+0000", 2024-04-25T22:02:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7843999999999999e-05 2024-04-25T22:02:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.626977+0000", 2024-04-25T22:02:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7756000000000001e-05 2024-04-25T22:02:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627153+0000", 2024-04-25T22:02:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017643800000000001 2024-04-25T22:02:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627425+0000", 2024-04-25T22:02:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027207300000000001 2024-04-25T22:02:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.627848+0000", 2024-04-25T22:02:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042297199999999997 2024-04-25T22:02:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629590+0000", 2024-04-25T22:02:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017416809999999999 2024-04-25T22:02:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629720+0000", 2024-04-25T22:02:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130526 2024-04-25T22:02:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629808+0000", 2024-04-25T22:02:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7449999999999998e-05 2024-04-25T22:02:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:40.629879+0000", 2024-04-25T22:02:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1445999999999993e-05 2024-04-25T22:02:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4185.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-04-25T22:02:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 53.931485397000003, 2024-04-25T22:02:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0036257939999999999, 2024-04-25T22:02:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:02:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4185", 2024-04-25T22:02:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.44:0/2048337248", 2024-04-25T22:02:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2 2024-04-25T22:02:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615007+0000", 2024-04-25T22:02:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615010+0000", 2024-04-25T22:02:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8059999999999999e-06 2024-04-25T22:02:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615023+0000", 2024-04-25T22:02:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3159999999999999e-05 2024-04-25T22:02:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615043+0000", 2024-04-25T22:02:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0305999999999998e-05 2024-04-25T22:02:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615059+0000", 2024-04-25T22:02:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5519000000000002e-05 2024-04-25T22:02:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615241+0000", 2024-04-25T22:02:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018207100000000001 2024-04-25T22:02:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:02:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.615258+0000", 2024-04-25T22:02:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7278999999999998e-05 2024-04-25T22:02:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618429+0000", 2024-04-25T22:02:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003171213 2024-04-25T22:02:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:01:57.618633+0000", 2024-04-25T22:02:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020343999999999999 2024-04-25T22:02:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:51.639 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:51.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:51.644 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:51.641+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:51.745 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:51.741+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:51.773 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:51.773 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:51.773 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:02:51.773 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:51.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:51.846 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:51.841+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:51.861 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-25T22:02:51.946 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:51.945+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:51.955 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:51.955 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:02:51.956 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:02:51.956 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:51.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:52.047 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:52.041+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:52.081 INFO:tasks.workunit.client.0.smithi044.stderr:+ tar xzf ltp-full.tgz 2024-04-25T22:02:52.098 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:52.098 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:52.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:52.098 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:52.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.098 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:104 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'66, mlcod=10'64)", 2024-04-25T22:02:52.098 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:52.098 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.270337434, 2024-04-25T22:02:52.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085339409999999997, 2024-04-25T22:02:52.099 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.099 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.099 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.099 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:52.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825800+0000", 2024-04-25T22:02:52.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825802+0000", 2024-04-25T22:02:52.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.767e-06 2024-04-25T22:02:52.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825813+0000", 2024-04-25T22:02:52.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1336e-05 2024-04-25T22:02:52.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825840+0000", 2024-04-25T22:02:52.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7276000000000001e-05 2024-04-25T22:02:52.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825854+0000", 2024-04-25T22:02:52.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3307e-05 2024-04-25T22:02:52.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.825986+0000", 2024-04-25T22:02:52.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132156 2024-04-25T22:02:52.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826045+0000", 2024-04-25T22:02:52.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9546000000000002e-05 2024-04-25T22:02:52.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:52.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834265+0000", 2024-04-25T22:02:52.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082194239999999995 2024-04-25T22:02:52.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834334+0000", 2024-04-25T22:02:52.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9128999999999995e-05 2024-04-25T22:02:52.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.102 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.103 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:52.103 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:52.103 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.269606616, 2024-04-25T22:02:52.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:52.103 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.103 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.103 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.103 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:52.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:52.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:52.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:52.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:52.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:52.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:52.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:52.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:52.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:52.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:52.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:52.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:52.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:52.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:52.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:52.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:52.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:52.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:52.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.106 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.107 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:52.107 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:52.107 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.268940345, 2024-04-25T22:02:52.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:52.107 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.107 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.107 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.107 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:52.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:52.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:52.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:52.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:52.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:52.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:52.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:52.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:52.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:52.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:52.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:52.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:52.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:52.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:52.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:52.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:52.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:52.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:52.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.110 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.111 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-25T22:02:52.111 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:52.111 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.268040445, 2024-04-25T22:02:52.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086034739999999998, 2024-04-25T22:02:52.111 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.111 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.111 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.111 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:52.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828097+0000", 2024-04-25T22:02:52.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828099+0000", 2024-04-25T22:02:52.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:52.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828111+0000", 2024-04-25T22:02:52.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2153e-05 2024-04-25T22:02:52.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828133+0000", 2024-04-25T22:02:52.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2557000000000001e-05 2024-04-25T22:02:52.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.828146+0000", 2024-04-25T22:02:52.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2799000000000001e-05 2024-04-25T22:02:52.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829240+0000", 2024-04-25T22:02:52.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010938790000000001 2024-04-25T22:02:52.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.829291+0000", 2024-04-25T22:02:52.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0850000000000003e-05 2024-04-25T22:02:52.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:52.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836668+0000", 2024-04-25T22:02:52.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073769090000000001 2024-04-25T22:02:52.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836700+0000", 2024-04-25T22:02:52.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2477000000000001e-05 2024-04-25T22:02:52.114 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.115 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.115 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:52.115 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:52.115 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.266004104, 2024-04-25T22:02:52.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:52.115 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.115 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.115 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.115 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:52.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:52.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:52.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:52.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:52.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:52.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:52.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:52.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:52.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:52.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:52.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:52.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:52.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:52.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:52.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:52.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:52.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:52.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:52.119 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.119 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.119 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.119 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:52.119 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:52.119 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.265540767, 2024-04-25T22:02:52.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:52.119 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.119 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.119 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.120 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:52.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:52.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:52.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:52.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:52.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:52.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:52.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:52.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:52.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:52.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:52.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:52.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:52.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:52.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:52.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:52.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:52.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:52.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:52.123 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.123 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.123 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.123 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'64)", 2024-04-25T22:02:52.123 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:52.123 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.264673888, 2024-04-25T22:02:52.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0093867940000000004, 2024-04-25T22:02:52.124 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.124 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.124 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:52.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831463+0000", 2024-04-25T22:02:52.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831465+0000", 2024-04-25T22:02:52.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7370000000000001e-06 2024-04-25T22:02:52.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831476+0000", 2024-04-25T22:02:52.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0803e-05 2024-04-25T22:02:52.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831520+0000", 2024-04-25T22:02:52.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4554000000000001e-05 2024-04-25T22:02:52.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831540+0000", 2024-04-25T22:02:52.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9136000000000001e-05 2024-04-25T22:02:52.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836042+0000", 2024-04-25T22:02:52.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045025289999999999 2024-04-25T22:02:52.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836073+0000", 2024-04-25T22:02:52.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1072999999999999e-05 2024-04-25T22:02:52.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:52.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840815+0000", 2024-04-25T22:02:52.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047418929999999996 2024-04-25T22:02:52.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840850+0000", 2024-04-25T22:02:52.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5068999999999999e-05 2024-04-25T22:02:52.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.127 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.127 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'64)", 2024-04-25T22:02:52.127 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:52.128 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.26422281399999, 2024-04-25T22:02:52.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0089975230000000003, 2024-04-25T22:02:52.128 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.128 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.128 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.128 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:52.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831914+0000", 2024-04-25T22:02:52.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831916+0000", 2024-04-25T22:02:52.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2669999999999999e-06 2024-04-25T22:02:52.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831925+0000", 2024-04-25T22:02:52.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8799999999999997e-06 2024-04-25T22:02:52.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831945+0000", 2024-04-25T22:02:52.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9933e-05 2024-04-25T22:02:52.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.831956+0000", 2024-04-25T22:02:52.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.166e-05 2024-04-25T22:02:52.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836981+0000", 2024-04-25T22:02:52.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005025074 2024-04-25T22:02:52.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837042+0000", 2024-04-25T22:02:52.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0532999999999998e-05 2024-04-25T22:02:52.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:52.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840852+0000", 2024-04-25T22:02:52.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038100170000000002 2024-04-25T22:02:52.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840912+0000", 2024-04-25T22:02:52.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0158999999999998e-05 2024-04-25T22:02:52.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.131 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.132 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:115 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'77, mlcod=10'64)", 2024-04-25T22:02:52.132 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:52.132 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.26377322800001, 2024-04-25T22:02:52.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085885739999999999, 2024-04-25T22:02:52.132 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.132 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.132 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.132 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:52.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832364+0000", 2024-04-25T22:02:52.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832365+0000", 2024-04-25T22:02:52.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-04-25T22:02:52.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832483+0000", 2024-04-25T22:02:52.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011804200000000001 2024-04-25T22:02:52.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832506+0000", 2024-04-25T22:02:52.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:02:52.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.832516+0000", 2024-04-25T22:02:52.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5929999999999995e-06 2024-04-25T22:02:52.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837790+0000", 2024-04-25T22:02:52.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052743759999999999 2024-04-25T22:02:52.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.837849+0000", 2024-04-25T22:02:52.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.948e-05 2024-04-25T22:02:52.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:52.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840914+0000", 2024-04-25T22:02:52.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064509 2024-04-25T22:02:52.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840953+0000", 2024-04-25T22:02:52.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8720000000000002e-05 2024-04-25T22:02:52.135 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.135 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.135 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.136 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:52.136 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:52.136 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.467116740999998, 2024-04-25T22:02:52.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:52.136 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.136 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.136 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.136 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:52.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:52.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:52.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:52.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:52.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:52.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:52.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:52.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:52.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:52.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:52.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:52.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:52.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:52.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:52.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:52.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:52.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:52.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:52.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:52.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:52.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:52.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:52.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:52.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:52.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:52.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:52.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.140 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.141 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:52.141 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:52.141 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.466992758000004, 2024-04-25T22:02:52.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:52.141 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.141 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.141 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.141 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:52.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:52.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:52.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:52.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:52.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:52.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:52.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:52.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:52.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:52.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:52.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:52.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:52.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.466918821999997, 2024-04-25T22:02:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:52.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:52.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:52.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:52.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:52.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:52.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:52.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:52.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:52.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:52.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:52.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:52.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:52.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:52.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:52.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:52.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:52.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:52.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:52.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:52.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:52.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.150 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.151 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:52.151 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:52.151 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.466802569999999, 2024-04-25T22:02:52.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:52.151 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.151 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.151 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.151 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:52.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:52.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:52.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:52.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:52.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:52.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:52.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:52.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:52.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:52.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:52.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:52.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:52.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:52.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:52.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:52.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:52.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.466639161000003, 2024-04-25T22:02:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.466536965000003, 2024-04-25T22:02:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.161 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.165 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.466458012000004, 2024-04-25T22:02:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:52.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:52.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:52.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:52.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:52.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:52.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:52.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:52.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:52.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:52.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:52.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:52.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:52.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:52.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:52.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:52.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:52.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:52.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:52.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:52.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:52.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:52.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:52.170 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.466392988999999, 2024-04-25T22:02:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:52.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:52.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:52.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:52.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:52.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:52.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:52.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:52.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:52.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:52.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:52.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:52.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:52.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:52.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:52.174 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.174 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.174 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.174 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:52.174 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:52.175 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.466314796999995, 2024-04-25T22:02:52.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:52.175 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.175 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.175 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:52.175 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:52.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:52.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:52.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:52.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:52.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:52.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:52.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:52.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:52.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:52.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:52.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:52.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:52.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:52.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:52.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:52.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.178 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.178 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:11 3.10 e17/15 3:0d89b25e:::603.00000000:head v 17'6, mlcod=0'0)", 2024-04-25T22:02:52.178 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:52.178 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.451668337000001, 2024-04-25T22:02:52.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085888939999999997, 2024-04-25T22:02:52.178 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.178 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.178 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:52.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644469+0000", 2024-04-25T22:02:52.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644470+0000", 2024-04-25T22:02:52.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.54e-07 2024-04-25T22:02:52.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644489+0000", 2024-04-25T22:02:52.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9032999999999999e-05 2024-04-25T22:02:52.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644507+0000", 2024-04-25T22:02:52.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-04-25T22:02:52.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644603+0000", 2024-04-25T22:02:52.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5353000000000007e-05 2024-04-25T22:02:52.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.648547+0000", 2024-04-25T22:02:52.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039443100000000004 2024-04-25T22:02:52.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649059+0000", 2024-04-25T22:02:52.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00051187900000000002 2024-04-25T22:02:52.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:52.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.652973+0000", 2024-04-25T22:02:52.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039140529999999998 2024-04-25T22:02:52.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653058+0000", 2024-04-25T22:02:52.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4986000000000003e-05 2024-04-25T22:02:52.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.182 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.182 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:29 3.10 e17/15 3:0bd6d154:::602.00000000:head v 17'7, mlcod=0'0)", 2024-04-25T22:02:52.182 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:52.182 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.451508380999996, 2024-04-25T22:02:52.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085167509999999995, 2024-04-25T22:02:52.182 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:52.182 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:52.182 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.182 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:52.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:52.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:52.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:52.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644629+0000", 2024-04-25T22:02:52.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:52.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:52.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644630+0000", 2024-04-25T22:02:52.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:02:52.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:52.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644640+0000", 2024-04-25T22:02:52.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-04-25T22:02:52.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:52.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644659+0000", 2024-04-25T22:02:52.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8227e-05 2024-04-25T22:02:52.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.644677+0000", 2024-04-25T22:02:52.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7995999999999998e-05 2024-04-25T22:02:52.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:52.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649580+0000", 2024-04-25T22:02:52.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049030799999999998 2024-04-25T22:02:52.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:52.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.649633+0000", 2024-04-25T22:02:52.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3053000000000002e-05 2024-04-25T22:02:52.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:52.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653065+0000", 2024-04-25T22:02:52.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034322200000000001 2024-04-25T22:02:52.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:52.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:52.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:52.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.653146+0000", 2024-04-25T22:02:52.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0668999999999996e-05 2024-04-25T22:02:52.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.185 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:52.185 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:52.186 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:52.187 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:52.181+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:52.187 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:52.288 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:52.281+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:52.325 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:52.325 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:52.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.325 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:138 4.20 e51/46)", 2024-04-25T22:02:52.325 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.324426+0000", 2024-04-25T22:02:52.325 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00026626900000000002, 2024-04-25T22:02:52.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028250399999999999, 2024-04-25T22:02:52.325 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.326 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.326 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-25T22:02:52.326 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.324426+0000", 2024-04-25T22:02:52.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.324426+0000", 2024-04-25T22:02:52.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.324427+0000", 2024-04-25T22:02:52.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:02:52.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.324535+0000", 2024-04-25T22:02:52.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108003 2024-04-25T22:02:52.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.324546+0000", 2024-04-25T22:02:52.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1127e-05 2024-04-25T22:02:52.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.324554+0000", 2024-04-25T22:02:52.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.303e-06 2024-04-25T22:02:52.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.324702+0000", 2024-04-25T22:02:52.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014751 2024-04-25T22:02:52.328 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.328 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.328 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.328 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.328 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:02:52.328 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 1 2024-04-25T22:02:52.328 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:52.341 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:52.389 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:52.385+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:52.489 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:52.485+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:52.519 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:52.519 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:52.519 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:52.519 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:52.519 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:52.535 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:52.591 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:52.585+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:52.690 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:02:52.692 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:52.692 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:52.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:52.692 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:52.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.692 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:52.693 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:52.693 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.492214848, 2024-04-25T22:02:52.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:52.693 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.693 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.693 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.693 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:52.693 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:52.693 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:52.693 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:52.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.693 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.492019606, 2024-04-25T22:02:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:52.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:52.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:52.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:52.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:52.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:52.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:52.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:52.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:52.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:52.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:52.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:52.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:52.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:52.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:52.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:52.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:52.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:52.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:52.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:52.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:52.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:52.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:52.704 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.704 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.704 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.705 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:52.705 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:52.705 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.491957313, 2024-04-25T22:02:52.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:52.705 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.705 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.705 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.705 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:52.705 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:52.705 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:52.705 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:52.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.706 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:52.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:52.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:52.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:52.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:52.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:52.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:52.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:52.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:52.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:52.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:52.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:52.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:52.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:52.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:52.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:52.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:52.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:52.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:52.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:52.710 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.711 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.711 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.711 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:52.711 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:52.711 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.49189709700001, 2024-04-25T22:02:52.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:52.711 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.711 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.711 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.711 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:52.711 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:52.711 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:52.711 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:52.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.712 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:52.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:52.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:52.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:52.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:52.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:52.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:52.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:52.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:52.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:52.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:52.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:52.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:52.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:52.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:52.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:52.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:52.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:52.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:52.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:52.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:52.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:52.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:52.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:52.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:52.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:52.716 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.716 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.716 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.716 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:52.717 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:52.717 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.491707585, 2024-04-25T22:02:52.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:52.717 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.717 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.717 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.717 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:52.717 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:52.717 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:52.717 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:52.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.717 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:52.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:52.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:52.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:52.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:52.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:52.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:52.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:52.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:52.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:52.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:52.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:52.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:52.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:52.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:52.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:52.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:52.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:52.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:52.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:52.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:52.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:52.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:52.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:52.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:52.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:52.722 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.722 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.722 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.722 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:52.722 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:52.722 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.300051463, 2024-04-25T22:02:52.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:52.722 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.722 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.722 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.722 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:52.723 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:52.723 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:52.723 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:52.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.723 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:52.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:52.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:52.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:52.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:52.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:52.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:52.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:52.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:52.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:52.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:52.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:52.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:52.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:52.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:52.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:52.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:52.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:52.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:52.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:52.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:52.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:52.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:52.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:52.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:52.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:52.728 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.728 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.728 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.728 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:52.728 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:52.728 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.299842138, 2024-04-25T22:02:52.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:52.728 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.728 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.728 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.728 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:52.729 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:52.729 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:52.729 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:52.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.729 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:52.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:52.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:52.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:52.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:52.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:52.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:52.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:52.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:52.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:52.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:52.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:52.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:52.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:52.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:52.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:52.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:52.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:52.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:52.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:52.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:52.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:52.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:52.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:52.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:52.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:52.733 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.733 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.733 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.734 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T22:02:52.734 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:02:52.734 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.68458264099999999, 2024-04-25T22:02:52.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.180276931, 2024-04-25T22:02:52.734 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.734 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.734 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.734 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:52.734 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:52.734 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:52.734 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4 2024-04-25T22:02:52.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.735 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:02:52.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:02:52.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983834+0000", 2024-04-25T22:02:52.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2900000000000001e-06 2024-04-25T22:02:52.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991787+0000", 2024-04-25T22:02:52.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079521690000000003 2024-04-25T22:02:52.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991826+0000", 2024-04-25T22:02:52.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9258999999999998e-05 2024-04-25T22:02:52.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991845+0000", 2024-04-25T22:02:52.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9360000000000001e-05 2024-04-25T22:02:52.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992058+0000", 2024-04-25T22:02:52.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212559 2024-04-25T22:02:52.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992213+0000", 2024-04-25T22:02:52.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015520700000000001 2024-04-25T22:02:52.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:52.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992414+0000", 2024-04-25T22:02:52.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020049 2024-04-25T22:02:52.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162511+0000", 2024-04-25T22:02:52.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.17009782900000001 2024-04-25T22:02:52.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:52.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163967+0000", 2024-04-25T22:02:52.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001455752 2024-04-25T22:02:52.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164045+0000", 2024-04-25T22:02:52.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7415000000000003e-05 2024-04-25T22:02:52.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164109+0000", 2024-04-25T22:02:52.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4601e-05 2024-04-25T22:02:52.739 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.739 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.739 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.739 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:52.739 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:02:52.739 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.58512449300000002, 2024-04-25T22:02:52.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.12612672599999999, 2024-04-25T22:02:52.739 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.739 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.740 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.740 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:52.740 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:52.740 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:52.740 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2024-04-25T22:02:52.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.740 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:02:52.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:02:52.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083293+0000", 2024-04-25T22:02:52.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6630000000000002e-06 2024-04-25T22:02:52.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086619+0000", 2024-04-25T22:02:52.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033261699999999998 2024-04-25T22:02:52.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086647+0000", 2024-04-25T22:02:52.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8085999999999998e-05 2024-04-25T22:02:52.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086665+0000", 2024-04-25T22:02:52.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:02:52.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086870+0000", 2024-04-25T22:02:52.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020488599999999999 2024-04-25T22:02:52.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087110+0000", 2024-04-25T22:02:52.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024093199999999999 2024-04-25T22:02:52.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:52.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087310+0000", 2024-04-25T22:02:52.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000199936 2024-04-25T22:02:52.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207766+0000", 2024-04-25T22:02:52.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.120456035 2024-04-25T22:02:52.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:52.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209358+0000", 2024-04-25T22:02:52.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015912369999999999 2024-04-25T22:02:52.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209390+0000", 2024-04-25T22:02:52.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2434999999999997e-05 2024-04-25T22:02:52.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209417+0000", 2024-04-25T22:02:52.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6936000000000001e-05 2024-04-25T22:02:52.744 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.744 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.744 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.745 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop_reply(client.4564.0:4 4.32 e51/16 ondisk, result = 0)", 2024-04-25T22:02:52.745 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.102726+0000", 2024-04-25T22:02:52.745 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.56568895900000005, 2024-04-25T22:02:52.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059798849000000001, 2024-04-25T22:02:52.745 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.745 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.745 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-25T22:02:52.745 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102726+0000", 2024-04-25T22:02:52.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102726+0000", 2024-04-25T22:02:52.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102727+0000", 2024-04-25T22:02:52.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7800000000000001e-07 2024-04-25T22:02:52.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102732+0000", 2024-04-25T22:02:52.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9389999999999996e-06 2024-04-25T22:02:52.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102747+0000", 2024-04-25T22:02:52.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5554e-05 2024-04-25T22:02:52.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102755+0000", 2024-04-25T22:02:52.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1599999999999998e-06 2024-04-25T22:02:52.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162489+0000", 2024-04-25T22:02:52.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059734204999999999 2024-04-25T22:02:52.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162501+0000", 2024-04-25T22:02:52.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1775e-05 2024-04-25T22:02:52.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162525+0000", 2024-04-25T22:02:52.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3438000000000002e-05 2024-04-25T22:02:52.748 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.749 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.749 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.749 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:52.749 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.111321+0000", 2024-04-25T22:02:52.749 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.55709336600000003, 2024-04-25T22:02:52.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.053212803000000003, 2024-04-25T22:02:52.749 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.749 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.749 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.749 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:52.749 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:52.749 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:52.749 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 19 2024-04-25T22:02:52.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.750 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111321+0000", 2024-04-25T22:02:52.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111321+0000", 2024-04-25T22:02:52.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111323+0000", 2024-04-25T22:02:52.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9759999999999998e-06 2024-04-25T22:02:52.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111334+0000", 2024-04-25T22:02:52.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.049e-05 2024-04-25T22:02:52.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111359+0000", 2024-04-25T22:02:52.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.495e-05 2024-04-25T22:02:52.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111380+0000", 2024-04-25T22:02:52.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1063000000000001e-05 2024-04-25T22:02:52.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162572+0000", 2024-04-25T22:02:52.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.051191677999999997 2024-04-25T22:02:52.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162760+0000", 2024-04-25T22:02:52.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018837500000000001 2024-04-25T22:02:52.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:52.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162962+0000", 2024-04-25T22:02:52.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020174200000000001 2024-04-25T22:02:52.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164379+0000", 2024-04-25T22:02:52.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001416856 2024-04-25T22:02:52.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:52.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164402+0000", 2024-04-25T22:02:52.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3734e-05 2024-04-25T22:02:52.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164474+0000", 2024-04-25T22:02:52.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1422999999999997e-05 2024-04-25T22:02:52.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164534+0000", 2024-04-25T22:02:52.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0516000000000001e-05 2024-04-25T22:02:52.754 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.755 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.755 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.755 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:24 4.b e51/16 4:d3eda40d:::1000000020f.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:02:52.755 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.119033+0000", 2024-04-25T22:02:52.755 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.54938149000000003, 2024-04-25T22:02:52.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088682448999999997, 2024-04-25T22:02:52.755 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.755 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.755 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.755 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119033+0000", 2024-04-25T22:02:52.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119033+0000", 2024-04-25T22:02:52.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119035+0000", 2024-04-25T22:02:52.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:02:52.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119044+0000", 2024-04-25T22:02:52.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0860000000000008e-06 2024-04-25T22:02:52.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119068+0000", 2024-04-25T22:02:52.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4037e-05 2024-04-25T22:02:52.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119080+0000", 2024-04-25T22:02:52.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2322e-05 2024-04-25T22:02:52.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119203+0000", 2024-04-25T22:02:52.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012249799999999999 2024-04-25T22:02:52.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119253+0000", 2024-04-25T22:02:52.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0148999999999997e-05 2024-04-25T22:02:52.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207679+0000", 2024-04-25T22:02:52.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088425928000000001 2024-04-25T22:02:52.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207716+0000", 2024-04-25T22:02:52.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7048999999999997e-05 2024-04-25T22:02:52.759 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.759 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.759 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.759 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:27 4.13 4:cbcb6224:::10000000212.00000000:head [write 0~3719] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:52.759 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.122624+0000", 2024-04-25T22:02:52.759 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.54579059699999999, 2024-04-25T22:02:52.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087419288999999997, 2024-04-25T22:02:52.759 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.759 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.759 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.760 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:52.760 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:52.760 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:52.760 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 27 2024-04-25T22:02:52.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.760 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122624+0000", 2024-04-25T22:02:52.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122624+0000", 2024-04-25T22:02:52.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122625+0000", 2024-04-25T22:02:52.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.181e-06 2024-04-25T22:02:52.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122632+0000", 2024-04-25T22:02:52.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8279999999999997e-06 2024-04-25T22:02:52.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122647+0000", 2024-04-25T22:02:52.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4398e-05 2024-04-25T22:02:52.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122657+0000", 2024-04-25T22:02:52.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0662999999999999e-05 2024-04-25T22:02:52.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.206922+0000", 2024-04-25T22:02:52.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084264247 2024-04-25T22:02:52.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207073+0000", 2024-04-25T22:02:52.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015129499999999999 2024-04-25T22:02:52.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:52.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207227+0000", 2024-04-25T22:02:52.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000153819 2024-04-25T22:02:52.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:52.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209429+0000", 2024-04-25T22:02:52.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022023899999999998 2024-04-25T22:02:52.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209971+0000", 2024-04-25T22:02:52.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00054203900000000002 2024-04-25T22:02:52.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210004+0000", 2024-04-25T22:02:52.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2468999999999997e-05 2024-04-25T22:02:52.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210044+0000", 2024-04-25T22:02:52.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9959999999999997e-05 2024-04-25T22:02:52.764 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.764 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.764 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.765 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:52.765 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.124053+0000", 2024-04-25T22:02:52.765 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.54436148399999995, 2024-04-25T22:02:52.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.040913613000000001, 2024-04-25T22:02:52.765 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.765 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.765 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.765 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:52.765 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:52.765 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:52.765 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 28 2024-04-25T22:02:52.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.765 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124053+0000", 2024-04-25T22:02:52.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124053+0000", 2024-04-25T22:02:52.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124054+0000", 2024-04-25T22:02:52.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8200000000000008e-07 2024-04-25T22:02:52.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124060+0000", 2024-04-25T22:02:52.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6879999999999996e-06 2024-04-25T22:02:52.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124073+0000", 2024-04-25T22:02:52.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3113e-05 2024-04-25T22:02:52.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124081+0000", 2024-04-25T22:02:52.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4959999999999999e-06 2024-04-25T22:02:52.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163657+0000", 2024-04-25T22:02:52.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.039576014 2024-04-25T22:02:52.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163775+0000", 2024-04-25T22:02:52.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011861100000000001 2024-04-25T22:02:52.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:52.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163907+0000", 2024-04-25T22:02:52.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013217599999999999 2024-04-25T22:02:52.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164803+0000", 2024-04-25T22:02:52.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000895801 2024-04-25T22:02:52.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:52.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164825+0000", 2024-04-25T22:02:52.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1339e-05 2024-04-25T22:02:52.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164906+0000", 2024-04-25T22:02:52.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.119e-05 2024-04-25T22:02:52.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164967+0000", 2024-04-25T22:02:52.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1203000000000003e-05 2024-04-25T22:02:52.770 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.770 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.770 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.770 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:32 4.b e51/16 4:d2dbd4ac:::10000000217.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:02:52.770 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.130764+0000", 2024-04-25T22:02:52.771 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.53765074499999999, 2024-04-25T22:02:52.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.07870402, 2024-04-25T22:02:52.771 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.771 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.771 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.771 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130764+0000", 2024-04-25T22:02:52.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130764+0000", 2024-04-25T22:02:52.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130766+0000", 2024-04-25T22:02:52.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6270000000000001e-06 2024-04-25T22:02:52.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130777+0000", 2024-04-25T22:02:52.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1799e-05 2024-04-25T22:02:52.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130805+0000", 2024-04-25T22:02:52.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7036999999999999e-05 2024-04-25T22:02:52.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130817+0000", 2024-04-25T22:02:52.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2856e-05 2024-04-25T22:02:52.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.206926+0000", 2024-04-25T22:02:52.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.076108517000000001 2024-04-25T22:02:52.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207009+0000", 2024-04-25T22:02:52.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.276e-05 2024-04-25T22:02:52.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209432+0000", 2024-04-25T22:02:52.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024229830000000001 2024-04-25T22:02:52.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209468+0000", 2024-04-25T22:02:52.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6440999999999999e-05 2024-04-25T22:02:52.775 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.776 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.776 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.776 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:46 4.b e51/16 4:d0d26e50:::10000000225.00000000:head v 51'3, mlcod=0'0)", 2024-04-25T22:02:52.776 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:02:52.776 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.51759522999999996, 2024-04-25T22:02:52.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.058683655000000001, 2024-04-25T22:02:52.776 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.776 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.776 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.776 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:02:52.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:02:52.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:02:52.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7499999999999999e-07 2024-04-25T22:02:52.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150827+0000", 2024-04-25T22:02:52.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.64e-06 2024-04-25T22:02:52.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150841+0000", 2024-04-25T22:02:52.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3895e-05 2024-04-25T22:02:52.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150849+0000", 2024-04-25T22:02:52.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5310000000000004e-06 2024-04-25T22:02:52.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207762+0000", 2024-04-25T22:02:52.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.056913380999999999 2024-04-25T22:02:52.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207782+0000", 2024-04-25T22:02:52.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0026000000000001e-05 2024-04-25T22:02:52.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209471+0000", 2024-04-25T22:02:52.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016892020000000001 2024-04-25T22:02:52.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209503+0000", 2024-04-25T22:02:52.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2104999999999998e-05 2024-04-25T22:02:52.780 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.780 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.780 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.780 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:54 4.2b 4:d5ee56ee:::1000000022d.00000000:head [write 0~3953] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:52.780 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.162091+0000", 2024-04-25T22:02:52.780 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.50632427099999999, 2024-04-25T22:02:52.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.048184338, 2024-04-25T22:02:52.780 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.780 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.781 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.781 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:52.781 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:52.781 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:52.781 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54 2024-04-25T22:02:52.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.781 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162091+0000", 2024-04-25T22:02:52.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162091+0000", 2024-04-25T22:02:52.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162092+0000", 2024-04-25T22:02:52.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.175e-06 2024-04-25T22:02:52.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162102+0000", 2024-04-25T22:02:52.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0012e-05 2024-04-25T22:02:52.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162117+0000", 2024-04-25T22:02:52.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5443000000000001e-05 2024-04-25T22:02:52.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162126+0000", 2024-04-25T22:02:52.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1840000000000005e-06 2024-04-25T22:02:52.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207805+0000", 2024-04-25T22:02:52.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.045678641999999998 2024-04-25T22:02:52.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207941+0000", 2024-04-25T22:02:52.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000135983 2024-04-25T22:02:52.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:02:52.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.208119+0000", 2024-04-25T22:02:52.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017767099999999999 2024-04-25T22:02:52.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:52.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209511+0000", 2024-04-25T22:02:52.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001392304 2024-04-25T22:02:52.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210222+0000", 2024-04-25T22:02:52.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00071096500000000003 2024-04-25T22:02:52.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210250+0000", 2024-04-25T22:02:52.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8004000000000002e-05 2024-04-25T22:02:52.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210275+0000", 2024-04-25T22:02:52.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4955000000000001e-05 2024-04-25T22:02:52.786 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.786 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.786 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.786 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:66 4.13 4:c9855970:::10000000239.00000000:head [write 0~5553] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:52.786 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.182863+0000", 2024-04-25T22:02:52.786 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.48555192800000002, 2024-04-25T22:02:52.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02766389, 2024-04-25T22:02:52.786 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.786 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.786 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.787 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:52.787 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:52.787 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:52.787 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 66 2024-04-25T22:02:52.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.787 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.182863+0000", 2024-04-25T22:02:52.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.182863+0000", 2024-04-25T22:02:52.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.182864+0000", 2024-04-25T22:02:52.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0359999999999999e-06 2024-04-25T22:02:52.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.182874+0000", 2024-04-25T22:02:52.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0131e-05 2024-04-25T22:02:52.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.182889+0000", 2024-04-25T22:02:52.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4497e-05 2024-04-25T22:02:52.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.182897+0000", 2024-04-25T22:02:52.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0900000000000005e-06 2024-04-25T22:02:52.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.208187+0000", 2024-04-25T22:02:52.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025289903999999998 2024-04-25T22:02:52.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.208342+0000", 2024-04-25T22:02:52.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015553499999999999 2024-04-25T22:02:52.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:52.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.208508+0000", 2024-04-25T22:02:52.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016545199999999999 2024-04-25T22:02:52.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:52.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210054+0000", 2024-04-25T22:02:52.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015464210000000001 2024-04-25T22:02:52.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210467+0000", 2024-04-25T22:02:52.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00041311800000000002 2024-04-25T22:02:52.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210502+0000", 2024-04-25T22:02:52.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5379999999999997e-05 2024-04-25T22:02:52.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210527+0000", 2024-04-25T22:02:52.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4326000000000001e-05 2024-04-25T22:02:52.791 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.791 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.791 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.791 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:52.791 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.201108+0000", 2024-04-25T22:02:52.791 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.467307264, 2024-04-25T22:02:52.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088952635000000002, 2024-04-25T22:02:52.792 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.792 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.792 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.792 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:52.792 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:52.792 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:52.792 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 77 2024-04-25T22:02:52.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.792 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201108+0000", 2024-04-25T22:02:52.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201108+0000", 2024-04-25T22:02:52.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201109+0000", 2024-04-25T22:02:52.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2160000000000001e-06 2024-04-25T22:02:52.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201116+0000", 2024-04-25T22:02:52.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9979999999999997e-06 2024-04-25T22:02:52.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201133+0000", 2024-04-25T22:02:52.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.753e-05 2024-04-25T22:02:52.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201156+0000", 2024-04-25T22:02:52.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2558999999999999e-05 2024-04-25T22:02:52.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201216+0000", 2024-04-25T22:02:52.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9741000000000003e-05 2024-04-25T22:02:52.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201307+0000", 2024-04-25T22:02:52.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1314e-05 2024-04-25T22:02:52.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:02:52.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201395+0000", 2024-04-25T22:02:52.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8460000000000003e-05 2024-04-25T22:02:52.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:52.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.202212+0000", 2024-04-25T22:02:52.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000816923 2024-04-25T22:02:52.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.289754+0000", 2024-04-25T22:02:52.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087541315999999994 2024-04-25T22:02:52.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.289931+0000", 2024-04-25T22:02:52.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017723700000000001 2024-04-25T22:02:52.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290060+0000", 2024-04-25T22:02:52.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012934099999999999 2024-04-25T22:02:52.797 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.797 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.797 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.797 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:52.797 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.224278+0000", 2024-04-25T22:02:52.797 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.44413657600000001, 2024-04-25T22:02:52.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.066143380000000002, 2024-04-25T22:02:52.797 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:52.797 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:52.797 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:52.797 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:52.797 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:52.797 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:52.798 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 89 2024-04-25T22:02:52.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.798 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:52.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:52.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224278+0000", 2024-04-25T22:02:52.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:52.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224278+0000", 2024-04-25T22:02:52.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:52.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:52.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224279+0000", 2024-04-25T22:02:52.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.248e-06 2024-04-25T22:02:52.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:52.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224286+0000", 2024-04-25T22:02:52.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4799999999999998e-06 2024-04-25T22:02:52.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:52.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224300+0000", 2024-04-25T22:02:52.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4275e-05 2024-04-25T22:02:52.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:52.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224311+0000", 2024-04-25T22:02:52.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1182999999999999e-05 2024-04-25T22:02:52.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:52.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224396+0000", 2024-04-25T22:02:52.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4901999999999995e-05 2024-04-25T22:02:52.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:52.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224561+0000", 2024-04-25T22:02:52.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016465699999999999 2024-04-25T22:02:52.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:02:52.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224734+0000", 2024-04-25T22:02:52.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017334800000000001 2024-04-25T22:02:52.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:52.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.225929+0000", 2024-04-25T22:02:52.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001194575 2024-04-25T22:02:52.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:52.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290179+0000", 2024-04-25T22:02:52.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064250242999999999 2024-04-25T22:02:52.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:52.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290329+0000", 2024-04-25T22:02:52.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014964700000000001 2024-04-25T22:02:52.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:52.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:52.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:52.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290422+0000", 2024-04-25T22:02:52.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2822e-05 2024-04-25T22:02:52.802 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.802 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.802 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.802 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:52.803 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:52.803 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:52.803 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:52.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:52.689+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:52.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:52.801+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:52.906 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:52.901+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:52.942 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:52.942 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:52.942 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:02:52.942 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:52.957 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:52.981 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:52.981 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:53.005 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:53.005 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:53.006 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:53.001+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:53.030 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:53.031 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:53.087 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:53.087 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:53.105 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:53.106 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:53.101+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:53.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:53.205+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:53.226 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:53.226 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:53.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:53.308 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:53.305+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:53.376 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:53.376 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:53.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:53.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:53.405+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:53.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:53.505+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:53.560 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:53.560 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:53.575 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:53.620 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:53.617+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:53.701 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:53.701 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:53.713 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:53.709+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:53.716 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:53.813 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:53.809+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:53.855 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:53.856 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:53.871 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:53.888 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:02:53.888 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:02:53.888 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-25T22:02:53.888 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-25T22:02:53.889 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:02:53.915 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:53.909+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:54.005 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:54.005 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:54.015 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:54.009+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:54.021 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:54.116 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:54.109+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:54.191 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:54.191 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:54.206 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:54.246 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:02:54.247 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-25T22:02:54.247 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 51, 2024-04-25T22:02:54.247 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "1ced109c-704f-44b1-9811-a2da74898889", 2024-04-25T22:02:54.247 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-25T22:00:52.024472+0000", 2024-04-25T22:02:54.247 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-25T22:02:51.852306+0000", 2024-04-25T22:02:54.247 INFO:teuthology.orchestra.run.smithi044.stdout: "last_up_change": "2024-04-25T22:01:03.432353+0000", 2024-04-25T22:02:54.247 INFO:teuthology.orchestra.run.smithi044.stdout: "last_in_change": "2024-04-25T22:00:53.642701+0000", 2024-04-25T22:02:54.247 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-25T22:02:54.247 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_num": 5806080, 2024-04-25T22:02:54.247 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_set": [ 2024-04-25T22:02:54.247 INFO:teuthology.orchestra.run.smithi044.stdout: "nodeep-scrub", 2024-04-25T22:02:54.247 INFO:teuthology.orchestra.run.smithi044.stdout: "noscrub", 2024-04-25T22:02:54.247 INFO:teuthology.orchestra.run.smithi044.stdout: "pglog_hardlimit", 2024-04-25T22:02:54.247 INFO:teuthology.orchestra.run.smithi044.stdout: "purged_snapdirs", 2024-04-25T22:02:54.248 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_deletes", 2024-04-25T22:02:54.248 INFO:teuthology.orchestra.run.smithi044.stdout: "sortbitwise" 2024-04-25T22:02:54.248 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:02:54.248 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_version": 4, 2024-04-25T22:02:54.248 INFO:teuthology.orchestra.run.smithi044.stdout: "full_ratio": 0.94999998807907104, 2024-04-25T22:02:54.248 INFO:teuthology.orchestra.run.smithi044.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-25T22:02:54.248 INFO:teuthology.orchestra.run.smithi044.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-25T22:02:54.248 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_snapshot": "", 2024-04-25T22:02:54.248 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_max": 4, 2024-04-25T22:02:54.248 INFO:teuthology.orchestra.run.smithi044.stdout: "max_osd": 3, 2024-04-25T22:02:54.248 INFO:teuthology.orchestra.run.smithi044.stdout: "require_min_compat_client": "luminous", 2024-04-25T22:02:54.248 INFO:teuthology.orchestra.run.smithi044.stdout: "min_compat_client": "jewel", 2024-04-25T22:02:54.248 INFO:teuthology.orchestra.run.smithi044.stdout: "require_osd_release": "squid", 2024-04-25T22:02:54.248 INFO:teuthology.orchestra.run.smithi044.stdout: "allow_crimson": false, 2024-04-25T22:02:54.249 INFO:teuthology.orchestra.run.smithi044.stdout: "pools": [ 2024-04-25T22:02:54.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.249 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 1, 2024-04-25T22:02:54.249 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": ".mgr", 2024-04-25T22:02:54.249 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:03.632568+0000", 2024-04-25T22:02:54.249 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:02:54.249 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:02:54.249 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:02:54.249 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:02:54.249 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:02:54.249 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:02:54.249 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:02:54.249 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:02:54.249 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:02:54.249 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:02:54.250 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:02:54.250 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:02:54.250 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 1, 2024-04-25T22:02:54.250 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 1, 2024-04-25T22:02:54.250 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 1, 2024-04-25T22:02:54.250 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 1, 2024-04-25T22:02:54.250 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 1, 2024-04-25T22:02:54.250 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:02:54.250 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:02:54.250 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:02:54.250 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:02:54.250 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:02:54.250 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:02:54.250 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:02:54.251 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.251 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "11", 2024-04-25T22:02:54.251 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:02:54.251 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:02:54.251 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:02:54.251 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:02:54.251 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:02:54.251 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:02:54.251 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:02:54.251 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:02:54.251 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:02:54.251 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:02:54.251 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:02:54.251 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:02:54.252 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:02:54.252 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:02:54.252 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:02:54.252 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:02:54.252 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:02:54.252 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:02:54.252 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:02:54.252 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:02:54.252 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:02:54.252 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:02:54.252 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:02:54.252 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:02:54.252 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:02:54.252 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:02:54.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.253 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:02:54.253 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:02:54.253 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:02:54.253 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:02:54.253 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:02:54.253 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:02:54.253 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:02:54.253 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:02:54.253 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:02:54.253 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:02:54.253 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:02:54.253 INFO:teuthology.orchestra.run.smithi044.stdout: "options": { 2024-04-25T22:02:54.253 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_max": 32, 2024-04-25T22:02:54.253 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_min": 1 2024-04-25T22:02:54.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.254 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:02:54.254 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": {} 2024-04-25T22:02:54.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.254 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:02:54.254 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:02:54.254 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 2, 2024-04-25T22:02:54.254 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 2, 2024-04-25T22:02:54.254 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 1, 2024-04-25T22:02:54.254 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 2, 2024-04-25T22:02:54.254 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 2, 2024-04-25T22:02:54.254 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 0.55499780178070068, 2024-04-25T22:02:54.254 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 0.82999998331069946, 2024-04-25T22:02:54.254 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 0.55000001192092896 2024-04-25T22:02:54.255 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.255 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.255 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.255 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 2, 2024-04-25T22:02:54.255 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": "rbd", 2024-04-25T22:02:54.255 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:07.995071+0000", 2024-04-25T22:02:54.255 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:02:54.255 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:02:54.255 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:02:54.255 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:02:54.255 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:02:54.255 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:02:54.255 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:02:54.255 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:02:54.255 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:02:54.256 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:02:54.256 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:02:54.256 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:02:54.256 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 8, 2024-04-25T22:02:54.256 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 8, 2024-04-25T22:02:54.256 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 8, 2024-04-25T22:02:54.256 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 8, 2024-04-25T22:02:54.256 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 8, 2024-04-25T22:02:54.256 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:02:54.256 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:02:54.256 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:02:54.256 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:02:54.256 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:02:54.256 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:02:54.257 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:02:54.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.257 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "14", 2024-04-25T22:02:54.257 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:02:54.257 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:02:54.257 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:02:54.257 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:02:54.257 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:02:54.257 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:02:54.257 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:02:54.257 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:02:54.257 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:02:54.257 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:02:54.257 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:02:54.257 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:02:54.258 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:02:54.258 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:02:54.258 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:02:54.258 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:02:54.258 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:02:54.258 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:02:54.258 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:02:54.258 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:02:54.258 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:02:54.258 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:02:54.258 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:02:54.258 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:02:54.258 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:02:54.258 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:02:54.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.259 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:02:54.259 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:02:54.259 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:02:54.259 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:02:54.259 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:02:54.259 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:02:54.259 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:02:54.259 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:02:54.259 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:02:54.259 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:02:54.259 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:02:54.259 INFO:teuthology.orchestra.run.smithi044.stdout: "options": {}, 2024-04-25T22:02:54.259 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:02:54.259 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd": {} 2024-04-25T22:02:54.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.260 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:02:54.260 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:02:54.260 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 1, 2024-04-25T22:02:54.260 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 1, 2024-04-25T22:02:54.260 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 1.5, 2024-04-25T22:02:54.260 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 1.5, 2024-04-25T22:02:54.260 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 1.5, 2024-04-25T22:02:54.260 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 0.55499780178070068, 2024-04-25T22:02:54.260 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 0.82999998331069946, 2024-04-25T22:02:54.260 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 0.55000001192092896 2024-04-25T22:02:54.260 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.260 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.260 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 3, 2024-04-25T22:02:54.261 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": "cephfs_metadata", 2024-04-25T22:02:54.261 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:12.514055+0000", 2024-04-25T22:02:54.261 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:02:54.261 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:02:54.261 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:02:54.261 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:02:54.261 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:02:54.261 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:02:54.261 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:02:54.261 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:02:54.261 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:02:54.261 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:02:54.261 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:02:54.261 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:02:54.261 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 32, 2024-04-25T22:02:54.262 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 32, 2024-04-25T22:02:54.262 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 32, 2024-04-25T22:02:54.262 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 32, 2024-04-25T22:02:54.262 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 32, 2024-04-25T22:02:54.262 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:02:54.262 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:02:54.262 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:02:54.262 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:02:54.262 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:02:54.262 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:02:54.262 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:02:54.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.262 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "17", 2024-04-25T22:02:54.262 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:02:54.263 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:02:54.263 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:02:54.263 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:02:54.263 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:02:54.263 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:02:54.263 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:02:54.263 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:02:54.263 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:02:54.263 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:02:54.263 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:02:54.263 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:02:54.263 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:02:54.263 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:02:54.263 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:02:54.263 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:02:54.264 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:02:54.264 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:02:54.264 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:02:54.264 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:02:54.264 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:02:54.264 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:02:54.264 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:02:54.264 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:02:54.264 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:02:54.264 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:02:54.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.264 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:02:54.264 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:02:54.264 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:02:54.264 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:02:54.264 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:02:54.265 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:02:54.265 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:02:54.265 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:02:54.265 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:02:54.265 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:02:54.265 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:02:54.265 INFO:teuthology.orchestra.run.smithi044.stdout: "options": { 2024-04-25T22:02:54.265 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_bias": 4, 2024-04-25T22:02:54.265 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_min": 16, 2024-04-25T22:02:54.265 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_priority": 5 2024-04-25T22:02:54.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.265 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:02:54.265 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs": { 2024-04-25T22:02:54.265 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": "cephfs" 2024-04-25T22:02:54.265 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.266 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:02:54.266 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:02:54.266 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 6.679999828338623, 2024-04-25T22:02:54.266 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 1.1299999952316284, 2024-04-25T22:02:54.266 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 1.5, 2024-04-25T22:02:54.266 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 10.020000457763672, 2024-04-25T22:02:54.266 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 1.690000057220459, 2024-04-25T22:02:54.266 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 0.55499780178070068, 2024-04-25T22:02:54.266 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 0.82999998331069946, 2024-04-25T22:02:54.266 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 0.55000001192092896, 2024-04-25T22:02:54.266 INFO:teuthology.orchestra.run.smithi044.stdout: "error_message": "pool 3 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate" 2024-04-25T22:02:54.266 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.266 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.267 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 4, 2024-04-25T22:02:54.267 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": "cephfs_data", 2024-04-25T22:02:54.267 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:12.963831+0000", 2024-04-25T22:02:54.267 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:02:54.267 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:02:54.267 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:02:54.267 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:02:54.267 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:02:54.267 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:02:54.267 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:02:54.267 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:02:54.267 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:02:54.267 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:02:54.267 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:02:54.267 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:02:54.267 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 64, 2024-04-25T22:02:54.267 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 64, 2024-04-25T22:02:54.268 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 64, 2024-04-25T22:02:54.268 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 64, 2024-04-25T22:02:54.268 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 64, 2024-04-25T22:02:54.268 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:02:54.268 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:02:54.268 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:02:54.268 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:02:54.268 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:02:54.268 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:02:54.268 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:02:54.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.268 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "18", 2024-04-25T22:02:54.268 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:02:54.268 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:02:54.268 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:02:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:02:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:02:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:02:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:02:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:02:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:02:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:02:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:02:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:02:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:02:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:02:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:02:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:02:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:02:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:02:54.269 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:02:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:02:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:02:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:02:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:02:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:02:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:02:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:02:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:02:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:02:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:02:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:02:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:02:54.270 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:02:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:02:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:02:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:02:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:02:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:02:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "options": { 2024-04-25T22:02:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_min": 64, 2024-04-25T22:02:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "target_size_ratio": 0.89999997615814209 2024-04-25T22:02:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:02:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs": { 2024-04-25T22:02:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "data": "cephfs" 2024-04-25T22:02:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:02:54.271 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:02:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 14.470000267028809, 2024-04-25T22:02:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 1.0900000333786011, 2024-04-25T22:02:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 1.5, 2024-04-25T22:02:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 21.700000762939453, 2024-04-25T22:02:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 1.6399999856948853, 2024-04-25T22:02:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 0.55499780178070068, 2024-04-25T22:02:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 0.82999998331069946, 2024-04-25T22:02:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 0.55000001192092896, 2024-04-25T22:02:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "error_message": "pool 4 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate" 2024-04-25T22:02:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:02:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "osds": [ 2024-04-25T22:02:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 0, 2024-04-25T22:02:54.272 INFO:teuthology.orchestra.run.smithi044.stdout: "uuid": "098ec92c-0fd2-4231-8beb-09fccca634d9", 2024-04-25T22:02:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "up": 1, 2024-04-25T22:02:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "in": 1, 2024-04-25T22:02:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 1, 2024-04-25T22:02:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity": 0.6649932861328125, 2024-04-25T22:02:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_begin": 0, 2024-04-25T22:02:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_end": 0, 2024-04-25T22:02:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "up_from": 8, 2024-04-25T22:02:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "up_thru": 49, 2024-04-25T22:02:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "down_at": 0, 2024-04-25T22:02:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "lost_at": 0, 2024-04-25T22:02:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-25T22:02:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:54.273 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6800", 2024-04-25T22:02:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:02:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6801", 2024-04-25T22:02:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:02:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addrs": { 2024-04-25T22:02:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6802", 2024-04-25T22:02:54.274 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:02:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6803", 2024-04-25T22:02:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:02:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addrs": { 2024-04-25T22:02:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6806", 2024-04-25T22:02:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:02:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6807", 2024-04-25T22:02:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:02:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addrs": { 2024-04-25T22:02:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6804", 2024-04-25T22:02:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:02:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.276 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6805", 2024-04-25T22:02:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:02:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.57:6801/2385981072", 2024-04-25T22:02:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addr": "172.21.15.57:6803/2385981072", 2024-04-25T22:02:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addr": "172.21.15.57:6807/2385981072", 2024-04-25T22:02:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addr": "172.21.15.57:6805/2385981072", 2024-04-25T22:02:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "state": [ 2024-04-25T22:02:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "exists", 2024-04-25T22:02:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: "up" 2024-04-25T22:02:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:54.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 1, 2024-04-25T22:02:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "uuid": "a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef", 2024-04-25T22:02:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "up": 1, 2024-04-25T22:02:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "in": 1, 2024-04-25T22:02:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 1, 2024-04-25T22:02:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity": 1, 2024-04-25T22:02:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_begin": 0, 2024-04-25T22:02:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_end": 0, 2024-04-25T22:02:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "up_from": 8, 2024-04-25T22:02:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "up_thru": 49, 2024-04-25T22:02:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "down_at": 0, 2024-04-25T22:02:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "lost_at": 0, 2024-04-25T22:02:54.278 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-25T22:02:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6800", 2024-04-25T22:02:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:02:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6801", 2024-04-25T22:02:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:02:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.279 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addrs": { 2024-04-25T22:02:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6802", 2024-04-25T22:02:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:02:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6803", 2024-04-25T22:02:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:02:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:54.280 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addrs": { 2024-04-25T22:02:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6806", 2024-04-25T22:02:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:02:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6807", 2024-04-25T22:02:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:02:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.281 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addrs": { 2024-04-25T22:02:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6804", 2024-04-25T22:02:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:02:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6805", 2024-04-25T22:02:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:02:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.282 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.79:6801/29975895", 2024-04-25T22:02:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addr": "172.21.15.79:6803/29975895", 2024-04-25T22:02:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addr": "172.21.15.79:6807/29975895", 2024-04-25T22:02:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addr": "172.21.15.79:6805/29975895", 2024-04-25T22:02:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "state": [ 2024-04-25T22:02:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "exists", 2024-04-25T22:02:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "up" 2024-04-25T22:02:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 2, 2024-04-25T22:02:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "uuid": "290ee5c1-81af-400c-b15a-f63c4794a3b0", 2024-04-25T22:02:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "up": 1, 2024-04-25T22:02:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "in": 1, 2024-04-25T22:02:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 1, 2024-04-25T22:02:54.283 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity": 0, 2024-04-25T22:02:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_begin": 0, 2024-04-25T22:02:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_end": 0, 2024-04-25T22:02:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: "up_from": 8, 2024-04-25T22:02:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: "up_thru": 46, 2024-04-25T22:02:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: "down_at": 0, 2024-04-25T22:02:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: "lost_at": 0, 2024-04-25T22:02:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-25T22:02:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6800", 2024-04-25T22:02:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:02:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.284 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6801", 2024-04-25T22:02:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:02:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addrs": { 2024-04-25T22:02:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6802", 2024-04-25T22:02:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:02:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.285 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6803", 2024-04-25T22:02:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:02:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addrs": { 2024-04-25T22:02:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6806", 2024-04-25T22:02:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:02:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.286 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6807", 2024-04-25T22:02:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:02:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addrs": { 2024-04-25T22:02:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:02:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:02:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6804", 2024-04-25T22:02:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:02:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.287 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:02:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6805", 2024-04-25T22:02:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:02:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.81:6801/3918111900", 2024-04-25T22:02:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addr": "172.21.15.81:6803/3918111900", 2024-04-25T22:02:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addr": "172.21.15.81:6807/3918111900", 2024-04-25T22:02:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addr": "172.21.15.81:6805/3918111900", 2024-04-25T22:02:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: "state": [ 2024-04-25T22:02:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: "exists", 2024-04-25T22:02:54.288 INFO:teuthology.orchestra.run.smithi044.stdout: "up" 2024-04-25T22:02:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:02:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:02:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_xinfo": [ 2024-04-25T22:02:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 0, 2024-04-25T22:02:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: "down_stamp": "0.000000", 2024-04-25T22:02:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_probability": 0, 2024-04-25T22:02:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_interval": 0, 2024-04-25T22:02:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: "features": 4540701547738038271, 2024-04-25T22:02:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: "old_weight": 0, 2024-04-25T22:02:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: "last_purged_snaps_scrub": "2024-04-25T22:00:59.025944+0000", 2024-04-25T22:02:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: "dead_epoch": 0 2024-04-25T22:02:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 1, 2024-04-25T22:02:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "down_stamp": "0.000000", 2024-04-25T22:02:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_probability": 0, 2024-04-25T22:02:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_interval": 0, 2024-04-25T22:02:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "features": 4540701547738038271, 2024-04-25T22:02:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "old_weight": 0, 2024-04-25T22:02:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "last_purged_snaps_scrub": "2024-04-25T22:00:58.986080+0000", 2024-04-25T22:02:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "dead_epoch": 0 2024-04-25T22:02:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:02:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 2, 2024-04-25T22:02:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "down_stamp": "0.000000", 2024-04-25T22:02:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_probability": 0, 2024-04-25T22:02:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_interval": 0, 2024-04-25T22:02:54.290 INFO:teuthology.orchestra.run.smithi044.stdout: "features": 4540701547738038271, 2024-04-25T22:02:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "old_weight": 0, 2024-04-25T22:02:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "last_purged_snaps_scrub": "2024-04-25T22:00:58.971238+0000", 2024-04-25T22:02:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "dead_epoch": 0 2024-04-25T22:02:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:02:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_upmap": [], 2024-04-25T22:02:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_upmap_items": [], 2024-04-25T22:02:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_upmap_primaries": [], 2024-04-25T22:02:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_temp": [], 2024-04-25T22:02:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_temp": [], 2024-04-25T22:02:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklist": {}, 2024-04-25T22:02:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "range_blocklist": {}, 2024-04-25T22:02:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profiles": { 2024-04-25T22:02:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "default": { 2024-04-25T22:02:54.291 INFO:teuthology.orchestra.run.smithi044.stdout: "crush-failure-domain": "osd", 2024-04-25T22:02:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "k": "2", 2024-04-25T22:02:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "m": "1", 2024-04-25T22:02:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "plugin": "jerasure", 2024-04-25T22:02:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "technique": "reed_sol_van" 2024-04-25T22:02:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:02:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps_queue": [], 2024-04-25T22:02:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "new_removed_snaps": [], 2024-04-25T22:02:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "new_purged_snaps": [], 2024-04-25T22:02:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_node_flags": {}, 2024-04-25T22:02:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "device_class_flags": {}, 2024-04-25T22:02:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": { 2024-04-25T22:02:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode_enabled": false, 2024-04-25T22:02:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_bucket_count": 0, 2024-04-25T22:02:54.292 INFO:teuthology.orchestra.run.smithi044.stdout: "degraded_stretch_mode": 0, 2024-04-25T22:02:54.293 INFO:teuthology.orchestra.run.smithi044.stdout: "recovering_stretch_mode": 0, 2024-04-25T22:02:54.293 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode_bucket": 0 2024-04-25T22:02:54.293 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:02:54.293 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-25T22:02:54.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:54.249+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:54.295 INFO:tasks.thrashosds.thrasher:j is {'epoch': 51, 'fsid': '1ced109c-704f-44b1-9811-a2da74898889', 'created': '2024-04-25T22:00:52.024472+0000', 'modified': '2024-04-25T22:02:51.852306+0000', 'last_up_change': '2024-04-25T22:01:03.432353+0000', 'last_in_change': '2024-04-25T22:00:53.642701+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:01:03.632568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.5549978017807007, 'average_primary_affinity': 0.8299999833106995, 'average_primary_affinity_weighted': 0.550000011920929}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:01:07.995071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1, 'score_stable': 1, 'optimal_score': 1.5, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.5549978017807007, 'average_primary_affinity': 0.8299999833106995, 'average_primary_affinity_weighted': 0.550000011920929}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:01:12.514055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.679999828338623, 'score_stable': 1.1299999952316284, 'optimal_score': 1.5, 'raw_score_acting': 10.020000457763672, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 0.5549978017807007, 'average_primary_affinity': 0.8299999833106995, 'average_primary_affinity_weighted': 0.550000011920929, 'error_message': 'pool 3 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate'}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:01:12.963831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 14.470000267028809, 'score_stable': 1.090000033378601, 'optimal_score': 1.5, 'raw_score_acting': 21.700000762939453, 'raw_score_stable': 1.6399999856948853, 'primary_affinity_weighted': 0.5549978017807007, 'average_primary_affinity': 0.8299999833106995, 'average_primary_affinity_weighted': 0.550000011920929, 'error_message': 'pool 4 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate'}}], 'osds': [{'osd': 0, 'uuid': '098ec92c-0fd2-4231-8beb-09fccca634d9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6649932861328125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 49, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6800', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6801', 'nonce': 2385981072}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6802', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6803', 'nonce': 2385981072}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6806', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6807', 'nonce': 2385981072}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6804', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6805', 'nonce': 2385981072}]}, 'public_addr': '172.21.15.57:6801/2385981072', 'cluster_addr': '172.21.15.57:6803/2385981072', 'heartbeat_back_addr': '172.21.15.57:6807/2385981072', 'heartbeat_front_addr': '172.21.15.57:6805/2385981072', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 49, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 29975895}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 29975895}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 29975895}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 29975895}]}, 'public_addr': '172.21.15.79:6801/29975895', 'cluster_addr': '172.21.15.79:6803/29975895', 'heartbeat_back_addr': '172.21.15.79:6807/29975895', 'heartbeat_front_addr': '172.21.15.79:6805/29975895', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '290ee5c1-81af-400c-b15a-f63c4794a3b0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6800', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6801', 'nonce': 3918111900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 3918111900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 3918111900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 3918111900}]}, 'public_addr': '172.21.15.81:6801/3918111900', 'cluster_addr': '172.21.15.81:6803/3918111900', 'heartbeat_back_addr': '172.21.15.81:6807/3918111900', 'heartbeat_front_addr': '172.21.15.81:6805/3918111900', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:00:59.025944+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:00:58.986080+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:00:58.971238+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-25T22:02:54.295 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:02:54.318 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:54.313+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:54.343 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:54.343 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:54.358 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:54.419 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:54.413+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:54.519 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:54.513+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:54.539 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:54.539 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:54.555 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:54.620 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:54.613+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:54.647 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:02:54.649 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:02:54.666 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-04-25T22:02:53.588812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":257,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90748,"kb_used_data":1360,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024772,"statfs":{"total":289910292480,"available":289817366528,"internally_reserved":0,"allocated":1392640,"data_stored":1740178,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001464"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.849161+0000","last_change":"2024-04-25T22:01:14.641678+0000","last_active":"2024-04-25T22:02:45.849161+0000","last_peered":"2024-04-25T22:02:45.849161+0000","last_clean":"2024-04-25T22:02:45.849161+0000","last_became_active":"2024-04-25T22:01:14.640808+0000","last_became_peered":"2024-04-25T22:01:14.640808+0000","last_unstale":"2024-04-25T22:02:45.849161+0000","last_undegraded":"2024-04-25T22:02:45.849161+0000","last_fullsized":"2024-04-25T22:02:45.849161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848773+0000","last_change":"2024-04-25T22:01:14.648935+0000","last_active":"2024-04-25T22:02:45.848773+0000","last_peered":"2024-04-25T22:02:45.848773+0000","last_clean":"2024-04-25T22:02:45.848773+0000","last_became_active":"2024-04-25T22:01:14.647871+0000","last_became_peered":"2024-04-25T22:01:14.647871+0000","last_unstale":"2024-04-25T22:02:45.848773+0000","last_undegraded":"2024-04-25T22:02:45.848773+0000","last_fullsized":"2024-04-25T22:02:45.848773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848334+0000","last_change":"2024-04-25T22:02:43.852218+0000","last_active":"2024-04-25T22:02:45.848334+0000","last_peered":"2024-04-25T22:02:45.848334+0000","last_clean":"2024-04-25T22:02:45.848334+0000","last_became_active":"2024-04-25T22:02:43.851732+0000","last_became_peered":"2024-04-25T22:02:43.851732+0000","last_unstale":"2024-04-25T22:02:45.848334+0000","last_undegraded":"2024-04-25T22:02:45.848334+0000","last_fullsized":"2024-04-25T22:02:45.848334+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:08.019453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.919486+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:02:46.919486+0000","last_peered":"2024-04-25T22:02:46.919486+0000","last_clean":"2024-04-25T22:02:46.919486+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:02:46.919486+0000","last_undegraded":"2024-04-25T22:02:46.919486+0000","last_fullsized":"2024-04-25T22:02:46.919486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848247+0000","last_change":"2024-04-25T22:01:14.642505+0000","last_active":"2024-04-25T22:02:45.848247+0000","last_peered":"2024-04-25T22:02:45.848247+0000","last_clean":"2024-04-25T22:02:45.848247+0000","last_became_active":"2024-04-25T22:01:14.641574+0000","last_became_peered":"2024-04-25T22:01:14.641574+0000","last_unstale":"2024-04-25T22:02:45.848247+0000","last_undegraded":"2024-04-25T22:02:45.848247+0000","last_fullsized":"2024-04-25T22:02:45.848247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.917999+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:02:46.917999+0000","last_peered":"2024-04-25T22:02:46.917999+0000","last_clean":"2024-04-25T22:02:46.917999+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:02:46.917999+0000","last_undegraded":"2024-04-25T22:02:46.917999+0000","last_fullsized":"2024-04-25T22:02:46.917999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.918089+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:02:46.918089+0000","last_peered":"2024-04-25T22:02:46.918089+0000","last_clean":"2024-04-25T22:02:46.918089+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:02:46.918089+0000","last_undegraded":"2024-04-25T22:02:46.918089+0000","last_fullsized":"2024-04-25T22:02:46.918089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.917516+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:02:46.917516+0000","last_peered":"2024-04-25T22:02:46.917516+0000","last_clean":"2024-04-25T22:02:46.917516+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:02:46.917516+0000","last_undegraded":"2024-04-25T22:02:46.917516+0000","last_fullsized":"2024-04-25T22:02:46.917516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.850270+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:02:45.850270+0000","last_peered":"2024-04-25T22:02:45.850270+0000","last_clean":"2024-04-25T22:02:45.850270+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:02:45.850270+0000","last_undegraded":"2024-04-25T22:02:45.850270+0000","last_fullsized":"2024-04-25T22:02:45.850270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848778+0000","last_change":"2024-04-25T22:01:14.647968+0000","last_active":"2024-04-25T22:02:45.848778+0000","last_peered":"2024-04-25T22:02:45.848778+0000","last_clean":"2024-04-25T22:02:45.848778+0000","last_became_active":"2024-04-25T22:01:14.646872+0000","last_became_peered":"2024-04-25T22:01:14.646872+0000","last_unstale":"2024-04-25T22:02:45.848778+0000","last_undegraded":"2024-04-25T22:02:45.848778+0000","last_fullsized":"2024-04-25T22:02:45.848778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.918701+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:02:46.918701+0000","last_peered":"2024-04-25T22:02:46.918701+0000","last_clean":"2024-04-25T22:02:46.918701+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:02:46.918701+0000","last_undegraded":"2024-04-25T22:02:46.918701+0000","last_fullsized":"2024-04-25T22:02:46.918701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848398+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:02:45.848398+0000","last_peered":"2024-04-25T22:02:45.848398+0000","last_clean":"2024-04-25T22:02:45.848398+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:02:45.848398+0000","last_undegraded":"2024-04-25T22:02:45.848398+0000","last_fullsized":"2024-04-25T22:02:45.848398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848084+0000","last_change":"2024-04-25T22:01:14.643909+0000","last_active":"2024-04-25T22:02:45.848084+0000","last_peered":"2024-04-25T22:02:45.848084+0000","last_clean":"2024-04-25T22:02:45.848084+0000","last_became_active":"2024-04-25T22:01:14.642421+0000","last_became_peered":"2024-04-25T22:01:14.642421+0000","last_unstale":"2024-04-25T22:02:45.848084+0000","last_undegraded":"2024-04-25T22:02:45.848084+0000","last_fullsized":"2024-04-25T22:02:45.848084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.918080+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:02:46.918080+0000","last_peered":"2024-04-25T22:02:46.918080+0000","last_clean":"2024-04-25T22:02:46.918080+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:02:46.918080+0000","last_undegraded":"2024-04-25T22:02:46.918080+0000","last_fullsized":"2024-04-25T22:02:46.918080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.918249+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:02:46.918249+0000","last_peered":"2024-04-25T22:02:46.918249+0000","last_clean":"2024-04-25T22:02:46.918249+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:02:46.918249+0000","last_undegraded":"2024-04-25T22:02:46.918249+0000","last_fullsized":"2024-04-25T22:02:46.918249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.917653+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:02:46.917653+0000","last_peered":"2024-04-25T22:02:46.917653+0000","last_clean":"2024-04-25T22:02:46.917653+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:02:46.917653+0000","last_undegraded":"2024-04-25T22:02:46.917653+0000","last_fullsized":"2024-04-25T22:02:46.917653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.851091+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:02:45.851091+0000","last_peered":"2024-04-25T22:02:45.851091+0000","last_clean":"2024-04-25T22:02:45.851091+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:02:45.851091+0000","last_undegraded":"2024-04-25T22:02:45.851091+0000","last_fullsized":"2024-04-25T22:02:45.851091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848978+0000","last_change":"2024-04-25T22:01:14.647317+0000","last_active":"2024-04-25T22:02:45.848978+0000","last_peered":"2024-04-25T22:02:45.848978+0000","last_clean":"2024-04-25T22:02:45.848978+0000","last_became_active":"2024-04-25T22:01:14.644027+0000","last_became_peered":"2024-04-25T22:01:14.644027+0000","last_unstale":"2024-04-25T22:02:45.848978+0000","last_undegraded":"2024-04-25T22:02:45.848978+0000","last_fullsized":"2024-04-25T22:02:45.848978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.850770+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:02:45.850770+0000","last_peered":"2024-04-25T22:02:45.850770+0000","last_clean":"2024-04-25T22:02:45.850770+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:02:45.850770+0000","last_undegraded":"2024-04-25T22:02:45.850770+0000","last_fullsized":"2024-04-25T22:02:45.850770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.919512+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:02:46.919512+0000","last_peered":"2024-04-25T22:02:46.919512+0000","last_clean":"2024-04-25T22:02:46.919512+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:02:46.919512+0000","last_undegraded":"2024-04-25T22:02:46.919512+0000","last_fullsized":"2024-04-25T22:02:46.919512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.918823+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:02:46.918823+0000","last_peered":"2024-04-25T22:02:46.918823+0000","last_clean":"2024-04-25T22:02:46.918823+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:02:46.918823+0000","last_undegraded":"2024-04-25T22:02:46.918823+0000","last_fullsized":"2024-04-25T22:02:46.918823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848087+0000","last_change":"2024-04-25T22:01:14.633477+0000","last_active":"2024-04-25T22:02:45.848087+0000","last_peered":"2024-04-25T22:02:45.848087+0000","last_clean":"2024-04-25T22:02:45.848087+0000","last_became_active":"2024-04-25T22:01:14.632678+0000","last_became_peered":"2024-04-25T22:01:14.632678+0000","last_unstale":"2024-04-25T22:02:45.848087+0000","last_undegraded":"2024-04-25T22:02:45.848087+0000","last_fullsized":"2024-04-25T22:02:45.848087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848193+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:02:45.848193+0000","last_peered":"2024-04-25T22:02:45.848193+0000","last_clean":"2024-04-25T22:02:45.848193+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:02:45.848193+0000","last_undegraded":"2024-04-25T22:02:45.848193+0000","last_fullsized":"2024-04-25T22:02:45.848193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.847860+0000","last_change":"2024-04-25T22:01:14.641991+0000","last_active":"2024-04-25T22:02:45.847860+0000","last_peered":"2024-04-25T22:02:45.847860+0000","last_clean":"2024-04-25T22:02:45.847860+0000","last_became_active":"2024-04-25T22:01:14.641244+0000","last_became_peered":"2024-04-25T22:01:14.641244+0000","last_unstale":"2024-04-25T22:02:45.847860+0000","last_undegraded":"2024-04-25T22:02:45.847860+0000","last_fullsized":"2024-04-25T22:02:45.847860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:03.098700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.849224+0000","last_change":"2024-04-25T22:01:14.638103+0000","last_active":"2024-04-25T22:02:45.849224+0000","last_peered":"2024-04-25T22:02:45.849224+0000","last_clean":"2024-04-25T22:02:45.849224+0000","last_became_active":"2024-04-25T22:01:14.636488+0000","last_became_peered":"2024-04-25T22:01:14.636488+0000","last_unstale":"2024-04-25T22:02:45.849224+0000","last_undegraded":"2024-04-25T22:02:45.849224+0000","last_fullsized":"2024-04-25T22:02:45.849224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.850399+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:02:45.850399+0000","last_peered":"2024-04-25T22:02:45.850399+0000","last_clean":"2024-04-25T22:02:45.850399+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:02:45.850399+0000","last_undegraded":"2024-04-25T22:02:45.850399+0000","last_fullsized":"2024-04-25T22:02:45.850399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.918799+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:02:46.918799+0000","last_peered":"2024-04-25T22:02:46.918799+0000","last_clean":"2024-04-25T22:02:46.918799+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:02:46.918799+0000","last_undegraded":"2024-04-25T22:02:46.918799+0000","last_fullsized":"2024-04-25T22:02:46.918799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848641+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:02:45.848641+0000","last_peered":"2024-04-25T22:02:45.848641+0000","last_clean":"2024-04-25T22:02:45.848641+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:02:45.848641+0000","last_undegraded":"2024-04-25T22:02:45.848641+0000","last_fullsized":"2024-04-25T22:02:45.848641+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.849401+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:02:45.849401+0000","last_peered":"2024-04-25T22:02:45.849401+0000","last_clean":"2024-04-25T22:02:45.849401+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:02:45.849401+0000","last_undegraded":"2024-04-25T22:02:45.849401+0000","last_fullsized":"2024-04-25T22:02:45.849401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848266+0000","last_change":"2024-04-25T22:01:14.638343+0000","last_active":"2024-04-25T22:02:45.848266+0000","last_peered":"2024-04-25T22:02:45.848266+0000","last_clean":"2024-04-25T22:02:45.848266+0000","last_became_active":"2024-04-25T22:01:14.637694+0000","last_became_peered":"2024-04-25T22:01:14.637694+0000","last_unstale":"2024-04-25T22:02:45.848266+0000","last_undegraded":"2024-04-25T22:02:45.848266+0000","last_fullsized":"2024-04-25T22:02:45.848266+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848307+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:02:45.848307+0000","last_peered":"2024-04-25T22:02:45.848307+0000","last_clean":"2024-04-25T22:02:45.848307+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:02:45.848307+0000","last_undegraded":"2024-04-25T22:02:45.848307+0000","last_fullsized":"2024-04-25T22:02:45.848307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848175+0000","last_change":"2024-04-25T22:02:43.850984+0000","last_active":"2024-04-25T22:02:45.848175+0000","last_peered":"2024-04-25T22:02:45.848175+0000","last_clean":"2024-04-25T22:02:45.848175+0000","last_became_active":"2024-04-25T22:02:43.850651+0000","last_became_peered":"2024-04-25T22:02:43.850651+0000","last_unstale":"2024-04-25T22:02:45.848175+0000","last_undegraded":"2024-04-25T22:02:45.848175+0000","last_fullsized":"2024-04-25T22:02:45.848175+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:08.019453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848586+0000","last_change":"2024-04-25T22:01:14.641706+0000","last_active":"2024-04-25T22:02:45.848586+0000","last_peered":"2024-04-25T22:02:45.848586+0000","last_clean":"2024-04-25T22:02:45.848586+0000","last_became_active":"2024-04-25T22:01:14.641043+0000","last_became_peered":"2024-04-25T22:01:14.641043+0000","last_unstale":"2024-04-25T22:02:45.848586+0000","last_undegraded":"2024-04-25T22:02:45.848586+0000","last_fullsized":"2024-04-25T22:02:45.848586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":75,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.918841+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:02:46.918841+0000","last_peered":"2024-04-25T22:02:46.918841+0000","last_clean":"2024-04-25T22:02:46.918841+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:02:46.918841+0000","last_undegraded":"2024-04-25T22:02:46.918841+0000","last_fullsized":"2024-04-25T22:02:46.918841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848622+0000","last_change":"2024-04-25T22:01:14.635075+0000","last_active":"2024-04-25T22:02:45.848622+0000","last_peered":"2024-04-25T22:02:45.848622+0000","last_clean":"2024-04-25T22:02:45.848622+0000","last_became_active":"2024-04-25T22:01:14.630677+0000","last_became_peered":"2024-04-25T22:01:14.630677+0000","last_unstale":"2024-04-25T22:02:45.848622+0000","last_undegraded":"2024-04-25T22:02:45.848622+0000","last_fullsized":"2024-04-25T22:02:45.848622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848957+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:02:45.848957+0000","last_peered":"2024-04-25T22:02:45.848957+0000","last_clean":"2024-04-25T22:02:45.848957+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:02:45.848957+0000","last_undegraded":"2024-04-25T22:02:45.848957+0000","last_fullsized":"2024-04-25T22:02:45.848957+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.850852+0000","last_change":"2024-04-25T22:01:14.648527+0000","last_active":"2024-04-25T22:02:45.850852+0000","last_peered":"2024-04-25T22:02:45.850852+0000","last_clean":"2024-04-25T22:02:45.850852+0000","last_became_active":"2024-04-25T22:01:14.645040+0000","last_became_peered":"2024-04-25T22:01:14.645040+0000","last_unstale":"2024-04-25T22:02:45.850852+0000","last_undegraded":"2024-04-25T22:02:45.850852+0000","last_fullsized":"2024-04-25T22:02:45.850852+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848221+0000","last_change":"2024-04-25T22:01:13.630817+0000","last_active":"2024-04-25T22:02:45.848221+0000","last_peered":"2024-04-25T22:02:45.848221+0000","last_clean":"2024-04-25T22:02:45.848221+0000","last_became_active":"2024-04-25T22:01:13.629994+0000","last_became_peered":"2024-04-25T22:01:13.629994+0000","last_unstale":"2024-04-25T22:02:45.848221+0000","last_undegraded":"2024-04-25T22:02:45.848221+0000","last_fullsized":"2024-04-25T22:02:45.848221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:49:06.071207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.850269+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:02:45.850269+0000","last_peered":"2024-04-25T22:02:45.850269+0000","last_clean":"2024-04-25T22:02:45.850269+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:02:45.850269+0000","last_undegraded":"2024-04-25T22:02:45.850269+0000","last_fullsized":"2024-04-25T22:02:45.850269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":81,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.917965+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:02:46.917965+0000","last_peered":"2024-04-25T22:02:46.917965+0000","last_clean":"2024-04-25T22:02:46.917965+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:02:46.917965+0000","last_undegraded":"2024-04-25T22:02:46.917965+0000","last_fullsized":"2024-04-25T22:02:46.917965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.919658+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:02:46.919658+0000","last_peered":"2024-04-25T22:02:46.919658+0000","last_clean":"2024-04-25T22:02:46.919658+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:02:46.919658+0000","last_undegraded":"2024-04-25T22:02:46.919658+0000","last_fullsized":"2024-04-25T22:02:46.919658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.847875+0000","last_change":"2024-04-25T22:01:14.633805+0000","last_active":"2024-04-25T22:02:45.847875+0000","last_peered":"2024-04-25T22:02:45.847875+0000","last_clean":"2024-04-25T22:02:45.847875+0000","last_became_active":"2024-04-25T22:01:14.633045+0000","last_became_peered":"2024-04-25T22:01:14.633045+0000","last_unstale":"2024-04-25T22:02:45.847875+0000","last_undegraded":"2024-04-25T22:02:45.847875+0000","last_fullsized":"2024-04-25T22:02:45.847875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:43.718628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":76,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.849024+0000","last_change":"2024-04-25T22:01:13.631135+0000","last_active":"2024-04-25T22:02:45.849024+0000","last_peered":"2024-04-25T22:02:45.849024+0000","last_clean":"2024-04-25T22:02:45.849024+0000","last_became_active":"2024-04-25T22:01:13.630257+0000","last_became_peered":"2024-04-25T22:01:13.630257+0000","last_unstale":"2024-04-25T22:02:45.849024+0000","last_undegraded":"2024-04-25T22:02:45.849024+0000","last_fullsized":"2024-04-25T22:02:45.849024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.847891+0000","last_change":"2024-04-25T22:01:14.630233+0000","last_active":"2024-04-25T22:02:45.847891+0000","last_peered":"2024-04-25T22:02:45.847891+0000","last_clean":"2024-04-25T22:02:45.847891+0000","last_became_active":"2024-04-25T22:01:14.629415+0000","last_became_peered":"2024-04-25T22:01:14.629415+0000","last_unstale":"2024-04-25T22:02:45.847891+0000","last_undegraded":"2024-04-25T22:02:45.847891+0000","last_fullsized":"2024-04-25T22:02:45.847891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:02:28.593163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":24,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848512+0000","last_change":"2024-04-25T22:02:43.852522+0000","last_active":"2024-04-25T22:02:45.848512+0000","last_peered":"2024-04-25T22:02:45.848512+0000","last_clean":"2024-04-25T22:02:45.848512+0000","last_became_active":"2024-04-25T22:02:43.851917+0000","last_became_peered":"2024-04-25T22:02:43.851917+0000","last_unstale":"2024-04-25T22:02:45.848512+0000","last_undegraded":"2024-04-25T22:02:45.848512+0000","last_fullsized":"2024-04-25T22:02:45.848512+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:56:58.100216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.918348+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:02:46.918348+0000","last_peered":"2024-04-25T22:02:46.918348+0000","last_clean":"2024-04-25T22:02:46.918348+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:02:46.918348+0000","last_undegraded":"2024-04-25T22:02:46.918348+0000","last_fullsized":"2024-04-25T22:02:46.918348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.849413+0000","last_change":"2024-04-25T22:02:43.853012+0000","last_active":"2024-04-25T22:02:45.849413+0000","last_peered":"2024-04-25T22:02:45.849413+0000","last_clean":"2024-04-25T22:02:45.849413+0000","last_became_active":"2024-04-25T22:02:43.852338+0000","last_became_peered":"2024-04-25T22:02:43.852338+0000","last_unstale":"2024-04-25T22:02:45.849413+0000","last_undegraded":"2024-04-25T22:02:45.849413+0000","last_fullsized":"2024-04-25T22:02:45.849413+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:07.951790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.849702+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:02:45.849702+0000","last_peered":"2024-04-25T22:02:45.849702+0000","last_clean":"2024-04-25T22:02:45.849702+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:02:45.849702+0000","last_undegraded":"2024-04-25T22:02:45.849702+0000","last_fullsized":"2024-04-25T22:02:45.849702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":76,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.849881+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:02:45.849881+0000","last_peered":"2024-04-25T22:02:45.849881+0000","last_clean":"2024-04-25T22:02:45.849881+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:02:45.849881+0000","last_undegraded":"2024-04-25T22:02:45.849881+0000","last_fullsized":"2024-04-25T22:02:45.849881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.849169+0000","last_change":"2024-04-25T22:02:43.853286+0000","last_active":"2024-04-25T22:02:45.849169+0000","last_peered":"2024-04-25T22:02:45.849169+0000","last_clean":"2024-04-25T22:02:45.849169+0000","last_became_active":"2024-04-25T22:02:43.852555+0000","last_became_peered":"2024-04-25T22:02:43.852555+0000","last_unstale":"2024-04-25T22:02:45.849169+0000","last_undegraded":"2024-04-25T22:02:45.849169+0000","last_fullsized":"2024-04-25T22:02:45.849169+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:42:10.005523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":73,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.919188+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:02:46.919188+0000","last_peered":"2024-04-25T22:02:46.919188+0000","last_clean":"2024-04-25T22:02:46.919188+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:02:46.919188+0000","last_undegraded":"2024-04-25T22:02:46.919188+0000","last_fullsized":"2024-04-25T22:02:46.919188+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.919108+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:02:46.919108+0000","last_peered":"2024-04-25T22:02:46.919108+0000","last_clean":"2024-04-25T22:02:46.919108+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:02:46.919108+0000","last_undegraded":"2024-04-25T22:02:46.919108+0000","last_fullsized":"2024-04-25T22:02:46.919108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848406+0000","last_change":"2024-04-25T22:01:13.631439+0000","last_active":"2024-04-25T22:02:45.848406+0000","last_peered":"2024-04-25T22:02:45.848406+0000","last_clean":"2024-04-25T22:02:45.848406+0000","last_became_active":"2024-04-25T22:01:13.630812+0000","last_became_peered":"2024-04-25T22:01:13.630812+0000","last_unstale":"2024-04-25T22:02:45.848406+0000","last_undegraded":"2024-04-25T22:02:45.848406+0000","last_fullsized":"2024-04-25T22:02:45.848406+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:56.735974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.919017+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:02:46.919017+0000","last_peered":"2024-04-25T22:02:46.919017+0000","last_clean":"2024-04-25T22:02:46.919017+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:02:46.919017+0000","last_undegraded":"2024-04-25T22:02:46.919017+0000","last_fullsized":"2024-04-25T22:02:46.919017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.847982+0000","last_change":"2024-04-25T22:01:13.623342+0000","last_active":"2024-04-25T22:02:45.847982+0000","last_peered":"2024-04-25T22:02:45.847982+0000","last_clean":"2024-04-25T22:02:45.847982+0000","last_became_active":"2024-04-25T22:01:13.621460+0000","last_became_peered":"2024-04-25T22:01:13.621460+0000","last_unstale":"2024-04-25T22:02:45.847982+0000","last_undegraded":"2024-04-25T22:02:45.847982+0000","last_fullsized":"2024-04-25T22:02:45.847982+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:11.561677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.850544+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:02:45.850544+0000","last_peered":"2024-04-25T22:02:45.850544+0000","last_clean":"2024-04-25T22:02:45.850544+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:02:45.850544+0000","last_undegraded":"2024-04-25T22:02:45.850544+0000","last_fullsized":"2024-04-25T22:02:45.850544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":281,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.919974+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:02:46.919974+0000","last_peered":"2024-04-25T22:02:46.919974+0000","last_clean":"2024-04-25T22:02:46.919974+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:02:46.919974+0000","last_undegraded":"2024-04-25T22:02:46.919974+0000","last_fullsized":"2024-04-25T22:02:46.919974+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":79,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.919218+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:02:46.919218+0000","last_peered":"2024-04-25T22:02:46.919218+0000","last_clean":"2024-04-25T22:02:46.919218+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:02:46.919218+0000","last_undegraded":"2024-04-25T22:02:46.919218+0000","last_fullsized":"2024-04-25T22:02:46.919218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.849237+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:02:45.849237+0000","last_peered":"2024-04-25T22:02:45.849237+0000","last_clean":"2024-04-25T22:02:45.849237+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:02:45.849237+0000","last_undegraded":"2024-04-25T22:02:45.849237+0000","last_fullsized":"2024-04-25T22:02:45.849237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.919186+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:02:46.919186+0000","last_peered":"2024-04-25T22:02:46.919186+0000","last_clean":"2024-04-25T22:02:46.919186+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:02:46.919186+0000","last_undegraded":"2024-04-25T22:02:46.919186+0000","last_fullsized":"2024-04-25T22:02:46.919186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":79,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.920002+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:02:46.920002+0000","last_peered":"2024-04-25T22:02:46.920002+0000","last_clean":"2024-04-25T22:02:46.920002+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:02:46.920002+0000","last_undegraded":"2024-04-25T22:02:46.920002+0000","last_fullsized":"2024-04-25T22:02:46.920002+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848875+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:02:45.848875+0000","last_peered":"2024-04-25T22:02:45.848875+0000","last_clean":"2024-04-25T22:02:45.848875+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:02:45.848875+0000","last_undegraded":"2024-04-25T22:02:45.848875+0000","last_fullsized":"2024-04-25T22:02:45.848875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848887+0000","last_change":"2024-04-25T22:01:14.645176+0000","last_active":"2024-04-25T22:02:45.848887+0000","last_peered":"2024-04-25T22:02:45.848887+0000","last_clean":"2024-04-25T22:02:45.848887+0000","last_became_active":"2024-04-25T22:01:14.642395+0000","last_became_peered":"2024-04-25T22:01:14.642395+0000","last_unstale":"2024-04-25T22:02:45.848887+0000","last_undegraded":"2024-04-25T22:02:45.848887+0000","last_fullsized":"2024-04-25T22:02:45.848887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.849139+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:02:45.849139+0000","last_peered":"2024-04-25T22:02:45.849139+0000","last_clean":"2024-04-25T22:02:45.849139+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:02:45.849139+0000","last_undegraded":"2024-04-25T22:02:45.849139+0000","last_fullsized":"2024-04-25T22:02:45.849139+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848076+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:02:45.848076+0000","last_peered":"2024-04-25T22:02:45.848076+0000","last_clean":"2024-04-25T22:02:45.848076+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:02:45.848076+0000","last_undegraded":"2024-04-25T22:02:45.848076+0000","last_fullsized":"2024-04-25T22:02:45.848076+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.850579+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:02:45.850579+0000","last_peered":"2024-04-25T22:02:45.850579+0000","last_clean":"2024-04-25T22:02:45.850579+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:02:45.850579+0000","last_undegraded":"2024-04-25T22:02:45.850579+0000","last_fullsized":"2024-04-25T22:02:45.850579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":79,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.919235+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:02:46.919235+0000","last_peered":"2024-04-25T22:02:46.919235+0000","last_clean":"2024-04-25T22:02:46.919235+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:02:46.919235+0000","last_undegraded":"2024-04-25T22:02:46.919235+0000","last_fullsized":"2024-04-25T22:02:46.919235+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.849389+0000","last_change":"2024-04-25T22:02:43.851416+0000","last_active":"2024-04-25T22:02:45.849389+0000","last_peered":"2024-04-25T22:02:45.849389+0000","last_clean":"2024-04-25T22:02:45.849389+0000","last_became_active":"2024-04-25T22:02:43.850822+0000","last_became_peered":"2024-04-25T22:02:43.850822+0000","last_unstale":"2024-04-25T22:02:45.849389+0000","last_undegraded":"2024-04-25T22:02:45.849389+0000","last_fullsized":"2024-04-25T22:02:45.849389+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:56:58.100216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.849695+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:02:45.849695+0000","last_peered":"2024-04-25T22:02:45.849695+0000","last_clean":"2024-04-25T22:02:45.849695+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:02:45.849695+0000","last_undegraded":"2024-04-25T22:02:45.849695+0000","last_fullsized":"2024-04-25T22:02:45.849695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":73,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.919629+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:02:46.919629+0000","last_peered":"2024-04-25T22:02:46.919629+0000","last_clean":"2024-04-25T22:02:46.919629+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:02:46.919629+0000","last_undegraded":"2024-04-25T22:02:46.919629+0000","last_fullsized":"2024-04-25T22:02:46.919629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.849952+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:02:45.849952+0000","last_peered":"2024-04-25T22:02:45.849952+0000","last_clean":"2024-04-25T22:02:45.849952+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:02:45.849952+0000","last_undegraded":"2024-04-25T22:02:45.849952+0000","last_fullsized":"2024-04-25T22:02:45.849952+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848144+0000","last_change":"2024-04-25T22:01:14.637520+0000","last_active":"2024-04-25T22:02:45.848144+0000","last_peered":"2024-04-25T22:02:45.848144+0000","last_clean":"2024-04-25T22:02:45.848144+0000","last_became_active":"2024-04-25T22:01:14.636765+0000","last_became_peered":"2024-04-25T22:01:14.636765+0000","last_unstale":"2024-04-25T22:02:45.848144+0000","last_undegraded":"2024-04-25T22:02:45.848144+0000","last_fullsized":"2024-04-25T22:02:45.848144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.849819+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:02:45.849819+0000","last_peered":"2024-04-25T22:02:45.849819+0000","last_clean":"2024-04-25T22:02:45.849819+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:02:45.849819+0000","last_undegraded":"2024-04-25T22:02:45.849819+0000","last_fullsized":"2024-04-25T22:02:45.849819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848916+0000","last_change":"2024-04-25T22:01:09.582204+0000","last_active":"2024-04-25T22:02:45.848916+0000","last_peered":"2024-04-25T22:02:45.848916+0000","last_clean":"2024-04-25T22:02:45.848916+0000","last_became_active":"2024-04-25T22:01:09.581494+0000","last_became_peered":"2024-04-25T22:01:09.581494+0000","last_unstale":"2024-04-25T22:02:45.848916+0000","last_undegraded":"2024-04-25T22:02:45.848916+0000","last_fullsized":"2024-04-25T22:02:45.848916+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:13.088700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848618+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:02:45.848618+0000","last_peered":"2024-04-25T22:02:45.848618+0000","last_clean":"2024-04-25T22:02:45.848618+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:02:45.848618+0000","last_undegraded":"2024-04-25T22:02:45.848618+0000","last_fullsized":"2024-04-25T22:02:45.848618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":76,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.851232+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:02:45.851232+0000","last_peered":"2024-04-25T22:02:45.851232+0000","last_clean":"2024-04-25T22:02:45.851232+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:02:45.851232+0000","last_undegraded":"2024-04-25T22:02:45.851232+0000","last_fullsized":"2024-04-25T22:02:45.851232+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.851119+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:02:45.851119+0000","last_peered":"2024-04-25T22:02:45.851119+0000","last_clean":"2024-04-25T22:02:45.851119+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:02:45.851119+0000","last_undegraded":"2024-04-25T22:02:45.851119+0000","last_fullsized":"2024-04-25T22:02:45.851119+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848633+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:02:45.848633+0000","last_peered":"2024-04-25T22:02:45.848633+0000","last_clean":"2024-04-25T22:02:45.848633+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:02:45.848633+0000","last_undegraded":"2024-04-25T22:02:45.848633+0000","last_fullsized":"2024-04-25T22:02:45.848633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":77,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.851045+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:02:45.851045+0000","last_peered":"2024-04-25T22:02:45.851045+0000","last_clean":"2024-04-25T22:02:45.851045+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:02:45.851045+0000","last_undegraded":"2024-04-25T22:02:45.851045+0000","last_fullsized":"2024-04-25T22:02:45.851045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.919763+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:02:46.919763+0000","last_peered":"2024-04-25T22:02:46.919763+0000","last_clean":"2024-04-25T22:02:46.919763+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:02:46.919763+0000","last_undegraded":"2024-04-25T22:02:46.919763+0000","last_fullsized":"2024-04-25T22:02:46.919763+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.847896+0000","last_change":"2024-04-25T22:01:14.632306+0000","last_active":"2024-04-25T22:02:45.847896+0000","last_peered":"2024-04-25T22:02:45.847896+0000","last_clean":"2024-04-25T22:02:45.847896+0000","last_became_active":"2024-04-25T22:01:14.631179+0000","last_became_peered":"2024-04-25T22:01:14.631179+0000","last_unstale":"2024-04-25T22:02:45.847896+0000","last_undegraded":"2024-04-25T22:02:45.847896+0000","last_fullsized":"2024-04-25T22:02:45.847896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.918269+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:02:46.918269+0000","last_peered":"2024-04-25T22:02:46.918269+0000","last_clean":"2024-04-25T22:02:46.918269+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:02:46.918269+0000","last_undegraded":"2024-04-25T22:02:46.918269+0000","last_fullsized":"2024-04-25T22:02:46.918269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"23'11","reported_seq":84,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.919859+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:02:46.919859+0000","last_peered":"2024-04-25T22:02:46.919859+0000","last_clean":"2024-04-25T22:02:46.919859+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:02:46.919859+0000","last_undegraded":"2024-04-25T22:02:46.919859+0000","last_fullsized":"2024-04-25T22:02:46.919859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848632+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:02:45.848632+0000","last_peered":"2024-04-25T22:02:45.848632+0000","last_clean":"2024-04-25T22:02:45.848632+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:02:45.848632+0000","last_undegraded":"2024-04-25T22:02:45.848632+0000","last_fullsized":"2024-04-25T22:02:45.848632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":77,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848779+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:02:45.848779+0000","last_peered":"2024-04-25T22:02:45.848779+0000","last_clean":"2024-04-25T22:02:45.848779+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:02:45.848779+0000","last_undegraded":"2024-04-25T22:02:45.848779+0000","last_fullsized":"2024-04-25T22:02:45.848779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.850325+0000","last_change":"2024-04-25T22:02:43.852674+0000","last_active":"2024-04-25T22:02:45.850325+0000","last_peered":"2024-04-25T22:02:45.850325+0000","last_clean":"2024-04-25T22:02:45.850325+0000","last_became_active":"2024-04-25T22:02:43.852292+0000","last_became_peered":"2024-04-25T22:02:43.852292+0000","last_unstale":"2024-04-25T22:02:45.850325+0000","last_undegraded":"2024-04-25T22:02:45.850325+0000","last_fullsized":"2024-04-25T22:02:45.850325+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:57.388397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848468+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:02:45.848468+0000","last_peered":"2024-04-25T22:02:45.848468+0000","last_clean":"2024-04-25T22:02:45.848468+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:02:45.848468+0000","last_undegraded":"2024-04-25T22:02:45.848468+0000","last_fullsized":"2024-04-25T22:02:45.848468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.850971+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:02:45.850971+0000","last_peered":"2024-04-25T22:02:45.850971+0000","last_clean":"2024-04-25T22:02:45.850971+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:02:45.850971+0000","last_undegraded":"2024-04-25T22:02:45.850971+0000","last_fullsized":"2024-04-25T22:02:45.850971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848474+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:02:45.848474+0000","last_peered":"2024-04-25T22:02:45.848474+0000","last_clean":"2024-04-25T22:02:45.848474+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:02:45.848474+0000","last_undegraded":"2024-04-25T22:02:45.848474+0000","last_fullsized":"2024-04-25T22:02:45.848474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.849228+0000","last_change":"2024-04-25T22:01:14.639447+0000","last_active":"2024-04-25T22:02:45.849228+0000","last_peered":"2024-04-25T22:02:45.849228+0000","last_clean":"2024-04-25T22:02:45.849228+0000","last_became_active":"2024-04-25T22:01:14.638864+0000","last_became_peered":"2024-04-25T22:01:14.638864+0000","last_unstale":"2024-04-25T22:02:45.849228+0000","last_undegraded":"2024-04-25T22:02:45.849228+0000","last_fullsized":"2024-04-25T22:02:45.849228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.849361+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:02:45.849361+0000","last_peered":"2024-04-25T22:02:45.849361+0000","last_clean":"2024-04-25T22:02:45.849361+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:02:45.849361+0000","last_undegraded":"2024-04-25T22:02:45.849361+0000","last_fullsized":"2024-04-25T22:02:45.849361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.850561+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:02:45.850561+0000","last_peered":"2024-04-25T22:02:45.850561+0000","last_clean":"2024-04-25T22:02:45.850561+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:02:45.850561+0000","last_undegraded":"2024-04-25T22:02:45.850561+0000","last_fullsized":"2024-04-25T22:02:45.850561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848761+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:02:45.848761+0000","last_peered":"2024-04-25T22:02:45.848761+0000","last_clean":"2024-04-25T22:02:45.848761+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:02:45.848761+0000","last_undegraded":"2024-04-25T22:02:45.848761+0000","last_fullsized":"2024-04-25T22:02:45.848761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848563+0000","last_change":"2024-04-25T22:01:14.637452+0000","last_active":"2024-04-25T22:02:45.848563+0000","last_peered":"2024-04-25T22:02:45.848563+0000","last_clean":"2024-04-25T22:02:45.848563+0000","last_became_active":"2024-04-25T22:01:14.636407+0000","last_became_peered":"2024-04-25T22:01:14.636407+0000","last_unstale":"2024-04-25T22:02:45.848563+0000","last_undegraded":"2024-04-25T22:02:45.848563+0000","last_fullsized":"2024-04-25T22:02:45.848563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":75,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848430+0000","last_change":"2024-04-25T22:01:13.621997+0000","last_active":"2024-04-25T22:02:45.848430+0000","last_peered":"2024-04-25T22:02:45.848430+0000","last_clean":"2024-04-25T22:02:45.848430+0000","last_became_active":"2024-04-25T22:01:13.620987+0000","last_became_peered":"2024-04-25T22:01:13.620987+0000","last_unstale":"2024-04-25T22:02:45.848430+0000","last_undegraded":"2024-04-25T22:02:45.848430+0000","last_fullsized":"2024-04-25T22:02:45.848430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:52.750904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848526+0000","last_change":"2024-04-25T22:01:14.650437+0000","last_active":"2024-04-25T22:02:45.848526+0000","last_peered":"2024-04-25T22:02:45.848526+0000","last_clean":"2024-04-25T22:02:45.848526+0000","last_became_active":"2024-04-25T22:01:14.648116+0000","last_became_peered":"2024-04-25T22:01:14.648116+0000","last_unstale":"2024-04-25T22:02:45.848526+0000","last_undegraded":"2024-04-25T22:02:45.848526+0000","last_fullsized":"2024-04-25T22:02:45.848526+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":75,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848455+0000","last_change":"2024-04-25T22:01:13.631562+0000","last_active":"2024-04-25T22:02:45.848455+0000","last_peered":"2024-04-25T22:02:45.848455+0000","last_clean":"2024-04-25T22:02:45.848455+0000","last_became_active":"2024-04-25T22:01:13.630731+0000","last_became_peered":"2024-04-25T22:01:13.630731+0000","last_unstale":"2024-04-25T22:02:45.848455+0000","last_undegraded":"2024-04-25T22:02:45.848455+0000","last_fullsized":"2024-04-25T22:02:45.848455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:37.489738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848747+0000","last_change":"2024-04-25T22:02:43.850869+0000","last_active":"2024-04-25T22:02:45.848747+0000","last_peered":"2024-04-25T22:02:45.848747+0000","last_clean":"2024-04-25T22:02:45.848747+0000","last_became_active":"2024-04-25T22:02:43.850568+0000","last_became_peered":"2024-04-25T22:02:43.850568+0000","last_unstale":"2024-04-25T22:02:45.848747+0000","last_undegraded":"2024-04-25T22:02:45.848747+0000","last_fullsized":"2024-04-25T22:02:45.848747+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:10:32.881419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":24,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.849278+0000","last_change":"2024-04-25T22:02:43.853253+0000","last_active":"2024-04-25T22:02:45.849278+0000","last_peered":"2024-04-25T22:02:45.849278+0000","last_clean":"2024-04-25T22:02:45.849278+0000","last_became_active":"2024-04-25T22:02:43.852769+0000","last_became_peered":"2024-04-25T22:02:43.852769+0000","last_unstale":"2024-04-25T22:02:45.849278+0000","last_undegraded":"2024-04-25T22:02:45.849278+0000","last_fullsized":"2024-04-25T22:02:45.849278+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:51:36.457092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848779+0000","last_change":"2024-04-25T22:02:43.852778+0000","last_active":"2024-04-25T22:02:45.848779+0000","last_peered":"2024-04-25T22:02:45.848779+0000","last_clean":"2024-04-25T22:02:45.848779+0000","last_became_active":"2024-04-25T22:02:43.852263+0000","last_became_peered":"2024-04-25T22:02:43.852263+0000","last_unstale":"2024-04-25T22:02:45.848779+0000","last_undegraded":"2024-04-25T22:02:45.848779+0000","last_fullsized":"2024-04-25T22:02:45.848779+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:10:40.487543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":76,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848713+0000","last_change":"2024-04-25T22:01:13.630502+0000","last_active":"2024-04-25T22:02:45.848713+0000","last_peered":"2024-04-25T22:02:45.848713+0000","last_clean":"2024-04-25T22:02:45.848713+0000","last_became_active":"2024-04-25T22:01:13.629854+0000","last_became_peered":"2024-04-25T22:01:13.629854+0000","last_unstale":"2024-04-25T22:02:45.848713+0000","last_undegraded":"2024-04-25T22:02:45.848713+0000","last_fullsized":"2024-04-25T22:02:45.848713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.848480+0000","last_change":"2024-04-25T22:01:14.642104+0000","last_active":"2024-04-25T22:02:45.848480+0000","last_peered":"2024-04-25T22:02:45.848480+0000","last_clean":"2024-04-25T22:02:45.848480+0000","last_became_active":"2024-04-25T22:01:14.641323+0000","last_became_peered":"2024-04-25T22:01:14.641323+0000","last_unstale":"2024-04-25T22:02:45.848480+0000","last_undegraded":"2024-04-25T22:02:45.848480+0000","last_fullsized":"2024-04-25T22:02:45.848480+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":75,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.850826+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:02:45.850826+0000","last_peered":"2024-04-25T22:02:45.850826+0000","last_clean":"2024-04-25T22:02:45.850826+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:02:45.850826+0000","last_undegraded":"2024-04-25T22:02:45.850826+0000","last_fullsized":"2024-04-25T22:02:45.850826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:46.919038+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:02:46.919038+0000","last_peered":"2024-04-25T22:02:46.919038+0000","last_clean":"2024-04-25T22:02:46.919038+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:02:46.919038+0000","last_undegraded":"2024-04-25T22:02:46.919038+0000","last_fullsized":"2024-04-25T22:02:46.919038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":78,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-04-25T22:02:45.850820+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:02:45.850820+0000","last_peered":"2024-04-25T22:02:45.850820+0000","last_clean":"2024-04-25T22:02:45.850820+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:02:45.850820+0000","last_undegraded":"2024-04-25T22:02:45.850820+0000","last_fullsized":"2024-04-25T22:02:45.850820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738395,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":487424,"data_stored":778683,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738394,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":409600,"data_stored":182196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738395,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31664,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":495616,"data_stored":779299,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:02:54.670 INFO:tasks.thrashosds.thrasher:Setting 2.7 to [1, 2, 0] 2024-04-25T22:02:54.670 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '2.7', '1', '2', '0'] 2024-04-25T22:02:54.671 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 2.7 1 2 0 2024-04-25T22:02:54.678 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:54.678 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:54.693 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:54.721 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:54.717+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:54.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:54.817+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:54.832 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:54.832 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:54.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:54.889 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-25T22:02:54.923 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:54.917+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:54.985 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:54.985 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:55.000 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:55.044 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:55.041+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:55.050 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:02:55.069 INFO:teuthology.orchestra.run.smithi044.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-25T22:02:55.073 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T22:02:55.074 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-25T22:02:55.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:55.121+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:55.130 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:55.130 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:55.145 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:55.201 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:55.201 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:55.225 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:55.221+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:55.226 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:55.226 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:55.248 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:55.249 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:55.296 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:55.296 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:55.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.296 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:1661 4.1e e52/16 4:7bdef072:::1000000097b.00000000:head v 52'22, mlcod=52'20)", 2024-04-25T22:02:55.296 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:55.295060+0000", 2024-04-25T22:02:55.296 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00064278600000000001, 2024-04-25T22:02:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000680431, 2024-04-25T22:02:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-25T22:02:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.295060+0000", 2024-04-25T22:02:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.295060+0000", 2024-04-25T22:02:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.295061+0000", 2024-04-25T22:02:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.28e-06 2024-04-25T22:02:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.295073+0000", 2024-04-25T22:02:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1922999999999999e-05 2024-04-25T22:02:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.295093+0000", 2024-04-25T22:02:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9783999999999999e-05 2024-04-25T22:02:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.295134+0000", 2024-04-25T22:02:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1192000000000001e-05 2024-04-25T22:02:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.295255+0000", 2024-04-25T22:02:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120535 2024-04-25T22:02:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.295289+0000", 2024-04-25T22:02:55.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4181999999999999e-05 2024-04-25T22:02:55.300 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.300 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.300 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.300 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.300 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:02:55.300 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 1 2024-04-25T22:02:55.300 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:55.312 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:55.357 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:55.353+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:55.427 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:55.421+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:55.488 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:55.489 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:55.489 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:55.489 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:55.489 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:55.504 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:55.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:55.525+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:55.629 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:55.625+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:55.643 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:55.644 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:55.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:55.644 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:55.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.644 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:55.644 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:55.644 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 109.46336834900001, 2024-04-25T22:02:55.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:55.644 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.644 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.644 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.644 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:55.644 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:55.645 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:55.645 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:55.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.645 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:55.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:55.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:55.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:55.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:55.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:55.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:55.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:55.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:55.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:55.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:55.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:55.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:55.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:55.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:55.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:55.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:55.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:55.651 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.651 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.651 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.651 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:55.651 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:55.651 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 109.463173107, 2024-04-25T22:02:55.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:55.652 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.652 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.652 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.652 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:55.652 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:55.652 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:55.652 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:55.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.652 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:55.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:55.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:55.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:55.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:55.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:55.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:55.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:55.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:55.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:55.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:55.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:55.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:55.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:55.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:55.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:55.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:55.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:55.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:55.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:55.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:55.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:55.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:55.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:55.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:55.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:55.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:55.657 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.657 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.657 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.657 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:55.657 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:55.657 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 109.463110814, 2024-04-25T22:02:55.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:55.657 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.657 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.658 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.658 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:55.658 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:55.658 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:55.658 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:55.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.658 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:55.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:55.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:55.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:55.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:55.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:55.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:55.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:55.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:55.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:55.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:55.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:55.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:55.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:55.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:55.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:55.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:55.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:55.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:55.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:55.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:55.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:55.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:55.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:55.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:55.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:55.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:55.663 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.663 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.663 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.663 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:55.663 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:55.663 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 109.463050598, 2024-04-25T22:02:55.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:55.664 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.664 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.664 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.664 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:55.664 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:55.664 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:55.664 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:55.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.664 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:55.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:55.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:55.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:55.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:55.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:55.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:55.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:55.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:55.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:55.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:55.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:55.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:55.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:55.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:55.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:55.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:55.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:55.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:55.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:55.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:55.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:55.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:55.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:55.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:55.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:55.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:55.669 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.669 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.669 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.670 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:55.670 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:55.670 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 109.462861086, 2024-04-25T22:02:55.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:55.670 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.670 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.670 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.670 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:55.670 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:55.670 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:55.670 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:55.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.670 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:55.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:55.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:55.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:55.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:55.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:55.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:55.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:55.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:55.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:55.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:55.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:55.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:55.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:55.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:55.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:55.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:55.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:55.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:55.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:55.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:55.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:55.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:55.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:55.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:55.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:55.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:55.675 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.675 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.675 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.677 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:55.677 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:55.677 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 109.27120496400001, 2024-04-25T22:02:55.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027831966, 2024-04-25T22:02:55.677 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.677 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.677 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.677 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:55.678 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:55.678 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:55.678 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 188 2024-04-25T22:02:55.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.678 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:55.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368363+0000", 2024-04-25T22:02:55.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368364+0000", 2024-04-25T22:02:55.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4000000000000001e-07 2024-04-25T22:02:55.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368459+0000", 2024-04-25T22:02:55.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4681999999999999e-05 2024-04-25T22:02:55.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368470+0000", 2024-04-25T22:02:55.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1574e-05 2024-04-25T22:02:55.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368478+0000", 2024-04-25T22:02:55.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8890000000000002e-06 2024-04-25T22:02:55.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388327+0000", 2024-04-25T22:02:55.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019849042000000001 2024-04-25T22:02:55.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388468+0000", 2024-04-25T22:02:55.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140452 2024-04-25T22:02:55.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:55.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.388680+0000", 2024-04-25T22:02:55.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212752 2024-04-25T22:02:55.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:55.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395114+0000", 2024-04-25T22:02:55.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064332039999999997 2024-04-25T22:02:55.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:55.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396056+0000", 2024-04-25T22:02:55.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00094251600000000001 2024-04-25T22:02:55.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396130+0000", 2024-04-25T22:02:55.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3960000000000003e-05 2024-04-25T22:02:55.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396195+0000", 2024-04-25T22:02:55.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5154999999999995e-05 2024-04-25T22:02:55.682 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.682 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.682 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.683 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:55.683 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:55.683 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 109.27099563900001, 2024-04-25T22:02:55.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:55.683 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.683 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.683 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.683 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:55.683 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:55.683 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:55.683 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:55.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.683 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:55.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:55.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:55.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:55.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:55.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:55.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:55.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:55.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:55.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:55.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:55.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:55.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:55.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:55.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:55.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:55.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:55.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:55.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:55.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:55.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:55.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:55.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:55.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:55.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:55.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:55.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:55.688 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.688 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.688 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.688 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T22:02:55.688 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:02:55.688 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.6557361419999999, 2024-04-25T22:02:55.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.180276931, 2024-04-25T22:02:55.688 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.688 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.688 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.688 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:55.688 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:55.688 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:55.688 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4 2024-04-25T22:02:55.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.689 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:02:55.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:02:55.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983834+0000", 2024-04-25T22:02:55.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2900000000000001e-06 2024-04-25T22:02:55.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991787+0000", 2024-04-25T22:02:55.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079521690000000003 2024-04-25T22:02:55.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991826+0000", 2024-04-25T22:02:55.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9258999999999998e-05 2024-04-25T22:02:55.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991845+0000", 2024-04-25T22:02:55.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9360000000000001e-05 2024-04-25T22:02:55.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992058+0000", 2024-04-25T22:02:55.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212559 2024-04-25T22:02:55.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992213+0000", 2024-04-25T22:02:55.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015520700000000001 2024-04-25T22:02:55.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:55.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992414+0000", 2024-04-25T22:02:55.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020049 2024-04-25T22:02:55.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:55.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162511+0000", 2024-04-25T22:02:55.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.17009782900000001 2024-04-25T22:02:55.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:55.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163967+0000", 2024-04-25T22:02:55.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001455752 2024-04-25T22:02:55.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164045+0000", 2024-04-25T22:02:55.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7415000000000003e-05 2024-04-25T22:02:55.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164109+0000", 2024-04-25T22:02:55.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4601e-05 2024-04-25T22:02:55.693 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.693 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.693 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.693 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:55.693 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:02:55.693 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.5562779940000002, 2024-04-25T22:02:55.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.12612672599999999, 2024-04-25T22:02:55.694 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.694 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.694 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.694 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:55.694 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:55.694 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:55.694 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2024-04-25T22:02:55.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.694 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:02:55.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:02:55.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083293+0000", 2024-04-25T22:02:55.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6630000000000002e-06 2024-04-25T22:02:55.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086619+0000", 2024-04-25T22:02:55.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033261699999999998 2024-04-25T22:02:55.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086647+0000", 2024-04-25T22:02:55.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8085999999999998e-05 2024-04-25T22:02:55.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086665+0000", 2024-04-25T22:02:55.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:02:55.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086870+0000", 2024-04-25T22:02:55.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020488599999999999 2024-04-25T22:02:55.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087110+0000", 2024-04-25T22:02:55.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024093199999999999 2024-04-25T22:02:55.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:55.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087310+0000", 2024-04-25T22:02:55.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000199936 2024-04-25T22:02:55.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:55.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207766+0000", 2024-04-25T22:02:55.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.120456035 2024-04-25T22:02:55.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:55.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209358+0000", 2024-04-25T22:02:55.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015912369999999999 2024-04-25T22:02:55.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209390+0000", 2024-04-25T22:02:55.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2434999999999997e-05 2024-04-25T22:02:55.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209417+0000", 2024-04-25T22:02:55.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6936000000000001e-05 2024-04-25T22:02:55.698 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.698 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.699 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.699 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop_reply(client.4564.0:4 4.32 e51/16 ondisk, result = 0)", 2024-04-25T22:02:55.699 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.102726+0000", 2024-04-25T22:02:55.699 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.5368424599999999, 2024-04-25T22:02:55.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059798849000000001, 2024-04-25T22:02:55.699 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.699 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.699 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-25T22:02:55.699 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102726+0000", 2024-04-25T22:02:55.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102726+0000", 2024-04-25T22:02:55.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102727+0000", 2024-04-25T22:02:55.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7800000000000001e-07 2024-04-25T22:02:55.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102732+0000", 2024-04-25T22:02:55.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9389999999999996e-06 2024-04-25T22:02:55.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102747+0000", 2024-04-25T22:02:55.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5554e-05 2024-04-25T22:02:55.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102755+0000", 2024-04-25T22:02:55.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1599999999999998e-06 2024-04-25T22:02:55.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162489+0000", 2024-04-25T22:02:55.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059734204999999999 2024-04-25T22:02:55.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162501+0000", 2024-04-25T22:02:55.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1775e-05 2024-04-25T22:02:55.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162525+0000", 2024-04-25T22:02:55.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3438000000000002e-05 2024-04-25T22:02:55.702 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.702 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.702 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.702 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:55.702 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.111321+0000", 2024-04-25T22:02:55.702 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.528246867, 2024-04-25T22:02:55.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.053212803000000003, 2024-04-25T22:02:55.703 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.703 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.703 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.703 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:55.703 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:55.703 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:55.703 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 19 2024-04-25T22:02:55.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.703 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111321+0000", 2024-04-25T22:02:55.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111321+0000", 2024-04-25T22:02:55.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111323+0000", 2024-04-25T22:02:55.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9759999999999998e-06 2024-04-25T22:02:55.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111334+0000", 2024-04-25T22:02:55.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.049e-05 2024-04-25T22:02:55.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111359+0000", 2024-04-25T22:02:55.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.495e-05 2024-04-25T22:02:55.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111380+0000", 2024-04-25T22:02:55.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1063000000000001e-05 2024-04-25T22:02:55.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162572+0000", 2024-04-25T22:02:55.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.051191677999999997 2024-04-25T22:02:55.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162760+0000", 2024-04-25T22:02:55.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018837500000000001 2024-04-25T22:02:55.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:55.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162962+0000", 2024-04-25T22:02:55.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020174200000000001 2024-04-25T22:02:55.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:55.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164379+0000", 2024-04-25T22:02:55.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001416856 2024-04-25T22:02:55.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:55.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164402+0000", 2024-04-25T22:02:55.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3734e-05 2024-04-25T22:02:55.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164474+0000", 2024-04-25T22:02:55.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1422999999999997e-05 2024-04-25T22:02:55.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164534+0000", 2024-04-25T22:02:55.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0516000000000001e-05 2024-04-25T22:02:55.708 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.708 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.708 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.708 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:24 4.b e51/16 4:d3eda40d:::1000000020f.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:02:55.708 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.119033+0000", 2024-04-25T22:02:55.708 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.5205349909999999, 2024-04-25T22:02:55.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088682448999999997, 2024-04-25T22:02:55.708 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.709 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.709 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.709 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119033+0000", 2024-04-25T22:02:55.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119033+0000", 2024-04-25T22:02:55.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119035+0000", 2024-04-25T22:02:55.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:02:55.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119044+0000", 2024-04-25T22:02:55.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0860000000000008e-06 2024-04-25T22:02:55.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119068+0000", 2024-04-25T22:02:55.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4037e-05 2024-04-25T22:02:55.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119080+0000", 2024-04-25T22:02:55.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2322e-05 2024-04-25T22:02:55.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119203+0000", 2024-04-25T22:02:55.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012249799999999999 2024-04-25T22:02:55.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119253+0000", 2024-04-25T22:02:55.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0148999999999997e-05 2024-04-25T22:02:55.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207679+0000", 2024-04-25T22:02:55.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088425928000000001 2024-04-25T22:02:55.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207716+0000", 2024-04-25T22:02:55.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7048999999999997e-05 2024-04-25T22:02:55.712 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.712 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.712 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.713 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:27 4.13 4:cbcb6224:::10000000212.00000000:head [write 0~3719] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:55.713 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.122624+0000", 2024-04-25T22:02:55.713 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.5169440979999997, 2024-04-25T22:02:55.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087419288999999997, 2024-04-25T22:02:55.713 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.713 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.713 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.713 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:55.713 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:55.713 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:55.713 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 27 2024-04-25T22:02:55.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.713 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122624+0000", 2024-04-25T22:02:55.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122624+0000", 2024-04-25T22:02:55.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122625+0000", 2024-04-25T22:02:55.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.181e-06 2024-04-25T22:02:55.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122632+0000", 2024-04-25T22:02:55.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8279999999999997e-06 2024-04-25T22:02:55.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122647+0000", 2024-04-25T22:02:55.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4398e-05 2024-04-25T22:02:55.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122657+0000", 2024-04-25T22:02:55.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0662999999999999e-05 2024-04-25T22:02:55.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.206922+0000", 2024-04-25T22:02:55.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084264247 2024-04-25T22:02:55.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207073+0000", 2024-04-25T22:02:55.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015129499999999999 2024-04-25T22:02:55.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:55.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207227+0000", 2024-04-25T22:02:55.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000153819 2024-04-25T22:02:55.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:55.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209429+0000", 2024-04-25T22:02:55.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022023899999999998 2024-04-25T22:02:55.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:55.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209971+0000", 2024-04-25T22:02:55.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00054203900000000002 2024-04-25T22:02:55.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210004+0000", 2024-04-25T22:02:55.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2468999999999997e-05 2024-04-25T22:02:55.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210044+0000", 2024-04-25T22:02:55.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9959999999999997e-05 2024-04-25T22:02:55.718 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.718 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.718 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.718 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:55.718 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.124053+0000", 2024-04-25T22:02:55.718 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.5155149850000003, 2024-04-25T22:02:55.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.040913613000000001, 2024-04-25T22:02:55.718 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.718 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.718 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.719 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:55.719 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:55.719 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:55.719 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 28 2024-04-25T22:02:55.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.719 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124053+0000", 2024-04-25T22:02:55.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124053+0000", 2024-04-25T22:02:55.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124054+0000", 2024-04-25T22:02:55.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8200000000000008e-07 2024-04-25T22:02:55.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124060+0000", 2024-04-25T22:02:55.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6879999999999996e-06 2024-04-25T22:02:55.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124073+0000", 2024-04-25T22:02:55.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3113e-05 2024-04-25T22:02:55.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124081+0000", 2024-04-25T22:02:55.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4959999999999999e-06 2024-04-25T22:02:55.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163657+0000", 2024-04-25T22:02:55.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.039576014 2024-04-25T22:02:55.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163775+0000", 2024-04-25T22:02:55.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011861100000000001 2024-04-25T22:02:55.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:55.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163907+0000", 2024-04-25T22:02:55.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013217599999999999 2024-04-25T22:02:55.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:55.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164803+0000", 2024-04-25T22:02:55.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000895801 2024-04-25T22:02:55.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:55.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164825+0000", 2024-04-25T22:02:55.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1339e-05 2024-04-25T22:02:55.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164906+0000", 2024-04-25T22:02:55.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.119e-05 2024-04-25T22:02:55.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164967+0000", 2024-04-25T22:02:55.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1203000000000003e-05 2024-04-25T22:02:55.723 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.723 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.723 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.724 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:32 4.b e51/16 4:d2dbd4ac:::10000000217.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:02:55.724 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.130764+0000", 2024-04-25T22:02:55.724 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.508804246, 2024-04-25T22:02:55.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.07870402, 2024-04-25T22:02:55.724 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.724 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.724 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.724 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130764+0000", 2024-04-25T22:02:55.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130764+0000", 2024-04-25T22:02:55.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130766+0000", 2024-04-25T22:02:55.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6270000000000001e-06 2024-04-25T22:02:55.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130777+0000", 2024-04-25T22:02:55.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1799e-05 2024-04-25T22:02:55.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130805+0000", 2024-04-25T22:02:55.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7036999999999999e-05 2024-04-25T22:02:55.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130817+0000", 2024-04-25T22:02:55.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2856e-05 2024-04-25T22:02:55.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.206926+0000", 2024-04-25T22:02:55.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.076108517000000001 2024-04-25T22:02:55.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207009+0000", 2024-04-25T22:02:55.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.276e-05 2024-04-25T22:02:55.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209432+0000", 2024-04-25T22:02:55.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024229830000000001 2024-04-25T22:02:55.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209468+0000", 2024-04-25T22:02:55.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6440999999999999e-05 2024-04-25T22:02:55.728 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.728 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.728 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.728 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:46 4.b e51/16 4:d0d26e50:::10000000225.00000000:head v 51'3, mlcod=0'0)", 2024-04-25T22:02:55.728 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:02:55.728 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.4887487309999998, 2024-04-25T22:02:55.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.058683655000000001, 2024-04-25T22:02:55.728 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.728 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.728 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.728 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:02:55.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:02:55.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:02:55.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7499999999999999e-07 2024-04-25T22:02:55.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150827+0000", 2024-04-25T22:02:55.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.64e-06 2024-04-25T22:02:55.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150841+0000", 2024-04-25T22:02:55.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3895e-05 2024-04-25T22:02:55.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150849+0000", 2024-04-25T22:02:55.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5310000000000004e-06 2024-04-25T22:02:55.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207762+0000", 2024-04-25T22:02:55.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.056913380999999999 2024-04-25T22:02:55.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207782+0000", 2024-04-25T22:02:55.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0026000000000001e-05 2024-04-25T22:02:55.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209471+0000", 2024-04-25T22:02:55.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016892020000000001 2024-04-25T22:02:55.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209503+0000", 2024-04-25T22:02:55.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2104999999999998e-05 2024-04-25T22:02:55.732 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.732 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.732 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.732 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:54 4.2b 4:d5ee56ee:::1000000022d.00000000:head [write 0~3953] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:55.732 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.162091+0000", 2024-04-25T22:02:55.732 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.4774777719999999, 2024-04-25T22:02:55.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.048184338, 2024-04-25T22:02:55.732 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.733 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.733 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.733 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:55.733 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:55.733 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:55.733 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54 2024-04-25T22:02:55.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.733 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162091+0000", 2024-04-25T22:02:55.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162091+0000", 2024-04-25T22:02:55.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162092+0000", 2024-04-25T22:02:55.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.175e-06 2024-04-25T22:02:55.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162102+0000", 2024-04-25T22:02:55.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0012e-05 2024-04-25T22:02:55.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162117+0000", 2024-04-25T22:02:55.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5443000000000001e-05 2024-04-25T22:02:55.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162126+0000", 2024-04-25T22:02:55.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1840000000000005e-06 2024-04-25T22:02:55.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207805+0000", 2024-04-25T22:02:55.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.045678641999999998 2024-04-25T22:02:55.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207941+0000", 2024-04-25T22:02:55.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000135983 2024-04-25T22:02:55.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:02:55.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.208119+0000", 2024-04-25T22:02:55.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017767099999999999 2024-04-25T22:02:55.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:55.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209511+0000", 2024-04-25T22:02:55.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001392304 2024-04-25T22:02:55.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:55.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210222+0000", 2024-04-25T22:02:55.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00071096500000000003 2024-04-25T22:02:55.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210250+0000", 2024-04-25T22:02:55.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8004000000000002e-05 2024-04-25T22:02:55.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210275+0000", 2024-04-25T22:02:55.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4955000000000001e-05 2024-04-25T22:02:55.737 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.737 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.738 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.738 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:55.738 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.201108+0000", 2024-04-25T22:02:55.738 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.4384607649999999, 2024-04-25T22:02:55.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088952635000000002, 2024-04-25T22:02:55.738 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.738 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.738 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.738 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:55.738 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:55.738 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:55.738 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 77 2024-04-25T22:02:55.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.739 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201108+0000", 2024-04-25T22:02:55.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201108+0000", 2024-04-25T22:02:55.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201109+0000", 2024-04-25T22:02:55.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2160000000000001e-06 2024-04-25T22:02:55.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201116+0000", 2024-04-25T22:02:55.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9979999999999997e-06 2024-04-25T22:02:55.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201133+0000", 2024-04-25T22:02:55.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.753e-05 2024-04-25T22:02:55.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201156+0000", 2024-04-25T22:02:55.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2558999999999999e-05 2024-04-25T22:02:55.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201216+0000", 2024-04-25T22:02:55.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9741000000000003e-05 2024-04-25T22:02:55.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201307+0000", 2024-04-25T22:02:55.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1314e-05 2024-04-25T22:02:55.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:02:55.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201395+0000", 2024-04-25T22:02:55.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8460000000000003e-05 2024-04-25T22:02:55.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:55.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.202212+0000", 2024-04-25T22:02:55.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000816923 2024-04-25T22:02:55.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:55.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.289754+0000", 2024-04-25T22:02:55.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087541315999999994 2024-04-25T22:02:55.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.289931+0000", 2024-04-25T22:02:55.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017723700000000001 2024-04-25T22:02:55.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290060+0000", 2024-04-25T22:02:55.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012934099999999999 2024-04-25T22:02:55.743 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.743 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.743 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.744 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:55.744 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.224278+0000", 2024-04-25T22:02:55.744 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.4152900769999999, 2024-04-25T22:02:55.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.066143380000000002, 2024-04-25T22:02:55.744 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.744 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.744 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.744 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:55.744 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:55.744 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:55.744 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 89 2024-04-25T22:02:55.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.744 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224278+0000", 2024-04-25T22:02:55.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224278+0000", 2024-04-25T22:02:55.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224279+0000", 2024-04-25T22:02:55.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.248e-06 2024-04-25T22:02:55.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224286+0000", 2024-04-25T22:02:55.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4799999999999998e-06 2024-04-25T22:02:55.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224300+0000", 2024-04-25T22:02:55.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4275e-05 2024-04-25T22:02:55.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224311+0000", 2024-04-25T22:02:55.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1182999999999999e-05 2024-04-25T22:02:55.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224396+0000", 2024-04-25T22:02:55.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4901999999999995e-05 2024-04-25T22:02:55.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224561+0000", 2024-04-25T22:02:55.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016465699999999999 2024-04-25T22:02:55.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:02:55.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224734+0000", 2024-04-25T22:02:55.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017334800000000001 2024-04-25T22:02:55.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:55.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.225929+0000", 2024-04-25T22:02:55.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001194575 2024-04-25T22:02:55.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:55.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290179+0000", 2024-04-25T22:02:55.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064250242999999999 2024-04-25T22:02:55.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290329+0000", 2024-04-25T22:02:55.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014964700000000001 2024-04-25T22:02:55.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290422+0000", 2024-04-25T22:02:55.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2822e-05 2024-04-25T22:02:55.749 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.749 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.749 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.749 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:59 3.14 3:2e2fa760:::200.00000001:head [write 2774296~1300645 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-25T22:02:55.750 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:55.373674+0000", 2024-04-25T22:02:55.750 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.26589475200000001, 2024-04-25T22:02:55.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.039145353000000001, 2024-04-25T22:02:55.750 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:55.750 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:55.750 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:55.750 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:55.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:55.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.373674+0000", 2024-04-25T22:02:55.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:55.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.373674+0000", 2024-04-25T22:02:55.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:55.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:55.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.373676+0000", 2024-04-25T22:02:55.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0729999999999999e-06 2024-04-25T22:02:55.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:55.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375383+0000", 2024-04-25T22:02:55.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017077469999999999 2024-04-25T22:02:55.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:55.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375414+0000", 2024-04-25T22:02:55.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0661999999999999e-05 2024-04-25T22:02:55.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:55.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375438+0000", 2024-04-25T22:02:55.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4332999999999999e-05 2024-04-25T22:02:55.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:55.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375513+0000", 2024-04-25T22:02:55.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4562999999999997e-05 2024-04-25T22:02:55.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:55.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375569+0000", 2024-04-25T22:02:55.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6286000000000003e-05 2024-04-25T22:02:55.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:55.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375651+0000", 2024-04-25T22:02:55.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2149000000000002e-05 2024-04-25T22:02:55.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:55.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.389672+0000", 2024-04-25T22:02:55.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014020886999999999 2024-04-25T22:02:55.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:55.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.412742+0000", 2024-04-25T22:02:55.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023070100999999999 2024-04-25T22:02:55.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:55.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.412784+0000", 2024-04-25T22:02:55.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1925999999999998e-05 2024-04-25T22:02:55.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:55.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:55.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:55.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.412819+0000", 2024-04-25T22:02:55.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4625999999999997e-05 2024-04-25T22:02:55.754 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.755 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.755 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.755 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:55.755 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:55.755 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:55.756 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:55.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:55.753+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:55.858 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:55.853+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:55.899 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:55.899 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:55.899 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:02:55.899 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:55.914 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:55.958 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:55.953+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:56.042 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:56.043 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:02:56.043 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:02:56.043 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:02:56.043 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:56.058 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:56.059 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:56.053+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:56.161 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:56.157+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:56.188 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:02:56.188 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:02:56.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:02:56.188 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:02:56.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.188 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:56.189 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:02:56.189 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.0983417859999998, 2024-04-25T22:02:56.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:02:56.189 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.189 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.189 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.189 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:56.189 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:02:56.189 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:56.189 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:02:56.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.189 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:02:56.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:02:56.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:02:56.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:02:56.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:02:56.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:02:56.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:02:56.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:02:56.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:02:56.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:02:56.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:02:56.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:02:56.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:02:56.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:02:56.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:02:56.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:02:56.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:02:56.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:02:56.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:02:56.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:56.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:02:56.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:02:56.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:02:56.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:02:56.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:56.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:02:56.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:02:56.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:56.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:02:56.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:02:56.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:02:56.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:02:56.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.195 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.195 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:7 4.36 4:6ee5e2c4:::100000001f9.00000000:head [write 0~18007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:56.195 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.094428+0000", 2024-04-25T22:02:56.195 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.0894584780000001, 2024-04-25T22:02:56.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019201958000000002, 2024-04-25T22:02:56.195 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.195 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.195 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.195 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:56.196 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:02:56.196 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:56.196 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7 2024-04-25T22:02:56.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.196 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094428+0000", 2024-04-25T22:02:56.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094428+0000", 2024-04-25T22:02:56.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094430+0000", 2024-04-25T22:02:56.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2000000000000001e-06 2024-04-25T22:02:56.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094496+0000", 2024-04-25T22:02:56.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5194e-05 2024-04-25T22:02:56.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094519+0000", 2024-04-25T22:02:56.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3499999999999999e-05 2024-04-25T22:02:56.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094539+0000", 2024-04-25T22:02:56.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0013e-05 2024-04-25T22:02:56.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094705+0000", 2024-04-25T22:02:56.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016609900000000001 2024-04-25T22:02:56.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:02:56.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094722+0000", 2024-04-25T22:02:56.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6589999999999999e-05 2024-04-25T22:02:56.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102955+0000", 2024-04-25T22:02:56.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082329329999999996 2024-04-25T22:02:56.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103213+0000", 2024-04-25T22:02:56.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000258707 2024-04-25T22:02:56.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:56.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103500+0000", 2024-04-25T22:02:56.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028622000000000001 2024-04-25T22:02:56.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:56.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.106790+0000", 2024-04-25T22:02:56.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003290042 2024-04-25T22:02:56.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.113503+0000", 2024-04-25T22:02:56.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0067130660000000002 2024-04-25T22:02:56.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:56.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.113573+0000", 2024-04-25T22:02:56.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0306000000000001e-05 2024-04-25T22:02:56.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.113630+0000", 2024-04-25T22:02:56.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7088e-05 2024-04-25T22:02:56.201 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.201 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.201 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.201 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:56.201 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:02:56.201 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.0883410229999999, 2024-04-25T22:02:56.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:02:56.201 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.202 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.202 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.202 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:56.202 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:02:56.202 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:56.202 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:02:56.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.202 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:02:56.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:02:56.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:02:56.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:02:56.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:02:56.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:02:56.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:02:56.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:02:56.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:02:56.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:02:56.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:02:56.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:02:56.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:02:56.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:02:56.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:02:56.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:02:56.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:02:56.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:02:56.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:02:56.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:56.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:02:56.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:02:56.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:56.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:02:56.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:02:56.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:02:56.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:02:56.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:56.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:02:56.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:02:56.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:02:56.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:02:56.207 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.207 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.207 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.207 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:56.207 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:02:56.208 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.0841767490000001, 2024-04-25T22:02:56.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:02:56.208 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.208 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.208 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.208 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:56.208 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:02:56.208 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:56.208 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:02:56.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.208 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:02:56.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:02:56.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:02:56.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:02:56.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:02:56.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:02:56.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:02:56.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:02:56.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:02:56.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:02:56.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:02:56.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:02:56.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:02:56.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:02:56.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:56.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:02:56.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:02:56.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:56.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:02:56.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:02:56.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:02:56.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:02:56.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:56.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:02:56.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:02:56.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:02:56.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:02:56.213 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.213 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.213 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.213 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:56.213 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:02:56.213 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.0825804320000003, 2024-04-25T22:02:56.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:02:56.213 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.213 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.213 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.213 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:56.213 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:02:56.213 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:56.214 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:02:56.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.214 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:02:56.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:02:56.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:02:56.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:02:56.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:02:56.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:02:56.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:02:56.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:02:56.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:02:56.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:02:56.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:02:56.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:02:56.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:02:56.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:02:56.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:56.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:02:56.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:02:56.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:56.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:02:56.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:02:56.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:02:56.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:02:56.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:56.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:02:56.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:02:56.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:02:56.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:02:56.218 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.218 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.218 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.218 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:24 4.b 4:d3eda40d:::1000000020f.00000000:head [write 0~1144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:56.219 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.118844+0000", 2024-04-25T22:02:56.219 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.065042579, 2024-04-25T22:02:56.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.089959257000000001, 2024-04-25T22:02:56.219 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.219 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.219 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.219 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:56.219 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:02:56.219 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:56.219 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 24 2024-04-25T22:02:56.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.219 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118844+0000", 2024-04-25T22:02:56.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118844+0000", 2024-04-25T22:02:56.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118846+0000", 2024-04-25T22:02:56.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:56.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118855+0000", 2024-04-25T22:02:56.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2930000000000006e-06 2024-04-25T22:02:56.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118879+0000", 2024-04-25T22:02:56.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3312999999999999e-05 2024-04-25T22:02:56.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118891+0000", 2024-04-25T22:02:56.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2136e-05 2024-04-25T22:02:56.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118997+0000", 2024-04-25T22:02:56.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010655800000000001 2024-04-25T22:02:56.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.119214+0000", 2024-04-25T22:02:56.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021723099999999999 2024-04-25T22:02:56.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:56.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.119408+0000", 2024-04-25T22:02:56.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000193582 2024-04-25T22:02:56.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:56.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.121105+0000", 2024-04-25T22:02:56.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016972549999999999 2024-04-25T22:02:56.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208552+0000", 2024-04-25T22:02:56.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087447104999999997 2024-04-25T22:02:56.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:56.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208688+0000", 2024-04-25T22:02:56.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000135394 2024-04-25T22:02:56.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208803+0000", 2024-04-25T22:02:56.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011557000000000001 2024-04-25T22:02:56.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.224 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.224 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:32 4.b 4:d2dbd4ac:::10000000217.00000000:head [write 0~1921] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:56.224 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.130139+0000", 2024-04-25T22:02:56.224 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.0537474380000003, 2024-04-25T22:02:56.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.080213211000000006, 2024-04-25T22:02:56.224 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.224 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.224 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.224 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:56.225 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:02:56.225 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:56.225 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 32 2024-04-25T22:02:56.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.225 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130139+0000", 2024-04-25T22:02:56.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130139+0000", 2024-04-25T22:02:56.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130141+0000", 2024-04-25T22:02:56.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.243e-06 2024-04-25T22:02:56.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130153+0000", 2024-04-25T22:02:56.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1994000000000001e-05 2024-04-25T22:02:56.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130185+0000", 2024-04-25T22:02:56.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1201999999999997e-05 2024-04-25T22:02:56.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130201+0000", 2024-04-25T22:02:56.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.605e-05 2024-04-25T22:02:56.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130348+0000", 2024-04-25T22:02:56.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014707300000000001 2024-04-25T22:02:56.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130696+0000", 2024-04-25T22:02:56.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034790800000000002 2024-04-25T22:02:56.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:56.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.131078+0000", 2024-04-25T22:02:56.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038188399999999998 2024-04-25T22:02:56.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:56.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.132597+0000", 2024-04-25T22:02:56.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001519252 2024-04-25T22:02:56.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210220+0000", 2024-04-25T22:02:56.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.077623485000000006 2024-04-25T22:02:56.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:56.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210294+0000", 2024-04-25T22:02:56.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3444999999999999e-05 2024-04-25T22:02:56.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210352+0000", 2024-04-25T22:02:56.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8675000000000003e-05 2024-04-25T22:02:56.229 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.229 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.229 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.229 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:46 4.b 4:d0d26e50:::10000000225.00000000:head [write 0~1224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:56.230 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.150212+0000", 2024-04-25T22:02:56.230 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.0336742340000002, 2024-04-25T22:02:56.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060337512000000003, 2024-04-25T22:02:56.230 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.230 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.230 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.230 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:56.230 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:02:56.230 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:56.230 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46 2024-04-25T22:02:56.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.230 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150212+0000", 2024-04-25T22:02:56.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150212+0000", 2024-04-25T22:02:56.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150215+0000", 2024-04-25T22:02:56.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4229999999999999e-06 2024-04-25T22:02:56.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150229+0000", 2024-04-25T22:02:56.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4059999999999999e-05 2024-04-25T22:02:56.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150255+0000", 2024-04-25T22:02:56.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5795999999999998e-05 2024-04-25T22:02:56.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150277+0000", 2024-04-25T22:02:56.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2682999999999999e-05 2024-04-25T22:02:56.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150409+0000", 2024-04-25T22:02:56.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013196599999999999 2024-04-25T22:02:56.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150771+0000", 2024-04-25T22:02:56.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000361245 2024-04-25T22:02:56.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:56.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.151146+0000", 2024-04-25T22:02:56.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000375044 2024-04-25T22:02:56.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:56.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.155311+0000", 2024-04-25T22:02:56.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041656599999999998 2024-04-25T22:02:56.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210420+0000", 2024-04-25T22:02:56.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055108428000000001 2024-04-25T22:02:56.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:56.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210493+0000", 2024-04-25T22:02:56.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3155e-05 2024-04-25T22:02:56.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210550+0000", 2024-04-25T22:02:56.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7052000000000002e-05 2024-04-25T22:02:56.235 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.235 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.235 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.235 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:56.235 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:02:56.235 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.0257941820000003, 2024-04-25T22:02:56.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:02:56.235 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.235 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.235 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.236 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:56.236 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:02:56.236 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:56.236 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:02:56.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.236 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:02:56.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:02:56.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:02:56.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:02:56.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:02:56.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:02:56.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:02:56.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:02:56.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:02:56.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:02:56.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:02:56.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:02:56.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:02:56.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:02:56.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:56.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:02:56.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:02:56.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:02:56.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:02:56.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:56.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:02:56.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:02:56.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:56.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:02:56.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:02:56.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:02:56.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:02:56.240 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.240 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.240 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.241 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:56.241 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:02:56.241 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.0101499159999996, 2024-04-25T22:02:56.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:02:56.241 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.241 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.241 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:56.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:02:56.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:56.241 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:02:56.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.241 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:02:56.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:02:56.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:02:56.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:02:56.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:02:56.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:02:56.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:02:56.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:02:56.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:02:56.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:02:56.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:02:56.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:02:56.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:02:56.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:02:56.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:56.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:02:56.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:02:56.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:02:56.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:02:56.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:56.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:02:56.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:02:56.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:56.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:02:56.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:02:56.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:02:56.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:02:56.246 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.246 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.246 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.246 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:56.246 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:02:56.246 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.0053112249999998, 2024-04-25T22:02:56.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:02:56.247 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.247 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.247 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.247 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:56.247 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:02:56.247 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:56.247 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:02:56.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.247 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:02:56.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:02:56.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:02:56.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:56.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:02:56.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:02:56.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:02:56.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:02:56.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:02:56.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:02:56.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:02:56.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:02:56.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:02:56.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:02:56.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:56.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:02:56.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:02:56.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:02:56.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:02:56.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:56.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:02:56.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:02:56.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:56.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:02:56.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:02:56.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:02:56.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:02:56.251 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.252 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.252 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.252 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:56.252 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:02:56.252 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.9919941410000002, 2024-04-25T22:02:56.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.098402492999999994, 2024-04-25T22:02:56.252 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.252 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.252 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.252 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:56.252 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:02:56.252 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:56.252 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71 2024-04-25T22:02:56.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.253 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:02:56.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:02:56.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191895+0000", 2024-04-25T22:02:56.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0899999999999999e-06 2024-04-25T22:02:56.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191906+0000", 2024-04-25T22:02:56.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1508999999999999e-05 2024-04-25T22:02:56.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191937+0000", 2024-04-25T22:02:56.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0772999999999998e-05 2024-04-25T22:02:56.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191951+0000", 2024-04-25T22:02:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.437e-05 2024-04-25T22:02:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286217+0000", 2024-04-25T22:02:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.094265989999999994 2024-04-25T22:02:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286383+0000", 2024-04-25T22:02:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016591899999999999 2024-04-25T22:02:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286594+0000", 2024-04-25T22:02:56.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021108800000000001 2024-04-25T22:02:56.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.288518+0000", 2024-04-25T22:02:56.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001923391 2024-04-25T22:02:56.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:56.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290219+0000", 2024-04-25T22:02:56.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001701239 2024-04-25T22:02:56.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:56.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290266+0000", 2024-04-25T22:02:56.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6838000000000001e-05 2024-04-25T22:02:56.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290295+0000", 2024-04-25T22:02:56.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9286e-05 2024-04-25T22:02:56.257 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.257 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.257 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.257 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4564.0:77 4.30 e51/16 4:0c28cce1:::10000000244.00000000:head v 51'3, mlcod=51'1)", 2024-04-25T22:02:56.257 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.202141+0000", 2024-04-25T22:02:56.257 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.9817456240000002, 2024-04-25T22:02:56.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087897668999999998, 2024-04-25T22:02:56.257 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.257 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.258 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.258 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.202141+0000", 2024-04-25T22:02:56.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.202141+0000", 2024-04-25T22:02:56.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.202143+0000", 2024-04-25T22:02:56.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.477e-06 2024-04-25T22:02:56.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.202153+0000", 2024-04-25T22:02:56.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0599e-05 2024-04-25T22:02:56.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.202172+0000", 2024-04-25T22:02:56.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9113000000000001e-05 2024-04-25T22:02:56.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.202184+0000", 2024-04-25T22:02:56.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.147e-05 2024-04-25T22:02:56.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284532+0000", 2024-04-25T22:02:56.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.082347907999999997 2024-04-25T22:02:56.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284545+0000", 2024-04-25T22:02:56.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3825999999999999e-05 2024-04-25T22:02:56.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:56.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290013+0000", 2024-04-25T22:02:56.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054677249999999997 2024-04-25T22:02:56.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290039+0000", 2024-04-25T22:02:56.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5551e-05 2024-04-25T22:02:56.261 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.261 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.261 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.261 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4564.0:11 4.28 e51/49 ondisk, result = 0)", 2024-04-25T22:02:56.261 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.208333+0000", 2024-04-25T22:02:56.261 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.9755538169999998, 2024-04-25T22:02:56.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076582211999999997, 2024-04-25T22:02:56.262 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.262 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.262 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:56.262 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208333+0000", 2024-04-25T22:02:56.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208333+0000", 2024-04-25T22:02:56.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208335+0000", 2024-04-25T22:02:56.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.827e-06 2024-04-25T22:02:56.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208344+0000", 2024-04-25T22:02:56.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2690000000000005e-06 2024-04-25T22:02:56.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208367+0000", 2024-04-25T22:02:56.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.281e-05 2024-04-25T22:02:56.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208399+0000", 2024-04-25T22:02:56.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2085999999999997e-05 2024-04-25T22:02:56.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284794+0000", 2024-04-25T22:02:56.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076394869000000004 2024-04-25T22:02:56.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284806+0000", 2024-04-25T22:02:56.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1804000000000001e-05 2024-04-25T22:02:56.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284915+0000", 2024-04-25T22:02:56.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109547 2024-04-25T22:02:56.265 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.265 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.265 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.265 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4564.0:12 4.28 e51/49 ondisk, result = 0)", 2024-04-25T22:02:56.265 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.208427+0000", 2024-04-25T22:02:56.265 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.9754592090000003, 2024-04-25T22:02:56.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076675030000000005, 2024-04-25T22:02:56.265 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.265 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.266 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:56.266 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208427+0000", 2024-04-25T22:02:56.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208427+0000", 2024-04-25T22:02:56.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208428+0000", 2024-04-25T22:02:56.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8599999999999996e-07 2024-04-25T22:02:56.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208434+0000", 2024-04-25T22:02:56.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2270000000000001e-06 2024-04-25T22:02:56.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208452+0000", 2024-04-25T22:02:56.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8275999999999999e-05 2024-04-25T22:02:56.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208466+0000", 2024-04-25T22:02:56.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-04-25T22:02:56.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284953+0000", 2024-04-25T22:02:56.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076487148000000005 2024-04-25T22:02:56.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284974+0000", 2024-04-25T22:02:56.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1217999999999999e-05 2024-04-25T22:02:56.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285102+0000", 2024-04-25T22:02:56.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012848199999999999 2024-04-25T22:02:56.269 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.269 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.269 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.269 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4564.0:5 4.10 e51/16 ondisk, result = 0)", 2024-04-25T22:02:56.269 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.210916+0000", 2024-04-25T22:02:56.269 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.9729702380000003, 2024-04-25T22:02:56.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.074873453000000006, 2024-04-25T22:02:56.269 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.269 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.269 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:02:56.269 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210916+0000", 2024-04-25T22:02:56.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210916+0000", 2024-04-25T22:02:56.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210918+0000", 2024-04-25T22:02:56.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6700000000000001e-06 2024-04-25T22:02:56.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210927+0000", 2024-04-25T22:02:56.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4999999999999999e-06 2024-04-25T22:02:56.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210950+0000", 2024-04-25T22:02:56.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2976000000000002e-05 2024-04-25T22:02:56.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210963+0000", 2024-04-25T22:02:56.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3396e-05 2024-04-25T22:02:56.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285777+0000", 2024-04-25T22:02:56.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.074814172999999998 2024-04-25T22:02:56.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285782+0000", 2024-04-25T22:02:56.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4349999999999999e-06 2024-04-25T22:02:56.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285790+0000", 2024-04-25T22:02:56.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.303e-06 2024-04-25T22:02:56.273 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.273 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.273 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.273 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4564.0:89 4.30 e51/16 4:0e3d5a27:::10000000250.00000000:head v 51'4, mlcod=51'1)", 2024-04-25T22:02:56.273 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.225423+0000", 2024-04-25T22:02:56.273 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.9584640179999999, 2024-04-25T22:02:56.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064789777000000007, 2024-04-25T22:02:56.273 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.273 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.273 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.273 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.225423+0000", 2024-04-25T22:02:56.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.225423+0000", 2024-04-25T22:02:56.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.225423+0000", 2024-04-25T22:02:56.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4600000000000003e-07 2024-04-25T22:02:56.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.225431+0000", 2024-04-25T22:02:56.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:02:56.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.225446+0000", 2024-04-25T22:02:56.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5121e-05 2024-04-25T22:02:56.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.225454+0000", 2024-04-25T22:02:56.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5979999999999997e-06 2024-04-25T22:02:56.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285779+0000", 2024-04-25T22:02:56.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060325060999999999 2024-04-25T22:02:56.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285809+0000", 2024-04-25T22:02:56.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0136000000000001e-05 2024-04-25T22:02:56.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:56.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290191+0000", 2024-04-25T22:02:56.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043816640000000004 2024-04-25T22:02:56.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290212+0000", 2024-04-25T22:02:56.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1274e-05 2024-04-25T22:02:56.277 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.277 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.277 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.277 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:56.277 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.239486+0000", 2024-04-25T22:02:56.277 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.9444010870000001, 2024-04-25T22:02:56.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050859021999999997, 2024-04-25T22:02:56.277 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.277 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.277 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.277 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:56.277 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:02:56.278 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:56.278 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96 2024-04-25T22:02:56.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.278 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.239486+0000", 2024-04-25T22:02:56.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.239486+0000", 2024-04-25T22:02:56.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.239488+0000", 2024-04-25T22:02:56.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0559999999999999e-06 2024-04-25T22:02:56.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.239499+0000", 2024-04-25T22:02:56.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1387e-05 2024-04-25T22:02:56.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.239524+0000", 2024-04-25T22:02:56.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5276e-05 2024-04-25T22:02:56.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.239544+0000", 2024-04-25T22:02:56.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9888999999999999e-05 2024-04-25T22:02:56.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287217+0000", 2024-04-25T22:02:56.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047672503999999997 2024-04-25T22:02:56.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287292+0000", 2024-04-25T22:02:56.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5722000000000004e-05 2024-04-25T22:02:56.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:56.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287362+0000", 2024-04-25T22:02:56.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0017000000000004e-05 2024-04-25T22:02:56.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.288555+0000", 2024-04-25T22:02:56.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001192504 2024-04-25T22:02:56.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:56.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290299+0000", 2024-04-25T22:02:56.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001744518 2024-04-25T22:02:56.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:56.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290325+0000", 2024-04-25T22:02:56.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5496000000000001e-05 2024-04-25T22:02:56.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290345+0000", 2024-04-25T22:02:56.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9653e-05 2024-04-25T22:02:56.282 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.282 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.282 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.282 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:100 4.0 4:03a9c962:::1000000025b.00000000:head [write 0~1163] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:56.282 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.246611+0000", 2024-04-25T22:02:56.283 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.9372754830000001, 2024-04-25T22:02:56.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045312548000000001, 2024-04-25T22:02:56.283 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.283 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.283 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.283 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:02:56.283 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:02:56.283 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:56.283 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 100 2024-04-25T22:02:56.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.283 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.246611+0000", 2024-04-25T22:02:56.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.246611+0000", 2024-04-25T22:02:56.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.246617+0000", 2024-04-25T22:02:56.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4859999999999997e-06 2024-04-25T22:02:56.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.246626+0000", 2024-04-25T22:02:56.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2369999999999998e-06 2024-04-25T22:02:56.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.246649+0000", 2024-04-25T22:02:56.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2616000000000002e-05 2024-04-25T22:02:56.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.246667+0000", 2024-04-25T22:02:56.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8366e-05 2024-04-25T22:02:56.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287684+0000", 2024-04-25T22:02:56.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.041017419999999999 2024-04-25T22:02:56.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287755+0000", 2024-04-25T22:02:56.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1050999999999994e-05 2024-04-25T22:02:56.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:56.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287834+0000", 2024-04-25T22:02:56.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8702999999999995e-05 2024-04-25T22:02:56.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:56.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290350+0000", 2024-04-25T22:02:56.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025156610000000002 2024-04-25T22:02:56.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.291841+0000", 2024-04-25T22:02:56.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001491551 2024-04-25T22:02:56.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:56.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.291900+0000", 2024-04-25T22:02:56.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8405000000000001e-05 2024-04-25T22:02:56.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.291924+0000", 2024-04-25T22:02:56.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4051999999999999e-05 2024-04-25T22:02:56.288 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.288 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.288 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.288 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:62 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-25T22:02:56.288 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:55.643420+0000", 2024-04-25T22:02:56.288 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.54046705100000003, 2024-04-25T22:02:56.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018767585, 2024-04-25T22:02:56.288 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:02:56.288 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:02:56.288 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.288 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:02:56.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:02:56.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:55.643420+0000", 2024-04-25T22:02:56.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:02:56.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:55.643420+0000", 2024-04-25T22:02:56.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:02:56.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:02:56.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:55.643422+0000", 2024-04-25T22:02:56.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2570000000000002e-06 2024-04-25T22:02:56.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:02:56.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:55.643668+0000", 2024-04-25T22:02:56.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024642700000000002 2024-04-25T22:02:56.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:02:56.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:55.643700+0000", 2024-04-25T22:02:56.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1402000000000002e-05 2024-04-25T22:02:56.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:55.643722+0000", 2024-04-25T22:02:56.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2589999999999999e-05 2024-04-25T22:02:56.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:02:56.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:55.643848+0000", 2024-04-25T22:02:56.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012568400000000001 2024-04-25T22:02:56.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:02:56.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:55.643984+0000", 2024-04-25T22:02:56.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0001359 2024-04-25T22:02:56.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:56.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:55.652578+0000", 2024-04-25T22:02:56.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008593636 2024-04-25T22:02:56.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:55.658944+0000", 2024-04-25T22:02:56.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063661789999999996 2024-04-25T22:02:56.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:02:56.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:55.661923+0000", 2024-04-25T22:02:56.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029797930000000001 2024-04-25T22:02:56.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:02:56.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:55.662069+0000", 2024-04-25T22:02:56.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014589299999999999 2024-04-25T22:02:56.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:02:56.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:02:56.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:02:56.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:55.662187+0000", 2024-04-25T22:02:56.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000117824 2024-04-25T22:02:56.293 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.293 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.293 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.293 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:02:56.293 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:02:56.293 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:02:56.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:56.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:56.289+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:56.396 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:56.389+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:56.429 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:56.429 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:56.429 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:02:56.429 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:56.443 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:56.498 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:56.493+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:56.570 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:02:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:02:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:02:56.570 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:56.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:56.599 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:56.593+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:56.701 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:56.693+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:56.762 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:105 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'67, mlcod=10'64)", 2024-04-25T22:02:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.93234996299999, 2024-04-25T22:02:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010089522, 2024-04-25T22:02:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826531+0000", 2024-04-25T22:02:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826533+0000", 2024-04-25T22:02:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8560000000000001e-06 2024-04-25T22:02:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826544+0000", 2024-04-25T22:02:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-04-25T22:02:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826570+0000", 2024-04-25T22:02:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5602999999999999e-05 2024-04-25T22:02:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826583+0000", 2024-04-25T22:02:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3137e-05 2024-04-25T22:02:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826779+0000", 2024-04-25T22:02:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019576500000000001 2024-04-25T22:02:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.826818+0000", 2024-04-25T22:02:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9002999999999999e-05 2024-04-25T22:02:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836562+0000", 2024-04-25T22:02:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097446479999999999 2024-04-25T22:02:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836620+0000", 2024-04-25T22:02:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7782999999999999e-05 2024-04-25T22:02:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-25T22:02:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.93168369200001, 2024-04-25T22:02:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0094664910000000005, 2024-04-25T22:02:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827197+0000", 2024-04-25T22:02:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827199+0000", 2024-04-25T22:02:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9199999999999998e-06 2024-04-25T22:02:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827253+0000", 2024-04-25T22:02:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4459000000000002e-05 2024-04-25T22:02:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827279+0000", 2024-04-25T22:02:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5950000000000001e-05 2024-04-25T22:02:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827296+0000", 2024-04-25T22:02:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6816999999999998e-05 2024-04-25T22:02:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827466+0000", 2024-04-25T22:02:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016952199999999999 2024-04-25T22:02:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.827524+0000", 2024-04-25T22:02:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7979000000000002e-05 2024-04-25T22:02:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836625+0000", 2024-04-25T22:02:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0091018599999999998 2024-04-25T22:02:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.836663+0000", 2024-04-25T22:02:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7984000000000001e-05 2024-04-25T22:02:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.92874745100001, 2024-04-25T22:02:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'64)", 2024-04-25T22:02:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.92828411399999, 2024-04-25T22:02:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010215531, 2024-04-25T22:02:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830597+0000", 2024-04-25T22:02:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830598+0000", 2024-04-25T22:02:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:02:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830719+0000", 2024-04-25T22:02:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000120705 2024-04-25T22:02:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830744+0000", 2024-04-25T22:02:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4810000000000001e-05 2024-04-25T22:02:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830761+0000", 2024-04-25T22:02:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7156999999999999e-05 2024-04-25T22:02:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834441+0000", 2024-04-25T22:02:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036801339999999998 2024-04-25T22:02:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.834508+0000", 2024-04-25T22:02:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6914000000000003e-05 2024-04-25T22:02:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840775+0000", 2024-04-25T22:02:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006267417 2024-04-25T22:02:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840812+0000", 2024-04-25T22:02:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6884000000000001e-05 2024-04-25T22:02:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.129860088, 2024-04-25T22:02:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.12973610500001, 2024-04-25T22:02:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.129662169, 2024-04-25T22:02:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.129545917, 2024-04-25T22:02:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.12938250800001, 2024-04-25T22:02:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.12928031200001, 2024-04-25T22:02:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.12920135900001, 2024-04-25T22:02:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.129136336, 2024-04-25T22:02:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.129058144, 2024-04-25T22:02:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:4 4.32 e51/16 4:4def72d4:::10000000003.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:02:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:02:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.7664223840000002, 2024-04-25T22:02:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10987878, 2024-04-25T22:02:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:02:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:02:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992461+0000", 2024-04-25T22:02:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5780000000000001e-06 2024-04-25T22:02:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997784+0000", 2024-04-25T22:02:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005323627 2024-04-25T22:02:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997815+0000", 2024-04-25T22:02:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0066999999999999e-05 2024-04-25T22:02:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997830+0000", 2024-04-25T22:02:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5290000000000001e-05 2024-04-25T22:02:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997927+0000", 2024-04-25T22:02:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7391000000000003e-05 2024-04-25T22:02:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997947+0000", 2024-04-25T22:02:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0259999999999999e-05 2024-04-25T22:02:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102225+0000", 2024-04-25T22:02:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10427777100000001 2024-04-25T22:02:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102337+0000", 2024-04-25T22:02:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000111796 2024-04-25T22:02:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:6 4.13 e51/16 4:cbe72331:::10000000003.00000002:head v 51'1, mlcod=0'0)", 2024-04-25T22:02:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:02:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6716084000000002, 2024-04-25T22:02:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.11536371400000001, 2024-04-25T22:02:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:02:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:02:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087273+0000", 2024-04-25T22:02:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:02:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089358+0000", 2024-04-25T22:02:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0020848170000000001 2024-04-25T22:02:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089372+0000", 2024-04-25T22:02:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.452e-05 2024-04-25T22:02:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089381+0000", 2024-04-25T22:02:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5979999999999997e-06 2024-04-25T22:02:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089486+0000", 2024-04-25T22:02:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105573 2024-04-25T22:02:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089536+0000", 2024-04-25T22:02:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9505000000000001e-05 2024-04-25T22:02:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202556+0000", 2024-04-25T22:02:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.113020169 2024-04-25T22:02:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202636+0000", 2024-04-25T22:02:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9814000000000005e-05 2024-04-25T22:02:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:5 4.10 e51/16 4:09a4c37f:::10000000003.00000001:head v 51'1, mlcod=0'0)", 2024-04-25T22:02:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:02:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6590324829999998, 2024-04-25T22:02:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.110104358, 2024-04-25T22:02:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:02:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:02:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099849+0000", 2024-04-25T22:02:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7000000000000003e-07 2024-04-25T22:02:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108349+0000", 2024-04-25T22:02:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085003230000000006 2024-04-25T22:02:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108391+0000", 2024-04-25T22:02:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2011999999999997e-05 2024-04-25T22:02:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108415+0000", 2024-04-25T22:02:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3702000000000001e-05 2024-04-25T22:02:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108504+0000", 2024-04-25T22:02:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8684999999999995e-05 2024-04-25T22:02:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108520+0000", 2024-04-25T22:02:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5931999999999999e-05 2024-04-25T22:02:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209918+0000", 2024-04-25T22:02:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.101398696 2024-04-25T22:02:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209952+0000", 2024-04-25T22:02:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4038000000000002e-05 2024-04-25T22:02:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11 4.28 e51/49 4:177a762d:::10000000201.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:02:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:02:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6503305570000002, 2024-04-25T22:02:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098799331000000004, 2024-04-25T22:02:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:02:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:02:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108551+0000", 2024-04-25T22:02:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0699999999999996e-07 2024-04-25T22:02:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108576+0000", 2024-04-25T22:02:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4856000000000001e-05 2024-04-25T22:02:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108593+0000", 2024-04-25T22:02:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7125999999999998e-05 2024-04-25T22:02:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108609+0000", 2024-04-25T22:02:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6535999999999999e-05 2024-04-25T22:02:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108713+0000", 2024-04-25T22:02:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010344999999999999 2024-04-25T22:02:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108762+0000", 2024-04-25T22:02:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8711000000000002e-05 2024-04-25T22:02:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207305+0000", 2024-04-25T22:02:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098543566999999999 2024-04-25T22:02:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207349+0000", 2024-04-25T22:02:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4178000000000003e-05 2024-04-25T22:02:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:12 4.28 e51/49 4:15246602:::10000000202.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:02:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:02:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6502492660000003, 2024-04-25T22:02:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098749009999999998, 2024-04-25T22:02:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:02:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:02:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108632+0000", 2024-04-25T22:02:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2699999999999999e-07 2024-04-25T22:02:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108647+0000", 2024-04-25T22:02:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4585e-05 2024-04-25T22:02:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108667+0000", 2024-04-25T22:02:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9887000000000001e-05 2024-04-25T22:02:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108680+0000", 2024-04-25T22:02:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3249e-05 2024-04-25T22:02:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109917+0000", 2024-04-25T22:02:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012367050000000001 2024-04-25T22:02:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109961+0000", 2024-04-25T22:02:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4029000000000001e-05 2024-04-25T22:02:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207351+0000", 2024-04-25T22:02:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.097390791000000004 2024-04-25T22:02:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207380+0000", 2024-04-25T22:02:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9037e-05 2024-04-25T22:02:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:8 4.3b e51/49 4:deccbd37:::100000001fe.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:02:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:02:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6501843620000001, 2024-04-25T22:02:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090839771, 2024-04-25T22:02:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:02:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:02:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108697+0000", 2024-04-25T22:02:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1399999999999997e-07 2024-04-25T22:02:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108712+0000", 2024-04-25T22:02:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4772e-05 2024-04-25T22:02:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108728+0000", 2024-04-25T22:02:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5943e-05 2024-04-25T22:02:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108740+0000", 2024-04-25T22:02:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.235e-05 2024-04-25T22:02:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108797+0000", 2024-04-25T22:02:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6879000000000002e-05 2024-04-25T22:02:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108812+0000", 2024-04-25T22:02:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5268999999999999e-05 2024-04-25T22:02:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199495+0000", 2024-04-25T22:02:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090683071000000004 2024-04-25T22:02:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199536+0000", 2024-04-25T22:02:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0873e-05 2024-04-25T22:02:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:59 3.14 e52/15 3:2e2fa760:::200.00000001:head v 52'20, mlcod=51'18)", 2024-04-25T22:02:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:55.375543+0000", 2024-04-25T22:02:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.3833377040000001, 2024-04-25T22:02:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.036557824000000003, 2024-04-25T22:02:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.375543+0000", 2024-04-25T22:02:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.375543+0000", 2024-04-25T22:02:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.375544+0000", 2024-04-25T22:02:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2640000000000001e-06 2024-04-25T22:02:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377524+0000", 2024-04-25T22:02:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001980154 2024-04-25T22:02:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377551+0000", 2024-04-25T22:02:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6211999999999999e-05 2024-04-25T22:02:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377569+0000", 2024-04-25T22:02:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182e-05 2024-04-25T22:02:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377689+0000", 2024-04-25T22:02:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119973 2024-04-25T22:02:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377722+0000", 2024-04-25T22:02:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3113e-05 2024-04-25T22:02:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.412025+0000", 2024-04-25T22:02:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.034302721000000001 2024-04-25T22:02:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.412101+0000", 2024-04-25T22:02:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6205000000000006e-05 2024-04-25T22:02:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:56.851 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:02:56.852 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:56.849+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:56.853 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:56.911 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:02:56.953 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:56.949+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:56.997 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:2244 4.22 4:46062411:::10000000c10.00000000:head [write 0~137 in=137b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-25T22:02:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:56.995394+0000", 2024-04-25T22:02:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0016409549999999999, 2024-04-25T22:02:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001683574, 2024-04-25T22:02:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:02:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2244 2024-04-25T22:02:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:56.995394+0000", 2024-04-25T22:02:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:56.995394+0000", 2024-04-25T22:02:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:56.995395+0000", 2024-04-25T22:02:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6300000000000001e-06 2024-04-25T22:02:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:56.995403+0000", 2024-04-25T22:02:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8760000000000005e-06 2024-04-25T22:02:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:56.995420+0000", 2024-04-25T22:02:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6903000000000001e-05 2024-04-25T22:02:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:56.995430+0000", 2024-04-25T22:02:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0336999999999999e-05 2024-04-25T22:02:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:56.995492+0000", 2024-04-25T22:02:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1389999999999993e-05 2024-04-25T22:02:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:56.995619+0000", 2024-04-25T22:02:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012676500000000001 2024-04-25T22:02:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:56.995744+0000", 2024-04-25T22:02:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000125883 2024-04-25T22:02:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:56.996752+0000", 2024-04-25T22:02:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0010073320000000001 2024-04-25T22:02:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:02:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 1 2024-04-25T22:02:57.002 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:57.014 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:57.054 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:57.049+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:57.155 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:57.149+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:57.197 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:57.197 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:02:57.197 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:02:57.197 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:02:57.197 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:57.214 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:57.257 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:57.253+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:57.266 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:02:57.336 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-25T22:02:57.355 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:02:57.355 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:02:57.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:02:57.355 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:02:57.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.355 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:57.355 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:57.355 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 111.17500440800001, 2024-04-25T22:02:57.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:02:57.355 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.355 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.355 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.356 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:57.356 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:57.356 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:57.356 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:02:57.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.356 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:57.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:02:57.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:02:57.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:02:57.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:02:57.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:02:57.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:02:57.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:02:57.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:02:57.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:02:57.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:02:57.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:02:57.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:02:57.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:02:57.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:57.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:02:57.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:02:57.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:57.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:02:57.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:02:57.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:57.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:02:57.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:02:57.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:02:57.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:02:57.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:02:57.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:02:57.360 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.360 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.360 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.360 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:57.360 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:57.360 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 111.174809166, 2024-04-25T22:02:57.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028607158000000001, 2024-04-25T22:02:57.361 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.361 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.361 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.361 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:57.361 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:57.361 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:57.361 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 162 2024-04-25T22:02:57.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.361 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:57.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176395+0000", 2024-04-25T22:02:57.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176396+0000", 2024-04-25T22:02:57.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8999999999999995e-07 2024-04-25T22:02:57.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176405+0000", 2024-04-25T22:02:57.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4440000000000008e-06 2024-04-25T22:02:57.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176429+0000", 2024-04-25T22:02:57.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4719000000000002e-05 2024-04-25T22:02:57.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176441+0000", 2024-04-25T22:02:57.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1440000000000001e-05 2024-04-25T22:02:57.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196611+0000", 2024-04-25T22:02:57.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020170486000000001 2024-04-25T22:02:57.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.196845+0000", 2024-04-25T22:02:57.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000234105 2024-04-25T22:02:57.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:57.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197190+0000", 2024-04-25T22:02:57.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034515300000000001 2024-04-25T22:02:57.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:57.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199553+0000", 2024-04-25T22:02:57.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023621409999999999 2024-04-25T22:02:57.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:57.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204891+0000", 2024-04-25T22:02:57.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053384469999999996 2024-04-25T22:02:57.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204952+0000", 2024-04-25T22:02:57.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0665999999999998e-05 2024-04-25T22:02:57.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205002+0000", 2024-04-25T22:02:57.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0667000000000001e-05 2024-04-25T22:02:57.366 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.366 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.366 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.366 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:57.366 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:57.366 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 111.174746873, 2024-04-25T22:02:57.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:02:57.366 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.366 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.366 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.366 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:57.366 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:57.367 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:57.367 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:02:57.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.367 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:57.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:02:57.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:02:57.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:02:57.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:02:57.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:02:57.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:02:57.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:02:57.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:02:57.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:02:57.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:02:57.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:02:57.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:02:57.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:02:57.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:57.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:02:57.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:02:57.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:57.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:02:57.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:02:57.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:57.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:02:57.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:02:57.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:02:57.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:02:57.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:02:57.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:02:57.371 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.371 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.371 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.371 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:57.371 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:57.371 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 111.174686657, 2024-04-25T22:02:57.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:02:57.372 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.372 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.372 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.372 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:57.372 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:57.372 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:57.372 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:02:57.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.372 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:57.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:02:57.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:02:57.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:02:57.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:02:57.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:02:57.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:02:57.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:02:57.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:02:57.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:02:57.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:02:57.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:02:57.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:02:57.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:02:57.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:57.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:02:57.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:02:57.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:57.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:02:57.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:02:57.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:57.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:02:57.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:02:57.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:02:57.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:02:57.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:02:57.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:02:57.376 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.376 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.376 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.377 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:57.377 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:57.377 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 111.174497145, 2024-04-25T22:02:57.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:02:57.377 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.377 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.377 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.377 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:57.377 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:57.377 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:57.377 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:02:57.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.377 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:57.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:02:57.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:02:57.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:02:57.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:02:57.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:02:57.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:02:57.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:02:57.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:02:57.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:02:57.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:02:57.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:02:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:02:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:02:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:02:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:02:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:02:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:02:57.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:02:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:02:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:02:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:02:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:02:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:02:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.381 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:02:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 110.98263169800001, 2024-04-25T22:02:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:02:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:02:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:02:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:02:57.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:02:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:02:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:02:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:02:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:02:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:02:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:02:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:02:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:02:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:02:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:02:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:02:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:02:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:02:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:02:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:57.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:02:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:02:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:02:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:02:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:02:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:02:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:02:57.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:02:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T22:02:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:02:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.3673722010000002, 2024-04-25T22:02:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.180276931, 2024-04-25T22:02:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4 2024-04-25T22:02:57.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:02:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:02:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983834+0000", 2024-04-25T22:02:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2900000000000001e-06 2024-04-25T22:02:57.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991787+0000", 2024-04-25T22:02:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079521690000000003 2024-04-25T22:02:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991826+0000", 2024-04-25T22:02:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9258999999999998e-05 2024-04-25T22:02:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991845+0000", 2024-04-25T22:02:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9360000000000001e-05 2024-04-25T22:02:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992058+0000", 2024-04-25T22:02:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212559 2024-04-25T22:02:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992213+0000", 2024-04-25T22:02:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015520700000000001 2024-04-25T22:02:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992414+0000", 2024-04-25T22:02:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020049 2024-04-25T22:02:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162511+0000", 2024-04-25T22:02:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.17009782900000001 2024-04-25T22:02:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163967+0000", 2024-04-25T22:02:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001455752 2024-04-25T22:02:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164045+0000", 2024-04-25T22:02:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7415000000000003e-05 2024-04-25T22:02:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164109+0000", 2024-04-25T22:02:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4601e-05 2024-04-25T22:02:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:02:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.2679140530000002, 2024-04-25T22:02:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.12612672599999999, 2024-04-25T22:02:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2024-04-25T22:02:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:02:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:02:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083293+0000", 2024-04-25T22:02:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6630000000000002e-06 2024-04-25T22:02:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086619+0000", 2024-04-25T22:02:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033261699999999998 2024-04-25T22:02:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086647+0000", 2024-04-25T22:02:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8085999999999998e-05 2024-04-25T22:02:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086665+0000", 2024-04-25T22:02:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:02:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086870+0000", 2024-04-25T22:02:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020488599999999999 2024-04-25T22:02:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087110+0000", 2024-04-25T22:02:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024093199999999999 2024-04-25T22:02:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087310+0000", 2024-04-25T22:02:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000199936 2024-04-25T22:02:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207766+0000", 2024-04-25T22:02:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.120456035 2024-04-25T22:02:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209358+0000", 2024-04-25T22:02:57.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015912369999999999 2024-04-25T22:02:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209390+0000", 2024-04-25T22:02:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2434999999999997e-05 2024-04-25T22:02:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209417+0000", 2024-04-25T22:02:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6936000000000001e-05 2024-04-25T22:02:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop_reply(client.4564.0:4 4.32 e51/16 ondisk, result = 0)", 2024-04-25T22:02:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.102726+0000", 2024-04-25T22:02:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.2484785189999998, 2024-04-25T22:02:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059798849000000001, 2024-04-25T22:02:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-25T22:02:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102726+0000", 2024-04-25T22:02:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102726+0000", 2024-04-25T22:02:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102727+0000", 2024-04-25T22:02:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7800000000000001e-07 2024-04-25T22:02:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102732+0000", 2024-04-25T22:02:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9389999999999996e-06 2024-04-25T22:02:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102747+0000", 2024-04-25T22:02:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5554e-05 2024-04-25T22:02:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102755+0000", 2024-04-25T22:02:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1599999999999998e-06 2024-04-25T22:02:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162489+0000", 2024-04-25T22:02:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059734204999999999 2024-04-25T22:02:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162501+0000", 2024-04-25T22:02:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1775e-05 2024-04-25T22:02:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162525+0000", 2024-04-25T22:02:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3438000000000002e-05 2024-04-25T22:02:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.111321+0000", 2024-04-25T22:02:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.2398829259999999, 2024-04-25T22:02:57.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.053212803000000003, 2024-04-25T22:02:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 19 2024-04-25T22:02:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111321+0000", 2024-04-25T22:02:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111321+0000", 2024-04-25T22:02:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111323+0000", 2024-04-25T22:02:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9759999999999998e-06 2024-04-25T22:02:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111334+0000", 2024-04-25T22:02:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.049e-05 2024-04-25T22:02:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111359+0000", 2024-04-25T22:02:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.495e-05 2024-04-25T22:02:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111380+0000", 2024-04-25T22:02:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1063000000000001e-05 2024-04-25T22:02:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162572+0000", 2024-04-25T22:02:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.051191677999999997 2024-04-25T22:02:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162760+0000", 2024-04-25T22:02:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018837500000000001 2024-04-25T22:02:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162962+0000", 2024-04-25T22:02:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020174200000000001 2024-04-25T22:02:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164379+0000", 2024-04-25T22:02:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001416856 2024-04-25T22:02:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164402+0000", 2024-04-25T22:02:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3734e-05 2024-04-25T22:02:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164474+0000", 2024-04-25T22:02:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1422999999999997e-05 2024-04-25T22:02:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164534+0000", 2024-04-25T22:02:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0516000000000001e-05 2024-04-25T22:02:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:24 4.b e51/16 4:d3eda40d:::1000000020f.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:02:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.119033+0000", 2024-04-25T22:02:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.2321710499999998, 2024-04-25T22:02:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088682448999999997, 2024-04-25T22:02:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.407 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119033+0000", 2024-04-25T22:02:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119033+0000", 2024-04-25T22:02:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119035+0000", 2024-04-25T22:02:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:02:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119044+0000", 2024-04-25T22:02:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0860000000000008e-06 2024-04-25T22:02:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119068+0000", 2024-04-25T22:02:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4037e-05 2024-04-25T22:02:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119080+0000", 2024-04-25T22:02:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2322e-05 2024-04-25T22:02:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119203+0000", 2024-04-25T22:02:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012249799999999999 2024-04-25T22:02:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119253+0000", 2024-04-25T22:02:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0148999999999997e-05 2024-04-25T22:02:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207679+0000", 2024-04-25T22:02:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088425928000000001 2024-04-25T22:02:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207716+0000", 2024-04-25T22:02:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7048999999999997e-05 2024-04-25T22:02:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:27 4.13 4:cbcb6224:::10000000212.00000000:head [write 0~3719] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.122624+0000", 2024-04-25T22:02:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.2285801569999997, 2024-04-25T22:02:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087419288999999997, 2024-04-25T22:02:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:57.411 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 27 2024-04-25T22:02:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122624+0000", 2024-04-25T22:02:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122624+0000", 2024-04-25T22:02:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122625+0000", 2024-04-25T22:02:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.181e-06 2024-04-25T22:02:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122632+0000", 2024-04-25T22:02:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8279999999999997e-06 2024-04-25T22:02:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122647+0000", 2024-04-25T22:02:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4398e-05 2024-04-25T22:02:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122657+0000", 2024-04-25T22:02:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0662999999999999e-05 2024-04-25T22:02:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.206922+0000", 2024-04-25T22:02:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084264247 2024-04-25T22:02:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207073+0000", 2024-04-25T22:02:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015129499999999999 2024-04-25T22:02:57.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207227+0000", 2024-04-25T22:02:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000153819 2024-04-25T22:02:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209429+0000", 2024-04-25T22:02:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022023899999999998 2024-04-25T22:02:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209971+0000", 2024-04-25T22:02:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00054203900000000002 2024-04-25T22:02:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210004+0000", 2024-04-25T22:02:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2468999999999997e-05 2024-04-25T22:02:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210044+0000", 2024-04-25T22:02:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9959999999999997e-05 2024-04-25T22:02:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.124053+0000", 2024-04-25T22:02:57.416 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.2271510440000002, 2024-04-25T22:02:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.040913613000000001, 2024-04-25T22:02:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 28 2024-04-25T22:02:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124053+0000", 2024-04-25T22:02:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124053+0000", 2024-04-25T22:02:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124054+0000", 2024-04-25T22:02:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8200000000000008e-07 2024-04-25T22:02:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124060+0000", 2024-04-25T22:02:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6879999999999996e-06 2024-04-25T22:02:57.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124073+0000", 2024-04-25T22:02:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3113e-05 2024-04-25T22:02:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124081+0000", 2024-04-25T22:02:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4959999999999999e-06 2024-04-25T22:02:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163657+0000", 2024-04-25T22:02:57.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.039576014 2024-04-25T22:02:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163775+0000", 2024-04-25T22:02:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011861100000000001 2024-04-25T22:02:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163907+0000", 2024-04-25T22:02:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013217599999999999 2024-04-25T22:02:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164803+0000", 2024-04-25T22:02:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000895801 2024-04-25T22:02:57.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164825+0000", 2024-04-25T22:02:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1339e-05 2024-04-25T22:02:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164906+0000", 2024-04-25T22:02:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.119e-05 2024-04-25T22:02:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164967+0000", 2024-04-25T22:02:57.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1203000000000003e-05 2024-04-25T22:02:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:32 4.b e51/16 4:d2dbd4ac:::10000000217.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:02:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.130764+0000", 2024-04-25T22:02:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.2204403050000003, 2024-04-25T22:02:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.07870402, 2024-04-25T22:02:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130764+0000", 2024-04-25T22:02:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130764+0000", 2024-04-25T22:02:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130766+0000", 2024-04-25T22:02:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6270000000000001e-06 2024-04-25T22:02:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130777+0000", 2024-04-25T22:02:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1799e-05 2024-04-25T22:02:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130805+0000", 2024-04-25T22:02:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7036999999999999e-05 2024-04-25T22:02:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130817+0000", 2024-04-25T22:02:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2856e-05 2024-04-25T22:02:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.206926+0000", 2024-04-25T22:02:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.076108517000000001 2024-04-25T22:02:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207009+0000", 2024-04-25T22:02:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.276e-05 2024-04-25T22:02:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209432+0000", 2024-04-25T22:02:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024229830000000001 2024-04-25T22:02:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209468+0000", 2024-04-25T22:02:57.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6440999999999999e-05 2024-04-25T22:02:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:46 4.b e51/16 4:d0d26e50:::10000000225.00000000:head v 51'3, mlcod=0'0)", 2024-04-25T22:02:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:02:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.2003847900000002, 2024-04-25T22:02:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.058683655000000001, 2024-04-25T22:02:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:02:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:02:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:02:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7499999999999999e-07 2024-04-25T22:02:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150827+0000", 2024-04-25T22:02:57.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.64e-06 2024-04-25T22:02:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150841+0000", 2024-04-25T22:02:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3895e-05 2024-04-25T22:02:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150849+0000", 2024-04-25T22:02:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5310000000000004e-06 2024-04-25T22:02:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207762+0000", 2024-04-25T22:02:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.056913380999999999 2024-04-25T22:02:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207782+0000", 2024-04-25T22:02:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0026000000000001e-05 2024-04-25T22:02:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209471+0000", 2024-04-25T22:02:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016892020000000001 2024-04-25T22:02:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209503+0000", 2024-04-25T22:02:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2104999999999998e-05 2024-04-25T22:02:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:54 4.2b 4:d5ee56ee:::1000000022d.00000000:head [write 0~3953] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.162091+0000", 2024-04-25T22:02:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.1891138310000002, 2024-04-25T22:02:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.048184338, 2024-04-25T22:02:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54 2024-04-25T22:02:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.430 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162091+0000", 2024-04-25T22:02:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162091+0000", 2024-04-25T22:02:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162092+0000", 2024-04-25T22:02:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.175e-06 2024-04-25T22:02:57.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162102+0000", 2024-04-25T22:02:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0012e-05 2024-04-25T22:02:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162117+0000", 2024-04-25T22:02:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5443000000000001e-05 2024-04-25T22:02:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162126+0000", 2024-04-25T22:02:57.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1840000000000005e-06 2024-04-25T22:02:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207805+0000", 2024-04-25T22:02:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.045678641999999998 2024-04-25T22:02:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207941+0000", 2024-04-25T22:02:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000135983 2024-04-25T22:02:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:02:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.208119+0000", 2024-04-25T22:02:57.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017767099999999999 2024-04-25T22:02:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209511+0000", 2024-04-25T22:02:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001392304 2024-04-25T22:02:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210222+0000", 2024-04-25T22:02:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00071096500000000003 2024-04-25T22:02:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210250+0000", 2024-04-25T22:02:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8004000000000002e-05 2024-04-25T22:02:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210275+0000", 2024-04-25T22:02:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4955000000000001e-05 2024-04-25T22:02:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.201108+0000", 2024-04-25T22:02:57.435 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.1500968240000002, 2024-04-25T22:02:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088952635000000002, 2024-04-25T22:02:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 77 2024-04-25T22:02:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201108+0000", 2024-04-25T22:02:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201108+0000", 2024-04-25T22:02:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201109+0000", 2024-04-25T22:02:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2160000000000001e-06 2024-04-25T22:02:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201116+0000", 2024-04-25T22:02:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9979999999999997e-06 2024-04-25T22:02:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201133+0000", 2024-04-25T22:02:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.753e-05 2024-04-25T22:02:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201156+0000", 2024-04-25T22:02:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2558999999999999e-05 2024-04-25T22:02:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201216+0000", 2024-04-25T22:02:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9741000000000003e-05 2024-04-25T22:02:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201307+0000", 2024-04-25T22:02:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1314e-05 2024-04-25T22:02:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:02:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201395+0000", 2024-04-25T22:02:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8460000000000003e-05 2024-04-25T22:02:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.202212+0000", 2024-04-25T22:02:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000816923 2024-04-25T22:02:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.289754+0000", 2024-04-25T22:02:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087541315999999994 2024-04-25T22:02:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.289931+0000", 2024-04-25T22:02:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017723700000000001 2024-04-25T22:02:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290060+0000", 2024-04-25T22:02:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012934099999999999 2024-04-25T22:02:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:02:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.224278+0000", 2024-04-25T22:02:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.1269261359999998, 2024-04-25T22:02:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.066143380000000002, 2024-04-25T22:02:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 89 2024-04-25T22:02:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224278+0000", 2024-04-25T22:02:57.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224278+0000", 2024-04-25T22:02:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224279+0000", 2024-04-25T22:02:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.248e-06 2024-04-25T22:02:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224286+0000", 2024-04-25T22:02:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4799999999999998e-06 2024-04-25T22:02:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224300+0000", 2024-04-25T22:02:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4275e-05 2024-04-25T22:02:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224311+0000", 2024-04-25T22:02:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1182999999999999e-05 2024-04-25T22:02:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224396+0000", 2024-04-25T22:02:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4901999999999995e-05 2024-04-25T22:02:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224561+0000", 2024-04-25T22:02:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016465699999999999 2024-04-25T22:02:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:02:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224734+0000", 2024-04-25T22:02:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017334800000000001 2024-04-25T22:02:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:57.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.225929+0000", 2024-04-25T22:02:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001194575 2024-04-25T22:02:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290179+0000", 2024-04-25T22:02:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064250242999999999 2024-04-25T22:02:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290329+0000", 2024-04-25T22:02:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014964700000000001 2024-04-25T22:02:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290422+0000", 2024-04-25T22:02:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2822e-05 2024-04-25T22:02:57.445 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:59 3.14 3:2e2fa760:::200.00000001:head [write 2774296~1300645 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-25T22:02:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:55.373674+0000", 2024-04-25T22:02:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.9775308110000001, 2024-04-25T22:02:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.039145353000000001, 2024-04-25T22:02:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.373674+0000", 2024-04-25T22:02:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.373674+0000", 2024-04-25T22:02:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.373676+0000", 2024-04-25T22:02:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0729999999999999e-06 2024-04-25T22:02:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375383+0000", 2024-04-25T22:02:57.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017077469999999999 2024-04-25T22:02:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375414+0000", 2024-04-25T22:02:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0661999999999999e-05 2024-04-25T22:02:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375438+0000", 2024-04-25T22:02:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4332999999999999e-05 2024-04-25T22:02:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375513+0000", 2024-04-25T22:02:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4562999999999997e-05 2024-04-25T22:02:57.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375569+0000", 2024-04-25T22:02:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6286000000000003e-05 2024-04-25T22:02:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375651+0000", 2024-04-25T22:02:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2149000000000002e-05 2024-04-25T22:02:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.389672+0000", 2024-04-25T22:02:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014020886999999999 2024-04-25T22:02:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:57.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.412742+0000", 2024-04-25T22:02:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023070100999999999 2024-04-25T22:02:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.412784+0000", 2024-04-25T22:02:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1925999999999998e-05 2024-04-25T22:02:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.412819+0000", 2024-04-25T22:02:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4625999999999997e-05 2024-04-25T22:02:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:2315 4.1f 4:f84a2a2d:::10000000c60.00000000:head [write 0~648229] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-25T22:02:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:57.110762+0000", 2024-04-25T22:02:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.24044227000000001, 2024-04-25T22:02:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.041428231000000003, 2024-04-25T22:02:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:02:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:02:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:02:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:02:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2315 2024-04-25T22:02:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:02:57.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:02:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.110762+0000", 2024-04-25T22:02:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:02:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.110762+0000", 2024-04-25T22:02:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:02:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:02:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.110764+0000", 2024-04-25T22:02:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5460000000000001e-06 2024-04-25T22:02:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:02:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.111342+0000", 2024-04-25T22:02:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057855899999999997 2024-04-25T22:02:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:02:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.111364+0000", 2024-04-25T22:02:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1810999999999998e-05 2024-04-25T22:02:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:02:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.111376+0000", 2024-04-25T22:02:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.165e-05 2024-04-25T22:02:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:02:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.111533+0000", 2024-04-25T22:02:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156902 2024-04-25T22:02:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:02:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.111910+0000", 2024-04-25T22:02:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037699000000000001 2024-04-25T22:02:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:02:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.112294+0000", 2024-04-25T22:02:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038433899999999998 2024-04-25T22:02:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:02:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.150695+0000", 2024-04-25T22:02:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.038401063999999999 2024-04-25T22:02:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.151992+0000", 2024-04-25T22:02:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012968529999999999 2024-04-25T22:02:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:02:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.152082+0000", 2024-04-25T22:02:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0645999999999999e-05 2024-04-25T22:02:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:02:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:02:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:02:57.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.152190+0000", 2024-04-25T22:02:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000107871 2024-04-25T22:02:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:02:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:02:57.456 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:02:57.458 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:57.458 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:57.459 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:57.453+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:57.459 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:57.459 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:57.459 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:57.478 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:57.478 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:57.558 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:57.553+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:57.595 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:57.595 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:57.610 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:57.659 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:57.653+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:57.750 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:57.750 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:57.759 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:57.753+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:57.766 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:57.860 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:57.853+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:57.896 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:57.896 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:57.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:57.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:57.957+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:58.046 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:58.046 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:58.060 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:58.061 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:58.057+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:58.162 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:58.157+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:58.189 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:58.189 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:58.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:58.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:58.261+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:58.365 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:58.361+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:58.381 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:58.382 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:58.397 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:02:58.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:58.461+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:58.540 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:58.540 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:58.556 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:02:58.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:58.561+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:58.667 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:58.665+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:58.688 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:58.688 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:58.703 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:02:58.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:58.765+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:58.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:58.865+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:58.875 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:58.875 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:58.890 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:02:58.970 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:58.969+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:59.024 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:59.025 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:59.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:02:59.071 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:59.065+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:59.166 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:59.167 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:59.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:59.169+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:59.182 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:02:59.272 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:59.269+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:59.349 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:59.349 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:59.364 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:02:59.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:59.369+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:59.458 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:02:59.475 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:59.469+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:59.498 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:02:59.505 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:59.505 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:59.522 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:02:59.608 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:59.605+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:59.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:02:59.673+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:02:59.681 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:02:59.681 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:02:59.693 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:02:59.693 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:02:59.708 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:02:59.708 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:02:59.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:02:59.732 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:02:59.733 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:02:59.797 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:02:59.793+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:02:59.878 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:02:59.877+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:02:59.890 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:02:59.890 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:02:59.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:02:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:02:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4153.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'64)", 2024-04-25T22:02:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 114.05567670400001, 2024-04-25T22:02:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010635491, 2024-04-25T22:02:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830133+0000", 2024-04-25T22:02:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830135+0000", 2024-04-25T22:02:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:02:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830147+0000", 2024-04-25T22:02:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.219e-05 2024-04-25T22:02:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830174+0000", 2024-04-25T22:02:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:02:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.830187+0000", 2024-04-25T22:02:59.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.295e-05 2024-04-25T22:02:59.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833502+0000", 2024-04-25T22:02:59.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033148380000000001 2024-04-25T22:02:59.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.833552+0000", 2024-04-25T22:02:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0389999999999997e-05 2024-04-25T22:02:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840632+0000", 2024-04-25T22:02:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070797810000000003 2024-04-25T22:02:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:05.840769+0000", 2024-04-25T22:02:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136966 2024-04-25T22:02:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 105.256789341, 2024-04-25T22:02:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:02:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:02:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:02:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:02:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:02:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:02:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:02:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:02:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:02:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:02:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:02:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:02:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:02:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:02:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:02:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:02:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:02:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:02:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:02:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:02:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:02:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:02:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:02:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:02:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 105.25666535800001, 2024-04-25T22:02:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:02:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:02:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:02:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:02:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:02:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:02:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:02:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:02:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:02:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:02:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:02:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:02:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:02:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:02:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:02:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:02:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:02:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:02:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:59.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:02:59.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:02:59.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:59.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:02:59.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:02:59.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:02:59.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:02:59.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.910 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.910 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:59.910 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:59.911 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 105.256591422, 2024-04-25T22:02:59.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:02:59.911 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.911 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.911 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:59.911 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:59.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:02:59.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:02:59.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:02:59.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:02:59.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:02:59.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:02:59.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:02:59.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:02:59.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:02:59.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:02:59.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:02:59.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:02:59.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:02:59.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:59.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:02:59.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:02:59.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:59.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:02:59.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:02:59.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:59.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:02:59.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:02:59.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:59.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:02:59.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:02:59.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:02:59.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:02:59.916 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.916 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.917 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:59.917 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:59.917 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 105.25647517, 2024-04-25T22:02:59.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:02:59.917 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.917 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.917 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:59.917 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:59.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:02:59.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:02:59.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:02:59.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:02:59.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:02:59.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:02:59.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:02:59.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:02:59.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:02:59.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:02:59.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:02:59.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:02:59.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:02:59.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:59.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:02:59.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:02:59.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:59.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:02:59.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:02:59.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:59.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:02:59.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:02:59.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:59.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:02:59.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:02:59.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:02:59.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:02:59.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.923 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.923 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.923 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:59.923 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:59.923 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 105.25631176100001, 2024-04-25T22:02:59.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:02:59.923 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.923 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:59.923 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:59.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:02:59.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:02:59.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:02:59.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:02:59.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:02:59.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:02:59.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:02:59.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:02:59.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:02:59.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:02:59.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:02:59.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:02:59.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:02:59.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:59.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:02:59.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:02:59.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:59.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:02:59.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:02:59.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:59.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:02:59.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:02:59.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:59.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:02:59.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:02:59.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:02:59.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:02:59.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.929 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.929 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:59.929 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:59.929 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 105.25620956500001, 2024-04-25T22:02:59.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:02:59.930 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.930 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:59.930 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:59.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:02:59.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:02:59.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:02:59.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:02:59.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:02:59.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:02:59.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:02:59.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:02:59.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:02:59.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:02:59.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:02:59.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:02:59.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:02:59.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:59.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:02:59.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:02:59.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:59.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:02:59.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:02:59.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:59.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:02:59.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:02:59.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:59.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:02:59.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:02:59.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:02:59.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:02:59.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.935 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.936 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:59.936 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:59.936 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 105.25613061200001, 2024-04-25T22:02:59.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:02:59.936 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.936 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.936 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:59.936 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:59.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:02:59.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:02:59.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:02:59.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:02:59.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:02:59.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:02:59.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:02:59.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:02:59.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:02:59.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:02:59.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:02:59.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:02:59.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:02:59.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:59.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:02:59.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:02:59.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:59.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:02:59.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:02:59.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:59.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:02:59.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:02:59.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:59.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:02:59.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:02:59.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:02:59.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:02:59.941 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.941 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.942 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.942 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:59.942 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:59.942 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 105.256065589, 2024-04-25T22:02:59.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011216719, 2024-04-25T22:02:59.942 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.942 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:59.942 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:59.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629744+0000", 2024-04-25T22:02:59.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629746+0000", 2024-04-25T22:02:59.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:02:59.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629751+0000", 2024-04-25T22:02:59.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7060000000000001e-06 2024-04-25T22:02:59.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629769+0000", 2024-04-25T22:02:59.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7354e-05 2024-04-25T22:02:59.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629783+0000", 2024-04-25T22:02:59.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4423000000000001e-05 2024-04-25T22:02:59.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629916+0000", 2024-04-25T22:02:59.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013309899999999999 2024-04-25T22:02:59.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630214+0000", 2024-04-25T22:02:59.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029808699999999999 2024-04-25T22:02:59.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640961+0000", 2024-04-25T22:02:59.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01074665 2024-04-25T22:02:59.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.946 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.946 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:02:59.946 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:59.946 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 105.255987397, 2024-04-25T22:02:59.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:02:59.946 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.947 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.947 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:02:59.947 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:59.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:02:59.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:02:59.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:02:59.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:02:59.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:02:59.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:02:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:02:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:02:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:02:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:02:59.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:02:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:02:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:02:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:02:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:02:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:4 4.32 e51/16 4:4def72d4:::10000000003.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:02:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:02:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8933516370000003, 2024-04-25T22:02:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10987878, 2024-04-25T22:02:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:02:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:02:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992461+0000", 2024-04-25T22:02:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5780000000000001e-06 2024-04-25T22:02:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997784+0000", 2024-04-25T22:02:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005323627 2024-04-25T22:02:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997815+0000", 2024-04-25T22:02:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0066999999999999e-05 2024-04-25T22:02:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997830+0000", 2024-04-25T22:02:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5290000000000001e-05 2024-04-25T22:02:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997927+0000", 2024-04-25T22:02:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7391000000000003e-05 2024-04-25T22:02:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997947+0000", 2024-04-25T22:02:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0259999999999999e-05 2024-04-25T22:02:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102225+0000", 2024-04-25T22:02:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10427777100000001 2024-04-25T22:02:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102337+0000", 2024-04-25T22:02:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000111796 2024-04-25T22:02:59.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:6 4.13 e51/16 4:cbe72331:::10000000003.00000002:head v 51'1, mlcod=0'0)", 2024-04-25T22:02:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:02:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.7985376530000003, 2024-04-25T22:02:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.11536371400000001, 2024-04-25T22:02:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:59.956 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:02:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:02:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087273+0000", 2024-04-25T22:02:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:02:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089358+0000", 2024-04-25T22:02:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0020848170000000001 2024-04-25T22:02:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089372+0000", 2024-04-25T22:02:59.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.452e-05 2024-04-25T22:02:59.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089381+0000", 2024-04-25T22:02:59.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5979999999999997e-06 2024-04-25T22:02:59.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089486+0000", 2024-04-25T22:02:59.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105573 2024-04-25T22:02:59.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089536+0000", 2024-04-25T22:02:59.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9505000000000001e-05 2024-04-25T22:02:59.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:59.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202556+0000", 2024-04-25T22:02:59.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.113020169 2024-04-25T22:02:59.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202636+0000", 2024-04-25T22:02:59.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9814000000000005e-05 2024-04-25T22:02:59.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.961 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.961 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:5 4.10 e51/16 4:09a4c37f:::10000000003.00000001:head v 51'1, mlcod=0'0)", 2024-04-25T22:02:59.961 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:02:59.961 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.785961736, 2024-04-25T22:02:59.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.110104358, 2024-04-25T22:02:59.961 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.961 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:59.962 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:02:59.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:02:59.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099849+0000", 2024-04-25T22:02:59.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7000000000000003e-07 2024-04-25T22:02:59.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108349+0000", 2024-04-25T22:02:59.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085003230000000006 2024-04-25T22:02:59.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108391+0000", 2024-04-25T22:02:59.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2011999999999997e-05 2024-04-25T22:02:59.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108415+0000", 2024-04-25T22:02:59.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3702000000000001e-05 2024-04-25T22:02:59.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108504+0000", 2024-04-25T22:02:59.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8684999999999995e-05 2024-04-25T22:02:59.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108520+0000", 2024-04-25T22:02:59.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5931999999999999e-05 2024-04-25T22:02:59.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:59.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209918+0000", 2024-04-25T22:02:59.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.101398696 2024-04-25T22:02:59.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209952+0000", 2024-04-25T22:02:59.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4038000000000002e-05 2024-04-25T22:02:59.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.965 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.966 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11 4.28 e51/49 4:177a762d:::10000000201.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:02:59.966 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:02:59.966 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.7772598100000003, 2024-04-25T22:02:59.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098799331000000004, 2024-04-25T22:02:59.966 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.966 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.966 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:59.966 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:02:59.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:02:59.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108551+0000", 2024-04-25T22:02:59.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0699999999999996e-07 2024-04-25T22:02:59.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108576+0000", 2024-04-25T22:02:59.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4856000000000001e-05 2024-04-25T22:02:59.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108593+0000", 2024-04-25T22:02:59.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7125999999999998e-05 2024-04-25T22:02:59.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108609+0000", 2024-04-25T22:02:59.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6535999999999999e-05 2024-04-25T22:02:59.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108713+0000", 2024-04-25T22:02:59.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010344999999999999 2024-04-25T22:02:59.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108762+0000", 2024-04-25T22:02:59.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8711000000000002e-05 2024-04-25T22:02:59.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:59.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207305+0000", 2024-04-25T22:02:59.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098543566999999999 2024-04-25T22:02:59.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207349+0000", 2024-04-25T22:02:59.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4178000000000003e-05 2024-04-25T22:02:59.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.970 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.971 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:12 4.28 e51/49 4:15246602:::10000000202.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:02:59.971 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:02:59.971 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.7771785189999996, 2024-04-25T22:02:59.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098749009999999998, 2024-04-25T22:02:59.971 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.971 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.971 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:59.971 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:02:59.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:02:59.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108632+0000", 2024-04-25T22:02:59.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2699999999999999e-07 2024-04-25T22:02:59.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108647+0000", 2024-04-25T22:02:59.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4585e-05 2024-04-25T22:02:59.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108667+0000", 2024-04-25T22:02:59.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9887000000000001e-05 2024-04-25T22:02:59.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108680+0000", 2024-04-25T22:02:59.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3249e-05 2024-04-25T22:02:59.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109917+0000", 2024-04-25T22:02:59.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012367050000000001 2024-04-25T22:02:59.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109961+0000", 2024-04-25T22:02:59.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4029000000000001e-05 2024-04-25T22:02:59.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:59.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207351+0000", 2024-04-25T22:02:59.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.097390791000000004 2024-04-25T22:02:59.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207380+0000", 2024-04-25T22:02:59.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9037e-05 2024-04-25T22:02:59.975 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.975 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.975 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.976 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:8 4.3b e51/49 4:deccbd37:::100000001fe.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:02:59.976 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:02:59.976 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.7771136150000002, 2024-04-25T22:02:59.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090839771, 2024-04-25T22:02:59.976 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.976 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:59.976 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:02:59.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:02:59.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108697+0000", 2024-04-25T22:02:59.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1399999999999997e-07 2024-04-25T22:02:59.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108712+0000", 2024-04-25T22:02:59.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4772e-05 2024-04-25T22:02:59.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108728+0000", 2024-04-25T22:02:59.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5943e-05 2024-04-25T22:02:59.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108740+0000", 2024-04-25T22:02:59.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.235e-05 2024-04-25T22:02:59.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108797+0000", 2024-04-25T22:02:59.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6879000000000002e-05 2024-04-25T22:02:59.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108812+0000", 2024-04-25T22:02:59.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5268999999999999e-05 2024-04-25T22:02:59.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:59.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199495+0000", 2024-04-25T22:02:59.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090683071000000004 2024-04-25T22:02:59.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199536+0000", 2024-04-25T22:02:59.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0873e-05 2024-04-25T22:02:59.980 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.980 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.980 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.981 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:59 3.14 e52/15 3:2e2fa760:::200.00000001:head v 52'20, mlcod=51'18)", 2024-04-25T22:02:59.981 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:55.375543+0000", 2024-04-25T22:02:59.981 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.5102669569999998, 2024-04-25T22:02:59.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.036557824000000003, 2024-04-25T22:02:59.981 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.981 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:59.981 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.375543+0000", 2024-04-25T22:02:59.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.375543+0000", 2024-04-25T22:02:59.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.375544+0000", 2024-04-25T22:02:59.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2640000000000001e-06 2024-04-25T22:02:59.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377524+0000", 2024-04-25T22:02:59.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001980154 2024-04-25T22:02:59.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377551+0000", 2024-04-25T22:02:59.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6211999999999999e-05 2024-04-25T22:02:59.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377569+0000", 2024-04-25T22:02:59.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182e-05 2024-04-25T22:02:59.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377689+0000", 2024-04-25T22:02:59.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119973 2024-04-25T22:02:59.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377722+0000", 2024-04-25T22:02:59.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3113e-05 2024-04-25T22:02:59.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:59.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.412025+0000", 2024-04-25T22:02:59.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.034302721000000001 2024-04-25T22:02:59.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.412101+0000", 2024-04-25T22:02:59.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6205000000000006e-05 2024-04-25T22:02:59.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.985 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.986 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:2289 4.24 4:25fa82de:::10000000c45.00000000:head [write 0~72464] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-25T22:02:59.986 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:57.068683+0000", 2024-04-25T22:02:59.986 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 2.8171264369999998, 2024-04-25T22:02:59.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010459044000000001, 2024-04-25T22:02:59.986 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.986 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:59.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:02:59.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:02:59.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:02:59.986 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2289 2024-04-25T22:02:59.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.987 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.068683+0000", 2024-04-25T22:02:59.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.068683+0000", 2024-04-25T22:02:59.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.068686+0000", 2024-04-25T22:02:59.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6400000000000001e-06 2024-04-25T22:02:59.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.068939+0000", 2024-04-25T22:02:59.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025319300000000003 2024-04-25T22:02:59.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.068973+0000", 2024-04-25T22:02:59.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3843000000000001e-05 2024-04-25T22:02:59.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.068994+0000", 2024-04-25T22:02:59.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0842000000000001e-05 2024-04-25T22:02:59.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.069105+0000", 2024-04-25T22:02:59.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000111307 2024-04-25T22:02:59.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.069310+0000", 2024-04-25T22:02:59.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000204961 2024-04-25T22:02:59.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:02:59.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.069526+0000", 2024-04-25T22:02:59.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000215489 2024-04-25T22:02:59.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:02:59.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.075971+0000", 2024-04-25T22:02:59.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0064457230000000004 2024-04-25T22:02:59.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:02:59.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.078990+0000", 2024-04-25T22:02:59.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030187730000000002 2024-04-25T22:02:59.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:59.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.079072+0000", 2024-04-25T22:02:59.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1808e-05 2024-04-25T22:02:59.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.079142+0000", 2024-04-25T22:02:59.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0464999999999997e-05 2024-04-25T22:02:59.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.992 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.992 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:2291 4.32 e52/16 4:4ffda274:::10000000c47.00000000:head v 52'42, mlcod=52'40)", 2024-04-25T22:02:59.992 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:57.074116+0000", 2024-04-25T22:02:59.992 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 2.811694181, 2024-04-25T22:02:59.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017364083999999998, 2024-04-25T22:02:59.992 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.993 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:59.993 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074116+0000", 2024-04-25T22:02:59.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074116+0000", 2024-04-25T22:02:59.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074118+0000", 2024-04-25T22:02:59.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.903e-06 2024-04-25T22:02:59.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074223+0000", 2024-04-25T22:02:59.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105664 2024-04-25T22:02:59.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074251+0000", 2024-04-25T22:02:59.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8161999999999999e-05 2024-04-25T22:02:59.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:02:59.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074264+0000", 2024-04-25T22:02:59.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2989999999999999e-05 2024-04-25T22:02:59.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:02:59.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074390+0000", 2024-04-25T22:02:59.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012554600000000001 2024-04-25T22:02:59.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:02:59.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074451+0000", 2024-04-25T22:02:59.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1092000000000004e-05 2024-04-25T22:02:59.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:02:59.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.091406+0000", 2024-04-25T22:02:59.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016955409000000001 2024-04-25T22:02:59.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:02:59.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.091480+0000", 2024-04-25T22:02:59.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3318000000000005e-05 2024-04-25T22:02:59.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.997 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:02:59.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:02:59.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.997 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:2315 4.1f e52/49 4:f84a2a2d:::10000000c60.00000000:head v 52'42, mlcod=52'40)", 2024-04-25T22:02:59.997 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:57.112380+0000", 2024-04-25T22:02:59.997 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 2.7734303279999999, 2024-04-25T22:02:59.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.038962912000000002, 2024-04-25T22:02:59.997 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:02:59.997 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:02:59.998 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:02:59.998 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:02:59.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:02:59.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112380+0000", 2024-04-25T22:02:59.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:02:59.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112380+0000", 2024-04-25T22:02:59.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:02:59.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:02:59.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112381+0000", 2024-04-25T22:02:59.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:02:59.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:02:59.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112856+0000", 2024-04-25T22:02:59.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047428299999999999 2024-04-25T22:02:59.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:02:59.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:02:59.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:02:59.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112885+0000", 2024-04-25T22:03:00.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9019000000000001e-05 2024-04-25T22:03:00.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:00.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:00.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112898+0000", 2024-04-25T22:03:00.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:03:00.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:00.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:00.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:00.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.113041+0000", 2024-04-25T22:03:00.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014280599999999999 2024-04-25T22:03:00.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:00.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:00.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:00.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.113102+0000", 2024-04-25T22:03:00.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1495000000000007e-05 2024-04-25T22:03:00.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:00.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:00.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:00.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.151273+0000", 2024-04-25T22:03:00.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.038170444999999997 2024-04-25T22:03:00.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:00.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:00.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:00.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.151342+0000", 2024-04-25T22:03:00.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9861000000000001e-05 2024-04-25T22:03:00.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:00.002 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:00.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:00.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:00.002 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:00.002 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:00.004 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:00.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:00.001+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:00.075 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:03:00.075 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T22:03:00.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:00.101+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:00.154 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:00.154 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:00.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.154 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:3797 4.1d 4:bb5a6510:::1000000124c.00000000:head [write 0~2853 in=2853b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-25T22:03:00.154 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:00.151976+0000", 2024-04-25T22:03:00.154 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0016637430000000001, 2024-04-25T22:03:00.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00168228, 2024-04-25T22:03:00.154 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.154 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3797 2024-04-25T22:03:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.151976+0000", 2024-04-25T22:03:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.151976+0000", 2024-04-25T22:03:00.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.151977+0000", 2024-04-25T22:03:00.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7999999999999993e-07 2024-04-25T22:03:00.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.151981+0000", 2024-04-25T22:03:00.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8729999999999998e-06 2024-04-25T22:03:00.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.151991+0000", 2024-04-25T22:03:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9429999999999995e-06 2024-04-25T22:03:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.151997+0000", 2024-04-25T22:03:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5110000000000003e-06 2024-04-25T22:03:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.152124+0000", 2024-04-25T22:03:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012704799999999999 2024-04-25T22:03:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.152331+0000", 2024-04-25T22:03:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020689300000000001 2024-04-25T22:03:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.152519+0000", 2024-04-25T22:03:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018791399999999999 2024-04-25T22:03:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop_reply(client.4564.0:3797 4.1d e53/49)", 2024-04-25T22:03:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:00.153651+0000", 2024-04-25T22:03:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9999886, 2024-04-25T22:03:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6586999999999999e-05, 2024-04-25T22:03:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.153651+0000", 2024-04-25T22:03:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.153651+0000", 2024-04-25T22:03:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.153651+0000", 2024-04-25T22:03:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1799999999999995e-07 2024-04-25T22:03:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.153655+0000", 2024-04-25T22:03:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.597e-06 2024-04-25T22:03:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.153673+0000", 2024-04-25T22:03:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8275999999999999e-05 2024-04-25T22:03:00.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.153679+0000", 2024-04-25T22:03:00.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5130000000000004e-06 2024-04-25T22:03:00.161 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.161 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.161 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.161 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.161 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:03:00.161 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 2 2024-04-25T22:03:00.161 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:00.168 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:00.213 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:00.213+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:00.306 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:00.305+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:00.316 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:03:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:03:00.317 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:00.333 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:00.425 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:00.425+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:00.508 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:00.505+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:00.524 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:00.524 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:03:00.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:03:00.524 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:00.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.524 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:03:00.525 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:03:00.525 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 114.34285081100001, 2024-04-25T22:03:00.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:03:00.525 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.525 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.525 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.525 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:00.525 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:03:00.525 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:03:00.525 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:03:00.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.525 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:03:00.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:03:00.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:03:00.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:03:00.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:03:00.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:03:00.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:03:00.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:03:00.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:03:00.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:03:00.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:03:00.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:03:00.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:03:00.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:03:00.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:00.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:03:00.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:03:00.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:00.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:03:00.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:03:00.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:00.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:03:00.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:03:00.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:03:00.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:03:00.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:03:00.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:03:00.530 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.530 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.530 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.530 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:03:00.530 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:03:00.530 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 114.342593276, 2024-04-25T22:03:00.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028672070000000001, 2024-04-25T22:03:00.530 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.530 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.530 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.531 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:00.531 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:03:00.531 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:03:00.531 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 163 2024-04-25T22:03:00.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.531 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:03:00.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176457+0000", 2024-04-25T22:03:00.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176458+0000", 2024-04-25T22:03:00.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9299999999999996e-07 2024-04-25T22:03:00.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176465+0000", 2024-04-25T22:03:00.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.144e-06 2024-04-25T22:03:00.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176475+0000", 2024-04-25T22:03:00.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-25T22:03:00.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176482+0000", 2024-04-25T22:03:00.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4599999999999997e-06 2024-04-25T22:03:00.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.197941+0000", 2024-04-25T22:03:00.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021458914999999999 2024-04-25T22:03:00.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198197+0000", 2024-04-25T22:03:00.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256331 2024-04-25T22:03:00.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:00.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.198525+0000", 2024-04-25T22:03:00.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032814399999999999 2024-04-25T22:03:00.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:00.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204552+0000", 2024-04-25T22:03:00.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060267510000000003 2024-04-25T22:03:00.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:00.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205020+0000", 2024-04-25T22:03:00.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046757400000000001 2024-04-25T22:03:00.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205083+0000", 2024-04-25T22:03:00.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3532000000000001e-05 2024-04-25T22:03:00.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205130+0000", 2024-04-25T22:03:00.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6313000000000002e-05 2024-04-25T22:03:00.536 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.536 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.536 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.536 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:03:00.536 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:03:00.536 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 114.34253305999999, 2024-04-25T22:03:00.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:03:00.536 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.536 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.536 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.537 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:00.537 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:03:00.537 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:03:00.537 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:03:00.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.537 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:03:00.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:03:00.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:03:00.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:03:00.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:03:00.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:03:00.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:03:00.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:03:00.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:03:00.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:03:00.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:03:00.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:03:00.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:03:00.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:03:00.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:00.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:03:00.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:03:00.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:00.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:03:00.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:03:00.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:00.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:03:00.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:03:00.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:03:00.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:03:00.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:03:00.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:03:00.541 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.541 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.541 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.542 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:03:00.542 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:03:00.542 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 114.342343548, 2024-04-25T22:03:00.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:03:00.542 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.542 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.542 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.542 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:00.542 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:03:00.542 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:03:00.542 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:03:00.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.543 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:03:00.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:03:00.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:03:00.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:03:00.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:03:00.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:03:00.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:03:00.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:03:00.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:03:00.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:03:00.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:03:00.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:03:00.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:03:00.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:03:00.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:00.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:03:00.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:03:00.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:00.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:03:00.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:03:00.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:00.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:03:00.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:03:00.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:03:00.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:03:00.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:03:00.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:03:00.547 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.547 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.547 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.547 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:03:00.547 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:03:00.547 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 114.150478101, 2024-04-25T22:03:00.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:03:00.547 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.548 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.548 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.548 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:00.548 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:03:00.548 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:03:00.548 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:03:00.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.548 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:03:00.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:03:00.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:03:00.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:03:00.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:03:00.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:03:00.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:03:00.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:03:00.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:03:00.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:03:00.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:03:00.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:03:00.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:03:00.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:03:00.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:00.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:03:00.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:03:00.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:00.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:03:00.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:03:00.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:00.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:03:00.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:03:00.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:03:00.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:03:00.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:03:00.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:03:00.553 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.553 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.553 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.553 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T22:03:00.553 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:00.553 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.5352186040000007, 2024-04-25T22:03:00.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.180276931, 2024-04-25T22:03:00.553 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.553 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.553 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.553 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:00.553 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:00.553 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:00.554 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4 2024-04-25T22:03:00.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.554 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:00.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:00.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983834+0000", 2024-04-25T22:03:00.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2900000000000001e-06 2024-04-25T22:03:00.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991787+0000", 2024-04-25T22:03:00.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079521690000000003 2024-04-25T22:03:00.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991826+0000", 2024-04-25T22:03:00.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9258999999999998e-05 2024-04-25T22:03:00.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991845+0000", 2024-04-25T22:03:00.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9360000000000001e-05 2024-04-25T22:03:00.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992058+0000", 2024-04-25T22:03:00.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212559 2024-04-25T22:03:00.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992213+0000", 2024-04-25T22:03:00.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015520700000000001 2024-04-25T22:03:00.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:00.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992414+0000", 2024-04-25T22:03:00.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020049 2024-04-25T22:03:00.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:00.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162511+0000", 2024-04-25T22:03:00.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.17009782900000001 2024-04-25T22:03:00.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:00.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163967+0000", 2024-04-25T22:03:00.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001455752 2024-04-25T22:03:00.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164045+0000", 2024-04-25T22:03:00.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7415000000000003e-05 2024-04-25T22:03:00.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164109+0000", 2024-04-25T22:03:00.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4601e-05 2024-04-25T22:03:00.558 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.558 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.558 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.558 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:00.558 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:00.559 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.4357604560000006, 2024-04-25T22:03:00.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.12612672599999999, 2024-04-25T22:03:00.559 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.559 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.559 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.559 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:00.559 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:00.559 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:00.559 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2024-04-25T22:03:00.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.559 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:00.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:00.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083293+0000", 2024-04-25T22:03:00.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6630000000000002e-06 2024-04-25T22:03:00.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086619+0000", 2024-04-25T22:03:00.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033261699999999998 2024-04-25T22:03:00.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086647+0000", 2024-04-25T22:03:00.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8085999999999998e-05 2024-04-25T22:03:00.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086665+0000", 2024-04-25T22:03:00.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:03:00.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086870+0000", 2024-04-25T22:03:00.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020488599999999999 2024-04-25T22:03:00.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087110+0000", 2024-04-25T22:03:00.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024093199999999999 2024-04-25T22:03:00.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:00.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087310+0000", 2024-04-25T22:03:00.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000199936 2024-04-25T22:03:00.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:00.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207766+0000", 2024-04-25T22:03:00.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.120456035 2024-04-25T22:03:00.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:00.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209358+0000", 2024-04-25T22:03:00.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015912369999999999 2024-04-25T22:03:00.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209390+0000", 2024-04-25T22:03:00.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2434999999999997e-05 2024-04-25T22:03:00.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209417+0000", 2024-04-25T22:03:00.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6936000000000001e-05 2024-04-25T22:03:00.564 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.564 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.564 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.564 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop_reply(client.4564.0:4 4.32 e51/16 ondisk, result = 0)", 2024-04-25T22:03:00.564 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.102726+0000", 2024-04-25T22:03:00.564 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.4163249219999994, 2024-04-25T22:03:00.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059798849000000001, 2024-04-25T22:03:00.564 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.564 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.565 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-25T22:03:00.565 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102726+0000", 2024-04-25T22:03:00.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102726+0000", 2024-04-25T22:03:00.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102727+0000", 2024-04-25T22:03:00.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7800000000000001e-07 2024-04-25T22:03:00.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102732+0000", 2024-04-25T22:03:00.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9389999999999996e-06 2024-04-25T22:03:00.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102747+0000", 2024-04-25T22:03:00.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5554e-05 2024-04-25T22:03:00.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102755+0000", 2024-04-25T22:03:00.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1599999999999998e-06 2024-04-25T22:03:00.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162489+0000", 2024-04-25T22:03:00.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059734204999999999 2024-04-25T22:03:00.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162501+0000", 2024-04-25T22:03:00.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1775e-05 2024-04-25T22:03:00.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162525+0000", 2024-04-25T22:03:00.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3438000000000002e-05 2024-04-25T22:03:00.568 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.568 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.568 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.568 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:00.568 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.111321+0000", 2024-04-25T22:03:00.568 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.4077293290000004, 2024-04-25T22:03:00.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.053212803000000003, 2024-04-25T22:03:00.568 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.568 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.568 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.569 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:00.569 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:00.569 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:00.569 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 19 2024-04-25T22:03:00.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.569 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111321+0000", 2024-04-25T22:03:00.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111321+0000", 2024-04-25T22:03:00.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111323+0000", 2024-04-25T22:03:00.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9759999999999998e-06 2024-04-25T22:03:00.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111334+0000", 2024-04-25T22:03:00.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.049e-05 2024-04-25T22:03:00.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111359+0000", 2024-04-25T22:03:00.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.495e-05 2024-04-25T22:03:00.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111380+0000", 2024-04-25T22:03:00.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1063000000000001e-05 2024-04-25T22:03:00.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162572+0000", 2024-04-25T22:03:00.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.051191677999999997 2024-04-25T22:03:00.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162760+0000", 2024-04-25T22:03:00.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018837500000000001 2024-04-25T22:03:00.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:00.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162962+0000", 2024-04-25T22:03:00.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020174200000000001 2024-04-25T22:03:00.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:00.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164379+0000", 2024-04-25T22:03:00.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001416856 2024-04-25T22:03:00.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:00.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164402+0000", 2024-04-25T22:03:00.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3734e-05 2024-04-25T22:03:00.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164474+0000", 2024-04-25T22:03:00.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1422999999999997e-05 2024-04-25T22:03:00.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164534+0000", 2024-04-25T22:03:00.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0516000000000001e-05 2024-04-25T22:03:00.573 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.573 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.574 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.574 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:24 4.b e51/16 4:d3eda40d:::1000000020f.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:00.574 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.119033+0000", 2024-04-25T22:03:00.574 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.4000174530000002, 2024-04-25T22:03:00.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088682448999999997, 2024-04-25T22:03:00.574 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.574 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.574 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.574 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119033+0000", 2024-04-25T22:03:00.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119033+0000", 2024-04-25T22:03:00.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119035+0000", 2024-04-25T22:03:00.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:03:00.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119044+0000", 2024-04-25T22:03:00.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0860000000000008e-06 2024-04-25T22:03:00.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119068+0000", 2024-04-25T22:03:00.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4037e-05 2024-04-25T22:03:00.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119080+0000", 2024-04-25T22:03:00.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2322e-05 2024-04-25T22:03:00.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119203+0000", 2024-04-25T22:03:00.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012249799999999999 2024-04-25T22:03:00.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119253+0000", 2024-04-25T22:03:00.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0148999999999997e-05 2024-04-25T22:03:00.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207679+0000", 2024-04-25T22:03:00.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088425928000000001 2024-04-25T22:03:00.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207716+0000", 2024-04-25T22:03:00.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7048999999999997e-05 2024-04-25T22:03:00.578 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.578 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.578 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.578 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:27 4.13 4:cbcb6224:::10000000212.00000000:head [write 0~3719] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:00.578 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.122624+0000", 2024-04-25T22:03:00.578 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.3964265600000001, 2024-04-25T22:03:00.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087419288999999997, 2024-04-25T22:03:00.578 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.578 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.578 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.579 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:00.579 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:00.579 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:00.579 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 27 2024-04-25T22:03:00.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.579 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122624+0000", 2024-04-25T22:03:00.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122624+0000", 2024-04-25T22:03:00.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122625+0000", 2024-04-25T22:03:00.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.181e-06 2024-04-25T22:03:00.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122632+0000", 2024-04-25T22:03:00.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8279999999999997e-06 2024-04-25T22:03:00.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122647+0000", 2024-04-25T22:03:00.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4398e-05 2024-04-25T22:03:00.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122657+0000", 2024-04-25T22:03:00.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0662999999999999e-05 2024-04-25T22:03:00.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.206922+0000", 2024-04-25T22:03:00.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084264247 2024-04-25T22:03:00.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207073+0000", 2024-04-25T22:03:00.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015129499999999999 2024-04-25T22:03:00.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:00.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207227+0000", 2024-04-25T22:03:00.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000153819 2024-04-25T22:03:00.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:00.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209429+0000", 2024-04-25T22:03:00.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022023899999999998 2024-04-25T22:03:00.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:00.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209971+0000", 2024-04-25T22:03:00.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00054203900000000002 2024-04-25T22:03:00.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210004+0000", 2024-04-25T22:03:00.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2468999999999997e-05 2024-04-25T22:03:00.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210044+0000", 2024-04-25T22:03:00.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9959999999999997e-05 2024-04-25T22:03:00.583 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.583 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.583 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.583 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:00.583 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.124053+0000", 2024-04-25T22:03:00.584 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.3949974469999997, 2024-04-25T22:03:00.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.040913613000000001, 2024-04-25T22:03:00.584 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.584 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.584 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.584 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:00.584 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:00.584 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:00.584 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 28 2024-04-25T22:03:00.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.584 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124053+0000", 2024-04-25T22:03:00.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124053+0000", 2024-04-25T22:03:00.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124054+0000", 2024-04-25T22:03:00.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8200000000000008e-07 2024-04-25T22:03:00.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124060+0000", 2024-04-25T22:03:00.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6879999999999996e-06 2024-04-25T22:03:00.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124073+0000", 2024-04-25T22:03:00.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3113e-05 2024-04-25T22:03:00.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124081+0000", 2024-04-25T22:03:00.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4959999999999999e-06 2024-04-25T22:03:00.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163657+0000", 2024-04-25T22:03:00.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.039576014 2024-04-25T22:03:00.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163775+0000", 2024-04-25T22:03:00.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011861100000000001 2024-04-25T22:03:00.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:00.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163907+0000", 2024-04-25T22:03:00.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013217599999999999 2024-04-25T22:03:00.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:00.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164803+0000", 2024-04-25T22:03:00.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000895801 2024-04-25T22:03:00.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:00.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164825+0000", 2024-04-25T22:03:00.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1339e-05 2024-04-25T22:03:00.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164906+0000", 2024-04-25T22:03:00.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.119e-05 2024-04-25T22:03:00.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164967+0000", 2024-04-25T22:03:00.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1203000000000003e-05 2024-04-25T22:03:00.589 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.589 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.589 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.589 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:32 4.b e51/16 4:d2dbd4ac:::10000000217.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:03:00.589 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.130764+0000", 2024-04-25T22:03:00.589 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.3882867080000008, 2024-04-25T22:03:00.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.07870402, 2024-04-25T22:03:00.590 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.590 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.590 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.590 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130764+0000", 2024-04-25T22:03:00.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130764+0000", 2024-04-25T22:03:00.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130766+0000", 2024-04-25T22:03:00.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6270000000000001e-06 2024-04-25T22:03:00.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130777+0000", 2024-04-25T22:03:00.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1799e-05 2024-04-25T22:03:00.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130805+0000", 2024-04-25T22:03:00.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7036999999999999e-05 2024-04-25T22:03:00.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130817+0000", 2024-04-25T22:03:00.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2856e-05 2024-04-25T22:03:00.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.206926+0000", 2024-04-25T22:03:00.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.076108517000000001 2024-04-25T22:03:00.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207009+0000", 2024-04-25T22:03:00.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.276e-05 2024-04-25T22:03:00.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209432+0000", 2024-04-25T22:03:00.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024229830000000001 2024-04-25T22:03:00.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209468+0000", 2024-04-25T22:03:00.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6440999999999999e-05 2024-04-25T22:03:00.593 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.593 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.593 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.594 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:46 4.b e51/16 4:d0d26e50:::10000000225.00000000:head v 51'3, mlcod=0'0)", 2024-04-25T22:03:00.594 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:03:00.594 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.3682311929999997, 2024-04-25T22:03:00.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.058683655000000001, 2024-04-25T22:03:00.594 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.594 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.594 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.594 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:03:00.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:03:00.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:03:00.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7499999999999999e-07 2024-04-25T22:03:00.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150827+0000", 2024-04-25T22:03:00.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.64e-06 2024-04-25T22:03:00.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150841+0000", 2024-04-25T22:03:00.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3895e-05 2024-04-25T22:03:00.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150849+0000", 2024-04-25T22:03:00.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5310000000000004e-06 2024-04-25T22:03:00.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207762+0000", 2024-04-25T22:03:00.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.056913380999999999 2024-04-25T22:03:00.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207782+0000", 2024-04-25T22:03:00.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0026000000000001e-05 2024-04-25T22:03:00.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209471+0000", 2024-04-25T22:03:00.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016892020000000001 2024-04-25T22:03:00.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209503+0000", 2024-04-25T22:03:00.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2104999999999998e-05 2024-04-25T22:03:00.598 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.598 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.598 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.598 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:54 4.2b 4:d5ee56ee:::1000000022d.00000000:head [write 0~3953] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:00.598 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.162091+0000", 2024-04-25T22:03:00.598 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.3569602340000007, 2024-04-25T22:03:00.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.048184338, 2024-04-25T22:03:00.598 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.598 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.598 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.598 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:00.598 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:00.599 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:00.599 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54 2024-04-25T22:03:00.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.599 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162091+0000", 2024-04-25T22:03:00.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162091+0000", 2024-04-25T22:03:00.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162092+0000", 2024-04-25T22:03:00.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.175e-06 2024-04-25T22:03:00.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162102+0000", 2024-04-25T22:03:00.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0012e-05 2024-04-25T22:03:00.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162117+0000", 2024-04-25T22:03:00.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5443000000000001e-05 2024-04-25T22:03:00.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162126+0000", 2024-04-25T22:03:00.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1840000000000005e-06 2024-04-25T22:03:00.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207805+0000", 2024-04-25T22:03:00.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.045678641999999998 2024-04-25T22:03:00.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207941+0000", 2024-04-25T22:03:00.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000135983 2024-04-25T22:03:00.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:00.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.208119+0000", 2024-04-25T22:03:00.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017767099999999999 2024-04-25T22:03:00.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:00.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209511+0000", 2024-04-25T22:03:00.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001392304 2024-04-25T22:03:00.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:00.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210222+0000", 2024-04-25T22:03:00.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00071096500000000003 2024-04-25T22:03:00.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210250+0000", 2024-04-25T22:03:00.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8004000000000002e-05 2024-04-25T22:03:00.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210275+0000", 2024-04-25T22:03:00.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4955000000000001e-05 2024-04-25T22:03:00.603 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.603 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.603 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.603 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:00.603 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.201108+0000", 2024-04-25T22:03:00.603 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.3179432270000007, 2024-04-25T22:03:00.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088952635000000002, 2024-04-25T22:03:00.604 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.604 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.604 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.604 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:00.604 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:00.604 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:00.604 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 77 2024-04-25T22:03:00.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.604 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201108+0000", 2024-04-25T22:03:00.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201108+0000", 2024-04-25T22:03:00.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201109+0000", 2024-04-25T22:03:00.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2160000000000001e-06 2024-04-25T22:03:00.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201116+0000", 2024-04-25T22:03:00.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9979999999999997e-06 2024-04-25T22:03:00.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201133+0000", 2024-04-25T22:03:00.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.753e-05 2024-04-25T22:03:00.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201156+0000", 2024-04-25T22:03:00.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2558999999999999e-05 2024-04-25T22:03:00.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201216+0000", 2024-04-25T22:03:00.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9741000000000003e-05 2024-04-25T22:03:00.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201307+0000", 2024-04-25T22:03:00.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1314e-05 2024-04-25T22:03:00.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:00.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201395+0000", 2024-04-25T22:03:00.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8460000000000003e-05 2024-04-25T22:03:00.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:00.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.202212+0000", 2024-04-25T22:03:00.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000816923 2024-04-25T22:03:00.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:00.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.289754+0000", 2024-04-25T22:03:00.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087541315999999994 2024-04-25T22:03:00.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.289931+0000", 2024-04-25T22:03:00.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017723700000000001 2024-04-25T22:03:00.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290060+0000", 2024-04-25T22:03:00.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012934099999999999 2024-04-25T22:03:00.608 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.609 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.609 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.609 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:00.609 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.224278+0000", 2024-04-25T22:03:00.609 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.2947725390000002, 2024-04-25T22:03:00.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.066143380000000002, 2024-04-25T22:03:00.609 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.609 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.609 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.609 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:00.609 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:00.609 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:00.609 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 89 2024-04-25T22:03:00.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.610 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224278+0000", 2024-04-25T22:03:00.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224278+0000", 2024-04-25T22:03:00.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224279+0000", 2024-04-25T22:03:00.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.248e-06 2024-04-25T22:03:00.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224286+0000", 2024-04-25T22:03:00.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4799999999999998e-06 2024-04-25T22:03:00.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224300+0000", 2024-04-25T22:03:00.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4275e-05 2024-04-25T22:03:00.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224311+0000", 2024-04-25T22:03:00.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1182999999999999e-05 2024-04-25T22:03:00.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224396+0000", 2024-04-25T22:03:00.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4901999999999995e-05 2024-04-25T22:03:00.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224561+0000", 2024-04-25T22:03:00.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016465699999999999 2024-04-25T22:03:00.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:00.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224734+0000", 2024-04-25T22:03:00.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017334800000000001 2024-04-25T22:03:00.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:00.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.225929+0000", 2024-04-25T22:03:00.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001194575 2024-04-25T22:03:00.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:00.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290179+0000", 2024-04-25T22:03:00.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064250242999999999 2024-04-25T22:03:00.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290329+0000", 2024-04-25T22:03:00.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014964700000000001 2024-04-25T22:03:00.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290422+0000", 2024-04-25T22:03:00.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2822e-05 2024-04-25T22:03:00.614 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.614 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.614 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.614 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:59 3.14 3:2e2fa760:::200.00000001:head [write 2774296~1300645 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-25T22:03:00.614 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:55.373674+0000", 2024-04-25T22:03:00.614 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.1453772139999998, 2024-04-25T22:03:00.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.039145353000000001, 2024-04-25T22:03:00.615 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.615 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.615 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.615 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.373674+0000", 2024-04-25T22:03:00.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.373674+0000", 2024-04-25T22:03:00.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.373676+0000", 2024-04-25T22:03:00.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0729999999999999e-06 2024-04-25T22:03:00.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375383+0000", 2024-04-25T22:03:00.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017077469999999999 2024-04-25T22:03:00.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375414+0000", 2024-04-25T22:03:00.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0661999999999999e-05 2024-04-25T22:03:00.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375438+0000", 2024-04-25T22:03:00.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4332999999999999e-05 2024-04-25T22:03:00.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375513+0000", 2024-04-25T22:03:00.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4562999999999997e-05 2024-04-25T22:03:00.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375569+0000", 2024-04-25T22:03:00.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6286000000000003e-05 2024-04-25T22:03:00.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:00.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375651+0000", 2024-04-25T22:03:00.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2149000000000002e-05 2024-04-25T22:03:00.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:00.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.389672+0000", 2024-04-25T22:03:00.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014020886999999999 2024-04-25T22:03:00.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:00.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.412742+0000", 2024-04-25T22:03:00.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023070100999999999 2024-04-25T22:03:00.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.412784+0000", 2024-04-25T22:03:00.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1925999999999998e-05 2024-04-25T22:03:00.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.412819+0000", 2024-04-25T22:03:00.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4625999999999997e-05 2024-04-25T22:03:00.619 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.619 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.619 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.620 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:2315 4.1f 4:f84a2a2d:::10000000c60.00000000:head [write 0~648229] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-25T22:03:00.620 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:57.110762+0000", 2024-04-25T22:03:00.620 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.4082886729999999, 2024-04-25T22:03:00.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.041428231000000003, 2024-04-25T22:03:00.620 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.620 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.620 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.620 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:00.620 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:00.620 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:00.620 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2315 2024-04-25T22:03:00.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.620 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.110762+0000", 2024-04-25T22:03:00.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.110762+0000", 2024-04-25T22:03:00.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.110764+0000", 2024-04-25T22:03:00.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5460000000000001e-06 2024-04-25T22:03:00.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.111342+0000", 2024-04-25T22:03:00.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057855899999999997 2024-04-25T22:03:00.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.111364+0000", 2024-04-25T22:03:00.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1810999999999998e-05 2024-04-25T22:03:00.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.111376+0000", 2024-04-25T22:03:00.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.165e-05 2024-04-25T22:03:00.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.111533+0000", 2024-04-25T22:03:00.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156902 2024-04-25T22:03:00.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.111910+0000", 2024-04-25T22:03:00.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037699000000000001 2024-04-25T22:03:00.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:00.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.112294+0000", 2024-04-25T22:03:00.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038433899999999998 2024-04-25T22:03:00.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:00.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.150695+0000", 2024-04-25T22:03:00.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.038401063999999999 2024-04-25T22:03:00.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:00.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.151992+0000", 2024-04-25T22:03:00.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012968529999999999 2024-04-25T22:03:00.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.152082+0000", 2024-04-25T22:03:00.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0645999999999999e-05 2024-04-25T22:03:00.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.152190+0000", 2024-04-25T22:03:00.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000107871 2024-04-25T22:03:00.625 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.625 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.625 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.625 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:71 3.b e53/15 3:d5c7a900:::200.00000003:head v 53'3, mlcod=17'1)", 2024-04-25T22:03:00.625 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:59.679079+0000", 2024-04-25T22:03:00.625 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.83997131899999999, 2024-04-25T22:03:00.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.035071150000000002, 2024-04-25T22:03:00.625 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:00.625 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:00.625 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:00.625 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:00.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:00.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.679079+0000", 2024-04-25T22:03:00.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:00.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.679079+0000", 2024-04-25T22:03:00.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:00.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:00.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.679081+0000", 2024-04-25T22:03:00.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.753e-06 2024-04-25T22:03:00.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:00.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.681130+0000", 2024-04-25T22:03:00.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002049057 2024-04-25T22:03:00.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:00.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.681176+0000", 2024-04-25T22:03:00.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6211999999999997e-05 2024-04-25T22:03:00.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.681190+0000", 2024-04-25T22:03:00.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.307e-05 2024-04-25T22:03:00.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:00.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.681326+0000", 2024-04-25T22:03:00.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013620799999999999 2024-04-25T22:03:00.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:00.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.681381+0000", 2024-04-25T22:03:00.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5402999999999998e-05 2024-04-25T22:03:00.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:00.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.714026+0000", 2024-04-25T22:03:00.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.032645242999999997 2024-04-25T22:03:00.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:00.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:00.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:00.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.714151+0000", 2024-04-25T22:03:00.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012420399999999999 2024-04-25T22:03:00.629 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.629 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.629 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.629 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:00.629 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:00.629 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:00.631 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:00.631 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:00.629+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:00.662 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-25T22:03:00.663 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T22:03:00.691 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T22:03:00.731 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:00.729+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:00.774 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:00.774 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:00.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:00.774 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:4199 4.19 4:9ab07188:::100000013ee.00000000:head [write 0~575 in=575b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-25T22:03:00.774 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:00.774001+0000", 2024-04-25T22:03:00.775 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00043219999999999999, 2024-04-25T22:03:00.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049815600000000003, 2024-04-25T22:03:00.775 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:00.775 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:00.775 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:03:00.775 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:00.775 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:00.775 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:00.775 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4199 2024-04-25T22:03:00.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:00.775 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:00.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:00.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:00.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.774001+0000", 2024-04-25T22:03:00.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:00.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:00.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:00.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:00.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.774001+0000", 2024-04-25T22:03:00.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:00.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:00.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:00.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:00.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.774003+0000", 2024-04-25T22:03:00.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0729999999999999e-06 2024-04-25T22:03:00.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:00.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:00.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:00.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.774014+0000", 2024-04-25T22:03:00.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0815999999999999e-05 2024-04-25T22:03:00.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:00.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:00.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:00.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.774039+0000", 2024-04-25T22:03:00.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4867000000000001e-05 2024-04-25T22:03:00.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:00.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:00.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:00.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.774052+0000", 2024-04-25T22:03:00.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3682e-05 2024-04-25T22:03:00.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:00.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:00.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:00.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.774166+0000", 2024-04-25T22:03:00.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000114212 2024-04-25T22:03:00.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:00.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:00.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:00.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.774362+0000", 2024-04-25T22:03:00.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195575 2024-04-25T22:03:00.778 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:00.778 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:00.779 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:00.779 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:00.779 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-04-25T22:03:00.779 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 1 2024-04-25T22:03:00.779 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:00.789 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:00.832 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:00.829+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:00.921 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:00.921 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:00.921 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:03:00.921 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:03:00.921 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:00.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:00.929+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:00.937 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:01.033 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:01.029+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:01.117 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:01.118 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:01.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:01.118 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:01.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.118 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:01.118 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:01.118 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0297432020000006, 2024-04-25T22:03:01.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:01.118 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.118 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.119 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.119 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:01.119 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:01.119 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:01.119 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:01.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.120 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:01.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:01.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:01.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:01.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:01.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:01.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:01.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:01.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:01.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:01.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:01.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:01.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:01.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:01.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:01.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:01.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:01.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:01.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:01.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:01.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:01.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:01.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:01.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:01.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:01.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:01.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:01.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:01.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:01.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:01.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:01.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:01.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.127 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.127 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:01.127 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:01.127 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0197424389999998, 2024-04-25T22:03:01.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:01.127 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.127 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.127 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.128 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:01.128 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:01.128 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:01.128 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:01.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.128 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:01.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:01.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:01.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:01.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:01.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:01.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:01.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:01.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:01.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:01.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:01.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:01.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:01.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:01.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:01.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:01.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:01.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:01.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:01.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:01.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:01.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:01.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:01.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:01.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:01.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:01.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:01.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:01.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:01.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:01.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:01.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:01.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.134 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.134 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.134 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:01.134 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:01.135 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0155781650000009, 2024-04-25T22:03:01.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:01.135 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.135 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.135 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.135 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:01.136 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:01.136 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:01.136 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:01.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.136 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:01.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:01.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:01.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:01.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:01.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:01.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:01.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:01.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:01.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:01.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:01.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:01.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:01.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:01.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:01.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:01.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:01.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:01.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:01.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:01.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:01.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:01.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:01.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:01.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:01.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:01.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:01.146 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.146 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.147 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.147 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:01.147 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:01.147 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0139818480000002, 2024-04-25T22:03:01.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:01.148 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.148 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.148 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.148 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:01.148 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:01.149 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:01.149 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:01.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.149 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:01.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:01.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:01.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:01.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:01.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:01.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:01.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:01.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:01.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:01.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:01.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:01.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:01.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:01.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:01.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:01.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:01.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:01.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:01.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:01.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:01.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:01.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:01.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:01.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:01.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:01.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:01.160 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.160 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.160 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.161 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:24 4.b 4:d3eda40d:::1000000020f.00000000:head [write 0~1144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:01.161 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.118844+0000", 2024-04-25T22:03:01.161 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.9964439949999999, 2024-04-25T22:03:01.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.089959257000000001, 2024-04-25T22:03:01.161 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.162 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.162 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.162 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:01.162 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:01.162 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:01.162 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 24 2024-04-25T22:03:01.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.163 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118844+0000", 2024-04-25T22:03:01.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118844+0000", 2024-04-25T22:03:01.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118846+0000", 2024-04-25T22:03:01.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:03:01.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118855+0000", 2024-04-25T22:03:01.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2930000000000006e-06 2024-04-25T22:03:01.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118879+0000", 2024-04-25T22:03:01.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3312999999999999e-05 2024-04-25T22:03:01.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118891+0000", 2024-04-25T22:03:01.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2136e-05 2024-04-25T22:03:01.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118997+0000", 2024-04-25T22:03:01.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010655800000000001 2024-04-25T22:03:01.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.119214+0000", 2024-04-25T22:03:01.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021723099999999999 2024-04-25T22:03:01.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:01.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.119408+0000", 2024-04-25T22:03:01.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000193582 2024-04-25T22:03:01.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:01.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.121105+0000", 2024-04-25T22:03:01.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016972549999999999 2024-04-25T22:03:01.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208552+0000", 2024-04-25T22:03:01.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087447104999999997 2024-04-25T22:03:01.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:01.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208688+0000", 2024-04-25T22:03:01.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000135394 2024-04-25T22:03:01.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208803+0000", 2024-04-25T22:03:01.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011557000000000001 2024-04-25T22:03:01.170 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.170 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.170 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.171 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:32 4.b 4:d2dbd4ac:::10000000217.00000000:head [write 0~1921] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:01.171 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.130139+0000", 2024-04-25T22:03:01.171 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.9851488540000002, 2024-04-25T22:03:01.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.080213211000000006, 2024-04-25T22:03:01.171 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.171 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.171 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.171 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:01.171 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:01.171 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:01.171 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 32 2024-04-25T22:03:01.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.171 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130139+0000", 2024-04-25T22:03:01.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130139+0000", 2024-04-25T22:03:01.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130141+0000", 2024-04-25T22:03:01.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.243e-06 2024-04-25T22:03:01.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130153+0000", 2024-04-25T22:03:01.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1994000000000001e-05 2024-04-25T22:03:01.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130185+0000", 2024-04-25T22:03:01.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1201999999999997e-05 2024-04-25T22:03:01.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130201+0000", 2024-04-25T22:03:01.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.605e-05 2024-04-25T22:03:01.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130348+0000", 2024-04-25T22:03:01.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014707300000000001 2024-04-25T22:03:01.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130696+0000", 2024-04-25T22:03:01.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034790800000000002 2024-04-25T22:03:01.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:01.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.131078+0000", 2024-04-25T22:03:01.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038188399999999998 2024-04-25T22:03:01.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:01.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.132597+0000", 2024-04-25T22:03:01.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001519252 2024-04-25T22:03:01.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210220+0000", 2024-04-25T22:03:01.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.077623485000000006 2024-04-25T22:03:01.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:01.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210294+0000", 2024-04-25T22:03:01.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3444999999999999e-05 2024-04-25T22:03:01.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210352+0000", 2024-04-25T22:03:01.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8675000000000003e-05 2024-04-25T22:03:01.176 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.176 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.176 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.177 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:46 4.b 4:d0d26e50:::10000000225.00000000:head [write 0~1224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:01.177 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.150212+0000", 2024-04-25T22:03:01.177 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.9650756499999993, 2024-04-25T22:03:01.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060337512000000003, 2024-04-25T22:03:01.177 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.177 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.177 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.177 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:01.177 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:01.177 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:01.177 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46 2024-04-25T22:03:01.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.177 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150212+0000", 2024-04-25T22:03:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150212+0000", 2024-04-25T22:03:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150215+0000", 2024-04-25T22:03:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4229999999999999e-06 2024-04-25T22:03:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150229+0000", 2024-04-25T22:03:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4059999999999999e-05 2024-04-25T22:03:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150255+0000", 2024-04-25T22:03:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5795999999999998e-05 2024-04-25T22:03:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150277+0000", 2024-04-25T22:03:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2682999999999999e-05 2024-04-25T22:03:01.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150409+0000", 2024-04-25T22:03:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013196599999999999 2024-04-25T22:03:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150771+0000", 2024-04-25T22:03:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000361245 2024-04-25T22:03:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.151146+0000", 2024-04-25T22:03:01.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000375044 2024-04-25T22:03:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.155311+0000", 2024-04-25T22:03:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041656599999999998 2024-04-25T22:03:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210420+0000", 2024-04-25T22:03:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055108428000000001 2024-04-25T22:03:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210493+0000", 2024-04-25T22:03:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3155e-05 2024-04-25T22:03:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210550+0000", 2024-04-25T22:03:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7052000000000002e-05 2024-04-25T22:03:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.9571955980000002, 2024-04-25T22:03:01.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:01.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:01.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:01.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:01.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.9415513319999995, 2024-04-25T22:03:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:01.188 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:01.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:01.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:01.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.9367126409999997, 2024-04-25T22:03:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.194 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:01.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:01.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:01.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.9233955569999992, 2024-04-25T22:03:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.098402492999999994, 2024-04-25T22:03:01.199 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71 2024-04-25T22:03:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191895+0000", 2024-04-25T22:03:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0899999999999999e-06 2024-04-25T22:03:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191906+0000", 2024-04-25T22:03:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1508999999999999e-05 2024-04-25T22:03:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191937+0000", 2024-04-25T22:03:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0772999999999998e-05 2024-04-25T22:03:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191951+0000", 2024-04-25T22:03:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.437e-05 2024-04-25T22:03:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286217+0000", 2024-04-25T22:03:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.094265989999999994 2024-04-25T22:03:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286383+0000", 2024-04-25T22:03:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016591899999999999 2024-04-25T22:03:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286594+0000", 2024-04-25T22:03:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021108800000000001 2024-04-25T22:03:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.288518+0000", 2024-04-25T22:03:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001923391 2024-04-25T22:03:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290219+0000", 2024-04-25T22:03:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001701239 2024-04-25T22:03:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290266+0000", 2024-04-25T22:03:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6838000000000001e-05 2024-04-25T22:03:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290295+0000", 2024-04-25T22:03:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9286e-05 2024-04-25T22:03:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.204 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4564.0:77 4.30 e51/16 4:0c28cce1:::10000000244.00000000:head v 51'3, mlcod=51'1)", 2024-04-25T22:03:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.202141+0000", 2024-04-25T22:03:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.9131470400000001, 2024-04-25T22:03:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087897668999999998, 2024-04-25T22:03:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.202141+0000", 2024-04-25T22:03:01.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.202141+0000", 2024-04-25T22:03:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.202143+0000", 2024-04-25T22:03:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.477e-06 2024-04-25T22:03:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.202153+0000", 2024-04-25T22:03:01.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0599e-05 2024-04-25T22:03:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.202172+0000", 2024-04-25T22:03:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9113000000000001e-05 2024-04-25T22:03:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.202184+0000", 2024-04-25T22:03:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.147e-05 2024-04-25T22:03:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284532+0000", 2024-04-25T22:03:01.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.082347907999999997 2024-04-25T22:03:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284545+0000", 2024-04-25T22:03:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3825999999999999e-05 2024-04-25T22:03:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290013+0000", 2024-04-25T22:03:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054677249999999997 2024-04-25T22:03:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290039+0000", 2024-04-25T22:03:01.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5551e-05 2024-04-25T22:03:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4564.0:11 4.28 e51/49 ondisk, result = 0)", 2024-04-25T22:03:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.208333+0000", 2024-04-25T22:03:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.9069552329999997, 2024-04-25T22:03:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076582211999999997, 2024-04-25T22:03:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:03:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208333+0000", 2024-04-25T22:03:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208333+0000", 2024-04-25T22:03:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208335+0000", 2024-04-25T22:03:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.827e-06 2024-04-25T22:03:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208344+0000", 2024-04-25T22:03:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2690000000000005e-06 2024-04-25T22:03:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208367+0000", 2024-04-25T22:03:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.281e-05 2024-04-25T22:03:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208399+0000", 2024-04-25T22:03:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2085999999999997e-05 2024-04-25T22:03:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284794+0000", 2024-04-25T22:03:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076394869000000004 2024-04-25T22:03:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284806+0000", 2024-04-25T22:03:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1804000000000001e-05 2024-04-25T22:03:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284915+0000", 2024-04-25T22:03:01.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109547 2024-04-25T22:03:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4564.0:12 4.28 e51/49 ondisk, result = 0)", 2024-04-25T22:03:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.208427+0000", 2024-04-25T22:03:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.9068606250000002, 2024-04-25T22:03:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076675030000000005, 2024-04-25T22:03:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:03:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208427+0000", 2024-04-25T22:03:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208427+0000", 2024-04-25T22:03:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208428+0000", 2024-04-25T22:03:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8599999999999996e-07 2024-04-25T22:03:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208434+0000", 2024-04-25T22:03:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2270000000000001e-06 2024-04-25T22:03:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208452+0000", 2024-04-25T22:03:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8275999999999999e-05 2024-04-25T22:03:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208466+0000", 2024-04-25T22:03:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-04-25T22:03:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284953+0000", 2024-04-25T22:03:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076487148000000005 2024-04-25T22:03:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284974+0000", 2024-04-25T22:03:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1217999999999999e-05 2024-04-25T22:03:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285102+0000", 2024-04-25T22:03:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012848199999999999 2024-04-25T22:03:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4564.0:5 4.10 e51/16 ondisk, result = 0)", 2024-04-25T22:03:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.210916+0000", 2024-04-25T22:03:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.9043716540000002, 2024-04-25T22:03:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.074873453000000006, 2024-04-25T22:03:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:03:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210916+0000", 2024-04-25T22:03:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210916+0000", 2024-04-25T22:03:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210918+0000", 2024-04-25T22:03:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6700000000000001e-06 2024-04-25T22:03:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210927+0000", 2024-04-25T22:03:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4999999999999999e-06 2024-04-25T22:03:01.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210950+0000", 2024-04-25T22:03:01.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2976000000000002e-05 2024-04-25T22:03:01.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210963+0000", 2024-04-25T22:03:01.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3396e-05 2024-04-25T22:03:01.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285777+0000", 2024-04-25T22:03:01.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.074814172999999998 2024-04-25T22:03:01.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285782+0000", 2024-04-25T22:03:01.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4349999999999999e-06 2024-04-25T22:03:01.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285790+0000", 2024-04-25T22:03:01.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.303e-06 2024-04-25T22:03:01.221 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.221 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.221 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.221 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4564.0:89 4.30 e51/16 4:0e3d5a27:::10000000250.00000000:head v 51'4, mlcod=51'1)", 2024-04-25T22:03:01.222 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.225423+0000", 2024-04-25T22:03:01.222 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.8898654340000007, 2024-04-25T22:03:01.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064789777000000007, 2024-04-25T22:03:01.222 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.222 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.222 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.222 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.225423+0000", 2024-04-25T22:03:01.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.225423+0000", 2024-04-25T22:03:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.225423+0000", 2024-04-25T22:03:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4600000000000003e-07 2024-04-25T22:03:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.225431+0000", 2024-04-25T22:03:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:03:01.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.225446+0000", 2024-04-25T22:03:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5121e-05 2024-04-25T22:03:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.225454+0000", 2024-04-25T22:03:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5979999999999997e-06 2024-04-25T22:03:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285779+0000", 2024-04-25T22:03:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060325060999999999 2024-04-25T22:03:01.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285809+0000", 2024-04-25T22:03:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0136000000000001e-05 2024-04-25T22:03:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290191+0000", 2024-04-25T22:03:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043816640000000004 2024-04-25T22:03:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290212+0000", 2024-04-25T22:03:01.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1274e-05 2024-04-25T22:03:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.239486+0000", 2024-04-25T22:03:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.8758025029999992, 2024-04-25T22:03:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050859021999999997, 2024-04-25T22:03:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96 2024-04-25T22:03:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.239486+0000", 2024-04-25T22:03:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.239486+0000", 2024-04-25T22:03:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.239488+0000", 2024-04-25T22:03:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0559999999999999e-06 2024-04-25T22:03:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.239499+0000", 2024-04-25T22:03:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1387e-05 2024-04-25T22:03:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.239524+0000", 2024-04-25T22:03:01.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5276e-05 2024-04-25T22:03:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.239544+0000", 2024-04-25T22:03:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9888999999999999e-05 2024-04-25T22:03:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287217+0000", 2024-04-25T22:03:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047672503999999997 2024-04-25T22:03:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287292+0000", 2024-04-25T22:03:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5722000000000004e-05 2024-04-25T22:03:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287362+0000", 2024-04-25T22:03:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0017000000000004e-05 2024-04-25T22:03:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.288555+0000", 2024-04-25T22:03:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001192504 2024-04-25T22:03:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290299+0000", 2024-04-25T22:03:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001744518 2024-04-25T22:03:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290325+0000", 2024-04-25T22:03:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5496000000000001e-05 2024-04-25T22:03:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290345+0000", 2024-04-25T22:03:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9653e-05 2024-04-25T22:03:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.231 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:114 3.b 3:d5c7a900:::200.00000003:head [write 1094078~6875 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-25T22:03:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:59.733582+0000", 2024-04-25T22:03:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.3817065479999999, 2024-04-25T22:03:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049307908999999997, 2024-04-25T22:03:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733582+0000", 2024-04-25T22:03:01.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733582+0000", 2024-04-25T22:03:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733583+0000", 2024-04-25T22:03:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8899999999999999e-06 2024-04-25T22:03:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733600+0000", 2024-04-25T22:03:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6779999999999999e-05 2024-04-25T22:03:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733623+0000", 2024-04-25T22:03:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2796e-05 2024-04-25T22:03:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733637+0000", 2024-04-25T22:03:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3883000000000001e-05 2024-04-25T22:03:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.775890+0000", 2024-04-25T22:03:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042253394999999999 2024-04-25T22:03:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.776031+0000", 2024-04-25T22:03:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000140877 2024-04-25T22:03:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.776314+0000", 2024-04-25T22:03:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000282811 2024-04-25T22:03:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.780890+0000", 2024-04-25T22:03:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045759879999999996 2024-04-25T22:03:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.782588+0000", 2024-04-25T22:03:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001698312 2024-04-25T22:03:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.782764+0000", 2024-04-25T22:03:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017606300000000001 2024-04-25T22:03:01.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.782889+0000", 2024-04-25T22:03:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012511400000000001 2024-04-25T22:03:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:115 3.b 3:d5c7a900:::200.00000003:head [write 1100953~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-25T22:03:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:59.733764+0000", 2024-04-25T22:03:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.3815238080000001, 2024-04-25T22:03:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049669942000000002, 2024-04-25T22:03:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.237 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733764+0000", 2024-04-25T22:03:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733764+0000", 2024-04-25T22:03:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733766+0000", 2024-04-25T22:03:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.313e-06 2024-04-25T22:03:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733772+0000", 2024-04-25T22:03:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9e-06 2024-04-25T22:03:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733788+0000", 2024-04-25T22:03:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.502e-05 2024-04-25T22:03:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733797+0000", 2024-04-25T22:03:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6800000000000005e-06 2024-04-25T22:03:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.777405+0000", 2024-04-25T22:03:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043607335999999997 2024-04-25T22:03:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.777537+0000", 2024-04-25T22:03:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000132364 2024-04-25T22:03:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.777731+0000", 2024-04-25T22:03:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000194506 2024-04-25T22:03:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.780898+0000", 2024-04-25T22:03:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031667650000000002 2024-04-25T22:03:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.783117+0000", 2024-04-25T22:03:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022189570000000001 2024-04-25T22:03:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.783308+0000", 2024-04-25T22:03:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019085799999999999 2024-04-25T22:03:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.783434+0000", 2024-04-25T22:03:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000126243 2024-04-25T22:03:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.242 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:127 3.b 3:d5c7a900:::200.00000003:head [write 1190944~2474554 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-25T22:03:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:00.516732+0000", 2024-04-25T22:03:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.59855648100000003, 2024-04-25T22:03:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.074062791000000003, 2024-04-25T22:03:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.516732+0000", 2024-04-25T22:03:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:01.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.516732+0000", 2024-04-25T22:03:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.516735+0000", 2024-04-25T22:03:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0759999999999999e-06 2024-04-25T22:03:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.520391+0000", 2024-04-25T22:03:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0036560540000000002 2024-04-25T22:03:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:01.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.520424+0000", 2024-04-25T22:03:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3552e-05 2024-04-25T22:03:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.520439+0000", 2024-04-25T22:03:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4433000000000001e-05 2024-04-25T22:03:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.520574+0000", 2024-04-25T22:03:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013541399999999999 2024-04-25T22:03:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:01.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.520717+0000", 2024-04-25T22:03:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014332400000000001 2024-04-25T22:03:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.520930+0000", 2024-04-25T22:03:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021277199999999999 2024-04-25T22:03:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.580222+0000", 2024-04-25T22:03:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059291614999999999 2024-04-25T22:03:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.590627+0000", 2024-04-25T22:03:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010405118 2024-04-25T22:03:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.590722+0000", 2024-04-25T22:03:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5336999999999999e-05 2024-04-25T22:03:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.590794+0000", 2024-04-25T22:03:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2095999999999995e-05 2024-04-25T22:03:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.247 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.248 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:01.248 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:01.248 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:01.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:01.250 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:01.249+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:01.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:01.345+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:01.391 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:01.391 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:01.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.391 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:4651 4.33 e54/49 4:cda2c1d9:::100000015e3.00000000:head v 54'63, mlcod=54'61)", 2024-04-25T22:03:01.391 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:01.389502+0000", 2024-04-25T22:03:01.391 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00061483399999999998, 2024-04-25T22:03:01.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00064973600000000004, 2024-04-25T22:03:01.391 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.391 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.391 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:01.392 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:01.389502+0000", 2024-04-25T22:03:01.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:01.389502+0000", 2024-04-25T22:03:01.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:01.389503+0000", 2024-04-25T22:03:01.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.133e-06 2024-04-25T22:03:01.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:01.389515+0000", 2024-04-25T22:03:01.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2510000000000001e-05 2024-04-25T22:03:01.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:01.389533+0000", 2024-04-25T22:03:01.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7725999999999999e-05 2024-04-25T22:03:01.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:01.389543+0000", 2024-04-25T22:03:01.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6129999999999993e-06 2024-04-25T22:03:01.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:01.389624+0000", 2024-04-25T22:03:01.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0824999999999999e-05 2024-04-25T22:03:01.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:01.389655+0000", 2024-04-25T22:03:01.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1819000000000001e-05 2024-04-25T22:03:01.394 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.394 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.395 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.395 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.395 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-25T22:03:01.395 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 1 2024-04-25T22:03:01.395 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:01.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:01.452 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:01.448+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:01.535 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:01.535 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:01.535 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:03:01.535 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:03:01.535 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:01.550 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:01.597 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:01.592+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:01.653 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:01.653+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:01.663 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T22:03:01.690 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T22:03:01.732 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:01.732 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:03:01.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:03:01.732 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:01.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.732 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:03:01.732 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:03:01.732 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 107.098392539, 2024-04-25T22:03:01.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:03:01.732 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.732 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.732 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.733 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:03:01.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:03:01.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:03:01.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:03:01.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:03:01.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:03:01.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:03:01.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:03:01.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:03:01.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:03:01.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:03:01.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:03:01.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:03:01.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:03:01.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:01.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:03:01.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:03:01.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:01.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:03:01.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:03:01.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:03:01.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:03:01.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:03:01.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:03:01.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:03:01.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:03:01.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.737 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.737 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:03:01.737 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:03:01.737 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 107.09826855599999, 2024-04-25T22:03:01.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:03:01.737 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.738 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.738 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.738 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:03:01.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:03:01.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:03:01.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:03:01.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:03:01.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:03:01.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:03:01.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:03:01.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:03:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:03:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:03:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:03:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:03:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:03:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:03:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:03:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:03:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:03:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:03:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:03:01.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:03:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:03:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:03:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:03:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:16 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:03:01.743 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:03:01.743 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 107.09819462, 2024-04-25T22:03:01.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011281029999999999, 2024-04-25T22:03:01.743 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.743 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.743 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.743 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:03:01.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629218+0000", 2024-04-25T22:03:01.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629220+0000", 2024-04-25T22:03:01.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:03:01.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629258+0000", 2024-04-25T22:03:01.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8033e-05 2024-04-25T22:03:01.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629281+0000", 2024-04-25T22:03:01.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3053000000000001e-05 2024-04-25T22:03:01.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629297+0000", 2024-04-25T22:03:01.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6047000000000001e-05 2024-04-25T22:03:01.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629422+0000", 2024-04-25T22:03:01.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125165 2024-04-25T22:03:01.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629753+0000", 2024-04-25T22:03:01.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033109799999999999 2024-04-25T22:03:01.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:01.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630147+0000", 2024-04-25T22:03:01.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000393664 2024-04-25T22:03:01.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:01.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.633845+0000", 2024-04-25T22:03:01.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036979949999999999 2024-04-25T22:03:01.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640223+0000", 2024-04-25T22:03:01.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063777369999999996 2024-04-25T22:03:01.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640397+0000", 2024-04-25T22:03:01.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174072 2024-04-25T22:03:01.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640499+0000", 2024-04-25T22:03:01.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102753 2024-04-25T22:03:01.747 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.747 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.748 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:03:01.748 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:03:01.748 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 107.098078368, 2024-04-25T22:03:01.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:03:01.748 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.748 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.748 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.748 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:03:01.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:03:01.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:03:01.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:03:01.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:03:01.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:03:01.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:03:01.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:03:01.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:03:01.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:03:01.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:03:01.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:03:01.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:03:01.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:03:01.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:01.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:03:01.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:03:01.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:01.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:03:01.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:03:01.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:03:01.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:03:01.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:03:01.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:03:01.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:03:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:03:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:03:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:03:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 107.09791495899999, 2024-04-25T22:03:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:03:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.753 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:03:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:03:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:03:01.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:03:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:03:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:03:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:03:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:03:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:03:01.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:03:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:03:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:03:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:03:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:03:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:03:01.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:03:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:03:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:03:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:03:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:03:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:03:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:03:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:03:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:03:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:03:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:03:01.758 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 107.09781276299999, 2024-04-25T22:03:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:03:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:03:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:03:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:03:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:03:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:03:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:03:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:03:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:03:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:03:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:03:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:03:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:03:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:03:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:03:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:03:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:03:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:03:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:03:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:03:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:03:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:03:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:03:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:03:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:03:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:03:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:03:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 107.09773380999999, 2024-04-25T22:03:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:03:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:03:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:03:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:03:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:03:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:03:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:03:01.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:03:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:03:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:03:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:03:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:03:01.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:03:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:03:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:03:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:03:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:03:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:03:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:03:01.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:03:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:03:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:03:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:03:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:03:01.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:03:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:03:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:03:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 107.097590595, 2024-04-25T22:03:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:03:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:03:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:03:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:03:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:03:01.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:03:01.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:03:01.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:03:01.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:03:01.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:03:01.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:03:01.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:03:01.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:03:01.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:03:01.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:03:01.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:03:01.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:03:01.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.773 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.773 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:4 4.32 e51/16 4:4def72d4:::10000000003.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:03:01.773 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:01.773 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7349548349999999, 2024-04-25T22:03:01.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10987878, 2024-04-25T22:03:01.773 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.773 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.773 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:01.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:01.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992461+0000", 2024-04-25T22:03:01.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5780000000000001e-06 2024-04-25T22:03:01.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997784+0000", 2024-04-25T22:03:01.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005323627 2024-04-25T22:03:01.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997815+0000", 2024-04-25T22:03:01.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0066999999999999e-05 2024-04-25T22:03:01.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997830+0000", 2024-04-25T22:03:01.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5290000000000001e-05 2024-04-25T22:03:01.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997927+0000", 2024-04-25T22:03:01.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7391000000000003e-05 2024-04-25T22:03:01.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997947+0000", 2024-04-25T22:03:01.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0259999999999999e-05 2024-04-25T22:03:01.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102225+0000", 2024-04-25T22:03:01.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10427777100000001 2024-04-25T22:03:01.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102337+0000", 2024-04-25T22:03:01.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000111796 2024-04-25T22:03:01.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.777 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.777 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:6 4.13 e51/16 4:cbe72331:::10000000003.00000002:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:01.777 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:01.777 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.640140851, 2024-04-25T22:03:01.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.11536371400000001, 2024-04-25T22:03:01.777 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.777 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.777 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.777 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:01.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:01.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087273+0000", 2024-04-25T22:03:01.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:03:01.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089358+0000", 2024-04-25T22:03:01.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0020848170000000001 2024-04-25T22:03:01.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089372+0000", 2024-04-25T22:03:01.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.452e-05 2024-04-25T22:03:01.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089381+0000", 2024-04-25T22:03:01.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5979999999999997e-06 2024-04-25T22:03:01.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089486+0000", 2024-04-25T22:03:01.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105573 2024-04-25T22:03:01.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089536+0000", 2024-04-25T22:03:01.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9505000000000001e-05 2024-04-25T22:03:01.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202556+0000", 2024-04-25T22:03:01.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.113020169 2024-04-25T22:03:01.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202636+0000", 2024-04-25T22:03:01.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9814000000000005e-05 2024-04-25T22:03:01.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.781 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.781 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:5 4.10 e51/16 4:09a4c37f:::10000000003.00000001:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:01.781 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:01.781 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6275649340000005, 2024-04-25T22:03:01.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.110104358, 2024-04-25T22:03:01.782 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.782 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.782 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:01.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:01.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099849+0000", 2024-04-25T22:03:01.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7000000000000003e-07 2024-04-25T22:03:01.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108349+0000", 2024-04-25T22:03:01.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085003230000000006 2024-04-25T22:03:01.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108391+0000", 2024-04-25T22:03:01.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2011999999999997e-05 2024-04-25T22:03:01.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108415+0000", 2024-04-25T22:03:01.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3702000000000001e-05 2024-04-25T22:03:01.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108504+0000", 2024-04-25T22:03:01.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8684999999999995e-05 2024-04-25T22:03:01.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108520+0000", 2024-04-25T22:03:01.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5931999999999999e-05 2024-04-25T22:03:01.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209918+0000", 2024-04-25T22:03:01.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.101398696 2024-04-25T22:03:01.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209952+0000", 2024-04-25T22:03:01.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4038000000000002e-05 2024-04-25T22:03:01.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.785 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.786 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11 4.28 e51/49 4:177a762d:::10000000201.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:01.786 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:01.786 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6188630079999999, 2024-04-25T22:03:01.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098799331000000004, 2024-04-25T22:03:01.786 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.786 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.786 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:01.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:01.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108551+0000", 2024-04-25T22:03:01.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0699999999999996e-07 2024-04-25T22:03:01.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108576+0000", 2024-04-25T22:03:01.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4856000000000001e-05 2024-04-25T22:03:01.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108593+0000", 2024-04-25T22:03:01.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7125999999999998e-05 2024-04-25T22:03:01.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108609+0000", 2024-04-25T22:03:01.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6535999999999999e-05 2024-04-25T22:03:01.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108713+0000", 2024-04-25T22:03:01.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010344999999999999 2024-04-25T22:03:01.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108762+0000", 2024-04-25T22:03:01.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8711000000000002e-05 2024-04-25T22:03:01.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207305+0000", 2024-04-25T22:03:01.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098543566999999999 2024-04-25T22:03:01.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207349+0000", 2024-04-25T22:03:01.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4178000000000003e-05 2024-04-25T22:03:01.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.790 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.790 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.790 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:12 4.28 e51/49 4:15246602:::10000000202.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:03:01.790 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:01.790 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6187817169999992, 2024-04-25T22:03:01.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098749009999999998, 2024-04-25T22:03:01.790 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.790 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.790 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:01.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:01.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108632+0000", 2024-04-25T22:03:01.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2699999999999999e-07 2024-04-25T22:03:01.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108647+0000", 2024-04-25T22:03:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4585e-05 2024-04-25T22:03:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108667+0000", 2024-04-25T22:03:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9887000000000001e-05 2024-04-25T22:03:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108680+0000", 2024-04-25T22:03:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3249e-05 2024-04-25T22:03:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109917+0000", 2024-04-25T22:03:01.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012367050000000001 2024-04-25T22:03:01.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109961+0000", 2024-04-25T22:03:01.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4029000000000001e-05 2024-04-25T22:03:01.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207351+0000", 2024-04-25T22:03:01.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.097390791000000004 2024-04-25T22:03:01.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207380+0000", 2024-04-25T22:03:01.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9037e-05 2024-04-25T22:03:01.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.794 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.794 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:8 4.3b e51/49 4:deccbd37:::100000001fe.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:01.794 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:01.794 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6187168130000007, 2024-04-25T22:03:01.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090839771, 2024-04-25T22:03:01.794 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.794 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.794 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:01.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:01.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108697+0000", 2024-04-25T22:03:01.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1399999999999997e-07 2024-04-25T22:03:01.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108712+0000", 2024-04-25T22:03:01.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4772e-05 2024-04-25T22:03:01.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108728+0000", 2024-04-25T22:03:01.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5943e-05 2024-04-25T22:03:01.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108740+0000", 2024-04-25T22:03:01.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.235e-05 2024-04-25T22:03:01.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108797+0000", 2024-04-25T22:03:01.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6879000000000002e-05 2024-04-25T22:03:01.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108812+0000", 2024-04-25T22:03:01.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5268999999999999e-05 2024-04-25T22:03:01.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199495+0000", 2024-04-25T22:03:01.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090683071000000004 2024-04-25T22:03:01.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199536+0000", 2024-04-25T22:03:01.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0873e-05 2024-04-25T22:03:01.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.798 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.798 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:59 3.14 e52/15 3:2e2fa760:::200.00000001:head v 52'20, mlcod=51'18)", 2024-04-25T22:03:01.798 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:55.375543+0000", 2024-04-25T22:03:01.798 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 6.3518701550000003, 2024-04-25T22:03:01.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.036557824000000003, 2024-04-25T22:03:01.798 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.798 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.799 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.799 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.375543+0000", 2024-04-25T22:03:01.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.375543+0000", 2024-04-25T22:03:01.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.375544+0000", 2024-04-25T22:03:01.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2640000000000001e-06 2024-04-25T22:03:01.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377524+0000", 2024-04-25T22:03:01.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001980154 2024-04-25T22:03:01.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377551+0000", 2024-04-25T22:03:01.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6211999999999999e-05 2024-04-25T22:03:01.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377569+0000", 2024-04-25T22:03:01.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182e-05 2024-04-25T22:03:01.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377689+0000", 2024-04-25T22:03:01.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119973 2024-04-25T22:03:01.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377722+0000", 2024-04-25T22:03:01.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3113e-05 2024-04-25T22:03:01.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.412025+0000", 2024-04-25T22:03:01.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.034302721000000001 2024-04-25T22:03:01.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.412101+0000", 2024-04-25T22:03:01.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6205000000000006e-05 2024-04-25T22:03:01.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.802 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.802 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:2291 4.32 e52/16 4:4ffda274:::10000000c47.00000000:head v 52'42, mlcod=52'40)", 2024-04-25T22:03:01.802 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:57.074116+0000", 2024-04-25T22:03:01.802 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6532973789999996, 2024-04-25T22:03:01.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017364083999999998, 2024-04-25T22:03:01.802 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.803 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.803 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074116+0000", 2024-04-25T22:03:01.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074116+0000", 2024-04-25T22:03:01.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074118+0000", 2024-04-25T22:03:01.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.903e-06 2024-04-25T22:03:01.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074223+0000", 2024-04-25T22:03:01.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105664 2024-04-25T22:03:01.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074251+0000", 2024-04-25T22:03:01.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8161999999999999e-05 2024-04-25T22:03:01.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074264+0000", 2024-04-25T22:03:01.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2989999999999999e-05 2024-04-25T22:03:01.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074390+0000", 2024-04-25T22:03:01.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012554600000000001 2024-04-25T22:03:01.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074451+0000", 2024-04-25T22:03:01.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1092000000000004e-05 2024-04-25T22:03:01.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.091406+0000", 2024-04-25T22:03:01.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016955409000000001 2024-04-25T22:03:01.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.091480+0000", 2024-04-25T22:03:01.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3318000000000005e-05 2024-04-25T22:03:01.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.806 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.806 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:2315 4.1f e52/49 4:f84a2a2d:::10000000c60.00000000:head v 52'42, mlcod=52'40)", 2024-04-25T22:03:01.806 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:57.112380+0000", 2024-04-25T22:03:01.807 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6150335260000004, 2024-04-25T22:03:01.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.038962912000000002, 2024-04-25T22:03:01.807 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.807 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.807 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112380+0000", 2024-04-25T22:03:01.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112380+0000", 2024-04-25T22:03:01.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112381+0000", 2024-04-25T22:03:01.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:01.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112856+0000", 2024-04-25T22:03:01.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047428299999999999 2024-04-25T22:03:01.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112885+0000", 2024-04-25T22:03:01.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9019000000000001e-05 2024-04-25T22:03:01.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112898+0000", 2024-04-25T22:03:01.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:03:01.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.113041+0000", 2024-04-25T22:03:01.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014280599999999999 2024-04-25T22:03:01.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.113102+0000", 2024-04-25T22:03:01.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1495000000000007e-05 2024-04-25T22:03:01.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.151273+0000", 2024-04-25T22:03:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.038170444999999997 2024-04-25T22:03:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.151342+0000", 2024-04-25T22:03:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9861000000000001e-05 2024-04-25T22:03:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:3804 4.2f e53/16 4:f569593f:::10000001253.00000000:head v 53'67, mlcod=53'65)", 2024-04-25T22:03:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:00.169882+0000", 2024-04-25T22:03:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.5575312690000001, 2024-04-25T22:03:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030929529000000001, 2024-04-25T22:03:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.169882+0000", 2024-04-25T22:03:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.169882+0000", 2024-04-25T22:03:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.169884+0000", 2024-04-25T22:03:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.843e-06 2024-04-25T22:03:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.170484+0000", 2024-04-25T22:03:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060082600000000005 2024-04-25T22:03:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.170511+0000", 2024-04-25T22:03:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6373e-05 2024-04-25T22:03:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.170523+0000", 2024-04-25T22:03:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2583e-05 2024-04-25T22:03:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.170655+0000", 2024-04-25T22:03:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013200899999999999 2024-04-25T22:03:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.170717+0000", 2024-04-25T22:03:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1984999999999997e-05 2024-04-25T22:03:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.200715+0000", 2024-04-25T22:03:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029997271999999998 2024-04-25T22:03:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.200811+0000", 2024-04-25T22:03:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6638000000000005e-05 2024-04-25T22:03:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:3816 4.37 e53/16 4:eea7faa5:::10000001260.00000000:head v 53'60, mlcod=53'58)", 2024-04-25T22:03:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:00.182914+0000", 2024-04-25T22:03:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.544499563, 2024-04-25T22:03:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017412075999999999, 2024-04-25T22:03:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.182914+0000", 2024-04-25T22:03:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.182914+0000", 2024-04-25T22:03:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.182915+0000", 2024-04-25T22:03:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6530000000000001e-06 2024-04-25T22:03:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.182926+0000", 2024-04-25T22:03:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.092e-05 2024-04-25T22:03:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.182978+0000", 2024-04-25T22:03:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1557999999999997e-05 2024-04-25T22:03:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.182989+0000", 2024-04-25T22:03:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.165e-05 2024-04-25T22:03:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.183098+0000", 2024-04-25T22:03:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010888 2024-04-25T22:03:01.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.183130+0000", 2024-04-25T22:03:01.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2082999999999998e-05 2024-04-25T22:03:01.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.200203+0000", 2024-04-25T22:03:01.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017072442 2024-04-25T22:03:01.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.200326+0000", 2024-04-25T22:03:01.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012289000000000001 2024-04-25T22:03:01.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.819 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.819 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:3818 4.3f e53/49 4:fc3019ee:::10000001262.00000000:head v 53'55, mlcod=53'53)", 2024-04-25T22:03:01.819 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:00.184762+0000", 2024-04-25T22:03:01.819 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.5426514, 2024-04-25T22:03:01.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015658160000000001, 2024-04-25T22:03:01.819 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:01.819 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:01.819 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:01.819 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:01.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:01.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.184762+0000", 2024-04-25T22:03:01.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:01.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.184762+0000", 2024-04-25T22:03:01.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:01.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:01.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.184764+0000", 2024-04-25T22:03:01.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0540000000000002e-06 2024-04-25T22:03:01.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:01.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.184786+0000", 2024-04-25T22:03:01.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1954999999999999e-05 2024-04-25T22:03:01.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:01.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.184811+0000", 2024-04-25T22:03:01.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5687e-05 2024-04-25T22:03:01.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:01.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.184829+0000", 2024-04-25T22:03:01.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7186000000000001e-05 2024-04-25T22:03:01.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:01.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.184961+0000", 2024-04-25T22:03:01.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013210899999999999 2024-04-25T22:03:01.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:01.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.184993+0000", 2024-04-25T22:03:01.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1918999999999997e-05 2024-04-25T22:03:01.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:01.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.200332+0000", 2024-04-25T22:03:01.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015339492999999999 2024-04-25T22:03:01.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:01.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:01.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:01.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.200420+0000", 2024-04-25T22:03:01.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7756999999999993e-05 2024-04-25T22:03:01.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.823 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:01.823 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:01.823 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:01.824 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:03:01.825 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:01.821+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:01.826 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:01.925 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:01.925+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:01.976 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:01.976 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:01.977 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:01.977 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:01.992 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:01.998 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:01.998 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:02.018 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:02.018 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:02.033 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:02.033+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:02.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:02.121+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:02.170 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:02.170 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:02.185 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:02.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:02.221+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:02.328 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:02.325+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:02.331 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:02.331 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:02.348 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:02.429 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:02.424+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:02.487 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:02.487 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:02.504 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:02.530 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:02.529+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:02.631 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:02.624+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:02.637 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:02.637 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:02.653 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:02.672 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T22:03:02.692 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T22:03:02.692 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:03:02.693 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:03:02.732 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:02.729+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:02.783 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:02.783 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:02.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:02.848 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:02.844+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:02.933 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:02.928+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:02.939 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:02.939 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:02.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:03.031 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:03:03.033 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:03:03.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:03.029+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:03.049 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-04-25T22:03:02.670045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30164498,"num_objects":3136,"num_object_clones":0,"num_object_copies":6272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3136,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":3397,"num_write_kb":34338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3335,"ondisk_log_size":3335,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":166924,"kb_used_data":52588,"kb_used_omap":4,"kb_used_meta":114299,"kb_avail":282948596,"statfs":{"total":289910292480,"available":289739362304,"internally_reserved":0,"allocated":53850112,"data_stored":57753768,"data_compressed":3336519,"data_compressed_allocated":4517888,"data_compressed_original":22323200,"omap_allocated":4785,"internal_metadata":117042511},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15122473,"num_objects":2429,"num_object_clones":0,"num_object_copies":4858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2429,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2444,"num_write_kb":16252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.328737"},"pg_stats":[{"pgid":"4.3f","version":"53'41","reported_seq":59,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.371125+0000","last_change":"2024-04-25T22:02:49.882976+0000","last_active":"2024-04-25T22:02:58.371125+0000","last_peered":"2024-04-25T22:02:58.371125+0000","last_clean":"2024-04-25T22:02:58.371125+0000","last_became_active":"2024-04-25T22:02:49.882308+0000","last_became_peered":"2024-04-25T22:02:49.882308+0000","last_unstale":"2024-04-25T22:02:58.371125+0000","last_undegraded":"2024-04-25T22:02:58.371125+0000","last_fullsized":"2024-04-25T22:02:58.371125+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:46.257798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125137,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"53'45","reported_seq":63,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.245585+0000","last_change":"2024-04-25T22:02:49.882947+0000","last_active":"2024-04-25T22:02:58.245585+0000","last_peered":"2024-04-25T22:02:58.245585+0000","last_clean":"2024-04-25T22:02:58.245585+0000","last_became_active":"2024-04-25T22:02:49.882192+0000","last_became_peered":"2024-04-25T22:02:49.882192+0000","last_unstale":"2024-04-25T22:02:58.245585+0000","last_undegraded":"2024-04-25T22:02:58.245585+0000","last_fullsized":"2024-04-25T22:02:58.245585+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:07.474272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177929,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"53'52","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.935763+0000","last_change":"2024-04-25T22:02:49.886973+0000","last_active":"2024-04-25T22:02:57.935763+0000","last_peered":"2024-04-25T22:02:57.935763+0000","last_clean":"2024-04-25T22:02:57.935763+0000","last_became_active":"2024-04-25T22:02:49.884097+0000","last_became_peered":"2024-04-25T22:02:49.884097+0000","last_unstale":"2024-04-25T22:02:57.935763+0000","last_undegraded":"2024-04-25T22:02:57.935763+0000","last_fullsized":"2024-04-25T22:02:57.935763+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171750,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"53'28","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.869342+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:02:57.869342+0000","last_peered":"2024-04-25T22:02:57.869342+0000","last_clean":"2024-04-25T22:02:57.869342+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:02:57.869342+0000","last_undegraded":"2024-04-25T22:02:57.869342+0000","last_fullsized":"2024-04-25T22:02:57.869342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120190,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"53'57","reported_seq":75,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.358883+0000","last_change":"2024-04-25T22:02:49.879514+0000","last_active":"2024-04-25T22:02:58.358883+0000","last_peered":"2024-04-25T22:02:58.358883+0000","last_clean":"2024-04-25T22:02:58.358883+0000","last_became_active":"2024-04-25T22:02:49.878964+0000","last_became_peered":"2024-04-25T22:02:49.878964+0000","last_unstale":"2024-04-25T22:02:58.358883+0000","last_undegraded":"2024-04-25T22:02:58.358883+0000","last_fullsized":"2024-04-25T22:02:58.358883+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.432134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176240,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"53'44","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.306510+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:02:58.306510+0000","last_peered":"2024-04-25T22:02:58.306510+0000","last_clean":"2024-04-25T22:02:58.306510+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:02:58.306510+0000","last_undegraded":"2024-04-25T22:02:58.306510+0000","last_fullsized":"2024-04-25T22:02:58.306510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139138,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"53'53","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.603855+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:02:58.603855+0000","last_peered":"2024-04-25T22:02:58.603855+0000","last_clean":"2024-04-25T22:02:58.603855+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:02:58.603855+0000","last_undegraded":"2024-04-25T22:02:58.603855+0000","last_fullsized":"2024-04-25T22:02:58.603855+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128972,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"53'46","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.455084+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:02:58.455084+0000","last_peered":"2024-04-25T22:02:58.455084+0000","last_clean":"2024-04-25T22:02:58.455084+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:02:58.455084+0000","last_undegraded":"2024-04-25T22:02:58.455084+0000","last_fullsized":"2024-04-25T22:02:58.455084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221210,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"53'48","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.401085+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:02:58.401085+0000","last_peered":"2024-04-25T22:02:58.401085+0000","last_clean":"2024-04-25T22:02:58.401085+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:02:58.401085+0000","last_undegraded":"2024-04-25T22:02:58.401085+0000","last_fullsized":"2024-04-25T22:02:58.401085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161598,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"53'47","reported_seq":65,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.560297+0000","last_change":"2024-04-25T22:02:49.885137+0000","last_active":"2024-04-25T22:02:58.560297+0000","last_peered":"2024-04-25T22:02:58.560297+0000","last_clean":"2024-04-25T22:02:58.560297+0000","last_became_active":"2024-04-25T22:02:49.884276+0000","last_became_peered":"2024-04-25T22:02:49.884276+0000","last_unstale":"2024-04-25T22:02:58.560297+0000","last_undegraded":"2024-04-25T22:02:58.560297+0000","last_fullsized":"2024-04-25T22:02:58.560297+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:12.408801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182589,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"53'51","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.178919+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:02:58.178919+0000","last_peered":"2024-04-25T22:02:58.178919+0000","last_clean":"2024-04-25T22:02:58.178919+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:02:58.178919+0000","last_undegraded":"2024-04-25T22:02:58.178919+0000","last_fullsized":"2024-04-25T22:02:58.178919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156527,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"53'42","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.342615+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:02:58.342615+0000","last_peered":"2024-04-25T22:02:58.342615+0000","last_clean":"2024-04-25T22:02:58.342615+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:02:58.342615+0000","last_undegraded":"2024-04-25T22:02:58.342615+0000","last_fullsized":"2024-04-25T22:02:58.342615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125660,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"53'38","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.187544+0000","last_change":"2024-04-25T22:02:49.878698+0000","last_active":"2024-04-25T22:02:58.187544+0000","last_peered":"2024-04-25T22:02:58.187544+0000","last_clean":"2024-04-25T22:02:58.187544+0000","last_became_active":"2024-04-25T22:02:49.878377+0000","last_became_peered":"2024-04-25T22:02:49.878377+0000","last_unstale":"2024-04-25T22:02:58.187544+0000","last_undegraded":"2024-04-25T22:02:58.187544+0000","last_fullsized":"2024-04-25T22:02:58.187544+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:31:39.262571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131746,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"53'59","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.533836+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:02:58.533836+0000","last_peered":"2024-04-25T22:02:58.533836+0000","last_clean":"2024-04-25T22:02:58.533836+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:02:58.533836+0000","last_undegraded":"2024-04-25T22:02:58.533836+0000","last_fullsized":"2024-04-25T22:02:58.533836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4576654,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"53'49","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.439526+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:02:58.439526+0000","last_peered":"2024-04-25T22:02:58.439526+0000","last_clean":"2024-04-25T22:02:58.439526+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:02:58.439526+0000","last_undegraded":"2024-04-25T22:02:58.439526+0000","last_fullsized":"2024-04-25T22:02:58.439526+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112606,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"53'57","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.408634+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:02:58.408634+0000","last_peered":"2024-04-25T22:02:58.408634+0000","last_clean":"2024-04-25T22:02:58.408634+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:02:58.408634+0000","last_undegraded":"2024-04-25T22:02:58.408634+0000","last_fullsized":"2024-04-25T22:02:58.408634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172474,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"53'53","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.279735+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:02:58.279735+0000","last_peered":"2024-04-25T22:02:58.279735+0000","last_clean":"2024-04-25T22:02:58.279735+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:02:58.279735+0000","last_undegraded":"2024-04-25T22:02:58.279735+0000","last_fullsized":"2024-04-25T22:02:58.279735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124423,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"53'55","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.406815+0000","last_change":"2024-04-25T22:02:49.885489+0000","last_active":"2024-04-25T22:02:58.406815+0000","last_peered":"2024-04-25T22:02:58.406815+0000","last_clean":"2024-04-25T22:02:58.406815+0000","last_became_active":"2024-04-25T22:02:49.884784+0000","last_became_peered":"2024-04-25T22:02:49.884784+0000","last_unstale":"2024-04-25T22:02:58.406815+0000","last_undegraded":"2024-04-25T22:02:58.406815+0000","last_fullsized":"2024-04-25T22:02:58.406815+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131227,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"53'48","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.483038+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:02:58.483038+0000","last_peered":"2024-04-25T22:02:58.483038+0000","last_clean":"2024-04-25T22:02:58.483038+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:02:58.483038+0000","last_undegraded":"2024-04-25T22:02:58.483038+0000","last_fullsized":"2024-04-25T22:02:58.483038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159928,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"53'56","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.206004+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:02:58.206004+0000","last_peered":"2024-04-25T22:02:58.206004+0000","last_clean":"2024-04-25T22:02:58.206004+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:02:58.206004+0000","last_undegraded":"2024-04-25T22:02:58.206004+0000","last_fullsized":"2024-04-25T22:02:58.206004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126750,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"53'53","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.426765+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:02:58.426765+0000","last_peered":"2024-04-25T22:02:58.426765+0000","last_clean":"2024-04-25T22:02:58.426765+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:02:58.426765+0000","last_undegraded":"2024-04-25T22:02:58.426765+0000","last_fullsized":"2024-04-25T22:02:58.426765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136446,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"53'57","reported_seq":75,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.421052+0000","last_change":"2024-04-25T22:02:49.886169+0000","last_active":"2024-04-25T22:02:58.421052+0000","last_peered":"2024-04-25T22:02:58.421052+0000","last_clean":"2024-04-25T22:02:58.421052+0000","last_became_active":"2024-04-25T22:02:49.884516+0000","last_became_peered":"2024-04-25T22:02:49.884516+0000","last_unstale":"2024-04-25T22:02:58.421052+0000","last_undegraded":"2024-04-25T22:02:58.421052+0000","last_fullsized":"2024-04-25T22:02:58.421052+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:21.251127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264278,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"53'56","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.455592+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:02:58.455592+0000","last_peered":"2024-04-25T22:02:58.455592+0000","last_clean":"2024-04-25T22:02:58.455592+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:02:58.455592+0000","last_undegraded":"2024-04-25T22:02:58.455592+0000","last_fullsized":"2024-04-25T22:02:58.455592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639950,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"53'49","reported_seq":67,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.564102+0000","last_change":"2024-04-25T22:02:49.876986+0000","last_active":"2024-04-25T22:02:58.564102+0000","last_peered":"2024-04-25T22:02:58.564102+0000","last_clean":"2024-04-25T22:02:58.564102+0000","last_became_active":"2024-04-25T22:02:49.876269+0000","last_became_peered":"2024-04-25T22:02:49.876269+0000","last_unstale":"2024-04-25T22:02:58.564102+0000","last_undegraded":"2024-04-25T22:02:58.564102+0000","last_fullsized":"2024-04-25T22:02:58.564102+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:35:35.547810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260522,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"53'49","reported_seq":67,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.124619+0000","last_change":"2024-04-25T22:02:49.881388+0000","last_active":"2024-04-25T22:02:58.124619+0000","last_peered":"2024-04-25T22:02:58.124619+0000","last_clean":"2024-04-25T22:02:58.124619+0000","last_became_active":"2024-04-25T22:02:49.880527+0000","last_became_peered":"2024-04-25T22:02:49.880527+0000","last_unstale":"2024-04-25T22:02:58.124619+0000","last_undegraded":"2024-04-25T22:02:58.124619+0000","last_fullsized":"2024-04-25T22:02:58.124619+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119464,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"53'54","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.400504+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:02:58.400504+0000","last_peered":"2024-04-25T22:02:58.400504+0000","last_clean":"2024-04-25T22:02:58.400504+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:02:58.400504+0000","last_undegraded":"2024-04-25T22:02:58.400504+0000","last_fullsized":"2024-04-25T22:02:58.400504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":253076,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"53'41","reported_seq":122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.350851+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:02:58.350851+0000","last_peered":"2024-04-25T22:02:58.350851+0000","last_clean":"2024-04-25T22:02:58.350851+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:02:58.350851+0000","last_undegraded":"2024-04-25T22:02:58.350851+0000","last_fullsized":"2024-04-25T22:02:58.350851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228838,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"53'51","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.162049+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:02:58.162049+0000","last_peered":"2024-04-25T22:02:58.162049+0000","last_clean":"2024-04-25T22:02:58.162049+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:02:58.162049+0000","last_undegraded":"2024-04-25T22:02:58.162049+0000","last_fullsized":"2024-04-25T22:02:58.162049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":232367,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"53'44","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.460938+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:02:58.460938+0000","last_peered":"2024-04-25T22:02:58.460938+0000","last_clean":"2024-04-25T22:02:58.460938+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:02:58.460938+0000","last_undegraded":"2024-04-25T22:02:58.460938+0000","last_fullsized":"2024-04-25T22:02:58.460938+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218834,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"53'59","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.308058+0000","last_change":"2024-04-25T22:02:49.885001+0000","last_active":"2024-04-25T22:02:58.308058+0000","last_peered":"2024-04-25T22:02:58.308058+0000","last_clean":"2024-04-25T22:02:58.308058+0000","last_became_active":"2024-04-25T22:02:49.883649+0000","last_became_peered":"2024-04-25T22:02:49.883649+0000","last_unstale":"2024-04-25T22:02:58.308058+0000","last_undegraded":"2024-04-25T22:02:58.308058+0000","last_fullsized":"2024-04-25T22:02:58.308058+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:07.474272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194744,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"53'54","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.481024+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:02:58.481024+0000","last_peered":"2024-04-25T22:02:58.481024+0000","last_clean":"2024-04-25T22:02:58.481024+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:02:58.481024+0000","last_undegraded":"2024-04-25T22:02:58.481024+0000","last_fullsized":"2024-04-25T22:02:58.481024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234190,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"53'55","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.394902+0000","last_change":"2024-04-25T22:02:43.850984+0000","last_active":"2024-04-25T22:02:58.394902+0000","last_peered":"2024-04-25T22:02:58.394902+0000","last_clean":"2024-04-25T22:02:58.394902+0000","last_became_active":"2024-04-25T22:02:43.850651+0000","last_became_peered":"2024-04-25T22:02:43.850651+0000","last_unstale":"2024-04-25T22:02:58.394902+0000","last_undegraded":"2024-04-25T22:02:58.394902+0000","last_fullsized":"2024-04-25T22:02:58.394902+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:08.019453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209819,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"53'43","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.462790+0000","last_change":"2024-04-25T22:02:49.881928+0000","last_active":"2024-04-25T22:02:58.462790+0000","last_peered":"2024-04-25T22:02:58.462790+0000","last_clean":"2024-04-25T22:02:58.462790+0000","last_became_active":"2024-04-25T22:02:49.881638+0000","last_became_peered":"2024-04-25T22:02:49.881638+0000","last_unstale":"2024-04-25T22:02:58.462790+0000","last_undegraded":"2024-04-25T22:02:58.462790+0000","last_fullsized":"2024-04-25T22:02:58.462790+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:53:47.483774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238669,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.343788+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:02:57.343788+0000","last_peered":"2024-04-25T22:02:57.343788+0000","last_clean":"2024-04-25T22:02:57.343788+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:02:57.343788+0000","last_undegraded":"2024-04-25T22:02:57.343788+0000","last_fullsized":"2024-04-25T22:02:57.343788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"53'44","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.836077+0000","last_change":"2024-04-25T22:02:49.882694+0000","last_active":"2024-04-25T22:02:57.836077+0000","last_peered":"2024-04-25T22:02:57.836077+0000","last_clean":"2024-04-25T22:02:57.836077+0000","last_became_active":"2024-04-25T22:02:49.882085+0000","last_became_peered":"2024-04-25T22:02:49.882085+0000","last_unstale":"2024-04-25T22:02:57.836077+0000","last_undegraded":"2024-04-25T22:02:57.836077+0000","last_fullsized":"2024-04-25T22:02:57.836077+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:56.743509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137413,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.345795+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:02:57.345795+0000","last_peered":"2024-04-25T22:02:57.345795+0000","last_clean":"2024-04-25T22:02:57.345795+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:02:57.345795+0000","last_undegraded":"2024-04-25T22:02:57.345795+0000","last_fullsized":"2024-04-25T22:02:57.345795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"53'57","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.407697+0000","last_change":"2024-04-25T22:01:14.648527+0000","last_active":"2024-04-25T22:02:58.407697+0000","last_peered":"2024-04-25T22:02:58.407697+0000","last_clean":"2024-04-25T22:02:58.407697+0000","last_became_active":"2024-04-25T22:01:14.645040+0000","last_became_peered":"2024-04-25T22:01:14.645040+0000","last_unstale":"2024-04-25T22:02:58.407697+0000","last_undegraded":"2024-04-25T22:02:58.407697+0000","last_fullsized":"2024-04-25T22:02:58.407697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298162,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.341925+0000","last_change":"2024-04-25T22:02:49.881219+0000","last_active":"2024-04-25T22:02:57.341925+0000","last_peered":"2024-04-25T22:02:57.341925+0000","last_clean":"2024-04-25T22:02:57.341925+0000","last_became_active":"2024-04-25T22:02:49.880475+0000","last_became_peered":"2024-04-25T22:02:49.880475+0000","last_unstale":"2024-04-25T22:02:57.341925+0000","last_undegraded":"2024-04-25T22:02:57.341925+0000","last_fullsized":"2024-04-25T22:02:57.341925+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:49.944264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"53'43","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.268071+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:02:58.268071+0000","last_peered":"2024-04-25T22:02:58.268071+0000","last_clean":"2024-04-25T22:02:58.268071+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:02:58.268071+0000","last_undegraded":"2024-04-25T22:02:58.268071+0000","last_fullsized":"2024-04-25T22:02:58.268071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101936,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.341947+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:02:57.341947+0000","last_peered":"2024-04-25T22:02:57.341947+0000","last_clean":"2024-04-25T22:02:57.341947+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:02:57.341947+0000","last_undegraded":"2024-04-25T22:02:57.341947+0000","last_fullsized":"2024-04-25T22:02:57.341947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.343590+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:02:57.343590+0000","last_peered":"2024-04-25T22:02:57.343590+0000","last_clean":"2024-04-25T22:02:57.343590+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:02:57.343590+0000","last_undegraded":"2024-04-25T22:02:57.343590+0000","last_fullsized":"2024-04-25T22:02:57.343590+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"53'39","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.516570+0000","last_change":"2024-04-25T22:02:49.881394+0000","last_active":"2024-04-25T22:02:58.516570+0000","last_peered":"2024-04-25T22:02:58.516570+0000","last_clean":"2024-04-25T22:02:58.516570+0000","last_became_active":"2024-04-25T22:02:49.880690+0000","last_became_peered":"2024-04-25T22:02:49.880690+0000","last_unstale":"2024-04-25T22:02:58.516570+0000","last_undegraded":"2024-04-25T22:02:58.516570+0000","last_fullsized":"2024-04-25T22:02:58.516570+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:31:39.262571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110430,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.343024+0000","last_change":"2024-04-25T22:02:49.884340+0000","last_active":"2024-04-25T22:02:57.343024+0000","last_peered":"2024-04-25T22:02:57.343024+0000","last_clean":"2024-04-25T22:02:57.343024+0000","last_became_active":"2024-04-25T22:02:49.883397+0000","last_became_peered":"2024-04-25T22:02:49.883397+0000","last_unstale":"2024-04-25T22:02:57.343024+0000","last_undegraded":"2024-04-25T22:02:57.343024+0000","last_fullsized":"2024-04-25T22:02:57.343024+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:55.740324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"53'54","reported_seq":72,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.270046+0000","last_change":"2024-04-25T22:02:49.877784+0000","last_active":"2024-04-25T22:02:58.270046+0000","last_peered":"2024-04-25T22:02:58.270046+0000","last_clean":"2024-04-25T22:02:58.270046+0000","last_became_active":"2024-04-25T22:02:49.876644+0000","last_became_peered":"2024-04-25T22:02:49.876644+0000","last_unstale":"2024-04-25T22:02:58.270046+0000","last_undegraded":"2024-04-25T22:02:58.270046+0000","last_fullsized":"2024-04-25T22:02:58.270046+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:50.947449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164465,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.344228+0000","last_change":"2024-04-25T22:02:49.885084+0000","last_active":"2024-04-25T22:02:57.344228+0000","last_peered":"2024-04-25T22:02:57.344228+0000","last_clean":"2024-04-25T22:02:57.344228+0000","last_became_active":"2024-04-25T22:02:49.883048+0000","last_became_peered":"2024-04-25T22:02:49.883048+0000","last_unstale":"2024-04-25T22:02:57.344228+0000","last_undegraded":"2024-04-25T22:02:57.344228+0000","last_fullsized":"2024-04-25T22:02:57.344228+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:12.276434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"53'49","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.639995+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:02:58.639995+0000","last_peered":"2024-04-25T22:02:58.639995+0000","last_clean":"2024-04-25T22:02:58.639995+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:02:58.639995+0000","last_undegraded":"2024-04-25T22:02:58.639995+0000","last_fullsized":"2024-04-25T22:02:58.639995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154764,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.346821+0000","last_change":"2024-04-25T22:02:43.853012+0000","last_active":"2024-04-25T22:02:57.346821+0000","last_peered":"2024-04-25T22:02:57.346821+0000","last_clean":"2024-04-25T22:02:57.346821+0000","last_became_active":"2024-04-25T22:02:43.852338+0000","last_became_peered":"2024-04-25T22:02:43.852338+0000","last_unstale":"2024-04-25T22:02:57.346821+0000","last_undegraded":"2024-04-25T22:02:57.346821+0000","last_fullsized":"2024-04-25T22:02:57.346821+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:07.951790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"53'55","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.435660+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:02:58.435660+0000","last_peered":"2024-04-25T22:02:58.435660+0000","last_clean":"2024-04-25T22:02:58.435660+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:02:58.435660+0000","last_undegraded":"2024-04-25T22:02:58.435660+0000","last_fullsized":"2024-04-25T22:02:58.435660+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199620,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.347083+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:02:57.347083+0000","last_peered":"2024-04-25T22:02:57.347083+0000","last_clean":"2024-04-25T22:02:57.347083+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:02:57.347083+0000","last_undegraded":"2024-04-25T22:02:57.347083+0000","last_fullsized":"2024-04-25T22:02:57.347083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"53'50","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.876505+0000","last_change":"2024-04-25T22:02:43.853286+0000","last_active":"2024-04-25T22:02:57.876505+0000","last_peered":"2024-04-25T22:02:57.876505+0000","last_clean":"2024-04-25T22:02:57.876505+0000","last_became_active":"2024-04-25T22:02:43.852555+0000","last_became_peered":"2024-04-25T22:02:43.852555+0000","last_unstale":"2024-04-25T22:02:57.876505+0000","last_undegraded":"2024-04-25T22:02:57.876505+0000","last_fullsized":"2024-04-25T22:02:57.876505+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:42:10.005523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170893,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.342346+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:02:57.342346+0000","last_peered":"2024-04-25T22:02:57.342346+0000","last_clean":"2024-04-25T22:02:57.342346+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:02:57.342346+0000","last_undegraded":"2024-04-25T22:02:57.342346+0000","last_fullsized":"2024-04-25T22:02:57.342346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"53'48","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.310638+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:02:58.310638+0000","last_peered":"2024-04-25T22:02:58.310638+0000","last_clean":"2024-04-25T22:02:58.310638+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:02:58.310638+0000","last_undegraded":"2024-04-25T22:02:58.310638+0000","last_fullsized":"2024-04-25T22:02:58.310638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158671,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.341640+0000","last_change":"2024-04-25T22:02:49.884995+0000","last_active":"2024-04-25T22:02:57.341640+0000","last_peered":"2024-04-25T22:02:57.341640+0000","last_clean":"2024-04-25T22:02:57.341640+0000","last_became_active":"2024-04-25T22:02:49.883112+0000","last_became_peered":"2024-04-25T22:02:49.883112+0000","last_unstale":"2024-04-25T22:02:57.341640+0000","last_undegraded":"2024-04-25T22:02:57.341640+0000","last_fullsized":"2024-04-25T22:02:57.341640+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:45.254613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"53'34","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.611151+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:02:58.611151+0000","last_peered":"2024-04-25T22:02:58.611151+0000","last_clean":"2024-04-25T22:02:58.611151+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:02:58.611151+0000","last_undegraded":"2024-04-25T22:02:58.611151+0000","last_fullsized":"2024-04-25T22:02:58.611151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130899,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.344920+0000","last_change":"2024-04-25T22:02:49.878347+0000","last_active":"2024-04-25T22:02:57.344920+0000","last_peered":"2024-04-25T22:02:57.344920+0000","last_clean":"2024-04-25T22:02:57.344920+0000","last_became_active":"2024-04-25T22:02:49.876980+0000","last_became_peered":"2024-04-25T22:02:49.876980+0000","last_unstale":"2024-04-25T22:02:57.344920+0000","last_undegraded":"2024-04-25T22:02:57.344920+0000","last_fullsized":"2024-04-25T22:02:57.344920+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:49.595210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"53'44","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.380074+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:02:58.380074+0000","last_peered":"2024-04-25T22:02:58.380074+0000","last_clean":"2024-04-25T22:02:58.380074+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:02:58.380074+0000","last_undegraded":"2024-04-25T22:02:58.380074+0000","last_fullsized":"2024-04-25T22:02:58.380074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125378,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":291,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.342424+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:02:57.342424+0000","last_peered":"2024-04-25T22:02:57.342424+0000","last_clean":"2024-04-25T22:02:57.342424+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:02:57.342424+0000","last_undegraded":"2024-04-25T22:02:57.342424+0000","last_fullsized":"2024-04-25T22:02:57.342424+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.343990+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:02:57.343990+0000","last_peered":"2024-04-25T22:02:57.343990+0000","last_clean":"2024-04-25T22:02:57.343990+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:02:57.343990+0000","last_undegraded":"2024-04-25T22:02:57.343990+0000","last_fullsized":"2024-04-25T22:02:57.343990+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.346412+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:02:57.346412+0000","last_peered":"2024-04-25T22:02:57.346412+0000","last_clean":"2024-04-25T22:02:57.346412+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:02:57.346412+0000","last_undegraded":"2024-04-25T22:02:57.346412+0000","last_fullsized":"2024-04-25T22:02:57.346412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"53'47","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.299206+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:02:58.299206+0000","last_peered":"2024-04-25T22:02:58.299206+0000","last_clean":"2024-04-25T22:02:58.299206+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:02:58.299206+0000","last_undegraded":"2024-04-25T22:02:58.299206+0000","last_fullsized":"2024-04-25T22:02:58.299206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125977,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.342230+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:02:57.342230+0000","last_peered":"2024-04-25T22:02:57.342230+0000","last_clean":"2024-04-25T22:02:57.342230+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:02:57.342230+0000","last_undegraded":"2024-04-25T22:02:57.342230+0000","last_fullsized":"2024-04-25T22:02:57.342230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.345667+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:02:57.345667+0000","last_peered":"2024-04-25T22:02:57.345667+0000","last_clean":"2024-04-25T22:02:57.345667+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:02:57.345667+0000","last_undegraded":"2024-04-25T22:02:57.345667+0000","last_fullsized":"2024-04-25T22:02:57.345667+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"53'53","reported_seq":71,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.555266+0000","last_change":"2024-04-25T22:02:49.884767+0000","last_active":"2024-04-25T22:02:58.555266+0000","last_peered":"2024-04-25T22:02:58.555266+0000","last_clean":"2024-04-25T22:02:58.555266+0000","last_became_active":"2024-04-25T22:02:49.884289+0000","last_became_peered":"2024-04-25T22:02:49.884289+0000","last_unstale":"2024-04-25T22:02:58.555266+0000","last_undegraded":"2024-04-25T22:02:58.555266+0000","last_fullsized":"2024-04-25T22:02:58.555266+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:21.251127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197755,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.345947+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:02:57.345947+0000","last_peered":"2024-04-25T22:02:57.345947+0000","last_clean":"2024-04-25T22:02:57.345947+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:02:57.345947+0000","last_undegraded":"2024-04-25T22:02:57.345947+0000","last_fullsized":"2024-04-25T22:02:57.345947+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.342117+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:02:57.342117+0000","last_peered":"2024-04-25T22:02:57.342117+0000","last_clean":"2024-04-25T22:02:57.342117+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:02:57.342117+0000","last_undegraded":"2024-04-25T22:02:57.342117+0000","last_fullsized":"2024-04-25T22:02:57.342117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"53'47","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.355924+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:02:58.355924+0000","last_peered":"2024-04-25T22:02:58.355924+0000","last_clean":"2024-04-25T22:02:58.355924+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:02:58.355924+0000","last_undegraded":"2024-04-25T22:02:58.355924+0000","last_fullsized":"2024-04-25T22:02:58.355924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151700,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.342511+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:02:57.342511+0000","last_peered":"2024-04-25T22:02:57.342511+0000","last_clean":"2024-04-25T22:02:57.342511+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:02:57.342511+0000","last_undegraded":"2024-04-25T22:02:57.342511+0000","last_fullsized":"2024-04-25T22:02:57.342511+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.346490+0000","last_change":"2024-04-25T22:02:43.851416+0000","last_active":"2024-04-25T22:02:57.346490+0000","last_peered":"2024-04-25T22:02:57.346490+0000","last_clean":"2024-04-25T22:02:57.346490+0000","last_became_active":"2024-04-25T22:02:43.850822+0000","last_became_peered":"2024-04-25T22:02:43.850822+0000","last_unstale":"2024-04-25T22:02:57.346490+0000","last_undegraded":"2024-04-25T22:02:57.346490+0000","last_fullsized":"2024-04-25T22:02:57.346490+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:56:58.100216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"53'44","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.576486+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:02:58.576486+0000","last_peered":"2024-04-25T22:02:58.576486+0000","last_clean":"2024-04-25T22:02:58.576486+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:02:58.576486+0000","last_undegraded":"2024-04-25T22:02:58.576486+0000","last_fullsized":"2024-04-25T22:02:58.576486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175567,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.344452+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:02:57.344452+0000","last_peered":"2024-04-25T22:02:57.344452+0000","last_clean":"2024-04-25T22:02:57.344452+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:02:57.344452+0000","last_undegraded":"2024-04-25T22:02:57.344452+0000","last_fullsized":"2024-04-25T22:02:57.344452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.347504+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:02:57.347504+0000","last_peered":"2024-04-25T22:02:57.347504+0000","last_clean":"2024-04-25T22:02:57.347504+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:02:57.347504+0000","last_undegraded":"2024-04-25T22:02:57.347504+0000","last_fullsized":"2024-04-25T22:02:57.347504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"53'46","reported_seq":64,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.276725+0000","last_change":"2024-04-25T22:02:49.884459+0000","last_active":"2024-04-25T22:02:58.276725+0000","last_peered":"2024-04-25T22:02:58.276725+0000","last_clean":"2024-04-25T22:02:58.276725+0000","last_became_active":"2024-04-25T22:02:49.883467+0000","last_became_peered":"2024-04-25T22:02:49.883467+0000","last_unstale":"2024-04-25T22:02:58.276725+0000","last_undegraded":"2024-04-25T22:02:58.276725+0000","last_fullsized":"2024-04-25T22:02:58.276725+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:31.024577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128145,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.347391+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:02:57.347391+0000","last_peered":"2024-04-25T22:02:57.347391+0000","last_clean":"2024-04-25T22:02:57.347391+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:02:57.347391+0000","last_undegraded":"2024-04-25T22:02:57.347391+0000","last_fullsized":"2024-04-25T22:02:57.347391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.347140+0000","last_change":"2024-04-25T22:02:49.883875+0000","last_active":"2024-04-25T22:02:57.347140+0000","last_peered":"2024-04-25T22:02:57.347140+0000","last_clean":"2024-04-25T22:02:57.347140+0000","last_became_active":"2024-04-25T22:02:49.883397+0000","last_became_peered":"2024-04-25T22:02:49.883397+0000","last_unstale":"2024-04-25T22:02:57.347140+0000","last_undegraded":"2024-04-25T22:02:57.347140+0000","last_fullsized":"2024-04-25T22:02:57.347140+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:08.239628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"53'49","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.540971+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:02:58.540971+0000","last_peered":"2024-04-25T22:02:58.540971+0000","last_clean":"2024-04-25T22:02:58.540971+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:02:58.540971+0000","last_undegraded":"2024-04-25T22:02:58.540971+0000","last_fullsized":"2024-04-25T22:02:58.540971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166883,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.348725+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:02:57.348725+0000","last_peered":"2024-04-25T22:02:57.348725+0000","last_clean":"2024-04-25T22:02:57.348725+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:02:57.348725+0000","last_undegraded":"2024-04-25T22:02:57.348725+0000","last_fullsized":"2024-04-25T22:02:57.348725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.348367+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:02:57.348367+0000","last_peered":"2024-04-25T22:02:57.348367+0000","last_clean":"2024-04-25T22:02:57.348367+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:02:57.348367+0000","last_undegraded":"2024-04-25T22:02:57.348367+0000","last_fullsized":"2024-04-25T22:02:57.348367+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"53'44","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.643863+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:02:58.643863+0000","last_peered":"2024-04-25T22:02:58.643863+0000","last_clean":"2024-04-25T22:02:58.643863+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:02:58.643863+0000","last_undegraded":"2024-04-25T22:02:58.643863+0000","last_fullsized":"2024-04-25T22:02:58.643863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213715,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"53'11","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.656926+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:02:57.656926+0000","last_peered":"2024-04-25T22:02:57.656926+0000","last_clean":"2024-04-25T22:02:57.656926+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:02:57.656926+0000","last_undegraded":"2024-04-25T22:02:57.656926+0000","last_fullsized":"2024-04-25T22:02:57.656926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.343622+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:02:57.343622+0000","last_peered":"2024-04-25T22:02:57.343622+0000","last_clean":"2024-04-25T22:02:57.343622+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:02:57.343622+0000","last_undegraded":"2024-04-25T22:02:57.343622+0000","last_fullsized":"2024-04-25T22:02:57.343622+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"53'43","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.111692+0000","last_change":"2024-04-25T22:02:49.881600+0000","last_active":"2024-04-25T22:02:58.111692+0000","last_peered":"2024-04-25T22:02:58.111692+0000","last_clean":"2024-04-25T22:02:58.111692+0000","last_became_active":"2024-04-25T22:02:49.880681+0000","last_became_peered":"2024-04-25T22:02:49.880681+0000","last_unstale":"2024-04-25T22:02:58.111692+0000","last_undegraded":"2024-04-25T22:02:58.111692+0000","last_fullsized":"2024-04-25T22:02:58.111692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.432134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97360,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"53'50","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.382842+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:02:58.382842+0000","last_peered":"2024-04-25T22:02:58.382842+0000","last_clean":"2024-04-25T22:02:58.382842+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:02:58.382842+0000","last_undegraded":"2024-04-25T22:02:58.382842+0000","last_fullsized":"2024-04-25T22:02:58.382842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2476796,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":2445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"52'21","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.343286+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:02:57.343286+0000","last_peered":"2024-04-25T22:02:57.343286+0000","last_clean":"2024-04-25T22:02:57.343286+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:02:57.343286+0000","last_undegraded":"2024-04-25T22:02:57.343286+0000","last_fullsized":"2024-04-25T22:02:57.343286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"53'47","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.045156+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:02:58.045156+0000","last_peered":"2024-04-25T22:02:58.045156+0000","last_clean":"2024-04-25T22:02:58.045156+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:02:58.045156+0000","last_undegraded":"2024-04-25T22:02:58.045156+0000","last_fullsized":"2024-04-25T22:02:58.045156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239301,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.343827+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:02:57.343827+0000","last_peered":"2024-04-25T22:02:57.343827+0000","last_clean":"2024-04-25T22:02:57.343827+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:02:57.343827+0000","last_undegraded":"2024-04-25T22:02:57.343827+0000","last_fullsized":"2024-04-25T22:02:57.343827+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.347026+0000","last_change":"2024-04-25T22:02:43.852674+0000","last_active":"2024-04-25T22:02:57.347026+0000","last_peered":"2024-04-25T22:02:57.347026+0000","last_clean":"2024-04-25T22:02:57.347026+0000","last_became_active":"2024-04-25T22:02:43.852292+0000","last_became_peered":"2024-04-25T22:02:43.852292+0000","last_unstale":"2024-04-25T22:02:57.347026+0000","last_undegraded":"2024-04-25T22:02:57.347026+0000","last_fullsized":"2024-04-25T22:02:57.347026+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:57.388397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"53'50","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.393778+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:02:58.393778+0000","last_peered":"2024-04-25T22:02:58.393778+0000","last_clean":"2024-04-25T22:02:58.393778+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:02:58.393778+0000","last_undegraded":"2024-04-25T22:02:58.393778+0000","last_fullsized":"2024-04-25T22:02:58.393778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":795472,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.348503+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:02:57.348503+0000","last_peered":"2024-04-25T22:02:57.348503+0000","last_clean":"2024-04-25T22:02:57.348503+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:02:57.348503+0000","last_undegraded":"2024-04-25T22:02:57.348503+0000","last_fullsized":"2024-04-25T22:02:57.348503+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"53'48","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.369404+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:02:58.369404+0000","last_peered":"2024-04-25T22:02:58.369404+0000","last_clean":"2024-04-25T22:02:58.369404+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:02:58.369404+0000","last_undegraded":"2024-04-25T22:02:58.369404+0000","last_fullsized":"2024-04-25T22:02:58.369404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4366711,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"53'53","reported_seq":71,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.992281+0000","last_change":"2024-04-25T22:02:49.884155+0000","last_active":"2024-04-25T22:02:57.992281+0000","last_peered":"2024-04-25T22:02:57.992281+0000","last_clean":"2024-04-25T22:02:57.992281+0000","last_became_active":"2024-04-25T22:02:49.883314+0000","last_became_peered":"2024-04-25T22:02:49.883314+0000","last_unstale":"2024-04-25T22:02:57.992281+0000","last_undegraded":"2024-04-25T22:02:57.992281+0000","last_fullsized":"2024-04-25T22:02:57.992281+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:53:47.483774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":777540,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.345892+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:02:57.345892+0000","last_peered":"2024-04-25T22:02:57.345892+0000","last_clean":"2024-04-25T22:02:57.345892+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:02:57.345892+0000","last_undegraded":"2024-04-25T22:02:57.345892+0000","last_fullsized":"2024-04-25T22:02:57.345892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"53'48","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.532495+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:02:58.532495+0000","last_peered":"2024-04-25T22:02:58.532495+0000","last_clean":"2024-04-25T22:02:58.532495+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:02:58.532495+0000","last_undegraded":"2024-04-25T22:02:58.532495+0000","last_fullsized":"2024-04-25T22:02:58.532495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148671,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.345480+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:02:57.345480+0000","last_peered":"2024-04-25T22:02:57.345480+0000","last_clean":"2024-04-25T22:02:57.345480+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:02:57.345480+0000","last_undegraded":"2024-04-25T22:02:57.345480+0000","last_fullsized":"2024-04-25T22:02:57.345480+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"53'45","reported_seq":63,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.122260+0000","last_change":"2024-04-25T22:02:49.887569+0000","last_active":"2024-04-25T22:02:58.122260+0000","last_peered":"2024-04-25T22:02:58.122260+0000","last_clean":"2024-04-25T22:02:58.122260+0000","last_became_active":"2024-04-25T22:02:49.886732+0000","last_became_peered":"2024-04-25T22:02:49.886732+0000","last_unstale":"2024-04-25T22:02:58.122260+0000","last_undegraded":"2024-04-25T22:02:58.122260+0000","last_fullsized":"2024-04-25T22:02:58.122260+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:38.761184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147870,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.345123+0000","last_change":"2024-04-25T22:02:49.877703+0000","last_active":"2024-04-25T22:02:57.345123+0000","last_peered":"2024-04-25T22:02:57.345123+0000","last_clean":"2024-04-25T22:02:57.345123+0000","last_became_active":"2024-04-25T22:02:49.876443+0000","last_became_peered":"2024-04-25T22:02:49.876443+0000","last_unstale":"2024-04-25T22:02:57.345123+0000","last_undegraded":"2024-04-25T22:02:57.345123+0000","last_fullsized":"2024-04-25T22:02:57.345123+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:47.870352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"53'46","reported_seq":64,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.432009+0000","last_change":"2024-04-25T22:02:49.882913+0000","last_active":"2024-04-25T22:02:58.432009+0000","last_peered":"2024-04-25T22:02:58.432009+0000","last_clean":"2024-04-25T22:02:58.432009+0000","last_became_active":"2024-04-25T22:02:49.882175+0000","last_became_peered":"2024-04-25T22:02:49.882175+0000","last_unstale":"2024-04-25T22:02:58.432009+0000","last_undegraded":"2024-04-25T22:02:58.432009+0000","last_fullsized":"2024-04-25T22:02:58.432009+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:31.024577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295158,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"53'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.343085+0000","last_change":"2024-04-25T22:02:49.886319+0000","last_active":"2024-04-25T22:02:57.343085+0000","last_peered":"2024-04-25T22:02:57.343085+0000","last_clean":"2024-04-25T22:02:57.343085+0000","last_became_active":"2024-04-25T22:02:49.884039+0000","last_became_peered":"2024-04-25T22:02:49.884039+0000","last_unstale":"2024-04-25T22:02:57.343085+0000","last_undegraded":"2024-04-25T22:02:57.343085+0000","last_fullsized":"2024-04-25T22:02:57.343085+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:11.405616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1888122,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"53'47","reported_seq":71,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.487881+0000","last_change":"2024-04-25T22:02:43.850869+0000","last_active":"2024-04-25T22:02:58.487881+0000","last_peered":"2024-04-25T22:02:58.487881+0000","last_clean":"2024-04-25T22:02:58.487881+0000","last_became_active":"2024-04-25T22:02:43.850568+0000","last_became_peered":"2024-04-25T22:02:43.850568+0000","last_unstale":"2024-04-25T22:02:58.487881+0000","last_undegraded":"2024-04-25T22:02:58.487881+0000","last_fullsized":"2024-04-25T22:02:58.487881+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:10:32.881419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147277,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":34,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.346163+0000","last_change":"2024-04-25T22:02:43.853253+0000","last_active":"2024-04-25T22:02:57.346163+0000","last_peered":"2024-04-25T22:02:57.346163+0000","last_clean":"2024-04-25T22:02:57.346163+0000","last_became_active":"2024-04-25T22:02:43.852769+0000","last_became_peered":"2024-04-25T22:02:43.852769+0000","last_unstale":"2024-04-25T22:02:57.346163+0000","last_undegraded":"2024-04-25T22:02:57.346163+0000","last_fullsized":"2024-04-25T22:02:57.346163+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:51:36.457092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"53'41","reported_seq":65,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.303050+0000","last_change":"2024-04-25T22:02:43.852778+0000","last_active":"2024-04-25T22:02:58.303050+0000","last_peered":"2024-04-25T22:02:58.303050+0000","last_clean":"2024-04-25T22:02:58.303050+0000","last_became_active":"2024-04-25T22:02:43.852263+0000","last_became_peered":"2024-04-25T22:02:43.852263+0000","last_unstale":"2024-04-25T22:02:58.303050+0000","last_undegraded":"2024-04-25T22:02:58.303050+0000","last_fullsized":"2024-04-25T22:02:58.303050+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:10:40.487543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101611,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"52'3","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.342827+0000","last_change":"2024-04-25T22:02:49.887527+0000","last_active":"2024-04-25T22:02:57.342827+0000","last_peered":"2024-04-25T22:02:57.342827+0000","last_clean":"2024-04-25T22:02:57.342827+0000","last_became_active":"2024-04-25T22:02:49.886150+0000","last_became_peered":"2024-04-25T22:02:49.886150+0000","last_unstale":"2024-04-25T22:02:57.342827+0000","last_undegraded":"2024-04-25T22:02:57.342827+0000","last_fullsized":"2024-04-25T22:02:57.342827+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:23:43.687342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"53'50","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.375337+0000","last_change":"2024-04-25T22:02:49.876491+0000","last_active":"2024-04-25T22:02:58.375337+0000","last_peered":"2024-04-25T22:02:58.375337+0000","last_clean":"2024-04-25T22:02:58.375337+0000","last_became_active":"2024-04-25T22:02:49.876169+0000","last_became_peered":"2024-04-25T22:02:49.876169+0000","last_unstale":"2024-04-25T22:02:58.375337+0000","last_undegraded":"2024-04-25T22:02:58.375337+0000","last_fullsized":"2024-04-25T22:02:58.375337+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:56:41.591010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164422,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.347733+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:02:57.347733+0000","last_peered":"2024-04-25T22:02:57.347733+0000","last_clean":"2024-04-25T22:02:57.347733+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:02:57.347733+0000","last_undegraded":"2024-04-25T22:02:57.347733+0000","last_fullsized":"2024-04-25T22:02:57.347733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"53'63","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.320073+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:02:58.320073+0000","last_peered":"2024-04-25T22:02:58.320073+0000","last_clean":"2024-04-25T22:02:58.320073+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:02:58.320073+0000","last_undegraded":"2024-04-25T22:02:58.320073+0000","last_fullsized":"2024-04-25T22:02:58.320073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165727,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.348216+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:02:57.348216+0000","last_peered":"2024-04-25T22:02:57.348216+0000","last_clean":"2024-04-25T22:02:57.348216+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:02:57.348216+0000","last_undegraded":"2024-04-25T22:02:57.348216+0000","last_fullsized":"2024-04-25T22:02:57.348216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":23490234,"num_objects":3111,"num_object_clones":0,"num_object_copies":6222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3111,"num_write_kb":24624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":52477952,"data_stored":46983184,"data_compressed":2390178,"data_compressed_allocated":3211264,"data_compressed_original":11649024,"omap_allocated":0,"internal_metadata":0},"log_size":3112,"ondisk_log_size":3112,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":6083896,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":6254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1679360,"data_stored":12167792,"data_compressed":1115112,"data_compressed_allocated":1523712,"data_compressed_original":12066816,"omap_allocated":0,"internal_metadata":0},"log_size":66,"ondisk_log_size":66,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738397,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60940,"kb_used_data":21444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94310900,"statfs":{"total":96636764160,"available":96574361600,"internally_reserved":0,"allocated":21958656,"data_stored":25412552,"data_compressed":1428733,"data_compressed_allocated":1908736,"data_compressed_original":10035200,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738396,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49472,"kb_used_data":14132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322368,"statfs":{"total":96636764160,"available":96586104832,"internally_reserved":0,"allocated":14471168,"data_stored":11401983,"data_compressed":520268,"data_compressed_allocated":757760,"data_compressed_original":2371584,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56512,"kb_used_data":17012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315328,"statfs":{"total":96636764160,"available":96578895872,"internally_reserved":0,"allocated":17420288,"data_stored":20939233,"data_compressed":1387518,"data_compressed_allocated":1851392,"data_compressed_original":9916416,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":839680,"data_stored":6083896,"data_compressed":557556,"data_compressed_allocated":761856,"data_compressed_original":6033408,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":831488,"data_stored":6083280,"data_compressed":557556,"data_compressed_allocated":761856,"data_compressed_original":6033408,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16617472,"data_stored":15149332,"data_compressed":878962,"data_compressed_allocated":1146880,"data_compressed_original":4202496,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15056896,"data_stored":13144660,"data_compressed":629825,"data_compressed_allocated":929792,"data_compressed_original":3932160,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20803584,"data_stored":18689192,"data_compressed":881391,"data_compressed_allocated":1134592,"data_compressed_original":3514368,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:03:03.054 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:03:03.132 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:03.133 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:03.135 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:03.128+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:03.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:03.236 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:03.232+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:03.315 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:03.315 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:03.329 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:03.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:03.333+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:03.420 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:03:03.422 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:03:03.437 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:03.432+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:03.437 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-04-25T22:03:02.670045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30164498,"num_objects":3136,"num_object_clones":0,"num_object_copies":6272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3136,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":3397,"num_write_kb":34338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3335,"ondisk_log_size":3335,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":166924,"kb_used_data":52588,"kb_used_omap":4,"kb_used_meta":114299,"kb_avail":282948596,"statfs":{"total":289910292480,"available":289739362304,"internally_reserved":0,"allocated":53850112,"data_stored":57753768,"data_compressed":3336519,"data_compressed_allocated":4517888,"data_compressed_original":22323200,"omap_allocated":4785,"internal_metadata":117042511},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15122473,"num_objects":2429,"num_object_clones":0,"num_object_copies":4858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2429,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2444,"num_write_kb":16252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.328737"},"pg_stats":[{"pgid":"4.3f","version":"53'41","reported_seq":59,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.371125+0000","last_change":"2024-04-25T22:02:49.882976+0000","last_active":"2024-04-25T22:02:58.371125+0000","last_peered":"2024-04-25T22:02:58.371125+0000","last_clean":"2024-04-25T22:02:58.371125+0000","last_became_active":"2024-04-25T22:02:49.882308+0000","last_became_peered":"2024-04-25T22:02:49.882308+0000","last_unstale":"2024-04-25T22:02:58.371125+0000","last_undegraded":"2024-04-25T22:02:58.371125+0000","last_fullsized":"2024-04-25T22:02:58.371125+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:46.257798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125137,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"53'45","reported_seq":63,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.245585+0000","last_change":"2024-04-25T22:02:49.882947+0000","last_active":"2024-04-25T22:02:58.245585+0000","last_peered":"2024-04-25T22:02:58.245585+0000","last_clean":"2024-04-25T22:02:58.245585+0000","last_became_active":"2024-04-25T22:02:49.882192+0000","last_became_peered":"2024-04-25T22:02:49.882192+0000","last_unstale":"2024-04-25T22:02:58.245585+0000","last_undegraded":"2024-04-25T22:02:58.245585+0000","last_fullsized":"2024-04-25T22:02:58.245585+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:07.474272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177929,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"53'52","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.935763+0000","last_change":"2024-04-25T22:02:49.886973+0000","last_active":"2024-04-25T22:02:57.935763+0000","last_peered":"2024-04-25T22:02:57.935763+0000","last_clean":"2024-04-25T22:02:57.935763+0000","last_became_active":"2024-04-25T22:02:49.884097+0000","last_became_peered":"2024-04-25T22:02:49.884097+0000","last_unstale":"2024-04-25T22:02:57.935763+0000","last_undegraded":"2024-04-25T22:02:57.935763+0000","last_fullsized":"2024-04-25T22:02:57.935763+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171750,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"53'28","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.869342+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:02:57.869342+0000","last_peered":"2024-04-25T22:02:57.869342+0000","last_clean":"2024-04-25T22:02:57.869342+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:02:57.869342+0000","last_undegraded":"2024-04-25T22:02:57.869342+0000","last_fullsized":"2024-04-25T22:02:57.869342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120190,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"53'57","reported_seq":75,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.358883+0000","last_change":"2024-04-25T22:02:49.879514+0000","last_active":"2024-04-25T22:02:58.358883+0000","last_peered":"2024-04-25T22:02:58.358883+0000","last_clean":"2024-04-25T22:02:58.358883+0000","last_became_active":"2024-04-25T22:02:49.878964+0000","last_became_peered":"2024-04-25T22:02:49.878964+0000","last_unstale":"2024-04-25T22:02:58.358883+0000","last_undegraded":"2024-04-25T22:02:58.358883+0000","last_fullsized":"2024-04-25T22:02:58.358883+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.432134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176240,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"53'44","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.306510+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:02:58.306510+0000","last_peered":"2024-04-25T22:02:58.306510+0000","last_clean":"2024-04-25T22:02:58.306510+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:02:58.306510+0000","last_undegraded":"2024-04-25T22:02:58.306510+0000","last_fullsized":"2024-04-25T22:02:58.306510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139138,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"53'53","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.603855+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:02:58.603855+0000","last_peered":"2024-04-25T22:02:58.603855+0000","last_clean":"2024-04-25T22:02:58.603855+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:02:58.603855+0000","last_undegraded":"2024-04-25T22:02:58.603855+0000","last_fullsized":"2024-04-25T22:02:58.603855+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128972,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"53'46","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.455084+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:02:58.455084+0000","last_peered":"2024-04-25T22:02:58.455084+0000","last_clean":"2024-04-25T22:02:58.455084+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:02:58.455084+0000","last_undegraded":"2024-04-25T22:02:58.455084+0000","last_fullsized":"2024-04-25T22:02:58.455084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221210,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"53'48","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.401085+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:02:58.401085+0000","last_peered":"2024-04-25T22:02:58.401085+0000","last_clean":"2024-04-25T22:02:58.401085+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:02:58.401085+0000","last_undegraded":"2024-04-25T22:02:58.401085+0000","last_fullsized":"2024-04-25T22:02:58.401085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161598,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"53'47","reported_seq":65,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.560297+0000","last_change":"2024-04-25T22:02:49.885137+0000","last_active":"2024-04-25T22:02:58.560297+0000","last_peered":"2024-04-25T22:02:58.560297+0000","last_clean":"2024-04-25T22:02:58.560297+0000","last_became_active":"2024-04-25T22:02:49.884276+0000","last_became_peered":"2024-04-25T22:02:49.884276+0000","last_unstale":"2024-04-25T22:02:58.560297+0000","last_undegraded":"2024-04-25T22:02:58.560297+0000","last_fullsized":"2024-04-25T22:02:58.560297+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:12.408801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182589,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"53'51","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.178919+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:02:58.178919+0000","last_peered":"2024-04-25T22:02:58.178919+0000","last_clean":"2024-04-25T22:02:58.178919+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:02:58.178919+0000","last_undegraded":"2024-04-25T22:02:58.178919+0000","last_fullsized":"2024-04-25T22:02:58.178919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156527,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"53'42","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.342615+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:02:58.342615+0000","last_peered":"2024-04-25T22:02:58.342615+0000","last_clean":"2024-04-25T22:02:58.342615+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:02:58.342615+0000","last_undegraded":"2024-04-25T22:02:58.342615+0000","last_fullsized":"2024-04-25T22:02:58.342615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125660,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"53'38","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.187544+0000","last_change":"2024-04-25T22:02:49.878698+0000","last_active":"2024-04-25T22:02:58.187544+0000","last_peered":"2024-04-25T22:02:58.187544+0000","last_clean":"2024-04-25T22:02:58.187544+0000","last_became_active":"2024-04-25T22:02:49.878377+0000","last_became_peered":"2024-04-25T22:02:49.878377+0000","last_unstale":"2024-04-25T22:02:58.187544+0000","last_undegraded":"2024-04-25T22:02:58.187544+0000","last_fullsized":"2024-04-25T22:02:58.187544+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:31:39.262571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131746,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"53'59","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.533836+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:02:58.533836+0000","last_peered":"2024-04-25T22:02:58.533836+0000","last_clean":"2024-04-25T22:02:58.533836+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:02:58.533836+0000","last_undegraded":"2024-04-25T22:02:58.533836+0000","last_fullsized":"2024-04-25T22:02:58.533836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4576654,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"53'49","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.439526+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:02:58.439526+0000","last_peered":"2024-04-25T22:02:58.439526+0000","last_clean":"2024-04-25T22:02:58.439526+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:02:58.439526+0000","last_undegraded":"2024-04-25T22:02:58.439526+0000","last_fullsized":"2024-04-25T22:02:58.439526+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112606,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"53'57","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.408634+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:02:58.408634+0000","last_peered":"2024-04-25T22:02:58.408634+0000","last_clean":"2024-04-25T22:02:58.408634+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:02:58.408634+0000","last_undegraded":"2024-04-25T22:02:58.408634+0000","last_fullsized":"2024-04-25T22:02:58.408634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172474,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"53'53","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.279735+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:02:58.279735+0000","last_peered":"2024-04-25T22:02:58.279735+0000","last_clean":"2024-04-25T22:02:58.279735+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:02:58.279735+0000","last_undegraded":"2024-04-25T22:02:58.279735+0000","last_fullsized":"2024-04-25T22:02:58.279735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124423,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"53'55","reported_seq":73,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.406815+0000","last_change":"2024-04-25T22:02:49.885489+0000","last_active":"2024-04-25T22:02:58.406815+0000","last_peered":"2024-04-25T22:02:58.406815+0000","last_clean":"2024-04-25T22:02:58.406815+0000","last_became_active":"2024-04-25T22:02:49.884784+0000","last_became_peered":"2024-04-25T22:02:49.884784+0000","last_unstale":"2024-04-25T22:02:58.406815+0000","last_undegraded":"2024-04-25T22:02:58.406815+0000","last_fullsized":"2024-04-25T22:02:58.406815+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131227,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"53'48","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.483038+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:02:58.483038+0000","last_peered":"2024-04-25T22:02:58.483038+0000","last_clean":"2024-04-25T22:02:58.483038+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:02:58.483038+0000","last_undegraded":"2024-04-25T22:02:58.483038+0000","last_fullsized":"2024-04-25T22:02:58.483038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159928,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"53'56","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.206004+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:02:58.206004+0000","last_peered":"2024-04-25T22:02:58.206004+0000","last_clean":"2024-04-25T22:02:58.206004+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:02:58.206004+0000","last_undegraded":"2024-04-25T22:02:58.206004+0000","last_fullsized":"2024-04-25T22:02:58.206004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126750,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"53'53","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.426765+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:02:58.426765+0000","last_peered":"2024-04-25T22:02:58.426765+0000","last_clean":"2024-04-25T22:02:58.426765+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:02:58.426765+0000","last_undegraded":"2024-04-25T22:02:58.426765+0000","last_fullsized":"2024-04-25T22:02:58.426765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136446,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"53'57","reported_seq":75,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.421052+0000","last_change":"2024-04-25T22:02:49.886169+0000","last_active":"2024-04-25T22:02:58.421052+0000","last_peered":"2024-04-25T22:02:58.421052+0000","last_clean":"2024-04-25T22:02:58.421052+0000","last_became_active":"2024-04-25T22:02:49.884516+0000","last_became_peered":"2024-04-25T22:02:49.884516+0000","last_unstale":"2024-04-25T22:02:58.421052+0000","last_undegraded":"2024-04-25T22:02:58.421052+0000","last_fullsized":"2024-04-25T22:02:58.421052+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:21.251127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264278,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"53'56","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.455592+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:02:58.455592+0000","last_peered":"2024-04-25T22:02:58.455592+0000","last_clean":"2024-04-25T22:02:58.455592+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:02:58.455592+0000","last_undegraded":"2024-04-25T22:02:58.455592+0000","last_fullsized":"2024-04-25T22:02:58.455592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639950,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"53'49","reported_seq":67,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.564102+0000","last_change":"2024-04-25T22:02:49.876986+0000","last_active":"2024-04-25T22:02:58.564102+0000","last_peered":"2024-04-25T22:02:58.564102+0000","last_clean":"2024-04-25T22:02:58.564102+0000","last_became_active":"2024-04-25T22:02:49.876269+0000","last_became_peered":"2024-04-25T22:02:49.876269+0000","last_unstale":"2024-04-25T22:02:58.564102+0000","last_undegraded":"2024-04-25T22:02:58.564102+0000","last_fullsized":"2024-04-25T22:02:58.564102+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:35:35.547810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260522,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"53'49","reported_seq":67,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.124619+0000","last_change":"2024-04-25T22:02:49.881388+0000","last_active":"2024-04-25T22:02:58.124619+0000","last_peered":"2024-04-25T22:02:58.124619+0000","last_clean":"2024-04-25T22:02:58.124619+0000","last_became_active":"2024-04-25T22:02:49.880527+0000","last_became_peered":"2024-04-25T22:02:49.880527+0000","last_unstale":"2024-04-25T22:02:58.124619+0000","last_undegraded":"2024-04-25T22:02:58.124619+0000","last_fullsized":"2024-04-25T22:02:58.124619+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119464,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"53'54","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.400504+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:02:58.400504+0000","last_peered":"2024-04-25T22:02:58.400504+0000","last_clean":"2024-04-25T22:02:58.400504+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:02:58.400504+0000","last_undegraded":"2024-04-25T22:02:58.400504+0000","last_fullsized":"2024-04-25T22:02:58.400504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":253076,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"53'41","reported_seq":122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.350851+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:02:58.350851+0000","last_peered":"2024-04-25T22:02:58.350851+0000","last_clean":"2024-04-25T22:02:58.350851+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:02:58.350851+0000","last_undegraded":"2024-04-25T22:02:58.350851+0000","last_fullsized":"2024-04-25T22:02:58.350851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228838,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"53'51","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.162049+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:02:58.162049+0000","last_peered":"2024-04-25T22:02:58.162049+0000","last_clean":"2024-04-25T22:02:58.162049+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:02:58.162049+0000","last_undegraded":"2024-04-25T22:02:58.162049+0000","last_fullsized":"2024-04-25T22:02:58.162049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":232367,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"53'44","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.460938+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:02:58.460938+0000","last_peered":"2024-04-25T22:02:58.460938+0000","last_clean":"2024-04-25T22:02:58.460938+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:02:58.460938+0000","last_undegraded":"2024-04-25T22:02:58.460938+0000","last_fullsized":"2024-04-25T22:02:58.460938+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218834,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"53'59","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.308058+0000","last_change":"2024-04-25T22:02:49.885001+0000","last_active":"2024-04-25T22:02:58.308058+0000","last_peered":"2024-04-25T22:02:58.308058+0000","last_clean":"2024-04-25T22:02:58.308058+0000","last_became_active":"2024-04-25T22:02:49.883649+0000","last_became_peered":"2024-04-25T22:02:49.883649+0000","last_unstale":"2024-04-25T22:02:58.308058+0000","last_undegraded":"2024-04-25T22:02:58.308058+0000","last_fullsized":"2024-04-25T22:02:58.308058+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:07.474272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194744,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"53'54","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.481024+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:02:58.481024+0000","last_peered":"2024-04-25T22:02:58.481024+0000","last_clean":"2024-04-25T22:02:58.481024+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:02:58.481024+0000","last_undegraded":"2024-04-25T22:02:58.481024+0000","last_fullsized":"2024-04-25T22:02:58.481024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234190,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"53'55","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.394902+0000","last_change":"2024-04-25T22:02:43.850984+0000","last_active":"2024-04-25T22:02:58.394902+0000","last_peered":"2024-04-25T22:02:58.394902+0000","last_clean":"2024-04-25T22:02:58.394902+0000","last_became_active":"2024-04-25T22:02:43.850651+0000","last_became_peered":"2024-04-25T22:02:43.850651+0000","last_unstale":"2024-04-25T22:02:58.394902+0000","last_undegraded":"2024-04-25T22:02:58.394902+0000","last_fullsized":"2024-04-25T22:02:58.394902+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:08.019453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209819,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"53'43","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.462790+0000","last_change":"2024-04-25T22:02:49.881928+0000","last_active":"2024-04-25T22:02:58.462790+0000","last_peered":"2024-04-25T22:02:58.462790+0000","last_clean":"2024-04-25T22:02:58.462790+0000","last_became_active":"2024-04-25T22:02:49.881638+0000","last_became_peered":"2024-04-25T22:02:49.881638+0000","last_unstale":"2024-04-25T22:02:58.462790+0000","last_undegraded":"2024-04-25T22:02:58.462790+0000","last_fullsized":"2024-04-25T22:02:58.462790+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:53:47.483774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238669,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.343788+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:02:57.343788+0000","last_peered":"2024-04-25T22:02:57.343788+0000","last_clean":"2024-04-25T22:02:57.343788+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:02:57.343788+0000","last_undegraded":"2024-04-25T22:02:57.343788+0000","last_fullsized":"2024-04-25T22:02:57.343788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"53'44","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.836077+0000","last_change":"2024-04-25T22:02:49.882694+0000","last_active":"2024-04-25T22:02:57.836077+0000","last_peered":"2024-04-25T22:02:57.836077+0000","last_clean":"2024-04-25T22:02:57.836077+0000","last_became_active":"2024-04-25T22:02:49.882085+0000","last_became_peered":"2024-04-25T22:02:49.882085+0000","last_unstale":"2024-04-25T22:02:57.836077+0000","last_undegraded":"2024-04-25T22:02:57.836077+0000","last_fullsized":"2024-04-25T22:02:57.836077+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:56.743509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137413,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.345795+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:02:57.345795+0000","last_peered":"2024-04-25T22:02:57.345795+0000","last_clean":"2024-04-25T22:02:57.345795+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:02:57.345795+0000","last_undegraded":"2024-04-25T22:02:57.345795+0000","last_fullsized":"2024-04-25T22:02:57.345795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"53'57","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.407697+0000","last_change":"2024-04-25T22:01:14.648527+0000","last_active":"2024-04-25T22:02:58.407697+0000","last_peered":"2024-04-25T22:02:58.407697+0000","last_clean":"2024-04-25T22:02:58.407697+0000","last_became_active":"2024-04-25T22:01:14.645040+0000","last_became_peered":"2024-04-25T22:01:14.645040+0000","last_unstale":"2024-04-25T22:02:58.407697+0000","last_undegraded":"2024-04-25T22:02:58.407697+0000","last_fullsized":"2024-04-25T22:02:58.407697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298162,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.341925+0000","last_change":"2024-04-25T22:02:49.881219+0000","last_active":"2024-04-25T22:02:57.341925+0000","last_peered":"2024-04-25T22:02:57.341925+0000","last_clean":"2024-04-25T22:02:57.341925+0000","last_became_active":"2024-04-25T22:02:49.880475+0000","last_became_peered":"2024-04-25T22:02:49.880475+0000","last_unstale":"2024-04-25T22:02:57.341925+0000","last_undegraded":"2024-04-25T22:02:57.341925+0000","last_fullsized":"2024-04-25T22:02:57.341925+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:49.944264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"53'43","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.268071+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:02:58.268071+0000","last_peered":"2024-04-25T22:02:58.268071+0000","last_clean":"2024-04-25T22:02:58.268071+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:02:58.268071+0000","last_undegraded":"2024-04-25T22:02:58.268071+0000","last_fullsized":"2024-04-25T22:02:58.268071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101936,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.341947+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:02:57.341947+0000","last_peered":"2024-04-25T22:02:57.341947+0000","last_clean":"2024-04-25T22:02:57.341947+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:02:57.341947+0000","last_undegraded":"2024-04-25T22:02:57.341947+0000","last_fullsized":"2024-04-25T22:02:57.341947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.343590+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:02:57.343590+0000","last_peered":"2024-04-25T22:02:57.343590+0000","last_clean":"2024-04-25T22:02:57.343590+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:02:57.343590+0000","last_undegraded":"2024-04-25T22:02:57.343590+0000","last_fullsized":"2024-04-25T22:02:57.343590+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"53'39","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.516570+0000","last_change":"2024-04-25T22:02:49.881394+0000","last_active":"2024-04-25T22:02:58.516570+0000","last_peered":"2024-04-25T22:02:58.516570+0000","last_clean":"2024-04-25T22:02:58.516570+0000","last_became_active":"2024-04-25T22:02:49.880690+0000","last_became_peered":"2024-04-25T22:02:49.880690+0000","last_unstale":"2024-04-25T22:02:58.516570+0000","last_undegraded":"2024-04-25T22:02:58.516570+0000","last_fullsized":"2024-04-25T22:02:58.516570+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:31:39.262571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110430,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.343024+0000","last_change":"2024-04-25T22:02:49.884340+0000","last_active":"2024-04-25T22:02:57.343024+0000","last_peered":"2024-04-25T22:02:57.343024+0000","last_clean":"2024-04-25T22:02:57.343024+0000","last_became_active":"2024-04-25T22:02:49.883397+0000","last_became_peered":"2024-04-25T22:02:49.883397+0000","last_unstale":"2024-04-25T22:02:57.343024+0000","last_undegraded":"2024-04-25T22:02:57.343024+0000","last_fullsized":"2024-04-25T22:02:57.343024+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:55.740324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"53'54","reported_seq":72,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.270046+0000","last_change":"2024-04-25T22:02:49.877784+0000","last_active":"2024-04-25T22:02:58.270046+0000","last_peered":"2024-04-25T22:02:58.270046+0000","last_clean":"2024-04-25T22:02:58.270046+0000","last_became_active":"2024-04-25T22:02:49.876644+0000","last_became_peered":"2024-04-25T22:02:49.876644+0000","last_unstale":"2024-04-25T22:02:58.270046+0000","last_undegraded":"2024-04-25T22:02:58.270046+0000","last_fullsized":"2024-04-25T22:02:58.270046+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:50.947449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164465,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.344228+0000","last_change":"2024-04-25T22:02:49.885084+0000","last_active":"2024-04-25T22:02:57.344228+0000","last_peered":"2024-04-25T22:02:57.344228+0000","last_clean":"2024-04-25T22:02:57.344228+0000","last_became_active":"2024-04-25T22:02:49.883048+0000","last_became_peered":"2024-04-25T22:02:49.883048+0000","last_unstale":"2024-04-25T22:02:57.344228+0000","last_undegraded":"2024-04-25T22:02:57.344228+0000","last_fullsized":"2024-04-25T22:02:57.344228+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:12.276434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"53'49","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.639995+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:02:58.639995+0000","last_peered":"2024-04-25T22:02:58.639995+0000","last_clean":"2024-04-25T22:02:58.639995+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:02:58.639995+0000","last_undegraded":"2024-04-25T22:02:58.639995+0000","last_fullsized":"2024-04-25T22:02:58.639995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154764,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.346821+0000","last_change":"2024-04-25T22:02:43.853012+0000","last_active":"2024-04-25T22:02:57.346821+0000","last_peered":"2024-04-25T22:02:57.346821+0000","last_clean":"2024-04-25T22:02:57.346821+0000","last_became_active":"2024-04-25T22:02:43.852338+0000","last_became_peered":"2024-04-25T22:02:43.852338+0000","last_unstale":"2024-04-25T22:02:57.346821+0000","last_undegraded":"2024-04-25T22:02:57.346821+0000","last_fullsized":"2024-04-25T22:02:57.346821+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:07.951790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"53'55","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.435660+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:02:58.435660+0000","last_peered":"2024-04-25T22:02:58.435660+0000","last_clean":"2024-04-25T22:02:58.435660+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:02:58.435660+0000","last_undegraded":"2024-04-25T22:02:58.435660+0000","last_fullsized":"2024-04-25T22:02:58.435660+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199620,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.347083+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:02:57.347083+0000","last_peered":"2024-04-25T22:02:57.347083+0000","last_clean":"2024-04-25T22:02:57.347083+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:02:57.347083+0000","last_undegraded":"2024-04-25T22:02:57.347083+0000","last_fullsized":"2024-04-25T22:02:57.347083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"53'50","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.876505+0000","last_change":"2024-04-25T22:02:43.853286+0000","last_active":"2024-04-25T22:02:57.876505+0000","last_peered":"2024-04-25T22:02:57.876505+0000","last_clean":"2024-04-25T22:02:57.876505+0000","last_became_active":"2024-04-25T22:02:43.852555+0000","last_became_peered":"2024-04-25T22:02:43.852555+0000","last_unstale":"2024-04-25T22:02:57.876505+0000","last_undegraded":"2024-04-25T22:02:57.876505+0000","last_fullsized":"2024-04-25T22:02:57.876505+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:42:10.005523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170893,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.342346+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:02:57.342346+0000","last_peered":"2024-04-25T22:02:57.342346+0000","last_clean":"2024-04-25T22:02:57.342346+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:02:57.342346+0000","last_undegraded":"2024-04-25T22:02:57.342346+0000","last_fullsized":"2024-04-25T22:02:57.342346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"53'48","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.310638+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:02:58.310638+0000","last_peered":"2024-04-25T22:02:58.310638+0000","last_clean":"2024-04-25T22:02:58.310638+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:02:58.310638+0000","last_undegraded":"2024-04-25T22:02:58.310638+0000","last_fullsized":"2024-04-25T22:02:58.310638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158671,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.341640+0000","last_change":"2024-04-25T22:02:49.884995+0000","last_active":"2024-04-25T22:02:57.341640+0000","last_peered":"2024-04-25T22:02:57.341640+0000","last_clean":"2024-04-25T22:02:57.341640+0000","last_became_active":"2024-04-25T22:02:49.883112+0000","last_became_peered":"2024-04-25T22:02:49.883112+0000","last_unstale":"2024-04-25T22:02:57.341640+0000","last_undegraded":"2024-04-25T22:02:57.341640+0000","last_fullsized":"2024-04-25T22:02:57.341640+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:45.254613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"53'34","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.611151+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:02:58.611151+0000","last_peered":"2024-04-25T22:02:58.611151+0000","last_clean":"2024-04-25T22:02:58.611151+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:02:58.611151+0000","last_undegraded":"2024-04-25T22:02:58.611151+0000","last_fullsized":"2024-04-25T22:02:58.611151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130899,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.344920+0000","last_change":"2024-04-25T22:02:49.878347+0000","last_active":"2024-04-25T22:02:57.344920+0000","last_peered":"2024-04-25T22:02:57.344920+0000","last_clean":"2024-04-25T22:02:57.344920+0000","last_became_active":"2024-04-25T22:02:49.876980+0000","last_became_peered":"2024-04-25T22:02:49.876980+0000","last_unstale":"2024-04-25T22:02:57.344920+0000","last_undegraded":"2024-04-25T22:02:57.344920+0000","last_fullsized":"2024-04-25T22:02:57.344920+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:49.595210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"53'44","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.380074+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:02:58.380074+0000","last_peered":"2024-04-25T22:02:58.380074+0000","last_clean":"2024-04-25T22:02:58.380074+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:02:58.380074+0000","last_undegraded":"2024-04-25T22:02:58.380074+0000","last_fullsized":"2024-04-25T22:02:58.380074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125378,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":291,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.342424+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:02:57.342424+0000","last_peered":"2024-04-25T22:02:57.342424+0000","last_clean":"2024-04-25T22:02:57.342424+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:02:57.342424+0000","last_undegraded":"2024-04-25T22:02:57.342424+0000","last_fullsized":"2024-04-25T22:02:57.342424+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.343990+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:02:57.343990+0000","last_peered":"2024-04-25T22:02:57.343990+0000","last_clean":"2024-04-25T22:02:57.343990+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:02:57.343990+0000","last_undegraded":"2024-04-25T22:02:57.343990+0000","last_fullsized":"2024-04-25T22:02:57.343990+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.346412+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:02:57.346412+0000","last_peered":"2024-04-25T22:02:57.346412+0000","last_clean":"2024-04-25T22:02:57.346412+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:02:57.346412+0000","last_undegraded":"2024-04-25T22:02:57.346412+0000","last_fullsized":"2024-04-25T22:02:57.346412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"53'47","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.299206+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:02:58.299206+0000","last_peered":"2024-04-25T22:02:58.299206+0000","last_clean":"2024-04-25T22:02:58.299206+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:02:58.299206+0000","last_undegraded":"2024-04-25T22:02:58.299206+0000","last_fullsized":"2024-04-25T22:02:58.299206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125977,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.342230+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:02:57.342230+0000","last_peered":"2024-04-25T22:02:57.342230+0000","last_clean":"2024-04-25T22:02:57.342230+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:02:57.342230+0000","last_undegraded":"2024-04-25T22:02:57.342230+0000","last_fullsized":"2024-04-25T22:02:57.342230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.345667+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:02:57.345667+0000","last_peered":"2024-04-25T22:02:57.345667+0000","last_clean":"2024-04-25T22:02:57.345667+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:02:57.345667+0000","last_undegraded":"2024-04-25T22:02:57.345667+0000","last_fullsized":"2024-04-25T22:02:57.345667+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"53'53","reported_seq":71,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.555266+0000","last_change":"2024-04-25T22:02:49.884767+0000","last_active":"2024-04-25T22:02:58.555266+0000","last_peered":"2024-04-25T22:02:58.555266+0000","last_clean":"2024-04-25T22:02:58.555266+0000","last_became_active":"2024-04-25T22:02:49.884289+0000","last_became_peered":"2024-04-25T22:02:49.884289+0000","last_unstale":"2024-04-25T22:02:58.555266+0000","last_undegraded":"2024-04-25T22:02:58.555266+0000","last_fullsized":"2024-04-25T22:02:58.555266+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:21.251127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197755,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.345947+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:02:57.345947+0000","last_peered":"2024-04-25T22:02:57.345947+0000","last_clean":"2024-04-25T22:02:57.345947+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:02:57.345947+0000","last_undegraded":"2024-04-25T22:02:57.345947+0000","last_fullsized":"2024-04-25T22:02:57.345947+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.342117+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:02:57.342117+0000","last_peered":"2024-04-25T22:02:57.342117+0000","last_clean":"2024-04-25T22:02:57.342117+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:02:57.342117+0000","last_undegraded":"2024-04-25T22:02:57.342117+0000","last_fullsized":"2024-04-25T22:02:57.342117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"53'47","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.355924+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:02:58.355924+0000","last_peered":"2024-04-25T22:02:58.355924+0000","last_clean":"2024-04-25T22:02:58.355924+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:02:58.355924+0000","last_undegraded":"2024-04-25T22:02:58.355924+0000","last_fullsized":"2024-04-25T22:02:58.355924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151700,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.342511+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:02:57.342511+0000","last_peered":"2024-04-25T22:02:57.342511+0000","last_clean":"2024-04-25T22:02:57.342511+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:02:57.342511+0000","last_undegraded":"2024-04-25T22:02:57.342511+0000","last_fullsized":"2024-04-25T22:02:57.342511+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.346490+0000","last_change":"2024-04-25T22:02:43.851416+0000","last_active":"2024-04-25T22:02:57.346490+0000","last_peered":"2024-04-25T22:02:57.346490+0000","last_clean":"2024-04-25T22:02:57.346490+0000","last_became_active":"2024-04-25T22:02:43.850822+0000","last_became_peered":"2024-04-25T22:02:43.850822+0000","last_unstale":"2024-04-25T22:02:57.346490+0000","last_undegraded":"2024-04-25T22:02:57.346490+0000","last_fullsized":"2024-04-25T22:02:57.346490+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:56:58.100216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"53'44","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.576486+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:02:58.576486+0000","last_peered":"2024-04-25T22:02:58.576486+0000","last_clean":"2024-04-25T22:02:58.576486+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:02:58.576486+0000","last_undegraded":"2024-04-25T22:02:58.576486+0000","last_fullsized":"2024-04-25T22:02:58.576486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175567,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.344452+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:02:57.344452+0000","last_peered":"2024-04-25T22:02:57.344452+0000","last_clean":"2024-04-25T22:02:57.344452+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:02:57.344452+0000","last_undegraded":"2024-04-25T22:02:57.344452+0000","last_fullsized":"2024-04-25T22:02:57.344452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.347504+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:02:57.347504+0000","last_peered":"2024-04-25T22:02:57.347504+0000","last_clean":"2024-04-25T22:02:57.347504+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:02:57.347504+0000","last_undegraded":"2024-04-25T22:02:57.347504+0000","last_fullsized":"2024-04-25T22:02:57.347504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"53'46","reported_seq":64,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.276725+0000","last_change":"2024-04-25T22:02:49.884459+0000","last_active":"2024-04-25T22:02:58.276725+0000","last_peered":"2024-04-25T22:02:58.276725+0000","last_clean":"2024-04-25T22:02:58.276725+0000","last_became_active":"2024-04-25T22:02:49.883467+0000","last_became_peered":"2024-04-25T22:02:49.883467+0000","last_unstale":"2024-04-25T22:02:58.276725+0000","last_undegraded":"2024-04-25T22:02:58.276725+0000","last_fullsized":"2024-04-25T22:02:58.276725+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:31.024577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128145,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.347391+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:02:57.347391+0000","last_peered":"2024-04-25T22:02:57.347391+0000","last_clean":"2024-04-25T22:02:57.347391+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:02:57.347391+0000","last_undegraded":"2024-04-25T22:02:57.347391+0000","last_fullsized":"2024-04-25T22:02:57.347391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.347140+0000","last_change":"2024-04-25T22:02:49.883875+0000","last_active":"2024-04-25T22:02:57.347140+0000","last_peered":"2024-04-25T22:02:57.347140+0000","last_clean":"2024-04-25T22:02:57.347140+0000","last_became_active":"2024-04-25T22:02:49.883397+0000","last_became_peered":"2024-04-25T22:02:49.883397+0000","last_unstale":"2024-04-25T22:02:57.347140+0000","last_undegraded":"2024-04-25T22:02:57.347140+0000","last_fullsized":"2024-04-25T22:02:57.347140+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:08.239628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"53'49","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.540971+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:02:58.540971+0000","last_peered":"2024-04-25T22:02:58.540971+0000","last_clean":"2024-04-25T22:02:58.540971+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:02:58.540971+0000","last_undegraded":"2024-04-25T22:02:58.540971+0000","last_fullsized":"2024-04-25T22:02:58.540971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166883,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.348725+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:02:57.348725+0000","last_peered":"2024-04-25T22:02:57.348725+0000","last_clean":"2024-04-25T22:02:57.348725+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:02:57.348725+0000","last_undegraded":"2024-04-25T22:02:57.348725+0000","last_fullsized":"2024-04-25T22:02:57.348725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.348367+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:02:57.348367+0000","last_peered":"2024-04-25T22:02:57.348367+0000","last_clean":"2024-04-25T22:02:57.348367+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:02:57.348367+0000","last_undegraded":"2024-04-25T22:02:57.348367+0000","last_fullsized":"2024-04-25T22:02:57.348367+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"53'44","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.643863+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:02:58.643863+0000","last_peered":"2024-04-25T22:02:58.643863+0000","last_clean":"2024-04-25T22:02:58.643863+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:02:58.643863+0000","last_undegraded":"2024-04-25T22:02:58.643863+0000","last_fullsized":"2024-04-25T22:02:58.643863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213715,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"53'11","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.656926+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:02:57.656926+0000","last_peered":"2024-04-25T22:02:57.656926+0000","last_clean":"2024-04-25T22:02:57.656926+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:02:57.656926+0000","last_undegraded":"2024-04-25T22:02:57.656926+0000","last_fullsized":"2024-04-25T22:02:57.656926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.343622+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:02:57.343622+0000","last_peered":"2024-04-25T22:02:57.343622+0000","last_clean":"2024-04-25T22:02:57.343622+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:02:57.343622+0000","last_undegraded":"2024-04-25T22:02:57.343622+0000","last_fullsized":"2024-04-25T22:02:57.343622+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"53'43","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.111692+0000","last_change":"2024-04-25T22:02:49.881600+0000","last_active":"2024-04-25T22:02:58.111692+0000","last_peered":"2024-04-25T22:02:58.111692+0000","last_clean":"2024-04-25T22:02:58.111692+0000","last_became_active":"2024-04-25T22:02:49.880681+0000","last_became_peered":"2024-04-25T22:02:49.880681+0000","last_unstale":"2024-04-25T22:02:58.111692+0000","last_undegraded":"2024-04-25T22:02:58.111692+0000","last_fullsized":"2024-04-25T22:02:58.111692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.432134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97360,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"53'50","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.382842+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:02:58.382842+0000","last_peered":"2024-04-25T22:02:58.382842+0000","last_clean":"2024-04-25T22:02:58.382842+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:02:58.382842+0000","last_undegraded":"2024-04-25T22:02:58.382842+0000","last_fullsized":"2024-04-25T22:02:58.382842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2476796,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":2445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"52'21","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.343286+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:02:57.343286+0000","last_peered":"2024-04-25T22:02:57.343286+0000","last_clean":"2024-04-25T22:02:57.343286+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:02:57.343286+0000","last_undegraded":"2024-04-25T22:02:57.343286+0000","last_fullsized":"2024-04-25T22:02:57.343286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"53'47","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.045156+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:02:58.045156+0000","last_peered":"2024-04-25T22:02:58.045156+0000","last_clean":"2024-04-25T22:02:58.045156+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:02:58.045156+0000","last_undegraded":"2024-04-25T22:02:58.045156+0000","last_fullsized":"2024-04-25T22:02:58.045156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239301,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.343827+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:02:57.343827+0000","last_peered":"2024-04-25T22:02:57.343827+0000","last_clean":"2024-04-25T22:02:57.343827+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:02:57.343827+0000","last_undegraded":"2024-04-25T22:02:57.343827+0000","last_fullsized":"2024-04-25T22:02:57.343827+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.347026+0000","last_change":"2024-04-25T22:02:43.852674+0000","last_active":"2024-04-25T22:02:57.347026+0000","last_peered":"2024-04-25T22:02:57.347026+0000","last_clean":"2024-04-25T22:02:57.347026+0000","last_became_active":"2024-04-25T22:02:43.852292+0000","last_became_peered":"2024-04-25T22:02:43.852292+0000","last_unstale":"2024-04-25T22:02:57.347026+0000","last_undegraded":"2024-04-25T22:02:57.347026+0000","last_fullsized":"2024-04-25T22:02:57.347026+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:57.388397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"53'50","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.393778+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:02:58.393778+0000","last_peered":"2024-04-25T22:02:58.393778+0000","last_clean":"2024-04-25T22:02:58.393778+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:02:58.393778+0000","last_undegraded":"2024-04-25T22:02:58.393778+0000","last_fullsized":"2024-04-25T22:02:58.393778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":795472,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.348503+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:02:57.348503+0000","last_peered":"2024-04-25T22:02:57.348503+0000","last_clean":"2024-04-25T22:02:57.348503+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:02:57.348503+0000","last_undegraded":"2024-04-25T22:02:57.348503+0000","last_fullsized":"2024-04-25T22:02:57.348503+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"53'48","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.369404+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:02:58.369404+0000","last_peered":"2024-04-25T22:02:58.369404+0000","last_clean":"2024-04-25T22:02:58.369404+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:02:58.369404+0000","last_undegraded":"2024-04-25T22:02:58.369404+0000","last_fullsized":"2024-04-25T22:02:58.369404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4366711,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"53'53","reported_seq":71,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.992281+0000","last_change":"2024-04-25T22:02:49.884155+0000","last_active":"2024-04-25T22:02:57.992281+0000","last_peered":"2024-04-25T22:02:57.992281+0000","last_clean":"2024-04-25T22:02:57.992281+0000","last_became_active":"2024-04-25T22:02:49.883314+0000","last_became_peered":"2024-04-25T22:02:49.883314+0000","last_unstale":"2024-04-25T22:02:57.992281+0000","last_undegraded":"2024-04-25T22:02:57.992281+0000","last_fullsized":"2024-04-25T22:02:57.992281+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:53:47.483774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":777540,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.345892+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:02:57.345892+0000","last_peered":"2024-04-25T22:02:57.345892+0000","last_clean":"2024-04-25T22:02:57.345892+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:02:57.345892+0000","last_undegraded":"2024-04-25T22:02:57.345892+0000","last_fullsized":"2024-04-25T22:02:57.345892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"53'48","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.532495+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:02:58.532495+0000","last_peered":"2024-04-25T22:02:58.532495+0000","last_clean":"2024-04-25T22:02:58.532495+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:02:58.532495+0000","last_undegraded":"2024-04-25T22:02:58.532495+0000","last_fullsized":"2024-04-25T22:02:58.532495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148671,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.345480+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:02:57.345480+0000","last_peered":"2024-04-25T22:02:57.345480+0000","last_clean":"2024-04-25T22:02:57.345480+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:02:57.345480+0000","last_undegraded":"2024-04-25T22:02:57.345480+0000","last_fullsized":"2024-04-25T22:02:57.345480+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"53'45","reported_seq":63,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.122260+0000","last_change":"2024-04-25T22:02:49.887569+0000","last_active":"2024-04-25T22:02:58.122260+0000","last_peered":"2024-04-25T22:02:58.122260+0000","last_clean":"2024-04-25T22:02:58.122260+0000","last_became_active":"2024-04-25T22:02:49.886732+0000","last_became_peered":"2024-04-25T22:02:49.886732+0000","last_unstale":"2024-04-25T22:02:58.122260+0000","last_undegraded":"2024-04-25T22:02:58.122260+0000","last_fullsized":"2024-04-25T22:02:58.122260+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:38.761184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147870,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.345123+0000","last_change":"2024-04-25T22:02:49.877703+0000","last_active":"2024-04-25T22:02:57.345123+0000","last_peered":"2024-04-25T22:02:57.345123+0000","last_clean":"2024-04-25T22:02:57.345123+0000","last_became_active":"2024-04-25T22:02:49.876443+0000","last_became_peered":"2024-04-25T22:02:49.876443+0000","last_unstale":"2024-04-25T22:02:57.345123+0000","last_undegraded":"2024-04-25T22:02:57.345123+0000","last_fullsized":"2024-04-25T22:02:57.345123+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:47.870352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"53'46","reported_seq":64,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.432009+0000","last_change":"2024-04-25T22:02:49.882913+0000","last_active":"2024-04-25T22:02:58.432009+0000","last_peered":"2024-04-25T22:02:58.432009+0000","last_clean":"2024-04-25T22:02:58.432009+0000","last_became_active":"2024-04-25T22:02:49.882175+0000","last_became_peered":"2024-04-25T22:02:49.882175+0000","last_unstale":"2024-04-25T22:02:58.432009+0000","last_undegraded":"2024-04-25T22:02:58.432009+0000","last_fullsized":"2024-04-25T22:02:58.432009+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:31.024577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295158,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"53'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.343085+0000","last_change":"2024-04-25T22:02:49.886319+0000","last_active":"2024-04-25T22:02:57.343085+0000","last_peered":"2024-04-25T22:02:57.343085+0000","last_clean":"2024-04-25T22:02:57.343085+0000","last_became_active":"2024-04-25T22:02:49.884039+0000","last_became_peered":"2024-04-25T22:02:49.884039+0000","last_unstale":"2024-04-25T22:02:57.343085+0000","last_undegraded":"2024-04-25T22:02:57.343085+0000","last_fullsized":"2024-04-25T22:02:57.343085+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:11.405616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1888122,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"53'47","reported_seq":71,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.487881+0000","last_change":"2024-04-25T22:02:43.850869+0000","last_active":"2024-04-25T22:02:58.487881+0000","last_peered":"2024-04-25T22:02:58.487881+0000","last_clean":"2024-04-25T22:02:58.487881+0000","last_became_active":"2024-04-25T22:02:43.850568+0000","last_became_peered":"2024-04-25T22:02:43.850568+0000","last_unstale":"2024-04-25T22:02:58.487881+0000","last_undegraded":"2024-04-25T22:02:58.487881+0000","last_fullsized":"2024-04-25T22:02:58.487881+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:10:32.881419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147277,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":34,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.346163+0000","last_change":"2024-04-25T22:02:43.853253+0000","last_active":"2024-04-25T22:02:57.346163+0000","last_peered":"2024-04-25T22:02:57.346163+0000","last_clean":"2024-04-25T22:02:57.346163+0000","last_became_active":"2024-04-25T22:02:43.852769+0000","last_became_peered":"2024-04-25T22:02:43.852769+0000","last_unstale":"2024-04-25T22:02:57.346163+0000","last_undegraded":"2024-04-25T22:02:57.346163+0000","last_fullsized":"2024-04-25T22:02:57.346163+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:51:36.457092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"53'41","reported_seq":65,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.303050+0000","last_change":"2024-04-25T22:02:43.852778+0000","last_active":"2024-04-25T22:02:58.303050+0000","last_peered":"2024-04-25T22:02:58.303050+0000","last_clean":"2024-04-25T22:02:58.303050+0000","last_became_active":"2024-04-25T22:02:43.852263+0000","last_became_peered":"2024-04-25T22:02:43.852263+0000","last_unstale":"2024-04-25T22:02:58.303050+0000","last_undegraded":"2024-04-25T22:02:58.303050+0000","last_fullsized":"2024-04-25T22:02:58.303050+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:10:40.487543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101611,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"52'3","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.342827+0000","last_change":"2024-04-25T22:02:49.887527+0000","last_active":"2024-04-25T22:02:57.342827+0000","last_peered":"2024-04-25T22:02:57.342827+0000","last_clean":"2024-04-25T22:02:57.342827+0000","last_became_active":"2024-04-25T22:02:49.886150+0000","last_became_peered":"2024-04-25T22:02:49.886150+0000","last_unstale":"2024-04-25T22:02:57.342827+0000","last_undegraded":"2024-04-25T22:02:57.342827+0000","last_fullsized":"2024-04-25T22:02:57.342827+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:23:43.687342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"53'50","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.375337+0000","last_change":"2024-04-25T22:02:49.876491+0000","last_active":"2024-04-25T22:02:58.375337+0000","last_peered":"2024-04-25T22:02:58.375337+0000","last_clean":"2024-04-25T22:02:58.375337+0000","last_became_active":"2024-04-25T22:02:49.876169+0000","last_became_peered":"2024-04-25T22:02:49.876169+0000","last_unstale":"2024-04-25T22:02:58.375337+0000","last_undegraded":"2024-04-25T22:02:58.375337+0000","last_fullsized":"2024-04-25T22:02:58.375337+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:56:41.591010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164422,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.347733+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:02:57.347733+0000","last_peered":"2024-04-25T22:02:57.347733+0000","last_clean":"2024-04-25T22:02:57.347733+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:02:57.347733+0000","last_undegraded":"2024-04-25T22:02:57.347733+0000","last_fullsized":"2024-04-25T22:02:57.347733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"53'63","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:58.320073+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:02:58.320073+0000","last_peered":"2024-04-25T22:02:58.320073+0000","last_clean":"2024-04-25T22:02:58.320073+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:02:58.320073+0000","last_undegraded":"2024-04-25T22:02:58.320073+0000","last_fullsized":"2024-04-25T22:02:58.320073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165727,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T22:02:57.348216+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:02:57.348216+0000","last_peered":"2024-04-25T22:02:57.348216+0000","last_clean":"2024-04-25T22:02:57.348216+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:02:57.348216+0000","last_undegraded":"2024-04-25T22:02:57.348216+0000","last_fullsized":"2024-04-25T22:02:57.348216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":23490234,"num_objects":3111,"num_object_clones":0,"num_object_copies":6222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3111,"num_write_kb":24624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":52477952,"data_stored":46983184,"data_compressed":2390178,"data_compressed_allocated":3211264,"data_compressed_original":11649024,"omap_allocated":0,"internal_metadata":0},"log_size":3112,"ondisk_log_size":3112,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":6083896,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":6254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1679360,"data_stored":12167792,"data_compressed":1115112,"data_compressed_allocated":1523712,"data_compressed_original":12066816,"omap_allocated":0,"internal_metadata":0},"log_size":66,"ondisk_log_size":66,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738397,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60940,"kb_used_data":21444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94310900,"statfs":{"total":96636764160,"available":96574361600,"internally_reserved":0,"allocated":21958656,"data_stored":25412552,"data_compressed":1428733,"data_compressed_allocated":1908736,"data_compressed_original":10035200,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738396,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49472,"kb_used_data":14132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322368,"statfs":{"total":96636764160,"available":96586104832,"internally_reserved":0,"allocated":14471168,"data_stored":11401983,"data_compressed":520268,"data_compressed_allocated":757760,"data_compressed_original":2371584,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56512,"kb_used_data":17012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315328,"statfs":{"total":96636764160,"available":96578895872,"internally_reserved":0,"allocated":17420288,"data_stored":20939233,"data_compressed":1387518,"data_compressed_allocated":1851392,"data_compressed_original":9916416,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":839680,"data_stored":6083896,"data_compressed":557556,"data_compressed_allocated":761856,"data_compressed_original":6033408,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":831488,"data_stored":6083280,"data_compressed":557556,"data_compressed_allocated":761856,"data_compressed_original":6033408,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16617472,"data_stored":15149332,"data_compressed":878962,"data_compressed_allocated":1146880,"data_compressed_original":4202496,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15056896,"data_stored":13144660,"data_compressed":629825,"data_compressed_allocated":929792,"data_compressed_original":3932160,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20803584,"data_stored":18689192,"data_compressed":881391,"data_compressed_allocated":1134592,"data_compressed_original":3514368,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:03:03.442 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T22:03:03.442 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:03:03.442 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-25T22:03:03.442 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.942600 2024-04-25T22:03:03.442 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.9426002629852367 2024-04-25T22:03:03.473 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:03.473 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:03.488 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:03.537 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:03.537+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:03.639 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:03.632+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:03.641 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:03.642 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:03.660 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:03.672 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-25T22:03:03.745 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:03.745+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:03.830 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:03.830 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:03.841 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:03.836+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:03.846 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:03.942 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:03.936+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:03.988 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:03.989 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:04.006 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:04.033 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:03:04.043 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:04.036+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:04.133 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:04.133 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:04.144 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:04.140+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:04.149 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:04.213 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:04.214 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:04.239 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:04.239 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:04.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:04.241+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:04.265 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:04.265 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:04.282 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:04.282 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:04.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:04.282 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:04.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.283 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:04.283 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:04.283 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.193577299999999, 2024-04-25T22:03:04.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:04.283 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.283 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.283 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.283 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:04.283 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:04.283 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:04.285 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:04.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.285 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:04.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:04.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:04.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:04.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:04.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:04.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:04.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:04.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:04.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:04.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:04.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:04.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:04.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:04.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:04.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:04.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:04.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:04.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:04.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:04.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:04.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:04.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:04.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:04.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:04.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:04.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:04.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:04.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:04.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:04.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:04.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:04.290 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.291 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.291 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.291 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:04.291 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:04.291 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.183576537, 2024-04-25T22:03:04.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:04.291 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.291 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.291 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.291 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:04.291 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:04.291 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:04.291 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:04.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.292 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:04.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:04.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:04.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:04.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:04.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:04.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:04.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:04.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:04.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:04.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:04.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:04.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:04.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:04.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:04.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:04.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:04.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:04.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:04.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:04.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:04.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:04.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:04.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:04.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:04.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:04.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:04.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:04.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:04.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:04.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:04.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:04.297 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.297 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.297 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.297 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:04.297 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:04.297 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.179412263, 2024-04-25T22:03:04.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:04.297 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.297 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.297 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.297 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:04.298 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:04.298 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:04.298 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:04.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.298 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:04.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:04.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:04.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:04.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:04.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:04.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:04.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:04.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:04.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:04.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:04.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:04.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:04.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:04.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:04.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:04.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:04.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:04.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:04.302 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.302 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.302 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.302 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:04.303 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:04.303 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.177815946000001, 2024-04-25T22:03:04.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:04.303 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.303 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.303 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.303 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:04.303 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:04.303 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:04.303 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:04.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.303 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:04.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:04.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:04.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:04.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:04.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:04.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:04.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:04.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:04.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:04.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:04.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:04.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:04.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:04.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:04.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:04.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:04.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:04.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:04.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:04.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:04.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:04.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:04.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:04.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:04.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:04.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:04.308 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.308 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.308 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.308 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:24 4.b 4:d3eda40d:::1000000020f.00000000:head [write 0~1144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:04.308 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.118844+0000", 2024-04-25T22:03:04.308 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.160278093000001, 2024-04-25T22:03:04.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.089959257000000001, 2024-04-25T22:03:04.308 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.308 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.308 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.308 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:04.308 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:04.309 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:04.309 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 24 2024-04-25T22:03:04.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.309 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118844+0000", 2024-04-25T22:03:04.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118844+0000", 2024-04-25T22:03:04.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118846+0000", 2024-04-25T22:03:04.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:03:04.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118855+0000", 2024-04-25T22:03:04.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2930000000000006e-06 2024-04-25T22:03:04.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118879+0000", 2024-04-25T22:03:04.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3312999999999999e-05 2024-04-25T22:03:04.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118891+0000", 2024-04-25T22:03:04.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2136e-05 2024-04-25T22:03:04.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118997+0000", 2024-04-25T22:03:04.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010655800000000001 2024-04-25T22:03:04.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.119214+0000", 2024-04-25T22:03:04.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021723099999999999 2024-04-25T22:03:04.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:04.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.119408+0000", 2024-04-25T22:03:04.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000193582 2024-04-25T22:03:04.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:04.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.121105+0000", 2024-04-25T22:03:04.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016972549999999999 2024-04-25T22:03:04.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208552+0000", 2024-04-25T22:03:04.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087447104999999997 2024-04-25T22:03:04.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:04.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208688+0000", 2024-04-25T22:03:04.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000135394 2024-04-25T22:03:04.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208803+0000", 2024-04-25T22:03:04.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011557000000000001 2024-04-25T22:03:04.313 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.313 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.313 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.313 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:32 4.b 4:d2dbd4ac:::10000000217.00000000:head [write 0~1921] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:04.314 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.130139+0000", 2024-04-25T22:03:04.314 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.148982952000001, 2024-04-25T22:03:04.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.080213211000000006, 2024-04-25T22:03:04.314 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.314 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.314 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.314 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:04.314 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:04.314 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:04.314 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 32 2024-04-25T22:03:04.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.314 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130139+0000", 2024-04-25T22:03:04.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130139+0000", 2024-04-25T22:03:04.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130141+0000", 2024-04-25T22:03:04.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.243e-06 2024-04-25T22:03:04.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130153+0000", 2024-04-25T22:03:04.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1994000000000001e-05 2024-04-25T22:03:04.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130185+0000", 2024-04-25T22:03:04.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1201999999999997e-05 2024-04-25T22:03:04.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130201+0000", 2024-04-25T22:03:04.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.605e-05 2024-04-25T22:03:04.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130348+0000", 2024-04-25T22:03:04.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014707300000000001 2024-04-25T22:03:04.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.130696+0000", 2024-04-25T22:03:04.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034790800000000002 2024-04-25T22:03:04.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:04.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.131078+0000", 2024-04-25T22:03:04.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038188399999999998 2024-04-25T22:03:04.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:04.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.132597+0000", 2024-04-25T22:03:04.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001519252 2024-04-25T22:03:04.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210220+0000", 2024-04-25T22:03:04.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.077623485000000006 2024-04-25T22:03:04.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:04.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210294+0000", 2024-04-25T22:03:04.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3444999999999999e-05 2024-04-25T22:03:04.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210352+0000", 2024-04-25T22:03:04.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8675000000000003e-05 2024-04-25T22:03:04.319 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.319 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.319 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.319 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:46 4.b 4:d0d26e50:::10000000225.00000000:head [write 0~1224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:04.319 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.150212+0000", 2024-04-25T22:03:04.319 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.128909748, 2024-04-25T22:03:04.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060337512000000003, 2024-04-25T22:03:04.319 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.319 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.319 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.319 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:04.320 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:04.320 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:04.320 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46 2024-04-25T22:03:04.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.320 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150212+0000", 2024-04-25T22:03:04.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150212+0000", 2024-04-25T22:03:04.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150215+0000", 2024-04-25T22:03:04.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4229999999999999e-06 2024-04-25T22:03:04.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150229+0000", 2024-04-25T22:03:04.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4059999999999999e-05 2024-04-25T22:03:04.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150255+0000", 2024-04-25T22:03:04.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5795999999999998e-05 2024-04-25T22:03:04.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150277+0000", 2024-04-25T22:03:04.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2682999999999999e-05 2024-04-25T22:03:04.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150409+0000", 2024-04-25T22:03:04.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013196599999999999 2024-04-25T22:03:04.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.150771+0000", 2024-04-25T22:03:04.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000361245 2024-04-25T22:03:04.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:04.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.151146+0000", 2024-04-25T22:03:04.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000375044 2024-04-25T22:03:04.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:04.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.155311+0000", 2024-04-25T22:03:04.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041656599999999998 2024-04-25T22:03:04.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210420+0000", 2024-04-25T22:03:04.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055108428000000001 2024-04-25T22:03:04.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:04.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210493+0000", 2024-04-25T22:03:04.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3155e-05 2024-04-25T22:03:04.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210550+0000", 2024-04-25T22:03:04.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7052000000000002e-05 2024-04-25T22:03:04.324 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.324 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.324 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.324 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:04.324 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:04.325 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.121029696000001, 2024-04-25T22:03:04.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:04.325 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.325 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.325 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.325 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:04.325 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:04.325 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:04.325 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:04.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.325 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:04.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:04.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:04.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:04.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:04.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:04.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:04.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:04.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:04.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:04.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:04.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:04.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:04.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:04.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:04.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:04.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:04.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:04.330 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.330 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.330 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.330 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:04.330 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:04.330 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.10538543, 2024-04-25T22:03:04.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:04.330 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.331 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.331 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.331 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:04.331 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:04.331 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:04.331 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:04.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.331 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:04.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:04.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:04.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:04.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:04.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:04.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:04.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:04.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:04.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:04.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:04.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:04.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:04.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:04.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:04.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:04.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:04.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:04.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:04.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:04.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:04.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:04.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:04.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:04.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:04.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:04.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:04.335 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.335 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.335 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.336 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:04.336 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:04.336 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.100546739, 2024-04-25T22:03:04.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:04.336 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.336 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.336 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.336 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:04.336 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:04.336 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:04.336 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:04.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.336 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:04.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:04.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:04.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:04.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:04.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:04.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:04.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:04.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:04.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:04.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:04.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:04.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:04.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:04.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:04.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:04.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:04.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:04.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:04.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:04.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:04.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:04.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:04.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:04.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:04.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:04.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:04.341 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.341 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.341 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.341 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:04.341 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:04.341 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.087229655, 2024-04-25T22:03:04.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.098402492999999994, 2024-04-25T22:03:04.341 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.341 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.341 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.342 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:04.342 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:04.342 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:04.342 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71 2024-04-25T22:03:04.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.342 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:04.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:04.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191895+0000", 2024-04-25T22:03:04.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0899999999999999e-06 2024-04-25T22:03:04.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191906+0000", 2024-04-25T22:03:04.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1508999999999999e-05 2024-04-25T22:03:04.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191937+0000", 2024-04-25T22:03:04.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0772999999999998e-05 2024-04-25T22:03:04.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191951+0000", 2024-04-25T22:03:04.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.437e-05 2024-04-25T22:03:04.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286217+0000", 2024-04-25T22:03:04.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.094265989999999994 2024-04-25T22:03:04.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286383+0000", 2024-04-25T22:03:04.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016591899999999999 2024-04-25T22:03:04.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:04.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286594+0000", 2024-04-25T22:03:04.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021108800000000001 2024-04-25T22:03:04.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.288518+0000", 2024-04-25T22:03:04.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001923391 2024-04-25T22:03:04.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:04.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290219+0000", 2024-04-25T22:03:04.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001701239 2024-04-25T22:03:04.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:04.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290266+0000", 2024-04-25T22:03:04.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6838000000000001e-05 2024-04-25T22:03:04.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290295+0000", 2024-04-25T22:03:04.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9286e-05 2024-04-25T22:03:04.346 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.346 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.346 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.347 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4564.0:77 4.30 e51/16 4:0c28cce1:::10000000244.00000000:head v 51'3, mlcod=51'1)", 2024-04-25T22:03:04.347 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.202141+0000", 2024-04-25T22:03:04.347 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.076981138000001, 2024-04-25T22:03:04.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087897668999999998, 2024-04-25T22:03:04.347 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.347 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.347 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.347 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.202141+0000", 2024-04-25T22:03:04.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.202141+0000", 2024-04-25T22:03:04.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.202143+0000", 2024-04-25T22:03:04.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.477e-06 2024-04-25T22:03:04.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.202153+0000", 2024-04-25T22:03:04.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0599e-05 2024-04-25T22:03:04.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.202172+0000", 2024-04-25T22:03:04.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9113000000000001e-05 2024-04-25T22:03:04.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.202184+0000", 2024-04-25T22:03:04.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.147e-05 2024-04-25T22:03:04.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284532+0000", 2024-04-25T22:03:04.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.082347907999999997 2024-04-25T22:03:04.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284545+0000", 2024-04-25T22:03:04.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3825999999999999e-05 2024-04-25T22:03:04.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:04.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290013+0000", 2024-04-25T22:03:04.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054677249999999997 2024-04-25T22:03:04.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290039+0000", 2024-04-25T22:03:04.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5551e-05 2024-04-25T22:03:04.351 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.351 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.351 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.351 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4564.0:11 4.28 e51/49 ondisk, result = 0)", 2024-04-25T22:03:04.351 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.208333+0000", 2024-04-25T22:03:04.351 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.070789331, 2024-04-25T22:03:04.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076582211999999997, 2024-04-25T22:03:04.351 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.351 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.351 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:03:04.351 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208333+0000", 2024-04-25T22:03:04.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208333+0000", 2024-04-25T22:03:04.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208335+0000", 2024-04-25T22:03:04.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.827e-06 2024-04-25T22:03:04.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208344+0000", 2024-04-25T22:03:04.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2690000000000005e-06 2024-04-25T22:03:04.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208367+0000", 2024-04-25T22:03:04.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.281e-05 2024-04-25T22:03:04.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208399+0000", 2024-04-25T22:03:04.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2085999999999997e-05 2024-04-25T22:03:04.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284794+0000", 2024-04-25T22:03:04.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076394869000000004 2024-04-25T22:03:04.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284806+0000", 2024-04-25T22:03:04.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1804000000000001e-05 2024-04-25T22:03:04.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284915+0000", 2024-04-25T22:03:04.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109547 2024-04-25T22:03:04.354 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.355 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.355 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.355 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4564.0:12 4.28 e51/49 ondisk, result = 0)", 2024-04-25T22:03:04.355 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.208427+0000", 2024-04-25T22:03:04.355 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.070694723000001, 2024-04-25T22:03:04.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076675030000000005, 2024-04-25T22:03:04.355 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.355 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.355 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:03:04.355 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208427+0000", 2024-04-25T22:03:04.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208427+0000", 2024-04-25T22:03:04.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208428+0000", 2024-04-25T22:03:04.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8599999999999996e-07 2024-04-25T22:03:04.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208434+0000", 2024-04-25T22:03:04.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2270000000000001e-06 2024-04-25T22:03:04.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208452+0000", 2024-04-25T22:03:04.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8275999999999999e-05 2024-04-25T22:03:04.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208466+0000", 2024-04-25T22:03:04.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-04-25T22:03:04.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284953+0000", 2024-04-25T22:03:04.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076487148000000005 2024-04-25T22:03:04.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284974+0000", 2024-04-25T22:03:04.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1217999999999999e-05 2024-04-25T22:03:04.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285102+0000", 2024-04-25T22:03:04.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012848199999999999 2024-04-25T22:03:04.359 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.359 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.359 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.359 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4564.0:5 4.10 e51/16 ondisk, result = 0)", 2024-04-25T22:03:04.359 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.210916+0000", 2024-04-25T22:03:04.359 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.068205752000001, 2024-04-25T22:03:04.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.074873453000000006, 2024-04-25T22:03:04.359 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.359 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.359 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:03:04.359 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210916+0000", 2024-04-25T22:03:04.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210916+0000", 2024-04-25T22:03:04.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210918+0000", 2024-04-25T22:03:04.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6700000000000001e-06 2024-04-25T22:03:04.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210927+0000", 2024-04-25T22:03:04.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4999999999999999e-06 2024-04-25T22:03:04.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210950+0000", 2024-04-25T22:03:04.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2976000000000002e-05 2024-04-25T22:03:04.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.210963+0000", 2024-04-25T22:03:04.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3396e-05 2024-04-25T22:03:04.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285777+0000", 2024-04-25T22:03:04.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.074814172999999998 2024-04-25T22:03:04.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285782+0000", 2024-04-25T22:03:04.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4349999999999999e-06 2024-04-25T22:03:04.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285790+0000", 2024-04-25T22:03:04.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.303e-06 2024-04-25T22:03:04.363 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.363 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.363 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.363 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4564.0:89 4.30 e51/16 4:0e3d5a27:::10000000250.00000000:head v 51'4, mlcod=51'1)", 2024-04-25T22:03:04.363 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.225423+0000", 2024-04-25T22:03:04.363 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.053699532, 2024-04-25T22:03:04.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064789777000000007, 2024-04-25T22:03:04.363 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.364 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.364 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.364 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.225423+0000", 2024-04-25T22:03:04.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.225423+0000", 2024-04-25T22:03:04.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.225423+0000", 2024-04-25T22:03:04.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4600000000000003e-07 2024-04-25T22:03:04.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.225431+0000", 2024-04-25T22:03:04.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:03:04.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.225446+0000", 2024-04-25T22:03:04.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5121e-05 2024-04-25T22:03:04.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.225454+0000", 2024-04-25T22:03:04.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5979999999999997e-06 2024-04-25T22:03:04.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285779+0000", 2024-04-25T22:03:04.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060325060999999999 2024-04-25T22:03:04.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285809+0000", 2024-04-25T22:03:04.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0136000000000001e-05 2024-04-25T22:03:04.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:04.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290191+0000", 2024-04-25T22:03:04.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043816640000000004 2024-04-25T22:03:04.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290212+0000", 2024-04-25T22:03:04.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1274e-05 2024-04-25T22:03:04.367 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.368 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.368 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.368 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:96 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~1656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:04.368 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.239486+0000", 2024-04-25T22:03:04.368 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.039636601, 2024-04-25T22:03:04.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050859021999999997, 2024-04-25T22:03:04.368 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.368 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.368 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.368 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:04.368 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:04.368 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:04.368 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96 2024-04-25T22:03:04.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.369 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.239486+0000", 2024-04-25T22:03:04.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.239486+0000", 2024-04-25T22:03:04.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.239488+0000", 2024-04-25T22:03:04.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0559999999999999e-06 2024-04-25T22:03:04.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.239499+0000", 2024-04-25T22:03:04.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1387e-05 2024-04-25T22:03:04.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.239524+0000", 2024-04-25T22:03:04.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5276e-05 2024-04-25T22:03:04.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.239544+0000", 2024-04-25T22:03:04.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9888999999999999e-05 2024-04-25T22:03:04.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287217+0000", 2024-04-25T22:03:04.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047672503999999997 2024-04-25T22:03:04.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287292+0000", 2024-04-25T22:03:04.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5722000000000004e-05 2024-04-25T22:03:04.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:04.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287362+0000", 2024-04-25T22:03:04.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0017000000000004e-05 2024-04-25T22:03:04.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.288555+0000", 2024-04-25T22:03:04.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001192504 2024-04-25T22:03:04.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:04.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290299+0000", 2024-04-25T22:03:04.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001744518 2024-04-25T22:03:04.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:04.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290325+0000", 2024-04-25T22:03:04.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5496000000000001e-05 2024-04-25T22:03:04.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290345+0000", 2024-04-25T22:03:04.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9653e-05 2024-04-25T22:03:04.373 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.373 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.373 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.373 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:114 3.b 3:d5c7a900:::200.00000003:head [write 1094078~6875 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-25T22:03:04.373 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:59.733582+0000", 2024-04-25T22:03:04.373 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5455406460000001, 2024-04-25T22:03:04.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049307908999999997, 2024-04-25T22:03:04.373 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.374 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.374 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.374 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733582+0000", 2024-04-25T22:03:04.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733582+0000", 2024-04-25T22:03:04.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733583+0000", 2024-04-25T22:03:04.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8899999999999999e-06 2024-04-25T22:03:04.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733600+0000", 2024-04-25T22:03:04.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6779999999999999e-05 2024-04-25T22:03:04.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733623+0000", 2024-04-25T22:03:04.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2796e-05 2024-04-25T22:03:04.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733637+0000", 2024-04-25T22:03:04.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3883000000000001e-05 2024-04-25T22:03:04.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.775890+0000", 2024-04-25T22:03:04.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042253394999999999 2024-04-25T22:03:04.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.776031+0000", 2024-04-25T22:03:04.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000140877 2024-04-25T22:03:04.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:04.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.776314+0000", 2024-04-25T22:03:04.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000282811 2024-04-25T22:03:04.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:04.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.780890+0000", 2024-04-25T22:03:04.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045759879999999996 2024-04-25T22:03:04.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.782588+0000", 2024-04-25T22:03:04.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001698312 2024-04-25T22:03:04.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:04.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.782764+0000", 2024-04-25T22:03:04.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017606300000000001 2024-04-25T22:03:04.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.782889+0000", 2024-04-25T22:03:04.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012511400000000001 2024-04-25T22:03:04.378 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.378 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.378 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.378 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:115 3.b 3:d5c7a900:::200.00000003:head [write 1100953~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-25T22:03:04.378 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:59.733764+0000", 2024-04-25T22:03:04.378 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5453579059999996, 2024-04-25T22:03:04.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049669942000000002, 2024-04-25T22:03:04.379 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.379 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.379 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.379 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733764+0000", 2024-04-25T22:03:04.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733764+0000", 2024-04-25T22:03:04.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733766+0000", 2024-04-25T22:03:04.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.313e-06 2024-04-25T22:03:04.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733772+0000", 2024-04-25T22:03:04.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9e-06 2024-04-25T22:03:04.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733788+0000", 2024-04-25T22:03:04.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.502e-05 2024-04-25T22:03:04.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.733797+0000", 2024-04-25T22:03:04.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6800000000000005e-06 2024-04-25T22:03:04.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.777405+0000", 2024-04-25T22:03:04.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043607335999999997 2024-04-25T22:03:04.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.777537+0000", 2024-04-25T22:03:04.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000132364 2024-04-25T22:03:04.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:04.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.777731+0000", 2024-04-25T22:03:04.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000194506 2024-04-25T22:03:04.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:04.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.780898+0000", 2024-04-25T22:03:04.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031667650000000002 2024-04-25T22:03:04.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.783117+0000", 2024-04-25T22:03:04.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022189570000000001 2024-04-25T22:03:04.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:04.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.783308+0000", 2024-04-25T22:03:04.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019085799999999999 2024-04-25T22:03:04.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:59.783434+0000", 2024-04-25T22:03:04.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000126243 2024-04-25T22:03:04.383 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.383 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.383 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.383 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:127 3.b 3:d5c7a900:::200.00000003:head [write 1190944~2474554 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-25T22:03:04.384 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:00.516732+0000", 2024-04-25T22:03:04.384 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7623905789999998, 2024-04-25T22:03:04.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.074062791000000003, 2024-04-25T22:03:04.384 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:04.384 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:04.384 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.384 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:04.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:04.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.516732+0000", 2024-04-25T22:03:04.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:04.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.516732+0000", 2024-04-25T22:03:04.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:04.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:04.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.516735+0000", 2024-04-25T22:03:04.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0759999999999999e-06 2024-04-25T22:03:04.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:04.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.520391+0000", 2024-04-25T22:03:04.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0036560540000000002 2024-04-25T22:03:04.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:04.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.520424+0000", 2024-04-25T22:03:04.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3552e-05 2024-04-25T22:03:04.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.520439+0000", 2024-04-25T22:03:04.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4433000000000001e-05 2024-04-25T22:03:04.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:04.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.520574+0000", 2024-04-25T22:03:04.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013541399999999999 2024-04-25T22:03:04.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:04.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.520717+0000", 2024-04-25T22:03:04.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014332400000000001 2024-04-25T22:03:04.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:04.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.520930+0000", 2024-04-25T22:03:04.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021277199999999999 2024-04-25T22:03:04.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:04.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.580222+0000", 2024-04-25T22:03:04.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059291614999999999 2024-04-25T22:03:04.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.590627+0000", 2024-04-25T22:03:04.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010405118 2024-04-25T22:03:04.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:04.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.590722+0000", 2024-04-25T22:03:04.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5336999999999999e-05 2024-04-25T22:03:04.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:04.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:04.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:04.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:00.590794+0000", 2024-04-25T22:03:04.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2095999999999995e-05 2024-04-25T22:03:04.388 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.388 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.388 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.388 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:04.388 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:04.388 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:04.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:04.391 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:04.389+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:04.491 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:04.489+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:04.527 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:03:04.527 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:04.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:04.592 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:04.584+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:04.671 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:04.671 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:04.671 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:03:04.671 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:03:04.671 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:04.674 INFO:teuthology.orchestra.run.smithi044.stderr:set osd.1 primary-affinity to 0.9426 (8617742) 2024-04-25T22:03:04.688 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:04.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:04.689+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:04.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:04.789+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:04.872 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:04.872 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:03:04.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:03:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:12 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:03:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:03:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.239227128, 2024-04-25T22:03:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.014700167, 2024-04-25T22:03:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:03:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629021+0000", 2024-04-25T22:03:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629023+0000", 2024-04-25T22:03:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7870000000000002e-06 2024-04-25T22:03:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629037+0000", 2024-04-25T22:03:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4073000000000001e-05 2024-04-25T22:03:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629064+0000", 2024-04-25T22:03:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6492999999999999e-05 2024-04-25T22:03:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629091+0000", 2024-04-25T22:03:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6947000000000001e-05 2024-04-25T22:03:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629479+0000", 2024-04-25T22:03:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038849700000000002 2024-04-25T22:03:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629756+0000", 2024-04-25T22:03:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276968 2024-04-25T22:03:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.630123+0000", 2024-04-25T22:03:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036664 2024-04-25T22:03:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635629+0000", 2024-04-25T22:03:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055063610000000004 2024-04-25T22:03:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643468+0000", 2024-04-25T22:03:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078389930000000007 2024-04-25T22:03:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643614+0000", 2024-04-25T22:03:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000145685 2024-04-25T22:03:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.643721+0000", 2024-04-25T22:03:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106723 2024-04-25T22:03:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:13 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:03:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:03:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.239103145, 2024-04-25T22:03:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028895614, 2024-04-25T22:03:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:03:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629145+0000", 2024-04-25T22:03:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629146+0000", 2024-04-25T22:03:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7430000000000001e-06 2024-04-25T22:03:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629155+0000", 2024-04-25T22:03:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1700000000000003e-06 2024-04-25T22:03:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629177+0000", 2024-04-25T22:03:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1636000000000001e-05 2024-04-25T22:03:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629195+0000", 2024-04-25T22:03:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7796999999999999e-05 2024-04-25T22:03:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635456+0000", 2024-04-25T22:03:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006261005 2024-04-25T22:03:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635621+0000", 2024-04-25T22:03:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016487899999999999 2024-04-25T22:03:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.635854+0000", 2024-04-25T22:03:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233048 2024-04-25T22:03:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.639450+0000", 2024-04-25T22:03:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035961159999999999 2024-04-25T22:03:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657838+0000", 2024-04-25T22:03:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018388534000000002 2024-04-25T22:03:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657977+0000", 2024-04-25T22:03:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013862600000000001 2024-04-25T22:03:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658040+0000", 2024-04-25T22:03:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3059999999999996e-05 2024-04-25T22:03:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:03:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:03:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.238912957, 2024-04-25T22:03:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028779467999999999, 2024-04-25T22:03:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:03:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629335+0000", 2024-04-25T22:03:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629336+0000", 2024-04-25T22:03:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.35e-06 2024-04-25T22:03:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629345+0000", 2024-04-25T22:03:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7469999999999994e-06 2024-04-25T22:03:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629363+0000", 2024-04-25T22:03:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8593e-05 2024-04-25T22:03:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629378+0000", 2024-04-25T22:03:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4807000000000001e-05 2024-04-25T22:03:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636477+0000", 2024-04-25T22:03:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070987250000000002 2024-04-25T22:03:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.636757+0000", 2024-04-25T22:03:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027995100000000002 2024-04-25T22:03:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637067+0000", 2024-04-25T22:03:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030978400000000001 2024-04-25T22:03:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.640182+0000", 2024-04-25T22:03:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031156360000000002 2024-04-25T22:03:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657886+0000", 2024-04-25T22:03:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017703697000000001 2024-04-25T22:03:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.657987+0000", 2024-04-25T22:03:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010111300000000001 2024-04-25T22:03:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658114+0000", 2024-04-25T22:03:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012706499999999999 2024-04-25T22:03:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:03:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:03:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.238749548, 2024-04-25T22:03:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:03:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:03:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:03:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:03:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:03:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:03:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:03:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:03:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:03:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:03:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:03:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:03:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:03:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:03:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:03:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:03:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:03:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:03:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:03:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:03:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:03:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:03:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:03:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:03:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:03:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:03:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:03:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.238647352, 2024-04-25T22:03:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017382226000000001, 2024-04-25T22:03:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:03:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629600+0000", 2024-04-25T22:03:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629603+0000", 2024-04-25T22:03:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:03:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629611+0000", 2024-04-25T22:03:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2940000000000006e-06 2024-04-25T22:03:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629633+0000", 2024-04-25T22:03:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2370000000000001e-05 2024-04-25T22:03:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629650+0000", 2024-04-25T22:03:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6303e-05 2024-04-25T22:03:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631202+0000", 2024-04-25T22:03:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015526909999999999 2024-04-25T22:03:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631402+0000", 2024-04-25T22:03:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020009199999999999 2024-04-25T22:03:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631689+0000", 2024-04-25T22:03:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028633400000000001 2024-04-25T22:03:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.634229+0000", 2024-04-25T22:03:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025400179999999998 2024-04-25T22:03:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646727+0000", 2024-04-25T22:03:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012498789999999999 2024-04-25T22:03:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646876+0000", 2024-04-25T22:03:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014819200000000001 2024-04-25T22:03:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646983+0000", 2024-04-25T22:03:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010684900000000001 2024-04-25T22:03:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:21 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:03:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:03:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.238568399, 2024-04-25T22:03:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028765504000000001, 2024-04-25T22:03:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:03:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629679+0000", 2024-04-25T22:03:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629681+0000", 2024-04-25T22:03:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2890000000000001e-06 2024-04-25T22:03:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629690+0000", 2024-04-25T22:03:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8970000000000003e-06 2024-04-25T22:03:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629709+0000", 2024-04-25T22:03:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8240000000000002e-05 2024-04-25T22:03:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629724+0000", 2024-04-25T22:03:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5376999999999999e-05 2024-04-25T22:03:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637878+0000", 2024-04-25T22:03:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0081543899999999992 2024-04-25T22:03:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638093+0000", 2024-04-25T22:03:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000214265 2024-04-25T22:03:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638347+0000", 2024-04-25T22:03:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025457099999999999 2024-04-25T22:03:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646424+0000", 2024-04-25T22:03:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080766380000000006 2024-04-25T22:03:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658258+0000", 2024-04-25T22:03:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011833656 2024-04-25T22:03:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658381+0000", 2024-04-25T22:03:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123149 2024-04-25T22:03:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658445+0000", 2024-04-25T22:03:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4032e-05 2024-04-25T22:03:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:27 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:03:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:03:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.23842518399999, 2024-04-25T22:03:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026741997, 2024-04-25T22:03:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:03:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629822+0000", 2024-04-25T22:03:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629824+0000", 2024-04-25T22:03:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.703e-06 2024-04-25T22:03:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629830+0000", 2024-04-25T22:03:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2169999999999999e-06 2024-04-25T22:03:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629850+0000", 2024-04-25T22:03:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9262999999999998e-05 2024-04-25T22:03:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629867+0000", 2024-04-25T22:03:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7433999999999999e-05 2024-04-25T22:03:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631180+0000", 2024-04-25T22:03:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013130329999999999 2024-04-25T22:03:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.631469+0000", 2024-04-25T22:03:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028903099999999998 2024-04-25T22:03:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.656564+0000", 2024-04-25T22:03:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.025095315999999999 2024-04-25T22:03:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:4 4.32 e51/16 4:4def72d4:::10000000003.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:03:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.875789424000001, 2024-04-25T22:03:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10987878, 2024-04-25T22:03:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992461+0000", 2024-04-25T22:03:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5780000000000001e-06 2024-04-25T22:03:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997784+0000", 2024-04-25T22:03:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005323627 2024-04-25T22:03:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997815+0000", 2024-04-25T22:03:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0066999999999999e-05 2024-04-25T22:03:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997830+0000", 2024-04-25T22:03:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5290000000000001e-05 2024-04-25T22:03:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997927+0000", 2024-04-25T22:03:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7391000000000003e-05 2024-04-25T22:03:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997947+0000", 2024-04-25T22:03:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0259999999999999e-05 2024-04-25T22:03:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102225+0000", 2024-04-25T22:03:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10427777100000001 2024-04-25T22:03:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102337+0000", 2024-04-25T22:03:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000111796 2024-04-25T22:03:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:6 4.13 e51/16 4:cbe72331:::10000000003.00000002:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.780975440000001, 2024-04-25T22:03:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.11536371400000001, 2024-04-25T22:03:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087273+0000", 2024-04-25T22:03:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:03:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089358+0000", 2024-04-25T22:03:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0020848170000000001 2024-04-25T22:03:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089372+0000", 2024-04-25T22:03:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.452e-05 2024-04-25T22:03:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089381+0000", 2024-04-25T22:03:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5979999999999997e-06 2024-04-25T22:03:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089486+0000", 2024-04-25T22:03:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105573 2024-04-25T22:03:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089536+0000", 2024-04-25T22:03:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9505000000000001e-05 2024-04-25T22:03:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202556+0000", 2024-04-25T22:03:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.113020169 2024-04-25T22:03:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202636+0000", 2024-04-25T22:03:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9814000000000005e-05 2024-04-25T22:03:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:5 4.10 e51/16 4:09a4c37f:::10000000003.00000001:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.768399522999999, 2024-04-25T22:03:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.110104358, 2024-04-25T22:03:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099849+0000", 2024-04-25T22:03:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7000000000000003e-07 2024-04-25T22:03:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108349+0000", 2024-04-25T22:03:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085003230000000006 2024-04-25T22:03:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108391+0000", 2024-04-25T22:03:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2011999999999997e-05 2024-04-25T22:03:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108415+0000", 2024-04-25T22:03:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3702000000000001e-05 2024-04-25T22:03:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108504+0000", 2024-04-25T22:03:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8684999999999995e-05 2024-04-25T22:03:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108520+0000", 2024-04-25T22:03:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5931999999999999e-05 2024-04-25T22:03:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209918+0000", 2024-04-25T22:03:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.101398696 2024-04-25T22:03:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209952+0000", 2024-04-25T22:03:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4038000000000002e-05 2024-04-25T22:03:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11 4.28 e51/49 4:177a762d:::10000000201.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.759697597000001, 2024-04-25T22:03:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098799331000000004, 2024-04-25T22:03:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108551+0000", 2024-04-25T22:03:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0699999999999996e-07 2024-04-25T22:03:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108576+0000", 2024-04-25T22:03:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4856000000000001e-05 2024-04-25T22:03:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108593+0000", 2024-04-25T22:03:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7125999999999998e-05 2024-04-25T22:03:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108609+0000", 2024-04-25T22:03:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6535999999999999e-05 2024-04-25T22:03:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108713+0000", 2024-04-25T22:03:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010344999999999999 2024-04-25T22:03:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108762+0000", 2024-04-25T22:03:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8711000000000002e-05 2024-04-25T22:03:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207305+0000", 2024-04-25T22:03:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098543566999999999 2024-04-25T22:03:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207349+0000", 2024-04-25T22:03:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4178000000000003e-05 2024-04-25T22:03:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:12 4.28 e51/49 4:15246602:::10000000202.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:03:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.759616306, 2024-04-25T22:03:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098749009999999998, 2024-04-25T22:03:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108632+0000", 2024-04-25T22:03:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2699999999999999e-07 2024-04-25T22:03:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108647+0000", 2024-04-25T22:03:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4585e-05 2024-04-25T22:03:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108667+0000", 2024-04-25T22:03:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9887000000000001e-05 2024-04-25T22:03:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108680+0000", 2024-04-25T22:03:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3249e-05 2024-04-25T22:03:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109917+0000", 2024-04-25T22:03:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012367050000000001 2024-04-25T22:03:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109961+0000", 2024-04-25T22:03:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4029000000000001e-05 2024-04-25T22:03:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207351+0000", 2024-04-25T22:03:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.097390791000000004 2024-04-25T22:03:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207380+0000", 2024-04-25T22:03:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9037e-05 2024-04-25T22:03:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:8 4.3b e51/49 4:deccbd37:::100000001fe.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.759551402, 2024-04-25T22:03:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090839771, 2024-04-25T22:03:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108697+0000", 2024-04-25T22:03:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1399999999999997e-07 2024-04-25T22:03:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108712+0000", 2024-04-25T22:03:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4772e-05 2024-04-25T22:03:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108728+0000", 2024-04-25T22:03:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5943e-05 2024-04-25T22:03:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108740+0000", 2024-04-25T22:03:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.235e-05 2024-04-25T22:03:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108797+0000", 2024-04-25T22:03:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6879000000000002e-05 2024-04-25T22:03:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108812+0000", 2024-04-25T22:03:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5268999999999999e-05 2024-04-25T22:03:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199495+0000", 2024-04-25T22:03:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090683071000000004 2024-04-25T22:03:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199536+0000", 2024-04-25T22:03:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0873e-05 2024-04-25T22:03:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:59 3.14 e52/15 3:2e2fa760:::200.00000001:head v 52'20, mlcod=51'18)", 2024-04-25T22:03:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:55.375543+0000", 2024-04-25T22:03:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4927047439999992, 2024-04-25T22:03:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.036557824000000003, 2024-04-25T22:03:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.375543+0000", 2024-04-25T22:03:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.375543+0000", 2024-04-25T22:03:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.375544+0000", 2024-04-25T22:03:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2640000000000001e-06 2024-04-25T22:03:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377524+0000", 2024-04-25T22:03:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001980154 2024-04-25T22:03:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377551+0000", 2024-04-25T22:03:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6211999999999999e-05 2024-04-25T22:03:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377569+0000", 2024-04-25T22:03:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182e-05 2024-04-25T22:03:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377689+0000", 2024-04-25T22:03:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119973 2024-04-25T22:03:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377722+0000", 2024-04-25T22:03:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3113e-05 2024-04-25T22:03:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.412025+0000", 2024-04-25T22:03:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.034302721000000001 2024-04-25T22:03:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.412101+0000", 2024-04-25T22:03:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6205000000000006e-05 2024-04-25T22:03:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:2291 4.32 e52/16 4:4ffda274:::10000000c47.00000000:head v 52'42, mlcod=52'40)", 2024-04-25T22:03:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:57.074116+0000", 2024-04-25T22:03:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.7941319680000003, 2024-04-25T22:03:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017364083999999998, 2024-04-25T22:03:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074116+0000", 2024-04-25T22:03:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074116+0000", 2024-04-25T22:03:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074118+0000", 2024-04-25T22:03:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.903e-06 2024-04-25T22:03:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074223+0000", 2024-04-25T22:03:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105664 2024-04-25T22:03:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074251+0000", 2024-04-25T22:03:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8161999999999999e-05 2024-04-25T22:03:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074264+0000", 2024-04-25T22:03:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2989999999999999e-05 2024-04-25T22:03:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074390+0000", 2024-04-25T22:03:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012554600000000001 2024-04-25T22:03:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.074451+0000", 2024-04-25T22:03:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1092000000000004e-05 2024-04-25T22:03:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.091406+0000", 2024-04-25T22:03:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016955409000000001 2024-04-25T22:03:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.091480+0000", 2024-04-25T22:03:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3318000000000005e-05 2024-04-25T22:03:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:2315 4.1f e52/49 4:f84a2a2d:::10000000c60.00000000:head v 52'42, mlcod=52'40)", 2024-04-25T22:03:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:57.112380+0000", 2024-04-25T22:03:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.7558681150000002, 2024-04-25T22:03:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.038962912000000002, 2024-04-25T22:03:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112380+0000", 2024-04-25T22:03:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112380+0000", 2024-04-25T22:03:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112381+0000", 2024-04-25T22:03:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112856+0000", 2024-04-25T22:03:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047428299999999999 2024-04-25T22:03:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112885+0000", 2024-04-25T22:03:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9019000000000001e-05 2024-04-25T22:03:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112898+0000", 2024-04-25T22:03:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:03:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.113041+0000", 2024-04-25T22:03:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014280599999999999 2024-04-25T22:03:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.113102+0000", 2024-04-25T22:03:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1495000000000007e-05 2024-04-25T22:03:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.151273+0000", 2024-04-25T22:03:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.038170444999999997 2024-04-25T22:03:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.151342+0000", 2024-04-25T22:03:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9861000000000001e-05 2024-04-25T22:03:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:3804 4.2f e53/16 4:f569593f:::10000001253.00000000:head v 53'67, mlcod=53'65)", 2024-04-25T22:03:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:00.169882+0000", 2024-04-25T22:03:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6983658579999998, 2024-04-25T22:03:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030929529000000001, 2024-04-25T22:03:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.169882+0000", 2024-04-25T22:03:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.169882+0000", 2024-04-25T22:03:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.169884+0000", 2024-04-25T22:03:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.843e-06 2024-04-25T22:03:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.170484+0000", 2024-04-25T22:03:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060082600000000005 2024-04-25T22:03:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.170511+0000", 2024-04-25T22:03:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6373e-05 2024-04-25T22:03:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.170523+0000", 2024-04-25T22:03:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2583e-05 2024-04-25T22:03:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.170655+0000", 2024-04-25T22:03:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013200899999999999 2024-04-25T22:03:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.170717+0000", 2024-04-25T22:03:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1984999999999997e-05 2024-04-25T22:03:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.200715+0000", 2024-04-25T22:03:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029997271999999998 2024-04-25T22:03:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.200811+0000", 2024-04-25T22:03:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6638000000000005e-05 2024-04-25T22:03:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:3816 4.37 e53/16 4:eea7faa5:::10000001260.00000000:head v 53'60, mlcod=53'58)", 2024-04-25T22:03:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:00.182914+0000", 2024-04-25T22:03:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6853341520000003, 2024-04-25T22:03:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017412075999999999, 2024-04-25T22:03:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.182914+0000", 2024-04-25T22:03:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.182914+0000", 2024-04-25T22:03:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.182915+0000", 2024-04-25T22:03:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6530000000000001e-06 2024-04-25T22:03:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.182926+0000", 2024-04-25T22:03:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.092e-05 2024-04-25T22:03:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.182978+0000", 2024-04-25T22:03:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1557999999999997e-05 2024-04-25T22:03:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.182989+0000", 2024-04-25T22:03:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.165e-05 2024-04-25T22:03:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.183098+0000", 2024-04-25T22:03:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010888 2024-04-25T22:03:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.183130+0000", 2024-04-25T22:03:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2082999999999998e-05 2024-04-25T22:03:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.200203+0000", 2024-04-25T22:03:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017072442 2024-04-25T22:03:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.200326+0000", 2024-04-25T22:03:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012289000000000001 2024-04-25T22:03:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:3818 4.3f e53/49 4:fc3019ee:::10000001262.00000000:head v 53'55, mlcod=53'53)", 2024-04-25T22:03:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:00.184762+0000", 2024-04-25T22:03:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6834859890000002, 2024-04-25T22:03:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015658160000000001, 2024-04-25T22:03:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.184762+0000", 2024-04-25T22:03:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.184762+0000", 2024-04-25T22:03:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.184764+0000", 2024-04-25T22:03:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0540000000000002e-06 2024-04-25T22:03:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.184786+0000", 2024-04-25T22:03:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1954999999999999e-05 2024-04-25T22:03:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.184811+0000", 2024-04-25T22:03:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5687e-05 2024-04-25T22:03:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.184829+0000", 2024-04-25T22:03:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7186000000000001e-05 2024-04-25T22:03:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.184961+0000", 2024-04-25T22:03:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013210899999999999 2024-04-25T22:03:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.184993+0000", 2024-04-25T22:03:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1918999999999997e-05 2024-04-25T22:03:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.200332+0000", 2024-04-25T22:03:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015339492999999999 2024-04-25T22:03:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.200420+0000", 2024-04-25T22:03:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7756999999999993e-05 2024-04-25T22:03:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:142 3.1e e57/15 3:7bf7e7b5:::200.00000006:head v 57'3, mlcod=17'1)", 2024-04-25T22:03:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.680415+0000", 2024-04-25T22:03:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.18783269999999999, 2024-04-25T22:03:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030171997999999998, 2024-04-25T22:03:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.680415+0000", 2024-04-25T22:03:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.680415+0000", 2024-04-25T22:03:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.680417+0000", 2024-04-25T22:03:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8470000000000001e-06 2024-04-25T22:03:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.681319+0000", 2024-04-25T22:03:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090179699999999997 2024-04-25T22:03:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.681339+0000", 2024-04-25T22:03:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9928999999999998e-05 2024-04-25T22:03:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.681350+0000", 2024-04-25T22:03:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1917e-05 2024-04-25T22:03:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.681459+0000", 2024-04-25T22:03:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000108507 2024-04-25T22:03:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.681492+0000", 2024-04-25T22:03:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3488999999999997e-05 2024-04-25T22:03:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.710516+0000", 2024-04-25T22:03:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029023456999999999 2024-04-25T22:03:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.710587+0000", 2024-04-25T22:03:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1055000000000003e-05 2024-04-25T22:03:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:04.970 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:04.970 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:04.971 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:04.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:04.969+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:05.072 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:05.064+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:05.114 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:05.114 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:05.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.114 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6847 4.16 4.8bfe6e16 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:05.114 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:05.114 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.41959787700000001, 2024-04-25T22:03:05.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.419620669, 2024-04-25T22:03:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for peered", 2024-04-25T22:03:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6847 2024-04-25T22:03:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693473+0000", 2024-04-25T22:03:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.75e-06 2024-04-25T22:03:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693490+0000", 2024-04-25T22:03:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6540000000000001e-05 2024-04-25T22:03:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693509+0000", 2024-04-25T22:03:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9536999999999999e-05 2024-04-25T22:03:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693522+0000", 2024-04-25T22:03:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2099000000000001e-05 2024-04-25T22:03:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693677+0000", 2024-04-25T22:03:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015516799999999999 2024-04-25T22:03:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693705+0000", 2024-04-25T22:03:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8663e-05 2024-04-25T22:03:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7018 4.30 4:0f948e4c:::10000002017.00000000:head [write 0~83887 in=83887b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.105842+0000", 2024-04-25T22:03:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0072270720000000002, 2024-04-25T22:03:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074085519999999997, 2024-04-25T22:03:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7018 2024-04-25T22:03:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.105842+0000", 2024-04-25T22:03:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.105842+0000", 2024-04-25T22:03:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.105845+0000", 2024-04-25T22:03:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.136e-06 2024-04-25T22:03:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.105970+0000", 2024-04-25T22:03:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012551500000000001 2024-04-25T22:03:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.106000+0000", 2024-04-25T22:03:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0239999999999998e-05 2024-04-25T22:03:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.106015+0000", 2024-04-25T22:03:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4579999999999999e-05 2024-04-25T22:03:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.106168+0000", 2024-04-25T22:03:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000153191 2024-04-25T22:03:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.106569+0000", 2024-04-25T22:03:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040120999999999999 2024-04-25T22:03:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.106962+0000", 2024-04-25T22:03:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000393161 2024-04-25T22:03:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7019 4.3a 4:5ea99904:::10000002019.00000000:head [write 0~25615 in=25615b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.110335+0000", 2024-04-25T22:03:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00273434, 2024-04-25T22:03:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0030797139999999999, 2024-04-25T22:03:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7019 2024-04-25T22:03:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.110335+0000", 2024-04-25T22:03:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.110335+0000", 2024-04-25T22:03:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.110337+0000", 2024-04-25T22:03:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0439999999999998e-06 2024-04-25T22:03:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.110398+0000", 2024-04-25T22:03:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0475e-05 2024-04-25T22:03:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.110428+0000", 2024-04-25T22:03:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0073000000000002e-05 2024-04-25T22:03:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.110443+0000", 2024-04-25T22:03:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4793e-05 2024-04-25T22:03:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.110589+0000", 2024-04-25T22:03:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000146728 2024-04-25T22:03:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.110797+0000", 2024-04-25T22:03:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020723399999999999 2024-04-25T22:03:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.110971+0000", 2024-04-25T22:03:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017403300000000001 2024-04-25T22:03:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.112365+0000", 2024-04-25T22:03:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001394279 2024-04-25T22:03:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6960 4.16 4.44cbc416 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.142593779, 2024-04-25T22:03:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.143062571, 2024-04-25T22:03:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for peered", 2024-04-25T22:03:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6960 2024-04-25T22:03:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970478+0000", 2024-04-25T22:03:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.939e-06 2024-04-25T22:03:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970488+0000", 2024-04-25T22:03:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9699999999999994e-06 2024-04-25T22:03:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970524+0000", 2024-04-25T22:03:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5963000000000001e-05 2024-04-25T22:03:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970537+0000", 2024-04-25T22:03:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.31e-05 2024-04-25T22:03:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970701+0000", 2024-04-25T22:03:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164177 2024-04-25T22:03:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970718+0000", 2024-04-25T22:03:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7323e-05 2024-04-25T22:03:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:03:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 4 2024-04-25T22:03:05.131 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:05.132 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:05.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:05.169+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:05.268 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:05.269 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:05.269 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:03:05.269 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:03:05.269 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:05.273 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:05.268+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:05.284 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:05.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:05.369+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:05.422 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:05.422 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:03:05.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:03:05.422 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:05.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.422 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:03:05.422 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:03:05.422 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 119.240745961, 2024-04-25T22:03:05.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028679887000000001, 2024-04-25T22:03:05.422 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.422 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.422 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.422 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:05.423 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:03:05.423 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:03:05.423 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 161 2024-04-25T22:03:05.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.423 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:03:05.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176200+0000", 2024-04-25T22:03:05.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176201+0000", 2024-04-25T22:03:05.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6700000000000002e-07 2024-04-25T22:03:05.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176351+0000", 2024-04-25T22:03:05.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015009600000000001 2024-04-25T22:03:05.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176365+0000", 2024-04-25T22:03:05.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.413e-05 2024-04-25T22:03:05.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176374+0000", 2024-04-25T22:03:05.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1600000000000004e-06 2024-04-25T22:03:05.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193578+0000", 2024-04-25T22:03:05.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017203555999999998 2024-04-25T22:03:05.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.193855+0000", 2024-04-25T22:03:05.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027705699999999999 2024-04-25T22:03:05.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:05.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.194185+0000", 2024-04-25T22:03:05.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032975099999999998 2024-04-25T22:03:05.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:05.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.199394+0000", 2024-04-25T22:03:05.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052097749999999998 2024-04-25T22:03:05.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:05.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204731+0000", 2024-04-25T22:03:05.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053363059999999999 2024-04-25T22:03:05.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204814+0000", 2024-04-25T22:03:05.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3362999999999995e-05 2024-04-25T22:03:05.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204880+0000", 2024-04-25T22:03:05.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5826000000000003e-05 2024-04-25T22:03:05.427 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.427 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.427 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.427 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:03:05.427 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:03:05.428 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 119.24042821, 2024-04-25T22:03:05.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028797439000000001, 2024-04-25T22:03:05.428 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.428 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.428 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.428 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:05.428 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:03:05.428 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:03:05.428 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 164 2024-04-25T22:03:05.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.428 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:03:05.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176518+0000", 2024-04-25T22:03:05.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176519+0000", 2024-04-25T22:03:05.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.127e-06 2024-04-25T22:03:05.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176662+0000", 2024-04-25T22:03:05.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014326200000000001 2024-04-25T22:03:05.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176680+0000", 2024-04-25T22:03:05.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7535999999999999e-05 2024-04-25T22:03:05.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176689+0000", 2024-04-25T22:03:05.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3770000000000002e-06 2024-04-25T22:03:05.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200021+0000", 2024-04-25T22:03:05.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023332347 2024-04-25T22:03:05.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200226+0000", 2024-04-25T22:03:05.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000204305 2024-04-25T22:03:05.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:05.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.200432+0000", 2024-04-25T22:03:05.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206338 2024-04-25T22:03:05.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:05.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.204711+0000", 2024-04-25T22:03:05.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042790620000000001 2024-04-25T22:03:05.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:05.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205139+0000", 2024-04-25T22:03:05.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042788 2024-04-25T22:03:05.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205262+0000", 2024-04-25T22:03:05.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012334600000000001 2024-04-25T22:03:05.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205315+0000", 2024-04-25T22:03:05.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2859000000000003e-05 2024-04-25T22:03:05.432 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.432 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.432 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.433 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:03:05.433 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:03:05.433 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 119.240238698, 2024-04-25T22:03:05.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028960874000000001, 2024-04-25T22:03:05.433 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.433 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.433 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.433 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:05.433 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:03:05.433 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:03:05.433 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 165 2024-04-25T22:03:05.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.433 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:03:05.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176707+0000", 2024-04-25T22:03:05.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176708+0000", 2024-04-25T22:03:05.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8700000000000004e-07 2024-04-25T22:03:05.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176714+0000", 2024-04-25T22:03:05.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.003e-06 2024-04-25T22:03:05.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176724+0000", 2024-04-25T22:03:05.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8369999999999992e-06 2024-04-25T22:03:05.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.176731+0000", 2024-04-25T22:03:05.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3529999999999997e-06 2024-04-25T22:03:05.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203142+0000", 2024-04-25T22:03:05.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026410692 2024-04-25T22:03:05.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203414+0000", 2024-04-25T22:03:05.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027153799999999999 2024-04-25T22:03:05.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:05.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.203711+0000", 2024-04-25T22:03:05.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029739399999999998 2024-04-25T22:03:05.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:05.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205389+0000", 2024-04-25T22:03:05.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016785190000000001 2024-04-25T22:03:05.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:05.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205560+0000", 2024-04-25T22:03:05.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017036899999999999 2024-04-25T22:03:05.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205620+0000", 2024-04-25T22:03:05.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0306000000000002e-05 2024-04-25T22:03:05.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.205668+0000", 2024-04-25T22:03:05.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7976000000000003e-05 2024-04-25T22:03:05.438 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.438 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.438 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.438 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4153.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:03:05.438 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:03:05.438 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 119.048373251, 2024-04-25T22:03:05.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029137028999999998, 2024-04-25T22:03:05.438 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.438 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.438 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:05.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4153", 2024-04-25T22:03:05.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.44:0/3305001130", 2024-04-25T22:03:05.439 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 189 2024-04-25T22:03:05.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.439 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:03:05.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368573+0000", 2024-04-25T22:03:05.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368574+0000", 2024-04-25T22:03:05.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:03:05.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368581+0000", 2024-04-25T22:03:05.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0199999999999997e-06 2024-04-25T22:03:05.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368593+0000", 2024-04-25T22:03:05.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2046e-05 2024-04-25T22:03:05.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.368601+0000", 2024-04-25T22:03:05.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2029999999999992e-06 2024-04-25T22:03:05.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395170+0000", 2024-04-25T22:03:05.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026568791000000001 2024-04-25T22:03:05.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395296+0000", 2024-04-25T22:03:05.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012634199999999999 2024-04-25T22:03:05.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:05.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.395498+0000", 2024-04-25T22:03:05.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020245500000000001 2024-04-25T22:03:05.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:05.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.396950+0000", 2024-04-25T22:03:05.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001451075 2024-04-25T22:03:05.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:05.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397558+0000", 2024-04-25T22:03:05.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060886499999999999 2024-04-25T22:03:05.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397644+0000", 2024-04-25T22:03:05.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5362e-05 2024-04-25T22:03:05.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:01:06.397710+0000", 2024-04-25T22:03:05.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5959999999999999e-05 2024-04-25T22:03:05.443 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.443 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.443 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.444 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T22:03:05.444 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:05.444 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.433113754000001, 2024-04-25T22:03:05.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.180276931, 2024-04-25T22:03:05.444 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.444 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.444 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.444 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:05.444 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:05.444 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:05.444 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4 2024-04-25T22:03:05.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.444 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:05.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:05.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983834+0000", 2024-04-25T22:03:05.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2900000000000001e-06 2024-04-25T22:03:05.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991787+0000", 2024-04-25T22:03:05.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079521690000000003 2024-04-25T22:03:05.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991826+0000", 2024-04-25T22:03:05.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9258999999999998e-05 2024-04-25T22:03:05.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991845+0000", 2024-04-25T22:03:05.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9360000000000001e-05 2024-04-25T22:03:05.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992058+0000", 2024-04-25T22:03:05.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212559 2024-04-25T22:03:05.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992213+0000", 2024-04-25T22:03:05.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015520700000000001 2024-04-25T22:03:05.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:05.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992414+0000", 2024-04-25T22:03:05.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020049 2024-04-25T22:03:05.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:05.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162511+0000", 2024-04-25T22:03:05.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.17009782900000001 2024-04-25T22:03:05.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:05.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163967+0000", 2024-04-25T22:03:05.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001455752 2024-04-25T22:03:05.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164045+0000", 2024-04-25T22:03:05.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7415000000000003e-05 2024-04-25T22:03:05.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164109+0000", 2024-04-25T22:03:05.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4601e-05 2024-04-25T22:03:05.449 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.449 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.449 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.449 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:05.449 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:05.449 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.333655606000001, 2024-04-25T22:03:05.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.12612672599999999, 2024-04-25T22:03:05.449 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.449 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.449 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.450 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:05.450 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:05.450 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:05.450 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2024-04-25T22:03:05.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.450 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:05.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:05.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083293+0000", 2024-04-25T22:03:05.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6630000000000002e-06 2024-04-25T22:03:05.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086619+0000", 2024-04-25T22:03:05.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033261699999999998 2024-04-25T22:03:05.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086647+0000", 2024-04-25T22:03:05.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8085999999999998e-05 2024-04-25T22:03:05.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086665+0000", 2024-04-25T22:03:05.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:03:05.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086870+0000", 2024-04-25T22:03:05.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020488599999999999 2024-04-25T22:03:05.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087110+0000", 2024-04-25T22:03:05.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024093199999999999 2024-04-25T22:03:05.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:05.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087310+0000", 2024-04-25T22:03:05.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000199936 2024-04-25T22:03:05.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:05.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207766+0000", 2024-04-25T22:03:05.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.120456035 2024-04-25T22:03:05.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:05.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209358+0000", 2024-04-25T22:03:05.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015912369999999999 2024-04-25T22:03:05.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209390+0000", 2024-04-25T22:03:05.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2434999999999997e-05 2024-04-25T22:03:05.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209417+0000", 2024-04-25T22:03:05.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6936000000000001e-05 2024-04-25T22:03:05.454 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.454 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.454 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.455 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop_reply(client.4564.0:4 4.32 e51/16 ondisk, result = 0)", 2024-04-25T22:03:05.455 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.102726+0000", 2024-04-25T22:03:05.455 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.314220071999999, 2024-04-25T22:03:05.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059798849000000001, 2024-04-25T22:03:05.455 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.455 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.455 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-25T22:03:05.455 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102726+0000", 2024-04-25T22:03:05.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102726+0000", 2024-04-25T22:03:05.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102727+0000", 2024-04-25T22:03:05.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7800000000000001e-07 2024-04-25T22:03:05.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102732+0000", 2024-04-25T22:03:05.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9389999999999996e-06 2024-04-25T22:03:05.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102747+0000", 2024-04-25T22:03:05.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5554e-05 2024-04-25T22:03:05.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.102755+0000", 2024-04-25T22:03:05.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1599999999999998e-06 2024-04-25T22:03:05.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162489+0000", 2024-04-25T22:03:05.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059734204999999999 2024-04-25T22:03:05.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162501+0000", 2024-04-25T22:03:05.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1775e-05 2024-04-25T22:03:05.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162525+0000", 2024-04-25T22:03:05.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3438000000000002e-05 2024-04-25T22:03:05.458 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.458 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.458 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.459 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:19 4.2a 4:55a6cd83:::1000000020a.00000000:head [write 0~1605] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:05.459 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.111321+0000", 2024-04-25T22:03:05.459 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.305624479, 2024-04-25T22:03:05.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.053212803000000003, 2024-04-25T22:03:05.459 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.459 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.459 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.459 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:05.459 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:05.459 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:05.459 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 19 2024-04-25T22:03:05.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.459 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111321+0000", 2024-04-25T22:03:05.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111321+0000", 2024-04-25T22:03:05.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111323+0000", 2024-04-25T22:03:05.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9759999999999998e-06 2024-04-25T22:03:05.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111334+0000", 2024-04-25T22:03:05.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.049e-05 2024-04-25T22:03:05.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111359+0000", 2024-04-25T22:03:05.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.495e-05 2024-04-25T22:03:05.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.111380+0000", 2024-04-25T22:03:05.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1063000000000001e-05 2024-04-25T22:03:05.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162572+0000", 2024-04-25T22:03:05.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.051191677999999997 2024-04-25T22:03:05.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162760+0000", 2024-04-25T22:03:05.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018837500000000001 2024-04-25T22:03:05.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:05.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162962+0000", 2024-04-25T22:03:05.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020174200000000001 2024-04-25T22:03:05.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:05.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164379+0000", 2024-04-25T22:03:05.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001416856 2024-04-25T22:03:05.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:05.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164402+0000", 2024-04-25T22:03:05.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3734e-05 2024-04-25T22:03:05.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164474+0000", 2024-04-25T22:03:05.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1422999999999997e-05 2024-04-25T22:03:05.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164534+0000", 2024-04-25T22:03:05.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0516000000000001e-05 2024-04-25T22:03:05.464 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.464 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.464 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.464 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:24 4.b e51/16 4:d3eda40d:::1000000020f.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:05.464 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.119033+0000", 2024-04-25T22:03:05.464 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.297912603, 2024-04-25T22:03:05.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088682448999999997, 2024-04-25T22:03:05.464 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.464 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.464 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.464 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119033+0000", 2024-04-25T22:03:05.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119033+0000", 2024-04-25T22:03:05.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119035+0000", 2024-04-25T22:03:05.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:03:05.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119044+0000", 2024-04-25T22:03:05.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0860000000000008e-06 2024-04-25T22:03:05.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119068+0000", 2024-04-25T22:03:05.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4037e-05 2024-04-25T22:03:05.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119080+0000", 2024-04-25T22:03:05.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2322e-05 2024-04-25T22:03:05.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119203+0000", 2024-04-25T22:03:05.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012249799999999999 2024-04-25T22:03:05.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.119253+0000", 2024-04-25T22:03:05.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0148999999999997e-05 2024-04-25T22:03:05.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207679+0000", 2024-04-25T22:03:05.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088425928000000001 2024-04-25T22:03:05.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207716+0000", 2024-04-25T22:03:05.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7048999999999997e-05 2024-04-25T22:03:05.468 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.468 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.468 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.468 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:27 4.13 4:cbcb6224:::10000000212.00000000:head [write 0~3719] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:05.468 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.122624+0000", 2024-04-25T22:03:05.468 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.29432171, 2024-04-25T22:03:05.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087419288999999997, 2024-04-25T22:03:05.468 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.469 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.469 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.469 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:05.469 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:05.469 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:05.469 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 27 2024-04-25T22:03:05.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.469 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122624+0000", 2024-04-25T22:03:05.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122624+0000", 2024-04-25T22:03:05.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122625+0000", 2024-04-25T22:03:05.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.181e-06 2024-04-25T22:03:05.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122632+0000", 2024-04-25T22:03:05.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8279999999999997e-06 2024-04-25T22:03:05.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122647+0000", 2024-04-25T22:03:05.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4398e-05 2024-04-25T22:03:05.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.122657+0000", 2024-04-25T22:03:05.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0662999999999999e-05 2024-04-25T22:03:05.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.206922+0000", 2024-04-25T22:03:05.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084264247 2024-04-25T22:03:05.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207073+0000", 2024-04-25T22:03:05.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015129499999999999 2024-04-25T22:03:05.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:05.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207227+0000", 2024-04-25T22:03:05.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000153819 2024-04-25T22:03:05.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:05.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209429+0000", 2024-04-25T22:03:05.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022023899999999998 2024-04-25T22:03:05.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:05.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209971+0000", 2024-04-25T22:03:05.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00054203900000000002 2024-04-25T22:03:05.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210004+0000", 2024-04-25T22:03:05.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2468999999999997e-05 2024-04-25T22:03:05.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210044+0000", 2024-04-25T22:03:05.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9959999999999997e-05 2024-04-25T22:03:05.473 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.473 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.473 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.473 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:28 4.2a 4:56889a45:::10000000213.00000000:head [write 0~1971] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:05.474 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.124053+0000", 2024-04-25T22:03:05.474 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.292892597, 2024-04-25T22:03:05.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.040913613000000001, 2024-04-25T22:03:05.474 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.474 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.474 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.474 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:05.474 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:05.474 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:05.474 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 28 2024-04-25T22:03:05.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.474 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124053+0000", 2024-04-25T22:03:05.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124053+0000", 2024-04-25T22:03:05.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124054+0000", 2024-04-25T22:03:05.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8200000000000008e-07 2024-04-25T22:03:05.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124060+0000", 2024-04-25T22:03:05.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6879999999999996e-06 2024-04-25T22:03:05.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124073+0000", 2024-04-25T22:03:05.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3113e-05 2024-04-25T22:03:05.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.124081+0000", 2024-04-25T22:03:05.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4959999999999999e-06 2024-04-25T22:03:05.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163657+0000", 2024-04-25T22:03:05.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.039576014 2024-04-25T22:03:05.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163775+0000", 2024-04-25T22:03:05.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011861100000000001 2024-04-25T22:03:05.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:05.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163907+0000", 2024-04-25T22:03:05.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013217599999999999 2024-04-25T22:03:05.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:05.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164803+0000", 2024-04-25T22:03:05.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000895801 2024-04-25T22:03:05.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:05.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164825+0000", 2024-04-25T22:03:05.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1339e-05 2024-04-25T22:03:05.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164906+0000", 2024-04-25T22:03:05.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.119e-05 2024-04-25T22:03:05.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164967+0000", 2024-04-25T22:03:05.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1203000000000003e-05 2024-04-25T22:03:05.479 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.479 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.479 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.479 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:32 4.b e51/16 4:d2dbd4ac:::10000000217.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:03:05.479 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.130764+0000", 2024-04-25T22:03:05.479 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.286181858000001, 2024-04-25T22:03:05.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.07870402, 2024-04-25T22:03:05.479 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.479 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.480 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.480 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130764+0000", 2024-04-25T22:03:05.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130764+0000", 2024-04-25T22:03:05.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130766+0000", 2024-04-25T22:03:05.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6270000000000001e-06 2024-04-25T22:03:05.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130777+0000", 2024-04-25T22:03:05.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1799e-05 2024-04-25T22:03:05.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130805+0000", 2024-04-25T22:03:05.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7036999999999999e-05 2024-04-25T22:03:05.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.130817+0000", 2024-04-25T22:03:05.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2856e-05 2024-04-25T22:03:05.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.206926+0000", 2024-04-25T22:03:05.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.076108517000000001 2024-04-25T22:03:05.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207009+0000", 2024-04-25T22:03:05.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.276e-05 2024-04-25T22:03:05.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209432+0000", 2024-04-25T22:03:05.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024229830000000001 2024-04-25T22:03:05.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209468+0000", 2024-04-25T22:03:05.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6440999999999999e-05 2024-04-25T22:03:05.483 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.483 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.483 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.483 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:46 4.b e51/16 4:d0d26e50:::10000000225.00000000:head v 51'3, mlcod=0'0)", 2024-04-25T22:03:05.483 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:03:05.484 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.266126343, 2024-04-25T22:03:05.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.058683655000000001, 2024-04-25T22:03:05.484 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.484 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.484 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.484 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:03:05.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:03:05.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150820+0000", 2024-04-25T22:03:05.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7499999999999999e-07 2024-04-25T22:03:05.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150827+0000", 2024-04-25T22:03:05.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.64e-06 2024-04-25T22:03:05.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150841+0000", 2024-04-25T22:03:05.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3895e-05 2024-04-25T22:03:05.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.150849+0000", 2024-04-25T22:03:05.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5310000000000004e-06 2024-04-25T22:03:05.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207762+0000", 2024-04-25T22:03:05.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.056913380999999999 2024-04-25T22:03:05.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207782+0000", 2024-04-25T22:03:05.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0026000000000001e-05 2024-04-25T22:03:05.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209471+0000", 2024-04-25T22:03:05.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016892020000000001 2024-04-25T22:03:05.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209503+0000", 2024-04-25T22:03:05.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2104999999999998e-05 2024-04-25T22:03:05.487 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.487 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.487 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.488 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:54 4.2b 4:d5ee56ee:::1000000022d.00000000:head [write 0~3953] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:05.488 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.162091+0000", 2024-04-25T22:03:05.488 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.254855384000001, 2024-04-25T22:03:05.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.048184338, 2024-04-25T22:03:05.488 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.488 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.488 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.488 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:05.488 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:05.488 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:05.488 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54 2024-04-25T22:03:05.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.488 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162091+0000", 2024-04-25T22:03:05.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162091+0000", 2024-04-25T22:03:05.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162092+0000", 2024-04-25T22:03:05.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.175e-06 2024-04-25T22:03:05.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162102+0000", 2024-04-25T22:03:05.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0012e-05 2024-04-25T22:03:05.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162117+0000", 2024-04-25T22:03:05.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5443000000000001e-05 2024-04-25T22:03:05.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162126+0000", 2024-04-25T22:03:05.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1840000000000005e-06 2024-04-25T22:03:05.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207805+0000", 2024-04-25T22:03:05.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.045678641999999998 2024-04-25T22:03:05.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207941+0000", 2024-04-25T22:03:05.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000135983 2024-04-25T22:03:05.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:05.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.208119+0000", 2024-04-25T22:03:05.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017767099999999999 2024-04-25T22:03:05.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:05.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209511+0000", 2024-04-25T22:03:05.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001392304 2024-04-25T22:03:05.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:05.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210222+0000", 2024-04-25T22:03:05.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00071096500000000003 2024-04-25T22:03:05.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210250+0000", 2024-04-25T22:03:05.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8004000000000002e-05 2024-04-25T22:03:05.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.210275+0000", 2024-04-25T22:03:05.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4955000000000001e-05 2024-04-25T22:03:05.493 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.493 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.493 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.493 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:77 4.30 4:0c28cce1:::10000000244.00000000:head [write 0~1537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:05.493 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.201108+0000", 2024-04-25T22:03:05.493 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.215838377000001, 2024-04-25T22:03:05.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088952635000000002, 2024-04-25T22:03:05.494 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.494 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.494 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.494 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:05.494 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:05.494 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:05.494 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 77 2024-04-25T22:03:05.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.494 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201108+0000", 2024-04-25T22:03:05.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201108+0000", 2024-04-25T22:03:05.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201109+0000", 2024-04-25T22:03:05.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2160000000000001e-06 2024-04-25T22:03:05.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201116+0000", 2024-04-25T22:03:05.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9979999999999997e-06 2024-04-25T22:03:05.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201133+0000", 2024-04-25T22:03:05.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.753e-05 2024-04-25T22:03:05.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201156+0000", 2024-04-25T22:03:05.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2558999999999999e-05 2024-04-25T22:03:05.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201216+0000", 2024-04-25T22:03:05.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9741000000000003e-05 2024-04-25T22:03:05.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201307+0000", 2024-04-25T22:03:05.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1314e-05 2024-04-25T22:03:05.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:05.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.201395+0000", 2024-04-25T22:03:05.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8460000000000003e-05 2024-04-25T22:03:05.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:05.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.202212+0000", 2024-04-25T22:03:05.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000816923 2024-04-25T22:03:05.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:05.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.289754+0000", 2024-04-25T22:03:05.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087541315999999994 2024-04-25T22:03:05.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.289931+0000", 2024-04-25T22:03:05.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017723700000000001 2024-04-25T22:03:05.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290060+0000", 2024-04-25T22:03:05.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012934099999999999 2024-04-25T22:03:05.498 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.499 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.499 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.499 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:89 4.30 4:0e3d5a27:::10000000250.00000000:head [write 0~1321] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:05.499 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.224278+0000", 2024-04-25T22:03:05.499 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.192667689, 2024-04-25T22:03:05.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.066143380000000002, 2024-04-25T22:03:05.499 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.499 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.499 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.499 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:05.499 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:05.499 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:05.499 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 89 2024-04-25T22:03:05.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.500 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224278+0000", 2024-04-25T22:03:05.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224278+0000", 2024-04-25T22:03:05.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224279+0000", 2024-04-25T22:03:05.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.248e-06 2024-04-25T22:03:05.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224286+0000", 2024-04-25T22:03:05.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4799999999999998e-06 2024-04-25T22:03:05.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224300+0000", 2024-04-25T22:03:05.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4275e-05 2024-04-25T22:03:05.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224311+0000", 2024-04-25T22:03:05.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1182999999999999e-05 2024-04-25T22:03:05.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224396+0000", 2024-04-25T22:03:05.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4901999999999995e-05 2024-04-25T22:03:05.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224561+0000", 2024-04-25T22:03:05.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016465699999999999 2024-04-25T22:03:05.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:05.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.224734+0000", 2024-04-25T22:03:05.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017334800000000001 2024-04-25T22:03:05.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:05.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.225929+0000", 2024-04-25T22:03:05.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001194575 2024-04-25T22:03:05.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:05.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290179+0000", 2024-04-25T22:03:05.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064250242999999999 2024-04-25T22:03:05.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290329+0000", 2024-04-25T22:03:05.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014964700000000001 2024-04-25T22:03:05.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.290422+0000", 2024-04-25T22:03:05.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2822e-05 2024-04-25T22:03:05.504 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.504 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.504 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.504 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:59 3.14 3:2e2fa760:::200.00000001:head [write 2774296~1300645 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-25T22:03:05.504 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:55.373674+0000", 2024-04-25T22:03:05.505 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.043272364, 2024-04-25T22:03:05.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.039145353000000001, 2024-04-25T22:03:05.505 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.505 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.505 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.505 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.373674+0000", 2024-04-25T22:03:05.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.373674+0000", 2024-04-25T22:03:05.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.373676+0000", 2024-04-25T22:03:05.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0729999999999999e-06 2024-04-25T22:03:05.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375383+0000", 2024-04-25T22:03:05.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017077469999999999 2024-04-25T22:03:05.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375414+0000", 2024-04-25T22:03:05.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0661999999999999e-05 2024-04-25T22:03:05.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375438+0000", 2024-04-25T22:03:05.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4332999999999999e-05 2024-04-25T22:03:05.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375513+0000", 2024-04-25T22:03:05.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4562999999999997e-05 2024-04-25T22:03:05.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375569+0000", 2024-04-25T22:03:05.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6286000000000003e-05 2024-04-25T22:03:05.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:05.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.375651+0000", 2024-04-25T22:03:05.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2149000000000002e-05 2024-04-25T22:03:05.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:05.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.389672+0000", 2024-04-25T22:03:05.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014020886999999999 2024-04-25T22:03:05.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:05.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.412742+0000", 2024-04-25T22:03:05.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023070100999999999 2024-04-25T22:03:05.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.412784+0000", 2024-04-25T22:03:05.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1925999999999998e-05 2024-04-25T22:03:05.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:55.412819+0000", 2024-04-25T22:03:05.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4625999999999997e-05 2024-04-25T22:03:05.511 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.511 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.511 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.511 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:2315 4.1f 4:f84a2a2d:::10000000c60.00000000:head [write 0~648229] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-25T22:03:05.511 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:57.110762+0000", 2024-04-25T22:03:05.511 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.3061838229999996, 2024-04-25T22:03:05.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.041428231000000003, 2024-04-25T22:03:05.512 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.512 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.512 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.512 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:05.512 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:05.512 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:05.512 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2315 2024-04-25T22:03:05.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.512 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.110762+0000", 2024-04-25T22:03:05.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.110762+0000", 2024-04-25T22:03:05.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.110764+0000", 2024-04-25T22:03:05.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5460000000000001e-06 2024-04-25T22:03:05.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.111342+0000", 2024-04-25T22:03:05.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057855899999999997 2024-04-25T22:03:05.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.111364+0000", 2024-04-25T22:03:05.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1810999999999998e-05 2024-04-25T22:03:05.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.111376+0000", 2024-04-25T22:03:05.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.165e-05 2024-04-25T22:03:05.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.111533+0000", 2024-04-25T22:03:05.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156902 2024-04-25T22:03:05.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.111910+0000", 2024-04-25T22:03:05.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037699000000000001 2024-04-25T22:03:05.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:05.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.112294+0000", 2024-04-25T22:03:05.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038433899999999998 2024-04-25T22:03:05.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:05.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.150695+0000", 2024-04-25T22:03:05.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.038401063999999999 2024-04-25T22:03:05.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:05.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.151992+0000", 2024-04-25T22:03:05.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012968529999999999 2024-04-25T22:03:05.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.152082+0000", 2024-04-25T22:03:05.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0645999999999999e-05 2024-04-25T22:03:05.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:57.152190+0000", 2024-04-25T22:03:05.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000107871 2024-04-25T22:03:05.516 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.517 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.517 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.517 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:71 3.b e53/15 3:d5c7a900:::200.00000003:head v 53'3, mlcod=17'1)", 2024-04-25T22:03:05.517 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:59.679079+0000", 2024-04-25T22:03:05.517 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.7378664690000001, 2024-04-25T22:03:05.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.035071150000000002, 2024-04-25T22:03:05.517 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.517 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.517 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.517 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.679079+0000", 2024-04-25T22:03:05.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.679079+0000", 2024-04-25T22:03:05.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.679081+0000", 2024-04-25T22:03:05.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.753e-06 2024-04-25T22:03:05.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.681130+0000", 2024-04-25T22:03:05.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002049057 2024-04-25T22:03:05.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.681176+0000", 2024-04-25T22:03:05.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6211999999999997e-05 2024-04-25T22:03:05.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.681190+0000", 2024-04-25T22:03:05.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.307e-05 2024-04-25T22:03:05.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.681326+0000", 2024-04-25T22:03:05.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013620799999999999 2024-04-25T22:03:05.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.681381+0000", 2024-04-25T22:03:05.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5402999999999998e-05 2024-04-25T22:03:05.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.714026+0000", 2024-04-25T22:03:05.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.032645242999999997 2024-04-25T22:03:05.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:59.714151+0000", 2024-04-25T22:03:05.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012420399999999999 2024-04-25T22:03:05.521 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.521 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.521 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.521 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:127 3.b e53/15 3:d5c7a900:::200.00000003:head v 53'59, mlcod=53'57)", 2024-04-25T22:03:05.521 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:00.520819+0000", 2024-04-25T22:03:05.521 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.8961271599999998, 2024-04-25T22:03:05.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.068846882999999998, 2024-04-25T22:03:05.521 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:05.521 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:05.521 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:05.521 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:05.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:05.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.520819+0000", 2024-04-25T22:03:05.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:05.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.520819+0000", 2024-04-25T22:03:05.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:05.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:05.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.520821+0000", 2024-04-25T22:03:05.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0430000000000002e-06 2024-04-25T22:03:05.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:05.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.526223+0000", 2024-04-25T22:03:05.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054026480000000003 2024-04-25T22:03:05.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:05.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.526260+0000", 2024-04-25T22:03:05.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6338999999999999e-05 2024-04-25T22:03:05.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:05.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.526277+0000", 2024-04-25T22:03:05.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7053000000000001e-05 2024-04-25T22:03:05.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:05.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.526462+0000", 2024-04-25T22:03:05.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018547099999999999 2024-04-25T22:03:05.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:05.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.526500+0000", 2024-04-25T22:03:05.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8114999999999997e-05 2024-04-25T22:03:05.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:05.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.589596+0000", 2024-04-25T22:03:05.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.063095506999999995 2024-04-25T22:03:05.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:05.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:05.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:05.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:00.589666+0000", 2024-04-25T22:03:05.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9707000000000002e-05 2024-04-25T22:03:05.525 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.525 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.525 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.525 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:05.525 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:05.525 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:05.527 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:05.527 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:05.520+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:05.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:05.625+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:05.664 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:05.664 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:05.664 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:03:05.664 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:05.680 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:05.696 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:03:05.729 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:05.724+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:05.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:05.825+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:05.850 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:03:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:03:05.851 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:05.870 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:05.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:05.961+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:06.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:06.029+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:06.041 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:06.041 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:06.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:06.042 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:06.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.042 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:06.042 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:06.042 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.951487887000001, 2024-04-25T22:03:06.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:06.042 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.042 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.042 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.042 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:06.042 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:06.042 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:06.042 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:06.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.043 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:06.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:06.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:06.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:06.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:06.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:06.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:06.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:06.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:06.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:06.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:06.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:06.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:06.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:06.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:06.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:06.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:06.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:06.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:06.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:06.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:06.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:06.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:06.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:06.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:06.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:06.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:06.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:06.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:06.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:06.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.048 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.048 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:06.048 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:06.048 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.941487124, 2024-04-25T22:03:06.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:06.048 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.049 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.049 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:06.049 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:06.049 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:06.049 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:06.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.049 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:06.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:06.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:06.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:06.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:06.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:06.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:06.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:06.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:06.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:06.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:06.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:06.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:06.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:06.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:06.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:06.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:06.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:06.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:06.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:06.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:06.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:06.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:06.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:06.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:06.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:06.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:06.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:06.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:06.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:06.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.054 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.054 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.937322849999999, 2024-04-25T22:03:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:06.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:06.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:06.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:06.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:06.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:06.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:06.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:06.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:06.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:06.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:06.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:06.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:06.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:06.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:06.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:06.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:06.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:06.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:06.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:06.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:06.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.060 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.060 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:06.060 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:06.060 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.935726533, 2024-04-25T22:03:06.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:06.060 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.061 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.061 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.061 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:06.061 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:06.061 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:06.061 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:06.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.061 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:06.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:06.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:06.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:06.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:06.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:06.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:06.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:06.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:06.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:06.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:06.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:06.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:06.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:06.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:06.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:06.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:06.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:06.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:06.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:06.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:06.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:06.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:06.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:06.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:06.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.066 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.066 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:24 4.b 4:d3eda40d:::1000000020f.00000000:head [write 0~1144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:06.066 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.118844+0000", 2024-04-25T22:03:06.066 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.91818868, 2024-04-25T22:03:06.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.089959257000000001, 2024-04-25T22:03:06.066 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.066 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.066 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:06.066 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:06.067 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:06.067 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 24 2024-04-25T22:03:06.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.067 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118844+0000", 2024-04-25T22:03:06.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118844+0000", 2024-04-25T22:03:06.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118846+0000", 2024-04-25T22:03:06.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:03:06.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118855+0000", 2024-04-25T22:03:06.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2930000000000006e-06 2024-04-25T22:03:06.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118879+0000", 2024-04-25T22:03:06.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3312999999999999e-05 2024-04-25T22:03:06.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118891+0000", 2024-04-25T22:03:06.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2136e-05 2024-04-25T22:03:06.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118997+0000", 2024-04-25T22:03:06.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010655800000000001 2024-04-25T22:03:06.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.119214+0000", 2024-04-25T22:03:06.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021723099999999999 2024-04-25T22:03:06.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:06.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.119408+0000", 2024-04-25T22:03:06.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000193582 2024-04-25T22:03:06.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.121105+0000", 2024-04-25T22:03:06.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016972549999999999 2024-04-25T22:03:06.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208552+0000", 2024-04-25T22:03:06.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087447104999999997 2024-04-25T22:03:06.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208688+0000", 2024-04-25T22:03:06.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000135394 2024-04-25T22:03:06.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208803+0000", 2024-04-25T22:03:06.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011557000000000001 2024-04-25T22:03:06.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.071 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.072 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:06.072 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:06.072 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.878940283, 2024-04-25T22:03:06.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:06.072 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.072 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.072 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.072 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:06.072 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:06.072 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:06.072 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:06.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.072 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:06.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:06.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:06.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:06.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:06.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:06.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:06.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:06.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:06.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:06.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:06.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:06.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:06.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:06.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:06.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:06.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:06.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:06.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:06.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:06.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:06.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:06.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:06.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:06.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:06.077 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.077 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.077 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.077 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:06.077 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:06.077 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.863296017, 2024-04-25T22:03:06.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:06.077 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.077 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.078 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.078 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:06.078 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:06.078 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:06.078 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:06.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.078 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:06.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:06.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:06.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:06.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:06.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:06.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:06.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:06.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:06.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:06.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:06.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:06.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:06.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:06.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:06.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:06.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:06.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:06.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:06.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:06.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:06.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:06.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:06.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:06.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:06.082 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.083 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.083 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.083 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:06.083 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:06.083 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.858457326, 2024-04-25T22:03:06.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:06.083 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.083 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.083 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:06.083 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:06.083 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:06.084 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:06.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.084 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:06.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:06.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:06.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:06.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:06.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:06.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:06.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:06.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:06.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:06.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:06.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:06.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:06.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:06.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:06.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:06.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:06.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:06.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:06.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:06.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:06.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:06.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:06.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:06.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:06.088 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.088 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.088 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.089 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:06.089 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:06.089 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.845140241999999, 2024-04-25T22:03:06.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.098402492999999994, 2024-04-25T22:03:06.089 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.089 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.089 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.089 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:06.089 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:06.089 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:06.089 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71 2024-04-25T22:03:06.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.089 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:06.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:06.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191895+0000", 2024-04-25T22:03:06.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0899999999999999e-06 2024-04-25T22:03:06.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191906+0000", 2024-04-25T22:03:06.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1508999999999999e-05 2024-04-25T22:03:06.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191937+0000", 2024-04-25T22:03:06.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0772999999999998e-05 2024-04-25T22:03:06.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191951+0000", 2024-04-25T22:03:06.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.437e-05 2024-04-25T22:03:06.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286217+0000", 2024-04-25T22:03:06.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.094265989999999994 2024-04-25T22:03:06.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286383+0000", 2024-04-25T22:03:06.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016591899999999999 2024-04-25T22:03:06.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:06.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286594+0000", 2024-04-25T22:03:06.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021108800000000001 2024-04-25T22:03:06.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.288518+0000", 2024-04-25T22:03:06.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001923391 2024-04-25T22:03:06.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290219+0000", 2024-04-25T22:03:06.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001701239 2024-04-25T22:03:06.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290266+0000", 2024-04-25T22:03:06.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6838000000000001e-05 2024-04-25T22:03:06.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290295+0000", 2024-04-25T22:03:06.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9286e-05 2024-04-25T22:03:06.094 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.094 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.094 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.094 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:172 3.1e 3:7bf7e7b5:::200.00000006:head [write 1088406~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:06.094 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.680942+0000", 2024-04-25T22:03:06.094 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.356090944, 2024-04-25T22:03:06.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.091514501999999998, 2024-04-25T22:03:06.095 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.095 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.095 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.095 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680942+0000", 2024-04-25T22:03:06.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680942+0000", 2024-04-25T22:03:06.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680943+0000", 2024-04-25T22:03:06.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:03:06.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680947+0000", 2024-04-25T22:03:06.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0799999999999999e-06 2024-04-25T22:03:06.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680955+0000", 2024-04-25T22:03:06.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8899999999999996e-06 2024-04-25T22:03:06.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680962+0000", 2024-04-25T22:03:06.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9659999999999999e-06 2024-04-25T22:03:06.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.765238+0000", 2024-04-25T22:03:06.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.084275949000000003 2024-04-25T22:03:06.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.765380+0000", 2024-04-25T22:03:06.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014133700000000001 2024-04-25T22:03:06.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:06.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.765576+0000", 2024-04-25T22:03:06.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019578600000000001 2024-04-25T22:03:06.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.770419+0000", 2024-04-25T22:03:06.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0048431109999999998 2024-04-25T22:03:06.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772190+0000", 2024-04-25T22:03:06.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017712590000000001 2024-04-25T22:03:06.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772341+0000", 2024-04-25T22:03:06.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015073699999999999 2024-04-25T22:03:06.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772456+0000", 2024-04-25T22:03:06.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115697 2024-04-25T22:03:06.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.099 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.100 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:173 3.1e 3:7bf7e7b5:::200.00000006:head [write 1089806~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:06.100 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.680971+0000", 2024-04-25T22:03:06.100 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.356061561, 2024-04-25T22:03:06.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.097357530999999997, 2024-04-25T22:03:06.100 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.100 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.100 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.100 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680971+0000", 2024-04-25T22:03:06.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680971+0000", 2024-04-25T22:03:06.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680972+0000", 2024-04-25T22:03:06.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5700000000000002e-07 2024-04-25T22:03:06.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680976+0000", 2024-04-25T22:03:06.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8859999999999997e-06 2024-04-25T22:03:06.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680986+0000", 2024-04-25T22:03:06.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0107e-05 2024-04-25T22:03:06.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680992+0000", 2024-04-25T22:03:06.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:03:06.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.766932+0000", 2024-04-25T22:03:06.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.085939606000000002 2024-04-25T22:03:06.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.767162+0000", 2024-04-25T22:03:06.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022967899999999999 2024-04-25T22:03:06.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:06.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.767539+0000", 2024-04-25T22:03:06.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037684900000000001 2024-04-25T22:03:06.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773588+0000", 2024-04-25T22:03:06.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060498979999999997 2024-04-25T22:03:06.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778047+0000", 2024-04-25T22:03:06.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044585950000000001 2024-04-25T22:03:06.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778191+0000", 2024-04-25T22:03:06.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000144277 2024-04-25T22:03:06.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778329+0000", 2024-04-25T22:03:06.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013736799999999999 2024-04-25T22:03:06.104 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.105 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.105 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.105 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:174 3.1e 3:7bf7e7b5:::200.00000006:head [write 1091205~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:06.105 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681001+0000", 2024-04-25T22:03:06.105 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.3560318689999999, 2024-04-25T22:03:06.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.097586939999999997, 2024-04-25T22:03:06.105 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.105 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.105 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.105 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681001+0000", 2024-04-25T22:03:06.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681001+0000", 2024-04-25T22:03:06.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681002+0000", 2024-04-25T22:03:06.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1699999999999997e-07 2024-04-25T22:03:06.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681011+0000", 2024-04-25T22:03:06.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4099999999999997e-06 2024-04-25T22:03:06.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681020+0000", 2024-04-25T22:03:06.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0929999999999992e-06 2024-04-25T22:03:06.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681027+0000", 2024-04-25T22:03:06.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2069999999999998e-06 2024-04-25T22:03:06.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.768885+0000", 2024-04-25T22:03:06.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087857947000000006 2024-04-25T22:03:06.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.769110+0000", 2024-04-25T22:03:06.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000224243 2024-04-25T22:03:06.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:06.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.769453+0000", 2024-04-25T22:03:06.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034366900000000001 2024-04-25T22:03:06.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.776545+0000", 2024-04-25T22:03:06.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070918179999999997 2024-04-25T22:03:06.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778351+0000", 2024-04-25T22:03:06.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001806457 2024-04-25T22:03:06.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778482+0000", 2024-04-25T22:03:06.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130538 2024-04-25T22:03:06.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778588+0000", 2024-04-25T22:03:06.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010584100000000001 2024-04-25T22:03:06.110 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.110 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.110 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.110 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:175 3.1e 3:7bf7e7b5:::200.00000006:head [write 1092606~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:06.110 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:06.110 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.355996099, 2024-04-25T22:03:06.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.098895884000000003, 2024-04-25T22:03:06.110 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.110 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.111 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.111 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:06.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:06.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:06.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.37e-07 2024-04-25T22:03:06.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681042+0000", 2024-04-25T22:03:06.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.296e-06 2024-04-25T22:03:06.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681051+0000", 2024-04-25T22:03:06.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8729999999999996e-06 2024-04-25T22:03:06.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681058+0000", 2024-04-25T22:03:06.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1500000000000002e-06 2024-04-25T22:03:06.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.770531+0000", 2024-04-25T22:03:06.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.089473665999999993 2024-04-25T22:03:06.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.770765+0000", 2024-04-25T22:03:06.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023329899999999999 2024-04-25T22:03:06.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:06.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.771099+0000", 2024-04-25T22:03:06.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033428 2024-04-25T22:03:06.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778610+0000", 2024-04-25T22:03:06.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075115119999999997 2024-04-25T22:03:06.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779710+0000", 2024-04-25T22:03:06.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010997019999999999 2024-04-25T22:03:06.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779876+0000", 2024-04-25T22:03:06.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016592000000000001 2024-04-25T22:03:06.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779933+0000", 2024-04-25T22:03:06.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6449000000000001e-05 2024-04-25T22:03:06.115 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.115 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.115 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.115 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:176 3.1e 3:7bf7e7b5:::200.00000006:head [write 1094003~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:06.116 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681066+0000", 2024-04-25T22:03:06.116 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.3559664659999999, 2024-04-25T22:03:06.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099284439000000002, 2024-04-25T22:03:06.116 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.116 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.116 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.116 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681066+0000", 2024-04-25T22:03:06.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681066+0000", 2024-04-25T22:03:06.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681067+0000", 2024-04-25T22:03:06.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3e-07 2024-04-25T22:03:06.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681076+0000", 2024-04-25T22:03:06.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3659999999999998e-06 2024-04-25T22:03:06.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681087+0000", 2024-04-25T22:03:06.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0763e-05 2024-04-25T22:03:06.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681095+0000", 2024-04-25T22:03:06.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3599999999999998e-06 2024-04-25T22:03:06.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772564+0000", 2024-04-25T22:03:06.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.091469049999999996 2024-04-25T22:03:06.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772701+0000", 2024-04-25T22:03:06.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013743100000000001 2024-04-25T22:03:06.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:06.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772901+0000", 2024-04-25T22:03:06.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019971600000000001 2024-04-25T22:03:06.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778627+0000", 2024-04-25T22:03:06.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057267170000000001 2024-04-25T22:03:06.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780116+0000", 2024-04-25T22:03:06.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001488294 2024-04-25T22:03:06.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780282+0000", 2024-04-25T22:03:06.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016584999999999999 2024-04-25T22:03:06.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780351+0000", 2024-04-25T22:03:06.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9162e-05 2024-04-25T22:03:06.123 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.123 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.123 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.123 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:177 3.1e 3:7bf7e7b5:::200.00000006:head [write 1095406~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:06.123 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:06.123 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.355929124, 2024-04-25T22:03:06.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099467149000000005, 2024-04-25T22:03:06.123 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.123 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.123 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.123 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:06.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:06.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:06.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:03:06.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681108+0000", 2024-04-25T22:03:06.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0439999999999997e-06 2024-04-25T22:03:06.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681117+0000", 2024-04-25T22:03:06.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7499999999999992e-06 2024-04-25T22:03:06.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681124+0000", 2024-04-25T22:03:06.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9099999999999999e-06 2024-04-25T22:03:06.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773690+0000", 2024-04-25T22:03:06.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.092565760999999996 2024-04-25T22:03:06.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773817+0000", 2024-04-25T22:03:06.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012704799999999999 2024-04-25T22:03:06.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:06.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773999+0000", 2024-04-25T22:03:06.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018202 2024-04-25T22:03:06.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778647+0000", 2024-04-25T22:03:06.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046479049999999999 2024-04-25T22:03:06.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780446+0000", 2024-04-25T22:03:06.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017990739999999999 2024-04-25T22:03:06.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780519+0000", 2024-04-25T22:03:06.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3205000000000001e-05 2024-04-25T22:03:06.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780571+0000", 2024-04-25T22:03:06.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1638999999999998e-05 2024-04-25T22:03:06.128 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.128 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.128 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.128 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:178 3.1e 3:7bf7e7b5:::200.00000006:head [write 1096809~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:06.128 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681133+0000", 2024-04-25T22:03:06.128 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.3558998440000001, 2024-04-25T22:03:06.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099654375000000003, 2024-04-25T22:03:06.128 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.128 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.129 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.129 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681133+0000", 2024-04-25T22:03:06.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681133+0000", 2024-04-25T22:03:06.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681134+0000", 2024-04-25T22:03:06.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2699999999999999e-07 2024-04-25T22:03:06.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681139+0000", 2024-04-25T22:03:06.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.276e-06 2024-04-25T22:03:06.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681148+0000", 2024-04-25T22:03:06.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8130000000000002e-06 2024-04-25T22:03:06.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681155+0000", 2024-04-25T22:03:06.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0859999999999996e-06 2024-04-25T22:03:06.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.774610+0000", 2024-04-25T22:03:06.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.093455287999999997 2024-04-25T22:03:06.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.774856+0000", 2024-04-25T22:03:06.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000245772 2024-04-25T22:03:06.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:06.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.775244+0000", 2024-04-25T22:03:06.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038779599999999998 2024-04-25T22:03:06.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779955+0000", 2024-04-25T22:03:06.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047115910000000002 2024-04-25T22:03:06.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780656+0000", 2024-04-25T22:03:06.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070111200000000005 2024-04-25T22:03:06.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780733+0000", 2024-04-25T22:03:06.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6601999999999996e-05 2024-04-25T22:03:06.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780787+0000", 2024-04-25T22:03:06.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4311999999999998e-05 2024-04-25T22:03:06.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.133 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.133 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:179 3.1e 3:7bf7e7b5:::200.00000006:head [write 1098209~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:06.133 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681170+0000", 2024-04-25T22:03:06.133 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.355863088, 2024-04-25T22:03:06.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099820701999999997, 2024-04-25T22:03:06.134 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.134 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.134 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.134 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681170+0000", 2024-04-25T22:03:06.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681170+0000", 2024-04-25T22:03:06.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681171+0000", 2024-04-25T22:03:06.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4e-07 2024-04-25T22:03:06.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681175+0000", 2024-04-25T22:03:06.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7330000000000003e-06 2024-04-25T22:03:06.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681185+0000", 2024-04-25T22:03:06.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2730000000000008e-06 2024-04-25T22:03:06.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681192+0000", 2024-04-25T22:03:06.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3000000000000004e-06 2024-04-25T22:03:06.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.776664+0000", 2024-04-25T22:03:06.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095471850999999996 2024-04-25T22:03:06.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.776895+0000", 2024-04-25T22:03:06.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023155199999999999 2024-04-25T22:03:06.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:06.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.777244+0000", 2024-04-25T22:03:06.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034912300000000001 2024-04-25T22:03:06.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779962+0000", 2024-04-25T22:03:06.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027177870000000002 2024-04-25T22:03:06.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780870+0000", 2024-04-25T22:03:06.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090743499999999995 2024-04-25T22:03:06.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780939+0000", 2024-04-25T22:03:06.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9678999999999995e-05 2024-04-25T22:03:06.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780990+0000", 2024-04-25T22:03:06.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1128999999999998e-05 2024-04-25T22:03:06.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.138 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.139 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:180 3.1e 3:7bf7e7b5:::200.00000006:head [write 1099615~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:06.139 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681201+0000", 2024-04-25T22:03:06.139 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.355831572, 2024-04-25T22:03:06.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.100014121, 2024-04-25T22:03:06.139 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.139 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.139 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.139 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681201+0000", 2024-04-25T22:03:06.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681201+0000", 2024-04-25T22:03:06.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681202+0000", 2024-04-25T22:03:06.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2600000000000001e-07 2024-04-25T22:03:06.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681206+0000", 2024-04-25T22:03:06.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7799999999999998e-06 2024-04-25T22:03:06.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681215+0000", 2024-04-25T22:03:06.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7630000000000006e-06 2024-04-25T22:03:06.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681222+0000", 2024-04-25T22:03:06.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0740000000000004e-06 2024-04-25T22:03:06.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778720+0000", 2024-04-25T22:03:06.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.097498243999999998 2024-04-25T22:03:06.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778839+0000", 2024-04-25T22:03:06.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011882799999999999 2024-04-25T22:03:06.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:06.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779028+0000", 2024-04-25T22:03:06.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018962300000000001 2024-04-25T22:03:06.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781006+0000", 2024-04-25T22:03:06.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019778640000000002 2024-04-25T22:03:06.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781093+0000", 2024-04-25T22:03:06.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6802e-05 2024-04-25T22:03:06.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781164+0000", 2024-04-25T22:03:06.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0925000000000003e-05 2024-04-25T22:03:06.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781215+0000", 2024-04-25T22:03:06.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1391999999999999e-05 2024-04-25T22:03:06.143 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.143 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.144 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:6847 4.16 4.8bfe6e16 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-25T22:03:06.144 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.686897+0000", 2024-04-25T22:03:06.144 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.3501359609999999, 2024-04-25T22:03:06.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.094186503000000005, 2024-04-25T22:03:06.144 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.144 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.144 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:03:06.144 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:06.144 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:06.144 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:06.144 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6847 2024-04-25T22:03:06.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.145 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686897+0000", 2024-04-25T22:03:06.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686897+0000", 2024-04-25T22:03:06.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686903+0000", 2024-04-25T22:03:06.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9599999999999997e-06 2024-04-25T22:03:06.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686920+0000", 2024-04-25T22:03:06.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7102999999999999e-05 2024-04-25T22:03:06.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686939+0000", 2024-04-25T22:03:06.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.912e-05 2024-04-25T22:03:06.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686953+0000", 2024-04-25T22:03:06.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4062e-05 2024-04-25T22:03:06.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781065+0000", 2024-04-25T22:03:06.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.094112332000000007 2024-04-25T22:03:06.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781083+0000", 2024-04-25T22:03:06.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7926000000000001e-05 2024-04-25T22:03:06.147 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.147 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.147 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.148 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:181 3.1e 3:7bf7e7b5:::200.00000006:head [write 1101018~34350 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:06.148 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.698668+0000", 2024-04-25T22:03:06.148 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.338364543, 2024-04-25T22:03:06.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.090130145999999994, 2024-04-25T22:03:06.148 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:06.148 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:06.148 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:06.148 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:06.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:06.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.698668+0000", 2024-04-25T22:03:06.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:06.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.698668+0000", 2024-04-25T22:03:06.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:06.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:06.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.698671+0000", 2024-04-25T22:03:06.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6699999999999998e-06 2024-04-25T22:03:06.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:06.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.698721+0000", 2024-04-25T22:03:06.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9975000000000002e-05 2024-04-25T22:03:06.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:06.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.698752+0000", 2024-04-25T22:03:06.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0997000000000002e-05 2024-04-25T22:03:06.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:06.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.698773+0000", 2024-04-25T22:03:06.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0738999999999999e-05 2024-04-25T22:03:06.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:06.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.782382+0000", 2024-04-25T22:03:06.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.083609601000000006 2024-04-25T22:03:06.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:06.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.782516+0000", 2024-04-25T22:03:06.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013397100000000001 2024-04-25T22:03:06.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:06.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.782694+0000", 2024-04-25T22:03:06.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017751999999999999 2024-04-25T22:03:06.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:06.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.785933+0000", 2024-04-25T22:03:06.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032390320000000002 2024-04-25T22:03:06.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:06.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.788637+0000", 2024-04-25T22:03:06.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002704297 2024-04-25T22:03:06.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:06.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.788729+0000", 2024-04-25T22:03:06.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2151999999999995e-05 2024-04-25T22:03:06.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:06.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:06.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:06.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.788798+0000", 2024-04-25T22:03:06.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9191999999999998e-05 2024-04-25T22:03:06.152 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.152 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.152 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.153 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:06.153 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:06.153 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:06.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:06.155 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:06.153+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:06.256 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:06.253+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:06.289 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:06.289 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:06.289 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:03:06.289 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:06.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:06.356 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:06.348+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:06.391 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:03:06.438 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:06.438 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:06.438 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:03:06.438 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:03:06.438 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:06.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:06.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:06.453+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:06.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:06.553+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:06.567 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:06.568 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:06.593 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:06.594 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:06.616 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:06.616 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:06.627 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:06.627 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:06.643 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:06.689 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:06.689+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:06.695 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-25T22:03:06.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:06.757+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:06.786 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:06.786 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:06.802 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:06.893 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:06.893+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:06.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:06.957+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:06.980 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:06.980 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:06.996 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:07.063 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:07.056+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:07.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:07.161+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:07.168 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:07.168 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:07.183 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:07.265 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:07.265+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:07.320 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:07.321 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:07.335 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:07.365 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:07.364+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:07.463 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:07.464 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:07.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:07.461+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:07.478 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:07.567 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:07.564+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:07.651 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:07.652 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:07.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:07.667 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:07.664+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:07.769 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:07.764+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:07.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:07.870 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:07.868+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:07.934 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:07.934 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:07.948 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:07.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:07.965+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:08.069 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:08.070 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:08.071 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:08.064+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:08.085 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:08.172 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:08.164+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:08.225 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:08.225 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:08.242 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:08.289 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:08.288+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:08.373 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:08.373 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:08.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:08.369+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:08.387 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:08.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:08.469+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:08.559 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:08.560 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:08.575 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:08.575 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:08.572+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:08.636 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:03:08.676 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:08.668+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:08.709 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:08.709 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:08.721 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:03:08.724 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:08.776 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:08.768+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:08.819 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:08.819 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:08.845 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:08.845 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:08.862 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:08.862 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:08.862 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:03:08.862 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:03:08.862 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:08.871 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:08.871 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:08.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:08.873+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:08.879 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:08.978 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:08.972+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:09.069 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:09.069 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:09.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:09.069 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:09.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.069 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:09.069 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:09.070 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.980295307999999, 2024-04-25T22:03:09.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:09.070 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.070 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.070 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:09.070 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:09.070 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:09.070 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:09.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.071 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:09.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:09.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:09.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:09.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:09.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:09.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:09.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:09.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:09.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:09.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:09.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:09.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:09.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:09.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:09.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:09.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:09.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:09.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:09.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:09.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:09.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:09.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:09.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:09.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:09.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:09.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:09.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:09.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:09.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:09.077 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.077 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.077 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.077 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:09.077 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:09.077 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.970294545000002, 2024-04-25T22:03:09.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:09.077 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.077 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.077 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.077 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:09.077 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:09.077 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:09.078 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:09.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.078 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:09.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:09.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:09.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:09.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:09.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:09.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:09.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:09.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:09.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:09.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:09.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:09.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:09.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:09.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:09.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:09.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:09.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:09.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:09.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:09.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:09.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:09.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:09.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:09.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:09.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:09.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:09.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:09.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:09.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:09.083 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.083 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.083 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.083 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:09.083 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:09.083 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.966130271000001, 2024-04-25T22:03:09.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:09.083 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.084 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.084 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:09.084 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:09.084 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:09.084 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:09.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.084 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:09.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:09.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:09.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:09.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:09.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:09.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:09.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:09.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:09.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:09.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:09.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:09.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:09.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:09.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:09.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:09.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:09.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:09.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:09.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:09.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:09.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:09.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:09.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:09.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:09.089 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.089 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.089 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.089 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:09.089 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:09.090 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.964533954, 2024-04-25T22:03:09.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:09.090 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.090 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.090 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.090 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:09.090 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:09.090 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:09.090 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:09.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.090 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:09.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:09.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:09.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:09.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:09.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:09.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:09.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:09.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:09.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:09.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:09.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:09.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:09.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:09.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:09.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:09.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:09.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:09.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:09.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:09.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:09.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:09.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:09.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:09.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:09.095 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.095 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.095 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.095 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:24 4.b 4:d3eda40d:::1000000020f.00000000:head [write 0~1144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:09.095 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.118844+0000", 2024-04-25T22:03:09.096 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.946996101, 2024-04-25T22:03:09.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.089959257000000001, 2024-04-25T22:03:09.096 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.096 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.096 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.096 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:09.096 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:09.096 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:09.096 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 24 2024-04-25T22:03:09.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.096 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118844+0000", 2024-04-25T22:03:09.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118844+0000", 2024-04-25T22:03:09.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118846+0000", 2024-04-25T22:03:09.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:03:09.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118855+0000", 2024-04-25T22:03:09.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2930000000000006e-06 2024-04-25T22:03:09.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118879+0000", 2024-04-25T22:03:09.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3312999999999999e-05 2024-04-25T22:03:09.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118891+0000", 2024-04-25T22:03:09.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2136e-05 2024-04-25T22:03:09.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118997+0000", 2024-04-25T22:03:09.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010655800000000001 2024-04-25T22:03:09.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.119214+0000", 2024-04-25T22:03:09.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021723099999999999 2024-04-25T22:03:09.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:09.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.119408+0000", 2024-04-25T22:03:09.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000193582 2024-04-25T22:03:09.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.121105+0000", 2024-04-25T22:03:09.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016972549999999999 2024-04-25T22:03:09.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208552+0000", 2024-04-25T22:03:09.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087447104999999997 2024-04-25T22:03:09.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208688+0000", 2024-04-25T22:03:09.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000135394 2024-04-25T22:03:09.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208803+0000", 2024-04-25T22:03:09.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011557000000000001 2024-04-25T22:03:09.102 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.102 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.102 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.102 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:09.102 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:09.102 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.907747703999998, 2024-04-25T22:03:09.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:09.102 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.102 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.103 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.103 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:09.103 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:09.103 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:09.103 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:09.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.103 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:09.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:09.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:09.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:09.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:09.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:09.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:09.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:09.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:09.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:09.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:09.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:09.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:09.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:09.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:09.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:09.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:09.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:09.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:09.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:09.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:09.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:09.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:09.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:09.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:09.108 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.108 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.108 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.108 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:09.108 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:09.108 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.892103437999999, 2024-04-25T22:03:09.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:09.108 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.108 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.109 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.109 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:09.109 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:09.109 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:09.109 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:09.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.109 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:09.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:09.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:09.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:09.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:09.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:09.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:09.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:09.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:09.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:09.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:09.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:09.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:09.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:09.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:09.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:09.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:09.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:09.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:09.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:09.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:09.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:09.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:09.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:09.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:09.114 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.114 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.114 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.114 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:09.114 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:09.114 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.887264747, 2024-04-25T22:03:09.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:09.114 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.114 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.114 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.114 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:09.115 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:09.115 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:09.115 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:09.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.115 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:09.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:09.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:09.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:09.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:09.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:09.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:09.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:09.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:09.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:09.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:09.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:09.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:09.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:09.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:09.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:09.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:09.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:09.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:09.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:09.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:09.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:09.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:09.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:09.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:09.119 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.119 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.119 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.120 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:09.120 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:09.120 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.873947662999999, 2024-04-25T22:03:09.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.098402492999999994, 2024-04-25T22:03:09.120 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.120 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.120 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.120 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:09.120 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:09.120 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:09.120 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71 2024-04-25T22:03:09.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.121 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:09.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:09.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191895+0000", 2024-04-25T22:03:09.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0899999999999999e-06 2024-04-25T22:03:09.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191906+0000", 2024-04-25T22:03:09.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1508999999999999e-05 2024-04-25T22:03:09.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191937+0000", 2024-04-25T22:03:09.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0772999999999998e-05 2024-04-25T22:03:09.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191951+0000", 2024-04-25T22:03:09.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.437e-05 2024-04-25T22:03:09.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286217+0000", 2024-04-25T22:03:09.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.094265989999999994 2024-04-25T22:03:09.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286383+0000", 2024-04-25T22:03:09.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016591899999999999 2024-04-25T22:03:09.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:09.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286594+0000", 2024-04-25T22:03:09.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021108800000000001 2024-04-25T22:03:09.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.288518+0000", 2024-04-25T22:03:09.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001923391 2024-04-25T22:03:09.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290219+0000", 2024-04-25T22:03:09.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001701239 2024-04-25T22:03:09.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290266+0000", 2024-04-25T22:03:09.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6838000000000001e-05 2024-04-25T22:03:09.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290295+0000", 2024-04-25T22:03:09.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9286e-05 2024-04-25T22:03:09.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.125 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.126 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:172 3.1e 3:7bf7e7b5:::200.00000006:head [write 1088406~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:09.126 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.680942+0000", 2024-04-25T22:03:09.126 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3848983649999997, 2024-04-25T22:03:09.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.091514501999999998, 2024-04-25T22:03:09.126 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.126 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.126 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.126 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680942+0000", 2024-04-25T22:03:09.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680942+0000", 2024-04-25T22:03:09.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680943+0000", 2024-04-25T22:03:09.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:03:09.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680947+0000", 2024-04-25T22:03:09.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0799999999999999e-06 2024-04-25T22:03:09.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680955+0000", 2024-04-25T22:03:09.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8899999999999996e-06 2024-04-25T22:03:09.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680962+0000", 2024-04-25T22:03:09.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9659999999999999e-06 2024-04-25T22:03:09.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.765238+0000", 2024-04-25T22:03:09.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.084275949000000003 2024-04-25T22:03:09.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.765380+0000", 2024-04-25T22:03:09.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014133700000000001 2024-04-25T22:03:09.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:09.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.765576+0000", 2024-04-25T22:03:09.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019578600000000001 2024-04-25T22:03:09.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.770419+0000", 2024-04-25T22:03:09.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0048431109999999998 2024-04-25T22:03:09.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772190+0000", 2024-04-25T22:03:09.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017712590000000001 2024-04-25T22:03:09.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772341+0000", 2024-04-25T22:03:09.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015073699999999999 2024-04-25T22:03:09.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772456+0000", 2024-04-25T22:03:09.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115697 2024-04-25T22:03:09.131 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.131 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.131 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.132 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:173 3.1e 3:7bf7e7b5:::200.00000006:head [write 1089806~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:09.132 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.680971+0000", 2024-04-25T22:03:09.132 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3848689820000004, 2024-04-25T22:03:09.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.097357530999999997, 2024-04-25T22:03:09.132 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.132 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.132 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.132 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680971+0000", 2024-04-25T22:03:09.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680971+0000", 2024-04-25T22:03:09.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680972+0000", 2024-04-25T22:03:09.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5700000000000002e-07 2024-04-25T22:03:09.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680976+0000", 2024-04-25T22:03:09.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8859999999999997e-06 2024-04-25T22:03:09.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680986+0000", 2024-04-25T22:03:09.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0107e-05 2024-04-25T22:03:09.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680992+0000", 2024-04-25T22:03:09.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:03:09.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.766932+0000", 2024-04-25T22:03:09.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.085939606000000002 2024-04-25T22:03:09.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.767162+0000", 2024-04-25T22:03:09.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022967899999999999 2024-04-25T22:03:09.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:09.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.767539+0000", 2024-04-25T22:03:09.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037684900000000001 2024-04-25T22:03:09.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773588+0000", 2024-04-25T22:03:09.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060498979999999997 2024-04-25T22:03:09.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778047+0000", 2024-04-25T22:03:09.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044585950000000001 2024-04-25T22:03:09.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778191+0000", 2024-04-25T22:03:09.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000144277 2024-04-25T22:03:09.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778329+0000", 2024-04-25T22:03:09.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013736799999999999 2024-04-25T22:03:09.136 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.136 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.137 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.137 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:174 3.1e 3:7bf7e7b5:::200.00000006:head [write 1091205~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:09.137 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681001+0000", 2024-04-25T22:03:09.137 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3848392900000004, 2024-04-25T22:03:09.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.097586939999999997, 2024-04-25T22:03:09.137 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.137 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.137 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.137 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681001+0000", 2024-04-25T22:03:09.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681001+0000", 2024-04-25T22:03:09.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681002+0000", 2024-04-25T22:03:09.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1699999999999997e-07 2024-04-25T22:03:09.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681011+0000", 2024-04-25T22:03:09.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4099999999999997e-06 2024-04-25T22:03:09.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681020+0000", 2024-04-25T22:03:09.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0929999999999992e-06 2024-04-25T22:03:09.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681027+0000", 2024-04-25T22:03:09.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2069999999999998e-06 2024-04-25T22:03:09.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.768885+0000", 2024-04-25T22:03:09.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087857947000000006 2024-04-25T22:03:09.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.769110+0000", 2024-04-25T22:03:09.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000224243 2024-04-25T22:03:09.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:09.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.769453+0000", 2024-04-25T22:03:09.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034366900000000001 2024-04-25T22:03:09.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.776545+0000", 2024-04-25T22:03:09.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070918179999999997 2024-04-25T22:03:09.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778351+0000", 2024-04-25T22:03:09.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001806457 2024-04-25T22:03:09.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778482+0000", 2024-04-25T22:03:09.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130538 2024-04-25T22:03:09.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778588+0000", 2024-04-25T22:03:09.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010584100000000001 2024-04-25T22:03:09.142 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.142 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.142 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.142 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:175 3.1e 3:7bf7e7b5:::200.00000006:head [write 1092606~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:09.142 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:09.142 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3848035200000002, 2024-04-25T22:03:09.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.098895884000000003, 2024-04-25T22:03:09.143 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.143 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.143 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.143 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:09.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:09.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:09.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.37e-07 2024-04-25T22:03:09.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681042+0000", 2024-04-25T22:03:09.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.296e-06 2024-04-25T22:03:09.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681051+0000", 2024-04-25T22:03:09.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8729999999999996e-06 2024-04-25T22:03:09.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681058+0000", 2024-04-25T22:03:09.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1500000000000002e-06 2024-04-25T22:03:09.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.770531+0000", 2024-04-25T22:03:09.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.089473665999999993 2024-04-25T22:03:09.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.770765+0000", 2024-04-25T22:03:09.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023329899999999999 2024-04-25T22:03:09.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:09.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.771099+0000", 2024-04-25T22:03:09.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033428 2024-04-25T22:03:09.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778610+0000", 2024-04-25T22:03:09.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075115119999999997 2024-04-25T22:03:09.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779710+0000", 2024-04-25T22:03:09.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010997019999999999 2024-04-25T22:03:09.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779876+0000", 2024-04-25T22:03:09.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016592000000000001 2024-04-25T22:03:09.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779933+0000", 2024-04-25T22:03:09.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6449000000000001e-05 2024-04-25T22:03:09.147 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.147 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.148 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.148 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:176 3.1e 3:7bf7e7b5:::200.00000006:head [write 1094003~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:09.148 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681066+0000", 2024-04-25T22:03:09.148 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3847738869999997, 2024-04-25T22:03:09.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099284439000000002, 2024-04-25T22:03:09.148 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.148 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.148 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.148 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681066+0000", 2024-04-25T22:03:09.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681066+0000", 2024-04-25T22:03:09.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681067+0000", 2024-04-25T22:03:09.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3e-07 2024-04-25T22:03:09.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681076+0000", 2024-04-25T22:03:09.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3659999999999998e-06 2024-04-25T22:03:09.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681087+0000", 2024-04-25T22:03:09.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0763e-05 2024-04-25T22:03:09.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681095+0000", 2024-04-25T22:03:09.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3599999999999998e-06 2024-04-25T22:03:09.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772564+0000", 2024-04-25T22:03:09.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.091469049999999996 2024-04-25T22:03:09.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772701+0000", 2024-04-25T22:03:09.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013743100000000001 2024-04-25T22:03:09.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:09.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772901+0000", 2024-04-25T22:03:09.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019971600000000001 2024-04-25T22:03:09.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778627+0000", 2024-04-25T22:03:09.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057267170000000001 2024-04-25T22:03:09.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780116+0000", 2024-04-25T22:03:09.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001488294 2024-04-25T22:03:09.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780282+0000", 2024-04-25T22:03:09.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016584999999999999 2024-04-25T22:03:09.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780351+0000", 2024-04-25T22:03:09.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9162e-05 2024-04-25T22:03:09.153 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.153 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.153 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.153 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:177 3.1e 3:7bf7e7b5:::200.00000006:head [write 1095406~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:09.153 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:09.154 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.384736545, 2024-04-25T22:03:09.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099467149000000005, 2024-04-25T22:03:09.154 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.154 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.154 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.154 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:09.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:09.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:09.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:03:09.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681108+0000", 2024-04-25T22:03:09.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0439999999999997e-06 2024-04-25T22:03:09.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681117+0000", 2024-04-25T22:03:09.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7499999999999992e-06 2024-04-25T22:03:09.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681124+0000", 2024-04-25T22:03:09.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9099999999999999e-06 2024-04-25T22:03:09.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773690+0000", 2024-04-25T22:03:09.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.092565760999999996 2024-04-25T22:03:09.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773817+0000", 2024-04-25T22:03:09.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012704799999999999 2024-04-25T22:03:09.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:09.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773999+0000", 2024-04-25T22:03:09.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018202 2024-04-25T22:03:09.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778647+0000", 2024-04-25T22:03:09.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046479049999999999 2024-04-25T22:03:09.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780446+0000", 2024-04-25T22:03:09.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017990739999999999 2024-04-25T22:03:09.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780519+0000", 2024-04-25T22:03:09.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3205000000000001e-05 2024-04-25T22:03:09.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780571+0000", 2024-04-25T22:03:09.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1638999999999998e-05 2024-04-25T22:03:09.159 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.159 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.159 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.159 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:178 3.1e 3:7bf7e7b5:::200.00000006:head [write 1096809~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:09.159 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681133+0000", 2024-04-25T22:03:09.159 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3847072650000003, 2024-04-25T22:03:09.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099654375000000003, 2024-04-25T22:03:09.160 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.160 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.160 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.160 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681133+0000", 2024-04-25T22:03:09.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681133+0000", 2024-04-25T22:03:09.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681134+0000", 2024-04-25T22:03:09.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2699999999999999e-07 2024-04-25T22:03:09.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681139+0000", 2024-04-25T22:03:09.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.276e-06 2024-04-25T22:03:09.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681148+0000", 2024-04-25T22:03:09.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8130000000000002e-06 2024-04-25T22:03:09.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681155+0000", 2024-04-25T22:03:09.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0859999999999996e-06 2024-04-25T22:03:09.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.774610+0000", 2024-04-25T22:03:09.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.093455287999999997 2024-04-25T22:03:09.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.774856+0000", 2024-04-25T22:03:09.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000245772 2024-04-25T22:03:09.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:09.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.775244+0000", 2024-04-25T22:03:09.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038779599999999998 2024-04-25T22:03:09.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779955+0000", 2024-04-25T22:03:09.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047115910000000002 2024-04-25T22:03:09.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780656+0000", 2024-04-25T22:03:09.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070111200000000005 2024-04-25T22:03:09.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780733+0000", 2024-04-25T22:03:09.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6601999999999996e-05 2024-04-25T22:03:09.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780787+0000", 2024-04-25T22:03:09.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4311999999999998e-05 2024-04-25T22:03:09.164 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.164 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.164 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.165 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:179 3.1e 3:7bf7e7b5:::200.00000006:head [write 1098209~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:09.165 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681170+0000", 2024-04-25T22:03:09.165 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3846705090000002, 2024-04-25T22:03:09.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099820701999999997, 2024-04-25T22:03:09.165 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.165 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.165 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.165 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681170+0000", 2024-04-25T22:03:09.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681170+0000", 2024-04-25T22:03:09.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681171+0000", 2024-04-25T22:03:09.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4e-07 2024-04-25T22:03:09.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681175+0000", 2024-04-25T22:03:09.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7330000000000003e-06 2024-04-25T22:03:09.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681185+0000", 2024-04-25T22:03:09.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2730000000000008e-06 2024-04-25T22:03:09.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681192+0000", 2024-04-25T22:03:09.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3000000000000004e-06 2024-04-25T22:03:09.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.776664+0000", 2024-04-25T22:03:09.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095471850999999996 2024-04-25T22:03:09.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.776895+0000", 2024-04-25T22:03:09.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023155199999999999 2024-04-25T22:03:09.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:09.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.777244+0000", 2024-04-25T22:03:09.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034912300000000001 2024-04-25T22:03:09.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779962+0000", 2024-04-25T22:03:09.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027177870000000002 2024-04-25T22:03:09.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780870+0000", 2024-04-25T22:03:09.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090743499999999995 2024-04-25T22:03:09.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780939+0000", 2024-04-25T22:03:09.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9678999999999995e-05 2024-04-25T22:03:09.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780990+0000", 2024-04-25T22:03:09.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1128999999999998e-05 2024-04-25T22:03:09.170 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.170 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.170 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.170 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:180 3.1e 3:7bf7e7b5:::200.00000006:head [write 1099615~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:09.170 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681201+0000", 2024-04-25T22:03:09.171 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3846389930000003, 2024-04-25T22:03:09.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.100014121, 2024-04-25T22:03:09.171 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.171 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.171 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.171 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681201+0000", 2024-04-25T22:03:09.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681201+0000", 2024-04-25T22:03:09.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681202+0000", 2024-04-25T22:03:09.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2600000000000001e-07 2024-04-25T22:03:09.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681206+0000", 2024-04-25T22:03:09.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7799999999999998e-06 2024-04-25T22:03:09.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681215+0000", 2024-04-25T22:03:09.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7630000000000006e-06 2024-04-25T22:03:09.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681222+0000", 2024-04-25T22:03:09.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0740000000000004e-06 2024-04-25T22:03:09.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778720+0000", 2024-04-25T22:03:09.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.097498243999999998 2024-04-25T22:03:09.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778839+0000", 2024-04-25T22:03:09.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011882799999999999 2024-04-25T22:03:09.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:09.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779028+0000", 2024-04-25T22:03:09.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018962300000000001 2024-04-25T22:03:09.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781006+0000", 2024-04-25T22:03:09.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019778640000000002 2024-04-25T22:03:09.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781093+0000", 2024-04-25T22:03:09.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6802e-05 2024-04-25T22:03:09.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781164+0000", 2024-04-25T22:03:09.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0925000000000003e-05 2024-04-25T22:03:09.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781215+0000", 2024-04-25T22:03:09.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1391999999999999e-05 2024-04-25T22:03:09.176 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.176 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.176 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.176 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:6847 4.16 4.8bfe6e16 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-25T22:03:09.176 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.686897+0000", 2024-04-25T22:03:09.176 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3789433820000001, 2024-04-25T22:03:09.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.094186503000000005, 2024-04-25T22:03:09.176 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.176 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.176 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:03:09.176 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:09.176 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:09.176 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:09.177 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6847 2024-04-25T22:03:09.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.177 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686897+0000", 2024-04-25T22:03:09.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686897+0000", 2024-04-25T22:03:09.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686903+0000", 2024-04-25T22:03:09.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9599999999999997e-06 2024-04-25T22:03:09.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686920+0000", 2024-04-25T22:03:09.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7102999999999999e-05 2024-04-25T22:03:09.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686939+0000", 2024-04-25T22:03:09.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.912e-05 2024-04-25T22:03:09.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686953+0000", 2024-04-25T22:03:09.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4062e-05 2024-04-25T22:03:09.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781065+0000", 2024-04-25T22:03:09.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.094112332000000007 2024-04-25T22:03:09.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781083+0000", 2024-04-25T22:03:09.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7926000000000001e-05 2024-04-25T22:03:09.179 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:181 3.1e 3:7bf7e7b5:::200.00000006:head [write 1101018~34350 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.698668+0000", 2024-04-25T22:03:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3671719639999997, 2024-04-25T22:03:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.090130145999999994, 2024-04-25T22:03:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.698668+0000", 2024-04-25T22:03:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.698668+0000", 2024-04-25T22:03:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.698671+0000", 2024-04-25T22:03:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6699999999999998e-06 2024-04-25T22:03:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:09.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.698721+0000", 2024-04-25T22:03:09.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9975000000000002e-05 2024-04-25T22:03:09.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:09.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.698752+0000", 2024-04-25T22:03:09.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0997000000000002e-05 2024-04-25T22:03:09.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.698773+0000", 2024-04-25T22:03:09.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0738999999999999e-05 2024-04-25T22:03:09.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:09.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.782382+0000", 2024-04-25T22:03:09.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.083609601000000006 2024-04-25T22:03:09.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:09.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.782516+0000", 2024-04-25T22:03:09.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013397100000000001 2024-04-25T22:03:09.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:09.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.782694+0000", 2024-04-25T22:03:09.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017751999999999999 2024-04-25T22:03:09.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.785933+0000", 2024-04-25T22:03:09.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032390320000000002 2024-04-25T22:03:09.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:09.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.788637+0000", 2024-04-25T22:03:09.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002704297 2024-04-25T22:03:09.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:09.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.788729+0000", 2024-04-25T22:03:09.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2151999999999995e-05 2024-04-25T22:03:09.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:09.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:09.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:09.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.788798+0000", 2024-04-25T22:03:09.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9191999999999998e-05 2024-04-25T22:03:09.185 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.185 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.185 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.185 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:09.185 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:09.185 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:09.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:09.187 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:09.184+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:09.288 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:09.280+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:09.318 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:09.318 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:09.318 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:03:09.318 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:09.332 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:09.425 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:09.420+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:09.490 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:09.484+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:09.509 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:09.509 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:09.509 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:03:09.509 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:03:09.509 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:09.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:09.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:09.589+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:09.692 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:09.688+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:09.702 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:03:09.702 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T22:03:09.707 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:03:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:03:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-25T22:03:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:03:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 115.07270357599999, 2024-04-25T22:03:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028993713000000001, 2024-04-25T22:03:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.707 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:03:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629498+0000", 2024-04-25T22:03:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629500+0000", 2024-04-25T22:03:09.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9099999999999999e-06 2024-04-25T22:03:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629521+0000", 2024-04-25T22:03:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0747e-05 2024-04-25T22:03:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629545+0000", 2024-04-25T22:03:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3862999999999998e-05 2024-04-25T22:03:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.629564+0000", 2024-04-25T22:03:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9485999999999999e-05 2024-04-25T22:03:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637696+0000", 2024-04-25T22:03:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008132294 2024-04-25T22:03:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.637898+0000", 2024-04-25T22:03:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020122900000000001 2024-04-25T22:03:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.638172+0000", 2024-04-25T22:03:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027390800000000001 2024-04-25T22:03:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.646408+0000", 2024-04-25T22:03:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082364719999999999 2024-04-25T22:03:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658266+0000", 2024-04-25T22:03:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.01185812 2024-04-25T22:03:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658391+0000", 2024-04-25T22:03:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124714 2024-04-25T22:03:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:01:14.658492+0000", 2024-04-25T22:03:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010097 2024-04-25T22:03:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.712 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:4 4.32 e51/16 4:4def72d4:::10000000003.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:03:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.709743452000001, 2024-04-25T22:03:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10987878, 2024-04-25T22:03:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992461+0000", 2024-04-25T22:03:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5780000000000001e-06 2024-04-25T22:03:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997784+0000", 2024-04-25T22:03:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005323627 2024-04-25T22:03:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997815+0000", 2024-04-25T22:03:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0066999999999999e-05 2024-04-25T22:03:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997830+0000", 2024-04-25T22:03:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5290000000000001e-05 2024-04-25T22:03:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997927+0000", 2024-04-25T22:03:09.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7391000000000003e-05 2024-04-25T22:03:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997947+0000", 2024-04-25T22:03:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0259999999999999e-05 2024-04-25T22:03:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102225+0000", 2024-04-25T22:03:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10427777100000001 2024-04-25T22:03:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102337+0000", 2024-04-25T22:03:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000111796 2024-04-25T22:03:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:6 4.13 e51/16 4:cbe72331:::10000000003.00000002:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.614929468, 2024-04-25T22:03:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.11536371400000001, 2024-04-25T22:03:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.717 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087273+0000", 2024-04-25T22:03:09.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:03:09.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089358+0000", 2024-04-25T22:03:09.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0020848170000000001 2024-04-25T22:03:09.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089372+0000", 2024-04-25T22:03:09.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.452e-05 2024-04-25T22:03:09.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089381+0000", 2024-04-25T22:03:09.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5979999999999997e-06 2024-04-25T22:03:09.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089486+0000", 2024-04-25T22:03:09.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105573 2024-04-25T22:03:09.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089536+0000", 2024-04-25T22:03:09.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9505000000000001e-05 2024-04-25T22:03:09.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202556+0000", 2024-04-25T22:03:09.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.113020169 2024-04-25T22:03:09.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202636+0000", 2024-04-25T22:03:09.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9814000000000005e-05 2024-04-25T22:03:09.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.721 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.721 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:5 4.10 e51/16 4:09a4c37f:::10000000003.00000001:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:09.721 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:09.722 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.602353551, 2024-04-25T22:03:09.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.110104358, 2024-04-25T22:03:09.722 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.722 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.722 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:09.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:09.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099849+0000", 2024-04-25T22:03:09.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7000000000000003e-07 2024-04-25T22:03:09.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108349+0000", 2024-04-25T22:03:09.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085003230000000006 2024-04-25T22:03:09.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108391+0000", 2024-04-25T22:03:09.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2011999999999997e-05 2024-04-25T22:03:09.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108415+0000", 2024-04-25T22:03:09.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3702000000000001e-05 2024-04-25T22:03:09.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108504+0000", 2024-04-25T22:03:09.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8684999999999995e-05 2024-04-25T22:03:09.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108520+0000", 2024-04-25T22:03:09.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5931999999999999e-05 2024-04-25T22:03:09.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209918+0000", 2024-04-25T22:03:09.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.101398696 2024-04-25T22:03:09.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209952+0000", 2024-04-25T22:03:09.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4038000000000002e-05 2024-04-25T22:03:09.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.725 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.726 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11 4.28 e51/49 4:177a762d:::10000000201.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:09.726 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:09.726 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.593651625, 2024-04-25T22:03:09.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098799331000000004, 2024-04-25T22:03:09.726 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.726 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.726 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:09.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:09.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108551+0000", 2024-04-25T22:03:09.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0699999999999996e-07 2024-04-25T22:03:09.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108576+0000", 2024-04-25T22:03:09.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4856000000000001e-05 2024-04-25T22:03:09.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108593+0000", 2024-04-25T22:03:09.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7125999999999998e-05 2024-04-25T22:03:09.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108609+0000", 2024-04-25T22:03:09.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6535999999999999e-05 2024-04-25T22:03:09.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108713+0000", 2024-04-25T22:03:09.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010344999999999999 2024-04-25T22:03:09.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108762+0000", 2024-04-25T22:03:09.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8711000000000002e-05 2024-04-25T22:03:09.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207305+0000", 2024-04-25T22:03:09.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098543566999999999 2024-04-25T22:03:09.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207349+0000", 2024-04-25T22:03:09.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4178000000000003e-05 2024-04-25T22:03:09.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.730 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.730 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:12 4.28 e51/49 4:15246602:::10000000202.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:03:09.730 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:09.731 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.593570333999999, 2024-04-25T22:03:09.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098749009999999998, 2024-04-25T22:03:09.731 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.731 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.731 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:09.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:09.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108632+0000", 2024-04-25T22:03:09.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2699999999999999e-07 2024-04-25T22:03:09.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108647+0000", 2024-04-25T22:03:09.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4585e-05 2024-04-25T22:03:09.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108667+0000", 2024-04-25T22:03:09.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9887000000000001e-05 2024-04-25T22:03:09.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108680+0000", 2024-04-25T22:03:09.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3249e-05 2024-04-25T22:03:09.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109917+0000", 2024-04-25T22:03:09.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012367050000000001 2024-04-25T22:03:09.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109961+0000", 2024-04-25T22:03:09.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4029000000000001e-05 2024-04-25T22:03:09.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207351+0000", 2024-04-25T22:03:09.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.097390791000000004 2024-04-25T22:03:09.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207380+0000", 2024-04-25T22:03:09.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9037e-05 2024-04-25T22:03:09.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.734 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.735 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:8 4.3b e51/49 4:deccbd37:::100000001fe.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:09.735 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:09.735 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.59350543, 2024-04-25T22:03:09.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090839771, 2024-04-25T22:03:09.735 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.735 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.735 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.735 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:09.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:09.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108697+0000", 2024-04-25T22:03:09.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1399999999999997e-07 2024-04-25T22:03:09.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108712+0000", 2024-04-25T22:03:09.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4772e-05 2024-04-25T22:03:09.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108728+0000", 2024-04-25T22:03:09.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5943e-05 2024-04-25T22:03:09.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108740+0000", 2024-04-25T22:03:09.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.235e-05 2024-04-25T22:03:09.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108797+0000", 2024-04-25T22:03:09.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6879000000000002e-05 2024-04-25T22:03:09.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108812+0000", 2024-04-25T22:03:09.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5268999999999999e-05 2024-04-25T22:03:09.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199495+0000", 2024-04-25T22:03:09.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090683071000000004 2024-04-25T22:03:09.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199536+0000", 2024-04-25T22:03:09.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0873e-05 2024-04-25T22:03:09.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.739 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.739 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:59 3.14 e52/15 3:2e2fa760:::200.00000001:head v 52'20, mlcod=51'18)", 2024-04-25T22:03:09.739 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:55.375543+0000", 2024-04-25T22:03:09.739 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.326658772, 2024-04-25T22:03:09.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.036557824000000003, 2024-04-25T22:03:09.739 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.739 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.739 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.740 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.375543+0000", 2024-04-25T22:03:09.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.375543+0000", 2024-04-25T22:03:09.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.375544+0000", 2024-04-25T22:03:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2640000000000001e-06 2024-04-25T22:03:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377524+0000", 2024-04-25T22:03:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001980154 2024-04-25T22:03:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377551+0000", 2024-04-25T22:03:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6211999999999999e-05 2024-04-25T22:03:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377569+0000", 2024-04-25T22:03:09.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182e-05 2024-04-25T22:03:09.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377689+0000", 2024-04-25T22:03:09.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119973 2024-04-25T22:03:09.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.377722+0000", 2024-04-25T22:03:09.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3113e-05 2024-04-25T22:03:09.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.412025+0000", 2024-04-25T22:03:09.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.034302721000000001 2024-04-25T22:03:09.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:55.412101+0000", 2024-04-25T22:03:09.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6205000000000006e-05 2024-04-25T22:03:09.743 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.743 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.743 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.743 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:2315 4.1f e52/49 4:f84a2a2d:::10000000c60.00000000:head v 52'42, mlcod=52'40)", 2024-04-25T22:03:09.744 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:57.112380+0000", 2024-04-25T22:03:09.744 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.589822142999999, 2024-04-25T22:03:09.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.038962912000000002, 2024-04-25T22:03:09.744 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.744 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.744 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.744 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112380+0000", 2024-04-25T22:03:09.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112380+0000", 2024-04-25T22:03:09.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112381+0000", 2024-04-25T22:03:09.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:09.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112856+0000", 2024-04-25T22:03:09.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047428299999999999 2024-04-25T22:03:09.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112885+0000", 2024-04-25T22:03:09.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9019000000000001e-05 2024-04-25T22:03:09.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.112898+0000", 2024-04-25T22:03:09.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3152999999999999e-05 2024-04-25T22:03:09.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.113041+0000", 2024-04-25T22:03:09.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014280599999999999 2024-04-25T22:03:09.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.113102+0000", 2024-04-25T22:03:09.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1495000000000007e-05 2024-04-25T22:03:09.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.151273+0000", 2024-04-25T22:03:09.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.038170444999999997 2024-04-25T22:03:09.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:57.151342+0000", 2024-04-25T22:03:09.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9861000000000001e-05 2024-04-25T22:03:09.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.749 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.749 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:3804 4.2f e53/16 4:f569593f:::10000001253.00000000:head v 53'67, mlcod=53'65)", 2024-04-25T22:03:09.749 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:00.169882+0000", 2024-04-25T22:03:09.749 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.5323198859999998, 2024-04-25T22:03:09.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030929529000000001, 2024-04-25T22:03:09.750 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.750 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.750 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.169882+0000", 2024-04-25T22:03:09.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.169882+0000", 2024-04-25T22:03:09.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.169884+0000", 2024-04-25T22:03:09.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.843e-06 2024-04-25T22:03:09.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.170484+0000", 2024-04-25T22:03:09.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060082600000000005 2024-04-25T22:03:09.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.170511+0000", 2024-04-25T22:03:09.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6373e-05 2024-04-25T22:03:09.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.170523+0000", 2024-04-25T22:03:09.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2583e-05 2024-04-25T22:03:09.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.170655+0000", 2024-04-25T22:03:09.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013200899999999999 2024-04-25T22:03:09.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.170717+0000", 2024-04-25T22:03:09.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1984999999999997e-05 2024-04-25T22:03:09.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.200715+0000", 2024-04-25T22:03:09.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029997271999999998 2024-04-25T22:03:09.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:00.200811+0000", 2024-04-25T22:03:09.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6638000000000005e-05 2024-04-25T22:03:09.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.759 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.759 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:142 3.1e e57/15 3:7bf7e7b5:::200.00000006:head v 57'3, mlcod=17'1)", 2024-04-25T22:03:09.759 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.680415+0000", 2024-04-25T22:03:09.760 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.0217867280000004, 2024-04-25T22:03:09.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.030171997999999998, 2024-04-25T22:03:09.760 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.760 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.680415+0000", 2024-04-25T22:03:09.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.680415+0000", 2024-04-25T22:03:09.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.680417+0000", 2024-04-25T22:03:09.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8470000000000001e-06 2024-04-25T22:03:09.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.681319+0000", 2024-04-25T22:03:09.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090179699999999997 2024-04-25T22:03:09.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.681339+0000", 2024-04-25T22:03:09.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9928999999999998e-05 2024-04-25T22:03:09.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.681350+0000", 2024-04-25T22:03:09.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1917e-05 2024-04-25T22:03:09.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.681459+0000", 2024-04-25T22:03:09.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000108507 2024-04-25T22:03:09.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.681492+0000", 2024-04-25T22:03:09.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3488999999999997e-05 2024-04-25T22:03:09.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.710516+0000", 2024-04-25T22:03:09.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.029023456999999999 2024-04-25T22:03:09.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.710587+0000", 2024-04-25T22:03:09.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1055000000000003e-05 2024-04-25T22:03:09.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.769 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.769 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:6909 4.6 4:631b09cd:::10000001f99.00000000:head [write 0~1706] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:09.769 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.879622+0000", 2024-04-25T22:03:09.770 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.8225799199999999, 2024-04-25T22:03:09.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83167118299999998, 2024-04-25T22:03:09.770 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.770 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.770 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.770 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:09.771 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:09.771 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:09.771 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 6909 2024-04-25T22:03:09.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.771 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879622+0000", 2024-04-25T22:03:09.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879622+0000", 2024-04-25T22:03:09.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879624+0000", 2024-04-25T22:03:09.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.429e-06 2024-04-25T22:03:09.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879639+0000", 2024-04-25T22:03:09.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4534e-05 2024-04-25T22:03:09.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879669+0000", 2024-04-25T22:03:09.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0349e-05 2024-04-25T22:03:09.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879684+0000", 2024-04-25T22:03:09.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:03:09.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879767+0000", 2024-04-25T22:03:09.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3410000000000003e-05 2024-04-25T22:03:09.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:09.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879783+0000", 2024-04-25T22:03:09.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5378000000000001e-05 2024-04-25T22:03:09.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.700268+0000", 2024-04-25T22:03:09.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.82048565699999998 2024-04-25T22:03:09.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.700627+0000", 2024-04-25T22:03:09.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035847800000000002 2024-04-25T22:03:09.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:09.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.700977+0000", 2024-04-25T22:03:09.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035024699999999998 2024-04-25T22:03:09.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.704901+0000", 2024-04-25T22:03:09.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039243230000000004 2024-04-25T22:03:09.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:09.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711150+0000", 2024-04-25T22:03:09.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0062490519999999997 2024-04-25T22:03:09.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711230+0000", 2024-04-25T22:03:09.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9370999999999996e-05 2024-04-25T22:03:09.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:09.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3221999999999999e-05 2024-04-25T22:03:09.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.783 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.783 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:6922 4.6 4:62b4ea5c:::10000001fab.00000000:head [write 0~7953] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:09.784 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.902807+0000", 2024-04-25T22:03:09.784 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.799394693, 2024-04-25T22:03:09.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80868129799999999, 2024-04-25T22:03:09.784 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.784 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.784 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:09.784 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:09.785 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:09.785 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 6922 2024-04-25T22:03:09.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.785 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902807+0000", 2024-04-25T22:03:09.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902807+0000", 2024-04-25T22:03:09.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902809+0000", 2024-04-25T22:03:09.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4099999999999998e-06 2024-04-25T22:03:09.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902830+0000", 2024-04-25T22:03:09.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0381999999999999e-05 2024-04-25T22:03:09.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902852+0000", 2024-04-25T22:03:09.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2357e-05 2024-04-25T22:03:09.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902864+0000", 2024-04-25T22:03:09.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2329e-05 2024-04-25T22:03:09.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902923+0000", 2024-04-25T22:03:09.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8485e-05 2024-04-25T22:03:09.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:09.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902930+0000", 2024-04-25T22:03:09.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4200000000000001e-06 2024-04-25T22:03:09.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.702506+0000", 2024-04-25T22:03:09.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.79957517899999997 2024-04-25T22:03:09.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.702674+0000", 2024-04-25T22:03:09.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016807200000000001 2024-04-25T22:03:09.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:09.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.702860+0000", 2024-04-25T22:03:09.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018624200000000001 2024-04-25T22:03:09.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706186+0000", 2024-04-25T22:03:09.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033265619999999999 2024-04-25T22:03:09.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:09.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711369+0000", 2024-04-25T22:03:09.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005182496 2024-04-25T22:03:09.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711436+0000", 2024-04-25T22:03:09.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7135e-05 2024-04-25T22:03:09.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711488+0000", 2024-04-25T22:03:09.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2228999999999997e-05 2024-04-25T22:03:09.790 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.790 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.790 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.791 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:6926 4.6 4:62749b46:::10000001faf.00000000:head [write 0~2676] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:09.791 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.908574+0000", 2024-04-25T22:03:09.791 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.7936278449999996, 2024-04-25T22:03:09.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.803246511, 2024-04-25T22:03:09.791 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.791 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.791 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:09.791 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:09.791 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:09.791 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 6926 2024-04-25T22:03:09.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.792 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908574+0000", 2024-04-25T22:03:09.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908574+0000", 2024-04-25T22:03:09.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908576+0000", 2024-04-25T22:03:09.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.784e-06 2024-04-25T22:03:09.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908585+0000", 2024-04-25T22:03:09.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6420000000000002e-06 2024-04-25T22:03:09.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908609+0000", 2024-04-25T22:03:09.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3303e-05 2024-04-25T22:03:09.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908622+0000", 2024-04-25T22:03:09.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3783e-05 2024-04-25T22:03:09.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908730+0000", 2024-04-25T22:03:09.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107831 2024-04-25T22:03:09.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:09.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908748+0000", 2024-04-25T22:03:09.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7909000000000001e-05 2024-04-25T22:03:09.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.703586+0000", 2024-04-25T22:03:09.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.794838131 2024-04-25T22:03:09.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.703854+0000", 2024-04-25T22:03:09.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026782299999999999 2024-04-25T22:03:09.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:09.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.704060+0000", 2024-04-25T22:03:09.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020576200000000001 2024-04-25T22:03:09.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711121+0000", 2024-04-25T22:03:09.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070615510000000001 2024-04-25T22:03:09.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:09.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711705+0000", 2024-04-25T22:03:09.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00058315899999999998 2024-04-25T22:03:09.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711769+0000", 2024-04-25T22:03:09.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4877999999999998e-05 2024-04-25T22:03:09.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711820+0000", 2024-04-25T22:03:09.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0955000000000003e-05 2024-04-25T22:03:09.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.797 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.797 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7057 4.6 4:63cd8154:::10000002047.00000000:head [write 0~2047] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:09.797 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.194487+0000", 2024-04-25T22:03:09.797 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.5077149350000001, 2024-04-25T22:03:09.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.51749014100000001, 2024-04-25T22:03:09.798 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.798 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.798 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.798 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:09.798 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:09.798 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:09.798 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7057 2024-04-25T22:03:09.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.798 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194487+0000", 2024-04-25T22:03:09.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194487+0000", 2024-04-25T22:03:09.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194489+0000", 2024-04-25T22:03:09.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-04-25T22:03:09.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194499+0000", 2024-04-25T22:03:09.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0117e-05 2024-04-25T22:03:09.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194522+0000", 2024-04-25T22:03:09.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2925000000000002e-05 2024-04-25T22:03:09.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194541+0000", 2024-04-25T22:03:09.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9137e-05 2024-04-25T22:03:09.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194712+0000", 2024-04-25T22:03:09.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000170602 2024-04-25T22:03:09.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:09.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194743+0000", 2024-04-25T22:03:09.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1479000000000001e-05 2024-04-25T22:03:09.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.704997+0000", 2024-04-25T22:03:09.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.51025366000000005 2024-04-25T22:03:09.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.705197+0000", 2024-04-25T22:03:09.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020022799999999999 2024-04-25T22:03:09.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:09.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.705399+0000", 2024-04-25T22:03:09.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020160499999999999 2024-04-25T22:03:09.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711586+0000", 2024-04-25T22:03:09.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061875350000000001 2024-04-25T22:03:09.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:09.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711841+0000", 2024-04-25T22:03:09.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025510300000000001 2024-04-25T22:03:09.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711906+0000", 2024-04-25T22:03:09.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4381999999999994e-05 2024-04-25T22:03:09.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711977+0000", 2024-04-25T22:03:09.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1295000000000001e-05 2024-04-25T22:03:09.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.804 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.805 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7114 4.6 4:63547153:::10000002086.00000000:head [write 0~67896] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:09.805 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.411903+0000", 2024-04-25T22:03:09.805 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.2902983509999997, 2024-04-25T22:03:09.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.301551715, 2024-04-25T22:03:09.805 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.805 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.805 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.805 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:09.805 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:09.805 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:09.805 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7114 2024-04-25T22:03:09.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.806 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.411903+0000", 2024-04-25T22:03:09.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.411903+0000", 2024-04-25T22:03:09.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.411906+0000", 2024-04-25T22:03:09.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9469999999999999e-06 2024-04-25T22:03:09.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412184+0000", 2024-04-25T22:03:09.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027727600000000002 2024-04-25T22:03:09.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412215+0000", 2024-04-25T22:03:09.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1899000000000001e-05 2024-04-25T22:03:09.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412230+0000", 2024-04-25T22:03:09.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4703e-05 2024-04-25T22:03:09.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412384+0000", 2024-04-25T22:03:09.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015366300000000001 2024-04-25T22:03:09.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:09.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412405+0000", 2024-04-25T22:03:09.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0936000000000001e-05 2024-04-25T22:03:09.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706266+0000", 2024-04-25T22:03:09.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.29386084299999998 2024-04-25T22:03:09.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706440+0000", 2024-04-25T22:03:09.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174759 2024-04-25T22:03:09.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:09.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706655+0000", 2024-04-25T22:03:09.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021489100000000001 2024-04-25T22:03:09.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711675+0000", 2024-04-25T22:03:09.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050198639999999997 2024-04-25T22:03:09.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:09.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.713316+0000", 2024-04-25T22:03:09.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016410280000000001 2024-04-25T22:03:09.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.713391+0000", 2024-04-25T22:03:09.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5065e-05 2024-04-25T22:03:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.713455+0000", 2024-04-25T22:03:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3841000000000001e-05 2024-04-25T22:03:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7117 4.6 4:60a5b603:::10000002089.00000000:head [write 0~12740] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.421192+0000", 2024-04-25T22:03:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.2810099529999999, 2024-04-25T22:03:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.29400416200000001, 2024-04-25T22:03:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7117 2024-04-25T22:03:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421192+0000", 2024-04-25T22:03:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421192+0000", 2024-04-25T22:03:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421194+0000", 2024-04-25T22:03:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3700000000000002e-06 2024-04-25T22:03:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421247+0000", 2024-04-25T22:03:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2539e-05 2024-04-25T22:03:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421278+0000", 2024-04-25T22:03:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1392e-05 2024-04-25T22:03:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421293+0000", 2024-04-25T22:03:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5133000000000001e-05 2024-04-25T22:03:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421487+0000", 2024-04-25T22:03:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019340899999999999 2024-04-25T22:03:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421506+0000", 2024-04-25T22:03:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9568999999999998e-05 2024-04-25T22:03:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.709232+0000", 2024-04-25T22:03:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.28772543699999997 2024-04-25T22:03:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.709416+0000", 2024-04-25T22:03:09.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000184019 2024-04-25T22:03:09.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:09.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.709668+0000", 2024-04-25T22:03:09.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025279000000000002 2024-04-25T22:03:09.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712068+0000", 2024-04-25T22:03:09.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002399558 2024-04-25T22:03:09.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:09.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.715072+0000", 2024-04-25T22:03:09.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030037800000000002 2024-04-25T22:03:09.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.715143+0000", 2024-04-25T22:03:09.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1000999999999993e-05 2024-04-25T22:03:09.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.715196+0000", 2024-04-25T22:03:09.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3164999999999997e-05 2024-04-25T22:03:09.821 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.821 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.821 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.822 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7136 4.6 4:60bfd03c:::100000020a0.00000000:head [write 0~1357] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:09.822 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.489503+0000", 2024-04-25T22:03:09.822 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.2126990720000004, 2024-04-25T22:03:09.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.22876102600000001, 2024-04-25T22:03:09.822 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.822 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.822 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:09.822 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:09.822 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:09.822 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7136 2024-04-25T22:03:09.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.823 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489503+0000", 2024-04-25T22:03:09.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489503+0000", 2024-04-25T22:03:09.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489505+0000", 2024-04-25T22:03:09.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.486e-06 2024-04-25T22:03:09.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489517+0000", 2024-04-25T22:03:09.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.217e-05 2024-04-25T22:03:09.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489544+0000", 2024-04-25T22:03:09.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6852999999999999e-05 2024-04-25T22:03:09.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489559+0000", 2024-04-25T22:03:09.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:03:09.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489705+0000", 2024-04-25T22:03:09.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014583 2024-04-25T22:03:09.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:09.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489722+0000", 2024-04-25T22:03:09.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7376000000000001e-05 2024-04-25T22:03:09.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712122+0000", 2024-04-25T22:03:09.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.22239948300000001 2024-04-25T22:03:09.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712376+0000", 2024-04-25T22:03:09.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025398700000000001 2024-04-25T22:03:09.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:09.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712639+0000", 2024-04-25T22:03:09.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026326300000000002 2024-04-25T22:03:09.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:09.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.714861+0000", 2024-04-25T22:03:09.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00222236 2024-04-25T22:03:09.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:09.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.718091+0000", 2024-04-25T22:03:09.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032294400000000001 2024-04-25T22:03:09.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.718197+0000", 2024-04-25T22:03:09.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010655 2024-04-25T22:03:09.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.718264+0000", 2024-04-25T22:03:09.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6482000000000005e-05 2024-04-25T22:03:09.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.828 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.828 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:196 3.1e e59/15 3:7bf7e7b5:::200.00000006:head v 59'56, mlcod=58'54)", 2024-04-25T22:03:09.828 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.860149+0000", 2024-04-25T22:03:09.828 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.8420527149999999, 2024-04-25T22:03:09.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.081648222000000006, 2024-04-25T22:03:09.828 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.829 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.829 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.860149+0000", 2024-04-25T22:03:09.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.860149+0000", 2024-04-25T22:03:09.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.860151+0000", 2024-04-25T22:03:09.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1100000000000001e-06 2024-04-25T22:03:09.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.864700+0000", 2024-04-25T22:03:09.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045484289999999997 2024-04-25T22:03:09.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.864728+0000", 2024-04-25T22:03:09.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8022999999999999e-05 2024-04-25T22:03:09.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.864744+0000", 2024-04-25T22:03:09.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.649e-05 2024-04-25T22:03:09.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.864841+0000", 2024-04-25T22:03:09.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7397000000000003e-05 2024-04-25T22:03:09.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.864898+0000", 2024-04-25T22:03:09.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6854999999999997e-05 2024-04-25T22:03:09.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.941744+0000", 2024-04-25T22:03:09.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.076845998999999998 2024-04-25T22:03:09.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.941797+0000", 2024-04-25T22:03:09.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2918999999999999e-05 2024-04-25T22:03:09.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.832 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.832 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:206 3.1d e60/49 3:bf8dcf43:::200.00000008:head v 60'8, mlcod=60'6)", 2024-04-25T22:03:09.833 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:09.213356+0000", 2024-04-25T22:03:09.833 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.48884590700000002, 2024-04-25T22:03:09.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042613472999999999, 2024-04-25T22:03:09.833 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:09.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:09.833 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:09.833 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:09.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:09.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:09.213356+0000", 2024-04-25T22:03:09.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:09.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:09.213356+0000", 2024-04-25T22:03:09.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:09.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:09.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:09.213358+0000", 2024-04-25T22:03:09.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6060000000000001e-06 2024-04-25T22:03:09.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:09.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:09.217299+0000", 2024-04-25T22:03:09.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003940402 2024-04-25T22:03:09.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:09.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:09.217314+0000", 2024-04-25T22:03:09.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5141e-05 2024-04-25T22:03:09.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:09.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:09.217324+0000", 2024-04-25T22:03:09.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9939999999999995e-06 2024-04-25T22:03:09.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:09.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:09.217413+0000", 2024-04-25T22:03:09.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9170000000000002e-05 2024-04-25T22:03:09.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:09.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:09.217438+0000", 2024-04-25T22:03:09.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4796000000000001e-05 2024-04-25T22:03:09.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:09.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:09.255912+0000", 2024-04-25T22:03:09.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.038473737000000001 2024-04-25T22:03:09.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:09.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:09.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:09.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:09.255969+0000", 2024-04-25T22:03:09.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7627000000000002e-05 2024-04-25T22:03:09.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.838 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:09.838 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:09.839 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:09.841 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-25T22:03:09.841 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:09.832+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:09.841 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:09.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:09.937+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:09.983 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:09.983 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:09.983 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:03:09.984 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:10.000 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:10.042 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:10.036+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:10.127 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:10.127 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:10.127 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:03:10.127 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:03:10.127 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:10.142 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:10.143 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:10.136+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:10.243 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:10.236+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:10.282 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:10.282 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:03:10.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:03:10.282 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T22:03:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.293176222, 2024-04-25T22:03:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.180276931, 2024-04-25T22:03:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4 2024-04-25T22:03:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983834+0000", 2024-04-25T22:03:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2900000000000001e-06 2024-04-25T22:03:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991787+0000", 2024-04-25T22:03:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079521690000000003 2024-04-25T22:03:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991826+0000", 2024-04-25T22:03:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9258999999999998e-05 2024-04-25T22:03:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991845+0000", 2024-04-25T22:03:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9360000000000001e-05 2024-04-25T22:03:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992058+0000", 2024-04-25T22:03:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212559 2024-04-25T22:03:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992213+0000", 2024-04-25T22:03:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015520700000000001 2024-04-25T22:03:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992414+0000", 2024-04-25T22:03:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020049 2024-04-25T22:03:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162511+0000", 2024-04-25T22:03:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.17009782900000001 2024-04-25T22:03:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163967+0000", 2024-04-25T22:03:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001455752 2024-04-25T22:03:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164045+0000", 2024-04-25T22:03:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7415000000000003e-05 2024-04-25T22:03:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164109+0000", 2024-04-25T22:03:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4601e-05 2024-04-25T22:03:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.193718074, 2024-04-25T22:03:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.12612672599999999, 2024-04-25T22:03:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2024-04-25T22:03:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083293+0000", 2024-04-25T22:03:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6630000000000002e-06 2024-04-25T22:03:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086619+0000", 2024-04-25T22:03:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033261699999999998 2024-04-25T22:03:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086647+0000", 2024-04-25T22:03:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8085999999999998e-05 2024-04-25T22:03:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086665+0000", 2024-04-25T22:03:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:03:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086870+0000", 2024-04-25T22:03:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020488599999999999 2024-04-25T22:03:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087110+0000", 2024-04-25T22:03:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024093199999999999 2024-04-25T22:03:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087310+0000", 2024-04-25T22:03:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000199936 2024-04-25T22:03:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207766+0000", 2024-04-25T22:03:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.120456035 2024-04-25T22:03:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209358+0000", 2024-04-25T22:03:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015912369999999999 2024-04-25T22:03:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209390+0000", 2024-04-25T22:03:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2434999999999997e-05 2024-04-25T22:03:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209417+0000", 2024-04-25T22:03:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6936000000000001e-05 2024-04-25T22:03:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6847 4.16 4:68767fd1:::10000001f4f.00000000:head [write 0~7212] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.5835367609999995, 2024-04-25T22:03:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0208302119999999, 2024-04-25T22:03:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6847 2024-04-25T22:03:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693473+0000", 2024-04-25T22:03:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.75e-06 2024-04-25T22:03:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693490+0000", 2024-04-25T22:03:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6540000000000001e-05 2024-04-25T22:03:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693509+0000", 2024-04-25T22:03:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9536999999999999e-05 2024-04-25T22:03:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693522+0000", 2024-04-25T22:03:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2099000000000001e-05 2024-04-25T22:03:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693677+0000", 2024-04-25T22:03:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015516799999999999 2024-04-25T22:03:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693705+0000", 2024-04-25T22:03:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8663e-05 2024-04-25T22:03:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705551+0000", 2024-04-25T22:03:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.011845495 2024-04-25T22:03:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705942+0000", 2024-04-25T22:03:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00039080099999999997 2024-04-25T22:03:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.706151+0000", 2024-04-25T22:03:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000209457 2024-04-25T22:03:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711141+0000", 2024-04-25T22:03:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049901240000000003 2024-04-25T22:03:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714005+0000", 2024-04-25T22:03:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028642229999999999 2024-04-25T22:03:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714180+0000", 2024-04-25T22:03:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017433699999999999 2024-04-25T22:03:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714302+0000", 2024-04-25T22:03:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122018 2024-04-25T22:03:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6960 4.16 4:6823d322:::10000001fd2.00000000:head [write 0~150] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.3065326629999996, 2024-04-25T22:03:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.74417278899999995, 2024-04-25T22:03:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6960 2024-04-25T22:03:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970478+0000", 2024-04-25T22:03:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.939e-06 2024-04-25T22:03:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970488+0000", 2024-04-25T22:03:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9699999999999994e-06 2024-04-25T22:03:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970524+0000", 2024-04-25T22:03:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5963000000000001e-05 2024-04-25T22:03:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970537+0000", 2024-04-25T22:03:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.31e-05 2024-04-25T22:03:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970701+0000", 2024-04-25T22:03:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164177 2024-04-25T22:03:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970718+0000", 2024-04-25T22:03:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7323e-05 2024-04-25T22:03:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707632+0000", 2024-04-25T22:03:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.73691394300000002 2024-04-25T22:03:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707924+0000", 2024-04-25T22:03:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029223299999999998 2024-04-25T22:03:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.708389+0000", 2024-04-25T22:03:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046429300000000001 2024-04-25T22:03:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029039830000000002 2024-04-25T22:03:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714409+0000", 2024-04-25T22:03:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031159260000000002 2024-04-25T22:03:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714538+0000", 2024-04-25T22:03:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012952100000000001 2024-04-25T22:03:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714649+0000", 2024-04-25T22:03:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110418 2024-04-25T22:03:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7039 4.16 4:6919637e:::10000002032.00000000:head [write 0~2968] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.1204861580000003, 2024-04-25T22:03:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.56024932199999999, 2024-04-25T22:03:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7039 2024-04-25T22:03:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156523+0000", 2024-04-25T22:03:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2130000000000001e-06 2024-04-25T22:03:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156530+0000", 2024-04-25T22:03:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9090000000000003e-06 2024-04-25T22:03:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156544+0000", 2024-04-25T22:03:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3271999999999999e-05 2024-04-25T22:03:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156551+0000", 2024-04-25T22:03:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4970000000000004e-06 2024-04-25T22:03:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156639+0000", 2024-04-25T22:03:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7638000000000004e-05 2024-04-25T22:03:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156649+0000", 2024-04-25T22:03:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0536e-05 2024-04-25T22:03:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709515+0000", 2024-04-25T22:03:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.55286568999999997 2024-04-25T22:03:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709836+0000", 2024-04-25T22:03:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032078899999999998 2024-04-25T22:03:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.710271+0000", 2024-04-25T22:03:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043530000000000001 2024-04-25T22:03:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716576+0000", 2024-04-25T22:03:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063045050000000002 2024-04-25T22:03:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716605+0000", 2024-04-25T22:03:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8949e-05 2024-04-25T22:03:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716706+0000", 2024-04-25T22:03:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101765 2024-04-25T22:03:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716772+0000", 2024-04-25T22:03:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5259000000000007e-05 2024-04-25T22:03:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7065 4.16 4:697a9f10:::10000002050.00000000:head [write 0~16297] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.0628702099999998, 2024-04-25T22:03:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.50307290800000004, 2024-04-25T22:03:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7065 2024-04-25T22:03:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214139+0000", 2024-04-25T22:03:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.186e-06 2024-04-25T22:03:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214170+0000", 2024-04-25T22:03:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0419000000000001e-05 2024-04-25T22:03:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214186+0000", 2024-04-25T22:03:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6526000000000001e-05 2024-04-25T22:03:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214194+0000", 2024-04-25T22:03:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6769999999999995e-06 2024-04-25T22:03:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214380+0000", 2024-04-25T22:03:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018580699999999999 2024-04-25T22:03:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214399+0000", 2024-04-25T22:03:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9446e-05 2024-04-25T22:03:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711402+0000", 2024-04-25T22:03:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.497002901 2024-04-25T22:03:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711822+0000", 2024-04-25T22:03:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00041989399999999997 2024-04-25T22:03:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.712017+0000", 2024-04-25T22:03:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019540700000000001 2024-04-25T22:03:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716792+0000", 2024-04-25T22:03:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047748210000000003 2024-04-25T22:03:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716937+0000", 2024-04-25T22:03:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014479099999999999 2024-04-25T22:03:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717081+0000", 2024-04-25T22:03:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014412100000000001 2024-04-25T22:03:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717211+0000", 2024-04-25T22:03:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012991200000000001 2024-04-25T22:03:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7089 4.16 4:6868fcac:::1000000206b.00000000:head [write 0~5386] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.003316216, 2024-04-25T22:03:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44658810700000001, 2024-04-25T22:03:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7089 2024-04-25T22:03:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273695+0000", 2024-04-25T22:03:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.463e-06 2024-04-25T22:03:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273712+0000", 2024-04-25T22:03:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7842999999999998e-05 2024-04-25T22:03:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273742+0000", 2024-04-25T22:03:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9039000000000001e-05 2024-04-25T22:03:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273756+0000", 2024-04-25T22:03:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4406999999999999e-05 2024-04-25T22:03:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273943+0000", 2024-04-25T22:03:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018708 2024-04-25T22:03:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273961+0000", 2024-04-25T22:03:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7977000000000001e-05 2024-04-25T22:03:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714748+0000", 2024-04-25T22:03:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.440786605 2024-04-25T22:03:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715013+0000", 2024-04-25T22:03:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026558300000000001 2024-04-25T22:03:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715309+0000", 2024-04-25T22:03:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000295715 2024-04-25T22:03:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.719035+0000", 2024-04-25T22:03:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037256310000000001 2024-04-25T22:03:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720142+0000", 2024-04-25T22:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001107053 2024-04-25T22:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720221+0000", 2024-04-25T22:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9832000000000004e-05 2024-04-25T22:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720280+0000", 2024-04-25T22:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8879000000000003e-05 2024-04-25T22:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7090 4.16 4:69dc3034:::1000000206c.00000000:head [write 0~957] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.0006918860000003, 2024-04-25T22:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44572077100000002, 2024-04-25T22:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7090 2024-04-25T22:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276319+0000", 2024-04-25T22:03:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3429999999999998e-06 2024-04-25T22:03:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276330+0000", 2024-04-25T22:03:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1567e-05 2024-04-25T22:03:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276362+0000", 2024-04-25T22:03:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1863000000000003e-05 2024-04-25T22:03:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276377+0000", 2024-04-25T22:03:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5102999999999999e-05 2024-04-25T22:03:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276564+0000", 2024-04-25T22:03:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018629700000000001 2024-04-25T22:03:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276583+0000", 2024-04-25T22:03:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9743000000000001e-05 2024-04-25T22:03:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717354+0000", 2024-04-25T22:03:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44077094900000002 2024-04-25T22:03:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717723+0000", 2024-04-25T22:03:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036839099999999998 2024-04-25T22:03:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.718097+0000", 2024-04-25T22:03:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037392099999999999 2024-04-25T22:03:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720305+0000", 2024-04-25T22:03:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022084439999999999 2024-04-25T22:03:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721866+0000", 2024-04-25T22:03:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015610260000000001 2024-04-25T22:03:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721944+0000", 2024-04-25T22:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7961999999999997e-05 2024-04-25T22:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.722037+0000", 2024-04-25T22:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3162e-05 2024-04-25T22:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:260 3.1d 3:bf8dcf43:::200.00000008:head [write 3725664~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682245+0000", 2024-04-25T22:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.59476376500000006, 2024-04-25T22:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.090162838999999995, 2024-04-25T22:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682245+0000", 2024-04-25T22:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682245+0000", 2024-04-25T22:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682246+0000", 2024-04-25T22:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.46e-06 2024-04-25T22:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682267+0000", 2024-04-25T22:03:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0624000000000001e-05 2024-04-25T22:03:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682287+0000", 2024-04-25T22:03:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0689000000000001e-05 2024-04-25T22:03:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682301+0000", 2024-04-25T22:03:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3363000000000001e-05 2024-04-25T22:03:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.766151+0000", 2024-04-25T22:03:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083850657999999995 2024-04-25T22:03:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.766275+0000", 2024-04-25T22:03:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012367199999999999 2024-04-25T22:03:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.766466+0000", 2024-04-25T22:03:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000190607 2024-04-25T22:03:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.771908+0000", 2024-04-25T22:03:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054421499999999998 2024-04-25T22:03:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772078+0000", 2024-04-25T22:03:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017038099999999999 2024-04-25T22:03:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772262+0000", 2024-04-25T22:03:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018389799999999999 2024-04-25T22:03:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772407+0000", 2024-04-25T22:03:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014533699999999999 2024-04-25T22:03:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:261 3.1d 3:bf8dcf43:::200.00000008:head [write 3727070~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682317+0000", 2024-04-25T22:03:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.59469103599999995, 2024-04-25T22:03:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.090430008000000006, 2024-04-25T22:03:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682317+0000", 2024-04-25T22:03:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682317+0000", 2024-04-25T22:03:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682319+0000", 2024-04-25T22:03:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1570000000000001e-06 2024-04-25T22:03:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682333+0000", 2024-04-25T22:03:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4070000000000001e-05 2024-04-25T22:03:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682354+0000", 2024-04-25T22:03:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0916000000000001e-05 2024-04-25T22:03:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682367+0000", 2024-04-25T22:03:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:03:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.767445+0000", 2024-04-25T22:03:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085078215999999998 2024-04-25T22:03:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.767588+0000", 2024-04-25T22:03:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000142824 2024-04-25T22:03:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.767781+0000", 2024-04-25T22:03:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019285099999999999 2024-04-25T22:03:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772528+0000", 2024-04-25T22:03:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047471010000000001 2024-04-25T22:03:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772558+0000", 2024-04-25T22:03:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0355999999999999e-05 2024-04-25T22:03:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772667+0000", 2024-04-25T22:03:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108859 2024-04-25T22:03:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772747+0000", 2024-04-25T22:03:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0098000000000005e-05 2024-04-25T22:03:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:262 3.1d 3:bf8dcf43:::200.00000008:head [write 3728472~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682382+0000", 2024-04-25T22:03:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.594626137, 2024-04-25T22:03:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.09080241, 2024-04-25T22:03:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682382+0000", 2024-04-25T22:03:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682382+0000", 2024-04-25T22:03:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682383+0000", 2024-04-25T22:03:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:03:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682390+0000", 2024-04-25T22:03:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5629999999999997e-06 2024-04-25T22:03:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682410+0000", 2024-04-25T22:03:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0477000000000001e-05 2024-04-25T22:03:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682424+0000", 2024-04-25T22:03:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3216e-05 2024-04-25T22:03:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.768876+0000", 2024-04-25T22:03:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.086452575000000004 2024-04-25T22:03:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.769130+0000", 2024-04-25T22:03:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025331900000000001 2024-04-25T22:03:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.769501+0000", 2024-04-25T22:03:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037142099999999998 2024-04-25T22:03:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772761+0000", 2024-04-25T22:03:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032599510000000001 2024-04-25T22:03:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772901+0000", 2024-04-25T22:03:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014047500000000001 2024-04-25T22:03:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.773057+0000", 2024-04-25T22:03:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015578799999999999 2024-04-25T22:03:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.773185+0000", 2024-04-25T22:03:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012751799999999999 2024-04-25T22:03:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:263 3.1d 3:bf8dcf43:::200.00000008:head [write 3729875~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682439+0000", 2024-04-25T22:03:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.59456907800000003, 2024-04-25T22:03:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093602454000000002, 2024-04-25T22:03:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682439+0000", 2024-04-25T22:03:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682439+0000", 2024-04-25T22:03:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682440+0000", 2024-04-25T22:03:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.06e-06 2024-04-25T22:03:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682469+0000", 2024-04-25T22:03:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8269999999999999e-05 2024-04-25T22:03:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682490+0000", 2024-04-25T22:03:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1702999999999999e-05 2024-04-25T22:03:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682504+0000", 2024-04-25T22:03:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.394e-05 2024-04-25T22:03:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.770262+0000", 2024-04-25T22:03:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087757522000000004 2024-04-25T22:03:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.770501+0000", 2024-04-25T22:03:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000239612 2024-04-25T22:03:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.770841+0000", 2024-04-25T22:03:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034001499999999999 2024-04-25T22:03:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.774702+0000", 2024-04-25T22:03:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038608660000000001 2024-04-25T22:03:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.775840+0000", 2024-04-25T22:03:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001137299 2024-04-25T22:03:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.775935+0000", 2024-04-25T22:03:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5785000000000005e-05 2024-04-25T22:03:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.776042+0000", 2024-04-25T22:03:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106382 2024-04-25T22:03:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:264 3.1d 3:bf8dcf43:::200.00000008:head [write 3731277~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682521+0000", 2024-04-25T22:03:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.59448769899999998, 2024-04-25T22:03:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.09716756, 2024-04-25T22:03:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682521+0000", 2024-04-25T22:03:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682521+0000", 2024-04-25T22:03:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682522+0000", 2024-04-25T22:03:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.074e-06 2024-04-25T22:03:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682529+0000", 2024-04-25T22:03:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7630000000000003e-06 2024-04-25T22:03:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682573+0000", 2024-04-25T22:03:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4499000000000002e-05 2024-04-25T22:03:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682592+0000", 2024-04-25T22:03:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9323000000000001e-05 2024-04-25T22:03:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.773315+0000", 2024-04-25T22:03:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.090722811 2024-04-25T22:03:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.773542+0000", 2024-04-25T22:03:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00022711899999999999 2024-04-25T22:03:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.773723+0000", 2024-04-25T22:03:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000180321 2024-04-25T22:03:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779406+0000", 2024-04-25T22:03:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005683474 2024-04-25T22:03:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779531+0000", 2024-04-25T22:03:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000125208 2024-04-25T22:03:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779622+0000", 2024-04-25T22:03:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0643000000000006e-05 2024-04-25T22:03:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779688+0000", 2024-04-25T22:03:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6324999999999999e-05 2024-04-25T22:03:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:265 3.1d 3:bf8dcf43:::200.00000008:head [write 3732680~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682617+0000", 2024-04-25T22:03:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.59439162700000003, 2024-04-25T22:03:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.097415482999999997, 2024-04-25T22:03:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682617+0000", 2024-04-25T22:03:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682617+0000", 2024-04-25T22:03:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682618+0000", 2024-04-25T22:03:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:03:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682625+0000", 2024-04-25T22:03:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4059999999999999e-06 2024-04-25T22:03:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682643+0000", 2024-04-25T22:03:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7476e-05 2024-04-25T22:03:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682656+0000", 2024-04-25T22:03:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.311e-05 2024-04-25T22:03:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.774784+0000", 2024-04-25T22:03:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.092128053000000001 2024-04-25T22:03:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.774912+0000", 2024-04-25T22:03:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012798099999999999 2024-04-25T22:03:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.775095+0000", 2024-04-25T22:03:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000182607 2024-04-25T22:03:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779418+0000", 2024-04-25T22:03:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043234390000000001 2024-04-25T22:03:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779841+0000", 2024-04-25T22:03:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042321999999999998 2024-04-25T22:03:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779937+0000", 2024-04-25T22:03:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5402000000000006e-05 2024-04-25T22:03:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.780032+0000", 2024-04-25T22:03:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5564999999999997e-05 2024-04-25T22:03:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:266 3.1d 3:bf8dcf43:::200.00000008:head [write 3734079~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682671+0000", 2024-04-25T22:03:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.59433698400000001, 2024-04-25T22:03:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.100589284, 2024-04-25T22:03:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682671+0000", 2024-04-25T22:03:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682671+0000", 2024-04-25T22:03:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682672+0000", 2024-04-25T22:03:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:03:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682687+0000", 2024-04-25T22:03:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.418e-05 2024-04-25T22:03:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682704+0000", 2024-04-25T22:03:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7139e-05 2024-04-25T22:03:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682719+0000", 2024-04-25T22:03:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4776999999999999e-05 2024-04-25T22:03:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.776110+0000", 2024-04-25T22:03:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093391199999999994 2024-04-25T22:03:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.776237+0000", 2024-04-25T22:03:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012748800000000001 2024-04-25T22:03:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.776502+0000", 2024-04-25T22:03:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026474300000000001 2024-04-25T22:03:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.780083+0000", 2024-04-25T22:03:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035809190000000001 2024-04-25T22:03:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.783012+0000", 2024-04-25T22:03:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029288790000000001 2024-04-25T22:03:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.783173+0000", 2024-04-25T22:03:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016134799999999999 2024-04-25T22:03:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.783261+0000", 2024-04-25T22:03:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7558000000000004e-05 2024-04-25T22:03:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:281 3.1d 3:bf8dcf43:::200.00000008:head [write 3787969~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.716485+0000", 2024-04-25T22:03:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.56052336899999999, 2024-04-25T22:03:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.092100435999999994, 2024-04-25T22:03:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.716485+0000", 2024-04-25T22:03:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.716485+0000", 2024-04-25T22:03:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.716487+0000", 2024-04-25T22:03:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.57e-06 2024-04-25T22:03:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.716496+0000", 2024-04-25T22:03:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5899999999999997e-06 2024-04-25T22:03:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.716522+0000", 2024-04-25T22:03:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5443e-05 2024-04-25T22:03:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.716538+0000", 2024-04-25T22:03:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6345999999999999e-05 2024-04-25T22:03:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.801998+0000", 2024-04-25T22:03:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085460227 2024-04-25T22:03:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.802119+0000", 2024-04-25T22:03:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121271 2024-04-25T22:03:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.802369+0000", 2024-04-25T22:03:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000249473 2024-04-25T22:03:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.805116+0000", 2024-04-25T22:03:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0027474349999999999 2024-04-25T22:03:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.808433+0000", 2024-04-25T22:03:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033163369999999999 2024-04-25T22:03:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.808518+0000", 2024-04-25T22:03:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4964999999999997e-05 2024-04-25T22:03:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.808585+0000", 2024-04-25T22:03:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7779000000000003e-05 2024-04-25T22:03:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:283 3.1d 3:bf8dcf43:::200.00000008:head [write 3794614~4930 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.720609+0000", 2024-04-25T22:03:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.55639918799999999, 2024-04-25T22:03:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.090193344999999994, 2024-04-25T22:03:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720609+0000", 2024-04-25T22:03:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720609+0000", 2024-04-25T22:03:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720611+0000", 2024-04-25T22:03:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.063e-06 2024-04-25T22:03:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720626+0000", 2024-04-25T22:03:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:03:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720649+0000", 2024-04-25T22:03:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3223000000000001e-05 2024-04-25T22:03:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720664+0000", 2024-04-25T22:03:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4826e-05 2024-04-25T22:03:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.805230+0000", 2024-04-25T22:03:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084565959999999996 2024-04-25T22:03:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.805349+0000", 2024-04-25T22:03:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000119098 2024-04-25T22:03:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.805598+0000", 2024-04-25T22:03:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024827699999999998 2024-04-25T22:03:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.808960+0000", 2024-04-25T22:03:10.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003361943 2024-04-25T22:03:10.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.810606+0000", 2024-04-25T22:03:10.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016467509999999999 2024-04-25T22:03:10.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.810701+0000", 2024-04-25T22:03:10.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4357999999999993e-05 2024-04-25T22:03:10.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.810803+0000", 2024-04-25T22:03:10.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010188600000000001 2024-04-25T22:03:10.395 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.395 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.395 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.395 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:284 3.1d 3:bf8dcf43:::200.00000008:head [write 3799544~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:10.395 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.720779+0000", 2024-04-25T22:03:10.396 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.55622935399999995, 2024-04-25T22:03:10.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093008417999999995, 2024-04-25T22:03:10.396 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.396 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.396 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.396 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720779+0000", 2024-04-25T22:03:10.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720779+0000", 2024-04-25T22:03:10.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720781+0000", 2024-04-25T22:03:10.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.547e-06 2024-04-25T22:03:10.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720790+0000", 2024-04-25T22:03:10.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6860000000000001e-06 2024-04-25T22:03:10.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720804+0000", 2024-04-25T22:03:10.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3997e-05 2024-04-25T22:03:10.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720818+0000", 2024-04-25T22:03:10.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3550000000000001e-05 2024-04-25T22:03:10.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.806993+0000", 2024-04-25T22:03:10.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.086174915000000005 2024-04-25T22:03:10.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.807196+0000", 2024-04-25T22:03:10.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020306999999999999 2024-04-25T22:03:10.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.807425+0000", 2024-04-25T22:03:10.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00022923400000000001 2024-04-25T22:03:10.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.810916+0000", 2024-04-25T22:03:10.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034910700000000002 2024-04-25T22:03:10.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.813593+0000", 2024-04-25T22:03:10.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0026773420000000001 2024-04-25T22:03:10.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.813691+0000", 2024-04-25T22:03:10.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7071999999999995e-05 2024-04-25T22:03:10.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.813787+0000", 2024-04-25T22:03:10.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6935000000000006e-05 2024-04-25T22:03:10.403 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.403 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.403 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.403 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:285 3.1d 3:bf8dcf43:::200.00000008:head [write 3802501~5840 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-25T22:03:10.403 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.726839+0000", 2024-04-25T22:03:10.404 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.55016894999999999, 2024-04-25T22:03:10.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.092249908000000005, 2024-04-25T22:03:10.404 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.404 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.404 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.404 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.726839+0000", 2024-04-25T22:03:10.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.726839+0000", 2024-04-25T22:03:10.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.726842+0000", 2024-04-25T22:03:10.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:10.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.726866+0000", 2024-04-25T22:03:10.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3697e-05 2024-04-25T22:03:10.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.726898+0000", 2024-04-25T22:03:10.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2645999999999999e-05 2024-04-25T22:03:10.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.726920+0000", 2024-04-25T22:03:10.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759999999999998e-05 2024-04-25T22:03:10.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.809050+0000", 2024-04-25T22:03:10.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082129949999999993 2024-04-25T22:03:10.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.809212+0000", 2024-04-25T22:03:10.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000162285 2024-04-25T22:03:10.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.809512+0000", 2024-04-25T22:03:10.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030005800000000002 2024-04-25T22:03:10.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.818674+0000", 2024-04-25T22:03:10.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0091618240000000007 2024-04-25T22:03:10.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.818950+0000", 2024-04-25T22:03:10.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027553000000000001 2024-04-25T22:03:10.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.819036+0000", 2024-04-25T22:03:10.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5999000000000001e-05 2024-04-25T22:03:10.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.819089+0000", 2024-04-25T22:03:10.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3538999999999997e-05 2024-04-25T22:03:10.409 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.410 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.410 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.410 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:286 3.1d 3:bf8dcf43:::200.00000008:head [write 3808341~18914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-25T22:03:10.410 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.732283+0000", 2024-04-25T22:03:10.410 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.54472557499999996, 2024-04-25T22:03:10.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089729922000000004, 2024-04-25T22:03:10.410 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:10.410 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:10.410 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.410 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:10.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:10.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.732283+0000", 2024-04-25T22:03:10.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:10.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.732283+0000", 2024-04-25T22:03:10.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:10.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:10.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.732285+0000", 2024-04-25T22:03:10.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0200000000000001e-06 2024-04-25T22:03:10.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:10.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.732314+0000", 2024-04-25T22:03:10.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:03:10.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:10.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.732337+0000", 2024-04-25T22:03:10.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3289e-05 2024-04-25T22:03:10.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.732351+0000", 2024-04-25T22:03:10.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3699999999999999e-05 2024-04-25T22:03:10.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:10.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.811038+0000", 2024-04-25T22:03:10.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078687282999999997 2024-04-25T22:03:10.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:10.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.811228+0000", 2024-04-25T22:03:10.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018993699999999999 2024-04-25T22:03:10.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.811583+0000", 2024-04-25T22:03:10.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035520099999999998 2024-04-25T22:03:10.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.818915+0000", 2024-04-25T22:03:10.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073315089999999999 2024-04-25T22:03:10.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:10.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.821876+0000", 2024-04-25T22:03:10.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029611590000000001 2024-04-25T22:03:10.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:10.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.821958+0000", 2024-04-25T22:03:10.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2515000000000005e-05 2024-04-25T22:03:10.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:10.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:10.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:10.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.822013+0000", 2024-04-25T22:03:10.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4486e-05 2024-04-25T22:03:10.416 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.416 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.416 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.416 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:10.417 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:10.417 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:10.418 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:10.419 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:10.412+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:10.519 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:10.512+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:10.554 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:10.555 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:10.555 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:03:10.555 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:10.569 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:10.620 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:10.616+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:10.688 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:10.688 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:10.688 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:03:10.688 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:03:10.688 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:10.703 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:10.721 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:10.716+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:10.728 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T22:03:10.752 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T22:03:10.822 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:10.820+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:10.839 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:10.839 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:10.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:10.839 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:10.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.839 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:10.839 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.749983503999999, 2024-04-25T22:03:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.739982740999999, 2024-04-25T22:03:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:10.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:10.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:10.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:10.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.735818467000001, 2024-04-25T22:03:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.734222150000001, 2024-04-25T22:03:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:24 4.b 4:d3eda40d:::1000000020f.00000000:head [write 0~1144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.118844+0000", 2024-04-25T22:03:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.716684297, 2024-04-25T22:03:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.089959257000000001, 2024-04-25T22:03:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 24 2024-04-25T22:03:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118844+0000", 2024-04-25T22:03:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118844+0000", 2024-04-25T22:03:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118846+0000", 2024-04-25T22:03:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8199999999999999e-06 2024-04-25T22:03:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118855+0000", 2024-04-25T22:03:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2930000000000006e-06 2024-04-25T22:03:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118879+0000", 2024-04-25T22:03:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3312999999999999e-05 2024-04-25T22:03:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118891+0000", 2024-04-25T22:03:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2136e-05 2024-04-25T22:03:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.118997+0000", 2024-04-25T22:03:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010655800000000001 2024-04-25T22:03:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.119214+0000", 2024-04-25T22:03:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021723099999999999 2024-04-25T22:03:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.119408+0000", 2024-04-25T22:03:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000193582 2024-04-25T22:03:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.121105+0000", 2024-04-25T22:03:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016972549999999999 2024-04-25T22:03:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208552+0000", 2024-04-25T22:03:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087447104999999997 2024-04-25T22:03:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208688+0000", 2024-04-25T22:03:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000135394 2024-04-25T22:03:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.208803+0000", 2024-04-25T22:03:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011557000000000001 2024-04-25T22:03:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.677435899999999, 2024-04-25T22:03:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:10.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:10.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:10.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:10.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:10.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:10.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.661791634, 2024-04-25T22:03:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.656952943, 2024-04-25T22:03:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.643635859, 2024-04-25T22:03:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.098402492999999994, 2024-04-25T22:03:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71 2024-04-25T22:03:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191895+0000", 2024-04-25T22:03:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0899999999999999e-06 2024-04-25T22:03:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191906+0000", 2024-04-25T22:03:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1508999999999999e-05 2024-04-25T22:03:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191937+0000", 2024-04-25T22:03:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0772999999999998e-05 2024-04-25T22:03:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191951+0000", 2024-04-25T22:03:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.437e-05 2024-04-25T22:03:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286217+0000", 2024-04-25T22:03:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.094265989999999994 2024-04-25T22:03:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286383+0000", 2024-04-25T22:03:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016591899999999999 2024-04-25T22:03:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286594+0000", 2024-04-25T22:03:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021108800000000001 2024-04-25T22:03:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.288518+0000", 2024-04-25T22:03:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001923391 2024-04-25T22:03:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290219+0000", 2024-04-25T22:03:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001701239 2024-04-25T22:03:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290266+0000", 2024-04-25T22:03:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6838000000000001e-05 2024-04-25T22:03:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290295+0000", 2024-04-25T22:03:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9286e-05 2024-04-25T22:03:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:172 3.1e 3:7bf7e7b5:::200.00000006:head [write 1088406~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.680942+0000", 2024-04-25T22:03:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.1545865610000003, 2024-04-25T22:03:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.091514501999999998, 2024-04-25T22:03:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680942+0000", 2024-04-25T22:03:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680942+0000", 2024-04-25T22:03:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680943+0000", 2024-04-25T22:03:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8999999999999996e-07 2024-04-25T22:03:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680947+0000", 2024-04-25T22:03:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0799999999999999e-06 2024-04-25T22:03:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680955+0000", 2024-04-25T22:03:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8899999999999996e-06 2024-04-25T22:03:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680962+0000", 2024-04-25T22:03:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9659999999999999e-06 2024-04-25T22:03:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.765238+0000", 2024-04-25T22:03:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.084275949000000003 2024-04-25T22:03:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.765380+0000", 2024-04-25T22:03:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014133700000000001 2024-04-25T22:03:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.765576+0000", 2024-04-25T22:03:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019578600000000001 2024-04-25T22:03:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.770419+0000", 2024-04-25T22:03:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0048431109999999998 2024-04-25T22:03:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772190+0000", 2024-04-25T22:03:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017712590000000001 2024-04-25T22:03:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772341+0000", 2024-04-25T22:03:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015073699999999999 2024-04-25T22:03:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772456+0000", 2024-04-25T22:03:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115697 2024-04-25T22:03:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:173 3.1e 3:7bf7e7b5:::200.00000006:head [write 1089806~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.680971+0000", 2024-04-25T22:03:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.1545571780000001, 2024-04-25T22:03:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.097357530999999997, 2024-04-25T22:03:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680971+0000", 2024-04-25T22:03:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680971+0000", 2024-04-25T22:03:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680972+0000", 2024-04-25T22:03:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5700000000000002e-07 2024-04-25T22:03:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680976+0000", 2024-04-25T22:03:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8859999999999997e-06 2024-04-25T22:03:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680986+0000", 2024-04-25T22:03:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0107e-05 2024-04-25T22:03:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680992+0000", 2024-04-25T22:03:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:03:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.766932+0000", 2024-04-25T22:03:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.085939606000000002 2024-04-25T22:03:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.767162+0000", 2024-04-25T22:03:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022967899999999999 2024-04-25T22:03:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.767539+0000", 2024-04-25T22:03:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037684900000000001 2024-04-25T22:03:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773588+0000", 2024-04-25T22:03:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060498979999999997 2024-04-25T22:03:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778047+0000", 2024-04-25T22:03:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044585950000000001 2024-04-25T22:03:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778191+0000", 2024-04-25T22:03:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000144277 2024-04-25T22:03:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778329+0000", 2024-04-25T22:03:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013736799999999999 2024-04-25T22:03:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:174 3.1e 3:7bf7e7b5:::200.00000006:head [write 1091205~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681001+0000", 2024-04-25T22:03:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.1545274860000001, 2024-04-25T22:03:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.097586939999999997, 2024-04-25T22:03:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681001+0000", 2024-04-25T22:03:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681001+0000", 2024-04-25T22:03:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681002+0000", 2024-04-25T22:03:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1699999999999997e-07 2024-04-25T22:03:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681011+0000", 2024-04-25T22:03:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4099999999999997e-06 2024-04-25T22:03:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681020+0000", 2024-04-25T22:03:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0929999999999992e-06 2024-04-25T22:03:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681027+0000", 2024-04-25T22:03:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2069999999999998e-06 2024-04-25T22:03:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.768885+0000", 2024-04-25T22:03:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087857947000000006 2024-04-25T22:03:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.769110+0000", 2024-04-25T22:03:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000224243 2024-04-25T22:03:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.769453+0000", 2024-04-25T22:03:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034366900000000001 2024-04-25T22:03:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.776545+0000", 2024-04-25T22:03:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070918179999999997 2024-04-25T22:03:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778351+0000", 2024-04-25T22:03:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001806457 2024-04-25T22:03:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778482+0000", 2024-04-25T22:03:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130538 2024-04-25T22:03:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778588+0000", 2024-04-25T22:03:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010584100000000001 2024-04-25T22:03:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:175 3.1e 3:7bf7e7b5:::200.00000006:head [write 1092606~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.1544917159999999, 2024-04-25T22:03:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.098895884000000003, 2024-04-25T22:03:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.37e-07 2024-04-25T22:03:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681042+0000", 2024-04-25T22:03:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.296e-06 2024-04-25T22:03:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681051+0000", 2024-04-25T22:03:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8729999999999996e-06 2024-04-25T22:03:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681058+0000", 2024-04-25T22:03:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1500000000000002e-06 2024-04-25T22:03:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.770531+0000", 2024-04-25T22:03:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.089473665999999993 2024-04-25T22:03:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.770765+0000", 2024-04-25T22:03:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023329899999999999 2024-04-25T22:03:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.771099+0000", 2024-04-25T22:03:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033428 2024-04-25T22:03:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778610+0000", 2024-04-25T22:03:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075115119999999997 2024-04-25T22:03:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779710+0000", 2024-04-25T22:03:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010997019999999999 2024-04-25T22:03:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779876+0000", 2024-04-25T22:03:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016592000000000001 2024-04-25T22:03:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779933+0000", 2024-04-25T22:03:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6449000000000001e-05 2024-04-25T22:03:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:176 3.1e 3:7bf7e7b5:::200.00000006:head [write 1094003~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681066+0000", 2024-04-25T22:03:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.1544620830000003, 2024-04-25T22:03:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099284439000000002, 2024-04-25T22:03:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681066+0000", 2024-04-25T22:03:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681066+0000", 2024-04-25T22:03:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681067+0000", 2024-04-25T22:03:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3e-07 2024-04-25T22:03:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681076+0000", 2024-04-25T22:03:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3659999999999998e-06 2024-04-25T22:03:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681087+0000", 2024-04-25T22:03:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0763e-05 2024-04-25T22:03:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681095+0000", 2024-04-25T22:03:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3599999999999998e-06 2024-04-25T22:03:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772564+0000", 2024-04-25T22:03:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.091469049999999996 2024-04-25T22:03:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772701+0000", 2024-04-25T22:03:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013743100000000001 2024-04-25T22:03:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772901+0000", 2024-04-25T22:03:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019971600000000001 2024-04-25T22:03:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778627+0000", 2024-04-25T22:03:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057267170000000001 2024-04-25T22:03:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780116+0000", 2024-04-25T22:03:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001488294 2024-04-25T22:03:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780282+0000", 2024-04-25T22:03:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016584999999999999 2024-04-25T22:03:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780351+0000", 2024-04-25T22:03:10.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9162e-05 2024-04-25T22:03:10.919 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.919 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.919 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.919 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:177 3.1e 3:7bf7e7b5:::200.00000006:head [write 1095406~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:10.919 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:10.919 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.1544247409999997, 2024-04-25T22:03:10.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099467149000000005, 2024-04-25T22:03:10.919 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.919 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.919 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:03:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681108+0000", 2024-04-25T22:03:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0439999999999997e-06 2024-04-25T22:03:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681117+0000", 2024-04-25T22:03:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7499999999999992e-06 2024-04-25T22:03:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681124+0000", 2024-04-25T22:03:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9099999999999999e-06 2024-04-25T22:03:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773690+0000", 2024-04-25T22:03:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.092565760999999996 2024-04-25T22:03:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773817+0000", 2024-04-25T22:03:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012704799999999999 2024-04-25T22:03:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773999+0000", 2024-04-25T22:03:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018202 2024-04-25T22:03:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778647+0000", 2024-04-25T22:03:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046479049999999999 2024-04-25T22:03:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780446+0000", 2024-04-25T22:03:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017990739999999999 2024-04-25T22:03:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780519+0000", 2024-04-25T22:03:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3205000000000001e-05 2024-04-25T22:03:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780571+0000", 2024-04-25T22:03:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1638999999999998e-05 2024-04-25T22:03:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:178 3.1e 3:7bf7e7b5:::200.00000006:head [write 1096809~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681133+0000", 2024-04-25T22:03:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.154395461, 2024-04-25T22:03:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099654375000000003, 2024-04-25T22:03:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681133+0000", 2024-04-25T22:03:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681133+0000", 2024-04-25T22:03:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681134+0000", 2024-04-25T22:03:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2699999999999999e-07 2024-04-25T22:03:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681139+0000", 2024-04-25T22:03:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.276e-06 2024-04-25T22:03:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681148+0000", 2024-04-25T22:03:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8130000000000002e-06 2024-04-25T22:03:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681155+0000", 2024-04-25T22:03:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0859999999999996e-06 2024-04-25T22:03:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.774610+0000", 2024-04-25T22:03:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.093455287999999997 2024-04-25T22:03:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.774856+0000", 2024-04-25T22:03:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000245772 2024-04-25T22:03:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.775244+0000", 2024-04-25T22:03:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038779599999999998 2024-04-25T22:03:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779955+0000", 2024-04-25T22:03:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047115910000000002 2024-04-25T22:03:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780656+0000", 2024-04-25T22:03:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070111200000000005 2024-04-25T22:03:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780733+0000", 2024-04-25T22:03:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6601999999999996e-05 2024-04-25T22:03:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780787+0000", 2024-04-25T22:03:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4311999999999998e-05 2024-04-25T22:03:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:179 3.1e 3:7bf7e7b5:::200.00000006:head [write 1098209~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681170+0000", 2024-04-25T22:03:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.1543587049999999, 2024-04-25T22:03:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099820701999999997, 2024-04-25T22:03:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681170+0000", 2024-04-25T22:03:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681170+0000", 2024-04-25T22:03:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681171+0000", 2024-04-25T22:03:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4e-07 2024-04-25T22:03:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681175+0000", 2024-04-25T22:03:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7330000000000003e-06 2024-04-25T22:03:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681185+0000", 2024-04-25T22:03:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2730000000000008e-06 2024-04-25T22:03:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681192+0000", 2024-04-25T22:03:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3000000000000004e-06 2024-04-25T22:03:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.776664+0000", 2024-04-25T22:03:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095471850999999996 2024-04-25T22:03:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.776895+0000", 2024-04-25T22:03:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023155199999999999 2024-04-25T22:03:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.777244+0000", 2024-04-25T22:03:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034912300000000001 2024-04-25T22:03:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779962+0000", 2024-04-25T22:03:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027177870000000002 2024-04-25T22:03:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780870+0000", 2024-04-25T22:03:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090743499999999995 2024-04-25T22:03:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780939+0000", 2024-04-25T22:03:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9678999999999995e-05 2024-04-25T22:03:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780990+0000", 2024-04-25T22:03:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1128999999999998e-05 2024-04-25T22:03:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:180 3.1e 3:7bf7e7b5:::200.00000006:head [write 1099615~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681201+0000", 2024-04-25T22:03:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.154327189, 2024-04-25T22:03:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.100014121, 2024-04-25T22:03:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681201+0000", 2024-04-25T22:03:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681201+0000", 2024-04-25T22:03:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681202+0000", 2024-04-25T22:03:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2600000000000001e-07 2024-04-25T22:03:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681206+0000", 2024-04-25T22:03:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7799999999999998e-06 2024-04-25T22:03:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681215+0000", 2024-04-25T22:03:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7630000000000006e-06 2024-04-25T22:03:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681222+0000", 2024-04-25T22:03:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0740000000000004e-06 2024-04-25T22:03:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778720+0000", 2024-04-25T22:03:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.097498243999999998 2024-04-25T22:03:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778839+0000", 2024-04-25T22:03:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011882799999999999 2024-04-25T22:03:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779028+0000", 2024-04-25T22:03:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018962300000000001 2024-04-25T22:03:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781006+0000", 2024-04-25T22:03:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019778640000000002 2024-04-25T22:03:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781093+0000", 2024-04-25T22:03:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6802e-05 2024-04-25T22:03:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781164+0000", 2024-04-25T22:03:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0925000000000003e-05 2024-04-25T22:03:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781215+0000", 2024-04-25T22:03:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1391999999999999e-05 2024-04-25T22:03:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:6847 4.16 4.8bfe6e16 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-25T22:03:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.686897+0000", 2024-04-25T22:03:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.1486315779999998, 2024-04-25T22:03:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.094186503000000005, 2024-04-25T22:03:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:03:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6847 2024-04-25T22:03:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686897+0000", 2024-04-25T22:03:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686897+0000", 2024-04-25T22:03:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686903+0000", 2024-04-25T22:03:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9599999999999997e-06 2024-04-25T22:03:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686920+0000", 2024-04-25T22:03:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7102999999999999e-05 2024-04-25T22:03:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686939+0000", 2024-04-25T22:03:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.912e-05 2024-04-25T22:03:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686953+0000", 2024-04-25T22:03:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4062e-05 2024-04-25T22:03:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781065+0000", 2024-04-25T22:03:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.094112332000000007 2024-04-25T22:03:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781083+0000", 2024-04-25T22:03:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7926000000000001e-05 2024-04-25T22:03:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:181 3.1e 3:7bf7e7b5:::200.00000006:head [write 1101018~34350 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.698668+0000", 2024-04-25T22:03:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.1368601600000003, 2024-04-25T22:03:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.090130145999999994, 2024-04-25T22:03:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.698668+0000", 2024-04-25T22:03:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.698668+0000", 2024-04-25T22:03:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.698671+0000", 2024-04-25T22:03:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6699999999999998e-06 2024-04-25T22:03:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.698721+0000", 2024-04-25T22:03:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9975000000000002e-05 2024-04-25T22:03:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.698752+0000", 2024-04-25T22:03:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0997000000000002e-05 2024-04-25T22:03:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.698773+0000", 2024-04-25T22:03:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0738999999999999e-05 2024-04-25T22:03:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.782382+0000", 2024-04-25T22:03:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.083609601000000006 2024-04-25T22:03:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.782516+0000", 2024-04-25T22:03:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013397100000000001 2024-04-25T22:03:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.782694+0000", 2024-04-25T22:03:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017751999999999999 2024-04-25T22:03:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.785933+0000", 2024-04-25T22:03:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032390320000000002 2024-04-25T22:03:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.788637+0000", 2024-04-25T22:03:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002704297 2024-04-25T22:03:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.788729+0000", 2024-04-25T22:03:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2151999999999995e-05 2024-04-25T22:03:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.788798+0000", 2024-04-25T22:03:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9191999999999998e-05 2024-04-25T22:03:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.949 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:10.949 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:10.949 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:10.949 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:03:10.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:10.952 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:10.944+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:11.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:11.049+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:11.084 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:03:11.084 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:11.096 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:11.096 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:11.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:11.118 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:11.119 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:11.141 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:11.141 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:11.153 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:11.148+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:11.231 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:11.231 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:11.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:11.254 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:11.252+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:11.354 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:11.348+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:11.377 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:11.377 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:11.393 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:11.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:11.453+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:11.543 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:11.543 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:11.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:11.553+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:11.559 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:11.658 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:11.652+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:11.691 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:11.691 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:11.710 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:11.729 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T22:03:11.749 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T22:03:11.759 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:11.752+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:11.842 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:03:11.849 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:11.850 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:11.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:11.857+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:11.865 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:11.960 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:11.952+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:12.001 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:12.001 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:12.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:12.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:12.061+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:12.149 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:12.149 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:12.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:12.157+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:12.165 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:12.261 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:12.257+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:12.354 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:12.355 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:12.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:12.357+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:12.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:12.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:12.457+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:12.506 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:12.506 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:12.521 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:12.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:12.561+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:12.643 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:12.643 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:12.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:12.664 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:12.660+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:12.742 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T22:03:12.742 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-25T22:03:12.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:12.761+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:12.781 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T22:03:12.781 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:03:12.785 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:12.785 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:12.801 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:12.865 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:12.864+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:12.945 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:12.946 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:12.960 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:12.967 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:12.965+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:13.029 INFO:tasks.workunit.client.0.smithi044.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-25T22:03:13.033 INFO:tasks.workunit.client.0.smithi044.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T22:03:13.033 INFO:tasks.workunit.client.0.smithi044.stderr:+ make 2024-04-25T22:03:13.068 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:13.060+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:13.097 INFO:tasks.workunit.client.0.smithi044.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-25T22:03:13.117 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:03:13.119 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:03:13.129 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:13.129 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:13.134 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2024-04-25T22:03:12.737075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":80548716,"num_objects":8294,"num_object_clones":0,"num_object_copies":16588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8294,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":8700,"num_write_kb":86775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8626,"ondisk_log_size":8626,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":220060,"kb_used_data":114040,"kb_used_omap":4,"kb_used_meta":105979,"kb_avail":282895460,"statfs":{"total":289910292480,"available":289684951040,"internally_reserved":0,"allocated":116776960,"data_stored":161399681,"data_compressed":13241488,"data_compressed_allocated":18964480,"data_compressed_original":103292928,"omap_allocated":4785,"internal_metadata":108522831},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22392621,"num_objects":2096,"num_object_clones":0,"num_object_copies":4192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2096,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2169,"num_write_kb":23273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.145232"},"pg_stats":[{"pgid":"4.3f","version":"60'134","reported_seq":166,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.413407+0000","last_change":"2024-04-25T22:02:49.882976+0000","last_active":"2024-04-25T22:03:08.413407+0000","last_peered":"2024-04-25T22:03:08.413407+0000","last_clean":"2024-04-25T22:03:08.413407+0000","last_became_active":"2024-04-25T22:02:49.882308+0000","last_became_peered":"2024-04-25T22:02:49.882308+0000","last_unstale":"2024-04-25T22:03:08.413407+0000","last_undegraded":"2024-04-25T22:03:08.413407+0000","last_fullsized":"2024-04-25T22:03:08.413407+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:46.257798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":738940,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"60'119","reported_seq":151,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.509087+0000","last_change":"2024-04-25T22:02:49.882947+0000","last_active":"2024-04-25T22:03:08.509087+0000","last_peered":"2024-04-25T22:03:08.509087+0000","last_clean":"2024-04-25T22:03:08.509087+0000","last_became_active":"2024-04-25T22:02:49.882192+0000","last_became_peered":"2024-04-25T22:02:49.882192+0000","last_unstale":"2024-04-25T22:03:08.509087+0000","last_undegraded":"2024-04-25T22:03:08.509087+0000","last_fullsized":"2024-04-25T22:03:08.509087+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:07.474272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449721,"num_objects":119,"num_object_clones":0,"num_object_copies":238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"60'116","reported_seq":210,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:07.480831+0000","last_change":"2024-04-25T22:02:49.886973+0000","last_active":"2024-04-25T22:03:07.480831+0000","last_peered":"2024-04-25T22:03:07.480831+0000","last_clean":"2024-04-25T22:03:07.480831+0000","last_became_active":"2024-04-25T22:02:49.884097+0000","last_became_peered":"2024-04-25T22:02:49.884097+0000","last_unstale":"2024-04-25T22:03:07.480831+0000","last_undegraded":"2024-04-25T22:03:07.480831+0000","last_fullsized":"2024-04-25T22:03:07.480831+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655772,"num_objects":116,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'113","reported_seq":208,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.323368+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:03:08.323368+0000","last_peered":"2024-04-25T22:03:08.323368+0000","last_clean":"2024-04-25T22:03:08.323368+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:03:08.323368+0000","last_undegraded":"2024-04-25T22:03:08.323368+0000","last_fullsized":"2024-04-25T22:03:08.323368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":878778,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'142","reported_seq":174,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.289890+0000","last_change":"2024-04-25T22:02:49.879514+0000","last_active":"2024-04-25T22:03:08.289890+0000","last_peered":"2024-04-25T22:03:08.289890+0000","last_clean":"2024-04-25T22:03:08.289890+0000","last_became_active":"2024-04-25T22:02:49.878964+0000","last_became_peered":"2024-04-25T22:02:49.878964+0000","last_unstale":"2024-04-25T22:03:08.289890+0000","last_undegraded":"2024-04-25T22:03:08.289890+0000","last_fullsized":"2024-04-25T22:03:08.289890+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.432134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":607385,"num_objects":142,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"60'127","reported_seq":222,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.328905+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:03:08.328905+0000","last_peered":"2024-04-25T22:03:08.328905+0000","last_clean":"2024-04-25T22:03:08.328905+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:03:08.328905+0000","last_undegraded":"2024-04-25T22:03:08.328905+0000","last_fullsized":"2024-04-25T22:03:08.328905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815104,"num_objects":127,"num_object_clones":0,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'143","reported_seq":238,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.438493+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:03:08.438493+0000","last_peered":"2024-04-25T22:03:08.438493+0000","last_clean":"2024-04-25T22:03:08.438493+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:03:08.438493+0000","last_undegraded":"2024-04-25T22:03:08.438493+0000","last_fullsized":"2024-04-25T22:03:08.438493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549692,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'111","reported_seq":206,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:07.940704+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:03:07.940704+0000","last_peered":"2024-04-25T22:03:07.940704+0000","last_clean":"2024-04-25T22:03:07.940704+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:03:07.940704+0000","last_undegraded":"2024-04-25T22:03:07.940704+0000","last_fullsized":"2024-04-25T22:03:07.940704+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1111886,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":1143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'134","reported_seq":230,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.251613+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:03:08.251613+0000","last_peered":"2024-04-25T22:03:08.251613+0000","last_clean":"2024-04-25T22:03:08.251613+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:03:08.251613+0000","last_undegraded":"2024-04-25T22:03:08.251613+0000","last_fullsized":"2024-04-25T22:03:08.251613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628604,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'121","reported_seq":153,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.012066+0000","last_change":"2024-04-25T22:02:49.885137+0000","last_active":"2024-04-25T22:03:08.012066+0000","last_peered":"2024-04-25T22:03:08.012066+0000","last_clean":"2024-04-25T22:03:08.012066+0000","last_became_active":"2024-04-25T22:02:49.884276+0000","last_became_peered":"2024-04-25T22:02:49.884276+0000","last_unstale":"2024-04-25T22:03:08.012066+0000","last_undegraded":"2024-04-25T22:03:08.012066+0000","last_fullsized":"2024-04-25T22:03:08.012066+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:12.408801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":488187,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"60'119","reported_seq":214,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.460580+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:03:08.460580+0000","last_peered":"2024-04-25T22:03:08.460580+0000","last_clean":"2024-04-25T22:03:08.460580+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:03:08.460580+0000","last_undegraded":"2024-04-25T22:03:08.460580+0000","last_fullsized":"2024-04-25T22:03:08.460580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424574,"num_objects":119,"num_object_clones":0,"num_object_copies":238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'115","reported_seq":211,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.135933+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:03:08.135933+0000","last_peered":"2024-04-25T22:03:08.135933+0000","last_clean":"2024-04-25T22:03:08.135933+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:03:08.135933+0000","last_undegraded":"2024-04-25T22:03:08.135933+0000","last_fullsized":"2024-04-25T22:03:08.135933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333898,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'124","reported_seq":156,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:07.523446+0000","last_change":"2024-04-25T22:02:49.878698+0000","last_active":"2024-04-25T22:03:07.523446+0000","last_peered":"2024-04-25T22:03:07.523446+0000","last_clean":"2024-04-25T22:03:07.523446+0000","last_became_active":"2024-04-25T22:02:49.878377+0000","last_became_peered":"2024-04-25T22:02:49.878377+0000","last_unstale":"2024-04-25T22:03:07.523446+0000","last_undegraded":"2024-04-25T22:03:07.523446+0000","last_fullsized":"2024-04-25T22:03:07.523446+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:31:39.262571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407131,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"60'129","reported_seq":224,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.133655+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:03:08.133655+0000","last_peered":"2024-04-25T22:03:08.133655+0000","last_clean":"2024-04-25T22:03:08.133655+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:03:08.133655+0000","last_undegraded":"2024-04-25T22:03:08.133655+0000","last_fullsized":"2024-04-25T22:03:08.133655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4921605,"num_objects":128,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":4873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'128","reported_seq":223,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.275977+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:03:08.275977+0000","last_peered":"2024-04-25T22:03:08.275977+0000","last_clean":"2024-04-25T22:03:08.275977+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:03:08.275977+0000","last_undegraded":"2024-04-25T22:03:08.275977+0000","last_fullsized":"2024-04-25T22:03:08.275977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408108,"num_objects":128,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'147","reported_seq":242,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.051379+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:03:08.051379+0000","last_peered":"2024-04-25T22:03:08.051379+0000","last_clean":"2024-04-25T22:03:08.051379+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:03:08.051379+0000","last_undegraded":"2024-04-25T22:03:08.051379+0000","last_fullsized":"2024-04-25T22:03:08.051379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":619516,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'134","reported_seq":230,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.435681+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:03:08.435681+0000","last_peered":"2024-04-25T22:03:08.435681+0000","last_clean":"2024-04-25T22:03:08.435681+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:03:08.435681+0000","last_undegraded":"2024-04-25T22:03:08.435681+0000","last_fullsized":"2024-04-25T22:03:08.435681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":858626,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'127","reported_seq":159,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.544096+0000","last_change":"2024-04-25T22:02:49.885489+0000","last_active":"2024-04-25T22:03:08.544096+0000","last_peered":"2024-04-25T22:03:08.544096+0000","last_clean":"2024-04-25T22:03:08.544096+0000","last_became_active":"2024-04-25T22:02:49.884784+0000","last_became_peered":"2024-04-25T22:02:49.884784+0000","last_unstale":"2024-04-25T22:03:08.544096+0000","last_undegraded":"2024-04-25T22:03:08.544096+0000","last_fullsized":"2024-04-25T22:03:08.544096+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":499727,"num_objects":127,"num_object_clones":0,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'120","reported_seq":216,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.293210+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:03:08.293210+0000","last_peered":"2024-04-25T22:03:08.293210+0000","last_clean":"2024-04-25T22:03:08.293210+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:03:08.293210+0000","last_undegraded":"2024-04-25T22:03:08.293210+0000","last_fullsized":"2024-04-25T22:03:08.293210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437118,"num_objects":120,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'139","reported_seq":234,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:07.645735+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:03:07.645735+0000","last_peered":"2024-04-25T22:03:07.645735+0000","last_clean":"2024-04-25T22:03:07.645735+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:03:07.645735+0000","last_undegraded":"2024-04-25T22:03:07.645735+0000","last_fullsized":"2024-04-25T22:03:07.645735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591686,"num_objects":139,"num_object_clones":0,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'124","reported_seq":219,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.469908+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:03:08.469908+0000","last_peered":"2024-04-25T22:03:08.469908+0000","last_clean":"2024-04-25T22:03:08.469908+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:03:08.469908+0000","last_undegraded":"2024-04-25T22:03:08.469908+0000","last_fullsized":"2024-04-25T22:03:08.469908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":545314,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'142","reported_seq":174,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.156914+0000","last_change":"2024-04-25T22:02:49.886169+0000","last_active":"2024-04-25T22:03:08.156914+0000","last_peered":"2024-04-25T22:03:08.156914+0000","last_clean":"2024-04-25T22:03:08.156914+0000","last_became_active":"2024-04-25T22:02:49.884516+0000","last_became_peered":"2024-04-25T22:02:49.884516+0000","last_unstale":"2024-04-25T22:03:08.156914+0000","last_undegraded":"2024-04-25T22:03:08.156914+0000","last_fullsized":"2024-04-25T22:03:08.156914+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:21.251127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624739,"num_objects":142,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"60'122","reported_seq":218,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.098982+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:03:08.098982+0000","last_peered":"2024-04-25T22:03:08.098982+0000","last_clean":"2024-04-25T22:03:08.098982+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:03:08.098982+0000","last_undegraded":"2024-04-25T22:03:08.098982+0000","last_fullsized":"2024-04-25T22:03:08.098982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":932585,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'138","reported_seq":170,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.490909+0000","last_change":"2024-04-25T22:02:49.876986+0000","last_active":"2024-04-25T22:03:08.490909+0000","last_peered":"2024-04-25T22:03:08.490909+0000","last_clean":"2024-04-25T22:03:08.490909+0000","last_became_active":"2024-04-25T22:02:49.876269+0000","last_became_peered":"2024-04-25T22:02:49.876269+0000","last_unstale":"2024-04-25T22:03:08.490909+0000","last_undegraded":"2024-04-25T22:03:08.490909+0000","last_fullsized":"2024-04-25T22:03:08.490909+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:35:35.547810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630606,"num_objects":138,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"60'138","reported_seq":170,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.409390+0000","last_change":"2024-04-25T22:02:49.881388+0000","last_active":"2024-04-25T22:03:08.409390+0000","last_peered":"2024-04-25T22:03:08.409390+0000","last_clean":"2024-04-25T22:03:08.409390+0000","last_became_active":"2024-04-25T22:02:49.880527+0000","last_became_peered":"2024-04-25T22:02:49.880527+0000","last_unstale":"2024-04-25T22:03:08.409390+0000","last_undegraded":"2024-04-25T22:03:08.409390+0000","last_fullsized":"2024-04-25T22:03:08.409390+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418047,"num_objects":138,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"60'147","reported_seq":243,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.217961+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:03:08.217961+0000","last_peered":"2024-04-25T22:03:08.217961+0000","last_clean":"2024-04-25T22:03:08.217961+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:03:08.217961+0000","last_undegraded":"2024-04-25T22:03:08.217961+0000","last_fullsized":"2024-04-25T22:03:08.217961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":673112,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'123","reported_seq":218,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.486029+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:03:08.486029+0000","last_peered":"2024-04-25T22:03:08.486029+0000","last_clean":"2024-04-25T22:03:08.486029+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:03:08.486029+0000","last_undegraded":"2024-04-25T22:03:08.486029+0000","last_fullsized":"2024-04-25T22:03:08.486029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714748,"num_objects":123,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"60'116","reported_seq":212,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.347810+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:03:08.347810+0000","last_peered":"2024-04-25T22:03:08.347810+0000","last_clean":"2024-04-25T22:03:08.347810+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:03:08.347810+0000","last_undegraded":"2024-04-25T22:03:08.347810+0000","last_fullsized":"2024-04-25T22:03:08.347810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576319,"num_objects":116,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'120","reported_seq":216,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:07.753305+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:03:07.753305+0000","last_peered":"2024-04-25T22:03:07.753305+0000","last_clean":"2024-04-25T22:03:07.753305+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:03:07.753305+0000","last_undegraded":"2024-04-25T22:03:07.753305+0000","last_fullsized":"2024-04-25T22:03:07.753305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":608384,"num_objects":120,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'138","reported_seq":170,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.337284+0000","last_change":"2024-04-25T22:02:49.885001+0000","last_active":"2024-04-25T22:03:08.337284+0000","last_peered":"2024-04-25T22:03:08.337284+0000","last_clean":"2024-04-25T22:03:08.337284+0000","last_became_active":"2024-04-25T22:02:49.883649+0000","last_became_peered":"2024-04-25T22:02:49.883649+0000","last_unstale":"2024-04-25T22:03:08.337284+0000","last_undegraded":"2024-04-25T22:03:08.337284+0000","last_fullsized":"2024-04-25T22:03:08.337284+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:07.474272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":541097,"num_objects":138,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'142","reported_seq":238,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.445255+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:03:08.445255+0000","last_peered":"2024-04-25T22:03:08.445255+0000","last_clean":"2024-04-25T22:03:08.445255+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:03:08.445255+0000","last_undegraded":"2024-04-25T22:03:08.445255+0000","last_fullsized":"2024-04-25T22:03:08.445255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":807418,"num_objects":142,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"60'144","reported_seq":182,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.064005+0000","last_change":"2024-04-25T22:02:43.850984+0000","last_active":"2024-04-25T22:03:08.064005+0000","last_peered":"2024-04-25T22:03:08.064005+0000","last_clean":"2024-04-25T22:03:08.064005+0000","last_became_active":"2024-04-25T22:02:43.850651+0000","last_became_peered":"2024-04-25T22:02:43.850651+0000","last_unstale":"2024-04-25T22:03:08.064005+0000","last_undegraded":"2024-04-25T22:03:08.064005+0000","last_fullsized":"2024-04-25T22:03:08.064005+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:08.019453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2131730,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":2160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"60'122","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.506009+0000","last_change":"2024-04-25T22:02:49.881928+0000","last_active":"2024-04-25T22:03:08.506009+0000","last_peered":"2024-04-25T22:03:08.506009+0000","last_clean":"2024-04-25T22:03:08.506009+0000","last_became_active":"2024-04-25T22:02:49.881638+0000","last_became_peered":"2024-04-25T22:02:49.881638+0000","last_unstale":"2024-04-25T22:03:08.506009+0000","last_undegraded":"2024-04-25T22:03:08.506009+0000","last_fullsized":"2024-04-25T22:03:08.506009+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:53:47.483774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":518122,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"60'4","reported_seq":101,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.696035+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:03:06.696035+0000","last_peered":"2024-04-25T22:03:06.696035+0000","last_clean":"2024-04-25T22:03:06.696035+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:03:06.696035+0000","last_undegraded":"2024-04-25T22:03:06.696035+0000","last_fullsized":"2024-04-25T22:03:06.696035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"60'113","reported_seq":145,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.299591+0000","last_change":"2024-04-25T22:02:49.882694+0000","last_active":"2024-04-25T22:03:08.299591+0000","last_peered":"2024-04-25T22:03:08.299591+0000","last_clean":"2024-04-25T22:03:08.299591+0000","last_became_active":"2024-04-25T22:02:49.882085+0000","last_became_peered":"2024-04-25T22:02:49.882085+0000","last_unstale":"2024-04-25T22:03:08.299591+0000","last_undegraded":"2024-04-25T22:03:08.299591+0000","last_fullsized":"2024-04-25T22:03:08.299591+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:56.743509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411864,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":98,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.706957+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:03:06.706957+0000","last_peered":"2024-04-25T22:03:06.706957+0000","last_clean":"2024-04-25T22:03:06.706957+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:03:06.706957+0000","last_undegraded":"2024-04-25T22:03:06.706957+0000","last_fullsized":"2024-04-25T22:03:06.706957+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"60'137","reported_seq":238,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.095481+0000","last_change":"2024-04-25T22:03:05.707184+0000","last_active":"2024-04-25T22:03:08.095481+0000","last_peered":"2024-04-25T22:03:08.095481+0000","last_clean":"2024-04-25T22:03:08.095481+0000","last_became_active":"2024-04-25T22:03:05.704710+0000","last_became_peered":"2024-04-25T22:03:05.704710+0000","last_unstale":"2024-04-25T22:03:08.095481+0000","last_undegraded":"2024-04-25T22:03:08.095481+0000","last_fullsized":"2024-04-25T22:03:08.095481+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:53.632923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553024,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":31,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.695653+0000","last_change":"2024-04-25T22:02:49.881219+0000","last_active":"2024-04-25T22:03:06.695653+0000","last_peered":"2024-04-25T22:03:06.695653+0000","last_clean":"2024-04-25T22:03:06.695653+0000","last_became_active":"2024-04-25T22:02:49.880475+0000","last_became_peered":"2024-04-25T22:02:49.880475+0000","last_unstale":"2024-04-25T22:03:06.695653+0000","last_undegraded":"2024-04-25T22:03:06.695653+0000","last_fullsized":"2024-04-25T22:03:06.695653+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:49.944264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'122","reported_seq":218,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.546934+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:03:08.546934+0000","last_peered":"2024-04-25T22:03:08.546934+0000","last_clean":"2024-04-25T22:03:08.546934+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:03:08.546934+0000","last_undegraded":"2024-04-25T22:03:08.546934+0000","last_fullsized":"2024-04-25T22:03:08.546934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":596470,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":105,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.695490+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:03:06.695490+0000","last_peered":"2024-04-25T22:03:06.695490+0000","last_clean":"2024-04-25T22:03:06.695490+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:03:06.695490+0000","last_undegraded":"2024-04-25T22:03:06.695490+0000","last_fullsized":"2024-04-25T22:03:06.695490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":98,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.697073+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:03:06.697073+0000","last_peered":"2024-04-25T22:03:06.697073+0000","last_clean":"2024-04-25T22:03:06.697073+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:03:06.697073+0000","last_undegraded":"2024-04-25T22:03:06.697073+0000","last_fullsized":"2024-04-25T22:03:06.697073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'133","reported_seq":165,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.200811+0000","last_change":"2024-04-25T22:02:49.881394+0000","last_active":"2024-04-25T22:03:08.200811+0000","last_peered":"2024-04-25T22:03:08.200811+0000","last_clean":"2024-04-25T22:03:08.200811+0000","last_became_active":"2024-04-25T22:02:49.880690+0000","last_became_peered":"2024-04-25T22:02:49.880690+0000","last_unstale":"2024-04-25T22:03:08.200811+0000","last_undegraded":"2024-04-25T22:03:08.200811+0000","last_fullsized":"2024-04-25T22:03:08.200811+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:31:39.262571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666906,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":42,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.696835+0000","last_change":"2024-04-25T22:02:49.884340+0000","last_active":"2024-04-25T22:03:06.696835+0000","last_peered":"2024-04-25T22:03:06.696835+0000","last_clean":"2024-04-25T22:03:06.696835+0000","last_became_active":"2024-04-25T22:02:49.883397+0000","last_became_peered":"2024-04-25T22:02:49.883397+0000","last_unstale":"2024-04-25T22:03:06.696835+0000","last_undegraded":"2024-04-25T22:03:06.696835+0000","last_fullsized":"2024-04-25T22:03:06.696835+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:55.740324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"60'148","reported_seq":180,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.248451+0000","last_change":"2024-04-25T22:02:49.877784+0000","last_active":"2024-04-25T22:03:08.248451+0000","last_peered":"2024-04-25T22:03:08.248451+0000","last_clean":"2024-04-25T22:03:08.248451+0000","last_became_active":"2024-04-25T22:02:49.876644+0000","last_became_peered":"2024-04-25T22:02:49.876644+0000","last_unstale":"2024-04-25T22:03:08.248451+0000","last_undegraded":"2024-04-25T22:03:08.248451+0000","last_fullsized":"2024-04-25T22:03:08.248451+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:50.947449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388355,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":1431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":97,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.697381+0000","last_change":"2024-04-25T22:02:49.885084+0000","last_active":"2024-04-25T22:03:06.697381+0000","last_peered":"2024-04-25T22:03:06.697381+0000","last_clean":"2024-04-25T22:03:06.697381+0000","last_became_active":"2024-04-25T22:02:49.883048+0000","last_became_peered":"2024-04-25T22:02:49.883048+0000","last_unstale":"2024-04-25T22:03:06.697381+0000","last_undegraded":"2024-04-25T22:03:06.697381+0000","last_fullsized":"2024-04-25T22:03:06.697381+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:12.276434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'129","reported_seq":224,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.140303+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:03:08.140303+0000","last_peered":"2024-04-25T22:03:08.140303+0000","last_clean":"2024-04-25T22:03:08.140303+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:03:08.140303+0000","last_undegraded":"2024-04-25T22:03:08.140303+0000","last_fullsized":"2024-04-25T22:03:08.140303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":513655,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.706713+0000","last_change":"2024-04-25T22:02:43.853012+0000","last_active":"2024-04-25T22:03:06.706713+0000","last_peered":"2024-04-25T22:03:06.706713+0000","last_clean":"2024-04-25T22:03:06.706713+0000","last_became_active":"2024-04-25T22:02:43.852338+0000","last_became_peered":"2024-04-25T22:02:43.852338+0000","last_unstale":"2024-04-25T22:03:06.706713+0000","last_undegraded":"2024-04-25T22:03:06.706713+0000","last_fullsized":"2024-04-25T22:03:06.706713+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:07.951790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"60'136","reported_seq":232,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:07.320317+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:03:07.320317+0000","last_peered":"2024-04-25T22:03:07.320317+0000","last_clean":"2024-04-25T22:03:07.320317+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:03:07.320317+0000","last_undegraded":"2024-04-25T22:03:07.320317+0000","last_fullsized":"2024-04-25T22:03:07.320317+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476055,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"54'60","reported_seq":158,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.707891+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:03:06.707891+0000","last_peered":"2024-04-25T22:03:06.707891+0000","last_clean":"2024-04-25T22:03:06.707891+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:03:06.707891+0000","last_undegraded":"2024-04-25T22:03:06.707891+0000","last_fullsized":"2024-04-25T22:03:06.707891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'142","reported_seq":180,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.228517+0000","last_change":"2024-04-25T22:02:43.853286+0000","last_active":"2024-04-25T22:03:08.228517+0000","last_peered":"2024-04-25T22:03:08.228517+0000","last_clean":"2024-04-25T22:03:08.228517+0000","last_became_active":"2024-04-25T22:02:43.852555+0000","last_became_peered":"2024-04-25T22:02:43.852555+0000","last_unstale":"2024-04-25T22:03:08.228517+0000","last_undegraded":"2024-04-25T22:03:08.228517+0000","last_fullsized":"2024-04-25T22:03:08.228517+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:42:10.005523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433182,"num_objects":142,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":97,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.696494+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:03:06.696494+0000","last_peered":"2024-04-25T22:03:06.696494+0000","last_clean":"2024-04-25T22:03:06.696494+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:03:06.696494+0000","last_undegraded":"2024-04-25T22:03:06.696494+0000","last_fullsized":"2024-04-25T22:03:06.696494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'134","reported_seq":229,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:07.958730+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:03:07.958730+0000","last_peered":"2024-04-25T22:03:07.958730+0000","last_clean":"2024-04-25T22:03:07.958730+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:03:07.958730+0000","last_undegraded":"2024-04-25T22:03:07.958730+0000","last_fullsized":"2024-04-25T22:03:07.958730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":508227,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.695376+0000","last_change":"2024-04-25T22:02:49.884995+0000","last_active":"2024-04-25T22:03:06.695376+0000","last_peered":"2024-04-25T22:03:06.695376+0000","last_clean":"2024-04-25T22:03:06.695376+0000","last_became_active":"2024-04-25T22:02:49.883112+0000","last_became_peered":"2024-04-25T22:02:49.883112+0000","last_unstale":"2024-04-25T22:03:06.695376+0000","last_undegraded":"2024-04-25T22:03:06.695376+0000","last_fullsized":"2024-04-25T22:03:06.695376+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:45.254613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"60'117","reported_seq":212,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.356505+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:03:08.356505+0000","last_peered":"2024-04-25T22:03:08.356505+0000","last_clean":"2024-04-25T22:03:08.356505+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:03:08.356505+0000","last_undegraded":"2024-04-25T22:03:08.356505+0000","last_fullsized":"2024-04-25T22:03:08.356505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399227,"num_objects":117,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.705437+0000","last_change":"2024-04-25T22:02:49.878347+0000","last_active":"2024-04-25T22:03:06.705437+0000","last_peered":"2024-04-25T22:03:06.705437+0000","last_clean":"2024-04-25T22:03:06.705437+0000","last_became_active":"2024-04-25T22:02:49.876980+0000","last_became_peered":"2024-04-25T22:02:49.876980+0000","last_unstale":"2024-04-25T22:03:06.705437+0000","last_undegraded":"2024-04-25T22:03:06.705437+0000","last_fullsized":"2024-04-25T22:03:06.705437+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:49.595210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'122","reported_seq":218,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.419122+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:03:08.419122+0000","last_peered":"2024-04-25T22:03:08.419122+0000","last_clean":"2024-04-25T22:03:08.419122+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:03:08.419122+0000","last_undegraded":"2024-04-25T22:03:08.419122+0000","last_fullsized":"2024-04-25T22:03:08.419122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399633,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":306,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.695812+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:03:06.695812+0000","last_peered":"2024-04-25T22:03:06.695812+0000","last_clean":"2024-04-25T22:03:06.695812+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:03:06.695812+0000","last_undegraded":"2024-04-25T22:03:06.695812+0000","last_fullsized":"2024-04-25T22:03:06.695812+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":103,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.696137+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:03:06.696137+0000","last_peered":"2024-04-25T22:03:06.696137+0000","last_clean":"2024-04-25T22:03:06.696137+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:03:06.696137+0000","last_undegraded":"2024-04-25T22:03:06.696137+0000","last_fullsized":"2024-04-25T22:03:06.696137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"57'1","reported_seq":99,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.707474+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:03:06.707474+0000","last_peered":"2024-04-25T22:03:06.707474+0000","last_clean":"2024-04-25T22:03:06.707474+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:03:06.707474+0000","last_undegraded":"2024-04-25T22:03:06.707474+0000","last_fullsized":"2024-04-25T22:03:06.707474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'131","reported_seq":226,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.540429+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:03:08.540429+0000","last_peered":"2024-04-25T22:03:08.540429+0000","last_clean":"2024-04-25T22:03:08.540429+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:03:08.540429+0000","last_undegraded":"2024-04-25T22:03:08.540429+0000","last_fullsized":"2024-04-25T22:03:08.540429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438444,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":103,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.695674+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:03:06.695674+0000","last_peered":"2024-04-25T22:03:06.695674+0000","last_clean":"2024-04-25T22:03:06.695674+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:03:06.695674+0000","last_undegraded":"2024-04-25T22:03:06.695674+0000","last_fullsized":"2024-04-25T22:03:06.695674+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":98,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.706190+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:03:06.706190+0000","last_peered":"2024-04-25T22:03:06.706190+0000","last_clean":"2024-04-25T22:03:06.706190+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:03:06.706190+0000","last_undegraded":"2024-04-25T22:03:06.706190+0000","last_fullsized":"2024-04-25T22:03:06.706190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'137","reported_seq":173,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.532651+0000","last_change":"2024-04-25T22:03:05.702224+0000","last_active":"2024-04-25T22:03:08.532651+0000","last_peered":"2024-04-25T22:03:08.532651+0000","last_clean":"2024-04-25T22:03:08.532651+0000","last_became_active":"2024-04-25T22:03:05.699581+0000","last_became_peered":"2024-04-25T22:03:05.699581+0000","last_unstale":"2024-04-25T22:03:08.532651+0000","last_undegraded":"2024-04-25T22:03:08.532651+0000","last_fullsized":"2024-04-25T22:03:08.532651+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497486,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.706954+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:03:06.706954+0000","last_peered":"2024-04-25T22:03:06.706954+0000","last_clean":"2024-04-25T22:03:06.706954+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:03:06.706954+0000","last_undegraded":"2024-04-25T22:03:06.706954+0000","last_fullsized":"2024-04-25T22:03:06.706954+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"59'2","reported_seq":100,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.695774+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:03:06.695774+0000","last_peered":"2024-04-25T22:03:06.695774+0000","last_clean":"2024-04-25T22:03:06.695774+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:03:06.695774+0000","last_undegraded":"2024-04-25T22:03:06.695774+0000","last_fullsized":"2024-04-25T22:03:06.695774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'125","reported_seq":221,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.503019+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:03:08.503019+0000","last_peered":"2024-04-25T22:03:08.503019+0000","last_clean":"2024-04-25T22:03:08.503019+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:03:08.503019+0000","last_undegraded":"2024-04-25T22:03:08.503019+0000","last_fullsized":"2024-04-25T22:03:08.503019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":500088,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":103,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.696977+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:03:06.696977+0000","last_peered":"2024-04-25T22:03:06.696977+0000","last_clean":"2024-04-25T22:03:06.696977+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:03:06.696977+0000","last_undegraded":"2024-04-25T22:03:06.696977+0000","last_fullsized":"2024-04-25T22:03:06.696977+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.706913+0000","last_change":"2024-04-25T22:02:43.851416+0000","last_active":"2024-04-25T22:03:06.706913+0000","last_peered":"2024-04-25T22:03:06.706913+0000","last_clean":"2024-04-25T22:03:06.706913+0000","last_became_active":"2024-04-25T22:02:43.850822+0000","last_became_peered":"2024-04-25T22:02:43.850822+0000","last_unstale":"2024-04-25T22:03:06.706913+0000","last_undegraded":"2024-04-25T22:03:06.706913+0000","last_fullsized":"2024-04-25T22:03:06.706913+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:56:58.100216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"60'123","reported_seq":219,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.416549+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:03:08.416549+0000","last_peered":"2024-04-25T22:03:08.416549+0000","last_clean":"2024-04-25T22:03:08.416549+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:03:08.416549+0000","last_undegraded":"2024-04-25T22:03:08.416549+0000","last_fullsized":"2024-04-25T22:03:08.416549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":690237,"num_objects":123,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":97,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.698144+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:03:06.698144+0000","last_peered":"2024-04-25T22:03:06.698144+0000","last_clean":"2024-04-25T22:03:06.698144+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:03:06.698144+0000","last_undegraded":"2024-04-25T22:03:06.698144+0000","last_fullsized":"2024-04-25T22:03:06.698144+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":104,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.708185+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:03:06.708185+0000","last_peered":"2024-04-25T22:03:06.708185+0000","last_clean":"2024-04-25T22:03:06.708185+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:03:06.708185+0000","last_undegraded":"2024-04-25T22:03:06.708185+0000","last_fullsized":"2024-04-25T22:03:06.708185+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"60'121","reported_seq":153,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.424005+0000","last_change":"2024-04-25T22:02:49.884459+0000","last_active":"2024-04-25T22:03:08.424005+0000","last_peered":"2024-04-25T22:03:08.424005+0000","last_clean":"2024-04-25T22:03:08.424005+0000","last_became_active":"2024-04-25T22:02:49.883467+0000","last_became_peered":"2024-04-25T22:02:49.883467+0000","last_unstale":"2024-04-25T22:03:08.424005+0000","last_undegraded":"2024-04-25T22:03:08.424005+0000","last_fullsized":"2024-04-25T22:03:08.424005+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:31.024577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":475299,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":98,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.708048+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:03:06.708048+0000","last_peered":"2024-04-25T22:03:06.708048+0000","last_clean":"2024-04-25T22:03:06.708048+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:03:06.708048+0000","last_undegraded":"2024-04-25T22:03:06.708048+0000","last_fullsized":"2024-04-25T22:03:06.708048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.697621+0000","last_change":"2024-04-25T22:03:05.701809+0000","last_active":"2024-04-25T22:03:06.697621+0000","last_peered":"2024-04-25T22:03:06.697621+0000","last_clean":"2024-04-25T22:03:06.697621+0000","last_became_active":"2024-04-25T22:03:05.701322+0000","last_became_peered":"2024-04-25T22:03:05.701322+0000","last_unstale":"2024-04-25T22:03:06.697621+0000","last_undegraded":"2024-04-25T22:03:06.697621+0000","last_fullsized":"2024-04-25T22:03:06.697621+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:45.907458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"60'122","reported_seq":218,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:07.958647+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:03:07.958647+0000","last_peered":"2024-04-25T22:03:07.958647+0000","last_clean":"2024-04-25T22:03:07.958647+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:03:07.958647+0000","last_undegraded":"2024-04-25T22:03:07.958647+0000","last_fullsized":"2024-04-25T22:03:07.958647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473924,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":100,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.708678+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:03:06.708678+0000","last_peered":"2024-04-25T22:03:06.708678+0000","last_clean":"2024-04-25T22:03:06.708678+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:03:06.708678+0000","last_undegraded":"2024-04-25T22:03:06.708678+0000","last_fullsized":"2024-04-25T22:03:06.708678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":104,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.708305+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:03:06.708305+0000","last_peered":"2024-04-25T22:03:06.708305+0000","last_clean":"2024-04-25T22:03:06.708305+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:03:06.708305+0000","last_undegraded":"2024-04-25T22:03:06.708305+0000","last_fullsized":"2024-04-25T22:03:06.708305+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'131","reported_seq":227,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.341815+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:03:08.341815+0000","last_peered":"2024-04-25T22:03:08.341815+0000","last_clean":"2024-04-25T22:03:08.341815+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:03:08.341815+0000","last_undegraded":"2024-04-25T22:03:08.341815+0000","last_fullsized":"2024-04-25T22:03:08.341815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":460663,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"60'20","reported_seq":118,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.708307+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:03:06.708307+0000","last_peered":"2024-04-25T22:03:06.708307+0000","last_clean":"2024-04-25T22:03:06.708307+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:03:06.708307+0000","last_undegraded":"2024-04-25T22:03:06.708307+0000","last_fullsized":"2024-04-25T22:03:06.708307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":103,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.697115+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:03:06.697115+0000","last_peered":"2024-04-25T22:03:06.697115+0000","last_clean":"2024-04-25T22:03:06.697115+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:03:06.697115+0000","last_undegraded":"2024-04-25T22:03:06.697115+0000","last_fullsized":"2024-04-25T22:03:06.697115+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"60'111","reported_seq":143,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.301955+0000","last_change":"2024-04-25T22:02:49.881600+0000","last_active":"2024-04-25T22:03:08.301955+0000","last_peered":"2024-04-25T22:03:08.301955+0000","last_clean":"2024-04-25T22:03:08.301955+0000","last_became_active":"2024-04-25T22:02:49.880681+0000","last_became_peered":"2024-04-25T22:02:49.880681+0000","last_unstale":"2024-04-25T22:03:08.301955+0000","last_undegraded":"2024-04-25T22:03:08.301955+0000","last_fullsized":"2024-04-25T22:03:08.301955+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.432134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":675035,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'122","reported_seq":217,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.207589+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:03:08.207589+0000","last_peered":"2024-04-25T22:03:08.207589+0000","last_clean":"2024-04-25T22:03:08.207589+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:03:08.207589+0000","last_undegraded":"2024-04-25T22:03:08.207589+0000","last_fullsized":"2024-04-25T22:03:08.207589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2846168,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":2845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"60'22","reported_seq":119,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.696398+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:03:06.696398+0000","last_peered":"2024-04-25T22:03:06.696398+0000","last_clean":"2024-04-25T22:03:06.696398+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:03:06.696398+0000","last_undegraded":"2024-04-25T22:03:06.696398+0000","last_fullsized":"2024-04-25T22:03:06.696398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"60'121","reported_seq":217,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.023416+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:03:08.023416+0000","last_peered":"2024-04-25T22:03:08.023416+0000","last_clean":"2024-04-25T22:03:08.023416+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:03:08.023416+0000","last_undegraded":"2024-04-25T22:03:08.023416+0000","last_fullsized":"2024-04-25T22:03:08.023416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":523562,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":101,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.697350+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:03:06.697350+0000","last_peered":"2024-04-25T22:03:06.697350+0000","last_clean":"2024-04-25T22:03:06.697350+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:03:06.697350+0000","last_undegraded":"2024-04-25T22:03:06.697350+0000","last_fullsized":"2024-04-25T22:03:06.697350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.707360+0000","last_change":"2024-04-25T22:02:43.852674+0000","last_active":"2024-04-25T22:03:06.707360+0000","last_peered":"2024-04-25T22:03:06.707360+0000","last_clean":"2024-04-25T22:03:06.707360+0000","last_became_active":"2024-04-25T22:02:43.852292+0000","last_became_peered":"2024-04-25T22:02:43.852292+0000","last_unstale":"2024-04-25T22:03:06.707360+0000","last_undegraded":"2024-04-25T22:03:06.707360+0000","last_fullsized":"2024-04-25T22:03:06.707360+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:57.388397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"60'147","reported_seq":243,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.305308+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:03:08.305308+0000","last_peered":"2024-04-25T22:03:08.305308+0000","last_clean":"2024-04-25T22:03:08.305308+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:03:08.305308+0000","last_undegraded":"2024-04-25T22:03:08.305308+0000","last_fullsized":"2024-04-25T22:03:08.305308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1276588,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":1317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":98,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.708389+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:03:06.708389+0000","last_peered":"2024-04-25T22:03:06.708389+0000","last_clean":"2024-04-25T22:03:06.708389+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:03:06.708389+0000","last_undegraded":"2024-04-25T22:03:06.708389+0000","last_fullsized":"2024-04-25T22:03:06.708389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'142","reported_seq":238,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.286129+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:03:08.286129+0000","last_peered":"2024-04-25T22:03:08.286129+0000","last_clean":"2024-04-25T22:03:08.286129+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:03:08.286129+0000","last_undegraded":"2024-04-25T22:03:08.286129+0000","last_fullsized":"2024-04-25T22:03:08.286129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5021234,"num_objects":142,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'120","reported_seq":152,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.069234+0000","last_change":"2024-04-25T22:02:49.884155+0000","last_active":"2024-04-25T22:03:08.069234+0000","last_peered":"2024-04-25T22:03:08.069234+0000","last_clean":"2024-04-25T22:03:08.069234+0000","last_became_active":"2024-04-25T22:02:49.883314+0000","last_became_peered":"2024-04-25T22:02:49.883314+0000","last_unstale":"2024-04-25T22:03:08.069234+0000","last_undegraded":"2024-04-25T22:03:08.069234+0000","last_fullsized":"2024-04-25T22:03:08.069234+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:53:47.483774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1024817,"num_objects":120,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":1063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":98,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.706113+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:03:06.706113+0000","last_peered":"2024-04-25T22:03:06.706113+0000","last_clean":"2024-04-25T22:03:06.706113+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:03:06.706113+0000","last_undegraded":"2024-04-25T22:03:06.706113+0000","last_fullsized":"2024-04-25T22:03:06.706113+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'128","reported_seq":224,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.402676+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:03:08.402676+0000","last_peered":"2024-04-25T22:03:08.402676+0000","last_clean":"2024-04-25T22:03:08.402676+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:03:08.402676+0000","last_undegraded":"2024-04-25T22:03:08.402676+0000","last_fullsized":"2024-04-25T22:03:08.402676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442140,"num_objects":128,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":98,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.705952+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:03:06.705952+0000","last_peered":"2024-04-25T22:03:06.705952+0000","last_clean":"2024-04-25T22:03:06.705952+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:03:06.705952+0000","last_undegraded":"2024-04-25T22:03:06.705952+0000","last_fullsized":"2024-04-25T22:03:06.705952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"60'122","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.374674+0000","last_change":"2024-04-25T22:02:49.887569+0000","last_active":"2024-04-25T22:03:08.374674+0000","last_peered":"2024-04-25T22:03:08.374674+0000","last_clean":"2024-04-25T22:03:08.374674+0000","last_became_active":"2024-04-25T22:02:49.886732+0000","last_became_peered":"2024-04-25T22:02:49.886732+0000","last_unstale":"2024-04-25T22:03:08.374674+0000","last_undegraded":"2024-04-25T22:03:08.374674+0000","last_fullsized":"2024-04-25T22:03:08.374674+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:38.761184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401443,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"57'3","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.696441+0000","last_change":"2024-04-25T22:03:05.702244+0000","last_active":"2024-04-25T22:03:06.696441+0000","last_peered":"2024-04-25T22:03:06.696441+0000","last_clean":"2024-04-25T22:03:06.696441+0000","last_became_active":"2024-04-25T22:03:05.701350+0000","last_became_peered":"2024-04-25T22:03:05.701350+0000","last_unstale":"2024-04-25T22:03:06.696441+0000","last_undegraded":"2024-04-25T22:03:06.696441+0000","last_fullsized":"2024-04-25T22:03:06.696441+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:31:38.259386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'124","reported_seq":156,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.154303+0000","last_change":"2024-04-25T22:02:49.882913+0000","last_active":"2024-04-25T22:03:08.154303+0000","last_peered":"2024-04-25T22:03:08.154303+0000","last_clean":"2024-04-25T22:03:08.154303+0000","last_became_active":"2024-04-25T22:02:49.882175+0000","last_became_peered":"2024-04-25T22:02:49.882175+0000","last_unstale":"2024-04-25T22:03:08.154303+0000","last_undegraded":"2024-04-25T22:03:08.154303+0000","last_fullsized":"2024-04-25T22:03:08.154303+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:31.024577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559259,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"53'4","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.695573+0000","last_change":"2024-04-25T22:02:49.886319+0000","last_active":"2024-04-25T22:03:06.695573+0000","last_peered":"2024-04-25T22:03:06.695573+0000","last_clean":"2024-04-25T22:03:06.695573+0000","last_became_active":"2024-04-25T22:02:49.884039+0000","last_became_peered":"2024-04-25T22:02:49.884039+0000","last_unstale":"2024-04-25T22:03:06.695573+0000","last_undegraded":"2024-04-25T22:03:06.695573+0000","last_fullsized":"2024-04-25T22:03:06.695573+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:11.405616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'119","reported_seq":157,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:07.950181+0000","last_change":"2024-04-25T22:02:43.850869+0000","last_active":"2024-04-25T22:03:07.950181+0000","last_peered":"2024-04-25T22:03:07.950181+0000","last_clean":"2024-04-25T22:03:07.950181+0000","last_became_active":"2024-04-25T22:02:43.850568+0000","last_became_peered":"2024-04-25T22:02:43.850568+0000","last_unstale":"2024-04-25T22:03:07.950181+0000","last_undegraded":"2024-04-25T22:03:07.950181+0000","last_fullsized":"2024-04-25T22:03:07.950181+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:10:32.881419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368783,"num_objects":119,"num_object_clones":0,"num_object_copies":238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":48,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.706476+0000","last_change":"2024-04-25T22:02:43.853253+0000","last_active":"2024-04-25T22:03:06.706476+0000","last_peered":"2024-04-25T22:03:06.706476+0000","last_clean":"2024-04-25T22:03:06.706476+0000","last_became_active":"2024-04-25T22:02:43.852769+0000","last_became_peered":"2024-04-25T22:02:43.852769+0000","last_unstale":"2024-04-25T22:03:06.706476+0000","last_undegraded":"2024-04-25T22:03:06.706476+0000","last_fullsized":"2024-04-25T22:03:06.706476+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:51:36.457092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"60'138","reported_seq":176,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.454132+0000","last_change":"2024-04-25T22:02:43.852778+0000","last_active":"2024-04-25T22:03:08.454132+0000","last_peered":"2024-04-25T22:03:08.454132+0000","last_clean":"2024-04-25T22:03:08.454132+0000","last_became_active":"2024-04-25T22:02:43.852263+0000","last_became_peered":"2024-04-25T22:02:43.852263+0000","last_unstale":"2024-04-25T22:03:08.454132+0000","last_undegraded":"2024-04-25T22:03:08.454132+0000","last_fullsized":"2024-04-25T22:03:08.454132+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:10:40.487543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396933,"num_objects":138,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"60'7","reported_seq":47,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.852106+0000","last_change":"2024-04-25T22:02:49.887527+0000","last_active":"2024-04-25T22:03:06.852106+0000","last_peered":"2024-04-25T22:03:06.852106+0000","last_clean":"2024-04-25T22:03:06.852106+0000","last_became_active":"2024-04-25T22:02:49.886150+0000","last_became_peered":"2024-04-25T22:02:49.886150+0000","last_unstale":"2024-04-25T22:03:06.852106+0000","last_undegraded":"2024-04-25T22:03:06.852106+0000","last_fullsized":"2024-04-25T22:03:06.852106+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:23:43.687342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"60'139","reported_seq":171,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.452231+0000","last_change":"2024-04-25T22:02:49.876491+0000","last_active":"2024-04-25T22:03:08.452231+0000","last_peered":"2024-04-25T22:03:08.452231+0000","last_clean":"2024-04-25T22:03:08.452231+0000","last_became_active":"2024-04-25T22:02:49.876169+0000","last_became_peered":"2024-04-25T22:02:49.876169+0000","last_unstale":"2024-04-25T22:03:08.452231+0000","last_undegraded":"2024-04-25T22:03:08.452231+0000","last_fullsized":"2024-04-25T22:03:08.452231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:56:41.591010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540186,"num_objects":139,"num_object_clones":0,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"59'56","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.708008+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:03:06.708008+0000","last_peered":"2024-04-25T22:03:06.708008+0000","last_clean":"2024-04-25T22:03:06.708008+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:03:06.708008+0000","last_undegraded":"2024-04-25T22:03:06.708008+0000","last_fullsized":"2024-04-25T22:03:06.708008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'151","reported_seq":246,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.342596+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:03:08.342596+0000","last_peered":"2024-04-25T22:03:08.342596+0000","last_clean":"2024-04-25T22:03:08.342596+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:03:08.342596+0000","last_undegraded":"2024-04-25T22:03:08.342596+0000","last_fullsized":"2024-04-25T22:03:08.342596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489584,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"55'6","reported_seq":104,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.708067+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:03:06.708067+0000","last_peered":"2024-04-25T22:03:06.708067+0000","last_clean":"2024-04-25T22:03:06.708067+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:03:06.708067+0000","last_undegraded":"2024-04-25T22:03:06.708067+0000","last_fullsized":"2024-04-25T22:03:06.708067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":50596750,"num_objects":8264,"num_object_clones":0,"num_object_copies":16528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8264,"num_write_kb":53781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":108187648,"data_stored":101197495,"data_compressed":8244422,"data_compressed_allocated":11649024,"data_compressed_original":44105728,"omap_allocated":0,"internal_metadata":0},"log_size":8265,"ondisk_log_size":8265,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":29361598,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":29534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7970816,"data_stored":58723196,"data_compressed":4986736,"data_compressed_allocated":7249920,"data_compressed_original":58056704,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738399,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76396,"kb_used_data":41060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94295444,"statfs":{"total":96636764160,"available":96558534656,"internally_reserved":0,"allocated":42045440,"data_stored":57071031,"data_compressed":4566089,"data_compressed_allocated":6397952,"data_compressed_original":34426880,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738398,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71668,"kb_used_data":36324,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94300172,"statfs":{"total":96636764160,"available":96563376128,"internally_reserved":0,"allocated":37195776,"data_stored":50240587,"data_compressed":4158362,"data_compressed_allocated":6082560,"data_compressed_original":33030144,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738399,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71996,"kb_used_data":36656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94299844,"statfs":{"total":96636764160,"available":96563040256,"internally_reserved":0,"allocated":37535744,"data_stored":54088063,"data_compressed":4517037,"data_compressed_allocated":6483968,"data_compressed_original":35835904,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2863104,"data_stored":20972990,"data_compressed":1815296,"data_compressed_allocated":2625536,"data_compressed_original":20762624,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2326528,"data_stored":16777832,"data_compressed":1392983,"data_compressed_allocated":2048000,"data_compressed_original":16506880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2781184,"data_stored":20972374,"data_compressed":1778457,"data_compressed_allocated":2576384,"data_compressed_original":20787200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34320384,"data_stored":32386477,"data_compressed":2696576,"data_compressed_allocated":3825664,"data_compressed_original":14508032,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":35033088,"data_stored":33493903,"data_compressed":2768421,"data_compressed_allocated":4038656,"data_compressed_original":16531456,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38834176,"data_stored":35317115,"data_compressed":2779425,"data_compressed_allocated":3784704,"data_compressed_original":13066240,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:03:13.138 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:03:13.143 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:13.158 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:03:13.189 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:13.188+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:13.267 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:13.267 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:13.269 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:13.264+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:13.281 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:13.318 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:13.319 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:13.347 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:13.348 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:13.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:13.365+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:13.384 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:13.384 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:13.414 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:13.415 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:13.415 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:03:13.415 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:13.430 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:13.468 INFO:tasks.workunit.client.0.smithi044.stderr:++ readlink -f fsstress 2024-04-25T22:03:13.470 INFO:tasks.workunit.client.0.smithi044.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-25T22:03:13.470 INFO:tasks.workunit.client.0.smithi044.stderr:+ popd 2024-04-25T22:03:13.470 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:13.468+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:13.471 INFO:tasks.workunit.client.0.smithi044.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T22:03:13.471 INFO:tasks.workunit.client.0.smithi044.stderr:+ popd 2024-04-25T22:03:13.471 INFO:tasks.workunit.client.0.smithi044.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-25T22:03:13.471 INFO:tasks.workunit.client.0.smithi044.stderr:++ mktemp -d -p . 2024-04-25T22:03:13.473 INFO:tasks.workunit.client.0.smithi044.stderr:+ T=./tmp.YOF6MeUUoe 2024-04-25T22:03:13.473 INFO:tasks.workunit.client.0.smithi044.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.YOF6MeUUoe -l 1 -n 1000 -p 10 -v 2024-04-25T22:03:13.475 INFO:tasks.workunit.client.0.smithi044.stdout:seed = 1714262654 2024-04-25T22:03:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:03:13.477 INFO:tasks.workunit.client.0.smithi044.stdout:0/0: dread - no filename 2024-04-25T22:03:13.478 INFO:tasks.workunit.client.0.smithi044.stdout:0/1: dwrite - no filename 2024-04-25T22:03:13.480 INFO:tasks.workunit.client.0.smithi044.stdout:1/0: write - no filename 2024-04-25T22:03:13.481 INFO:tasks.workunit.client.0.smithi044.stdout:0/2: creat f0 x:0 0 0 2024-04-25T22:03:13.481 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:03:13.486 INFO:tasks.workunit.client.0.smithi044.stdout:0/3: chown f0 1 1 2024-04-25T22:03:13.486 INFO:tasks.workunit.client.0.smithi044.stdout:1/1: mkdir d0 0 2024-04-25T22:03:13.486 INFO:tasks.workunit.client.0.smithi044.stdout:1/2: dwrite - no filename 2024-04-25T22:03:13.486 INFO:tasks.workunit.client.0.smithi044.stdout:1/3: read - no filename 2024-04-25T22:03:13.486 INFO:tasks.workunit.client.0.smithi044.stdout:1/4: read - no filename 2024-04-25T22:03:13.486 INFO:tasks.workunit.client.0.smithi044.stdout:1/5: dread - no filename 2024-04-25T22:03:13.486 INFO:tasks.workunit.client.0.smithi044.stdout:3/0: truncate - no filename 2024-04-25T22:03:13.486 INFO:tasks.workunit.client.0.smithi044.stdout:0/4: write f0 [519533,587] 0 2024-04-25T22:03:13.486 INFO:tasks.workunit.client.0.smithi044.stdout:2/0: creat f0 x:0 0 0 2024-04-25T22:03:13.486 INFO:tasks.workunit.client.0.smithi044.stdout:3/1: mkdir d0 0 2024-04-25T22:03:13.486 INFO:tasks.workunit.client.0.smithi044.stdout:3/2: link - no file 2024-04-25T22:03:13.487 INFO:tasks.workunit.client.0.smithi044.stdout:1/6: rmdir d0 0 2024-04-25T22:03:13.487 INFO:tasks.workunit.client.0.smithi044.stdout:1/7: rename - no filename 2024-04-25T22:03:13.487 INFO:tasks.workunit.client.0.smithi044.stdout:1/8: write - no filename 2024-04-25T22:03:13.487 INFO:tasks.workunit.client.0.smithi044.stdout:1/9: rename - no filename 2024-04-25T22:03:13.487 INFO:tasks.workunit.client.0.smithi044.stdout:2/1: creat f1 x:0 0 0 2024-04-25T22:03:13.487 INFO:tasks.workunit.client.0.smithi044.stdout:2/2: readlink - no filename 2024-04-25T22:03:13.487 INFO:tasks.workunit.client.0.smithi044.stdout:0/5: chown f0 199154 1 2024-04-25T22:03:13.487 INFO:tasks.workunit.client.0.smithi044.stdout:4/0: creat f0 x:0 0 0 2024-04-25T22:03:13.487 INFO:tasks.workunit.client.0.smithi044.stdout:1/10: mknod c1 0 2024-04-25T22:03:13.487 INFO:tasks.workunit.client.0.smithi044.stdout:1/11: dwrite - no filename 2024-04-25T22:03:13.487 INFO:tasks.workunit.client.0.smithi044.stdout:5/0: rmdir - no directory 2024-04-25T22:03:13.487 INFO:tasks.workunit.client.0.smithi044.stdout:5/1: dread - no filename 2024-04-25T22:03:13.487 INFO:tasks.workunit.client.0.smithi044.stdout:0/6: chown f0 763 1 2024-04-25T22:03:13.487 INFO:tasks.workunit.client.0.smithi044.stdout:3/3: mkdir d0/d1 0 2024-04-25T22:03:13.487 INFO:tasks.workunit.client.0.smithi044.stdout:1/12: link c1 c2 0 2024-04-25T22:03:13.488 INFO:tasks.workunit.client.0.smithi044.stdout:1/13: dread - no filename 2024-04-25T22:03:13.488 INFO:tasks.workunit.client.0.smithi044.stdout:1/14: dread - no filename 2024-04-25T22:03:13.488 INFO:tasks.workunit.client.0.smithi044.stdout:1/15: readlink - no filename 2024-04-25T22:03:13.488 INFO:tasks.workunit.client.0.smithi044.stdout:7/0: chown . 2 1 2024-04-25T22:03:13.488 INFO:tasks.workunit.client.0.smithi044.stdout:7/1: dread - no filename 2024-04-25T22:03:13.488 INFO:tasks.workunit.client.0.smithi044.stdout:5/2: creat f0 x:0 0 0 2024-04-25T22:03:13.488 INFO:tasks.workunit.client.0.smithi044.stdout:5/3: readlink - no filename 2024-04-25T22:03:13.488 INFO:tasks.workunit.client.0.smithi044.stdout:7/2: chown . 9742273 1 2024-04-25T22:03:13.488 INFO:tasks.workunit.client.0.smithi044.stdout:7/3: link - no file 2024-04-25T22:03:13.488 INFO:tasks.workunit.client.0.smithi044.stdout:7/4: dwrite - no filename 2024-04-25T22:03:13.488 INFO:tasks.workunit.client.0.smithi044.stdout:3/4: mkdir d0/d2 0 2024-04-25T22:03:13.488 INFO:tasks.workunit.client.0.smithi044.stdout:3/5: truncate - no filename 2024-04-25T22:03:13.488 INFO:tasks.workunit.client.0.smithi044.stdout:6/0: mknod c0 0 2024-04-25T22:03:13.488 INFO:tasks.workunit.client.0.smithi044.stdout:7/5: chown . 8497 1 2024-04-25T22:03:13.488 INFO:tasks.workunit.client.0.smithi044.stdout:7/6: write - no filename 2024-04-25T22:03:13.489 INFO:tasks.workunit.client.0.smithi044.stdout:7/7: write - no filename 2024-04-25T22:03:13.489 INFO:tasks.workunit.client.0.smithi044.stdout:7/8: rmdir - no directory 2024-04-25T22:03:13.489 INFO:tasks.workunit.client.0.smithi044.stdout:9/0: dwrite - no filename 2024-04-25T22:03:13.489 INFO:tasks.workunit.client.0.smithi044.stdout:9/1: fsync - no filename 2024-04-25T22:03:13.489 INFO:tasks.workunit.client.0.smithi044.stdout:9/2: dwrite - no filename 2024-04-25T22:03:13.489 INFO:tasks.workunit.client.0.smithi044.stdout:6/1: mknod c1 0 2024-04-25T22:03:13.489 INFO:tasks.workunit.client.0.smithi044.stdout:8/0: dread - no filename 2024-04-25T22:03:13.489 INFO:tasks.workunit.client.0.smithi044.stdout:7/9: creat f0 x:0 0 0 2024-04-25T22:03:13.489 INFO:tasks.workunit.client.0.smithi044.stdout:5/4: chown f0 13806 1 2024-04-25T22:03:13.489 INFO:tasks.workunit.client.0.smithi044.stdout:1/16: chown c1 15 1 2024-04-25T22:03:13.489 INFO:tasks.workunit.client.0.smithi044.stdout:1/17: dwrite - no filename 2024-04-25T22:03:13.489 INFO:tasks.workunit.client.0.smithi044.stdout:1/18: dread - no filename 2024-04-25T22:03:13.489 INFO:tasks.workunit.client.0.smithi044.stdout:6/2: chown c1 11 1 2024-04-25T22:03:13.491 INFO:tasks.workunit.client.0.smithi044.stdout:3/6: creat d0/d2/f3 x:0 0 0 2024-04-25T22:03:13.491 INFO:tasks.workunit.client.0.smithi044.stdout:9/3: symlink l0 0 2024-04-25T22:03:13.491 INFO:tasks.workunit.client.0.smithi044.stdout:8/1: creat f0 x:0 0 0 2024-04-25T22:03:13.491 INFO:tasks.workunit.client.0.smithi044.stdout:1/19: mkdir d3 0 2024-04-25T22:03:13.491 INFO:tasks.workunit.client.0.smithi044.stdout:5/5: mknod c1 0 2024-04-25T22:03:13.491 INFO:tasks.workunit.client.0.smithi044.stdout:6/3: mkdir d2 0 2024-04-25T22:03:13.491 INFO:tasks.workunit.client.0.smithi044.stdout:6/4: write - no filename 2024-04-25T22:03:13.491 INFO:tasks.workunit.client.0.smithi044.stdout:6/5: truncate - no filename 2024-04-25T22:03:13.491 INFO:tasks.workunit.client.0.smithi044.stdout:9/4: mkdir d1 0 2024-04-25T22:03:13.491 INFO:tasks.workunit.client.0.smithi044.stdout:5/6: mkdir d2 0 2024-04-25T22:03:13.492 INFO:tasks.workunit.client.0.smithi044.stdout:8/2: write f0 [527204,48900] 0 2024-04-25T22:03:13.492 INFO:tasks.workunit.client.0.smithi044.stdout:6/6: chown c0 786578 1 2024-04-25T22:03:13.492 INFO:tasks.workunit.client.0.smithi044.stdout:6/7: dwrite - no filename 2024-04-25T22:03:13.492 INFO:tasks.workunit.client.0.smithi044.stdout:9/5: rename d1 to d1/d2 22 2024-04-25T22:03:13.492 INFO:tasks.workunit.client.0.smithi044.stdout:5/7: creat d2/f3 x:0 0 0 2024-04-25T22:03:13.492 INFO:tasks.workunit.client.0.smithi044.stdout:6/8: stat c0 0 2024-04-25T22:03:13.492 INFO:tasks.workunit.client.0.smithi044.stdout:6/9: truncate - no filename 2024-04-25T22:03:13.492 INFO:tasks.workunit.client.0.smithi044.stdout:6/10: dwrite - no filename 2024-04-25T22:03:13.492 INFO:tasks.workunit.client.0.smithi044.stdout:6/11: write - no filename 2024-04-25T22:03:13.493 INFO:tasks.workunit.client.0.smithi044.stdout:2/3: dwrite f1 [0,4194304] 0 2024-04-25T22:03:13.493 INFO:tasks.workunit.client.0.smithi044.stdout:5/8: chown f0 61057 1 2024-04-25T22:03:13.493 INFO:tasks.workunit.client.0.smithi044.stdout:0/7: dwrite f0 [0,4194304] 0 2024-04-25T22:03:13.493 INFO:tasks.workunit.client.0.smithi044.stdout:9/6: getdents d1 0 2024-04-25T22:03:13.493 INFO:tasks.workunit.client.0.smithi044.stdout:9/7: dwrite - no filename 2024-04-25T22:03:13.493 INFO:tasks.workunit.client.0.smithi044.stdout:6/12: mknod d2/c3 0 2024-04-25T22:03:13.493 INFO:tasks.workunit.client.0.smithi044.stdout:8/3: mkdir d1 0 2024-04-25T22:03:13.494 INFO:tasks.workunit.client.0.smithi044.stdout:5/9: chown c1 4807468 1 2024-04-25T22:03:13.494 INFO:tasks.workunit.client.0.smithi044.stdout:6/13: chown d2 177466728 1 2024-04-25T22:03:13.494 INFO:tasks.workunit.client.0.smithi044.stdout:5/10: dread - f0 zero size 2024-04-25T22:03:13.496 INFO:tasks.workunit.client.0.smithi044.stdout:6/14: mknod d2/c4 0 2024-04-25T22:03:13.496 INFO:tasks.workunit.client.0.smithi044.stdout:6/15: read - no filename 2024-04-25T22:03:13.500 INFO:tasks.workunit.client.0.smithi044.stdout:5/11: creat d2/f4 x:0 0 0 2024-04-25T22:03:13.501 INFO:tasks.workunit.client.0.smithi044.stdout:5/12: read - d2/f3 zero size 2024-04-25T22:03:13.502 INFO:tasks.workunit.client.0.smithi044.stdout:0/8: creat f1 x:0 0 0 2024-04-25T22:03:13.503 INFO:tasks.workunit.client.0.smithi044.stdout:6/16: rename d2/c4 to d2/c5 0 2024-04-25T22:03:13.503 INFO:tasks.workunit.client.0.smithi044.stdout:5/13: mkdir d2/d5 0 2024-04-25T22:03:13.503 INFO:tasks.workunit.client.0.smithi044.stdout:3/7: dwrite d0/d2/f3 [0,4194304] 0 2024-04-25T22:03:13.504 INFO:tasks.workunit.client.0.smithi044.stdout:5/14: dread - f0 zero size 2024-04-25T22:03:13.504 INFO:tasks.workunit.client.0.smithi044.stdout:6/17: mknod d2/c6 0 2024-04-25T22:03:13.505 INFO:tasks.workunit.client.0.smithi044.stdout:5/15: link f0 d2/f6 0 2024-04-25T22:03:13.506 INFO:tasks.workunit.client.0.smithi044.stdout:5/16: dread - f0 zero size 2024-04-25T22:03:13.506 INFO:tasks.workunit.client.0.smithi044.stdout:2/4: dwrite f0 [0,4194304] 0 2024-04-25T22:03:13.507 INFO:tasks.workunit.client.0.smithi044.stdout:2/5: mknod c2 0 2024-04-25T22:03:13.508 INFO:tasks.workunit.client.0.smithi044.stdout:5/17: link c1 d2/c7 0 2024-04-25T22:03:13.509 INFO:tasks.workunit.client.0.smithi044.stdout:2/6: creat f3 x:0 0 0 2024-04-25T22:03:13.509 INFO:tasks.workunit.client.0.smithi044.stdout:2/7: dread - f3 zero size 2024-04-25T22:03:13.510 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2024-04-25T22:03:12.737075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":80548716,"num_objects":8294,"num_object_clones":0,"num_object_copies":16588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8294,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":8700,"num_write_kb":86775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8626,"ondisk_log_size":8626,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":220060,"kb_used_data":114040,"kb_used_omap":4,"kb_used_meta":105979,"kb_avail":282895460,"statfs":{"total":289910292480,"available":289684951040,"internally_reserved":0,"allocated":116776960,"data_stored":161399681,"data_compressed":13241488,"data_compressed_allocated":18964480,"data_compressed_original":103292928,"omap_allocated":4785,"internal_metadata":108522831},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22392621,"num_objects":2096,"num_object_clones":0,"num_object_copies":4192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2096,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2169,"num_write_kb":23273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.145232"},"pg_stats":[{"pgid":"4.3f","version":"60'134","reported_seq":166,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.413407+0000","last_change":"2024-04-25T22:02:49.882976+0000","last_active":"2024-04-25T22:03:08.413407+0000","last_peered":"2024-04-25T22:03:08.413407+0000","last_clean":"2024-04-25T22:03:08.413407+0000","last_became_active":"2024-04-25T22:02:49.882308+0000","last_became_peered":"2024-04-25T22:02:49.882308+0000","last_unstale":"2024-04-25T22:03:08.413407+0000","last_undegraded":"2024-04-25T22:03:08.413407+0000","last_fullsized":"2024-04-25T22:03:08.413407+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:46.257798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":738940,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"60'119","reported_seq":151,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.509087+0000","last_change":"2024-04-25T22:02:49.882947+0000","last_active":"2024-04-25T22:03:08.509087+0000","last_peered":"2024-04-25T22:03:08.509087+0000","last_clean":"2024-04-25T22:03:08.509087+0000","last_became_active":"2024-04-25T22:02:49.882192+0000","last_became_peered":"2024-04-25T22:02:49.882192+0000","last_unstale":"2024-04-25T22:03:08.509087+0000","last_undegraded":"2024-04-25T22:03:08.509087+0000","last_fullsized":"2024-04-25T22:03:08.509087+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:07.474272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449721,"num_objects":119,"num_object_clones":0,"num_object_copies":238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"60'116","reported_seq":210,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:07.480831+0000","last_change":"2024-04-25T22:02:49.886973+0000","last_active":"2024-04-25T22:03:07.480831+0000","last_peered":"2024-04-25T22:03:07.480831+0000","last_clean":"2024-04-25T22:03:07.480831+0000","last_became_active":"2024-04-25T22:02:49.884097+0000","last_became_peered":"2024-04-25T22:02:49.884097+0000","last_unstale":"2024-04-25T22:03:07.480831+0000","last_undegraded":"2024-04-25T22:03:07.480831+0000","last_fullsized":"2024-04-25T22:03:07.480831+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655772,"num_objects":116,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'113","reported_seq":208,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.323368+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:03:08.323368+0000","last_peered":"2024-04-25T22:03:08.323368+0000","last_clean":"2024-04-25T22:03:08.323368+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:03:08.323368+0000","last_undegraded":"2024-04-25T22:03:08.323368+0000","last_fullsized":"2024-04-25T22:03:08.323368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":878778,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'142","reported_seq":174,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.289890+0000","last_change":"2024-04-25T22:02:49.879514+0000","last_active":"2024-04-25T22:03:08.289890+0000","last_peered":"2024-04-25T22:03:08.289890+0000","last_clean":"2024-04-25T22:03:08.289890+0000","last_became_active":"2024-04-25T22:02:49.878964+0000","last_became_peered":"2024-04-25T22:02:49.878964+0000","last_unstale":"2024-04-25T22:03:08.289890+0000","last_undegraded":"2024-04-25T22:03:08.289890+0000","last_fullsized":"2024-04-25T22:03:08.289890+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.432134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":607385,"num_objects":142,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"60'127","reported_seq":222,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.328905+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:03:08.328905+0000","last_peered":"2024-04-25T22:03:08.328905+0000","last_clean":"2024-04-25T22:03:08.328905+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:03:08.328905+0000","last_undegraded":"2024-04-25T22:03:08.328905+0000","last_fullsized":"2024-04-25T22:03:08.328905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815104,"num_objects":127,"num_object_clones":0,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'143","reported_seq":238,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.438493+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:03:08.438493+0000","last_peered":"2024-04-25T22:03:08.438493+0000","last_clean":"2024-04-25T22:03:08.438493+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:03:08.438493+0000","last_undegraded":"2024-04-25T22:03:08.438493+0000","last_fullsized":"2024-04-25T22:03:08.438493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549692,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'111","reported_seq":206,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:07.940704+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:03:07.940704+0000","last_peered":"2024-04-25T22:03:07.940704+0000","last_clean":"2024-04-25T22:03:07.940704+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:03:07.940704+0000","last_undegraded":"2024-04-25T22:03:07.940704+0000","last_fullsized":"2024-04-25T22:03:07.940704+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1111886,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":1143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'134","reported_seq":230,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.251613+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:03:08.251613+0000","last_peered":"2024-04-25T22:03:08.251613+0000","last_clean":"2024-04-25T22:03:08.251613+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:03:08.251613+0000","last_undegraded":"2024-04-25T22:03:08.251613+0000","last_fullsized":"2024-04-25T22:03:08.251613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628604,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'121","reported_seq":153,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.012066+0000","last_change":"2024-04-25T22:02:49.885137+0000","last_active":"2024-04-25T22:03:08.012066+0000","last_peered":"2024-04-25T22:03:08.012066+0000","last_clean":"2024-04-25T22:03:08.012066+0000","last_became_active":"2024-04-25T22:02:49.884276+0000","last_became_peered":"2024-04-25T22:02:49.884276+0000","last_unstale":"2024-04-25T22:03:08.012066+0000","last_undegraded":"2024-04-25T22:03:08.012066+0000","last_fullsized":"2024-04-25T22:03:08.012066+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:12.408801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":488187,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"60'119","reported_seq":214,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.460580+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:03:08.460580+0000","last_peered":"2024-04-25T22:03:08.460580+0000","last_clean":"2024-04-25T22:03:08.460580+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:03:08.460580+0000","last_undegraded":"2024-04-25T22:03:08.460580+0000","last_fullsized":"2024-04-25T22:03:08.460580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424574,"num_objects":119,"num_object_clones":0,"num_object_copies":238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'115","reported_seq":211,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.135933+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:03:08.135933+0000","last_peered":"2024-04-25T22:03:08.135933+0000","last_clean":"2024-04-25T22:03:08.135933+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:03:08.135933+0000","last_undegraded":"2024-04-25T22:03:08.135933+0000","last_fullsized":"2024-04-25T22:03:08.135933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333898,"num_objects":115,"num_object_clones":0,"num_object_copies":230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":115,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'124","reported_seq":156,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:07.523446+0000","last_change":"2024-04-25T22:02:49.878698+0000","last_active":"2024-04-25T22:03:07.523446+0000","last_peered":"2024-04-25T22:03:07.523446+0000","last_clean":"2024-04-25T22:03:07.523446+0000","last_became_active":"2024-04-25T22:02:49.878377+0000","last_became_peered":"2024-04-25T22:02:49.878377+0000","last_unstale":"2024-04-25T22:03:07.523446+0000","last_undegraded":"2024-04-25T22:03:07.523446+0000","last_fullsized":"2024-04-25T22:03:07.523446+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:31:39.262571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407131,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"60'129","reported_seq":224,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.133655+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:03:08.133655+0000","last_peered":"2024-04-25T22:03:08.133655+0000","last_clean":"2024-04-25T22:03:08.133655+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:03:08.133655+0000","last_undegraded":"2024-04-25T22:03:08.133655+0000","last_fullsized":"2024-04-25T22:03:08.133655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4921605,"num_objects":128,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":4873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'128","reported_seq":223,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.275977+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:03:08.275977+0000","last_peered":"2024-04-25T22:03:08.275977+0000","last_clean":"2024-04-25T22:03:08.275977+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:03:08.275977+0000","last_undegraded":"2024-04-25T22:03:08.275977+0000","last_fullsized":"2024-04-25T22:03:08.275977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408108,"num_objects":128,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'147","reported_seq":242,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.051379+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:03:08.051379+0000","last_peered":"2024-04-25T22:03:08.051379+0000","last_clean":"2024-04-25T22:03:08.051379+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:03:08.051379+0000","last_undegraded":"2024-04-25T22:03:08.051379+0000","last_fullsized":"2024-04-25T22:03:08.051379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":619516,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'134","reported_seq":230,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.435681+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:03:08.435681+0000","last_peered":"2024-04-25T22:03:08.435681+0000","last_clean":"2024-04-25T22:03:08.435681+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:03:08.435681+0000","last_undegraded":"2024-04-25T22:03:08.435681+0000","last_fullsized":"2024-04-25T22:03:08.435681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":858626,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'127","reported_seq":159,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.544096+0000","last_change":"2024-04-25T22:02:49.885489+0000","last_active":"2024-04-25T22:03:08.544096+0000","last_peered":"2024-04-25T22:03:08.544096+0000","last_clean":"2024-04-25T22:03:08.544096+0000","last_became_active":"2024-04-25T22:02:49.884784+0000","last_became_peered":"2024-04-25T22:02:49.884784+0000","last_unstale":"2024-04-25T22:03:08.544096+0000","last_undegraded":"2024-04-25T22:03:08.544096+0000","last_fullsized":"2024-04-25T22:03:08.544096+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":499727,"num_objects":127,"num_object_clones":0,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"60'120","reported_seq":216,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.293210+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:03:08.293210+0000","last_peered":"2024-04-25T22:03:08.293210+0000","last_clean":"2024-04-25T22:03:08.293210+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:03:08.293210+0000","last_undegraded":"2024-04-25T22:03:08.293210+0000","last_fullsized":"2024-04-25T22:03:08.293210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437118,"num_objects":120,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'139","reported_seq":234,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:07.645735+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:03:07.645735+0000","last_peered":"2024-04-25T22:03:07.645735+0000","last_clean":"2024-04-25T22:03:07.645735+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:03:07.645735+0000","last_undegraded":"2024-04-25T22:03:07.645735+0000","last_fullsized":"2024-04-25T22:03:07.645735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591686,"num_objects":139,"num_object_clones":0,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'124","reported_seq":219,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.469908+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:03:08.469908+0000","last_peered":"2024-04-25T22:03:08.469908+0000","last_clean":"2024-04-25T22:03:08.469908+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:03:08.469908+0000","last_undegraded":"2024-04-25T22:03:08.469908+0000","last_fullsized":"2024-04-25T22:03:08.469908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":545314,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'142","reported_seq":174,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.156914+0000","last_change":"2024-04-25T22:02:49.886169+0000","last_active":"2024-04-25T22:03:08.156914+0000","last_peered":"2024-04-25T22:03:08.156914+0000","last_clean":"2024-04-25T22:03:08.156914+0000","last_became_active":"2024-04-25T22:02:49.884516+0000","last_became_peered":"2024-04-25T22:02:49.884516+0000","last_unstale":"2024-04-25T22:03:08.156914+0000","last_undegraded":"2024-04-25T22:03:08.156914+0000","last_fullsized":"2024-04-25T22:03:08.156914+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:21.251127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":624739,"num_objects":142,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"60'122","reported_seq":218,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.098982+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:03:08.098982+0000","last_peered":"2024-04-25T22:03:08.098982+0000","last_clean":"2024-04-25T22:03:08.098982+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:03:08.098982+0000","last_undegraded":"2024-04-25T22:03:08.098982+0000","last_fullsized":"2024-04-25T22:03:08.098982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":932585,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'138","reported_seq":170,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.490909+0000","last_change":"2024-04-25T22:02:49.876986+0000","last_active":"2024-04-25T22:03:08.490909+0000","last_peered":"2024-04-25T22:03:08.490909+0000","last_clean":"2024-04-25T22:03:08.490909+0000","last_became_active":"2024-04-25T22:02:49.876269+0000","last_became_peered":"2024-04-25T22:02:49.876269+0000","last_unstale":"2024-04-25T22:03:08.490909+0000","last_undegraded":"2024-04-25T22:03:08.490909+0000","last_fullsized":"2024-04-25T22:03:08.490909+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:35:35.547810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630606,"num_objects":138,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"60'138","reported_seq":170,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.409390+0000","last_change":"2024-04-25T22:02:49.881388+0000","last_active":"2024-04-25T22:03:08.409390+0000","last_peered":"2024-04-25T22:03:08.409390+0000","last_clean":"2024-04-25T22:03:08.409390+0000","last_became_active":"2024-04-25T22:02:49.880527+0000","last_became_peered":"2024-04-25T22:02:49.880527+0000","last_unstale":"2024-04-25T22:03:08.409390+0000","last_undegraded":"2024-04-25T22:03:08.409390+0000","last_fullsized":"2024-04-25T22:03:08.409390+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418047,"num_objects":138,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"60'147","reported_seq":243,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.217961+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:03:08.217961+0000","last_peered":"2024-04-25T22:03:08.217961+0000","last_clean":"2024-04-25T22:03:08.217961+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:03:08.217961+0000","last_undegraded":"2024-04-25T22:03:08.217961+0000","last_fullsized":"2024-04-25T22:03:08.217961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":673112,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'123","reported_seq":218,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.486029+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:03:08.486029+0000","last_peered":"2024-04-25T22:03:08.486029+0000","last_clean":"2024-04-25T22:03:08.486029+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:03:08.486029+0000","last_undegraded":"2024-04-25T22:03:08.486029+0000","last_fullsized":"2024-04-25T22:03:08.486029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714748,"num_objects":123,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"60'116","reported_seq":212,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.347810+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:03:08.347810+0000","last_peered":"2024-04-25T22:03:08.347810+0000","last_clean":"2024-04-25T22:03:08.347810+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:03:08.347810+0000","last_undegraded":"2024-04-25T22:03:08.347810+0000","last_fullsized":"2024-04-25T22:03:08.347810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576319,"num_objects":116,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'120","reported_seq":216,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:07.753305+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:03:07.753305+0000","last_peered":"2024-04-25T22:03:07.753305+0000","last_clean":"2024-04-25T22:03:07.753305+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:03:07.753305+0000","last_undegraded":"2024-04-25T22:03:07.753305+0000","last_fullsized":"2024-04-25T22:03:07.753305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":608384,"num_objects":120,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'138","reported_seq":170,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.337284+0000","last_change":"2024-04-25T22:02:49.885001+0000","last_active":"2024-04-25T22:03:08.337284+0000","last_peered":"2024-04-25T22:03:08.337284+0000","last_clean":"2024-04-25T22:03:08.337284+0000","last_became_active":"2024-04-25T22:02:49.883649+0000","last_became_peered":"2024-04-25T22:02:49.883649+0000","last_unstale":"2024-04-25T22:03:08.337284+0000","last_undegraded":"2024-04-25T22:03:08.337284+0000","last_fullsized":"2024-04-25T22:03:08.337284+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:07.474272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":541097,"num_objects":138,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'142","reported_seq":238,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.445255+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:03:08.445255+0000","last_peered":"2024-04-25T22:03:08.445255+0000","last_clean":"2024-04-25T22:03:08.445255+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:03:08.445255+0000","last_undegraded":"2024-04-25T22:03:08.445255+0000","last_fullsized":"2024-04-25T22:03:08.445255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":807418,"num_objects":142,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"60'144","reported_seq":182,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.064005+0000","last_change":"2024-04-25T22:02:43.850984+0000","last_active":"2024-04-25T22:03:08.064005+0000","last_peered":"2024-04-25T22:03:08.064005+0000","last_clean":"2024-04-25T22:03:08.064005+0000","last_became_active":"2024-04-25T22:02:43.850651+0000","last_became_peered":"2024-04-25T22:02:43.850651+0000","last_unstale":"2024-04-25T22:03:08.064005+0000","last_undegraded":"2024-04-25T22:03:08.064005+0000","last_fullsized":"2024-04-25T22:03:08.064005+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:08.019453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2131730,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":2160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"60'122","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.506009+0000","last_change":"2024-04-25T22:02:49.881928+0000","last_active":"2024-04-25T22:03:08.506009+0000","last_peered":"2024-04-25T22:03:08.506009+0000","last_clean":"2024-04-25T22:03:08.506009+0000","last_became_active":"2024-04-25T22:02:49.881638+0000","last_became_peered":"2024-04-25T22:02:49.881638+0000","last_unstale":"2024-04-25T22:03:08.506009+0000","last_undegraded":"2024-04-25T22:03:08.506009+0000","last_fullsized":"2024-04-25T22:03:08.506009+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:53:47.483774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":518122,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"60'4","reported_seq":101,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.696035+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:03:06.696035+0000","last_peered":"2024-04-25T22:03:06.696035+0000","last_clean":"2024-04-25T22:03:06.696035+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:03:06.696035+0000","last_undegraded":"2024-04-25T22:03:06.696035+0000","last_fullsized":"2024-04-25T22:03:06.696035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"60'113","reported_seq":145,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.299591+0000","last_change":"2024-04-25T22:02:49.882694+0000","last_active":"2024-04-25T22:03:08.299591+0000","last_peered":"2024-04-25T22:03:08.299591+0000","last_clean":"2024-04-25T22:03:08.299591+0000","last_became_active":"2024-04-25T22:02:49.882085+0000","last_became_peered":"2024-04-25T22:02:49.882085+0000","last_unstale":"2024-04-25T22:03:08.299591+0000","last_undegraded":"2024-04-25T22:03:08.299591+0000","last_fullsized":"2024-04-25T22:03:08.299591+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:56.743509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411864,"num_objects":113,"num_object_clones":0,"num_object_copies":226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":98,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.706957+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:03:06.706957+0000","last_peered":"2024-04-25T22:03:06.706957+0000","last_clean":"2024-04-25T22:03:06.706957+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:03:06.706957+0000","last_undegraded":"2024-04-25T22:03:06.706957+0000","last_fullsized":"2024-04-25T22:03:06.706957+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"60'137","reported_seq":238,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.095481+0000","last_change":"2024-04-25T22:03:05.707184+0000","last_active":"2024-04-25T22:03:08.095481+0000","last_peered":"2024-04-25T22:03:08.095481+0000","last_clean":"2024-04-25T22:03:08.095481+0000","last_became_active":"2024-04-25T22:03:05.704710+0000","last_became_peered":"2024-04-25T22:03:05.704710+0000","last_unstale":"2024-04-25T22:03:08.095481+0000","last_undegraded":"2024-04-25T22:03:08.095481+0000","last_fullsized":"2024-04-25T22:03:08.095481+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:53.632923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553024,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":31,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.695653+0000","last_change":"2024-04-25T22:02:49.881219+0000","last_active":"2024-04-25T22:03:06.695653+0000","last_peered":"2024-04-25T22:03:06.695653+0000","last_clean":"2024-04-25T22:03:06.695653+0000","last_became_active":"2024-04-25T22:02:49.880475+0000","last_became_peered":"2024-04-25T22:02:49.880475+0000","last_unstale":"2024-04-25T22:03:06.695653+0000","last_undegraded":"2024-04-25T22:03:06.695653+0000","last_fullsized":"2024-04-25T22:03:06.695653+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:49.944264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'122","reported_seq":218,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.546934+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:03:08.546934+0000","last_peered":"2024-04-25T22:03:08.546934+0000","last_clean":"2024-04-25T22:03:08.546934+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:03:08.546934+0000","last_undegraded":"2024-04-25T22:03:08.546934+0000","last_fullsized":"2024-04-25T22:03:08.546934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":596470,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":105,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.695490+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:03:06.695490+0000","last_peered":"2024-04-25T22:03:06.695490+0000","last_clean":"2024-04-25T22:03:06.695490+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:03:06.695490+0000","last_undegraded":"2024-04-25T22:03:06.695490+0000","last_fullsized":"2024-04-25T22:03:06.695490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":98,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.697073+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:03:06.697073+0000","last_peered":"2024-04-25T22:03:06.697073+0000","last_clean":"2024-04-25T22:03:06.697073+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:03:06.697073+0000","last_undegraded":"2024-04-25T22:03:06.697073+0000","last_fullsized":"2024-04-25T22:03:06.697073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'133","reported_seq":165,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.200811+0000","last_change":"2024-04-25T22:02:49.881394+0000","last_active":"2024-04-25T22:03:08.200811+0000","last_peered":"2024-04-25T22:03:08.200811+0000","last_clean":"2024-04-25T22:03:08.200811+0000","last_became_active":"2024-04-25T22:02:49.880690+0000","last_became_peered":"2024-04-25T22:02:49.880690+0000","last_unstale":"2024-04-25T22:03:08.200811+0000","last_undegraded":"2024-04-25T22:03:08.200811+0000","last_fullsized":"2024-04-25T22:03:08.200811+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:31:39.262571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666906,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":42,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.696835+0000","last_change":"2024-04-25T22:02:49.884340+0000","last_active":"2024-04-25T22:03:06.696835+0000","last_peered":"2024-04-25T22:03:06.696835+0000","last_clean":"2024-04-25T22:03:06.696835+0000","last_became_active":"2024-04-25T22:02:49.883397+0000","last_became_peered":"2024-04-25T22:02:49.883397+0000","last_unstale":"2024-04-25T22:03:06.696835+0000","last_undegraded":"2024-04-25T22:03:06.696835+0000","last_fullsized":"2024-04-25T22:03:06.696835+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:55.740324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"60'148","reported_seq":180,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.248451+0000","last_change":"2024-04-25T22:02:49.877784+0000","last_active":"2024-04-25T22:03:08.248451+0000","last_peered":"2024-04-25T22:03:08.248451+0000","last_clean":"2024-04-25T22:03:08.248451+0000","last_became_active":"2024-04-25T22:02:49.876644+0000","last_became_peered":"2024-04-25T22:02:49.876644+0000","last_unstale":"2024-04-25T22:03:08.248451+0000","last_undegraded":"2024-04-25T22:03:08.248451+0000","last_fullsized":"2024-04-25T22:03:08.248451+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:50.947449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388355,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":1431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":97,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.697381+0000","last_change":"2024-04-25T22:02:49.885084+0000","last_active":"2024-04-25T22:03:06.697381+0000","last_peered":"2024-04-25T22:03:06.697381+0000","last_clean":"2024-04-25T22:03:06.697381+0000","last_became_active":"2024-04-25T22:02:49.883048+0000","last_became_peered":"2024-04-25T22:02:49.883048+0000","last_unstale":"2024-04-25T22:03:06.697381+0000","last_undegraded":"2024-04-25T22:03:06.697381+0000","last_fullsized":"2024-04-25T22:03:06.697381+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:12.276434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'129","reported_seq":224,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.140303+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:03:08.140303+0000","last_peered":"2024-04-25T22:03:08.140303+0000","last_clean":"2024-04-25T22:03:08.140303+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:03:08.140303+0000","last_undegraded":"2024-04-25T22:03:08.140303+0000","last_fullsized":"2024-04-25T22:03:08.140303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":513655,"num_objects":129,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.706713+0000","last_change":"2024-04-25T22:02:43.853012+0000","last_active":"2024-04-25T22:03:06.706713+0000","last_peered":"2024-04-25T22:03:06.706713+0000","last_clean":"2024-04-25T22:03:06.706713+0000","last_became_active":"2024-04-25T22:02:43.852338+0000","last_became_peered":"2024-04-25T22:02:43.852338+0000","last_unstale":"2024-04-25T22:03:06.706713+0000","last_undegraded":"2024-04-25T22:03:06.706713+0000","last_fullsized":"2024-04-25T22:03:06.706713+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:07.951790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"60'136","reported_seq":232,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:07.320317+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:03:07.320317+0000","last_peered":"2024-04-25T22:03:07.320317+0000","last_clean":"2024-04-25T22:03:07.320317+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:03:07.320317+0000","last_undegraded":"2024-04-25T22:03:07.320317+0000","last_fullsized":"2024-04-25T22:03:07.320317+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476055,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"54'60","reported_seq":158,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.707891+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:03:06.707891+0000","last_peered":"2024-04-25T22:03:06.707891+0000","last_clean":"2024-04-25T22:03:06.707891+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:03:06.707891+0000","last_undegraded":"2024-04-25T22:03:06.707891+0000","last_fullsized":"2024-04-25T22:03:06.707891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'142","reported_seq":180,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.228517+0000","last_change":"2024-04-25T22:02:43.853286+0000","last_active":"2024-04-25T22:03:08.228517+0000","last_peered":"2024-04-25T22:03:08.228517+0000","last_clean":"2024-04-25T22:03:08.228517+0000","last_became_active":"2024-04-25T22:02:43.852555+0000","last_became_peered":"2024-04-25T22:02:43.852555+0000","last_unstale":"2024-04-25T22:03:08.228517+0000","last_undegraded":"2024-04-25T22:03:08.228517+0000","last_fullsized":"2024-04-25T22:03:08.228517+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:42:10.005523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433182,"num_objects":142,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":97,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.696494+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:03:06.696494+0000","last_peered":"2024-04-25T22:03:06.696494+0000","last_clean":"2024-04-25T22:03:06.696494+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:03:06.696494+0000","last_undegraded":"2024-04-25T22:03:06.696494+0000","last_fullsized":"2024-04-25T22:03:06.696494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'134","reported_seq":229,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:07.958730+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:03:07.958730+0000","last_peered":"2024-04-25T22:03:07.958730+0000","last_clean":"2024-04-25T22:03:07.958730+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:03:07.958730+0000","last_undegraded":"2024-04-25T22:03:07.958730+0000","last_fullsized":"2024-04-25T22:03:07.958730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":508227,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.695376+0000","last_change":"2024-04-25T22:02:49.884995+0000","last_active":"2024-04-25T22:03:06.695376+0000","last_peered":"2024-04-25T22:03:06.695376+0000","last_clean":"2024-04-25T22:03:06.695376+0000","last_became_active":"2024-04-25T22:02:49.883112+0000","last_became_peered":"2024-04-25T22:02:49.883112+0000","last_unstale":"2024-04-25T22:03:06.695376+0000","last_undegraded":"2024-04-25T22:03:06.695376+0000","last_fullsized":"2024-04-25T22:03:06.695376+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:45.254613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"60'117","reported_seq":212,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.356505+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:03:08.356505+0000","last_peered":"2024-04-25T22:03:08.356505+0000","last_clean":"2024-04-25T22:03:08.356505+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:03:08.356505+0000","last_undegraded":"2024-04-25T22:03:08.356505+0000","last_fullsized":"2024-04-25T22:03:08.356505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399227,"num_objects":117,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.705437+0000","last_change":"2024-04-25T22:02:49.878347+0000","last_active":"2024-04-25T22:03:06.705437+0000","last_peered":"2024-04-25T22:03:06.705437+0000","last_clean":"2024-04-25T22:03:06.705437+0000","last_became_active":"2024-04-25T22:02:49.876980+0000","last_became_peered":"2024-04-25T22:02:49.876980+0000","last_unstale":"2024-04-25T22:03:06.705437+0000","last_undegraded":"2024-04-25T22:03:06.705437+0000","last_fullsized":"2024-04-25T22:03:06.705437+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:49.595210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'122","reported_seq":218,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.419122+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:03:08.419122+0000","last_peered":"2024-04-25T22:03:08.419122+0000","last_clean":"2024-04-25T22:03:08.419122+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:03:08.419122+0000","last_undegraded":"2024-04-25T22:03:08.419122+0000","last_fullsized":"2024-04-25T22:03:08.419122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399633,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":306,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.695812+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:03:06.695812+0000","last_peered":"2024-04-25T22:03:06.695812+0000","last_clean":"2024-04-25T22:03:06.695812+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:03:06.695812+0000","last_undegraded":"2024-04-25T22:03:06.695812+0000","last_fullsized":"2024-04-25T22:03:06.695812+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":103,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.696137+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:03:06.696137+0000","last_peered":"2024-04-25T22:03:06.696137+0000","last_clean":"2024-04-25T22:03:06.696137+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:03:06.696137+0000","last_undegraded":"2024-04-25T22:03:06.696137+0000","last_fullsized":"2024-04-25T22:03:06.696137+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"57'1","reported_seq":99,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.707474+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:03:06.707474+0000","last_peered":"2024-04-25T22:03:06.707474+0000","last_clean":"2024-04-25T22:03:06.707474+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:03:06.707474+0000","last_undegraded":"2024-04-25T22:03:06.707474+0000","last_fullsized":"2024-04-25T22:03:06.707474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'131","reported_seq":226,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.540429+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:03:08.540429+0000","last_peered":"2024-04-25T22:03:08.540429+0000","last_clean":"2024-04-25T22:03:08.540429+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:03:08.540429+0000","last_undegraded":"2024-04-25T22:03:08.540429+0000","last_fullsized":"2024-04-25T22:03:08.540429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438444,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":103,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.695674+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:03:06.695674+0000","last_peered":"2024-04-25T22:03:06.695674+0000","last_clean":"2024-04-25T22:03:06.695674+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:03:06.695674+0000","last_undegraded":"2024-04-25T22:03:06.695674+0000","last_fullsized":"2024-04-25T22:03:06.695674+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":98,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.706190+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:03:06.706190+0000","last_peered":"2024-04-25T22:03:06.706190+0000","last_clean":"2024-04-25T22:03:06.706190+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:03:06.706190+0000","last_undegraded":"2024-04-25T22:03:06.706190+0000","last_fullsized":"2024-04-25T22:03:06.706190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'137","reported_seq":173,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.532651+0000","last_change":"2024-04-25T22:03:05.702224+0000","last_active":"2024-04-25T22:03:08.532651+0000","last_peered":"2024-04-25T22:03:08.532651+0000","last_clean":"2024-04-25T22:03:08.532651+0000","last_became_active":"2024-04-25T22:03:05.699581+0000","last_became_peered":"2024-04-25T22:03:05.699581+0000","last_unstale":"2024-04-25T22:03:08.532651+0000","last_undegraded":"2024-04-25T22:03:08.532651+0000","last_fullsized":"2024-04-25T22:03:08.532651+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497486,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.706954+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:03:06.706954+0000","last_peered":"2024-04-25T22:03:06.706954+0000","last_clean":"2024-04-25T22:03:06.706954+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:03:06.706954+0000","last_undegraded":"2024-04-25T22:03:06.706954+0000","last_fullsized":"2024-04-25T22:03:06.706954+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"59'2","reported_seq":100,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.695774+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:03:06.695774+0000","last_peered":"2024-04-25T22:03:06.695774+0000","last_clean":"2024-04-25T22:03:06.695774+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:03:06.695774+0000","last_undegraded":"2024-04-25T22:03:06.695774+0000","last_fullsized":"2024-04-25T22:03:06.695774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'125","reported_seq":221,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.503019+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:03:08.503019+0000","last_peered":"2024-04-25T22:03:08.503019+0000","last_clean":"2024-04-25T22:03:08.503019+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:03:08.503019+0000","last_undegraded":"2024-04-25T22:03:08.503019+0000","last_fullsized":"2024-04-25T22:03:08.503019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":500088,"num_objects":125,"num_object_clones":0,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":103,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.696977+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:03:06.696977+0000","last_peered":"2024-04-25T22:03:06.696977+0000","last_clean":"2024-04-25T22:03:06.696977+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:03:06.696977+0000","last_undegraded":"2024-04-25T22:03:06.696977+0000","last_fullsized":"2024-04-25T22:03:06.696977+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.706913+0000","last_change":"2024-04-25T22:02:43.851416+0000","last_active":"2024-04-25T22:03:06.706913+0000","last_peered":"2024-04-25T22:03:06.706913+0000","last_clean":"2024-04-25T22:03:06.706913+0000","last_became_active":"2024-04-25T22:02:43.850822+0000","last_became_peered":"2024-04-25T22:02:43.850822+0000","last_unstale":"2024-04-25T22:03:06.706913+0000","last_undegraded":"2024-04-25T22:03:06.706913+0000","last_fullsized":"2024-04-25T22:03:06.706913+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:56:58.100216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"60'123","reported_seq":219,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.416549+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:03:08.416549+0000","last_peered":"2024-04-25T22:03:08.416549+0000","last_clean":"2024-04-25T22:03:08.416549+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:03:08.416549+0000","last_undegraded":"2024-04-25T22:03:08.416549+0000","last_fullsized":"2024-04-25T22:03:08.416549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":690237,"num_objects":123,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":97,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.698144+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:03:06.698144+0000","last_peered":"2024-04-25T22:03:06.698144+0000","last_clean":"2024-04-25T22:03:06.698144+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:03:06.698144+0000","last_undegraded":"2024-04-25T22:03:06.698144+0000","last_fullsized":"2024-04-25T22:03:06.698144+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":104,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.708185+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:03:06.708185+0000","last_peered":"2024-04-25T22:03:06.708185+0000","last_clean":"2024-04-25T22:03:06.708185+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:03:06.708185+0000","last_undegraded":"2024-04-25T22:03:06.708185+0000","last_fullsized":"2024-04-25T22:03:06.708185+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"60'121","reported_seq":153,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.424005+0000","last_change":"2024-04-25T22:02:49.884459+0000","last_active":"2024-04-25T22:03:08.424005+0000","last_peered":"2024-04-25T22:03:08.424005+0000","last_clean":"2024-04-25T22:03:08.424005+0000","last_became_active":"2024-04-25T22:02:49.883467+0000","last_became_peered":"2024-04-25T22:02:49.883467+0000","last_unstale":"2024-04-25T22:03:08.424005+0000","last_undegraded":"2024-04-25T22:03:08.424005+0000","last_fullsized":"2024-04-25T22:03:08.424005+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:31.024577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":475299,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":98,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.708048+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:03:06.708048+0000","last_peered":"2024-04-25T22:03:06.708048+0000","last_clean":"2024-04-25T22:03:06.708048+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:03:06.708048+0000","last_undegraded":"2024-04-25T22:03:06.708048+0000","last_fullsized":"2024-04-25T22:03:06.708048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.697621+0000","last_change":"2024-04-25T22:03:05.701809+0000","last_active":"2024-04-25T22:03:06.697621+0000","last_peered":"2024-04-25T22:03:06.697621+0000","last_clean":"2024-04-25T22:03:06.697621+0000","last_became_active":"2024-04-25T22:03:05.701322+0000","last_became_peered":"2024-04-25T22:03:05.701322+0000","last_unstale":"2024-04-25T22:03:06.697621+0000","last_undegraded":"2024-04-25T22:03:06.697621+0000","last_fullsized":"2024-04-25T22:03:06.697621+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:45.907458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"60'122","reported_seq":218,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:07.958647+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:03:07.958647+0000","last_peered":"2024-04-25T22:03:07.958647+0000","last_clean":"2024-04-25T22:03:07.958647+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:03:07.958647+0000","last_undegraded":"2024-04-25T22:03:07.958647+0000","last_fullsized":"2024-04-25T22:03:07.958647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473924,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":100,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.708678+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:03:06.708678+0000","last_peered":"2024-04-25T22:03:06.708678+0000","last_clean":"2024-04-25T22:03:06.708678+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:03:06.708678+0000","last_undegraded":"2024-04-25T22:03:06.708678+0000","last_fullsized":"2024-04-25T22:03:06.708678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":104,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.708305+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:03:06.708305+0000","last_peered":"2024-04-25T22:03:06.708305+0000","last_clean":"2024-04-25T22:03:06.708305+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:03:06.708305+0000","last_undegraded":"2024-04-25T22:03:06.708305+0000","last_fullsized":"2024-04-25T22:03:06.708305+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'131","reported_seq":227,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.341815+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:03:08.341815+0000","last_peered":"2024-04-25T22:03:08.341815+0000","last_clean":"2024-04-25T22:03:08.341815+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:03:08.341815+0000","last_undegraded":"2024-04-25T22:03:08.341815+0000","last_fullsized":"2024-04-25T22:03:08.341815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":460663,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"60'20","reported_seq":118,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.708307+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:03:06.708307+0000","last_peered":"2024-04-25T22:03:06.708307+0000","last_clean":"2024-04-25T22:03:06.708307+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:03:06.708307+0000","last_undegraded":"2024-04-25T22:03:06.708307+0000","last_fullsized":"2024-04-25T22:03:06.708307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":103,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.697115+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:03:06.697115+0000","last_peered":"2024-04-25T22:03:06.697115+0000","last_clean":"2024-04-25T22:03:06.697115+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:03:06.697115+0000","last_undegraded":"2024-04-25T22:03:06.697115+0000","last_fullsized":"2024-04-25T22:03:06.697115+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"60'111","reported_seq":143,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.301955+0000","last_change":"2024-04-25T22:02:49.881600+0000","last_active":"2024-04-25T22:03:08.301955+0000","last_peered":"2024-04-25T22:03:08.301955+0000","last_clean":"2024-04-25T22:03:08.301955+0000","last_became_active":"2024-04-25T22:02:49.880681+0000","last_became_peered":"2024-04-25T22:02:49.880681+0000","last_unstale":"2024-04-25T22:03:08.301955+0000","last_undegraded":"2024-04-25T22:03:08.301955+0000","last_fullsized":"2024-04-25T22:03:08.301955+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.432134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":675035,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'122","reported_seq":217,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.207589+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:03:08.207589+0000","last_peered":"2024-04-25T22:03:08.207589+0000","last_clean":"2024-04-25T22:03:08.207589+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:03:08.207589+0000","last_undegraded":"2024-04-25T22:03:08.207589+0000","last_fullsized":"2024-04-25T22:03:08.207589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2846168,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":2845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"60'22","reported_seq":119,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.696398+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:03:06.696398+0000","last_peered":"2024-04-25T22:03:06.696398+0000","last_clean":"2024-04-25T22:03:06.696398+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:03:06.696398+0000","last_undegraded":"2024-04-25T22:03:06.696398+0000","last_fullsized":"2024-04-25T22:03:06.696398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"60'121","reported_seq":217,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.023416+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:03:08.023416+0000","last_peered":"2024-04-25T22:03:08.023416+0000","last_clean":"2024-04-25T22:03:08.023416+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:03:08.023416+0000","last_undegraded":"2024-04-25T22:03:08.023416+0000","last_fullsized":"2024-04-25T22:03:08.023416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":523562,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":101,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.697350+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:03:06.697350+0000","last_peered":"2024-04-25T22:03:06.697350+0000","last_clean":"2024-04-25T22:03:06.697350+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:03:06.697350+0000","last_undegraded":"2024-04-25T22:03:06.697350+0000","last_fullsized":"2024-04-25T22:03:06.697350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.707360+0000","last_change":"2024-04-25T22:02:43.852674+0000","last_active":"2024-04-25T22:03:06.707360+0000","last_peered":"2024-04-25T22:03:06.707360+0000","last_clean":"2024-04-25T22:03:06.707360+0000","last_became_active":"2024-04-25T22:02:43.852292+0000","last_became_peered":"2024-04-25T22:02:43.852292+0000","last_unstale":"2024-04-25T22:03:06.707360+0000","last_undegraded":"2024-04-25T22:03:06.707360+0000","last_fullsized":"2024-04-25T22:03:06.707360+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:57.388397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"60'147","reported_seq":243,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.305308+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:03:08.305308+0000","last_peered":"2024-04-25T22:03:08.305308+0000","last_clean":"2024-04-25T22:03:08.305308+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:03:08.305308+0000","last_undegraded":"2024-04-25T22:03:08.305308+0000","last_fullsized":"2024-04-25T22:03:08.305308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1276588,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":1317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":98,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.708389+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:03:06.708389+0000","last_peered":"2024-04-25T22:03:06.708389+0000","last_clean":"2024-04-25T22:03:06.708389+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:03:06.708389+0000","last_undegraded":"2024-04-25T22:03:06.708389+0000","last_fullsized":"2024-04-25T22:03:06.708389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'142","reported_seq":238,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.286129+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:03:08.286129+0000","last_peered":"2024-04-25T22:03:08.286129+0000","last_clean":"2024-04-25T22:03:08.286129+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:03:08.286129+0000","last_undegraded":"2024-04-25T22:03:08.286129+0000","last_fullsized":"2024-04-25T22:03:08.286129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5021234,"num_objects":142,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'120","reported_seq":152,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.069234+0000","last_change":"2024-04-25T22:02:49.884155+0000","last_active":"2024-04-25T22:03:08.069234+0000","last_peered":"2024-04-25T22:03:08.069234+0000","last_clean":"2024-04-25T22:03:08.069234+0000","last_became_active":"2024-04-25T22:02:49.883314+0000","last_became_peered":"2024-04-25T22:02:49.883314+0000","last_unstale":"2024-04-25T22:03:08.069234+0000","last_undegraded":"2024-04-25T22:03:08.069234+0000","last_fullsized":"2024-04-25T22:03:08.069234+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:53:47.483774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1024817,"num_objects":120,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":1063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":98,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.706113+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:03:06.706113+0000","last_peered":"2024-04-25T22:03:06.706113+0000","last_clean":"2024-04-25T22:03:06.706113+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:03:06.706113+0000","last_undegraded":"2024-04-25T22:03:06.706113+0000","last_fullsized":"2024-04-25T22:03:06.706113+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'128","reported_seq":224,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.402676+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:03:08.402676+0000","last_peered":"2024-04-25T22:03:08.402676+0000","last_clean":"2024-04-25T22:03:08.402676+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:03:08.402676+0000","last_undegraded":"2024-04-25T22:03:08.402676+0000","last_fullsized":"2024-04-25T22:03:08.402676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442140,"num_objects":128,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":98,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.705952+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:03:06.705952+0000","last_peered":"2024-04-25T22:03:06.705952+0000","last_clean":"2024-04-25T22:03:06.705952+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:03:06.705952+0000","last_undegraded":"2024-04-25T22:03:06.705952+0000","last_fullsized":"2024-04-25T22:03:06.705952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"60'122","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.374674+0000","last_change":"2024-04-25T22:02:49.887569+0000","last_active":"2024-04-25T22:03:08.374674+0000","last_peered":"2024-04-25T22:03:08.374674+0000","last_clean":"2024-04-25T22:03:08.374674+0000","last_became_active":"2024-04-25T22:02:49.886732+0000","last_became_peered":"2024-04-25T22:02:49.886732+0000","last_unstale":"2024-04-25T22:03:08.374674+0000","last_undegraded":"2024-04-25T22:03:08.374674+0000","last_fullsized":"2024-04-25T22:03:08.374674+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:38.761184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401443,"num_objects":122,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"57'3","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.696441+0000","last_change":"2024-04-25T22:03:05.702244+0000","last_active":"2024-04-25T22:03:06.696441+0000","last_peered":"2024-04-25T22:03:06.696441+0000","last_clean":"2024-04-25T22:03:06.696441+0000","last_became_active":"2024-04-25T22:03:05.701350+0000","last_became_peered":"2024-04-25T22:03:05.701350+0000","last_unstale":"2024-04-25T22:03:06.696441+0000","last_undegraded":"2024-04-25T22:03:06.696441+0000","last_fullsized":"2024-04-25T22:03:06.696441+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:31:38.259386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'124","reported_seq":156,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.154303+0000","last_change":"2024-04-25T22:02:49.882913+0000","last_active":"2024-04-25T22:03:08.154303+0000","last_peered":"2024-04-25T22:03:08.154303+0000","last_clean":"2024-04-25T22:03:08.154303+0000","last_became_active":"2024-04-25T22:02:49.882175+0000","last_became_peered":"2024-04-25T22:02:49.882175+0000","last_unstale":"2024-04-25T22:03:08.154303+0000","last_undegraded":"2024-04-25T22:03:08.154303+0000","last_fullsized":"2024-04-25T22:03:08.154303+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:31.024577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559259,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"53'4","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.695573+0000","last_change":"2024-04-25T22:02:49.886319+0000","last_active":"2024-04-25T22:03:06.695573+0000","last_peered":"2024-04-25T22:03:06.695573+0000","last_clean":"2024-04-25T22:03:06.695573+0000","last_became_active":"2024-04-25T22:02:49.884039+0000","last_became_peered":"2024-04-25T22:02:49.884039+0000","last_unstale":"2024-04-25T22:03:06.695573+0000","last_undegraded":"2024-04-25T22:03:06.695573+0000","last_fullsized":"2024-04-25T22:03:06.695573+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:11.405616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'119","reported_seq":157,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:07.950181+0000","last_change":"2024-04-25T22:02:43.850869+0000","last_active":"2024-04-25T22:03:07.950181+0000","last_peered":"2024-04-25T22:03:07.950181+0000","last_clean":"2024-04-25T22:03:07.950181+0000","last_became_active":"2024-04-25T22:02:43.850568+0000","last_became_peered":"2024-04-25T22:02:43.850568+0000","last_unstale":"2024-04-25T22:03:07.950181+0000","last_undegraded":"2024-04-25T22:03:07.950181+0000","last_fullsized":"2024-04-25T22:03:07.950181+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:10:32.881419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368783,"num_objects":119,"num_object_clones":0,"num_object_copies":238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":48,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.706476+0000","last_change":"2024-04-25T22:02:43.853253+0000","last_active":"2024-04-25T22:03:06.706476+0000","last_peered":"2024-04-25T22:03:06.706476+0000","last_clean":"2024-04-25T22:03:06.706476+0000","last_became_active":"2024-04-25T22:02:43.852769+0000","last_became_peered":"2024-04-25T22:02:43.852769+0000","last_unstale":"2024-04-25T22:03:06.706476+0000","last_undegraded":"2024-04-25T22:03:06.706476+0000","last_fullsized":"2024-04-25T22:03:06.706476+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:51:36.457092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"60'138","reported_seq":176,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.454132+0000","last_change":"2024-04-25T22:02:43.852778+0000","last_active":"2024-04-25T22:03:08.454132+0000","last_peered":"2024-04-25T22:03:08.454132+0000","last_clean":"2024-04-25T22:03:08.454132+0000","last_became_active":"2024-04-25T22:02:43.852263+0000","last_became_peered":"2024-04-25T22:02:43.852263+0000","last_unstale":"2024-04-25T22:03:08.454132+0000","last_undegraded":"2024-04-25T22:03:08.454132+0000","last_fullsized":"2024-04-25T22:03:08.454132+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:10:40.487543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396933,"num_objects":138,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"60'7","reported_seq":47,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.852106+0000","last_change":"2024-04-25T22:02:49.887527+0000","last_active":"2024-04-25T22:03:06.852106+0000","last_peered":"2024-04-25T22:03:06.852106+0000","last_clean":"2024-04-25T22:03:06.852106+0000","last_became_active":"2024-04-25T22:02:49.886150+0000","last_became_peered":"2024-04-25T22:02:49.886150+0000","last_unstale":"2024-04-25T22:03:06.852106+0000","last_undegraded":"2024-04-25T22:03:06.852106+0000","last_fullsized":"2024-04-25T22:03:06.852106+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:23:43.687342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"60'139","reported_seq":171,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.452231+0000","last_change":"2024-04-25T22:02:49.876491+0000","last_active":"2024-04-25T22:03:08.452231+0000","last_peered":"2024-04-25T22:03:08.452231+0000","last_clean":"2024-04-25T22:03:08.452231+0000","last_became_active":"2024-04-25T22:02:49.876169+0000","last_became_peered":"2024-04-25T22:02:49.876169+0000","last_unstale":"2024-04-25T22:03:08.452231+0000","last_undegraded":"2024-04-25T22:03:08.452231+0000","last_fullsized":"2024-04-25T22:03:08.452231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:56:41.591010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540186,"num_objects":139,"num_object_clones":0,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"59'56","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.708008+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:03:06.708008+0000","last_peered":"2024-04-25T22:03:06.708008+0000","last_clean":"2024-04-25T22:03:06.708008+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:03:06.708008+0000","last_undegraded":"2024-04-25T22:03:06.708008+0000","last_fullsized":"2024-04-25T22:03:06.708008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'151","reported_seq":246,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:08.342596+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:03:08.342596+0000","last_peered":"2024-04-25T22:03:08.342596+0000","last_clean":"2024-04-25T22:03:08.342596+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:03:08.342596+0000","last_undegraded":"2024-04-25T22:03:08.342596+0000","last_fullsized":"2024-04-25T22:03:08.342596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489584,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"55'6","reported_seq":104,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-25T22:03:06.708067+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:03:06.708067+0000","last_peered":"2024-04-25T22:03:06.708067+0000","last_clean":"2024-04-25T22:03:06.708067+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:03:06.708067+0000","last_undegraded":"2024-04-25T22:03:06.708067+0000","last_fullsized":"2024-04-25T22:03:06.708067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":50596750,"num_objects":8264,"num_object_clones":0,"num_object_copies":16528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8264,"num_write_kb":53781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":108187648,"data_stored":101197495,"data_compressed":8244422,"data_compressed_allocated":11649024,"data_compressed_original":44105728,"omap_allocated":0,"internal_metadata":0},"log_size":8265,"ondisk_log_size":8265,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":29361598,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":29534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7970816,"data_stored":58723196,"data_compressed":4986736,"data_compressed_allocated":7249920,"data_compressed_original":58056704,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738399,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76396,"kb_used_data":41060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94295444,"statfs":{"total":96636764160,"available":96558534656,"internally_reserved":0,"allocated":42045440,"data_stored":57071031,"data_compressed":4566089,"data_compressed_allocated":6397952,"data_compressed_original":34426880,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738398,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71668,"kb_used_data":36324,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94300172,"statfs":{"total":96636764160,"available":96563376128,"internally_reserved":0,"allocated":37195776,"data_stored":50240587,"data_compressed":4158362,"data_compressed_allocated":6082560,"data_compressed_original":33030144,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738399,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71996,"kb_used_data":36656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94299844,"statfs":{"total":96636764160,"available":96563040256,"internally_reserved":0,"allocated":37535744,"data_stored":54088063,"data_compressed":4517037,"data_compressed_allocated":6483968,"data_compressed_original":35835904,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2863104,"data_stored":20972990,"data_compressed":1815296,"data_compressed_allocated":2625536,"data_compressed_original":20762624,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2326528,"data_stored":16777832,"data_compressed":1392983,"data_compressed_allocated":2048000,"data_compressed_original":16506880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2781184,"data_stored":20972374,"data_compressed":1778457,"data_compressed_allocated":2576384,"data_compressed_original":20787200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34320384,"data_stored":32386477,"data_compressed":2696576,"data_compressed_allocated":3825664,"data_compressed_original":14508032,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":35033088,"data_stored":33493903,"data_compressed":2768421,"data_compressed_allocated":4038656,"data_compressed_original":16531456,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38834176,"data_stored":35317115,"data_compressed":2779425,"data_compressed_allocated":3784704,"data_compressed_original":13066240,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:03:13.514 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T22:03:13.515 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:03:13.515 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-25T22:03:13.515 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-25T22:03:13.515 INFO:tasks.workunit.client.0.smithi044.stdout:5/18: unlink d2/c7 0 2024-04-25T22:03:13.515 INFO:tasks.workunit.client.0.smithi044.stdout:2/8: rename f1 to f4 0 2024-04-25T22:03:13.521 INFO:tasks.workunit.client.0.smithi044.stdout:0/9: getdents . 0 2024-04-25T22:03:13.521 INFO:tasks.workunit.client.0.smithi044.stdout:2/9: write f0 [4945222,115433] 0 2024-04-25T22:03:13.521 INFO:tasks.workunit.client.0.smithi044.stdout:6/18: rename d2/c5 to d2/c7 0 2024-04-25T22:03:13.521 INFO:tasks.workunit.client.0.smithi044.stdout:8/4: truncate f0 549117 0 2024-04-25T22:03:13.523 INFO:tasks.workunit.client.0.smithi044.stdout:6/19: mkdir d2/d8 0 2024-04-25T22:03:13.523 INFO:tasks.workunit.client.0.smithi044.stdout:8/5: rmdir d1 0 2024-04-25T22:03:13.523 INFO:tasks.workunit.client.0.smithi044.stdout:6/20: rename c0 to d2/d8/c9 0 2024-04-25T22:03:13.523 INFO:tasks.workunit.client.0.smithi044.stdout:6/21: creat d2/d8/fa x:0 0 0 2024-04-25T22:03:13.526 INFO:tasks.workunit.client.0.smithi044.stdout:2/10: dread f4 [0,4194304] 0 2024-04-25T22:03:13.526 INFO:tasks.workunit.client.0.smithi044.stdout:2/11: mknod c5 0 2024-04-25T22:03:13.527 INFO:tasks.workunit.client.0.smithi044.stdout:2/12: chown f4 81677978 1 2024-04-25T22:03:13.528 INFO:tasks.workunit.client.0.smithi044.stdout:2/13: write f0 [542918,116633] 0 2024-04-25T22:03:13.528 INFO:tasks.workunit.client.0.smithi044.stdout:0/10: dwrite f0 [0,4194304] 0 2024-04-25T22:03:13.529 INFO:tasks.workunit.client.0.smithi044.stdout:0/11: getdents . 0 2024-04-25T22:03:13.535 INFO:tasks.workunit.client.0.smithi044.stdout:0/12: dwrite f1 [0,4194304] 0 2024-04-25T22:03:13.536 INFO:tasks.workunit.client.0.smithi044.stdout:0/13: stat f0 0 2024-04-25T22:03:13.537 INFO:tasks.workunit.client.0.smithi044.stdout:6/22: getdents d2 0 2024-04-25T22:03:13.538 INFO:tasks.workunit.client.0.smithi044.stdout:6/23: rename d2/c3 to d2/d8/cb 0 2024-04-25T22:03:13.538 INFO:tasks.workunit.client.0.smithi044.stdout:2/14: getdents . 0 2024-04-25T22:03:13.538 INFO:tasks.workunit.client.0.smithi044.stdout:2/15: chown c5 0 1 2024-04-25T22:03:13.539 INFO:tasks.workunit.client.0.smithi044.stdout:2/16: chown f4 825770 1 2024-04-25T22:03:13.546 INFO:tasks.workunit.client.0.smithi044.stdout:2/17: dwrite f3 [0,4194304] 0 2024-04-25T22:03:13.571 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:13.568+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:13.579 INFO:tasks.workunit.client.0.smithi044.stdout:0/14: truncate f0 449540 0 2024-04-25T22:03:13.580 INFO:tasks.workunit.client.0.smithi044.stdout:8/6: truncate f0 232599 0 2024-04-25T22:03:13.580 INFO:tasks.workunit.client.0.smithi044.stdout:6/24: rename d2/d8/cb to d2/cc 0 2024-04-25T22:03:13.580 INFO:tasks.workunit.client.0.smithi044.stdout:6/25: fdatasync d2/d8/fa 0 2024-04-25T22:03:13.581 INFO:tasks.workunit.client.0.smithi044.stdout:8/7: chown f0 56969169 1 2024-04-25T22:03:13.584 INFO:tasks.workunit.client.0.smithi044.stdout:2/18: dwrite f3 [4194304,4194304] 0 2024-04-25T22:03:13.588 INFO:tasks.workunit.client.0.smithi044.stdout:2/19: dread f4 [0,4194304] 0 2024-04-25T22:03:13.589 INFO:tasks.workunit.client.0.smithi044.stdout:2/20: creat f6 x:0 0 0 2024-04-25T22:03:13.589 INFO:tasks.workunit.client.0.smithi044.stdout:2/21: dread - f6 zero size 2024-04-25T22:03:13.595 INFO:tasks.workunit.client.0.smithi044.stdout:8/8: dwrite f0 [0,4194304] 0 2024-04-25T22:03:13.596 INFO:tasks.workunit.client.0.smithi044.stdout:8/9: chown f0 68668 1 2024-04-25T22:03:13.597 INFO:tasks.workunit.client.0.smithi044.stdout:8/10: stat f0 0 2024-04-25T22:03:13.597 INFO:tasks.workunit.client.0.smithi044.stdout:2/22: dwrite f6 [0,4194304] 0 2024-04-25T22:03:13.597 INFO:tasks.workunit.client.0.smithi044.stdout:2/23: chown c2 9 1 2024-04-25T22:03:13.598 INFO:tasks.workunit.client.0.smithi044.stdout:2/24: write f6 [1151027,63600] 0 2024-04-25T22:03:13.598 INFO:tasks.workunit.client.0.smithi044.stdout:2/25: chown f6 1514516 1 2024-04-25T22:03:13.599 INFO:tasks.workunit.client.0.smithi044.stdout:2/26: mkdir d7 0 2024-04-25T22:03:13.605 INFO:tasks.workunit.client.0.smithi044.stdout:2/27: dread f4 [0,4194304] 0 2024-04-25T22:03:13.605 INFO:tasks.workunit.client.0.smithi044.stdout:2/28: chown d7 61241 1 2024-04-25T22:03:13.605 INFO:tasks.workunit.client.0.smithi044.stdout:8/11: dwrite f0 [0,4194304] 0 2024-04-25T22:03:13.606 INFO:tasks.workunit.client.0.smithi044.stdout:8/12: creat f2 x:0 0 0 2024-04-25T22:03:13.606 INFO:tasks.workunit.client.0.smithi044.stdout:8/13: creat f3 x:0 0 0 2024-04-25T22:03:13.607 INFO:tasks.workunit.client.0.smithi044.stdout:8/14: read f0 [3825727,112194] 0 2024-04-25T22:03:13.607 INFO:tasks.workunit.client.0.smithi044.stdout:8/15: creat f4 x:0 0 0 2024-04-25T22:03:13.608 INFO:tasks.workunit.client.0.smithi044.stdout:8/16: link f2 f5 0 2024-04-25T22:03:13.608 INFO:tasks.workunit.client.0.smithi044.stdout:8/17: creat f6 x:0 0 0 2024-04-25T22:03:13.609 INFO:tasks.workunit.client.0.smithi044.stdout:8/18: unlink f3 0 2024-04-25T22:03:13.609 INFO:tasks.workunit.client.0.smithi044.stdout:8/19: chown f6 1061 1 2024-04-25T22:03:13.616 INFO:tasks.workunit.client.0.smithi044.stdout:8/20: dwrite f4 [0,4194304] 0 2024-04-25T22:03:13.617 INFO:tasks.workunit.client.0.smithi044.stdout:8/21: dread - f2 zero size 2024-04-25T22:03:13.620 INFO:tasks.workunit.client.0.smithi044.stdout:8/22: dread f0 [0,4194304] 0 2024-04-25T22:03:13.623 INFO:tasks.workunit.client.0.smithi044.stdout:8/23: dread f0 [0,4194304] 0 2024-04-25T22:03:13.624 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:13.624 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:13.624 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:03:13.624 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:03:13.624 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:13.625 INFO:tasks.workunit.client.0.smithi044.stdout:8/24: creat f7 x:0 0 0 2024-04-25T22:03:13.625 INFO:tasks.workunit.client.0.smithi044.stdout:8/25: chown f2 4824 1 2024-04-25T22:03:13.630 INFO:tasks.workunit.client.0.smithi044.stdout:8/26: dwrite f6 [0,4194304] 0 2024-04-25T22:03:13.631 INFO:tasks.workunit.client.0.smithi044.stdout:8/27: fdatasync f5 0 2024-04-25T22:03:13.631 INFO:tasks.workunit.client.0.smithi044.stdout:8/28: chown f6 966390 1 2024-04-25T22:03:13.632 INFO:tasks.workunit.client.0.smithi044.stdout:8/29: rename f7 to f8 0 2024-04-25T22:03:13.632 INFO:tasks.workunit.client.0.smithi044.stdout:8/30: write f6 [628013,34086] 0 2024-04-25T22:03:13.641 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:13.645 INFO:tasks.workunit.client.0.smithi044.stdout:2/29: truncate f0 4150972 0 2024-04-25T22:03:13.645 INFO:tasks.workunit.client.0.smithi044.stdout:2/30: mkdir d7/d8 0 2024-04-25T22:03:13.645 INFO:tasks.workunit.client.0.smithi044.stdout:2/31: readlink - no filename 2024-04-25T22:03:13.646 INFO:tasks.workunit.client.0.smithi044.stdout:2/32: unlink f3 0 2024-04-25T22:03:13.646 INFO:tasks.workunit.client.0.smithi044.stdout:8/31: getdents . 0 2024-04-25T22:03:13.647 INFO:tasks.workunit.client.0.smithi044.stdout:2/33: rename d7 to d7/d9 22 2024-04-25T22:03:13.647 INFO:tasks.workunit.client.0.smithi044.stdout:8/32: link f2 f9 0 2024-04-25T22:03:13.647 INFO:tasks.workunit.client.0.smithi044.stdout:8/33: creat fa x:0 0 0 2024-04-25T22:03:13.654 INFO:tasks.workunit.client.0.smithi044.stdout:8/34: dwrite f5 [0,4194304] 0 2024-04-25T22:03:13.655 INFO:tasks.workunit.client.0.smithi044.stdout:8/35: write f6 [2357147,108628] 0 2024-04-25T22:03:13.671 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:13.664+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:13.710 INFO:tasks.workunit.client.0.smithi044.stdout:8/36: truncate f4 1845165 0 2024-04-25T22:03:13.710 INFO:tasks.workunit.client.0.smithi044.stdout:8/37: chown f8 43875251 1 2024-04-25T22:03:13.716 INFO:tasks.workunit.client.0.smithi044.stdout:8/38: truncate f0 1460733 0 2024-04-25T22:03:13.717 INFO:tasks.workunit.client.0.smithi044.stdout:8/39: link f4 fb 0 2024-04-25T22:03:13.717 INFO:tasks.workunit.client.0.smithi044.stdout:8/40: dread - f8 zero size 2024-04-25T22:03:13.718 INFO:tasks.workunit.client.0.smithi044.stdout:8/41: creat fc x:0 0 0 2024-04-25T22:03:13.718 INFO:tasks.workunit.client.0.smithi044.stdout:2/34: dwrite f0 [4194304,4194304] 0 2024-04-25T22:03:13.719 INFO:tasks.workunit.client.0.smithi044.stdout:8/42: link f9 fd 0 2024-04-25T22:03:13.719 INFO:tasks.workunit.client.0.smithi044.stdout:2/35: symlink d7/la 0 2024-04-25T22:03:13.720 INFO:tasks.workunit.client.0.smithi044.stdout:8/43: chown fd 4980791 1 2024-04-25T22:03:13.720 INFO:tasks.workunit.client.0.smithi044.stdout:2/36: mkdir d7/d8/db 0 2024-04-25T22:03:13.724 INFO:tasks.workunit.client.0.smithi044.stdout:8/44: dread fd [0,4194304] 0 2024-04-25T22:03:13.725 INFO:tasks.workunit.client.0.smithi044.stdout:2/37: dread f4 [0,4194304] 0 2024-04-25T22:03:13.725 INFO:tasks.workunit.client.0.smithi044.stdout:8/45: symlink le 0 2024-04-25T22:03:13.725 INFO:tasks.workunit.client.0.smithi044.stdout:8/46: chown fc 12656770 1 2024-04-25T22:03:13.726 INFO:tasks.workunit.client.0.smithi044.stdout:2/38: creat d7/d8/db/fc x:0 0 0 2024-04-25T22:03:13.726 INFO:tasks.workunit.client.0.smithi044.stdout:8/47: write fc [544426,82595] 0 2024-04-25T22:03:13.727 INFO:tasks.workunit.client.0.smithi044.stdout:8/48: truncate fd 2383510 0 2024-04-25T22:03:13.727 INFO:tasks.workunit.client.0.smithi044.stdout:8/49: creat ff x:0 0 0 2024-04-25T22:03:13.728 INFO:tasks.workunit.client.0.smithi044.stdout:8/50: mknod c10 0 2024-04-25T22:03:13.728 INFO:tasks.workunit.client.0.smithi044.stdout:8/51: write f6 [357119,67274] 0 2024-04-25T22:03:13.729 INFO:tasks.workunit.client.0.smithi044.stdout:8/52: symlink l11 0 2024-04-25T22:03:13.729 INFO:tasks.workunit.client.0.smithi044.stdout:8/53: fsync fb 0 2024-04-25T22:03:13.730 INFO:tasks.workunit.client.0.smithi044.stdout:8/54: chown fd 2979 1 2024-04-25T22:03:13.755 INFO:tasks.workunit.client.0.smithi044.stdout:8/55: write f0 [625893,38417] 0 2024-04-25T22:03:13.757 INFO:tasks.workunit.client.0.smithi044.stdout:8/56: read fc [80328,69566] 0 2024-04-25T22:03:13.762 INFO:tasks.workunit.client.0.smithi044.stdout:8/57: dread f6 [0,4194304] 0 2024-04-25T22:03:13.762 INFO:tasks.workunit.client.0.smithi044.stdout:8/58: chown f4 8522 1 2024-04-25T22:03:13.762 INFO:tasks.workunit.client.0.smithi044.stdout:8/59: write f6 [4008308,65819] 0 2024-04-25T22:03:13.763 INFO:tasks.workunit.client.0.smithi044.stdout:8/60: chown fa 1878 1 2024-04-25T22:03:13.763 INFO:tasks.workunit.client.0.smithi044.stdout:8/61: rmdir - no directory 2024-04-25T22:03:13.767 INFO:tasks.workunit.client.0.smithi044.stdout:8/62: fdatasync f5 0 2024-04-25T22:03:13.767 INFO:tasks.workunit.client.0.smithi044.stdout:8/63: chown fa 42 1 2024-04-25T22:03:13.767 INFO:tasks.workunit.client.0.smithi044.stdout:8/64: unlink ff 0 2024-04-25T22:03:13.772 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:13.768+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:13.774 INFO:tasks.workunit.client.0.smithi044.stdout:8/65: dwrite f0 [0,4194304] 0 2024-04-25T22:03:13.776 INFO:tasks.workunit.client.0.smithi044.stdout:8/66: write f9 [2652855,2417] 0 2024-04-25T22:03:13.776 INFO:tasks.workunit.client.0.smithi044.stdout:8/67: read - fa zero size 2024-04-25T22:03:13.776 INFO:tasks.workunit.client.0.smithi044.stdout:8/68: dread - fa zero size 2024-04-25T22:03:13.777 INFO:tasks.workunit.client.0.smithi044.stdout:8/69: fsync f6 0 2024-04-25T22:03:13.777 INFO:tasks.workunit.client.0.smithi044.stdout:8/70: creat f12 x:0 0 0 2024-04-25T22:03:13.781 INFO:tasks.workunit.client.0.smithi044.stdout:8/71: fsync f5 0 2024-04-25T22:03:13.782 INFO:tasks.workunit.client.0.smithi044.stdout:8/72: write f5 [372273,46441] 0 2024-04-25T22:03:13.783 INFO:tasks.workunit.client.0.smithi044.stdout:8/73: rename l11 to l13 0 2024-04-25T22:03:13.784 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:13.784 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:13.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:13.785 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:13.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.785 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:13.785 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:13.785 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.693700824, 2024-04-25T22:03:13.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:13.785 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.785 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.786 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.786 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:13.786 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:13.786 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:13.786 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:13.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.786 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:13.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:13.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:13.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:13.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:13.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:13.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:13.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:13.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:13.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:13.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:13.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:13.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:13.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:13.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:13.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:13.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:13.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:13.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:13.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:13.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:13.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:13.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:13.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:13.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:13.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:13.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:13.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:13.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:13.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:13.793 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.793 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.793 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.793 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:13.793 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:13.793 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.683700061, 2024-04-25T22:03:13.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:13.793 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.794 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.794 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.794 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:13.794 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:13.794 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:13.794 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:13.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.794 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.794 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:13.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:13.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:13.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:13.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:13.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:13.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:13.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:13.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:13.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:13.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:13.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:13.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:13.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:13.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:13.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:13.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:13.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:13.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:13.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:13.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:13.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:13.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:13.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:13.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:13.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:13.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:13.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:13.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:13.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:13.799 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.799 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.799 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.799 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:13.799 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:13.799 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.679535786999999, 2024-04-25T22:03:13.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:13.800 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.800 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.800 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.800 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:13.800 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:13.800 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:13.800 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:13.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.800 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:13.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:13.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:13.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:13.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:13.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:13.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:13.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:13.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:13.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:13.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:13.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:13.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:13.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:13.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:13.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:13.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:13.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:13.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:13.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:13.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:13.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:13.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:13.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:13.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:13.805 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.805 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.805 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.805 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:13.805 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:13.805 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.677939469999998, 2024-04-25T22:03:13.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:13.805 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.805 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.805 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.805 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:13.805 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:13.805 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:13.806 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:13.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.806 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:13.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:13.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:13.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:13.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:13.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:13.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:13.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:13.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:13.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:13.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:13.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:13.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:13.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:13.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:13.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:13.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:13.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:13.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:13.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:13.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:13.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:13.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:13.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:13.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:13.810 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.810 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.810 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.811 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:13.811 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:13.811 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.62115322, 2024-04-25T22:03:13.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:13.811 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.811 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.811 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.811 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:13.811 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:13.811 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:13.811 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:13.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.811 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:13.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:13.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:13.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:13.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:13.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:13.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:13.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:13.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:13.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:13.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:13.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:13.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:13.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:13.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:13.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:13.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:13.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:13.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:13.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:13.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:13.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:13.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:13.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:13.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:13.816 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.816 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.816 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.816 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:13.816 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:13.816 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.605508954000001, 2024-04-25T22:03:13.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:13.816 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.816 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.816 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.816 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:13.817 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:13.817 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:13.817 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:13.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.817 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:13.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:13.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:13.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:13.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:13.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:13.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:13.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:13.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:13.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:13.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:13.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:13.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:13.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:13.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:13.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:13.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:13.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:13.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:13.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:13.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:13.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:13.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:13.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:13.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:13.821 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.822 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.822 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.822 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:13.822 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:13.822 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.600670263000001, 2024-04-25T22:03:13.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:13.822 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.822 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.822 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.822 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:13.822 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:13.822 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:13.823 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:13.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.823 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:13.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:13.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:13.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:13.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:13.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:13.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:13.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:13.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:13.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:13.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:13.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:13.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:13.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:13.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:13.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:13.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:13.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:13.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:13.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:13.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:13.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:13.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:13.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.827 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:13.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:13.827 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.827 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.827 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.827 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:13.827 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:13.827 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.587353179000001, 2024-04-25T22:03:13.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.098402492999999994, 2024-04-25T22:03:13.828 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.828 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.828 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.828 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:13.828 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:13.828 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:13.828 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71 2024-04-25T22:03:13.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.828 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:13.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:13.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191895+0000", 2024-04-25T22:03:13.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0899999999999999e-06 2024-04-25T22:03:13.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191906+0000", 2024-04-25T22:03:13.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1508999999999999e-05 2024-04-25T22:03:13.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191937+0000", 2024-04-25T22:03:13.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0772999999999998e-05 2024-04-25T22:03:13.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191951+0000", 2024-04-25T22:03:13.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.437e-05 2024-04-25T22:03:13.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286217+0000", 2024-04-25T22:03:13.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.094265989999999994 2024-04-25T22:03:13.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286383+0000", 2024-04-25T22:03:13.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016591899999999999 2024-04-25T22:03:13.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:13.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286594+0000", 2024-04-25T22:03:13.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021108800000000001 2024-04-25T22:03:13.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.288518+0000", 2024-04-25T22:03:13.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001923391 2024-04-25T22:03:13.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290219+0000", 2024-04-25T22:03:13.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001701239 2024-04-25T22:03:13.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290266+0000", 2024-04-25T22:03:13.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6838000000000001e-05 2024-04-25T22:03:13.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290295+0000", 2024-04-25T22:03:13.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9286e-05 2024-04-25T22:03:13.832 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.832 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.832 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.833 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:173 3.1e 3:7bf7e7b5:::200.00000006:head [write 1089806~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:13.833 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.680971+0000", 2024-04-25T22:03:13.833 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0982744980000003, 2024-04-25T22:03:13.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.097357530999999997, 2024-04-25T22:03:13.833 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.833 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.833 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.833 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680971+0000", 2024-04-25T22:03:13.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680971+0000", 2024-04-25T22:03:13.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680972+0000", 2024-04-25T22:03:13.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5700000000000002e-07 2024-04-25T22:03:13.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680976+0000", 2024-04-25T22:03:13.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8859999999999997e-06 2024-04-25T22:03:13.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680986+0000", 2024-04-25T22:03:13.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0107e-05 2024-04-25T22:03:13.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680992+0000", 2024-04-25T22:03:13.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:03:13.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.766932+0000", 2024-04-25T22:03:13.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.085939606000000002 2024-04-25T22:03:13.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.767162+0000", 2024-04-25T22:03:13.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022967899999999999 2024-04-25T22:03:13.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:13.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.767539+0000", 2024-04-25T22:03:13.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037684900000000001 2024-04-25T22:03:13.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773588+0000", 2024-04-25T22:03:13.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060498979999999997 2024-04-25T22:03:13.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778047+0000", 2024-04-25T22:03:13.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044585950000000001 2024-04-25T22:03:13.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778191+0000", 2024-04-25T22:03:13.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000144277 2024-04-25T22:03:13.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778329+0000", 2024-04-25T22:03:13.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013736799999999999 2024-04-25T22:03:13.838 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.838 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.838 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.838 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:174 3.1e 3:7bf7e7b5:::200.00000006:head [write 1091205~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:13.838 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681001+0000", 2024-04-25T22:03:13.838 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0982448060000003, 2024-04-25T22:03:13.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.097586939999999997, 2024-04-25T22:03:13.838 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.838 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.838 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.839 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681001+0000", 2024-04-25T22:03:13.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681001+0000", 2024-04-25T22:03:13.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681002+0000", 2024-04-25T22:03:13.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1699999999999997e-07 2024-04-25T22:03:13.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681011+0000", 2024-04-25T22:03:13.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4099999999999997e-06 2024-04-25T22:03:13.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681020+0000", 2024-04-25T22:03:13.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0929999999999992e-06 2024-04-25T22:03:13.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681027+0000", 2024-04-25T22:03:13.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2069999999999998e-06 2024-04-25T22:03:13.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.768885+0000", 2024-04-25T22:03:13.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087857947000000006 2024-04-25T22:03:13.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.769110+0000", 2024-04-25T22:03:13.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000224243 2024-04-25T22:03:13.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:13.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.769453+0000", 2024-04-25T22:03:13.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034366900000000001 2024-04-25T22:03:13.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.776545+0000", 2024-04-25T22:03:13.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070918179999999997 2024-04-25T22:03:13.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778351+0000", 2024-04-25T22:03:13.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001806457 2024-04-25T22:03:13.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778482+0000", 2024-04-25T22:03:13.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130538 2024-04-25T22:03:13.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778588+0000", 2024-04-25T22:03:13.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010584100000000001 2024-04-25T22:03:13.843 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.843 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.843 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.843 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:175 3.1e 3:7bf7e7b5:::200.00000006:head [write 1092606~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:13.843 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:13.844 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0982090360000001, 2024-04-25T22:03:13.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.098895884000000003, 2024-04-25T22:03:13.844 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.844 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.844 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.844 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:13.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:13.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:13.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.37e-07 2024-04-25T22:03:13.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681042+0000", 2024-04-25T22:03:13.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.296e-06 2024-04-25T22:03:13.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681051+0000", 2024-04-25T22:03:13.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8729999999999996e-06 2024-04-25T22:03:13.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681058+0000", 2024-04-25T22:03:13.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1500000000000002e-06 2024-04-25T22:03:13.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.770531+0000", 2024-04-25T22:03:13.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.089473665999999993 2024-04-25T22:03:13.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.770765+0000", 2024-04-25T22:03:13.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023329899999999999 2024-04-25T22:03:13.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:13.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.771099+0000", 2024-04-25T22:03:13.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033428 2024-04-25T22:03:13.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778610+0000", 2024-04-25T22:03:13.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075115119999999997 2024-04-25T22:03:13.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779710+0000", 2024-04-25T22:03:13.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010997019999999999 2024-04-25T22:03:13.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779876+0000", 2024-04-25T22:03:13.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016592000000000001 2024-04-25T22:03:13.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779933+0000", 2024-04-25T22:03:13.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6449000000000001e-05 2024-04-25T22:03:13.848 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.848 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.848 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.849 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:176 3.1e 3:7bf7e7b5:::200.00000006:head [write 1094003~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:13.849 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681066+0000", 2024-04-25T22:03:13.849 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0981794029999996, 2024-04-25T22:03:13.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099284439000000002, 2024-04-25T22:03:13.849 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.849 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.849 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.849 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681066+0000", 2024-04-25T22:03:13.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681066+0000", 2024-04-25T22:03:13.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681067+0000", 2024-04-25T22:03:13.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3e-07 2024-04-25T22:03:13.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681076+0000", 2024-04-25T22:03:13.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3659999999999998e-06 2024-04-25T22:03:13.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681087+0000", 2024-04-25T22:03:13.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0763e-05 2024-04-25T22:03:13.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681095+0000", 2024-04-25T22:03:13.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3599999999999998e-06 2024-04-25T22:03:13.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772564+0000", 2024-04-25T22:03:13.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.091469049999999996 2024-04-25T22:03:13.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772701+0000", 2024-04-25T22:03:13.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013743100000000001 2024-04-25T22:03:13.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:13.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772901+0000", 2024-04-25T22:03:13.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019971600000000001 2024-04-25T22:03:13.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778627+0000", 2024-04-25T22:03:13.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057267170000000001 2024-04-25T22:03:13.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780116+0000", 2024-04-25T22:03:13.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001488294 2024-04-25T22:03:13.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780282+0000", 2024-04-25T22:03:13.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016584999999999999 2024-04-25T22:03:13.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780351+0000", 2024-04-25T22:03:13.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9162e-05 2024-04-25T22:03:13.853 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.854 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.854 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.854 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:177 3.1e 3:7bf7e7b5:::200.00000006:head [write 1095406~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:13.854 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:13.854 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0981420610000008, 2024-04-25T22:03:13.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099467149000000005, 2024-04-25T22:03:13.854 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.854 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.854 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.855 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:13.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:13.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:13.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:03:13.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681108+0000", 2024-04-25T22:03:13.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0439999999999997e-06 2024-04-25T22:03:13.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681117+0000", 2024-04-25T22:03:13.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7499999999999992e-06 2024-04-25T22:03:13.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681124+0000", 2024-04-25T22:03:13.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9099999999999999e-06 2024-04-25T22:03:13.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773690+0000", 2024-04-25T22:03:13.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.092565760999999996 2024-04-25T22:03:13.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773817+0000", 2024-04-25T22:03:13.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012704799999999999 2024-04-25T22:03:13.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:13.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773999+0000", 2024-04-25T22:03:13.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018202 2024-04-25T22:03:13.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778647+0000", 2024-04-25T22:03:13.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046479049999999999 2024-04-25T22:03:13.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780446+0000", 2024-04-25T22:03:13.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017990739999999999 2024-04-25T22:03:13.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780519+0000", 2024-04-25T22:03:13.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3205000000000001e-05 2024-04-25T22:03:13.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780571+0000", 2024-04-25T22:03:13.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1638999999999998e-05 2024-04-25T22:03:13.859 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.859 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.859 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.859 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:178 3.1e 3:7bf7e7b5:::200.00000006:head [write 1096809~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:13.860 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681133+0000", 2024-04-25T22:03:13.860 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0981127809999993, 2024-04-25T22:03:13.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099654375000000003, 2024-04-25T22:03:13.860 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.860 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.860 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.860 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681133+0000", 2024-04-25T22:03:13.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681133+0000", 2024-04-25T22:03:13.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681134+0000", 2024-04-25T22:03:13.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2699999999999999e-07 2024-04-25T22:03:13.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681139+0000", 2024-04-25T22:03:13.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.276e-06 2024-04-25T22:03:13.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681148+0000", 2024-04-25T22:03:13.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8130000000000002e-06 2024-04-25T22:03:13.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681155+0000", 2024-04-25T22:03:13.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0859999999999996e-06 2024-04-25T22:03:13.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.774610+0000", 2024-04-25T22:03:13.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.093455287999999997 2024-04-25T22:03:13.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.774856+0000", 2024-04-25T22:03:13.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000245772 2024-04-25T22:03:13.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:13.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.775244+0000", 2024-04-25T22:03:13.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038779599999999998 2024-04-25T22:03:13.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779955+0000", 2024-04-25T22:03:13.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047115910000000002 2024-04-25T22:03:13.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780656+0000", 2024-04-25T22:03:13.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070111200000000005 2024-04-25T22:03:13.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780733+0000", 2024-04-25T22:03:13.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6601999999999996e-05 2024-04-25T22:03:13.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780787+0000", 2024-04-25T22:03:13.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4311999999999998e-05 2024-04-25T22:03:13.864 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.864 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.865 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.865 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:179 3.1e 3:7bf7e7b5:::200.00000006:head [write 1098209~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:13.865 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681170+0000", 2024-04-25T22:03:13.865 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0980760249999992, 2024-04-25T22:03:13.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099820701999999997, 2024-04-25T22:03:13.865 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.865 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.865 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.865 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681170+0000", 2024-04-25T22:03:13.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681170+0000", 2024-04-25T22:03:13.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681171+0000", 2024-04-25T22:03:13.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4e-07 2024-04-25T22:03:13.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681175+0000", 2024-04-25T22:03:13.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7330000000000003e-06 2024-04-25T22:03:13.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681185+0000", 2024-04-25T22:03:13.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2730000000000008e-06 2024-04-25T22:03:13.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681192+0000", 2024-04-25T22:03:13.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3000000000000004e-06 2024-04-25T22:03:13.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.776664+0000", 2024-04-25T22:03:13.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095471850999999996 2024-04-25T22:03:13.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.776895+0000", 2024-04-25T22:03:13.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023155199999999999 2024-04-25T22:03:13.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:13.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.777244+0000", 2024-04-25T22:03:13.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034912300000000001 2024-04-25T22:03:13.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779962+0000", 2024-04-25T22:03:13.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027177870000000002 2024-04-25T22:03:13.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780870+0000", 2024-04-25T22:03:13.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090743499999999995 2024-04-25T22:03:13.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780939+0000", 2024-04-25T22:03:13.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9678999999999995e-05 2024-04-25T22:03:13.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780990+0000", 2024-04-25T22:03:13.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1128999999999998e-05 2024-04-25T22:03:13.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.871 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.871 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.871 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:180 3.1e 3:7bf7e7b5:::200.00000006:head [write 1099615~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:13.871 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681201+0000", 2024-04-25T22:03:13.871 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0980445089999993, 2024-04-25T22:03:13.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.100014121, 2024-04-25T22:03:13.871 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.871 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.871 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.871 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681201+0000", 2024-04-25T22:03:13.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681201+0000", 2024-04-25T22:03:13.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681202+0000", 2024-04-25T22:03:13.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2600000000000001e-07 2024-04-25T22:03:13.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681206+0000", 2024-04-25T22:03:13.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7799999999999998e-06 2024-04-25T22:03:13.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681215+0000", 2024-04-25T22:03:13.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7630000000000006e-06 2024-04-25T22:03:13.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681222+0000", 2024-04-25T22:03:13.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0740000000000004e-06 2024-04-25T22:03:13.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778720+0000", 2024-04-25T22:03:13.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.097498243999999998 2024-04-25T22:03:13.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778839+0000", 2024-04-25T22:03:13.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011882799999999999 2024-04-25T22:03:13.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:13.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779028+0000", 2024-04-25T22:03:13.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018962300000000001 2024-04-25T22:03:13.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781006+0000", 2024-04-25T22:03:13.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019778640000000002 2024-04-25T22:03:13.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781093+0000", 2024-04-25T22:03:13.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6802e-05 2024-04-25T22:03:13.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781164+0000", 2024-04-25T22:03:13.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0925000000000003e-05 2024-04-25T22:03:13.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781215+0000", 2024-04-25T22:03:13.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1391999999999999e-05 2024-04-25T22:03:13.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.876 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.877 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.877 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:6847 4.16 4.8bfe6e16 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-25T22:03:13.877 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.686897+0000", 2024-04-25T22:03:13.877 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0923488979999991, 2024-04-25T22:03:13.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.094186503000000005, 2024-04-25T22:03:13.877 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.877 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.877 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:03:13.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:13.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:13.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:13.877 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6847 2024-04-25T22:03:13.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.878 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686897+0000", 2024-04-25T22:03:13.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686897+0000", 2024-04-25T22:03:13.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686903+0000", 2024-04-25T22:03:13.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9599999999999997e-06 2024-04-25T22:03:13.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686920+0000", 2024-04-25T22:03:13.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7102999999999999e-05 2024-04-25T22:03:13.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686939+0000", 2024-04-25T22:03:13.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.912e-05 2024-04-25T22:03:13.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686953+0000", 2024-04-25T22:03:13.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4062e-05 2024-04-25T22:03:13.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781065+0000", 2024-04-25T22:03:13.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.094112332000000007 2024-04-25T22:03:13.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781083+0000", 2024-04-25T22:03:13.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7926000000000001e-05 2024-04-25T22:03:13.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.880 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.881 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10648 4.33 4:cc614d18:::100000030cb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:13.881 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:13.881 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.242066952, 2024-04-25T22:03:13.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13001143300000001, 2024-04-25T22:03:13.881 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.881 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.881 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.881 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:13.881 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:13.881 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:13.881 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10648 2024-04-25T22:03:13.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.882 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:13.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:13.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537181+0000", 2024-04-25T22:03:13.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.782e-06 2024-04-25T22:03:13.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541681+0000", 2024-04-25T22:03:13.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045008460000000002 2024-04-25T22:03:13.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541692+0000", 2024-04-25T22:03:13.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0726e-05 2024-04-25T22:03:13.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541698+0000", 2024-04-25T22:03:13.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-04-25T22:03:13.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541771+0000", 2024-04-25T22:03:13.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3070000000000003e-05 2024-04-25T22:03:13.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542021+0000", 2024-04-25T22:03:13.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025059799999999999 2024-04-25T22:03:13.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:13.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542246+0000", 2024-04-25T22:03:13.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022471000000000001 2024-04-25T22:03:13.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.579359+0000", 2024-04-25T22:03:13.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037113211 2024-04-25T22:03:13.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667067+0000", 2024-04-25T22:03:13.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087707255999999997 2024-04-25T22:03:13.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667134+0000", 2024-04-25T22:03:13.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7862999999999997e-05 2024-04-25T22:03:13.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667190+0000", 2024-04-25T22:03:13.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5698000000000001e-05 2024-04-25T22:03:13.886 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.886 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.886 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.887 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10651 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:13.887 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:13.887 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.182291174, 2024-04-25T22:03:13.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11324606800000001, 2024-04-25T22:03:13.887 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.887 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.887 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.887 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:13.887 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:13.887 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:13.887 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10651 2024-04-25T22:03:13.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.887 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:13.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:13.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596957+0000", 2024-04-25T22:03:13.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-04-25T22:03:13.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601272+0000", 2024-04-25T22:03:13.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004314834 2024-04-25T22:03:13.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601291+0000", 2024-04-25T22:03:13.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9380000000000001e-05 2024-04-25T22:03:13.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601302+0000", 2024-04-25T22:03:13.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0416e-05 2024-04-25T22:03:13.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.603978+0000", 2024-04-25T22:03:13.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026763109999999998 2024-04-25T22:03:13.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604327+0000", 2024-04-25T22:03:13.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034881099999999998 2024-04-25T22:03:13.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:13.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604571+0000", 2024-04-25T22:03:13.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024436100000000001 2024-04-25T22:03:13.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644439+0000", 2024-04-25T22:03:13.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039868270999999997 2024-04-25T22:03:13.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710091+0000", 2024-04-25T22:03:13.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.065651910999999993 2024-04-25T22:03:13.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710144+0000", 2024-04-25T22:03:13.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2444999999999997e-05 2024-04-25T22:03:13.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710201+0000", 2024-04-25T22:03:13.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6839999999999998e-05 2024-04-25T22:03:13.893 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.893 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.893 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.893 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10654 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:13.893 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:13.893 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.17246431100000001, 2024-04-25T22:03:13.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.103958778, 2024-04-25T22:03:13.893 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:13.894 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:13.894 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:13.894 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:13.894 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:13.894 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:13.894 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10654 2024-04-25T22:03:13.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.894 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:13.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:13.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:13.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:13.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:13.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:13.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:13.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606782+0000", 2024-04-25T22:03:13.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1699999999999999e-07 2024-04-25T22:03:13.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:13.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611155+0000", 2024-04-25T22:03:13.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043728580000000003 2024-04-25T22:03:13.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:13.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611173+0000", 2024-04-25T22:03:13.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8267e-05 2024-04-25T22:03:13.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:13.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611183+0000", 2024-04-25T22:03:13.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9250000000000007e-06 2024-04-25T22:03:13.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:13.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644642+0000", 2024-04-25T22:03:13.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033458976000000001 2024-04-25T22:03:13.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:13.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644739+0000", 2024-04-25T22:03:13.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7189999999999996e-05 2024-04-25T22:03:13.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:13.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644864+0000", 2024-04-25T22:03:13.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000124867 2024-04-25T22:03:13.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:13.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.672556+0000", 2024-04-25T22:03:13.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027691653 2024-04-25T22:03:13.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:13.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710668+0000", 2024-04-25T22:03:13.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038111956000000002 2024-04-25T22:03:13.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:13.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710703+0000", 2024-04-25T22:03:13.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5577000000000002e-05 2024-04-25T22:03:13.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:13.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:13.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:13.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710740+0000", 2024-04-25T22:03:13.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7092000000000003e-05 2024-04-25T22:03:13.898 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.898 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.899 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.899 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:13.899 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:13.899 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:13.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:13.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:13.897+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:13.903 INFO:tasks.workunit.client.0.smithi044.stdout:8/74: fsync f12 0 2024-04-25T22:03:13.904 INFO:tasks.workunit.client.0.smithi044.stdout:8/75: dwrite f8 [0,4194304] 0 2024-04-25T22:03:13.904 INFO:tasks.workunit.client.0.smithi044.stdout:8/76: write f9 [366738,107580] 0 2024-04-25T22:03:13.904 INFO:tasks.workunit.client.0.smithi044.stdout:8/77: symlink l14 0 2024-04-25T22:03:13.904 INFO:tasks.workunit.client.0.smithi044.stdout:8/78: stat fb 0 2024-04-25T22:03:13.904 INFO:tasks.workunit.client.0.smithi044.stdout:8/79: mknod c15 0 2024-04-25T22:03:13.904 INFO:tasks.workunit.client.0.smithi044.stdout:8/80: write f9 [2094402,120876] 0 2024-04-25T22:03:13.904 INFO:tasks.workunit.client.0.smithi044.stdout:8/81: chown f0 300 1 2024-04-25T22:03:13.904 INFO:tasks.workunit.client.0.smithi044.stdout:8/82: read f0 [2404176,72569] 0 2024-04-25T22:03:13.904 INFO:tasks.workunit.client.0.smithi044.stdout:8/83: creat f16 x:0 0 0 2024-04-25T22:03:13.904 INFO:tasks.workunit.client.0.smithi044.stdout:8/84: rename f16 to f17 0 2024-04-25T22:03:13.904 INFO:tasks.workunit.client.0.smithi044.stdout:8/85: dwrite fb [0,4194304] 0 2024-04-25T22:03:13.904 INFO:tasks.workunit.client.0.smithi044.stdout:8/86: mknod c18 0 2024-04-25T22:03:13.904 INFO:tasks.workunit.client.0.smithi044.stdout:8/87: write f17 [656230,92855] 0 2024-04-25T22:03:13.904 INFO:tasks.workunit.client.0.smithi044.stdout:8/88: truncate fd 3653042 0 2024-04-25T22:03:13.904 INFO:tasks.workunit.client.0.smithi044.stdout:8/89: rename f5 to f19 0 2024-04-25T22:03:13.905 INFO:tasks.workunit.client.0.smithi044.stdout:8/90: write fa [898901,24842] 0 2024-04-25T22:03:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:03:13.905 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-25T22:03:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 64, 2024-04-25T22:03:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "1ced109c-704f-44b1-9811-a2da74898889", 2024-04-25T22:03:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: "created": "2024-04-25T22:00:52.024472+0000", 2024-04-25T22:03:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: "modified": "2024-04-25T22:03:12.729575+0000", 2024-04-25T22:03:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: "last_up_change": "2024-04-25T22:01:03.432353+0000", 2024-04-25T22:03:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: "last_in_change": "2024-04-25T22:00:53.642701+0000", 2024-04-25T22:03:13.905 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-25T22:03:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_num": 5801984, 2024-04-25T22:03:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_set": [ 2024-04-25T22:03:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: "noscrub", 2024-04-25T22:03:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: "pglog_hardlimit", 2024-04-25T22:03:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: "purged_snapdirs", 2024-04-25T22:03:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_deletes", 2024-04-25T22:03:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: "sortbitwise" 2024-04-25T22:03:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:03:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_version": 4, 2024-04-25T22:03:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: "full_ratio": 0.94999998807907104, 2024-04-25T22:03:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-25T22:03:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-25T22:03:13.906 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_snapshot": "", 2024-04-25T22:03:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_max": 4, 2024-04-25T22:03:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: "max_osd": 3, 2024-04-25T22:03:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: "require_min_compat_client": "luminous", 2024-04-25T22:03:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: "min_compat_client": "jewel", 2024-04-25T22:03:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: "require_osd_release": "squid", 2024-04-25T22:03:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: "allow_crimson": false, 2024-04-25T22:03:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: "pools": [ 2024-04-25T22:03:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 1, 2024-04-25T22:03:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": ".mgr", 2024-04-25T22:03:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:03.632568+0000", 2024-04-25T22:03:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:03:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:03:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:03:13.907 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:03:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:03:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:03:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:03:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:03:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:03:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:03:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:03:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:03:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 1, 2024-04-25T22:03:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 1, 2024-04-25T22:03:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 1, 2024-04-25T22:03:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 1, 2024-04-25T22:03:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 1, 2024-04-25T22:03:13.908 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:03:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:03:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:03:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:03:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:03:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:03:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:03:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "11", 2024-04-25T22:03:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:03:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:03:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:03:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:03:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:03:13.909 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:03:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:03:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:03:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:03:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:03:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:03:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:03:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:03:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:03:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:03:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:03:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:03:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:03:13.910 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:03:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:03:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:03:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:03:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:03:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:03:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:03:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:03:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:03:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:03:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:03:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:03:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:03:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:03:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:03:13.911 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:03:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:03:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:03:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:03:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: "options": { 2024-04-25T22:03:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_max": 32, 2024-04-25T22:03:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_min": 1 2024-04-25T22:03:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:03:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": {} 2024-04-25T22:03:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:03:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:03:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 2, 2024-04-25T22:03:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 2, 2024-04-25T22:03:13.912 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 1, 2024-04-25T22:03:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 2, 2024-04-25T22:03:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 2, 2024-04-25T22:03:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 0.53586328029632568, 2024-04-25T22:03:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 0.80000001192092896, 2024-04-25T22:03:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 0.54000002145767212 2024-04-25T22:03:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 2, 2024-04-25T22:03:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": "rbd", 2024-04-25T22:03:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:07.995071+0000", 2024-04-25T22:03:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:03:13.913 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:03:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:03:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:03:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:03:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:03:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:03:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:03:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:03:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:03:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:03:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:03:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 8, 2024-04-25T22:03:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 8, 2024-04-25T22:03:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 8, 2024-04-25T22:03:13.914 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 8, 2024-04-25T22:03:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 8, 2024-04-25T22:03:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:03:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:03:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:03:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:03:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:03:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:03:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:03:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "14", 2024-04-25T22:03:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:03:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:03:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:03:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:03:13.915 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:03:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:03:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:03:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:03:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:03:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:03:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:03:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:03:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:03:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:03:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:03:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:03:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:03:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:03:13.916 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:03:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:03:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:03:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:03:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:03:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:03:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:03:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:03:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:03:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:03:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:03:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:03:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:03:13.917 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:03:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:03:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:03:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:03:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:03:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:03:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: "options": {}, 2024-04-25T22:03:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:03:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd": {} 2024-04-25T22:03:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:03:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:03:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 2.1500000953674316, 2024-04-25T22:03:13.918 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 1, 2024-04-25T22:03:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 1.5, 2024-04-25T22:03:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 3.2200000286102295, 2024-04-25T22:03:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 1.5, 2024-04-25T22:03:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 0.53586328029632568, 2024-04-25T22:03:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 0.80000001192092896, 2024-04-25T22:03:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 0.54000002145767212, 2024-04-25T22:03:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: "error_message": "pool 2 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate" 2024-04-25T22:03:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 3, 2024-04-25T22:03:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": "cephfs_metadata", 2024-04-25T22:03:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:12.514055+0000", 2024-04-25T22:03:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:03:13.919 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:03:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:03:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:03:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:03:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:03:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:03:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:03:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:03:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:03:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:03:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:03:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 32, 2024-04-25T22:03:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 32, 2024-04-25T22:03:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 32, 2024-04-25T22:03:13.920 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 32, 2024-04-25T22:03:13.921 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 32, 2024-04-25T22:03:13.921 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:03:13.921 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:03:13.921 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:03:13.921 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:03:13.921 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:03:13.921 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:03:13.921 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:03:13.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.921 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "17", 2024-04-25T22:03:13.921 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:03:13.921 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:03:13.921 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:03:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:03:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:03:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:03:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:03:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:03:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:03:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:03:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:03:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:03:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:03:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:03:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:03:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:03:13.922 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:03:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:03:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:03:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:03:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:03:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:03:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:03:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:03:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:03:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:03:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:03:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:03:13.923 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:03:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:03:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:03:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:03:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:03:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:03:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:03:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:03:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:03:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: "options": { 2024-04-25T22:03:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_bias": 4, 2024-04-25T22:03:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_min": 16, 2024-04-25T22:03:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_priority": 5 2024-04-25T22:03:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:03:13.924 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs": { 2024-04-25T22:03:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": "cephfs" 2024-04-25T22:03:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:03:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:03:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 6.4499998092651367, 2024-04-25T22:03:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 1.059999942779541, 2024-04-25T22:03:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 1.5, 2024-04-25T22:03:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 9.6700000762939453, 2024-04-25T22:03:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 1.5900000333786011, 2024-04-25T22:03:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 0.53586328029632568, 2024-04-25T22:03:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 0.80000001192092896, 2024-04-25T22:03:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 0.54000002145767212, 2024-04-25T22:03:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: "error_message": "pool 3 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate" 2024-04-25T22:03:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 4, 2024-04-25T22:03:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": "cephfs_data", 2024-04-25T22:03:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: "create_time": "2024-04-25T22:01:12.963831+0000", 2024-04-25T22:03:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-04-25T22:03:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: "flags_names": "hashpspool", 2024-04-25T22:03:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: "type": 1, 2024-04-25T22:03:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2, 2024-04-25T22:03:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": 1, 2024-04-25T22:03:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_rule": 0, 2024-04-25T22:03:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:03:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:03:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:03:13.926 INFO:teuthology.orchestra.run.smithi044.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:03:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: "object_hash": 2, 2024-04-25T22:03:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:03:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": 64, 2024-04-25T22:03:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num": 64, 2024-04-25T22:03:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_placement_num_target": 64, 2024-04-25T22:03:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_target": 64, 2024-04-25T22:03:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_pending": 64, 2024-04-25T22:03:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: "last_pg_merge_meta": { 2024-04-25T22:03:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: "source_pgid": "0.0", 2024-04-25T22:03:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: "ready_epoch": 0, 2024-04-25T22:03:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_started": 0, 2024-04-25T22:03:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: "last_epoch_clean": 0, 2024-04-25T22:03:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: "source_version": "0'0", 2024-04-25T22:03:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: "target_version": "0'0" 2024-04-25T22:03:13.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: "last_change": "18", 2024-04-25T22:03:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend": "0", 2024-04-25T22:03:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:03:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:03:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: "auid": 0, 2024-04-25T22:03:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:03:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_seq": 0, 2024-04-25T22:03:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_epoch": 0, 2024-04-25T22:03:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_snaps": [], 2024-04-25T22:03:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps": "[]", 2024-04-25T22:03:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_bytes": 0, 2024-04-25T22:03:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: "quota_max_objects": 0, 2024-04-25T22:03:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: "tiers": [], 2024-04-25T22:03:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: "tier_of": -1, 2024-04-25T22:03:13.928 INFO:teuthology.orchestra.run.smithi044.stdout: "read_tier": -1, 2024-04-25T22:03:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: "write_tier": -1, 2024-04-25T22:03:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_mode": "none", 2024-04-25T22:03:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_bytes": 0, 2024-04-25T22:03:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: "target_max_objects": 0, 2024-04-25T22:03:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:03:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:03:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:03:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_flush_age": 0, 2024-04-25T22:03:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: "cache_min_evict_age": 0, 2024-04-25T22:03:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profile": "", 2024-04-25T22:03:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_params": { 2024-04-25T22:03:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "none" 2024-04-25T22:03:13.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_period": 0, 2024-04-25T22:03:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_count": 0, 2024-04-25T22:03:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: "use_gmt_hitset": true, 2024-04-25T22:03:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:03:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:03:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:03:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:03:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: "grade_table": [], 2024-04-25T22:03:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_width": 0, 2024-04-25T22:03:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: "expected_num_objects": 0, 2024-04-25T22:03:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: "fast_read": false, 2024-04-25T22:03:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: "options": { 2024-04-25T22:03:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num_min": 64, 2024-04-25T22:03:13.930 INFO:teuthology.orchestra.run.smithi044.stdout: "target_size_ratio": 0.89999997615814209 2024-04-25T22:03:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: "application_metadata": { 2024-04-25T22:03:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: "cephfs": { 2024-04-25T22:03:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: "data": "cephfs" 2024-04-25T22:03:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: "read_balance": { 2024-04-25T22:03:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: "score_type": "Fair distribution", 2024-04-25T22:03:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: "score_acting": 14.510000228881836, 2024-04-25T22:03:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: "score_stable": 1.0299999713897705, 2024-04-25T22:03:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: "optimal_score": 1.5, 2024-04-25T22:03:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_acting": 21.760000228881836, 2024-04-25T22:03:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: "raw_score_stable": 1.5499999523162842, 2024-04-25T22:03:13.931 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity_weighted": 0.53586328029632568, 2024-04-25T22:03:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity": 0.80000001192092896, 2024-04-25T22:03:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: "average_primary_affinity_weighted": 0.54000002145767212, 2024-04-25T22:03:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: "error_message": "pool 4 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate" 2024-04-25T22:03:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:03:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: "osds": [ 2024-04-25T22:03:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 0, 2024-04-25T22:03:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: "uuid": "098ec92c-0fd2-4231-8beb-09fccca634d9", 2024-04-25T22:03:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: "up": 1, 2024-04-25T22:03:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: "in": 1, 2024-04-25T22:03:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 1, 2024-04-25T22:03:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity": 0.6649932861328125, 2024-04-25T22:03:13.932 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_begin": 0, 2024-04-25T22:03:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_end": 0, 2024-04-25T22:03:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: "up_from": 8, 2024-04-25T22:03:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: "up_thru": 58, 2024-04-25T22:03:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: "down_at": 0, 2024-04-25T22:03:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: "lost_at": 0, 2024-04-25T22:03:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-25T22:03:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:03:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:03:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6800", 2024-04-25T22:03:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:03:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.933 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:03:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6801", 2024-04-25T22:03:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:03:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:03:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addrs": { 2024-04-25T22:03:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:03:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:03:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6802", 2024-04-25T22:03:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:03:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:03:13.934 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6803", 2024-04-25T22:03:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:03:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:03:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addrs": { 2024-04-25T22:03:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:03:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:03:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6806", 2024-04-25T22:03:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:03:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:03:13.935 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6807", 2024-04-25T22:03:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:03:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:03:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addrs": { 2024-04-25T22:03:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:03:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:03:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6804", 2024-04-25T22:03:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:03:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:03:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.57:6805", 2024-04-25T22:03:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2385981072 2024-04-25T22:03:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:03:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.57:6801/2385981072", 2024-04-25T22:03:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addr": "172.21.15.57:6803/2385981072", 2024-04-25T22:03:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addr": "172.21.15.57:6807/2385981072", 2024-04-25T22:03:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addr": "172.21.15.57:6805/2385981072", 2024-04-25T22:03:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: "state": [ 2024-04-25T22:03:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: "exists", 2024-04-25T22:03:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: "up" 2024-04-25T22:03:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:03:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 1, 2024-04-25T22:03:13.937 INFO:teuthology.orchestra.run.smithi044.stdout: "uuid": "a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef", 2024-04-25T22:03:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: "up": 1, 2024-04-25T22:03:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: "in": 1, 2024-04-25T22:03:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 1, 2024-04-25T22:03:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity": 0.942596435546875, 2024-04-25T22:03:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_begin": 0, 2024-04-25T22:03:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_end": 0, 2024-04-25T22:03:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: "up_from": 8, 2024-04-25T22:03:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: "up_thru": 49, 2024-04-25T22:03:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: "down_at": 0, 2024-04-25T22:03:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: "lost_at": 0, 2024-04-25T22:03:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-25T22:03:13.938 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:03:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:03:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6800", 2024-04-25T22:03:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:03:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:03:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6801", 2024-04-25T22:03:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:03:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:03:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addrs": { 2024-04-25T22:03:13.939 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:03:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:03:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6802", 2024-04-25T22:03:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:03:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:03:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6803", 2024-04-25T22:03:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:03:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:03:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addrs": { 2024-04-25T22:03:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:03:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:03:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6806", 2024-04-25T22:03:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:03:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:03:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6807", 2024-04-25T22:03:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:03:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:03:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addrs": { 2024-04-25T22:03:13.941 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:03:13.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.942 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:03:13.942 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6804", 2024-04-25T22:03:13.942 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:03:13.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.942 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.942 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:03:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.79:6805", 2024-04-25T22:03:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 29975895 2024-04-25T22:03:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:03:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.79:6801/29975895", 2024-04-25T22:03:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addr": "172.21.15.79:6803/29975895", 2024-04-25T22:03:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addr": "172.21.15.79:6807/29975895", 2024-04-25T22:03:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addr": "172.21.15.79:6805/29975895", 2024-04-25T22:03:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: "state": [ 2024-04-25T22:03:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: "exists", 2024-04-25T22:03:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: "up" 2024-04-25T22:03:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:03:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.944 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 2, 2024-04-25T22:03:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: "uuid": "290ee5c1-81af-400c-b15a-f63c4794a3b0", 2024-04-25T22:03:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: "up": 1, 2024-04-25T22:03:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: "in": 1, 2024-04-25T22:03:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: "weight": 1, 2024-04-25T22:03:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_affinity": 0, 2024-04-25T22:03:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_begin": 0, 2024-04-25T22:03:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: "last_clean_end": 0, 2024-04-25T22:03:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: "up_from": 8, 2024-04-25T22:03:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: "up_thru": 58, 2024-04-25T22:03:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: "down_at": 0, 2024-04-25T22:03:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: "lost_at": 0, 2024-04-25T22:03:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addrs": { 2024-04-25T22:03:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:03:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:03:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6800", 2024-04-25T22:03:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:03:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:03:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6801", 2024-04-25T22:03:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:03:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:03:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addrs": { 2024-04-25T22:03:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:03:13.946 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:03:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6802", 2024-04-25T22:03:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:03:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:03:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6803", 2024-04-25T22:03:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:03:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:03:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addrs": { 2024-04-25T22:03:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:03:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.947 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:03:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6806", 2024-04-25T22:03:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:03:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:03:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6807", 2024-04-25T22:03:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:03:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:03:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addrs": { 2024-04-25T22:03:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-04-25T22:03:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-04-25T22:03:13.948 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6804", 2024-04-25T22:03:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:03:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-04-25T22:03:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.81:6805", 2024-04-25T22:03:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3918111900 2024-04-25T22:03:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:03:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: "public_addr": "172.21.15.81:6801/3918111900", 2024-04-25T22:03:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_addr": "172.21.15.81:6803/3918111900", 2024-04-25T22:03:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_back_addr": "172.21.15.81:6807/3918111900", 2024-04-25T22:03:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: "heartbeat_front_addr": "172.21.15.81:6805/3918111900", 2024-04-25T22:03:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: "state": [ 2024-04-25T22:03:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: "exists", 2024-04-25T22:03:13.949 INFO:teuthology.orchestra.run.smithi044.stdout: "up" 2024-04-25T22:03:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-04-25T22:03:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:03:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_xinfo": [ 2024-04-25T22:03:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 0, 2024-04-25T22:03:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: "down_stamp": "0.000000", 2024-04-25T22:03:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_probability": 0, 2024-04-25T22:03:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_interval": 0, 2024-04-25T22:03:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: "features": 4540701547738038271, 2024-04-25T22:03:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: "old_weight": 0, 2024-04-25T22:03:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: "last_purged_snaps_scrub": "2024-04-25T22:00:59.025944+0000", 2024-04-25T22:03:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: "dead_epoch": 0 2024-04-25T22:03:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 1, 2024-04-25T22:03:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: "down_stamp": "0.000000", 2024-04-25T22:03:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_probability": 0, 2024-04-25T22:03:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_interval": 0, 2024-04-25T22:03:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: "features": 4540701547738038271, 2024-04-25T22:03:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: "old_weight": 0, 2024-04-25T22:03:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: "last_purged_snaps_scrub": "2024-04-25T22:00:58.986080+0000", 2024-04-25T22:03:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: "dead_epoch": 0 2024-04-25T22:03:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-04-25T22:03:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": 2, 2024-04-25T22:03:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: "down_stamp": "0.000000", 2024-04-25T22:03:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_probability": 0, 2024-04-25T22:03:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: "laggy_interval": 0, 2024-04-25T22:03:13.951 INFO:teuthology.orchestra.run.smithi044.stdout: "features": 4540701547738038271, 2024-04-25T22:03:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: "old_weight": 0, 2024-04-25T22:03:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: "last_purged_snaps_scrub": "2024-04-25T22:00:58.971238+0000", 2024-04-25T22:03:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: "dead_epoch": 0 2024-04-25T22:03:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-04-25T22:03:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_upmap": [], 2024-04-25T22:03:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_upmap_items": [], 2024-04-25T22:03:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_upmap_primaries": [], 2024-04-25T22:03:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_temp": [], 2024-04-25T22:03:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: "primary_temp": [], 2024-04-25T22:03:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklist": {}, 2024-04-25T22:03:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: "range_blocklist": {}, 2024-04-25T22:03:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: "erasure_code_profiles": { 2024-04-25T22:03:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: "default": { 2024-04-25T22:03:13.952 INFO:teuthology.orchestra.run.smithi044.stdout: "crush-failure-domain": "osd", 2024-04-25T22:03:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: "k": "2", 2024-04-25T22:03:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: "m": "1", 2024-04-25T22:03:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: "plugin": "jerasure", 2024-04-25T22:03:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: "technique": "reed_sol_van" 2024-04-25T22:03:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-04-25T22:03:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: "removed_snaps_queue": [], 2024-04-25T22:03:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: "new_removed_snaps": [], 2024-04-25T22:03:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: "new_purged_snaps": [], 2024-04-25T22:03:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_node_flags": {}, 2024-04-25T22:03:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: "device_class_flags": {}, 2024-04-25T22:03:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode": { 2024-04-25T22:03:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode_enabled": false, 2024-04-25T22:03:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_bucket_count": 0, 2024-04-25T22:03:13.953 INFO:teuthology.orchestra.run.smithi044.stdout: "degraded_stretch_mode": 0, 2024-04-25T22:03:13.954 INFO:teuthology.orchestra.run.smithi044.stdout: "recovering_stretch_mode": 0, 2024-04-25T22:03:13.954 INFO:teuthology.orchestra.run.smithi044.stdout: "stretch_mode_bucket": 0 2024-04-25T22:03:13.954 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-04-25T22:03:13.954 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-25T22:03:13.955 INFO:tasks.workunit.client.0.smithi044.stdout:8/91: fdatasync f0 0 2024-04-25T22:03:13.955 INFO:tasks.workunit.client.0.smithi044.stdout:8/92: link f17 f1a 0 2024-04-25T22:03:13.955 INFO:tasks.workunit.client.0.smithi044.stdout:8/93: dread f17 [0,4194304] 0 2024-04-25T22:03:13.955 INFO:tasks.workunit.client.0.smithi044.stdout:8/94: unlink fb 0 2024-04-25T22:03:13.955 INFO:tasks.workunit.client.0.smithi044.stdout:8/95: dread f2 [0,4194304] 0 2024-04-25T22:03:13.955 INFO:tasks.workunit.client.0.smithi044.stdout:8/96: getdents . 0 2024-04-25T22:03:13.955 INFO:tasks.workunit.client.0.smithi044.stdout:8/97: truncate f2 1076012 0 2024-04-25T22:03:13.955 INFO:tasks.workunit.client.0.smithi044.stdout:8/98: rename c10 to c1b 0 2024-04-25T22:03:13.955 INFO:tasks.workunit.client.0.smithi044.stdout:8/99: fdatasync fc 0 2024-04-25T22:03:13.957 INFO:tasks.thrashosds.thrasher:j is {'epoch': 64, 'fsid': '1ced109c-704f-44b1-9811-a2da74898889', 'created': '2024-04-25T22:00:52.024472+0000', 'modified': '2024-04-25T22:03:12.729575+0000', 'last_up_change': '2024-04-25T22:01:03.432353+0000', 'last_in_change': '2024-04-25T22:00:53.642701+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:01:03.632568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.5358632802963257, 'average_primary_affinity': 0.800000011920929, 'average_primary_affinity_weighted': 0.5400000214576721}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:01:07.995071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.1500000953674316, 'score_stable': 1, 'optimal_score': 1.5, 'raw_score_acting': 3.2200000286102295, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.5358632802963257, 'average_primary_affinity': 0.800000011920929, 'average_primary_affinity_weighted': 0.5400000214576721, 'error_message': 'pool 2 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate'}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:01:12.514055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.449999809265137, 'score_stable': 1.059999942779541, 'optimal_score': 1.5, 'raw_score_acting': 9.670000076293945, 'raw_score_stable': 1.590000033378601, 'primary_affinity_weighted': 0.5358632802963257, 'average_primary_affinity': 0.800000011920929, 'average_primary_affinity_weighted': 0.5400000214576721, 'error_message': 'pool 3 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate'}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:01:12.963831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 14.510000228881836, 'score_stable': 1.0299999713897705, 'optimal_score': 1.5, 'raw_score_acting': 21.760000228881836, 'raw_score_stable': 1.5499999523162842, 'primary_affinity_weighted': 0.5358632802963257, 'average_primary_affinity': 0.800000011920929, 'average_primary_affinity_weighted': 0.5400000214576721, 'error_message': 'pool 4 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate'}}], 'osds': [{'osd': 0, 'uuid': '098ec92c-0fd2-4231-8beb-09fccca634d9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6649932861328125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 58, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6800', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6801', 'nonce': 2385981072}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6802', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6803', 'nonce': 2385981072}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6806', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6807', 'nonce': 2385981072}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6804', 'nonce': 2385981072}, {'type': 'v1', 'addr': '172.21.15.57:6805', 'nonce': 2385981072}]}, 'public_addr': '172.21.15.57:6801/2385981072', 'cluster_addr': '172.21.15.57:6803/2385981072', 'heartbeat_back_addr': '172.21.15.57:6807/2385981072', 'heartbeat_front_addr': '172.21.15.57:6805/2385981072', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.942596435546875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 49, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 29975895}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 29975895}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 29975895}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 29975895}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 29975895}]}, 'public_addr': '172.21.15.79:6801/29975895', 'cluster_addr': '172.21.15.79:6803/29975895', 'heartbeat_back_addr': '172.21.15.79:6807/29975895', 'heartbeat_front_addr': '172.21.15.79:6805/29975895', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '290ee5c1-81af-400c-b15a-f63c4794a3b0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 58, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6800', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6801', 'nonce': 3918111900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 3918111900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 3918111900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 3918111900}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 3918111900}]}, 'public_addr': '172.21.15.81:6801/3918111900', 'cluster_addr': '172.21.15.81:6803/3918111900', 'heartbeat_back_addr': '172.21.15.81:6807/3918111900', 'heartbeat_front_addr': '172.21.15.81:6805/3918111900', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:00:59.025944+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:00:58.986080+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:00:58.971238+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-25T22:03:13.957 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-25T22:03:13.961 INFO:tasks.workunit.client.0.smithi044.stdout:8/100: write f19 [1491914,29995] 0 2024-04-25T22:03:13.961 INFO:tasks.workunit.client.0.smithi044.stdout:8/101: rename le to l1c 0 2024-04-25T22:03:13.962 INFO:tasks.workunit.client.0.smithi044.stdout:8/102: mknod c1d 0 2024-04-25T22:03:13.962 INFO:tasks.workunit.client.0.smithi044.stdout:8/103: creat f1e x:0 0 0 2024-04-25T22:03:13.962 INFO:tasks.workunit.client.0.smithi044.stdout:8/104: creat f1f x:0 0 0 2024-04-25T22:03:13.962 INFO:tasks.workunit.client.0.smithi044.stdout:8/105: dwrite f1e [0,4194304] 0 2024-04-25T22:03:13.962 INFO:tasks.workunit.client.0.smithi044.stdout:8/106: creat f20 x:0 0 0 2024-04-25T22:03:13.962 INFO:tasks.workunit.client.0.smithi044.stdout:8/107: write f1e [5059912,57244] 0 2024-04-25T22:03:13.962 INFO:tasks.workunit.client.0.smithi044.stdout:8/108: truncate f4 5216645 0 2024-04-25T22:03:13.962 INFO:tasks.workunit.client.0.smithi044.stdout:8/109: dread f17 [0,4194304] 0 2024-04-25T22:03:13.962 INFO:tasks.workunit.client.0.smithi044.stdout:8/110: readlink l13 0 2024-04-25T22:03:13.962 INFO:tasks.workunit.client.0.smithi044.stdout:8/111: dread f2 [0,4194304] 0 2024-04-25T22:03:13.962 INFO:tasks.workunit.client.0.smithi044.stdout:8/112: truncate f9 1311451 0 2024-04-25T22:03:13.962 INFO:tasks.workunit.client.0.smithi044.stdout:8/113: mknod c21 0 2024-04-25T22:03:13.962 INFO:tasks.workunit.client.0.smithi044.stdout:8/114: creat f22 x:0 0 0 2024-04-25T22:03:13.963 INFO:tasks.workunit.client.0.smithi044.stdout:8/115: chown f17 25 1 2024-04-25T22:03:13.963 INFO:tasks.workunit.client.0.smithi044.stdout:8/116: write f20 [790368,26165] 0 2024-04-25T22:03:13.963 INFO:tasks.workunit.client.0.smithi044.stdout:8/117: creat f23 x:0 0 0 2024-04-25T22:03:13.963 INFO:tasks.workunit.client.0.smithi044.stdout:8/118: readlink l13 0 2024-04-25T22:03:13.963 INFO:tasks.workunit.client.0.smithi044.stdout:8/119: stat f6 0 2024-04-25T22:03:13.963 INFO:tasks.workunit.client.0.smithi044.stdout:8/120: dread - f23 zero size 2024-04-25T22:03:13.963 INFO:tasks.workunit.client.0.smithi044.stdout:8/121: dread f0 [0,4194304] 0 2024-04-25T22:03:13.963 INFO:tasks.workunit.client.0.smithi044.stdout:8/122: chown l1c 537 1 2024-04-25T22:03:13.963 INFO:tasks.workunit.client.0.smithi044.stdout:8/123: rmdir - no directory 2024-04-25T22:03:13.963 INFO:tasks.workunit.client.0.smithi044.stdout:8/124: chown f8 3 1 2024-04-25T22:03:13.963 INFO:tasks.workunit.client.0.smithi044.stdout:8/125: dwrite f19 [0,4194304] 0 2024-04-25T22:03:13.963 INFO:tasks.workunit.client.0.smithi044.stdout:8/126: readlink l1c 0 2024-04-25T22:03:13.963 INFO:tasks.workunit.client.0.smithi044.stdout:8/127: truncate fd 4612873 0 2024-04-25T22:03:13.963 INFO:tasks.workunit.client.0.smithi044.stdout:8/128: creat f24 x:0 0 0 2024-04-25T22:03:13.964 INFO:tasks.workunit.client.0.smithi044.stdout:8/129: write f12 [845639,91230] 0 2024-04-25T22:03:13.964 INFO:tasks.workunit.client.0.smithi044.stdout:8/130: dread - f1f zero size 2024-04-25T22:03:13.964 INFO:tasks.workunit.client.0.smithi044.stdout:8/131: getdents . 0 2024-04-25T22:03:13.964 INFO:tasks.workunit.client.0.smithi044.stdout:8/132: stat c21 0 2024-04-25T22:03:13.964 INFO:tasks.workunit.client.0.smithi044.stdout:8/133: creat f25 x:0 0 0 2024-04-25T22:03:13.964 INFO:tasks.workunit.client.0.smithi044.stdout:8/134: write f25 [41349,26502] 0 2024-04-25T22:03:13.964 INFO:tasks.workunit.client.0.smithi044.stdout:8/135: write f1e [3367652,45968] 0 2024-04-25T22:03:13.964 INFO:tasks.workunit.client.0.smithi044.stdout:8/136: write f2 [3681622,71704] 0 2024-04-25T22:03:13.964 INFO:tasks.workunit.client.0.smithi044.stdout:8/137: stat f1f 0 2024-04-25T22:03:13.964 INFO:tasks.workunit.client.0.smithi044.stdout:8/138: unlink f1a 0 2024-04-25T22:03:13.964 INFO:tasks.workunit.client.0.smithi044.stdout:8/139: symlink l26 0 2024-04-25T22:03:13.964 INFO:tasks.workunit.client.0.smithi044.stdout:8/140: creat f27 x:0 0 0 2024-04-25T22:03:13.964 INFO:tasks.workunit.client.0.smithi044.stdout:8/141: creat f28 x:0 0 0 2024-04-25T22:03:13.964 INFO:tasks.workunit.client.0.smithi044.stdout:8/142: rename l1c to l29 0 2024-04-25T22:03:13.965 INFO:tasks.workunit.client.0.smithi044.stdout:8/143: mkdir d2a 0 2024-04-25T22:03:13.965 INFO:tasks.workunit.client.0.smithi044.stdout:8/144: dwrite f28 [0,4194304] 0 2024-04-25T22:03:13.965 INFO:tasks.workunit.client.0.smithi044.stdout:8/145: mknod d2a/c2b 0 2024-04-25T22:03:13.965 INFO:tasks.workunit.client.0.smithi044.stdout:8/146: mknod d2a/c2c 0 2024-04-25T22:03:13.982 INFO:tasks.workunit.client.0.smithi044.stdout:8/147: fdatasync fd 0 2024-04-25T22:03:13.983 INFO:tasks.workunit.client.0.smithi044.stdout:8/148: write f9 [665895,38742] 0 2024-04-25T22:03:13.984 INFO:tasks.workunit.client.0.smithi044.stdout:8/149: creat d2a/f2d x:0 0 0 2024-04-25T22:03:13.985 INFO:tasks.workunit.client.0.smithi044.stdout:8/150: stat c21 0 2024-04-25T22:03:13.988 INFO:tasks.workunit.client.0.smithi044.stdout:8/151: fsync f19 0 2024-04-25T22:03:14.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:13.997+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:14.093 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:14.093 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:14.093 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:03:14.093 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:14.103 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:14.096+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:14.106 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:14.204 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:14.200+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:14.268 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:14.268 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:14.268 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:03:14.268 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:03:14.268 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:14.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:14.329 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:14.324+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:14.400 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:14.400 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:03:14.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:03:14.400 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:4 4.32 e51/16 4:4def72d4:::10000000003.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:03:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.405619977000001, 2024-04-25T22:03:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10987878, 2024-04-25T22:03:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992461+0000", 2024-04-25T22:03:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5780000000000001e-06 2024-04-25T22:03:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997784+0000", 2024-04-25T22:03:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005323627 2024-04-25T22:03:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997815+0000", 2024-04-25T22:03:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0066999999999999e-05 2024-04-25T22:03:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997830+0000", 2024-04-25T22:03:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5290000000000001e-05 2024-04-25T22:03:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997927+0000", 2024-04-25T22:03:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7391000000000003e-05 2024-04-25T22:03:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997947+0000", 2024-04-25T22:03:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0259999999999999e-05 2024-04-25T22:03:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102225+0000", 2024-04-25T22:03:14.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10427777100000001 2024-04-25T22:03:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102337+0000", 2024-04-25T22:03:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000111796 2024-04-25T22:03:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:6 4.13 e51/16 4:cbe72331:::10000000003.00000002:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.310805992999999, 2024-04-25T22:03:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.11536371400000001, 2024-04-25T22:03:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087273+0000", 2024-04-25T22:03:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:03:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089358+0000", 2024-04-25T22:03:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0020848170000000001 2024-04-25T22:03:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089372+0000", 2024-04-25T22:03:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.452e-05 2024-04-25T22:03:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089381+0000", 2024-04-25T22:03:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5979999999999997e-06 2024-04-25T22:03:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089486+0000", 2024-04-25T22:03:14.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105573 2024-04-25T22:03:14.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089536+0000", 2024-04-25T22:03:14.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9505000000000001e-05 2024-04-25T22:03:14.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202556+0000", 2024-04-25T22:03:14.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.113020169 2024-04-25T22:03:14.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202636+0000", 2024-04-25T22:03:14.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9814000000000005e-05 2024-04-25T22:03:14.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.410 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.410 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:5 4.10 e51/16 4:09a4c37f:::10000000003.00000001:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:14.410 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:14.410 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.298230075999999, 2024-04-25T22:03:14.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.110104358, 2024-04-25T22:03:14.410 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.410 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.410 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.410 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:14.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:14.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099849+0000", 2024-04-25T22:03:14.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7000000000000003e-07 2024-04-25T22:03:14.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108349+0000", 2024-04-25T22:03:14.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085003230000000006 2024-04-25T22:03:14.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108391+0000", 2024-04-25T22:03:14.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2011999999999997e-05 2024-04-25T22:03:14.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108415+0000", 2024-04-25T22:03:14.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3702000000000001e-05 2024-04-25T22:03:14.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108504+0000", 2024-04-25T22:03:14.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8684999999999995e-05 2024-04-25T22:03:14.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108520+0000", 2024-04-25T22:03:14.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5931999999999999e-05 2024-04-25T22:03:14.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209918+0000", 2024-04-25T22:03:14.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.101398696 2024-04-25T22:03:14.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209952+0000", 2024-04-25T22:03:14.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4038000000000002e-05 2024-04-25T22:03:14.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.414 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.414 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11 4.28 e51/49 4:177a762d:::10000000201.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:14.414 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:14.414 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.289528149999999, 2024-04-25T22:03:14.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098799331000000004, 2024-04-25T22:03:14.415 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.415 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.415 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:14.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:14.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108551+0000", 2024-04-25T22:03:14.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0699999999999996e-07 2024-04-25T22:03:14.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108576+0000", 2024-04-25T22:03:14.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4856000000000001e-05 2024-04-25T22:03:14.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108593+0000", 2024-04-25T22:03:14.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7125999999999998e-05 2024-04-25T22:03:14.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108609+0000", 2024-04-25T22:03:14.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6535999999999999e-05 2024-04-25T22:03:14.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108713+0000", 2024-04-25T22:03:14.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010344999999999999 2024-04-25T22:03:14.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108762+0000", 2024-04-25T22:03:14.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8711000000000002e-05 2024-04-25T22:03:14.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207305+0000", 2024-04-25T22:03:14.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098543566999999999 2024-04-25T22:03:14.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207349+0000", 2024-04-25T22:03:14.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4178000000000003e-05 2024-04-25T22:03:14.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.419 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.419 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:12 4.28 e51/49 4:15246602:::10000000202.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:03:14.419 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:14.419 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.289446859000002, 2024-04-25T22:03:14.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098749009999999998, 2024-04-25T22:03:14.419 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.419 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.420 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:14.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:14.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108632+0000", 2024-04-25T22:03:14.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2699999999999999e-07 2024-04-25T22:03:14.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108647+0000", 2024-04-25T22:03:14.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4585e-05 2024-04-25T22:03:14.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108667+0000", 2024-04-25T22:03:14.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9887000000000001e-05 2024-04-25T22:03:14.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108680+0000", 2024-04-25T22:03:14.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3249e-05 2024-04-25T22:03:14.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109917+0000", 2024-04-25T22:03:14.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012367050000000001 2024-04-25T22:03:14.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109961+0000", 2024-04-25T22:03:14.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4029000000000001e-05 2024-04-25T22:03:14.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207351+0000", 2024-04-25T22:03:14.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.097390791000000004 2024-04-25T22:03:14.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207380+0000", 2024-04-25T22:03:14.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9037e-05 2024-04-25T22:03:14.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.423 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.424 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:8 4.3b e51/49 4:deccbd37:::100000001fe.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:14.424 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:14.424 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.289381955, 2024-04-25T22:03:14.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090839771, 2024-04-25T22:03:14.424 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.424 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.424 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.424 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:14.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:14.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108697+0000", 2024-04-25T22:03:14.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1399999999999997e-07 2024-04-25T22:03:14.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108712+0000", 2024-04-25T22:03:14.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4772e-05 2024-04-25T22:03:14.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108728+0000", 2024-04-25T22:03:14.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5943e-05 2024-04-25T22:03:14.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108740+0000", 2024-04-25T22:03:14.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.235e-05 2024-04-25T22:03:14.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108797+0000", 2024-04-25T22:03:14.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6879000000000002e-05 2024-04-25T22:03:14.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108812+0000", 2024-04-25T22:03:14.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5268999999999999e-05 2024-04-25T22:03:14.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199495+0000", 2024-04-25T22:03:14.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090683071000000004 2024-04-25T22:03:14.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199536+0000", 2024-04-25T22:03:14.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0873e-05 2024-04-25T22:03:14.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.428 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.428 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:6909 4.6 4:631b09cd:::10000001f99.00000000:head [write 0~1706] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:14.429 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.879622+0000", 2024-04-25T22:03:14.429 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.518456445, 2024-04-25T22:03:14.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83167118299999998, 2024-04-25T22:03:14.429 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.429 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.429 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.429 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:14.429 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:14.429 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:14.429 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 6909 2024-04-25T22:03:14.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.429 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879622+0000", 2024-04-25T22:03:14.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879622+0000", 2024-04-25T22:03:14.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879624+0000", 2024-04-25T22:03:14.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.429e-06 2024-04-25T22:03:14.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879639+0000", 2024-04-25T22:03:14.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4534e-05 2024-04-25T22:03:14.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879669+0000", 2024-04-25T22:03:14.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0349e-05 2024-04-25T22:03:14.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879684+0000", 2024-04-25T22:03:14.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:03:14.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879767+0000", 2024-04-25T22:03:14.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3410000000000003e-05 2024-04-25T22:03:14.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:14.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879783+0000", 2024-04-25T22:03:14.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5378000000000001e-05 2024-04-25T22:03:14.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.700268+0000", 2024-04-25T22:03:14.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.82048565699999998 2024-04-25T22:03:14.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.700627+0000", 2024-04-25T22:03:14.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035847800000000002 2024-04-25T22:03:14.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:14.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.700977+0000", 2024-04-25T22:03:14.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035024699999999998 2024-04-25T22:03:14.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:14.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.704901+0000", 2024-04-25T22:03:14.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039243230000000004 2024-04-25T22:03:14.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:14.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711150+0000", 2024-04-25T22:03:14.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0062490519999999997 2024-04-25T22:03:14.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711230+0000", 2024-04-25T22:03:14.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9370999999999996e-05 2024-04-25T22:03:14.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:14.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3221999999999999e-05 2024-04-25T22:03:14.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.437 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.437 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:6922 4.6 4:62b4ea5c:::10000001fab.00000000:head [write 0~7953] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:14.437 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.902807+0000", 2024-04-25T22:03:14.437 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4952712179999992, 2024-04-25T22:03:14.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80868129799999999, 2024-04-25T22:03:14.437 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.437 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.438 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:14.438 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:14.438 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:14.438 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 6922 2024-04-25T22:03:14.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.438 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902807+0000", 2024-04-25T22:03:14.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902807+0000", 2024-04-25T22:03:14.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902809+0000", 2024-04-25T22:03:14.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4099999999999998e-06 2024-04-25T22:03:14.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902830+0000", 2024-04-25T22:03:14.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0381999999999999e-05 2024-04-25T22:03:14.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902852+0000", 2024-04-25T22:03:14.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2357e-05 2024-04-25T22:03:14.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902864+0000", 2024-04-25T22:03:14.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2329e-05 2024-04-25T22:03:14.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902923+0000", 2024-04-25T22:03:14.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8485e-05 2024-04-25T22:03:14.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:14.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902930+0000", 2024-04-25T22:03:14.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4200000000000001e-06 2024-04-25T22:03:14.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.702506+0000", 2024-04-25T22:03:14.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.79957517899999997 2024-04-25T22:03:14.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.702674+0000", 2024-04-25T22:03:14.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016807200000000001 2024-04-25T22:03:14.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:14.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.702860+0000", 2024-04-25T22:03:14.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018624200000000001 2024-04-25T22:03:14.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:14.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706186+0000", 2024-04-25T22:03:14.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033265619999999999 2024-04-25T22:03:14.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:14.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711369+0000", 2024-04-25T22:03:14.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005182496 2024-04-25T22:03:14.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711436+0000", 2024-04-25T22:03:14.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7135e-05 2024-04-25T22:03:14.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711488+0000", 2024-04-25T22:03:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2228999999999997e-05 2024-04-25T22:03:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:6926 4.6 4:62749b46:::10000001faf.00000000:head [write 0~2676] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.908574+0000", 2024-04-25T22:03:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4895043700000006, 2024-04-25T22:03:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.803246511, 2024-04-25T22:03:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:14.445 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:14.445 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:14.445 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 6926 2024-04-25T22:03:14.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.445 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908574+0000", 2024-04-25T22:03:14.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908574+0000", 2024-04-25T22:03:14.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908576+0000", 2024-04-25T22:03:14.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.784e-06 2024-04-25T22:03:14.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908585+0000", 2024-04-25T22:03:14.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6420000000000002e-06 2024-04-25T22:03:14.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908609+0000", 2024-04-25T22:03:14.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3303e-05 2024-04-25T22:03:14.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908622+0000", 2024-04-25T22:03:14.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3783e-05 2024-04-25T22:03:14.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908730+0000", 2024-04-25T22:03:14.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107831 2024-04-25T22:03:14.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:14.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908748+0000", 2024-04-25T22:03:14.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7909000000000001e-05 2024-04-25T22:03:14.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.703586+0000", 2024-04-25T22:03:14.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.794838131 2024-04-25T22:03:14.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.703854+0000", 2024-04-25T22:03:14.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026782299999999999 2024-04-25T22:03:14.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:14.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.704060+0000", 2024-04-25T22:03:14.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020576200000000001 2024-04-25T22:03:14.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:14.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711121+0000", 2024-04-25T22:03:14.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070615510000000001 2024-04-25T22:03:14.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:14.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711705+0000", 2024-04-25T22:03:14.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00058315899999999998 2024-04-25T22:03:14.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711769+0000", 2024-04-25T22:03:14.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4877999999999998e-05 2024-04-25T22:03:14.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711820+0000", 2024-04-25T22:03:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0955000000000003e-05 2024-04-25T22:03:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7057 4.6 4:63cd8154:::10000002047.00000000:head [write 0~2047] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.194487+0000", 2024-04-25T22:03:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.2035914600000002, 2024-04-25T22:03:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.51749014100000001, 2024-04-25T22:03:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7057 2024-04-25T22:03:14.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.452 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194487+0000", 2024-04-25T22:03:14.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194487+0000", 2024-04-25T22:03:14.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194489+0000", 2024-04-25T22:03:14.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-04-25T22:03:14.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194499+0000", 2024-04-25T22:03:14.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0117e-05 2024-04-25T22:03:14.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194522+0000", 2024-04-25T22:03:14.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2925000000000002e-05 2024-04-25T22:03:14.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194541+0000", 2024-04-25T22:03:14.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9137e-05 2024-04-25T22:03:14.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194712+0000", 2024-04-25T22:03:14.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000170602 2024-04-25T22:03:14.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:14.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194743+0000", 2024-04-25T22:03:14.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1479000000000001e-05 2024-04-25T22:03:14.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.704997+0000", 2024-04-25T22:03:14.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.51025366000000005 2024-04-25T22:03:14.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.705197+0000", 2024-04-25T22:03:14.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020022799999999999 2024-04-25T22:03:14.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:14.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.705399+0000", 2024-04-25T22:03:14.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020160499999999999 2024-04-25T22:03:14.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:14.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711586+0000", 2024-04-25T22:03:14.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061875350000000001 2024-04-25T22:03:14.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:14.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711841+0000", 2024-04-25T22:03:14.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025510300000000001 2024-04-25T22:03:14.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711906+0000", 2024-04-25T22:03:14.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4381999999999994e-05 2024-04-25T22:03:14.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711977+0000", 2024-04-25T22:03:14.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1295000000000001e-05 2024-04-25T22:03:14.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.456 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.457 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7114 4.6 4:63547153:::10000002086.00000000:head [write 0~67896] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:14.457 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.411903+0000", 2024-04-25T22:03:14.457 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9861748759999998, 2024-04-25T22:03:14.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.301551715, 2024-04-25T22:03:14.457 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.457 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.457 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.457 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:14.457 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:14.458 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:14.458 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7114 2024-04-25T22:03:14.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.458 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.411903+0000", 2024-04-25T22:03:14.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.411903+0000", 2024-04-25T22:03:14.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.411906+0000", 2024-04-25T22:03:14.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9469999999999999e-06 2024-04-25T22:03:14.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412184+0000", 2024-04-25T22:03:14.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027727600000000002 2024-04-25T22:03:14.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412215+0000", 2024-04-25T22:03:14.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1899000000000001e-05 2024-04-25T22:03:14.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412230+0000", 2024-04-25T22:03:14.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4703e-05 2024-04-25T22:03:14.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412384+0000", 2024-04-25T22:03:14.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015366300000000001 2024-04-25T22:03:14.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:14.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412405+0000", 2024-04-25T22:03:14.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0936000000000001e-05 2024-04-25T22:03:14.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706266+0000", 2024-04-25T22:03:14.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.29386084299999998 2024-04-25T22:03:14.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706440+0000", 2024-04-25T22:03:14.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174759 2024-04-25T22:03:14.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:14.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706655+0000", 2024-04-25T22:03:14.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021489100000000001 2024-04-25T22:03:14.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:14.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711675+0000", 2024-04-25T22:03:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050198639999999997 2024-04-25T22:03:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.713316+0000", 2024-04-25T22:03:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016410280000000001 2024-04-25T22:03:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.713391+0000", 2024-04-25T22:03:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5065e-05 2024-04-25T22:03:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.713455+0000", 2024-04-25T22:03:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3841000000000001e-05 2024-04-25T22:03:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7117 4.6 4:60a5b603:::10000002089.00000000:head [write 0~12740] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.421192+0000", 2024-04-25T22:03:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9768864780000008, 2024-04-25T22:03:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.29400416200000001, 2024-04-25T22:03:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7117 2024-04-25T22:03:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421192+0000", 2024-04-25T22:03:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421192+0000", 2024-04-25T22:03:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421194+0000", 2024-04-25T22:03:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3700000000000002e-06 2024-04-25T22:03:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421247+0000", 2024-04-25T22:03:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2539e-05 2024-04-25T22:03:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421278+0000", 2024-04-25T22:03:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1392e-05 2024-04-25T22:03:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421293+0000", 2024-04-25T22:03:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5133000000000001e-05 2024-04-25T22:03:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421487+0000", 2024-04-25T22:03:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019340899999999999 2024-04-25T22:03:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421506+0000", 2024-04-25T22:03:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9568999999999998e-05 2024-04-25T22:03:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.709232+0000", 2024-04-25T22:03:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.28772543699999997 2024-04-25T22:03:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.709416+0000", 2024-04-25T22:03:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000184019 2024-04-25T22:03:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.709668+0000", 2024-04-25T22:03:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025279000000000002 2024-04-25T22:03:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712068+0000", 2024-04-25T22:03:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002399558 2024-04-25T22:03:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.715072+0000", 2024-04-25T22:03:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030037800000000002 2024-04-25T22:03:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.715143+0000", 2024-04-25T22:03:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1000999999999993e-05 2024-04-25T22:03:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.715196+0000", 2024-04-25T22:03:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3164999999999997e-05 2024-04-25T22:03:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7136 4.6 4:60bfd03c:::100000020a0.00000000:head [write 0~1357] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.489503+0000", 2024-04-25T22:03:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9085755970000005, 2024-04-25T22:03:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.22876102600000001, 2024-04-25T22:03:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7136 2024-04-25T22:03:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489503+0000", 2024-04-25T22:03:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489503+0000", 2024-04-25T22:03:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489505+0000", 2024-04-25T22:03:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.486e-06 2024-04-25T22:03:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489517+0000", 2024-04-25T22:03:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.217e-05 2024-04-25T22:03:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489544+0000", 2024-04-25T22:03:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6852999999999999e-05 2024-04-25T22:03:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489559+0000", 2024-04-25T22:03:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:03:14.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489705+0000", 2024-04-25T22:03:14.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014583 2024-04-25T22:03:14.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:14.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489722+0000", 2024-04-25T22:03:14.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7376000000000001e-05 2024-04-25T22:03:14.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712122+0000", 2024-04-25T22:03:14.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.22239948300000001 2024-04-25T22:03:14.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712376+0000", 2024-04-25T22:03:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025398700000000001 2024-04-25T22:03:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712639+0000", 2024-04-25T22:03:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026326300000000002 2024-04-25T22:03:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.714861+0000", 2024-04-25T22:03:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00222236 2024-04-25T22:03:14.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:14.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.718091+0000", 2024-04-25T22:03:14.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032294400000000001 2024-04-25T22:03:14.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.718197+0000", 2024-04-25T22:03:14.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010655 2024-04-25T22:03:14.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.718264+0000", 2024-04-25T22:03:14.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6482000000000005e-05 2024-04-25T22:03:14.479 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.479 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.479 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.479 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:196 3.1e e59/15 3:7bf7e7b5:::200.00000006:head v 59'56, mlcod=58'54)", 2024-04-25T22:03:14.479 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.860149+0000", 2024-04-25T22:03:14.479 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.5379292400000004, 2024-04-25T22:03:14.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.081648222000000006, 2024-04-25T22:03:14.480 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.480 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.480 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.480 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.860149+0000", 2024-04-25T22:03:14.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.860149+0000", 2024-04-25T22:03:14.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.860151+0000", 2024-04-25T22:03:14.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1100000000000001e-06 2024-04-25T22:03:14.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.864700+0000", 2024-04-25T22:03:14.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045484289999999997 2024-04-25T22:03:14.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.864728+0000", 2024-04-25T22:03:14.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8022999999999999e-05 2024-04-25T22:03:14.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.864744+0000", 2024-04-25T22:03:14.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.649e-05 2024-04-25T22:03:14.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.864841+0000", 2024-04-25T22:03:14.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7397000000000003e-05 2024-04-25T22:03:14.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.864898+0000", 2024-04-25T22:03:14.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6854999999999997e-05 2024-04-25T22:03:14.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.941744+0000", 2024-04-25T22:03:14.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.076845998999999998 2024-04-25T22:03:14.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.941797+0000", 2024-04-25T22:03:14.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2918999999999999e-05 2024-04-25T22:03:14.483 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.483 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.483 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.483 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:299 3.0 3:02ac1934:::200.00000009:head [write 0~3532922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T22:03:14.483 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:10.968409+0000", 2024-04-25T22:03:14.484 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.429669573, 2024-04-25T22:03:14.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.094675465, 2024-04-25T22:03:14.484 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.484 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.484 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.484 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.968409+0000", 2024-04-25T22:03:14.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.968409+0000", 2024-04-25T22:03:14.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.968411+0000", 2024-04-25T22:03:14.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.012e-06 2024-04-25T22:03:14.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974350+0000", 2024-04-25T22:03:14.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059392259999999997 2024-04-25T22:03:14.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974375+0000", 2024-04-25T22:03:14.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:03:14.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974386+0000", 2024-04-25T22:03:14.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0900000000000001e-05 2024-04-25T22:03:14.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974473+0000", 2024-04-25T22:03:14.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6942999999999997e-05 2024-04-25T22:03:14.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974562+0000", 2024-04-25T22:03:14.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8744000000000003e-05 2024-04-25T22:03:14.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:14.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974706+0000", 2024-04-25T22:03:14.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014392499999999999 2024-04-25T22:03:14.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:14.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.020272+0000", 2024-04-25T22:03:14.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.045566723000000003 2024-04-25T22:03:14.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:14.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.062890+0000", 2024-04-25T22:03:14.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042617796999999999 2024-04-25T22:03:14.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.063008+0000", 2024-04-25T22:03:14.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011757 2024-04-25T22:03:14.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.063084+0000", 2024-04-25T22:03:14.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6395000000000003e-05 2024-04-25T22:03:14.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.488 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.488 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:10644 4.24 4:27515ddb:::100000030ad.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:14.489 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:13.506492+0000", 2024-04-25T22:03:14.489 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.89158653399999999, 2024-04-25T22:03:14.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066703626000000002, 2024-04-25T22:03:14.489 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.489 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.489 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.489 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:14.489 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:14.489 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:14.489 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 10644 2024-04-25T22:03:14.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.489 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.506492+0000", 2024-04-25T22:03:14.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.506492+0000", 2024-04-25T22:03:14.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.506494+0000", 2024-04-25T22:03:14.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6429999999999999e-06 2024-04-25T22:03:14.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.519629+0000", 2024-04-25T22:03:14.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013134249000000001 2024-04-25T22:03:14.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.519658+0000", 2024-04-25T22:03:14.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9586000000000001e-05 2024-04-25T22:03:14.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.519673+0000", 2024-04-25T22:03:14.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.472e-05 2024-04-25T22:03:14.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.519814+0000", 2024-04-25T22:03:14.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014130999999999999 2024-04-25T22:03:14.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.520065+0000", 2024-04-25T22:03:14.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025122300000000002 2024-04-25T22:03:14.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:14.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.520313+0000", 2024-04-25T22:03:14.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024737700000000001 2024-04-25T22:03:14.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:14.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.573007+0000", 2024-04-25T22:03:14.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052693795000000002 2024-04-25T22:03:14.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:14.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.573040+0000", 2024-04-25T22:03:14.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3148999999999997e-05 2024-04-25T22:03:14.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.573121+0000", 2024-04-25T22:03:14.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1495000000000005e-05 2024-04-25T22:03:14.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.573195+0000", 2024-04-25T22:03:14.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4078999999999993e-05 2024-04-25T22:03:14.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.494 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.494 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:10643 4.21 e64/16 4:84251430:::100000030be.00000000:head v 64'178, mlcod=64'176)", 2024-04-25T22:03:14.494 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:13.511510+0000", 2024-04-25T22:03:14.494 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.88656802599999995, 2024-04-25T22:03:14.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066529109000000003, 2024-04-25T22:03:14.494 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.494 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.494 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.511510+0000", 2024-04-25T22:03:14.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.511510+0000", 2024-04-25T22:03:14.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.511512+0000", 2024-04-25T22:03:14.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3999999999999999e-06 2024-04-25T22:03:14.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.517166+0000", 2024-04-25T22:03:14.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0056545409999999999 2024-04-25T22:03:14.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.517203+0000", 2024-04-25T22:03:14.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6553000000000001e-05 2024-04-25T22:03:14.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.517220+0000", 2024-04-25T22:03:14.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7459e-05 2024-04-25T22:03:14.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.517392+0000", 2024-04-25T22:03:14.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017202999999999999 2024-04-25T22:03:14.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.517437+0000", 2024-04-25T22:03:14.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4938999999999998e-05 2024-04-25T22:03:14.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.577908+0000", 2024-04-25T22:03:14.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.060470626 2024-04-25T22:03:14.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.578039+0000", 2024-04-25T22:03:14.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013156100000000001 2024-04-25T22:03:14.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.498 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.498 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:10648 4.33 e64/49 4:cc614d18:::100000030cb.00000000:head v 64'159, mlcod=64'157)", 2024-04-25T22:03:14.498 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:13.541451+0000", 2024-04-25T22:03:14.498 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.85662762199999998, 2024-04-25T22:03:14.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.120967456, 2024-04-25T22:03:14.498 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.498 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.499 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.541451+0000", 2024-04-25T22:03:14.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.541451+0000", 2024-04-25T22:03:14.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.541453+0000", 2024-04-25T22:03:14.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3530000000000002e-06 2024-04-25T22:03:14.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.545862+0000", 2024-04-25T22:03:14.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004409451 2024-04-25T22:03:14.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.545895+0000", 2024-04-25T22:03:14.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2811999999999997e-05 2024-04-25T22:03:14.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.545918+0000", 2024-04-25T22:03:14.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2407000000000001e-05 2024-04-25T22:03:14.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.546085+0000", 2024-04-25T22:03:14.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000167159 2024-04-25T22:03:14.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.546149+0000", 2024-04-25T22:03:14.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4208999999999995e-05 2024-04-25T22:03:14.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.662281+0000", 2024-04-25T22:03:14.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.116132255 2024-04-25T22:03:14.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.662418+0000", 2024-04-25T22:03:14.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013681000000000001 2024-04-25T22:03:14.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.502 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.502 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:10649 4.f e64/16 4:f2e415db:::100000030cf.00000000:head v 64'161, mlcod=64'159)", 2024-04-25T22:03:14.502 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:13.551314+0000", 2024-04-25T22:03:14.503 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.84676428299999995, 2024-04-25T22:03:14.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.060708294000000003, 2024-04-25T22:03:14.503 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.503 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.503 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.551314+0000", 2024-04-25T22:03:14.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.551314+0000", 2024-04-25T22:03:14.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.551316+0000", 2024-04-25T22:03:14.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.697e-06 2024-04-25T22:03:14.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.556887+0000", 2024-04-25T22:03:14.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055718419999999996 2024-04-25T22:03:14.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.556922+0000", 2024-04-25T22:03:14.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4619000000000002e-05 2024-04-25T22:03:14.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.556945+0000", 2024-04-25T22:03:14.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2813e-05 2024-04-25T22:03:14.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.557146+0000", 2024-04-25T22:03:14.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000200755 2024-04-25T22:03:14.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.557191+0000", 2024-04-25T22:03:14.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5368999999999999e-05 2024-04-25T22:03:14.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.611907+0000", 2024-04-25T22:03:14.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054716257999999997 2024-04-25T22:03:14.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.612022+0000", 2024-04-25T22:03:14.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000114941 2024-04-25T22:03:14.506 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.506 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.506 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.507 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:10650 4.3b e64/49 4:dc84b0b7:::100000030cf.00000001:head v 64'175, mlcod=64'173)", 2024-04-25T22:03:14.507 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:13.589819+0000", 2024-04-25T22:03:14.507 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.80825943700000003, 2024-04-25T22:03:14.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.072693051999999994, 2024-04-25T22:03:14.507 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:14.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:14.507 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:14.507 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:14.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:14.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.589819+0000", 2024-04-25T22:03:14.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:14.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.589819+0000", 2024-04-25T22:03:14.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:14.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:14.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.589821+0000", 2024-04-25T22:03:14.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0470000000000001e-06 2024-04-25T22:03:14.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:14.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.593804+0000", 2024-04-25T22:03:14.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039833170000000001 2024-04-25T22:03:14.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:14.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.593835+0000", 2024-04-25T22:03:14.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0883000000000002e-05 2024-04-25T22:03:14.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:14.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.593850+0000", 2024-04-25T22:03:14.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4823e-05 2024-04-25T22:03:14.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:14.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.593986+0000", 2024-04-25T22:03:14.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013660000000000001 2024-04-25T22:03:14.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:14.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.594046+0000", 2024-04-25T22:03:14.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9326000000000001e-05 2024-04-25T22:03:14.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:14.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.662432+0000", 2024-04-25T22:03:14.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.068386061999999997 2024-04-25T22:03:14.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:14.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:14.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:14.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.662512+0000", 2024-04-25T22:03:14.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9993999999999993e-05 2024-04-25T22:03:14.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.511 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:14.511 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:14.511 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:14.513 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:14.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:14.513+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:14.614 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:14.612+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:14.651 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:14.651 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:14.651 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:03:14.651 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:14.666 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:14.717 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:14.713+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:14.782 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:03:14.816 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:14.812+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:14.836 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:14.837 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:14.837 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:03:14.837 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:03:14.837 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:14.851 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:14.918 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:14.916+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:15.019 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:15.016+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:15.022 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:15.023 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:03:15.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:03:15.023 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:15.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.023 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T22:03:15.023 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:15.023 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.036451613000001, 2024-04-25T22:03:15.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.180276931, 2024-04-25T22:03:15.023 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.023 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.023 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.023 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:15.023 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:15.023 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.024 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4 2024-04-25T22:03:15.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.024 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:15.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:15.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983834+0000", 2024-04-25T22:03:15.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2900000000000001e-06 2024-04-25T22:03:15.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991787+0000", 2024-04-25T22:03:15.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079521690000000003 2024-04-25T22:03:15.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991826+0000", 2024-04-25T22:03:15.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9258999999999998e-05 2024-04-25T22:03:15.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991845+0000", 2024-04-25T22:03:15.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9360000000000001e-05 2024-04-25T22:03:15.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992058+0000", 2024-04-25T22:03:15.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212559 2024-04-25T22:03:15.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992213+0000", 2024-04-25T22:03:15.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015520700000000001 2024-04-25T22:03:15.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992414+0000", 2024-04-25T22:03:15.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020049 2024-04-25T22:03:15.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162511+0000", 2024-04-25T22:03:15.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.17009782900000001 2024-04-25T22:03:15.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163967+0000", 2024-04-25T22:03:15.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001455752 2024-04-25T22:03:15.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164045+0000", 2024-04-25T22:03:15.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7415000000000003e-05 2024-04-25T22:03:15.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164109+0000", 2024-04-25T22:03:15.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4601e-05 2024-04-25T22:03:15.028 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.028 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.028 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.028 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:15.028 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:15.028 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.936993465, 2024-04-25T22:03:15.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.12612672599999999, 2024-04-25T22:03:15.028 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.029 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.029 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.029 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:15.029 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:15.029 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.029 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2024-04-25T22:03:15.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.029 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:15.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:15.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083293+0000", 2024-04-25T22:03:15.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6630000000000002e-06 2024-04-25T22:03:15.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086619+0000", 2024-04-25T22:03:15.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033261699999999998 2024-04-25T22:03:15.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086647+0000", 2024-04-25T22:03:15.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8085999999999998e-05 2024-04-25T22:03:15.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086665+0000", 2024-04-25T22:03:15.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:03:15.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086870+0000", 2024-04-25T22:03:15.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020488599999999999 2024-04-25T22:03:15.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087110+0000", 2024-04-25T22:03:15.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024093199999999999 2024-04-25T22:03:15.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087310+0000", 2024-04-25T22:03:15.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000199936 2024-04-25T22:03:15.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207766+0000", 2024-04-25T22:03:15.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.120456035 2024-04-25T22:03:15.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209358+0000", 2024-04-25T22:03:15.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015912369999999999 2024-04-25T22:03:15.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209390+0000", 2024-04-25T22:03:15.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2434999999999997e-05 2024-04-25T22:03:15.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209417+0000", 2024-04-25T22:03:15.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6936000000000001e-05 2024-04-25T22:03:15.033 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.033 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.033 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.034 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6847 4.16 4:68767fd1:::10000001f4f.00000000:head [write 0~7212] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:15.034 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:15.034 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.326812152, 2024-04-25T22:03:15.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0208302119999999, 2024-04-25T22:03:15.034 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.034 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.034 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.034 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:15.034 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:15.034 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.034 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6847 2024-04-25T22:03:15.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.034 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:15.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:15.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693473+0000", 2024-04-25T22:03:15.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.75e-06 2024-04-25T22:03:15.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693490+0000", 2024-04-25T22:03:15.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6540000000000001e-05 2024-04-25T22:03:15.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693509+0000", 2024-04-25T22:03:15.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9536999999999999e-05 2024-04-25T22:03:15.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693522+0000", 2024-04-25T22:03:15.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2099000000000001e-05 2024-04-25T22:03:15.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693677+0000", 2024-04-25T22:03:15.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015516799999999999 2024-04-25T22:03:15.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:15.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693705+0000", 2024-04-25T22:03:15.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8663e-05 2024-04-25T22:03:15.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705551+0000", 2024-04-25T22:03:15.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.011845495 2024-04-25T22:03:15.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705942+0000", 2024-04-25T22:03:15.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00039080099999999997 2024-04-25T22:03:15.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:15.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.706151+0000", 2024-04-25T22:03:15.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000209457 2024-04-25T22:03:15.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711141+0000", 2024-04-25T22:03:15.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049901240000000003 2024-04-25T22:03:15.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714005+0000", 2024-04-25T22:03:15.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028642229999999999 2024-04-25T22:03:15.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714180+0000", 2024-04-25T22:03:15.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017433699999999999 2024-04-25T22:03:15.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714302+0000", 2024-04-25T22:03:15.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122018 2024-04-25T22:03:15.040 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.040 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.040 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.040 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6960 4.16 4:6823d322:::10000001fd2.00000000:head [write 0~150] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:15.040 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:15.040 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.049808054, 2024-04-25T22:03:15.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.74417278899999995, 2024-04-25T22:03:15.040 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.040 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.040 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.040 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:15.040 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:15.041 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.041 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6960 2024-04-25T22:03:15.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.041 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:15.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:15.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970478+0000", 2024-04-25T22:03:15.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.939e-06 2024-04-25T22:03:15.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970488+0000", 2024-04-25T22:03:15.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9699999999999994e-06 2024-04-25T22:03:15.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970524+0000", 2024-04-25T22:03:15.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5963000000000001e-05 2024-04-25T22:03:15.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970537+0000", 2024-04-25T22:03:15.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.31e-05 2024-04-25T22:03:15.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970701+0000", 2024-04-25T22:03:15.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164177 2024-04-25T22:03:15.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:15.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970718+0000", 2024-04-25T22:03:15.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7323e-05 2024-04-25T22:03:15.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707632+0000", 2024-04-25T22:03:15.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.73691394300000002 2024-04-25T22:03:15.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707924+0000", 2024-04-25T22:03:15.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029223299999999998 2024-04-25T22:03:15.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:15.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.708389+0000", 2024-04-25T22:03:15.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046429300000000001 2024-04-25T22:03:15.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:15.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029039830000000002 2024-04-25T22:03:15.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714409+0000", 2024-04-25T22:03:15.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031159260000000002 2024-04-25T22:03:15.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714538+0000", 2024-04-25T22:03:15.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012952100000000001 2024-04-25T22:03:15.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714649+0000", 2024-04-25T22:03:15.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110418 2024-04-25T22:03:15.046 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.046 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.046 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.046 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7039 4.16 4:6919637e:::10000002032.00000000:head [write 0~2968] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:15.046 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:15.046 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.8637615489999995, 2024-04-25T22:03:15.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.56024932199999999, 2024-04-25T22:03:15.046 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.047 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.047 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.047 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:15.047 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:15.047 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.047 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7039 2024-04-25T22:03:15.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.047 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:15.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:15.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156523+0000", 2024-04-25T22:03:15.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2130000000000001e-06 2024-04-25T22:03:15.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156530+0000", 2024-04-25T22:03:15.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9090000000000003e-06 2024-04-25T22:03:15.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156544+0000", 2024-04-25T22:03:15.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3271999999999999e-05 2024-04-25T22:03:15.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156551+0000", 2024-04-25T22:03:15.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4970000000000004e-06 2024-04-25T22:03:15.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156639+0000", 2024-04-25T22:03:15.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7638000000000004e-05 2024-04-25T22:03:15.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:15.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156649+0000", 2024-04-25T22:03:15.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0536e-05 2024-04-25T22:03:15.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709515+0000", 2024-04-25T22:03:15.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.55286568999999997 2024-04-25T22:03:15.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709836+0000", 2024-04-25T22:03:15.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032078899999999998 2024-04-25T22:03:15.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:15.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.710271+0000", 2024-04-25T22:03:15.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043530000000000001 2024-04-25T22:03:15.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716576+0000", 2024-04-25T22:03:15.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063045050000000002 2024-04-25T22:03:15.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716605+0000", 2024-04-25T22:03:15.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8949e-05 2024-04-25T22:03:15.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716706+0000", 2024-04-25T22:03:15.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101765 2024-04-25T22:03:15.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716772+0000", 2024-04-25T22:03:15.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5259000000000007e-05 2024-04-25T22:03:15.052 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.052 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.052 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.052 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7065 4.16 4:697a9f10:::10000002050.00000000:head [write 0~16297] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:15.052 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:15.053 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.8061456010000008, 2024-04-25T22:03:15.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.50307290800000004, 2024-04-25T22:03:15.053 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.053 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.053 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.053 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:15.053 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:15.053 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.053 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7065 2024-04-25T22:03:15.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.053 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:15.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:15.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214139+0000", 2024-04-25T22:03:15.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.186e-06 2024-04-25T22:03:15.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214170+0000", 2024-04-25T22:03:15.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0419000000000001e-05 2024-04-25T22:03:15.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214186+0000", 2024-04-25T22:03:15.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6526000000000001e-05 2024-04-25T22:03:15.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214194+0000", 2024-04-25T22:03:15.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6769999999999995e-06 2024-04-25T22:03:15.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214380+0000", 2024-04-25T22:03:15.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018580699999999999 2024-04-25T22:03:15.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:15.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214399+0000", 2024-04-25T22:03:15.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9446e-05 2024-04-25T22:03:15.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711402+0000", 2024-04-25T22:03:15.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.497002901 2024-04-25T22:03:15.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711822+0000", 2024-04-25T22:03:15.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00041989399999999997 2024-04-25T22:03:15.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:15.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.712017+0000", 2024-04-25T22:03:15.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019540700000000001 2024-04-25T22:03:15.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716792+0000", 2024-04-25T22:03:15.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047748210000000003 2024-04-25T22:03:15.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716937+0000", 2024-04-25T22:03:15.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014479099999999999 2024-04-25T22:03:15.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717081+0000", 2024-04-25T22:03:15.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014412100000000001 2024-04-25T22:03:15.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717211+0000", 2024-04-25T22:03:15.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012991200000000001 2024-04-25T22:03:15.058 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.058 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.058 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.059 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7089 4.16 4:6868fcac:::1000000206b.00000000:head [write 0~5386] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:15.059 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:15.059 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.7465916069999992, 2024-04-25T22:03:15.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44658810700000001, 2024-04-25T22:03:15.059 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.059 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.059 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.059 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:15.059 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:15.059 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.059 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7089 2024-04-25T22:03:15.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.059 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:15.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:15.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273695+0000", 2024-04-25T22:03:15.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.463e-06 2024-04-25T22:03:15.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273712+0000", 2024-04-25T22:03:15.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7842999999999998e-05 2024-04-25T22:03:15.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273742+0000", 2024-04-25T22:03:15.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9039000000000001e-05 2024-04-25T22:03:15.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273756+0000", 2024-04-25T22:03:15.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4406999999999999e-05 2024-04-25T22:03:15.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273943+0000", 2024-04-25T22:03:15.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018708 2024-04-25T22:03:15.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:15.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273961+0000", 2024-04-25T22:03:15.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7977000000000001e-05 2024-04-25T22:03:15.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714748+0000", 2024-04-25T22:03:15.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.440786605 2024-04-25T22:03:15.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715013+0000", 2024-04-25T22:03:15.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026558300000000001 2024-04-25T22:03:15.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:15.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715309+0000", 2024-04-25T22:03:15.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000295715 2024-04-25T22:03:15.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.719035+0000", 2024-04-25T22:03:15.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037256310000000001 2024-04-25T22:03:15.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720142+0000", 2024-04-25T22:03:15.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001107053 2024-04-25T22:03:15.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720221+0000", 2024-04-25T22:03:15.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9832000000000004e-05 2024-04-25T22:03:15.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720280+0000", 2024-04-25T22:03:15.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8879000000000003e-05 2024-04-25T22:03:15.064 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.064 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.065 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.065 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7090 4.16 4:69dc3034:::1000000206c.00000000:head [write 0~957] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:15.065 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:15.065 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.7439672769999994, 2024-04-25T22:03:15.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44572077100000002, 2024-04-25T22:03:15.065 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.065 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.065 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.065 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:15.065 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:15.065 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.065 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7090 2024-04-25T22:03:15.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.066 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:15.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:15.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276319+0000", 2024-04-25T22:03:15.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3429999999999998e-06 2024-04-25T22:03:15.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276330+0000", 2024-04-25T22:03:15.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1567e-05 2024-04-25T22:03:15.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276362+0000", 2024-04-25T22:03:15.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1863000000000003e-05 2024-04-25T22:03:15.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276377+0000", 2024-04-25T22:03:15.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5102999999999999e-05 2024-04-25T22:03:15.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276564+0000", 2024-04-25T22:03:15.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018629700000000001 2024-04-25T22:03:15.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:15.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276583+0000", 2024-04-25T22:03:15.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9743000000000001e-05 2024-04-25T22:03:15.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717354+0000", 2024-04-25T22:03:15.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44077094900000002 2024-04-25T22:03:15.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717723+0000", 2024-04-25T22:03:15.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036839099999999998 2024-04-25T22:03:15.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:15.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.718097+0000", 2024-04-25T22:03:15.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037392099999999999 2024-04-25T22:03:15.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720305+0000", 2024-04-25T22:03:15.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022084439999999999 2024-04-25T22:03:15.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721866+0000", 2024-04-25T22:03:15.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015610260000000001 2024-04-25T22:03:15.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721944+0000", 2024-04-25T22:03:15.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7961999999999997e-05 2024-04-25T22:03:15.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.722037+0000", 2024-04-25T22:03:15.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3162e-05 2024-04-25T22:03:15.071 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.071 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.071 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.071 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:261 3.1d 3:bf8dcf43:::200.00000008:head [write 3727070~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:15.071 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682317+0000", 2024-04-25T22:03:15.071 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.3379664269999996, 2024-04-25T22:03:15.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.090430008000000006, 2024-04-25T22:03:15.071 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.071 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.071 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.071 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682317+0000", 2024-04-25T22:03:15.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682317+0000", 2024-04-25T22:03:15.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682319+0000", 2024-04-25T22:03:15.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1570000000000001e-06 2024-04-25T22:03:15.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682333+0000", 2024-04-25T22:03:15.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4070000000000001e-05 2024-04-25T22:03:15.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682354+0000", 2024-04-25T22:03:15.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0916000000000001e-05 2024-04-25T22:03:15.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682367+0000", 2024-04-25T22:03:15.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:03:15.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.767445+0000", 2024-04-25T22:03:15.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085078215999999998 2024-04-25T22:03:15.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.767588+0000", 2024-04-25T22:03:15.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000142824 2024-04-25T22:03:15.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.767781+0000", 2024-04-25T22:03:15.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019285099999999999 2024-04-25T22:03:15.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772528+0000", 2024-04-25T22:03:15.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047471010000000001 2024-04-25T22:03:15.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772558+0000", 2024-04-25T22:03:15.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0355999999999999e-05 2024-04-25T22:03:15.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772667+0000", 2024-04-25T22:03:15.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108859 2024-04-25T22:03:15.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772747+0000", 2024-04-25T22:03:15.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0098000000000005e-05 2024-04-25T22:03:15.076 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.076 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.076 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.076 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:262 3.1d 3:bf8dcf43:::200.00000008:head [write 3728472~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:15.076 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682382+0000", 2024-04-25T22:03:15.076 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.3379015279999997, 2024-04-25T22:03:15.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.09080241, 2024-04-25T22:03:15.077 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.077 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.077 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.077 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682382+0000", 2024-04-25T22:03:15.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682382+0000", 2024-04-25T22:03:15.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682383+0000", 2024-04-25T22:03:15.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:03:15.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682390+0000", 2024-04-25T22:03:15.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5629999999999997e-06 2024-04-25T22:03:15.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682410+0000", 2024-04-25T22:03:15.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0477000000000001e-05 2024-04-25T22:03:15.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682424+0000", 2024-04-25T22:03:15.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3216e-05 2024-04-25T22:03:15.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.768876+0000", 2024-04-25T22:03:15.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.086452575000000004 2024-04-25T22:03:15.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.769130+0000", 2024-04-25T22:03:15.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025331900000000001 2024-04-25T22:03:15.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.769501+0000", 2024-04-25T22:03:15.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037142099999999998 2024-04-25T22:03:15.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772761+0000", 2024-04-25T22:03:15.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032599510000000001 2024-04-25T22:03:15.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772901+0000", 2024-04-25T22:03:15.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014047500000000001 2024-04-25T22:03:15.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.773057+0000", 2024-04-25T22:03:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015578799999999999 2024-04-25T22:03:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.773185+0000", 2024-04-25T22:03:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012751799999999999 2024-04-25T22:03:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:263 3.1d 3:bf8dcf43:::200.00000008:head [write 3729875~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682439+0000", 2024-04-25T22:03:15.082 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.3378444690000002, 2024-04-25T22:03:15.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093602454000000002, 2024-04-25T22:03:15.082 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.082 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.082 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.082 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682439+0000", 2024-04-25T22:03:15.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682439+0000", 2024-04-25T22:03:15.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682440+0000", 2024-04-25T22:03:15.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.06e-06 2024-04-25T22:03:15.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682469+0000", 2024-04-25T22:03:15.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8269999999999999e-05 2024-04-25T22:03:15.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682490+0000", 2024-04-25T22:03:15.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1702999999999999e-05 2024-04-25T22:03:15.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682504+0000", 2024-04-25T22:03:15.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.394e-05 2024-04-25T22:03:15.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.770262+0000", 2024-04-25T22:03:15.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087757522000000004 2024-04-25T22:03:15.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.770501+0000", 2024-04-25T22:03:15.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000239612 2024-04-25T22:03:15.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.770841+0000", 2024-04-25T22:03:15.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034001499999999999 2024-04-25T22:03:15.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.774702+0000", 2024-04-25T22:03:15.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038608660000000001 2024-04-25T22:03:15.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.775840+0000", 2024-04-25T22:03:15.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001137299 2024-04-25T22:03:15.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.775935+0000", 2024-04-25T22:03:15.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5785000000000005e-05 2024-04-25T22:03:15.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.776042+0000", 2024-04-25T22:03:15.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106382 2024-04-25T22:03:15.086 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.086 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.086 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.087 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:264 3.1d 3:bf8dcf43:::200.00000008:head [write 3731277~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:15.087 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682521+0000", 2024-04-25T22:03:15.087 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.3377630900000002, 2024-04-25T22:03:15.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.09716756, 2024-04-25T22:03:15.087 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.087 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.087 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.087 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682521+0000", 2024-04-25T22:03:15.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682521+0000", 2024-04-25T22:03:15.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682522+0000", 2024-04-25T22:03:15.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.074e-06 2024-04-25T22:03:15.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682529+0000", 2024-04-25T22:03:15.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7630000000000003e-06 2024-04-25T22:03:15.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682573+0000", 2024-04-25T22:03:15.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4499000000000002e-05 2024-04-25T22:03:15.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682592+0000", 2024-04-25T22:03:15.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9323000000000001e-05 2024-04-25T22:03:15.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.773315+0000", 2024-04-25T22:03:15.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.090722811 2024-04-25T22:03:15.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.773542+0000", 2024-04-25T22:03:15.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00022711899999999999 2024-04-25T22:03:15.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.773723+0000", 2024-04-25T22:03:15.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000180321 2024-04-25T22:03:15.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779406+0000", 2024-04-25T22:03:15.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005683474 2024-04-25T22:03:15.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779531+0000", 2024-04-25T22:03:15.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000125208 2024-04-25T22:03:15.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779622+0000", 2024-04-25T22:03:15.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0643000000000006e-05 2024-04-25T22:03:15.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779688+0000", 2024-04-25T22:03:15.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6324999999999999e-05 2024-04-25T22:03:15.092 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.092 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.092 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.092 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:265 3.1d 3:bf8dcf43:::200.00000008:head [write 3732680~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:15.092 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682617+0000", 2024-04-25T22:03:15.092 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.3376670180000003, 2024-04-25T22:03:15.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.097415482999999997, 2024-04-25T22:03:15.092 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.092 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.092 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.092 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682617+0000", 2024-04-25T22:03:15.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682617+0000", 2024-04-25T22:03:15.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682618+0000", 2024-04-25T22:03:15.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:03:15.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682625+0000", 2024-04-25T22:03:15.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4059999999999999e-06 2024-04-25T22:03:15.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682643+0000", 2024-04-25T22:03:15.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7476e-05 2024-04-25T22:03:15.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682656+0000", 2024-04-25T22:03:15.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.311e-05 2024-04-25T22:03:15.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.774784+0000", 2024-04-25T22:03:15.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.092128053000000001 2024-04-25T22:03:15.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.774912+0000", 2024-04-25T22:03:15.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012798099999999999 2024-04-25T22:03:15.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.775095+0000", 2024-04-25T22:03:15.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000182607 2024-04-25T22:03:15.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779418+0000", 2024-04-25T22:03:15.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043234390000000001 2024-04-25T22:03:15.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779841+0000", 2024-04-25T22:03:15.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042321999999999998 2024-04-25T22:03:15.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779937+0000", 2024-04-25T22:03:15.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5402000000000006e-05 2024-04-25T22:03:15.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.780032+0000", 2024-04-25T22:03:15.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5564999999999997e-05 2024-04-25T22:03:15.097 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.097 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.097 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.097 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:266 3.1d 3:bf8dcf43:::200.00000008:head [write 3734079~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:15.097 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682671+0000", 2024-04-25T22:03:15.097 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.337612375, 2024-04-25T22:03:15.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.100589284, 2024-04-25T22:03:15.098 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.098 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.098 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.098 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682671+0000", 2024-04-25T22:03:15.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682671+0000", 2024-04-25T22:03:15.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682672+0000", 2024-04-25T22:03:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:03:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682687+0000", 2024-04-25T22:03:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.418e-05 2024-04-25T22:03:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682704+0000", 2024-04-25T22:03:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7139e-05 2024-04-25T22:03:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682719+0000", 2024-04-25T22:03:15.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4776999999999999e-05 2024-04-25T22:03:15.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.776110+0000", 2024-04-25T22:03:15.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093391199999999994 2024-04-25T22:03:15.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.776237+0000", 2024-04-25T22:03:15.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012748800000000001 2024-04-25T22:03:15.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.776502+0000", 2024-04-25T22:03:15.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026474300000000001 2024-04-25T22:03:15.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.780083+0000", 2024-04-25T22:03:15.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035809190000000001 2024-04-25T22:03:15.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.783012+0000", 2024-04-25T22:03:15.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029288790000000001 2024-04-25T22:03:15.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.783173+0000", 2024-04-25T22:03:15.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016134799999999999 2024-04-25T22:03:15.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.783261+0000", 2024-04-25T22:03:15.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7558000000000004e-05 2024-04-25T22:03:15.102 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.102 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.102 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.102 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:281 3.1d 3:bf8dcf43:::200.00000008:head [write 3787969~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:15.102 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.716485+0000", 2024-04-25T22:03:15.102 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.3037987600000003, 2024-04-25T22:03:15.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.092100435999999994, 2024-04-25T22:03:15.103 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.103 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.103 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.103 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.716485+0000", 2024-04-25T22:03:15.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.716485+0000", 2024-04-25T22:03:15.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.716487+0000", 2024-04-25T22:03:15.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.57e-06 2024-04-25T22:03:15.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.716496+0000", 2024-04-25T22:03:15.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5899999999999997e-06 2024-04-25T22:03:15.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.716522+0000", 2024-04-25T22:03:15.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5443e-05 2024-04-25T22:03:15.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.716538+0000", 2024-04-25T22:03:15.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6345999999999999e-05 2024-04-25T22:03:15.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.801998+0000", 2024-04-25T22:03:15.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085460227 2024-04-25T22:03:15.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.802119+0000", 2024-04-25T22:03:15.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121271 2024-04-25T22:03:15.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.802369+0000", 2024-04-25T22:03:15.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000249473 2024-04-25T22:03:15.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.805116+0000", 2024-04-25T22:03:15.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0027474349999999999 2024-04-25T22:03:15.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.808433+0000", 2024-04-25T22:03:15.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033163369999999999 2024-04-25T22:03:15.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.808518+0000", 2024-04-25T22:03:15.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4964999999999997e-05 2024-04-25T22:03:15.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.808585+0000", 2024-04-25T22:03:15.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7779000000000003e-05 2024-04-25T22:03:15.107 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.107 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.107 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.107 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:284 3.1d 3:bf8dcf43:::200.00000008:head [write 3799544~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:15.107 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.720779+0000", 2024-04-25T22:03:15.108 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.2995047450000001, 2024-04-25T22:03:15.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093008417999999995, 2024-04-25T22:03:15.108 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.108 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.108 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.108 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720779+0000", 2024-04-25T22:03:15.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720779+0000", 2024-04-25T22:03:15.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720781+0000", 2024-04-25T22:03:15.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.547e-06 2024-04-25T22:03:15.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720790+0000", 2024-04-25T22:03:15.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6860000000000001e-06 2024-04-25T22:03:15.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720804+0000", 2024-04-25T22:03:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3997e-05 2024-04-25T22:03:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720818+0000", 2024-04-25T22:03:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3550000000000001e-05 2024-04-25T22:03:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.806993+0000", 2024-04-25T22:03:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.086174915000000005 2024-04-25T22:03:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.807196+0000", 2024-04-25T22:03:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020306999999999999 2024-04-25T22:03:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.807425+0000", 2024-04-25T22:03:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00022923400000000001 2024-04-25T22:03:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.810916+0000", 2024-04-25T22:03:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034910700000000002 2024-04-25T22:03:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.813593+0000", 2024-04-25T22:03:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0026773420000000001 2024-04-25T22:03:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.813691+0000", 2024-04-25T22:03:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7071999999999995e-05 2024-04-25T22:03:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.813787+0000", 2024-04-25T22:03:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6935000000000006e-05 2024-04-25T22:03:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.112 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:285 3.1d 3:bf8dcf43:::200.00000008:head [write 3802501~5840 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-25T22:03:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.726839+0000", 2024-04-25T22:03:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.2934443409999998, 2024-04-25T22:03:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.092249908000000005, 2024-04-25T22:03:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.726839+0000", 2024-04-25T22:03:15.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.726839+0000", 2024-04-25T22:03:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.726842+0000", 2024-04-25T22:03:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.726866+0000", 2024-04-25T22:03:15.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3697e-05 2024-04-25T22:03:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.726898+0000", 2024-04-25T22:03:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2645999999999999e-05 2024-04-25T22:03:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.726920+0000", 2024-04-25T22:03:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759999999999998e-05 2024-04-25T22:03:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.809050+0000", 2024-04-25T22:03:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082129949999999993 2024-04-25T22:03:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.809212+0000", 2024-04-25T22:03:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000162285 2024-04-25T22:03:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.809512+0000", 2024-04-25T22:03:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030005800000000002 2024-04-25T22:03:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.818674+0000", 2024-04-25T22:03:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0091618240000000007 2024-04-25T22:03:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.818950+0000", 2024-04-25T22:03:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027553000000000001 2024-04-25T22:03:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.819036+0000", 2024-04-25T22:03:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5999000000000001e-05 2024-04-25T22:03:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.819089+0000", 2024-04-25T22:03:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3538999999999997e-05 2024-04-25T22:03:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:10642 4.35 4:ae7b229b:::100000030a9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.493805+0000", 2024-04-25T22:03:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.5264791, 2024-04-25T22:03:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13451306399999999, 2024-04-25T22:03:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10642 2024-04-25T22:03:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.118 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.493805+0000", 2024-04-25T22:03:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.493805+0000", 2024-04-25T22:03:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.493807+0000", 2024-04-25T22:03:15.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2129999999999998e-06 2024-04-25T22:03:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502392+0000", 2024-04-25T22:03:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085850079999999999 2024-04-25T22:03:15.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502428+0000", 2024-04-25T22:03:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5952999999999999e-05 2024-04-25T22:03:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502447+0000", 2024-04-25T22:03:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9565999999999999e-05 2024-04-25T22:03:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502595+0000", 2024-04-25T22:03:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014737499999999999 2024-04-25T22:03:15.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502851+0000", 2024-04-25T22:03:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025651299999999999 2024-04-25T22:03:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.503238+0000", 2024-04-25T22:03:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038642800000000002 2024-04-25T22:03:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.627850+0000", 2024-04-25T22:03:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.12461184 2024-04-25T22:03:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628046+0000", 2024-04-25T22:03:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019659500000000001 2024-04-25T22:03:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628184+0000", 2024-04-25T22:03:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000137532 2024-04-25T22:03:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628318+0000", 2024-04-25T22:03:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000134041 2024-04-25T22:03:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:10647 4.35 4:ae7b229b:::100000030a9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.4909225830000001, 2024-04-25T22:03:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14506126, 2024-04-25T22:03:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10647 2024-04-25T22:03:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529364+0000", 2024-04-25T22:03:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.286e-06 2024-04-25T22:03:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538917+0000", 2024-04-25T22:03:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0095530010000000002 2024-04-25T22:03:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538955+0000", 2024-04-25T22:03:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:03:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538977+0000", 2024-04-25T22:03:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.105e-05 2024-04-25T22:03:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568092+0000", 2024-04-25T22:03:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029115604999999999 2024-04-25T22:03:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568243+0000", 2024-04-25T22:03:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000151044 2024-04-25T22:03:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568498+0000", 2024-04-25T22:03:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025517399999999999 2024-04-25T22:03:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628005+0000", 2024-04-25T22:03:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059506991000000002 2024-04-25T22:03:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674273+0000", 2024-04-25T22:03:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.046267233999999997 2024-04-25T22:03:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674357+0000", 2024-04-25T22:03:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4745000000000003e-05 2024-04-25T22:03:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674422+0000", 2024-04-25T22:03:15.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5160999999999995e-05 2024-04-25T22:03:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:10651 4.b e64/16 4:d2207142:::100000030bf.00000000:head v 64'182, mlcod=64'180)", 2024-04-25T22:03:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.604132+0000", 2024-04-25T22:03:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.416152249, 2024-04-25T22:03:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.105085936, 2024-04-25T22:03:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:15.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.604132+0000", 2024-04-25T22:03:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.604132+0000", 2024-04-25T22:03:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.604133+0000", 2024-04-25T22:03:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:03:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.608939+0000", 2024-04-25T22:03:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004806009 2024-04-25T22:03:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.608965+0000", 2024-04-25T22:03:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.639e-05 2024-04-25T22:03:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.608978+0000", 2024-04-25T22:03:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2666999999999999e-05 2024-04-25T22:03:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.609113+0000", 2024-04-25T22:03:15.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000135575 2024-04-25T22:03:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.609198+0000", 2024-04-25T22:03:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4899000000000001e-05 2024-04-25T22:03:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.709157+0000", 2024-04-25T22:03:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.099958796000000003 2024-04-25T22:03:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.709217+0000", 2024-04-25T22:03:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0553000000000001e-05 2024-04-25T22:03:15.133 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:15.134 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:15.134 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:15.135 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:15.136 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:15.132+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:15.236 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:15.232+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:15.266 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:15.266 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:15.266 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:03:15.266 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:15.282 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:15.337 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:15.336+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:15.401 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:03:15.403 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:15.403 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:15.403 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:03:15.404 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:03:15.404 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:15.417 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:15.438 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:15.436+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:15.539 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:15.536+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:15.545 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:15.546 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:15.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:15.546 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:15.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.546 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:15.546 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:15.546 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.456735213999998, 2024-04-25T22:03:15.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:15.546 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.546 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.546 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.546 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:15.546 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:15.547 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.547 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:15.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.547 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:15.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:15.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:15.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:15.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:15.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:15.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:15.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:15.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:15.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:15.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:15.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:15.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:15.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:15.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:15.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:15.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:15.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:15.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:15.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:15.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:15.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:15.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:15.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:15.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:15.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:15.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:15.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:15.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:15.552 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.552 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.552 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.552 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:15.552 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:15.552 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.446734451000001, 2024-04-25T22:03:15.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:15.552 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.552 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.552 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.552 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:15.553 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:15.553 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.553 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:15.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.553 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:15.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:15.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:15.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:15.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:15.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:15.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:15.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:15.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:15.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:15.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:15.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:15.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:15.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:15.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:15.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:15.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:15.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:15.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:15.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:15.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:15.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:15.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:15.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:15.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:15.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:15.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:15.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:15.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:15.558 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.558 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.558 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.558 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:15.558 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:15.558 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.442570177, 2024-04-25T22:03:15.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:15.558 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.558 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.559 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.559 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:15.559 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:15.559 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.559 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:15.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.559 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:15.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:15.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:15.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:15.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:15.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:15.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:15.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:15.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:15.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:15.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:15.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:15.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:15.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:15.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:15.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:15.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:15.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:15.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:15.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:15.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:15.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:15.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:15.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:15.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.563 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.564 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:15.564 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:15.564 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.44097386, 2024-04-25T22:03:15.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:15.564 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.564 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.564 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.564 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:15.564 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:15.564 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.564 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:15.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.564 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:15.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:15.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:15.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:15.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:15.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:15.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:15.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:15.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:15.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:15.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:15.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:15.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:15.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:15.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:15.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:15.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:15.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:15.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:15.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:15.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:15.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:15.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:15.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:15.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.568 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.569 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:15.569 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:15.569 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.384187610000001, 2024-04-25T22:03:15.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:15.569 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.569 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.569 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.569 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:15.569 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:15.569 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.569 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:15.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.569 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:15.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:15.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:15.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:15.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:15.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:15.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:15.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:15.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:15.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:15.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:15.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:15.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:15.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:15.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:15.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:15.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:15.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:15.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:15.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:15.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:15.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:15.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:15.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:15.574 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.574 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.574 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.574 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:15.574 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:15.574 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.368543343999999, 2024-04-25T22:03:15.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:15.574 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.574 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.575 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.575 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:15.575 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:15.575 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.575 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:15.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.575 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:15.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:15.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:15.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:15.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:15.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:15.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:15.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:15.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:15.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:15.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:15.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:15.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:15.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:15.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:15.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:15.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:15.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:15.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:15.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:15.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:15.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:15.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:15.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:15.579 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.579 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.579 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.580 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:15.580 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:15.580 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.363704652999999, 2024-04-25T22:03:15.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:15.580 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.580 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.580 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.580 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:15.580 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:15.580 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.580 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:15.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.580 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:15.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:15.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:15.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:15.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:15.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:15.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:15.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:15.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:15.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:15.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:15.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:15.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:15.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:15.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:15.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:15.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:15.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:15.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:15.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:15.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:15.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:15.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:15.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:15.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.584 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.585 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:71 4.10 4:08500202:::1000000023e.00000000:head [write 0~1105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:15.585 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:15.585 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.350387568999999, 2024-04-25T22:03:15.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.098402492999999994, 2024-04-25T22:03:15.585 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.585 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.585 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.585 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:15.585 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:15.585 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.585 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71 2024-04-25T22:03:15.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.585 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:15.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191893+0000", 2024-04-25T22:03:15.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191895+0000", 2024-04-25T22:03:15.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0899999999999999e-06 2024-04-25T22:03:15.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191906+0000", 2024-04-25T22:03:15.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1508999999999999e-05 2024-04-25T22:03:15.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191937+0000", 2024-04-25T22:03:15.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0772999999999998e-05 2024-04-25T22:03:15.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.191951+0000", 2024-04-25T22:03:15.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.437e-05 2024-04-25T22:03:15.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286217+0000", 2024-04-25T22:03:15.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.094265989999999994 2024-04-25T22:03:15.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286383+0000", 2024-04-25T22:03:15.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016591899999999999 2024-04-25T22:03:15.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286594+0000", 2024-04-25T22:03:15.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021108800000000001 2024-04-25T22:03:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.288518+0000", 2024-04-25T22:03:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001923391 2024-04-25T22:03:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290219+0000", 2024-04-25T22:03:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001701239 2024-04-25T22:03:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290266+0000", 2024-04-25T22:03:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6838000000000001e-05 2024-04-25T22:03:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290295+0000", 2024-04-25T22:03:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9286e-05 2024-04-25T22:03:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:173 3.1e 3:7bf7e7b5:::200.00000006:head [write 1089806~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.680971+0000", 2024-04-25T22:03:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.861308888, 2024-04-25T22:03:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.097357530999999997, 2024-04-25T22:03:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680971+0000", 2024-04-25T22:03:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680971+0000", 2024-04-25T22:03:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680972+0000", 2024-04-25T22:03:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5700000000000002e-07 2024-04-25T22:03:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680976+0000", 2024-04-25T22:03:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8859999999999997e-06 2024-04-25T22:03:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680986+0000", 2024-04-25T22:03:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0107e-05 2024-04-25T22:03:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.680992+0000", 2024-04-25T22:03:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:03:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.766932+0000", 2024-04-25T22:03:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.085939606000000002 2024-04-25T22:03:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.767162+0000", 2024-04-25T22:03:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022967899999999999 2024-04-25T22:03:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.767539+0000", 2024-04-25T22:03:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037684900000000001 2024-04-25T22:03:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773588+0000", 2024-04-25T22:03:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060498979999999997 2024-04-25T22:03:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778047+0000", 2024-04-25T22:03:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044585950000000001 2024-04-25T22:03:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778191+0000", 2024-04-25T22:03:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000144277 2024-04-25T22:03:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778329+0000", 2024-04-25T22:03:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013736799999999999 2024-04-25T22:03:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:174 3.1e 3:7bf7e7b5:::200.00000006:head [write 1091205~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681001+0000", 2024-04-25T22:03:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.861279196, 2024-04-25T22:03:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.097586939999999997, 2024-04-25T22:03:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681001+0000", 2024-04-25T22:03:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681001+0000", 2024-04-25T22:03:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681002+0000", 2024-04-25T22:03:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1699999999999997e-07 2024-04-25T22:03:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681011+0000", 2024-04-25T22:03:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4099999999999997e-06 2024-04-25T22:03:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681020+0000", 2024-04-25T22:03:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0929999999999992e-06 2024-04-25T22:03:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681027+0000", 2024-04-25T22:03:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2069999999999998e-06 2024-04-25T22:03:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.768885+0000", 2024-04-25T22:03:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087857947000000006 2024-04-25T22:03:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.769110+0000", 2024-04-25T22:03:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000224243 2024-04-25T22:03:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.769453+0000", 2024-04-25T22:03:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034366900000000001 2024-04-25T22:03:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.776545+0000", 2024-04-25T22:03:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070918179999999997 2024-04-25T22:03:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778351+0000", 2024-04-25T22:03:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001806457 2024-04-25T22:03:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778482+0000", 2024-04-25T22:03:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130538 2024-04-25T22:03:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778588+0000", 2024-04-25T22:03:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010584100000000001 2024-04-25T22:03:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:175 3.1e 3:7bf7e7b5:::200.00000006:head [write 1092606~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.861243426, 2024-04-25T22:03:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.098895884000000003, 2024-04-25T22:03:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681037+0000", 2024-04-25T22:03:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.37e-07 2024-04-25T22:03:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681042+0000", 2024-04-25T22:03:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.296e-06 2024-04-25T22:03:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681051+0000", 2024-04-25T22:03:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8729999999999996e-06 2024-04-25T22:03:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681058+0000", 2024-04-25T22:03:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1500000000000002e-06 2024-04-25T22:03:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.770531+0000", 2024-04-25T22:03:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.089473665999999993 2024-04-25T22:03:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.770765+0000", 2024-04-25T22:03:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023329899999999999 2024-04-25T22:03:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.771099+0000", 2024-04-25T22:03:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033428 2024-04-25T22:03:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778610+0000", 2024-04-25T22:03:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075115119999999997 2024-04-25T22:03:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779710+0000", 2024-04-25T22:03:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010997019999999999 2024-04-25T22:03:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779876+0000", 2024-04-25T22:03:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016592000000000001 2024-04-25T22:03:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779933+0000", 2024-04-25T22:03:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6449000000000001e-05 2024-04-25T22:03:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:176 3.1e 3:7bf7e7b5:::200.00000006:head [write 1094003~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681066+0000", 2024-04-25T22:03:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.861213792999999, 2024-04-25T22:03:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099284439000000002, 2024-04-25T22:03:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681066+0000", 2024-04-25T22:03:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681066+0000", 2024-04-25T22:03:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681067+0000", 2024-04-25T22:03:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3e-07 2024-04-25T22:03:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681076+0000", 2024-04-25T22:03:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3659999999999998e-06 2024-04-25T22:03:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681087+0000", 2024-04-25T22:03:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0763e-05 2024-04-25T22:03:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681095+0000", 2024-04-25T22:03:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3599999999999998e-06 2024-04-25T22:03:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772564+0000", 2024-04-25T22:03:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.091469049999999996 2024-04-25T22:03:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772701+0000", 2024-04-25T22:03:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013743100000000001 2024-04-25T22:03:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.772901+0000", 2024-04-25T22:03:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019971600000000001 2024-04-25T22:03:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778627+0000", 2024-04-25T22:03:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057267170000000001 2024-04-25T22:03:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780116+0000", 2024-04-25T22:03:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001488294 2024-04-25T22:03:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780282+0000", 2024-04-25T22:03:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016584999999999999 2024-04-25T22:03:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780351+0000", 2024-04-25T22:03:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9162e-05 2024-04-25T22:03:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:177 3.1e 3:7bf7e7b5:::200.00000006:head [write 1095406~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.861176451, 2024-04-25T22:03:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099467149000000005, 2024-04-25T22:03:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681104+0000", 2024-04-25T22:03:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:03:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681108+0000", 2024-04-25T22:03:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0439999999999997e-06 2024-04-25T22:03:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681117+0000", 2024-04-25T22:03:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7499999999999992e-06 2024-04-25T22:03:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681124+0000", 2024-04-25T22:03:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9099999999999999e-06 2024-04-25T22:03:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773690+0000", 2024-04-25T22:03:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.092565760999999996 2024-04-25T22:03:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773817+0000", 2024-04-25T22:03:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012704799999999999 2024-04-25T22:03:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.773999+0000", 2024-04-25T22:03:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018202 2024-04-25T22:03:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778647+0000", 2024-04-25T22:03:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046479049999999999 2024-04-25T22:03:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780446+0000", 2024-04-25T22:03:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017990739999999999 2024-04-25T22:03:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780519+0000", 2024-04-25T22:03:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3205000000000001e-05 2024-04-25T22:03:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780571+0000", 2024-04-25T22:03:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1638999999999998e-05 2024-04-25T22:03:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:178 3.1e 3:7bf7e7b5:::200.00000006:head [write 1096809~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681133+0000", 2024-04-25T22:03:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.861147171000001, 2024-04-25T22:03:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099654375000000003, 2024-04-25T22:03:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681133+0000", 2024-04-25T22:03:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681133+0000", 2024-04-25T22:03:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681134+0000", 2024-04-25T22:03:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2699999999999999e-07 2024-04-25T22:03:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681139+0000", 2024-04-25T22:03:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.276e-06 2024-04-25T22:03:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681148+0000", 2024-04-25T22:03:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8130000000000002e-06 2024-04-25T22:03:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681155+0000", 2024-04-25T22:03:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0859999999999996e-06 2024-04-25T22:03:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.774610+0000", 2024-04-25T22:03:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.093455287999999997 2024-04-25T22:03:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.774856+0000", 2024-04-25T22:03:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000245772 2024-04-25T22:03:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.775244+0000", 2024-04-25T22:03:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038779599999999998 2024-04-25T22:03:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779955+0000", 2024-04-25T22:03:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047115910000000002 2024-04-25T22:03:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780656+0000", 2024-04-25T22:03:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070111200000000005 2024-04-25T22:03:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780733+0000", 2024-04-25T22:03:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6601999999999996e-05 2024-04-25T22:03:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780787+0000", 2024-04-25T22:03:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4311999999999998e-05 2024-04-25T22:03:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:179 3.1e 3:7bf7e7b5:::200.00000006:head [write 1098209~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681170+0000", 2024-04-25T22:03:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.861110415000001, 2024-04-25T22:03:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099820701999999997, 2024-04-25T22:03:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681170+0000", 2024-04-25T22:03:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681170+0000", 2024-04-25T22:03:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681171+0000", 2024-04-25T22:03:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4e-07 2024-04-25T22:03:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681175+0000", 2024-04-25T22:03:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7330000000000003e-06 2024-04-25T22:03:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681185+0000", 2024-04-25T22:03:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2730000000000008e-06 2024-04-25T22:03:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681192+0000", 2024-04-25T22:03:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3000000000000004e-06 2024-04-25T22:03:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.776664+0000", 2024-04-25T22:03:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095471850999999996 2024-04-25T22:03:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.776895+0000", 2024-04-25T22:03:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023155199999999999 2024-04-25T22:03:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.777244+0000", 2024-04-25T22:03:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034912300000000001 2024-04-25T22:03:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779962+0000", 2024-04-25T22:03:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027177870000000002 2024-04-25T22:03:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780870+0000", 2024-04-25T22:03:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090743499999999995 2024-04-25T22:03:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780939+0000", 2024-04-25T22:03:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9678999999999995e-05 2024-04-25T22:03:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780990+0000", 2024-04-25T22:03:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1128999999999998e-05 2024-04-25T22:03:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:180 3.1e 3:7bf7e7b5:::200.00000006:head [write 1099615~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681201+0000", 2024-04-25T22:03:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.861078899000001, 2024-04-25T22:03:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.100014121, 2024-04-25T22:03:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681201+0000", 2024-04-25T22:03:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681201+0000", 2024-04-25T22:03:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681202+0000", 2024-04-25T22:03:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2600000000000001e-07 2024-04-25T22:03:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681206+0000", 2024-04-25T22:03:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7799999999999998e-06 2024-04-25T22:03:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681215+0000", 2024-04-25T22:03:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7630000000000006e-06 2024-04-25T22:03:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681222+0000", 2024-04-25T22:03:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0740000000000004e-06 2024-04-25T22:03:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778720+0000", 2024-04-25T22:03:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.097498243999999998 2024-04-25T22:03:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778839+0000", 2024-04-25T22:03:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011882799999999999 2024-04-25T22:03:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779028+0000", 2024-04-25T22:03:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018962300000000001 2024-04-25T22:03:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781006+0000", 2024-04-25T22:03:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019778640000000002 2024-04-25T22:03:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781093+0000", 2024-04-25T22:03:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6802e-05 2024-04-25T22:03:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781164+0000", 2024-04-25T22:03:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0925000000000003e-05 2024-04-25T22:03:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781215+0000", 2024-04-25T22:03:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1391999999999999e-05 2024-04-25T22:03:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:6847 4.16 4.8bfe6e16 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-25T22:03:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.686897+0000", 2024-04-25T22:03:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.855383288000001, 2024-04-25T22:03:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.094186503000000005, 2024-04-25T22:03:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-04-25T22:03:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6847 2024-04-25T22:03:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686897+0000", 2024-04-25T22:03:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686897+0000", 2024-04-25T22:03:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686903+0000", 2024-04-25T22:03:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9599999999999997e-06 2024-04-25T22:03:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686920+0000", 2024-04-25T22:03:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7102999999999999e-05 2024-04-25T22:03:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686939+0000", 2024-04-25T22:03:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.912e-05 2024-04-25T22:03:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.686953+0000", 2024-04-25T22:03:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4062e-05 2024-04-25T22:03:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781065+0000", 2024-04-25T22:03:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.094112332000000007 2024-04-25T22:03:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781083+0000", 2024-04-25T22:03:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7926000000000001e-05 2024-04-25T22:03:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10648 4.33 4:cc614d18:::100000030cb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.0051013420000001, 2024-04-25T22:03:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13001143300000001, 2024-04-25T22:03:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10648 2024-04-25T22:03:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537181+0000", 2024-04-25T22:03:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.782e-06 2024-04-25T22:03:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541681+0000", 2024-04-25T22:03:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045008460000000002 2024-04-25T22:03:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541692+0000", 2024-04-25T22:03:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0726e-05 2024-04-25T22:03:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541698+0000", 2024-04-25T22:03:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-04-25T22:03:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541771+0000", 2024-04-25T22:03:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3070000000000003e-05 2024-04-25T22:03:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542021+0000", 2024-04-25T22:03:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025059799999999999 2024-04-25T22:03:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542246+0000", 2024-04-25T22:03:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022471000000000001 2024-04-25T22:03:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.579359+0000", 2024-04-25T22:03:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037113211 2024-04-25T22:03:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667067+0000", 2024-04-25T22:03:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087707255999999997 2024-04-25T22:03:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667134+0000", 2024-04-25T22:03:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7862999999999997e-05 2024-04-25T22:03:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667190+0000", 2024-04-25T22:03:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5698000000000001e-05 2024-04-25T22:03:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10651 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.945325564, 2024-04-25T22:03:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11324606800000001, 2024-04-25T22:03:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10651 2024-04-25T22:03:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596957+0000", 2024-04-25T22:03:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-04-25T22:03:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601272+0000", 2024-04-25T22:03:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004314834 2024-04-25T22:03:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601291+0000", 2024-04-25T22:03:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9380000000000001e-05 2024-04-25T22:03:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601302+0000", 2024-04-25T22:03:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0416e-05 2024-04-25T22:03:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.603978+0000", 2024-04-25T22:03:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026763109999999998 2024-04-25T22:03:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604327+0000", 2024-04-25T22:03:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034881099999999998 2024-04-25T22:03:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604571+0000", 2024-04-25T22:03:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024436100000000001 2024-04-25T22:03:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644439+0000", 2024-04-25T22:03:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039868270999999997 2024-04-25T22:03:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710091+0000", 2024-04-25T22:03:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.065651910999999993 2024-04-25T22:03:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710144+0000", 2024-04-25T22:03:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2444999999999997e-05 2024-04-25T22:03:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710201+0000", 2024-04-25T22:03:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6839999999999998e-05 2024-04-25T22:03:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10654 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.935498701, 2024-04-25T22:03:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.103958778, 2024-04-25T22:03:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10654 2024-04-25T22:03:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606782+0000", 2024-04-25T22:03:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1699999999999999e-07 2024-04-25T22:03:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611155+0000", 2024-04-25T22:03:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043728580000000003 2024-04-25T22:03:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611173+0000", 2024-04-25T22:03:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8267e-05 2024-04-25T22:03:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611183+0000", 2024-04-25T22:03:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9250000000000007e-06 2024-04-25T22:03:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644642+0000", 2024-04-25T22:03:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033458976000000001 2024-04-25T22:03:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644739+0000", 2024-04-25T22:03:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7189999999999996e-05 2024-04-25T22:03:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644864+0000", 2024-04-25T22:03:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000124867 2024-04-25T22:03:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.672556+0000", 2024-04-25T22:03:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027691653 2024-04-25T22:03:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710668+0000", 2024-04-25T22:03:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038111956000000002 2024-04-25T22:03:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710703+0000", 2024-04-25T22:03:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5577000000000002e-05 2024-04-25T22:03:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710740+0000", 2024-04-25T22:03:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7092000000000003e-05 2024-04-25T22:03:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:15.652 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:15.653 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:15.653 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:15.654 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:15.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:15.649+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:15.671 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:15.671 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:15.693 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:15.694 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:15.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:15.753+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:15.768 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-25T22:03:15.787 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:15.787 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:15.802 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:15.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:15.853+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:15.922 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:15.922 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:15.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:15.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:15.953+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:16.052 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:16.052 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:16.056 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:16.052+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:16.066 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:16.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:16.153+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:16.201 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:16.201 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:16.217 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:16.259 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:16.252+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:16.341 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:16.341 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:16.356 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:16.401 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:16.400+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:16.461 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:16.456+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:16.476 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:16.476 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:16.492 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:16.562 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:16.560+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:16.622 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:16.622 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:16.636 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:16.663 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:16.660+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:16.668 INFO:tasks.workunit.client.0.smithi044.stdout:7/10: sync 2024-04-25T22:03:16.668 INFO:tasks.workunit.client.0.smithi044.stdout:8/152: sync 2024-04-25T22:03:16.668 INFO:tasks.workunit.client.0.smithi044.stdout:0/15: sync 2024-04-25T22:03:16.668 INFO:tasks.workunit.client.0.smithi044.stdout:1/20: sync 2024-04-25T22:03:16.668 INFO:tasks.workunit.client.0.smithi044.stdout:6/26: sync 2024-04-25T22:03:16.668 INFO:tasks.workunit.client.0.smithi044.stdout:3/8: sync 2024-04-25T22:03:16.668 INFO:tasks.workunit.client.0.smithi044.stdout:2/39: sync 2024-04-25T22:03:16.668 INFO:tasks.workunit.client.0.smithi044.stdout:5/19: sync 2024-04-25T22:03:16.668 INFO:tasks.workunit.client.0.smithi044.stdout:4/1: sync 2024-04-25T22:03:16.668 INFO:tasks.workunit.client.0.smithi044.stdout:9/8: sync 2024-04-25T22:03:16.669 INFO:tasks.workunit.client.0.smithi044.stdout:7/11: fdatasync f0 0 2024-04-25T22:03:16.669 INFO:tasks.workunit.client.0.smithi044.stdout:8/153: chown f12 3 1 2024-04-25T22:03:16.669 INFO:tasks.workunit.client.0.smithi044.stdout:9/9: stat l0 0 2024-04-25T22:03:16.669 INFO:tasks.workunit.client.0.smithi044.stdout:9/10: dread - no filename 2024-04-25T22:03:16.669 INFO:tasks.workunit.client.0.smithi044.stdout:9/11: dread - no filename 2024-04-25T22:03:16.670 INFO:tasks.workunit.client.0.smithi044.stdout:0/16: dread f0 [0,4194304] 0 2024-04-25T22:03:16.671 INFO:tasks.workunit.client.0.smithi044.stdout:7/12: write f0 [968342,49870] 0 2024-04-25T22:03:16.671 INFO:tasks.workunit.client.0.smithi044.stdout:4/2: creat f1 x:0 0 0 2024-04-25T22:03:16.671 INFO:tasks.workunit.client.0.smithi044.stdout:6/27: truncate d2/d8/fa 143884 0 2024-04-25T22:03:16.672 INFO:tasks.workunit.client.0.smithi044.stdout:7/13: symlink l1 0 2024-04-25T22:03:16.672 INFO:tasks.workunit.client.0.smithi044.stdout:4/3: dread - f0 zero size 2024-04-25T22:03:16.673 INFO:tasks.workunit.client.0.smithi044.stdout:8/154: dread f19 [4194304,4194304] 0 2024-04-25T22:03:16.674 INFO:tasks.workunit.client.0.smithi044.stdout:9/12: rmdir d1 0 2024-04-25T22:03:16.674 INFO:tasks.workunit.client.0.smithi044.stdout:9/13: dwrite - no filename 2024-04-25T22:03:16.674 INFO:tasks.workunit.client.0.smithi044.stdout:1/21: creat d3/f4 x:0 0 0 2024-04-25T22:03:16.675 INFO:tasks.workunit.client.0.smithi044.stdout:6/28: chown d2/c7 376842897 1 2024-04-25T22:03:16.675 INFO:tasks.workunit.client.0.smithi044.stdout:7/14: chown l1 0 1 2024-04-25T22:03:16.675 INFO:tasks.workunit.client.0.smithi044.stdout:4/4: dread - f0 zero size 2024-04-25T22:03:16.675 INFO:tasks.workunit.client.0.smithi044.stdout:9/14: chown l0 1090 1 2024-04-25T22:03:16.675 INFO:tasks.workunit.client.0.smithi044.stdout:9/15: dread - no filename 2024-04-25T22:03:16.675 INFO:tasks.workunit.client.0.smithi044.stdout:9/16: dwrite - no filename 2024-04-25T22:03:16.675 INFO:tasks.workunit.client.0.smithi044.stdout:9/17: write - no filename 2024-04-25T22:03:16.676 INFO:tasks.workunit.client.0.smithi044.stdout:8/155: creat d2a/f2e x:0 0 0 2024-04-25T22:03:16.677 INFO:tasks.workunit.client.0.smithi044.stdout:4/5: symlink l2 0 2024-04-25T22:03:16.677 INFO:tasks.workunit.client.0.smithi044.stdout:1/22: truncate d3/f4 459622 0 2024-04-25T22:03:16.677 INFO:tasks.workunit.client.0.smithi044.stdout:9/18: creat f3 x:0 0 0 2024-04-25T22:03:16.679 INFO:tasks.workunit.client.0.smithi044.stdout:6/29: dread d2/d8/fa [0,4194304] 0 2024-04-25T22:03:16.679 INFO:tasks.workunit.client.0.smithi044.stdout:4/6: truncate f1 214429 0 2024-04-25T22:03:16.680 INFO:tasks.workunit.client.0.smithi044.stdout:3/9: dread d0/d2/f3 [0,4194304] 0 2024-04-25T22:03:16.681 INFO:tasks.workunit.client.0.smithi044.stdout:9/19: write f3 [482357,91321] 0 2024-04-25T22:03:16.683 INFO:tasks.workunit.client.0.smithi044.stdout:4/7: write f0 [977118,39164] 0 2024-04-25T22:03:16.683 INFO:tasks.workunit.client.0.smithi044.stdout:5/20: dwrite d2/f3 [0,4194304] 0 2024-04-25T22:03:16.684 INFO:tasks.workunit.client.0.smithi044.stdout:3/10: mkdir d0/d2/d4 0 2024-04-25T22:03:16.685 INFO:tasks.workunit.client.0.smithi044.stdout:9/20: unlink l0 0 2024-04-25T22:03:16.685 INFO:tasks.workunit.client.0.smithi044.stdout:6/30: rename d2/d8/fa to d2/fd 0 2024-04-25T22:03:16.686 INFO:tasks.workunit.client.0.smithi044.stdout:2/40: dwrite f6 [0,4194304] 0 2024-04-25T22:03:16.687 INFO:tasks.workunit.client.0.smithi044.stdout:4/8: unlink f1 0 2024-04-25T22:03:16.688 INFO:tasks.workunit.client.0.smithi044.stdout:5/21: symlink d2/l8 0 2024-04-25T22:03:16.688 INFO:tasks.workunit.client.0.smithi044.stdout:9/21: truncate f3 768334 0 2024-04-25T22:03:16.689 INFO:tasks.workunit.client.0.smithi044.stdout:3/11: symlink d0/d2/d4/l5 0 2024-04-25T22:03:16.690 INFO:tasks.workunit.client.0.smithi044.stdout:2/41: fsync f0 0 2024-04-25T22:03:16.690 INFO:tasks.workunit.client.0.smithi044.stdout:6/31: dread d2/fd [0,4194304] 0 2024-04-25T22:03:16.690 INFO:tasks.workunit.client.0.smithi044.stdout:4/9: link l2 l3 0 2024-04-25T22:03:16.690 INFO:tasks.workunit.client.0.smithi044.stdout:9/22: truncate f3 985899 0 2024-04-25T22:03:16.692 INFO:tasks.workunit.client.0.smithi044.stdout:6/32: mkdir d2/de 0 2024-04-25T22:03:16.693 INFO:tasks.workunit.client.0.smithi044.stdout:9/23: mkdir d4 0 2024-04-25T22:03:16.693 INFO:tasks.workunit.client.0.smithi044.stdout:7/15: dwrite f0 [0,4194304] 0 2024-04-25T22:03:16.693 INFO:tasks.workunit.client.0.smithi044.stdout:8/156: dread f0 [0,4194304] 0 2024-04-25T22:03:16.693 INFO:tasks.workunit.client.0.smithi044.stdout:4/10: rename f0 to f4 0 2024-04-25T22:03:16.693 INFO:tasks.workunit.client.0.smithi044.stdout:2/42: mknod d7/cd 0 2024-04-25T22:03:16.694 INFO:tasks.workunit.client.0.smithi044.stdout:3/12: read d0/d2/f3 [3853319,2679] 0 2024-04-25T22:03:16.695 INFO:tasks.workunit.client.0.smithi044.stdout:9/24: rename d4 to d4/d5 22 2024-04-25T22:03:16.696 INFO:tasks.workunit.client.0.smithi044.stdout:1/23: dwrite d3/f4 [0,4194304] 0 2024-04-25T22:03:16.696 INFO:tasks.workunit.client.0.smithi044.stdout:6/33: read d2/fd [45669,3799] 0 2024-04-25T22:03:16.696 INFO:tasks.workunit.client.0.smithi044.stdout:4/11: symlink l5 0 2024-04-25T22:03:16.696 INFO:tasks.workunit.client.0.smithi044.stdout:8/157: stat fa 0 2024-04-25T22:03:16.696 INFO:tasks.workunit.client.0.smithi044.stdout:9/25: chown d4 878955 1 2024-04-25T22:03:16.696 INFO:tasks.workunit.client.0.smithi044.stdout:7/16: mknod c2 0 2024-04-25T22:03:16.697 INFO:tasks.workunit.client.0.smithi044.stdout:4/12: mknod c6 0 2024-04-25T22:03:16.698 INFO:tasks.workunit.client.0.smithi044.stdout:8/158: rename f20 to d2a/f2f 0 2024-04-25T22:03:16.700 INFO:tasks.workunit.client.0.smithi044.stdout:6/34: write d2/fd [216360,7835] 0 2024-04-25T22:03:16.702 INFO:tasks.workunit.client.0.smithi044.stdout:5/22: dwrite d2/f4 [0,4194304] 0 2024-04-25T22:03:16.704 INFO:tasks.workunit.client.0.smithi044.stdout:5/23: unlink d2/f6 0 2024-04-25T22:03:16.705 INFO:tasks.workunit.client.0.smithi044.stdout:5/24: stat d2 0 2024-04-25T22:03:16.705 INFO:tasks.workunit.client.0.smithi044.stdout:1/24: dread d3/f4 [0,4194304] 0 2024-04-25T22:03:16.711 INFO:tasks.workunit.client.0.smithi044.stdout:4/13: dwrite f4 [0,4194304] 0 2024-04-25T22:03:16.711 INFO:tasks.workunit.client.0.smithi044.stdout:3/13: dwrite d0/d2/f3 [0,4194304] 0 2024-04-25T22:03:16.712 INFO:tasks.workunit.client.0.smithi044.stdout:4/14: mknod c7 0 2024-04-25T22:03:16.713 INFO:tasks.workunit.client.0.smithi044.stdout:6/35: dwrite d2/fd [0,4194304] 0 2024-04-25T22:03:16.714 INFO:tasks.workunit.client.0.smithi044.stdout:6/36: write d2/fd [12277,56879] 0 2024-04-25T22:03:16.716 INFO:tasks.workunit.client.0.smithi044.stdout:6/37: link d2/d8/c9 d2/de/cf 0 2024-04-25T22:03:16.717 INFO:tasks.workunit.client.0.smithi044.stdout:3/14: dread d0/d2/f3 [0,4194304] 0 2024-04-25T22:03:16.725 INFO:tasks.workunit.client.0.smithi044.stdout:6/38: dwrite d2/fd [0,4194304] 0 2024-04-25T22:03:16.726 INFO:tasks.workunit.client.0.smithi044.stdout:6/39: chown d2/c7 53955 1 2024-04-25T22:03:16.726 INFO:tasks.workunit.client.0.smithi044.stdout:3/15: dwrite d0/d2/f3 [4194304,4194304] 0 2024-04-25T22:03:16.727 INFO:tasks.workunit.client.0.smithi044.stdout:6/40: mknod d2/de/c10 0 2024-04-25T22:03:16.728 INFO:tasks.workunit.client.0.smithi044.stdout:3/16: link d0/d2/f3 d0/f6 0 2024-04-25T22:03:16.728 INFO:tasks.workunit.client.0.smithi044.stdout:3/17: mknod d0/d2/c7 0 2024-04-25T22:03:16.728 INFO:tasks.workunit.client.0.smithi044.stdout:3/18: mknod d0/d2/c8 0 2024-04-25T22:03:16.729 INFO:tasks.workunit.client.0.smithi044.stdout:3/19: symlink d0/d1/l9 0 2024-04-25T22:03:16.730 INFO:tasks.workunit.client.0.smithi044.stdout:3/20: mkdir d0/d1/da 0 2024-04-25T22:03:16.737 INFO:tasks.workunit.client.0.smithi044.stdout:3/21: dwrite d0/f6 [4194304,4194304] 0 2024-04-25T22:03:16.737 INFO:tasks.workunit.client.0.smithi044.stdout:3/22: chown d0/d1 1062541430 1 2024-04-25T22:03:16.737 INFO:tasks.workunit.client.0.smithi044.stdout:3/23: rename d0/d1 to d0/d1/db 22 2024-04-25T22:03:16.738 INFO:tasks.workunit.client.0.smithi044.stdout:3/24: write d0/d2/f3 [7851145,17304] 0 2024-04-25T22:03:16.739 INFO:tasks.workunit.client.0.smithi044.stdout:3/25: mkdir d0/d1/dc 0 2024-04-25T22:03:16.739 INFO:tasks.workunit.client.0.smithi044.stdout:3/26: readlink d0/d1/l9 0 2024-04-25T22:03:16.740 INFO:tasks.workunit.client.0.smithi044.stdout:3/27: write d0/f6 [7781574,112445] 0 2024-04-25T22:03:16.741 INFO:tasks.workunit.client.0.smithi044.stdout:3/28: mkdir d0/d1/dc/dd 0 2024-04-25T22:03:16.741 INFO:tasks.workunit.client.0.smithi044.stdout:3/29: creat d0/d1/fe x:0 0 0 2024-04-25T22:03:16.742 INFO:tasks.workunit.client.0.smithi044.stdout:3/30: write d0/d1/fe [111493,85939] 0 2024-04-25T22:03:16.763 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:16.760+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:16.783 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:16.783 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:16.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:16.843 INFO:tasks.workunit.client.0.smithi044.stdout:9/26: fsync f3 0 2024-04-25T22:03:16.843 INFO:tasks.workunit.client.0.smithi044.stdout:2/43: truncate f0 3328908 0 2024-04-25T22:03:16.844 INFO:tasks.workunit.client.0.smithi044.stdout:7/17: getdents . 0 2024-04-25T22:03:16.845 INFO:tasks.workunit.client.0.smithi044.stdout:5/25: truncate d2/f4 3791883 0 2024-04-25T22:03:16.845 INFO:tasks.workunit.client.0.smithi044.stdout:2/44: fdatasync f6 0 2024-04-25T22:03:16.845 INFO:tasks.workunit.client.0.smithi044.stdout:4/15: truncate f4 3297800 0 2024-04-25T22:03:16.847 INFO:tasks.workunit.client.0.smithi044.stdout:3/31: fsync d0/d1/fe 0 2024-04-25T22:03:16.848 INFO:tasks.workunit.client.0.smithi044.stdout:9/27: truncate f3 966112 0 2024-04-25T22:03:16.851 INFO:tasks.workunit.client.0.smithi044.stdout:7/18: link l1 l3 0 2024-04-25T22:03:16.851 INFO:tasks.workunit.client.0.smithi044.stdout:9/28: symlink d4/l6 0 2024-04-25T22:03:16.852 INFO:tasks.workunit.client.0.smithi044.stdout:7/19: fdatasync f0 0 2024-04-25T22:03:16.854 INFO:tasks.workunit.client.0.smithi044.stdout:1/25: dwrite d3/f4 [4194304,4194304] 0 2024-04-25T22:03:16.854 INFO:tasks.workunit.client.0.smithi044.stdout:7/20: write f0 [572917,88718] 0 2024-04-25T22:03:16.856 INFO:tasks.workunit.client.0.smithi044.stdout:1/26: write d3/f4 [7599230,9870] 0 2024-04-25T22:03:16.857 INFO:tasks.workunit.client.0.smithi044.stdout:3/32: truncate d0/d2/f3 8368123 0 2024-04-25T22:03:16.859 INFO:tasks.workunit.client.0.smithi044.stdout:1/27: creat d3/f5 x:0 0 0 2024-04-25T22:03:16.864 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:16.860+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:16.869 INFO:tasks.workunit.client.0.smithi044.stdout:4/16: dwrite f4 [0,4194304] 0 2024-04-25T22:03:16.869 INFO:tasks.workunit.client.0.smithi044.stdout:6/41: fdatasync d2/fd 0 2024-04-25T22:03:16.872 INFO:tasks.workunit.client.0.smithi044.stdout:7/21: write f0 [4795666,25963] 0 2024-04-25T22:03:16.872 INFO:tasks.workunit.client.0.smithi044.stdout:6/42: write d2/fd [666503,28977] 0 2024-04-25T22:03:16.876 INFO:tasks.workunit.client.0.smithi044.stdout:6/43: chown d2/fd 26 1 2024-04-25T22:03:16.879 INFO:tasks.workunit.client.0.smithi044.stdout:3/33: dwrite d0/d1/fe [0,4194304] 0 2024-04-25T22:03:16.884 INFO:tasks.workunit.client.0.smithi044.stdout:3/34: chown d0/d1/dc/dd 111 1 2024-04-25T22:03:16.887 INFO:tasks.workunit.client.0.smithi044.stdout:3/35: chown d0/d1/da 47543 1 2024-04-25T22:03:16.888 INFO:tasks.workunit.client.0.smithi044.stdout:7/22: dread f0 [4194304,4194304] 0 2024-04-25T22:03:16.888 INFO:tasks.workunit.client.0.smithi044.stdout:2/45: dwrite f0 [0,4194304] 0 2024-04-25T22:03:16.889 INFO:tasks.workunit.client.0.smithi044.stdout:4/17: symlink l8 0 2024-04-25T22:03:16.889 INFO:tasks.workunit.client.0.smithi044.stdout:9/29: dwrite f3 [0,4194304] 0 2024-04-25T22:03:16.889 INFO:tasks.workunit.client.0.smithi044.stdout:6/44: mkdir d2/d8/d11 0 2024-04-25T22:03:16.893 INFO:tasks.workunit.client.0.smithi044.stdout:4/18: rename c7 to c9 0 2024-04-25T22:03:16.893 INFO:tasks.workunit.client.0.smithi044.stdout:9/30: mkdir d4/d7 0 2024-04-25T22:03:16.893 INFO:tasks.workunit.client.0.smithi044.stdout:1/28: getdents d3 0 2024-04-25T22:03:16.897 INFO:tasks.workunit.client.0.smithi044.stdout:9/31: creat d4/d7/f8 x:0 0 0 2024-04-25T22:03:16.898 INFO:tasks.workunit.client.0.smithi044.stdout:1/29: getdents d3 0 2024-04-25T22:03:16.899 INFO:tasks.workunit.client.0.smithi044.stdout:2/46: dread f6 [0,4194304] 0 2024-04-25T22:03:16.900 INFO:tasks.workunit.client.0.smithi044.stdout:6/45: dread d2/fd [0,4194304] 0 2024-04-25T22:03:16.900 INFO:tasks.workunit.client.0.smithi044.stdout:2/47: fdatasync f6 0 2024-04-25T22:03:16.901 INFO:tasks.workunit.client.0.smithi044.stdout:1/30: stat c1 0 2024-04-25T22:03:16.902 INFO:tasks.workunit.client.0.smithi044.stdout:7/23: dread f0 [0,4194304] 0 2024-04-25T22:03:16.905 INFO:tasks.workunit.client.0.smithi044.stdout:3/36: dread d0/d2/f3 [0,4194304] 0 2024-04-25T22:03:16.906 INFO:tasks.workunit.client.0.smithi044.stdout:2/48: chown d7/cd 624 1 2024-04-25T22:03:16.906 INFO:tasks.workunit.client.0.smithi044.stdout:2/49: rmdir d7/d8 39 2024-04-25T22:03:16.907 INFO:tasks.workunit.client.0.smithi044.stdout:3/37: write d0/d1/fe [3121296,43431] 0 2024-04-25T22:03:16.908 INFO:tasks.workunit.client.0.smithi044.stdout:7/24: rename l1 to l4 0 2024-04-25T22:03:16.909 INFO:tasks.workunit.client.0.smithi044.stdout:2/50: mknod d7/d8/ce 0 2024-04-25T22:03:16.910 INFO:tasks.workunit.client.0.smithi044.stdout:7/25: creat f5 x:0 0 0 2024-04-25T22:03:16.911 INFO:tasks.workunit.client.0.smithi044.stdout:7/26: creat f6 x:0 0 0 2024-04-25T22:03:16.911 INFO:tasks.workunit.client.0.smithi044.stdout:4/19: dwrite f4 [4194304,4194304] 0 2024-04-25T22:03:16.912 INFO:tasks.workunit.client.0.smithi044.stdout:6/46: dread d2/fd [0,4194304] 0 2024-04-25T22:03:16.914 INFO:tasks.workunit.client.0.smithi044.stdout:2/51: mkdir d7/d8/db/df 0 2024-04-25T22:03:16.915 INFO:tasks.workunit.client.0.smithi044.stdout:4/20: creat fa x:0 0 0 2024-04-25T22:03:16.917 INFO:tasks.workunit.client.0.smithi044.stdout:2/52: fsync d7/d8/db/fc 0 2024-04-25T22:03:16.917 INFO:tasks.workunit.client.0.smithi044.stdout:1/31: dwrite d3/f5 [0,4194304] 0 2024-04-25T22:03:16.918 INFO:tasks.workunit.client.0.smithi044.stdout:4/21: write f4 [3775086,55699] 0 2024-04-25T22:03:16.919 INFO:tasks.workunit.client.0.smithi044.stdout:2/53: readlink d7/la 0 2024-04-25T22:03:16.920 INFO:tasks.workunit.client.0.smithi044.stdout:4/22: mknod cb 0 2024-04-25T22:03:16.920 INFO:tasks.workunit.client.0.smithi044.stdout:1/32: symlink d3/l6 0 2024-04-25T22:03:16.922 INFO:tasks.workunit.client.0.smithi044.stdout:2/54: readlink d7/la 0 2024-04-25T22:03:16.923 INFO:tasks.workunit.client.0.smithi044.stdout:1/33: stat d3/l6 0 2024-04-25T22:03:16.924 INFO:tasks.workunit.client.0.smithi044.stdout:4/23: creat fc x:0 0 0 2024-04-25T22:03:16.926 INFO:tasks.workunit.client.0.smithi044.stdout:3/38: dwrite d0/d1/fe [0,4194304] 0 2024-04-25T22:03:16.926 INFO:tasks.workunit.client.0.smithi044.stdout:2/55: write f0 [1392175,81253] 0 2024-04-25T22:03:16.930 INFO:tasks.workunit.client.0.smithi044.stdout:7/27: dwrite f6 [0,4194304] 0 2024-04-25T22:03:16.930 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:16.930 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:16.931 INFO:tasks.workunit.client.0.smithi044.stdout:3/39: rename d0/d2/d4 to d0/d1/da/df 0 2024-04-25T22:03:16.932 INFO:tasks.workunit.client.0.smithi044.stdout:6/47: dwrite d2/fd [4194304,4194304] 0 2024-04-25T22:03:16.935 INFO:tasks.workunit.client.0.smithi044.stdout:1/34: dread d3/f4 [4194304,4194304] 0 2024-04-25T22:03:16.936 INFO:tasks.workunit.client.0.smithi044.stdout:2/56: dread f6 [0,4194304] 0 2024-04-25T22:03:16.936 INFO:tasks.workunit.client.0.smithi044.stdout:3/40: write d0/d2/f3 [5010602,84055] 0 2024-04-25T22:03:16.939 INFO:tasks.workunit.client.0.smithi044.stdout:3/41: getdents d0/d1/dc 0 2024-04-25T22:03:16.941 INFO:tasks.workunit.client.0.smithi044.stdout:3/42: creat d0/d2/f10 x:0 0 0 2024-04-25T22:03:16.942 INFO:tasks.workunit.client.0.smithi044.stdout:3/43: write d0/d2/f3 [8901317,84021] 0 2024-04-25T22:03:16.944 INFO:tasks.workunit.client.0.smithi044.stdout:3/44: mkdir d0/d1/dc/dd/d11 0 2024-04-25T22:03:16.946 INFO:tasks.workunit.client.0.smithi044.stdout:2/57: dwrite f6 [0,4194304] 0 2024-04-25T22:03:16.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:16.947 INFO:tasks.workunit.client.0.smithi044.stdout:2/58: link c5 d7/d8/db/c10 0 2024-04-25T22:03:16.948 INFO:tasks.workunit.client.0.smithi044.stdout:2/59: dread - d7/d8/db/fc zero size 2024-04-25T22:03:16.949 INFO:tasks.workunit.client.0.smithi044.stdout:2/60: chown d7/la 49504 1 2024-04-25T22:03:16.950 INFO:tasks.workunit.client.0.smithi044.stdout:2/61: unlink f4 0 2024-04-25T22:03:16.952 INFO:tasks.workunit.client.0.smithi044.stdout:2/62: creat d7/f11 x:0 0 0 2024-04-25T22:03:16.953 INFO:tasks.workunit.client.0.smithi044.stdout:2/63: read - d7/d8/db/fc zero size 2024-04-25T22:03:16.961 INFO:tasks.workunit.client.0.smithi044.stdout:9/32: getdents d4 0 2024-04-25T22:03:16.961 INFO:tasks.workunit.client.0.smithi044.stdout:4/24: getdents . 0 2024-04-25T22:03:16.962 INFO:tasks.workunit.client.0.smithi044.stdout:1/35: truncate d3/f4 6405589 0 2024-04-25T22:03:16.962 INFO:tasks.workunit.client.0.smithi044.stdout:6/48: truncate d2/fd 772939 0 2024-04-25T22:03:16.962 INFO:tasks.workunit.client.0.smithi044.stdout:3/45: rename d0/d1/dc to d0/d1/da/df/d12 0 2024-04-25T22:03:16.962 INFO:tasks.workunit.client.0.smithi044.stdout:2/64: symlink d7/l12 0 2024-04-25T22:03:16.962 INFO:tasks.workunit.client.0.smithi044.stdout:7/28: rename l4 to l7 0 2024-04-25T22:03:16.962 INFO:tasks.workunit.client.0.smithi044.stdout:9/33: symlink d4/d7/l9 0 2024-04-25T22:03:16.963 INFO:tasks.workunit.client.0.smithi044.stdout:4/25: mkdir dd 0 2024-04-25T22:03:16.967 INFO:tasks.workunit.client.0.smithi044.stdout:1/36: chown d3/f4 111187 1 2024-04-25T22:03:16.967 INFO:tasks.workunit.client.0.smithi044.stdout:9/34: chown f3 41 1 2024-04-25T22:03:16.967 INFO:tasks.workunit.client.0.smithi044.stdout:7/29: mknod c8 0 2024-04-25T22:03:16.967 INFO:tasks.workunit.client.0.smithi044.stdout:4/26: truncate fc 485325 0 2024-04-25T22:03:16.967 INFO:tasks.workunit.client.0.smithi044.stdout:2/65: write d7/f11 [160656,6341] 0 2024-04-25T22:03:16.967 INFO:tasks.workunit.client.0.smithi044.stdout:1/37: chown c2 1301067 1 2024-04-25T22:03:16.967 INFO:tasks.workunit.client.0.smithi044.stdout:2/66: truncate f0 4351893 0 2024-04-25T22:03:16.967 INFO:tasks.workunit.client.0.smithi044.stdout:4/27: symlink dd/le 0 2024-04-25T22:03:16.967 INFO:tasks.workunit.client.0.smithi044.stdout:9/35: write d4/d7/f8 [741797,101091] 0 2024-04-25T22:03:16.968 INFO:tasks.workunit.client.0.smithi044.stdout:4/28: creat dd/ff x:0 0 0 2024-04-25T22:03:16.968 INFO:tasks.workunit.client.0.smithi044.stdout:2/67: write d7/d8/db/fc [909707,14824] 0 2024-04-25T22:03:16.968 INFO:tasks.workunit.client.0.smithi044.stdout:2/68: getdents d7/d8 0 2024-04-25T22:03:16.970 INFO:tasks.workunit.client.0.smithi044.stdout:7/30: dread f6 [0,4194304] 0 2024-04-25T22:03:16.970 INFO:tasks.workunit.client.0.smithi044.stdout:7/31: rmdir - no directory 2024-04-25T22:03:16.970 INFO:tasks.workunit.client.0.smithi044.stdout:1/38: dread d3/f5 [0,4194304] 0 2024-04-25T22:03:16.970 INFO:tasks.workunit.client.0.smithi044.stdout:2/69: unlink d7/d8/db/fc 0 2024-04-25T22:03:16.971 INFO:tasks.workunit.client.0.smithi044.stdout:6/49: dread d2/fd [0,4194304] 0 2024-04-25T22:03:16.971 INFO:tasks.workunit.client.0.smithi044.stdout:9/36: dread f3 [0,4194304] 0 2024-04-25T22:03:16.971 INFO:tasks.workunit.client.0.smithi044.stdout:7/32: creat f9 x:0 0 0 2024-04-25T22:03:16.971 INFO:tasks.workunit.client.0.smithi044.stdout:1/39: chown d3/f5 3 1 2024-04-25T22:03:16.971 INFO:tasks.workunit.client.0.smithi044.stdout:6/50: stat d2/cc 0 2024-04-25T22:03:16.972 INFO:tasks.workunit.client.0.smithi044.stdout:9/37: rmdir d4 39 2024-04-25T22:03:16.972 INFO:tasks.workunit.client.0.smithi044.stdout:2/70: rename d7/l12 to d7/d8/db/df/l13 0 2024-04-25T22:03:16.972 INFO:tasks.workunit.client.0.smithi044.stdout:9/38: chown f3 183327215 1 2024-04-25T22:03:16.972 INFO:tasks.workunit.client.0.smithi044.stdout:2/71: write f6 [1426928,15813] 0 2024-04-25T22:03:16.973 INFO:tasks.workunit.client.0.smithi044.stdout:6/51: write d2/fd [1644200,66414] 0 2024-04-25T22:03:16.973 INFO:tasks.workunit.client.0.smithi044.stdout:9/39: rename d4 to d4/da 22 2024-04-25T22:03:16.973 INFO:tasks.workunit.client.0.smithi044.stdout:2/72: stat d7/d8/ce 0 2024-04-25T22:03:16.973 INFO:tasks.workunit.client.0.smithi044.stdout:6/52: rmdir d2/de 39 2024-04-25T22:03:16.973 INFO:tasks.workunit.client.0.smithi044.stdout:6/53: readlink - no filename 2024-04-25T22:03:16.974 INFO:tasks.workunit.client.0.smithi044.stdout:9/40: mknod d4/d7/cb 0 2024-04-25T22:03:16.974 INFO:tasks.workunit.client.0.smithi044.stdout:2/73: write d7/f11 [309537,24424] 0 2024-04-25T22:03:16.975 INFO:tasks.workunit.client.0.smithi044.stdout:9/41: creat d4/d7/fc x:0 0 0 2024-04-25T22:03:16.975 INFO:tasks.workunit.client.0.smithi044.stdout:6/54: rename d2/de to d2/d8/d12 0 2024-04-25T22:03:16.976 INFO:tasks.workunit.client.0.smithi044.stdout:9/42: creat d4/d7/fd x:0 0 0 2024-04-25T22:03:16.976 INFO:tasks.workunit.client.0.smithi044.stdout:6/55: mkdir d2/d8/d13 0 2024-04-25T22:03:16.977 INFO:tasks.workunit.client.0.smithi044.stdout:9/43: mknod d4/ce 0 2024-04-25T22:03:16.977 INFO:tasks.workunit.client.0.smithi044.stdout:6/56: symlink d2/d8/l14 0 2024-04-25T22:03:16.978 INFO:tasks.workunit.client.0.smithi044.stdout:6/57: mknod d2/d8/c15 0 2024-04-25T22:03:16.979 INFO:tasks.workunit.client.0.smithi044.stdout:6/58: write d2/fd [1519053,66706] 0 2024-04-25T22:03:16.980 INFO:tasks.workunit.client.0.smithi044.stdout:1/40: dwrite d3/f4 [0,4194304] 0 2024-04-25T22:03:16.986 INFO:tasks.workunit.client.0.smithi044.stdout:9/44: dwrite d4/d7/f8 [0,4194304] 0 2024-04-25T22:03:16.987 INFO:tasks.workunit.client.0.smithi044.stdout:9/45: creat d4/ff x:0 0 0 2024-04-25T22:03:16.989 INFO:tasks.workunit.client.0.smithi044.stdout:2/74: dread d7/f11 [0,4194304] 0 2024-04-25T22:03:16.992 INFO:tasks.workunit.client.0.smithi044.stdout:9/46: dread f3 [0,4194304] 0 2024-04-25T22:03:16.992 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:16.988+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:16.993 INFO:tasks.workunit.client.0.smithi044.stdout:9/47: symlink d4/l10 0 2024-04-25T22:03:16.993 INFO:tasks.workunit.client.0.smithi044.stdout:9/48: dread - d4/ff zero size 2024-04-25T22:03:16.997 INFO:tasks.workunit.client.0.smithi044.stdout:2/75: truncate f6 493103 0 2024-04-25T22:03:16.998 INFO:tasks.workunit.client.0.smithi044.stdout:2/76: read d7/f11 [224905,31411] 0 2024-04-25T22:03:17.000 INFO:tasks.workunit.client.0.smithi044.stdout:2/77: creat d7/f14 x:0 0 0 2024-04-25T22:03:17.001 INFO:tasks.workunit.client.0.smithi044.stdout:2/78: chown d7/cd 150421499 1 2024-04-25T22:03:17.001 INFO:tasks.workunit.client.0.smithi044.stdout:9/49: dwrite d4/d7/f8 [4194304,4194304] 0 2024-04-25T22:03:17.002 INFO:tasks.workunit.client.0.smithi044.stdout:9/50: dread - d4/ff zero size 2024-04-25T22:03:17.002 INFO:tasks.workunit.client.0.smithi044.stdout:2/79: creat d7/f15 x:0 0 0 2024-04-25T22:03:17.002 INFO:tasks.workunit.client.0.smithi044.stdout:9/51: rmdir d4 39 2024-04-25T22:03:17.003 INFO:tasks.workunit.client.0.smithi044.stdout:9/52: rmdir d4 39 2024-04-25T22:03:17.004 INFO:tasks.workunit.client.0.smithi044.stdout:2/80: rename d7/d8/db/df to d7/d16 0 2024-04-25T22:03:17.004 INFO:tasks.workunit.client.0.smithi044.stdout:9/53: rename d4/d7 to d4/d7/d11 22 2024-04-25T22:03:17.005 INFO:tasks.workunit.client.0.smithi044.stdout:2/81: truncate f6 816257 0 2024-04-25T22:03:17.005 INFO:tasks.workunit.client.0.smithi044.stdout:9/54: symlink d4/l12 0 2024-04-25T22:03:17.006 INFO:tasks.workunit.client.0.smithi044.stdout:9/55: creat d4/f13 x:0 0 0 2024-04-25T22:03:17.007 INFO:tasks.workunit.client.0.smithi044.stdout:6/59: truncate d2/fd 183795 0 2024-04-25T22:03:17.008 INFO:tasks.workunit.client.0.smithi044.stdout:6/60: getdents d2/d8/d13 0 2024-04-25T22:03:17.010 INFO:tasks.workunit.client.0.smithi044.stdout:6/61: creat d2/d8/d11/f16 x:0 0 0 2024-04-25T22:03:17.010 INFO:tasks.workunit.client.0.smithi044.stdout:2/82: dread f0 [0,4194304] 0 2024-04-25T22:03:17.011 INFO:tasks.workunit.client.0.smithi044.stdout:2/83: creat d7/d16/f17 x:0 0 0 2024-04-25T22:03:17.011 INFO:tasks.workunit.client.0.smithi044.stdout:6/62: rename d2/d8/c9 to d2/d8/d11/c17 0 2024-04-25T22:03:17.012 INFO:tasks.workunit.client.0.smithi044.stdout:2/84: write f0 [5295450,6412] 0 2024-04-25T22:03:17.013 INFO:tasks.workunit.client.0.smithi044.stdout:6/63: mknod d2/d8/c18 0 2024-04-25T22:03:17.014 INFO:tasks.workunit.client.0.smithi044.stdout:2/85: write d7/d16/f17 [135586,26636] 0 2024-04-25T22:03:17.014 INFO:tasks.workunit.client.0.smithi044.stdout:6/64: write d2/d8/d11/f16 [617265,1952] 0 2024-04-25T22:03:17.015 INFO:tasks.workunit.client.0.smithi044.stdout:9/56: dwrite f3 [4194304,4194304] 0 2024-04-25T22:03:17.016 INFO:tasks.workunit.client.0.smithi044.stdout:2/86: creat d7/f18 x:0 0 0 2024-04-25T22:03:17.016 INFO:tasks.workunit.client.0.smithi044.stdout:9/57: symlink d4/d7/l14 0 2024-04-25T22:03:17.016 INFO:tasks.workunit.client.0.smithi044.stdout:2/87: dread - d7/f14 zero size 2024-04-25T22:03:17.017 INFO:tasks.workunit.client.0.smithi044.stdout:2/88: write d7/f18 [499019,40528] 0 2024-04-25T22:03:17.018 INFO:tasks.workunit.client.0.smithi044.stdout:2/89: write d7/f18 [1578803,109604] 0 2024-04-25T22:03:17.021 INFO:tasks.workunit.client.0.smithi044.stdout:6/65: truncate d2/fd 628787 0 2024-04-25T22:03:17.021 INFO:tasks.workunit.client.0.smithi044.stdout:2/90: fsync d7/d16/f17 0 2024-04-25T22:03:17.022 INFO:tasks.workunit.client.0.smithi044.stdout:2/91: symlink d7/d8/l19 0 2024-04-25T22:03:17.022 INFO:tasks.workunit.client.0.smithi044.stdout:6/66: creat d2/d8/d12/f19 x:0 0 0 2024-04-25T22:03:17.024 INFO:tasks.workunit.client.0.smithi044.stdout:2/92: mknod d7/d8/c1a 0 2024-04-25T22:03:17.024 INFO:tasks.workunit.client.0.smithi044.stdout:6/67: write d2/d8/d11/f16 [1619231,127031] 0 2024-04-25T22:03:17.025 INFO:tasks.workunit.client.0.smithi044.stdout:6/68: chown d2/d8/d12 39 1 2024-04-25T22:03:17.025 INFO:tasks.workunit.client.0.smithi044.stdout:9/58: dwrite d4/ff [0,4194304] 0 2024-04-25T22:03:17.026 INFO:tasks.workunit.client.0.smithi044.stdout:6/69: mknod d2/d8/d13/c1a 0 2024-04-25T22:03:17.026 INFO:tasks.workunit.client.0.smithi044.stdout:9/59: write d4/d7/fc [1024041,81835] 0 2024-04-25T22:03:17.027 INFO:tasks.workunit.client.0.smithi044.stdout:9/60: chown d4/ce 56604 1 2024-04-25T22:03:17.027 INFO:tasks.workunit.client.0.smithi044.stdout:6/70: creat d2/d8/f1b x:0 0 0 2024-04-25T22:03:17.028 INFO:tasks.workunit.client.0.smithi044.stdout:6/71: chown d2/d8/d12 0 1 2024-04-25T22:03:17.028 INFO:tasks.workunit.client.0.smithi044.stdout:9/61: creat d4/f15 x:0 0 0 2024-04-25T22:03:17.028 INFO:tasks.workunit.client.0.smithi044.stdout:9/62: rmdir d4/d7 39 2024-04-25T22:03:17.030 INFO:tasks.workunit.client.0.smithi044.stdout:9/63: write d4/d7/f8 [895265,123393] 0 2024-04-25T22:03:17.031 INFO:tasks.workunit.client.0.smithi044.stdout:9/64: rename d4/ce to d4/c16 0 2024-04-25T22:03:17.031 INFO:tasks.workunit.client.0.smithi044.stdout:9/65: stat d4 0 2024-04-25T22:03:17.032 INFO:tasks.workunit.client.0.smithi044.stdout:9/66: write d4/f15 [19163,55422] 0 2024-04-25T22:03:17.037 INFO:tasks.workunit.client.0.smithi044.stdout:6/72: dwrite d2/d8/d12/f19 [0,4194304] 0 2024-04-25T22:03:17.039 INFO:tasks.workunit.client.0.smithi044.stdout:6/73: rmdir d2/d8 39 2024-04-25T22:03:17.041 INFO:tasks.workunit.client.0.smithi044.stdout:6/74: creat d2/d8/f1c x:0 0 0 2024-04-25T22:03:17.043 INFO:tasks.workunit.client.0.smithi044.stdout:9/67: dwrite d4/f15 [0,4194304] 0 2024-04-25T22:03:17.044 INFO:tasks.workunit.client.0.smithi044.stdout:9/68: rename d4/l10 to d4/d7/l17 0 2024-04-25T22:03:17.045 INFO:tasks.workunit.client.0.smithi044.stdout:9/69: stat d4/d7/fd 0 2024-04-25T22:03:17.046 INFO:tasks.workunit.client.0.smithi044.stdout:9/70: mkdir d4/d7/d18 0 2024-04-25T22:03:17.048 INFO:tasks.workunit.client.0.smithi044.stdout:9/71: chown d4/l12 599846 1 2024-04-25T22:03:17.051 INFO:tasks.workunit.client.0.smithi044.stdout:6/75: dread d2/d8/d11/f16 [0,4194304] 0 2024-04-25T22:03:17.052 INFO:tasks.workunit.client.0.smithi044.stdout:6/76: mkdir d2/d8/d12/d1d 0 2024-04-25T22:03:17.054 INFO:tasks.workunit.client.0.smithi044.stdout:6/77: symlink d2/d8/l1e 0 2024-04-25T22:03:17.055 INFO:tasks.workunit.client.0.smithi044.stdout:6/78: mkdir d2/d8/d12/d1f 0 2024-04-25T22:03:17.057 INFO:tasks.workunit.client.0.smithi044.stdout:9/72: dwrite d4/ff [0,4194304] 0 2024-04-25T22:03:17.058 INFO:tasks.workunit.client.0.smithi044.stdout:9/73: symlink d4/d7/l19 0 2024-04-25T22:03:17.059 INFO:tasks.workunit.client.0.smithi044.stdout:6/79: dread d2/d8/d11/f16 [0,4194304] 0 2024-04-25T22:03:17.059 INFO:tasks.workunit.client.0.smithi044.stdout:9/74: link d4/d7/fd d4/f1a 0 2024-04-25T22:03:17.060 INFO:tasks.workunit.client.0.smithi044.stdout:6/80: write d2/d8/d11/f16 [1741995,100567] 0 2024-04-25T22:03:17.061 INFO:tasks.workunit.client.0.smithi044.stdout:9/75: unlink d4/d7/l17 0 2024-04-25T22:03:17.062 INFO:tasks.workunit.client.0.smithi044.stdout:9/76: mknod d4/d7/d18/c1b 0 2024-04-25T22:03:17.062 INFO:tasks.workunit.client.0.smithi044.stdout:9/77: chown d4/f13 25 1 2024-04-25T22:03:17.062 INFO:tasks.workunit.client.0.smithi044.stdout:6/81: write d2/d8/f1c [519769,53136] 0 2024-04-25T22:03:17.063 INFO:tasks.workunit.client.0.smithi044.stdout:6/82: write d2/d8/d11/f16 [1797353,12294] 0 2024-04-25T22:03:17.064 INFO:tasks.workunit.client.0.smithi044.stdout:6/83: creat d2/d8/d12/d1f/f20 x:0 0 0 2024-04-25T22:03:17.066 INFO:tasks.workunit.client.0.smithi044.stdout:6/84: link d2/d8/d12/f19 d2/d8/d11/f21 0 2024-04-25T22:03:17.067 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:17.060+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:17.067 INFO:tasks.workunit.client.0.smithi044.stdout:6/85: mknod d2/d8/c22 0 2024-04-25T22:03:17.073 INFO:tasks.workunit.client.0.smithi044.stdout:9/78: dwrite d4/f1a [0,4194304] 0 2024-04-25T22:03:17.075 INFO:tasks.workunit.client.0.smithi044.stdout:9/79: write d4/ff [3401793,98195] 0 2024-04-25T22:03:17.078 INFO:tasks.workunit.client.0.smithi044.stdout:6/86: dwrite d2/d8/d11/f16 [0,4194304] 0 2024-04-25T22:03:17.079 INFO:tasks.workunit.client.0.smithi044.stdout:6/87: mkdir d2/d23 0 2024-04-25T22:03:17.080 INFO:tasks.workunit.client.0.smithi044.stdout:6/88: creat d2/d8/d12/d1d/f24 x:0 0 0 2024-04-25T22:03:17.085 INFO:tasks.workunit.client.0.smithi044.stdout:2/93: dread f6 [0,4194304] 0 2024-04-25T22:03:17.088 INFO:tasks.workunit.client.0.smithi044.stdout:6/89: dread d2/d8/f1c [0,4194304] 0 2024-04-25T22:03:17.089 INFO:tasks.workunit.client.0.smithi044.stdout:6/90: symlink d2/d8/d12/l25 0 2024-04-25T22:03:17.090 INFO:tasks.workunit.client.0.smithi044.stdout:6/91: chown d2/d8/d11/f16 19 1 2024-04-25T22:03:17.094 INFO:tasks.workunit.client.0.smithi044.stdout:6/92: write d2/fd [434181,119001] 0 2024-04-25T22:03:17.094 INFO:tasks.workunit.client.0.smithi044.stdout:6/93: chown d2/d8/f1c 64721 1 2024-04-25T22:03:17.095 INFO:tasks.workunit.client.0.smithi044.stdout:6/94: chown d2/d8/c22 258105 1 2024-04-25T22:03:17.095 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:17.095 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:17.099 INFO:tasks.workunit.client.0.smithi044.stdout:6/95: truncate d2/d8/f1c 541633 0 2024-04-25T22:03:17.109 INFO:tasks.workunit.client.0.smithi044.stdout:6/96: dwrite d2/d8/f1c [0,4194304] 0 2024-04-25T22:03:17.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:17.111 INFO:tasks.workunit.client.0.smithi044.stdout:6/97: rmdir d2/d8/d13 39 2024-04-25T22:03:17.118 INFO:tasks.workunit.client.0.smithi044.stdout:6/98: dwrite d2/d8/f1b [0,4194304] 0 2024-04-25T22:03:17.127 INFO:tasks.workunit.client.0.smithi044.stdout:6/99: dwrite d2/fd [0,4194304] 0 2024-04-25T22:03:17.128 INFO:tasks.workunit.client.0.smithi044.stdout:6/100: rmdir d2/d8/d12/d1f 39 2024-04-25T22:03:17.139 INFO:tasks.workunit.client.0.smithi044.stdout:6/101: truncate d2/d8/f1c 3008459 0 2024-04-25T22:03:17.140 INFO:tasks.workunit.client.0.smithi044.stdout:6/102: unlink d2/d8/l1e 0 2024-04-25T22:03:17.141 INFO:tasks.workunit.client.0.smithi044.stdout:6/103: link d2/d8/d12/cf d2/d8/d11/c26 0 2024-04-25T22:03:17.143 INFO:tasks.workunit.client.0.smithi044.stdout:6/104: getdents d2/d8/d12 0 2024-04-25T22:03:17.144 INFO:tasks.workunit.client.0.smithi044.stdout:6/105: truncate d2/d8/d12/d1d/f24 1027424 0 2024-04-25T22:03:17.145 INFO:tasks.workunit.client.0.smithi044.stdout:6/106: mkdir d2/d8/d12/d27 0 2024-04-25T22:03:17.150 INFO:tasks.workunit.client.0.smithi044.stdout:6/107: fdatasync d2/d8/d12/d1f/f20 0 2024-04-25T22:03:17.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:17.165+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:17.227 INFO:tasks.workunit.client.0.smithi044.stdout:0/17: sync 2024-04-25T22:03:17.233 INFO:tasks.workunit.client.0.smithi044.stdout:0/18: truncate f0 119153 0 2024-04-25T22:03:17.245 INFO:tasks.workunit.client.0.smithi044.stdout:0/19: write f0 [808494,49714] 0 2024-04-25T22:03:17.246 INFO:tasks.workunit.client.0.smithi044.stdout:0/20: symlink l2 0 2024-04-25T22:03:17.247 INFO:tasks.workunit.client.0.smithi044.stdout:0/21: creat f3 x:0 0 0 2024-04-25T22:03:17.253 INFO:tasks.workunit.client.0.smithi044.stdout:0/22: getdents . 0 2024-04-25T22:03:17.254 INFO:tasks.workunit.client.0.smithi044.stdout:0/23: creat f4 x:0 0 0 2024-04-25T22:03:17.255 INFO:tasks.workunit.client.0.smithi044.stdout:0/24: symlink l5 0 2024-04-25T22:03:17.256 INFO:tasks.workunit.client.0.smithi044.stdout:0/25: rename f4 to f6 0 2024-04-25T22:03:17.257 INFO:tasks.workunit.client.0.smithi044.stdout:0/26: mknod c7 0 2024-04-25T22:03:17.271 INFO:tasks.workunit.client.0.smithi044.stdout:8/159: sync 2024-04-25T22:03:17.271 INFO:tasks.workunit.client.0.smithi044.stdout:8/160: fdatasync f6 0 2024-04-25T22:03:17.271 INFO:tasks.workunit.client.0.smithi044.stdout:0/27: dwrite f1 [0,4194304] 0 2024-04-25T22:03:17.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:17.269+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:17.272 INFO:tasks.workunit.client.0.smithi044.stdout:0/28: chown l5 489 1 2024-04-25T22:03:17.273 INFO:tasks.workunit.client.0.smithi044.stdout:0/29: mkdir d8 0 2024-04-25T22:03:17.274 INFO:tasks.workunit.client.0.smithi044.stdout:8/161: link f4 d2a/f30 0 2024-04-25T22:03:17.274 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:17.274 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:17.275 INFO:tasks.workunit.client.0.smithi044.stdout:0/30: write f0 [413807,51937] 0 2024-04-25T22:03:17.276 INFO:tasks.workunit.client.0.smithi044.stdout:8/162: creat d2a/f31 x:0 0 0 2024-04-25T22:03:17.276 INFO:tasks.workunit.client.0.smithi044.stdout:0/31: stat f1 0 2024-04-25T22:03:17.277 INFO:tasks.workunit.client.0.smithi044.stdout:8/163: mkdir d2a/d32 0 2024-04-25T22:03:17.277 INFO:tasks.workunit.client.0.smithi044.stdout:0/32: creat d8/f9 x:0 0 0 2024-04-25T22:03:17.278 INFO:tasks.workunit.client.0.smithi044.stdout:8/164: rmdir d2a 39 2024-04-25T22:03:17.279 INFO:tasks.workunit.client.0.smithi044.stdout:0/33: mkdir d8/da 0 2024-04-25T22:03:17.280 INFO:tasks.workunit.client.0.smithi044.stdout:8/165: rename d2a/f30 to d2a/d32/f33 0 2024-04-25T22:03:17.282 INFO:tasks.workunit.client.0.smithi044.stdout:8/166: write f28 [2921505,27911] 0 2024-04-25T22:03:17.282 INFO:tasks.workunit.client.0.smithi044.stdout:0/34: rename l2 to d8/da/lb 0 2024-04-25T22:03:17.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:17.300 INFO:tasks.workunit.client.0.smithi044.stdout:0/35: dwrite f6 [0,4194304] 0 2024-04-25T22:03:17.301 INFO:tasks.workunit.client.0.smithi044.stdout:8/167: dwrite d2a/f2f [0,4194304] 0 2024-04-25T22:03:17.301 INFO:tasks.workunit.client.0.smithi044.stdout:0/36: read - f3 zero size 2024-04-25T22:03:17.302 INFO:tasks.workunit.client.0.smithi044.stdout:8/168: truncate fc 1119670 0 2024-04-25T22:03:17.305 INFO:tasks.workunit.client.0.smithi044.stdout:0/37: read f0 [246942,122313] 0 2024-04-25T22:03:17.307 INFO:tasks.workunit.client.0.smithi044.stdout:8/169: rmdir d2a 39 2024-04-25T22:03:17.307 INFO:tasks.workunit.client.0.smithi044.stdout:0/38: rename c7 to d8/cc 0 2024-04-25T22:03:17.310 INFO:tasks.workunit.client.0.smithi044.stdout:0/39: creat d8/da/fd x:0 0 0 2024-04-25T22:03:17.313 INFO:tasks.workunit.client.0.smithi044.stdout:8/170: rename f9 to d2a/d32/f34 0 2024-04-25T22:03:17.315 INFO:tasks.workunit.client.0.smithi044.stdout:8/171: truncate d2a/d32/f33 3390803 0 2024-04-25T22:03:17.320 INFO:tasks.workunit.client.0.smithi044.stdout:5/26: sync 2024-04-25T22:03:17.320 INFO:tasks.workunit.client.0.smithi044.stdout:7/33: sync 2024-04-25T22:03:17.320 INFO:tasks.workunit.client.0.smithi044.stdout:2/94: sync 2024-04-25T22:03:17.320 INFO:tasks.workunit.client.0.smithi044.stdout:4/29: sync 2024-04-25T22:03:17.320 INFO:tasks.workunit.client.0.smithi044.stdout:6/108: sync 2024-04-25T22:03:17.320 INFO:tasks.workunit.client.0.smithi044.stdout:1/41: sync 2024-04-25T22:03:17.320 INFO:tasks.workunit.client.0.smithi044.stdout:3/46: sync 2024-04-25T22:03:17.320 INFO:tasks.workunit.client.0.smithi044.stdout:9/80: sync 2024-04-25T22:03:17.321 INFO:tasks.workunit.client.0.smithi044.stdout:1/42: mkdir d3/d7 0 2024-04-25T22:03:17.322 INFO:tasks.workunit.client.0.smithi044.stdout:3/47: mkdir d0/d13 0 2024-04-25T22:03:17.322 INFO:tasks.workunit.client.0.smithi044.stdout:4/30: write fa [31659,89192] 0 2024-04-25T22:03:17.322 INFO:tasks.workunit.client.0.smithi044.stdout:5/27: creat d2/d5/f9 x:0 0 0 2024-04-25T22:03:17.323 INFO:tasks.workunit.client.0.smithi044.stdout:1/43: rmdir d3 39 2024-04-25T22:03:17.323 INFO:tasks.workunit.client.0.smithi044.stdout:6/109: write d2/d8/f1c [1054923,112526] 0 2024-04-25T22:03:17.323 INFO:tasks.workunit.client.0.smithi044.stdout:9/81: rename d4/f15 to d4/f1c 0 2024-04-25T22:03:17.324 INFO:tasks.workunit.client.0.smithi044.stdout:6/110: readlink d2/d8/d12/l25 0 2024-04-25T22:03:17.325 INFO:tasks.workunit.client.0.smithi044.stdout:9/82: truncate d4/f13 608327 0 2024-04-25T22:03:17.325 INFO:tasks.workunit.client.0.smithi044.stdout:1/44: creat d3/d7/f8 x:0 0 0 2024-04-25T22:03:17.326 INFO:tasks.workunit.client.0.smithi044.stdout:1/45: mknod d3/d7/c9 0 2024-04-25T22:03:17.327 INFO:tasks.workunit.client.0.smithi044.stdout:7/34: dread f6 [0,4194304] 0 2024-04-25T22:03:17.327 INFO:tasks.workunit.client.0.smithi044.stdout:0/40: truncate f1 1813816 0 2024-04-25T22:03:17.327 INFO:tasks.workunit.client.0.smithi044.stdout:1/46: write d3/f4 [2390520,6601] 0 2024-04-25T22:03:17.328 INFO:tasks.workunit.client.0.smithi044.stdout:0/41: fsync f3 0 2024-04-25T22:03:17.329 INFO:tasks.workunit.client.0.smithi044.stdout:8/172: getdents d2a/d32 0 2024-04-25T22:03:17.330 INFO:tasks.workunit.client.0.smithi044.stdout:0/42: truncate f0 1136492 0 2024-04-25T22:03:17.332 INFO:tasks.workunit.client.0.smithi044.stdout:0/43: mknod d8/da/ce 0 2024-04-25T22:03:17.332 INFO:tasks.workunit.client.0.smithi044.stdout:9/83: dread d4/f1c [0,4194304] 0 2024-04-25T22:03:17.332 INFO:tasks.workunit.client.0.smithi044.stdout:4/31: truncate f4 6785242 0 2024-04-25T22:03:17.333 INFO:tasks.workunit.client.0.smithi044.stdout:3/48: truncate d0/d2/f3 2420587 0 2024-04-25T22:03:17.335 INFO:tasks.workunit.client.0.smithi044.stdout:2/95: sync 2024-04-25T22:03:17.335 INFO:tasks.workunit.client.0.smithi044.stdout:5/28: sync 2024-04-25T22:03:17.335 INFO:tasks.workunit.client.0.smithi044.stdout:8/173: sync 2024-04-25T22:03:17.336 INFO:tasks.workunit.client.0.smithi044.stdout:3/49: symlink d0/d1/da/df/d12/dd/l14 0 2024-04-25T22:03:17.336 INFO:tasks.workunit.client.0.smithi044.stdout:6/111: dwrite d2/d8/f1b [4194304,4194304] 0 2024-04-25T22:03:17.336 INFO:tasks.workunit.client.0.smithi044.stdout:7/35: dread f0 [0,4194304] 0 2024-04-25T22:03:17.337 INFO:tasks.workunit.client.0.smithi044.stdout:3/50: chown d0/d13 3 1 2024-04-25T22:03:17.339 INFO:tasks.workunit.client.0.smithi044.stdout:2/96: fdatasync d7/f11 0 2024-04-25T22:03:17.339 INFO:tasks.workunit.client.0.smithi044.stdout:8/174: creat d2a/d32/f35 x:0 0 0 2024-04-25T22:03:17.340 INFO:tasks.workunit.client.0.smithi044.stdout:9/84: link d4/d7/l14 d4/l1d 0 2024-04-25T22:03:17.340 INFO:tasks.workunit.client.0.smithi044.stdout:5/29: truncate f0 223331 0 2024-04-25T22:03:17.340 INFO:tasks.workunit.client.0.smithi044.stdout:1/47: dwrite d3/d7/f8 [0,4194304] 0 2024-04-25T22:03:17.340 INFO:tasks.workunit.client.0.smithi044.stdout:6/112: creat d2/d23/f28 x:0 0 0 2024-04-25T22:03:17.341 INFO:tasks.workunit.client.0.smithi044.stdout:6/113: sync 2024-04-25T22:03:17.344 INFO:tasks.workunit.client.0.smithi044.stdout:8/175: creat d2a/f36 x:0 0 0 2024-04-25T22:03:17.344 INFO:tasks.workunit.client.0.smithi044.stdout:8/176: sync 2024-04-25T22:03:17.345 INFO:tasks.workunit.client.0.smithi044.stdout:2/97: creat d7/f1b x:0 0 0 2024-04-25T22:03:17.345 INFO:tasks.workunit.client.0.smithi044.stdout:0/44: dwrite f3 [0,4194304] 0 2024-04-25T22:03:17.346 INFO:tasks.workunit.client.0.smithi044.stdout:8/177: mknod d2a/c37 0 2024-04-25T22:03:17.347 INFO:tasks.workunit.client.0.smithi044.stdout:0/45: stat f0 0 2024-04-25T22:03:17.347 INFO:tasks.workunit.client.0.smithi044.stdout:0/46: fsync d8/da/fd 0 2024-04-25T22:03:17.347 INFO:tasks.workunit.client.0.smithi044.stdout:8/178: chown f23 102 1 2024-04-25T22:03:17.348 INFO:tasks.workunit.client.0.smithi044.stdout:8/179: chown f6 119 1 2024-04-25T22:03:17.348 INFO:tasks.workunit.client.0.smithi044.stdout:0/47: mkdir d8/df 0 2024-04-25T22:03:17.348 INFO:tasks.workunit.client.0.smithi044.stdout:1/48: dread d3/f5 [0,4194304] 0 2024-04-25T22:03:17.349 INFO:tasks.workunit.client.0.smithi044.stdout:9/85: dread d4/ff [0,4194304] 0 2024-04-25T22:03:17.350 INFO:tasks.workunit.client.0.smithi044.stdout:1/49: fdatasync d3/f5 0 2024-04-25T22:03:17.350 INFO:tasks.workunit.client.0.smithi044.stdout:7/36: dwrite f6 [0,4194304] 0 2024-04-25T22:03:17.351 INFO:tasks.workunit.client.0.smithi044.stdout:0/48: creat d8/df/f10 x:0 0 0 2024-04-25T22:03:17.352 INFO:tasks.workunit.client.0.smithi044.stdout:1/50: chown d3/d7/f8 133013381 1 2024-04-25T22:03:17.353 INFO:tasks.workunit.client.0.smithi044.stdout:7/37: write f0 [1387080,34375] 0 2024-04-25T22:03:17.353 INFO:tasks.workunit.client.0.smithi044.stdout:0/49: creat d8/f11 x:0 0 0 2024-04-25T22:03:17.353 INFO:tasks.workunit.client.0.smithi044.stdout:7/38: sync 2024-04-25T22:03:17.353 INFO:tasks.workunit.client.0.smithi044.stdout:9/86: rename d4/l1d to d4/d7/l1e 0 2024-04-25T22:03:17.353 INFO:tasks.workunit.client.0.smithi044.stdout:7/39: sync 2024-04-25T22:03:17.354 INFO:tasks.workunit.client.0.smithi044.stdout:1/51: symlink d3/la 0 2024-04-25T22:03:17.354 INFO:tasks.workunit.client.0.smithi044.stdout:7/40: read f0 [1563468,53158] 0 2024-04-25T22:03:17.355 INFO:tasks.workunit.client.0.smithi044.stdout:0/50: read - d8/f11 zero size 2024-04-25T22:03:17.356 INFO:tasks.workunit.client.0.smithi044.stdout:4/32: write f4 [1436187,105010] 0 2024-04-25T22:03:17.356 INFO:tasks.workunit.client.0.smithi044.stdout:4/33: sync 2024-04-25T22:03:17.357 INFO:tasks.workunit.client.0.smithi044.stdout:2/98: dwrite d7/f11 [0,4194304] 0 2024-04-25T22:03:17.357 INFO:tasks.workunit.client.0.smithi044.stdout:3/51: write d0/f6 [3164164,63664] 0 2024-04-25T22:03:17.357 INFO:tasks.workunit.client.0.smithi044.stdout:7/41: chown c8 2 1 2024-04-25T22:03:17.358 INFO:tasks.workunit.client.0.smithi044.stdout:1/52: mkdir d3/d7/db 0 2024-04-25T22:03:17.358 INFO:tasks.workunit.client.0.smithi044.stdout:9/87: rename d4/f1c to d4/f1f 0 2024-04-25T22:03:17.360 INFO:tasks.workunit.client.0.smithi044.stdout:1/53: symlink d3/lc 0 2024-04-25T22:03:17.360 INFO:tasks.workunit.client.0.smithi044.stdout:9/88: mknod d4/d7/c20 0 2024-04-25T22:03:17.360 INFO:tasks.workunit.client.0.smithi044.stdout:4/34: link dd/le dd/l10 0 2024-04-25T22:03:17.360 INFO:tasks.workunit.client.0.smithi044.stdout:3/52: rename d0/d1/da to d0/d1/d15 0 2024-04-25T22:03:17.360 INFO:tasks.workunit.client.0.smithi044.stdout:9/89: fdatasync d4/f1a 0 2024-04-25T22:03:17.361 INFO:tasks.workunit.client.0.smithi044.stdout:1/54: chown d3/d7/f8 7442 1 2024-04-25T22:03:17.361 INFO:tasks.workunit.client.0.smithi044.stdout:8/180: dwrite f2 [0,4194304] 0 2024-04-25T22:03:17.361 INFO:tasks.workunit.client.0.smithi044.stdout:4/35: creat dd/f11 x:0 0 0 2024-04-25T22:03:17.361 INFO:tasks.workunit.client.0.smithi044.stdout:3/53: chown d0/d2/c8 131 1 2024-04-25T22:03:17.364 INFO:tasks.workunit.client.0.smithi044.stdout:9/90: write d4/d7/f8 [6967236,35386] 0 2024-04-25T22:03:17.364 INFO:tasks.workunit.client.0.smithi044.stdout:4/36: readlink l3 0 2024-04-25T22:03:17.365 INFO:tasks.workunit.client.0.smithi044.stdout:2/99: read d7/d16/f17 [60095,8698] 0 2024-04-25T22:03:17.365 INFO:tasks.workunit.client.0.smithi044.stdout:3/54: symlink d0/d1/d15/df/l16 0 2024-04-25T22:03:17.367 INFO:tasks.workunit.client.0.smithi044.stdout:4/37: link l8 dd/l12 0 2024-04-25T22:03:17.367 INFO:tasks.workunit.client.0.smithi044.stdout:2/100: chown f6 3 1 2024-04-25T22:03:17.368 INFO:tasks.workunit.client.0.smithi044.stdout:6/114: dread d2/d8/d12/d1d/f24 [0,4194304] 0 2024-04-25T22:03:17.368 INFO:tasks.workunit.client.0.smithi044.stdout:8/181: getdents d2a/d32 0 2024-04-25T22:03:17.369 INFO:tasks.workunit.client.0.smithi044.stdout:4/38: symlink dd/l13 0 2024-04-25T22:03:17.370 INFO:tasks.workunit.client.0.smithi044.stdout:8/182: rename l13 to d2a/d32/l38 0 2024-04-25T22:03:17.375 INFO:tasks.workunit.client.0.smithi044.stdout:6/115: write d2/d23/f28 [538482,15362] 0 2024-04-25T22:03:17.375 INFO:tasks.workunit.client.0.smithi044.stdout:8/183: readlink l14 0 2024-04-25T22:03:17.375 INFO:tasks.workunit.client.0.smithi044.stdout:4/39: mknod dd/c14 0 2024-04-25T22:03:17.375 INFO:tasks.workunit.client.0.smithi044.stdout:3/55: getdents d0/d1/d15/df/d12 0 2024-04-25T22:03:17.375 INFO:tasks.workunit.client.0.smithi044.stdout:8/184: mkdir d2a/d39 0 2024-04-25T22:03:17.375 INFO:tasks.workunit.client.0.smithi044.stdout:7/42: dwrite f5 [0,4194304] 0 2024-04-25T22:03:17.375 INFO:tasks.workunit.client.0.smithi044.stdout:8/185: readlink l29 0 2024-04-25T22:03:17.376 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:17.368+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:17.376 INFO:tasks.workunit.client.0.smithi044.stdout:1/55: dwrite d3/d7/f8 [0,4194304] 0 2024-04-25T22:03:17.376 INFO:tasks.workunit.client.0.smithi044.stdout:9/91: dread d4/f1f [0,4194304] 0 2024-04-25T22:03:17.377 INFO:tasks.workunit.client.0.smithi044.stdout:2/101: dread f0 [0,4194304] 0 2024-04-25T22:03:17.378 INFO:tasks.workunit.client.0.smithi044.stdout:9/92: truncate d4/f13 1465524 0 2024-04-25T22:03:17.380 INFO:tasks.workunit.client.0.smithi044.stdout:1/56: link c1 d3/d7/db/cd 0 2024-04-25T22:03:17.382 INFO:tasks.workunit.client.0.smithi044.stdout:9/93: mknod d4/d7/d18/c21 0 2024-04-25T22:03:17.382 INFO:tasks.workunit.client.0.smithi044.stdout:2/102: getdents d7 0 2024-04-25T22:03:17.382 INFO:tasks.workunit.client.0.smithi044.stdout:6/116: dread d2/d8/d12/f19 [0,4194304] 0 2024-04-25T22:03:17.383 INFO:tasks.workunit.client.0.smithi044.stdout:1/57: fdatasync d3/f5 0 2024-04-25T22:03:17.384 INFO:tasks.workunit.client.0.smithi044.stdout:9/94: mkdir d4/d7/d22 0 2024-04-25T22:03:17.385 INFO:tasks.workunit.client.0.smithi044.stdout:6/117: unlink d2/c6 0 2024-04-25T22:03:17.386 INFO:tasks.workunit.client.0.smithi044.stdout:1/58: creat d3/fe x:0 0 0 2024-04-25T22:03:17.387 INFO:tasks.workunit.client.0.smithi044.stdout:1/59: stat d3 0 2024-04-25T22:03:17.387 INFO:tasks.workunit.client.0.smithi044.stdout:3/56: dwrite d0/f6 [0,4194304] 0 2024-04-25T22:03:17.388 INFO:tasks.workunit.client.0.smithi044.stdout:6/118: symlink d2/l29 0 2024-04-25T22:03:17.389 INFO:tasks.workunit.client.0.smithi044.stdout:2/103: getdents d7/d8/db 0 2024-04-25T22:03:17.389 INFO:tasks.workunit.client.0.smithi044.stdout:4/40: dwrite fa [0,4194304] 0 2024-04-25T22:03:17.389 INFO:tasks.workunit.client.0.smithi044.stdout:9/95: rename d4/f13 to d4/f23 0 2024-04-25T22:03:17.390 INFO:tasks.workunit.client.0.smithi044.stdout:8/186: dwrite fd [0,4194304] 0 2024-04-25T22:03:17.391 INFO:tasks.workunit.client.0.smithi044.stdout:3/57: truncate d0/f6 5005603 0 2024-04-25T22:03:17.391 INFO:tasks.workunit.client.0.smithi044.stdout:9/96: chown d4/f1a 32517334 1 2024-04-25T22:03:17.391 INFO:tasks.workunit.client.0.smithi044.stdout:6/119: fdatasync d2/d8/d12/d1d/f24 0 2024-04-25T22:03:17.391 INFO:tasks.workunit.client.0.smithi044.stdout:3/58: sync 2024-04-25T22:03:17.392 INFO:tasks.workunit.client.0.smithi044.stdout:2/104: getdents d7 0 2024-04-25T22:03:17.392 INFO:tasks.workunit.client.0.smithi044.stdout:8/187: creat d2a/d39/f3a x:0 0 0 2024-04-25T22:03:17.393 INFO:tasks.workunit.client.0.smithi044.stdout:3/59: write d0/d2/f10 [679302,67358] 0 2024-04-25T22:03:17.394 INFO:tasks.workunit.client.0.smithi044.stdout:6/120: mkdir d2/d8/d11/d2a 0 2024-04-25T22:03:17.395 INFO:tasks.workunit.client.0.smithi044.stdout:2/105: chown d7/d8 0 1 2024-04-25T22:03:17.395 INFO:tasks.workunit.client.0.smithi044.stdout:3/60: write d0/d2/f10 [757915,59126] 0 2024-04-25T22:03:17.396 INFO:tasks.workunit.client.0.smithi044.stdout:2/106: chown d7/d8 72435998 1 2024-04-25T22:03:17.396 INFO:tasks.workunit.client.0.smithi044.stdout:6/121: symlink d2/d8/l2b 0 2024-04-25T22:03:17.397 INFO:tasks.workunit.client.0.smithi044.stdout:3/61: fsync d0/d1/fe 0 2024-04-25T22:03:17.398 INFO:tasks.workunit.client.0.smithi044.stdout:6/122: mknod d2/d23/c2c 0 2024-04-25T22:03:17.398 INFO:tasks.workunit.client.0.smithi044.stdout:4/41: dread fa [0,4194304] 0 2024-04-25T22:03:17.398 INFO:tasks.workunit.client.0.smithi044.stdout:1/60: dwrite d3/f5 [0,4194304] 0 2024-04-25T22:03:17.399 INFO:tasks.workunit.client.0.smithi044.stdout:1/61: readlink d3/lc 0 2024-04-25T22:03:17.399 INFO:tasks.workunit.client.0.smithi044.stdout:3/62: symlink d0/l17 0 2024-04-25T22:03:17.399 INFO:tasks.workunit.client.0.smithi044.stdout:9/97: dread d4/f1f [0,4194304] 0 2024-04-25T22:03:17.400 INFO:tasks.workunit.client.0.smithi044.stdout:9/98: chown d4/f23 18302 1 2024-04-25T22:03:17.400 INFO:tasks.workunit.client.0.smithi044.stdout:6/123: fsync d2/d8/d11/f21 0 2024-04-25T22:03:17.401 INFO:tasks.workunit.client.0.smithi044.stdout:3/63: mknod d0/d1/d15/df/c18 0 2024-04-25T22:03:17.401 INFO:tasks.workunit.client.0.smithi044.stdout:8/188: dread f2 [0,4194304] 0 2024-04-25T22:03:17.401 INFO:tasks.workunit.client.0.smithi044.stdout:1/62: rename d3/f4 to d3/d7/db/ff 0 2024-04-25T22:03:17.402 INFO:tasks.workunit.client.0.smithi044.stdout:3/64: fsync d0/d1/fe 0 2024-04-25T22:03:17.402 INFO:tasks.workunit.client.0.smithi044.stdout:6/124: creat d2/d8/d12/d27/f2d x:0 0 0 2024-04-25T22:03:17.402 INFO:tasks.workunit.client.0.smithi044.stdout:9/99: rename d4/d7/d18/c1b to d4/d7/c24 0 2024-04-25T22:03:17.403 INFO:tasks.workunit.client.0.smithi044.stdout:1/63: creat d3/d7/f10 x:0 0 0 2024-04-25T22:03:17.404 INFO:tasks.workunit.client.0.smithi044.stdout:2/107: dread f0 [0,4194304] 0 2024-04-25T22:03:17.404 INFO:tasks.workunit.client.0.smithi044.stdout:9/100: chown d4/f1a 1677339 1 2024-04-25T22:03:17.404 INFO:tasks.workunit.client.0.smithi044.stdout:2/108: chown d7 2415 1 2024-04-25T22:03:17.404 INFO:tasks.workunit.client.0.smithi044.stdout:6/125: write d2/d8/d12/d1f/f20 [892829,97630] 0 2024-04-25T22:03:17.406 INFO:tasks.workunit.client.0.smithi044.stdout:2/109: chown d7/d8/ce 3696 1 2024-04-25T22:03:17.407 INFO:tasks.workunit.client.0.smithi044.stdout:0/51: write f0 [446235,81558] 0 2024-04-25T22:03:17.410 INFO:tasks.workunit.client.0.smithi044.stdout:4/42: dwrite fc [0,4194304] 0 2024-04-25T22:03:17.413 INFO:tasks.workunit.client.0.smithi044.stdout:2/110: mkdir d7/d8/d1c 0 2024-04-25T22:03:17.414 INFO:tasks.workunit.client.0.smithi044.stdout:0/52: symlink d8/da/l12 0 2024-04-25T22:03:17.414 INFO:tasks.workunit.client.0.smithi044.stdout:4/43: rename l3 to dd/l15 0 2024-04-25T22:03:17.415 INFO:tasks.workunit.client.0.smithi044.stdout:2/111: chown f6 15130 1 2024-04-25T22:03:17.416 INFO:tasks.workunit.client.0.smithi044.stdout:7/43: truncate f6 4027406 0 2024-04-25T22:03:17.417 INFO:tasks.workunit.client.0.smithi044.stdout:8/189: readlink d2a/d32/l38 0 2024-04-25T22:03:17.420 INFO:tasks.workunit.client.0.smithi044.stdout:5/30: dwrite f0 [0,4194304] 0 2024-04-25T22:03:17.420 INFO:tasks.workunit.client.0.smithi044.stdout:3/65: dwrite d0/d2/f10 [0,4194304] 0 2024-04-25T22:03:17.422 INFO:tasks.workunit.client.0.smithi044.stdout:5/31: stat d2/l8 0 2024-04-25T22:03:17.422 INFO:tasks.workunit.client.0.smithi044.stdout:4/44: symlink dd/l16 0 2024-04-25T22:03:17.422 INFO:tasks.workunit.client.0.smithi044.stdout:6/126: dread d2/d8/d11/f16 [0,4194304] 0 2024-04-25T22:03:17.422 INFO:tasks.workunit.client.0.smithi044.stdout:9/101: dwrite f3 [4194304,4194304] 0 2024-04-25T22:03:17.424 INFO:tasks.workunit.client.0.smithi044.stdout:6/127: readlink d2/l29 0 2024-04-25T22:03:17.424 INFO:tasks.workunit.client.0.smithi044.stdout:1/64: dwrite d3/fe [0,4194304] 0 2024-04-25T22:03:17.424 INFO:tasks.workunit.client.0.smithi044.stdout:2/112: rename c2 to d7/d8/db/c1d 0 2024-04-25T22:03:17.425 INFO:tasks.workunit.client.0.smithi044.stdout:3/66: symlink d0/d1/d15/df/d12/l19 0 2024-04-25T22:03:17.425 INFO:tasks.workunit.client.0.smithi044.stdout:9/102: stat d4/d7/l9 0 2024-04-25T22:03:17.425 INFO:tasks.workunit.client.0.smithi044.stdout:5/32: mknod d2/ca 0 2024-04-25T22:03:17.426 INFO:tasks.workunit.client.0.smithi044.stdout:4/45: creat dd/f17 x:0 0 0 2024-04-25T22:03:17.426 INFO:tasks.workunit.client.0.smithi044.stdout:6/128: symlink d2/d23/l2e 0 2024-04-25T22:03:17.426 INFO:tasks.workunit.client.0.smithi044.stdout:9/103: symlink d4/d7/l25 0 2024-04-25T22:03:17.428 INFO:tasks.workunit.client.0.smithi044.stdout:4/46: symlink dd/l18 0 2024-04-25T22:03:17.428 INFO:tasks.workunit.client.0.smithi044.stdout:2/113: dread f6 [0,4194304] 0 2024-04-25T22:03:17.428 INFO:tasks.workunit.client.0.smithi044.stdout:9/104: chown d4/d7 135873114 1 2024-04-25T22:03:17.428 INFO:tasks.workunit.client.0.smithi044.stdout:5/33: chown d2 1846038 1 2024-04-25T22:03:17.429 INFO:tasks.workunit.client.0.smithi044.stdout:0/53: dwrite f3 [0,4194304] 0 2024-04-25T22:03:17.429 INFO:tasks.workunit.client.0.smithi044.stdout:5/34: chown d2 3151374 1 2024-04-25T22:03:17.429 INFO:tasks.workunit.client.0.smithi044.stdout:6/129: dread - d2/d8/d12/d27/f2d zero size 2024-04-25T22:03:17.429 INFO:tasks.workunit.client.0.smithi044.stdout:0/54: read - d8/f11 zero size 2024-04-25T22:03:17.429 INFO:tasks.workunit.client.0.smithi044.stdout:4/47: mkdir dd/d19 0 2024-04-25T22:03:17.430 INFO:tasks.workunit.client.0.smithi044.stdout:2/114: mknod d7/c1e 0 2024-04-25T22:03:17.430 INFO:tasks.workunit.client.0.smithi044.stdout:9/105: chown d4/d7/l1e 130 1 2024-04-25T22:03:17.430 INFO:tasks.workunit.client.0.smithi044.stdout:6/130: chown d2/d8/f1c 1099118 1 2024-04-25T22:03:17.431 INFO:tasks.workunit.client.0.smithi044.stdout:0/55: truncate f0 1932459 0 2024-04-25T22:03:17.431 INFO:tasks.workunit.client.0.smithi044.stdout:2/115: fsync f0 0 2024-04-25T22:03:17.431 INFO:tasks.workunit.client.0.smithi044.stdout:5/35: rename c1 to d2/d5/cb 0 2024-04-25T22:03:17.431 INFO:tasks.workunit.client.0.smithi044.stdout:9/106: readlink d4/d7/l19 0 2024-04-25T22:03:17.431 INFO:tasks.workunit.client.0.smithi044.stdout:4/48: dread - dd/ff zero size 2024-04-25T22:03:17.432 INFO:tasks.workunit.client.0.smithi044.stdout:3/67: write d0/d2/f10 [4468501,35268] 0 2024-04-25T22:03:17.432 INFO:tasks.workunit.client.0.smithi044.stdout:5/36: symlink d2/d5/lc 0 2024-04-25T22:03:17.434 INFO:tasks.workunit.client.0.smithi044.stdout:2/116: truncate f0 2207312 0 2024-04-25T22:03:17.434 INFO:tasks.workunit.client.0.smithi044.stdout:4/49: chown fa 2410024 1 2024-04-25T22:03:17.434 INFO:tasks.workunit.client.0.smithi044.stdout:6/131: truncate d2/d8/d12/d27/f2d 901973 0 2024-04-25T22:03:17.434 INFO:tasks.workunit.client.0.smithi044.stdout:0/56: truncate d8/df/f10 739031 0 2024-04-25T22:03:17.434 INFO:tasks.workunit.client.0.smithi044.stdout:5/37: mknod d2/d5/cd 0 2024-04-25T22:03:17.435 INFO:tasks.workunit.client.0.smithi044.stdout:5/38: sync 2024-04-25T22:03:17.435 INFO:tasks.workunit.client.0.smithi044.stdout:9/107: rename d4/d7/d18/c21 to d4/d7/d18/c26 0 2024-04-25T22:03:17.435 INFO:tasks.workunit.client.0.smithi044.stdout:3/68: chown d0/d1/d15 1865 1 2024-04-25T22:03:17.436 INFO:tasks.workunit.client.0.smithi044.stdout:6/132: rmdir d2/d23 39 2024-04-25T22:03:17.436 INFO:tasks.workunit.client.0.smithi044.stdout:1/65: dwrite d3/d7/f10 [0,4194304] 0 2024-04-25T22:03:17.436 INFO:tasks.workunit.client.0.smithi044.stdout:2/117: mknod d7/c1f 0 2024-04-25T22:03:17.436 INFO:tasks.workunit.client.0.smithi044.stdout:2/118: sync 2024-04-25T22:03:17.436 INFO:tasks.workunit.client.0.smithi044.stdout:5/39: creat d2/d5/fe x:0 0 0 2024-04-25T22:03:17.436 INFO:tasks.workunit.client.0.smithi044.stdout:4/50: mknod dd/d19/c1a 0 2024-04-25T22:03:17.437 INFO:tasks.workunit.client.0.smithi044.stdout:9/108: symlink d4/d7/d22/l27 0 2024-04-25T22:03:17.437 INFO:tasks.workunit.client.0.smithi044.stdout:4/51: stat cb 0 2024-04-25T22:03:17.437 INFO:tasks.workunit.client.0.smithi044.stdout:5/40: rmdir d2 39 2024-04-25T22:03:17.438 INFO:tasks.workunit.client.0.smithi044.stdout:6/133: read d2/d8/f1c [743853,130584] 0 2024-04-25T22:03:17.438 INFO:tasks.workunit.client.0.smithi044.stdout:1/66: write d3/d7/db/ff [3854069,122815] 0 2024-04-25T22:03:17.439 INFO:tasks.workunit.client.0.smithi044.stdout:4/52: truncate dd/f17 109791 0 2024-04-25T22:03:17.440 INFO:tasks.workunit.client.0.smithi044.stdout:9/109: chown d4/l6 1717 1 2024-04-25T22:03:17.441 INFO:tasks.workunit.client.0.smithi044.stdout:4/53: creat dd/f1b x:0 0 0 2024-04-25T22:03:17.441 INFO:tasks.workunit.client.0.smithi044.stdout:6/134: rename d2/d8/d11/c17 to d2/d23/c2f 0 2024-04-25T22:03:17.442 INFO:tasks.workunit.client.0.smithi044.stdout:1/67: getdents d3/d7/db 0 2024-04-25T22:03:17.442 INFO:tasks.workunit.client.0.smithi044.stdout:4/54: read fa [3435147,62540] 0 2024-04-25T22:03:17.444 INFO:tasks.workunit.client.0.smithi044.stdout:1/68: symlink d3/d7/db/l11 0 2024-04-25T22:03:17.445 INFO:tasks.workunit.client.0.smithi044.stdout:0/57: dread f0 [0,4194304] 0 2024-04-25T22:03:17.445 INFO:tasks.workunit.client.0.smithi044.stdout:3/69: dread d0/d2/f3 [0,4194304] 0 2024-04-25T22:03:17.445 INFO:tasks.workunit.client.0.smithi044.stdout:6/135: chown d2/d8/d13/c1a 13508 1 2024-04-25T22:03:17.445 INFO:tasks.workunit.client.0.smithi044.stdout:1/69: mkdir d3/d12 0 2024-04-25T22:03:17.446 INFO:tasks.workunit.client.0.smithi044.stdout:4/55: chown dd/f11 20350 1 2024-04-25T22:03:17.446 INFO:tasks.workunit.client.0.smithi044.stdout:5/41: truncate f0 278705 0 2024-04-25T22:03:17.447 INFO:tasks.workunit.client.0.smithi044.stdout:6/136: mkdir d2/d23/d30 0 2024-04-25T22:03:17.447 INFO:tasks.workunit.client.0.smithi044.stdout:1/70: symlink d3/d7/l13 0 2024-04-25T22:03:17.448 INFO:tasks.workunit.client.0.smithi044.stdout:3/70: symlink d0/d1/d15/l1a 0 2024-04-25T22:03:17.448 INFO:tasks.workunit.client.0.smithi044.stdout:4/56: creat dd/f1c x:0 0 0 2024-04-25T22:03:17.448 INFO:tasks.workunit.client.0.smithi044.stdout:6/137: chown d2/d8/d13 25365658 1 2024-04-25T22:03:17.449 INFO:tasks.workunit.client.0.smithi044.stdout:0/58: link d8/da/fd d8/da/f13 0 2024-04-25T22:03:17.450 INFO:tasks.workunit.client.0.smithi044.stdout:6/138: readlink d2/d8/d12/l25 0 2024-04-25T22:03:17.450 INFO:tasks.workunit.client.0.smithi044.stdout:5/42: fdatasync d2/f3 0 2024-04-25T22:03:17.450 INFO:tasks.workunit.client.0.smithi044.stdout:0/59: fsync d8/f11 0 2024-04-25T22:03:17.451 INFO:tasks.workunit.client.0.smithi044.stdout:4/57: chown dd/l18 432 1 2024-04-25T22:03:17.451 INFO:tasks.workunit.client.0.smithi044.stdout:2/119: dwrite d7/f15 [0,4194304] 0 2024-04-25T22:03:17.451 INFO:tasks.workunit.client.0.smithi044.stdout:3/71: mknod d0/d1/d15/df/c1b 0 2024-04-25T22:03:17.453 INFO:tasks.workunit.client.0.smithi044.stdout:9/110: dwrite d4/d7/fd [0,4194304] 0 2024-04-25T22:03:17.453 INFO:tasks.workunit.client.0.smithi044.stdout:4/58: creat dd/d19/f1d x:0 0 0 2024-04-25T22:03:17.453 INFO:tasks.workunit.client.0.smithi044.stdout:1/71: rename d3/d7/db/ff to d3/d7/db/f14 0 2024-04-25T22:03:17.453 INFO:tasks.workunit.client.0.smithi044.stdout:0/60: mknod d8/da/c14 0 2024-04-25T22:03:17.454 INFO:tasks.workunit.client.0.smithi044.stdout:1/72: unlink d3/lc 0 2024-04-25T22:03:17.454 INFO:tasks.workunit.client.0.smithi044.stdout:4/59: truncate dd/ff 574300 0 2024-04-25T22:03:17.454 INFO:tasks.workunit.client.0.smithi044.stdout:0/61: chown d8/f11 16 1 2024-04-25T22:03:17.455 INFO:tasks.workunit.client.0.smithi044.stdout:9/111: rmdir d4/d7 39 2024-04-25T22:03:17.455 INFO:tasks.workunit.client.0.smithi044.stdout:4/60: write dd/ff [1418362,116190] 0 2024-04-25T22:03:17.456 INFO:tasks.workunit.client.0.smithi044.stdout:5/43: truncate f0 695213 0 2024-04-25T22:03:17.456 INFO:tasks.workunit.client.0.smithi044.stdout:7/44: truncate f6 1956832 0 2024-04-25T22:03:17.458 INFO:tasks.workunit.client.0.smithi044.stdout:1/73: rename d3/fe to d3/d7/db/f15 0 2024-04-25T22:03:17.458 INFO:tasks.workunit.client.0.smithi044.stdout:3/72: dread d0/d2/f3 [0,4194304] 0 2024-04-25T22:03:17.458 INFO:tasks.workunit.client.0.smithi044.stdout:4/61: mknod dd/c1e 0 2024-04-25T22:03:17.458 INFO:tasks.workunit.client.0.smithi044.stdout:5/44: truncate d2/f3 4383344 0 2024-04-25T22:03:17.459 INFO:tasks.workunit.client.0.smithi044.stdout:7/45: chown l3 3751045 1 2024-04-25T22:03:17.459 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:17.459 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:17.459 INFO:tasks.workunit.client.0.smithi044.stdout:9/112: symlink d4/d7/d18/l28 0 2024-04-25T22:03:17.460 INFO:tasks.workunit.client.0.smithi044.stdout:3/73: chown d0/d1/fe 19643489 1 2024-04-25T22:03:17.460 INFO:tasks.workunit.client.0.smithi044.stdout:7/46: dread - f9 zero size 2024-04-25T22:03:17.460 INFO:tasks.workunit.client.0.smithi044.stdout:1/74: rename d3/d12 to d3/d7/d16 0 2024-04-25T22:03:17.461 INFO:tasks.workunit.client.0.smithi044.stdout:9/113: write d4/f1f [1855188,57692] 0 2024-04-25T22:03:17.462 INFO:tasks.workunit.client.0.smithi044.stdout:7/47: read f5 [1440930,129767] 0 2024-04-25T22:03:17.463 INFO:tasks.workunit.client.0.smithi044.stdout:3/74: mkdir d0/d13/d1c 0 2024-04-25T22:03:17.463 INFO:tasks.workunit.client.0.smithi044.stdout:6/139: dwrite d2/d8/d11/f16 [0,4194304] 0 2024-04-25T22:03:17.466 INFO:tasks.workunit.client.0.smithi044.stdout:6/140: chown d2/d8/d12/d27/f2d 5429 1 2024-04-25T22:03:17.469 INFO:tasks.workunit.client.0.smithi044.stdout:5/45: dread d2/f4 [0,4194304] 0 2024-04-25T22:03:17.469 INFO:tasks.workunit.client.0.smithi044.stdout:2/120: dwrite f0 [0,4194304] 0 2024-04-25T22:03:17.471 INFO:tasks.workunit.client.0.smithi044.stdout:6/141: creat d2/d8/d12/d27/f31 x:0 0 0 2024-04-25T22:03:17.472 INFO:tasks.workunit.client.0.smithi044.stdout:4/62: dwrite dd/f11 [0,4194304] 0 2024-04-25T22:03:17.473 INFO:tasks.workunit.client.0.smithi044.stdout:7/48: dread f5 [0,4194304] 0 2024-04-25T22:03:17.473 INFO:tasks.workunit.client.0.smithi044.stdout:5/46: dread - d2/d5/fe zero size 2024-04-25T22:03:17.475 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:17.472+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:17.476 INFO:tasks.workunit.client.0.smithi044.stdout:2/121: chown d7/d8/db/c10 70 1 2024-04-25T22:03:17.477 INFO:tasks.workunit.client.0.smithi044.stdout:4/63: symlink dd/d19/l1f 0 2024-04-25T22:03:17.477 INFO:tasks.workunit.client.0.smithi044.stdout:7/49: write f0 [5638284,51339] 0 2024-04-25T22:03:17.478 INFO:tasks.workunit.client.0.smithi044.stdout:5/47: mknod d2/d5/cf 0 2024-04-25T22:03:17.478 INFO:tasks.workunit.client.0.smithi044.stdout:9/114: dwrite d4/f1f [4194304,4194304] 0 2024-04-25T22:03:17.479 INFO:tasks.workunit.client.0.smithi044.stdout:3/75: dwrite d0/d2/f10 [0,4194304] 0 2024-04-25T22:03:17.479 INFO:tasks.workunit.client.0.smithi044.stdout:6/142: link d2/d8/f1b d2/d8/d12/d1d/f32 0 2024-04-25T22:03:17.479 INFO:tasks.workunit.client.0.smithi044.stdout:2/122: creat d7/d16/f20 x:0 0 0 2024-04-25T22:03:17.480 INFO:tasks.workunit.client.0.smithi044.stdout:4/64: mknod dd/d19/c20 0 2024-04-25T22:03:17.480 INFO:tasks.workunit.client.0.smithi044.stdout:3/76: readlink d0/d1/d15/l1a 0 2024-04-25T22:03:17.480 INFO:tasks.workunit.client.0.smithi044.stdout:9/115: creat d4/d7/f29 x:0 0 0 2024-04-25T22:03:17.480 INFO:tasks.workunit.client.0.smithi044.stdout:5/48: write d2/d5/f9 [159080,129490] 0 2024-04-25T22:03:17.482 INFO:tasks.workunit.client.0.smithi044.stdout:6/143: write d2/d8/d11/f21 [4928786,111928] 0 2024-04-25T22:03:17.482 INFO:tasks.workunit.client.0.smithi044.stdout:3/77: chown d0/d2/f10 467563 1 2024-04-25T22:03:17.483 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:17.484 INFO:tasks.workunit.client.0.smithi044.stdout:5/49: unlink d2/f3 0 2024-04-25T22:03:17.484 INFO:tasks.workunit.client.0.smithi044.stdout:9/116: mknod d4/c2a 0 2024-04-25T22:03:17.485 INFO:tasks.workunit.client.0.smithi044.stdout:3/78: rename d0/d2/c7 to d0/d1/d15/c1d 0 2024-04-25T22:03:17.485 INFO:tasks.workunit.client.0.smithi044.stdout:6/144: mknod d2/d8/d12/c33 0 2024-04-25T22:03:17.485 INFO:tasks.workunit.client.0.smithi044.stdout:9/117: creat d4/f2b x:0 0 0 2024-04-25T22:03:17.488 INFO:tasks.workunit.client.0.smithi044.stdout:1/75: rmdir d3/d7/d16 0 2024-04-25T22:03:17.488 INFO:tasks.workunit.client.0.smithi044.stdout:9/118: unlink d4/d7/f29 0 2024-04-25T22:03:17.491 INFO:tasks.workunit.client.0.smithi044.stdout:1/76: write d3/d7/f10 [301621,62383] 0 2024-04-25T22:03:17.491 INFO:tasks.workunit.client.0.smithi044.stdout:7/50: dwrite f0 [0,4194304] 0 2024-04-25T22:03:17.492 INFO:tasks.workunit.client.0.smithi044.stdout:9/119: rename d4/c16 to d4/d7/d18/c2c 0 2024-04-25T22:03:17.494 INFO:tasks.workunit.client.0.smithi044.stdout:1/77: write d3/f5 [4136214,14046] 0 2024-04-25T22:03:17.495 INFO:tasks.workunit.client.0.smithi044.stdout:2/123: dwrite d7/f15 [0,4194304] 0 2024-04-25T22:03:17.496 INFO:tasks.workunit.client.0.smithi044.stdout:8/190: fdatasync f2 0 2024-04-25T22:03:17.496 INFO:tasks.workunit.client.0.smithi044.stdout:9/120: write d4/ff [4578586,66948] 0 2024-04-25T22:03:17.496 INFO:tasks.workunit.client.0.smithi044.stdout:0/62: dwrite d8/da/fd [0,4194304] 0 2024-04-25T22:03:17.497 INFO:tasks.workunit.client.0.smithi044.stdout:8/191: write f6 [5212415,105317] 0 2024-04-25T22:03:17.497 INFO:tasks.workunit.client.0.smithi044.stdout:0/63: chown d8/da/l12 129334074 1 2024-04-25T22:03:17.498 INFO:tasks.workunit.client.0.smithi044.stdout:1/78: rename d3/f5 to d3/d7/f17 0 2024-04-25T22:03:17.498 INFO:tasks.workunit.client.0.smithi044.stdout:8/192: rmdir d2a/d39 39 2024-04-25T22:03:17.499 INFO:tasks.workunit.client.0.smithi044.stdout:0/64: mkdir d8/d15 0 2024-04-25T22:03:17.499 INFO:tasks.workunit.client.0.smithi044.stdout:2/124: getdents d7/d8 0 2024-04-25T22:03:17.499 INFO:tasks.workunit.client.0.smithi044.stdout:1/79: unlink d3/d7/db/f14 0 2024-04-25T22:03:17.500 INFO:tasks.workunit.client.0.smithi044.stdout:6/145: dwrite d2/d8/d12/d1f/f20 [0,4194304] 0 2024-04-25T22:03:17.501 INFO:tasks.workunit.client.0.smithi044.stdout:1/80: symlink d3/d7/l18 0 2024-04-25T22:03:17.501 INFO:tasks.workunit.client.0.smithi044.stdout:0/65: getdents d8/d15 0 2024-04-25T22:03:17.501 INFO:tasks.workunit.client.0.smithi044.stdout:2/125: creat d7/d8/d1c/f21 x:0 0 0 2024-04-25T22:03:17.501 INFO:tasks.workunit.client.0.smithi044.stdout:6/146: unlink d2/d23/c2c 0 2024-04-25T22:03:17.504 INFO:tasks.workunit.client.0.smithi044.stdout:6/147: rename d2/d8/d12/d1f to d2/d8/d12/d1f/d34 22 2024-04-25T22:03:17.504 INFO:tasks.workunit.client.0.smithi044.stdout:8/193: dread d2a/d32/f34 [0,4194304] 0 2024-04-25T22:03:17.504 INFO:tasks.workunit.client.0.smithi044.stdout:6/148: chown d2/d23 791674194 1 2024-04-25T22:03:17.505 INFO:tasks.workunit.client.0.smithi044.stdout:8/194: write f24 [155472,101005] 0 2024-04-25T22:03:17.506 INFO:tasks.workunit.client.0.smithi044.stdout:0/66: dread f6 [0,4194304] 0 2024-04-25T22:03:17.506 INFO:tasks.workunit.client.0.smithi044.stdout:6/149: mknod d2/d8/d12/d1d/c35 0 2024-04-25T22:03:17.507 INFO:tasks.workunit.client.0.smithi044.stdout:6/150: fdatasync d2/d23/f28 0 2024-04-25T22:03:17.509 INFO:tasks.workunit.client.0.smithi044.stdout:2/126: dwrite d7/f11 [0,4194304] 0 2024-04-25T22:03:17.512 INFO:tasks.workunit.client.0.smithi044.stdout:0/67: dread d8/da/fd [0,4194304] 0 2024-04-25T22:03:17.513 INFO:tasks.workunit.client.0.smithi044.stdout:0/68: read f6 [3447367,82005] 0 2024-04-25T22:03:17.513 INFO:tasks.workunit.client.0.smithi044.stdout:6/151: dread d2/d8/d12/d1d/f32 [4194304,4194304] 0 2024-04-25T22:03:17.514 INFO:tasks.workunit.client.0.smithi044.stdout:0/69: link f6 d8/d15/f16 0 2024-04-25T22:03:17.514 INFO:tasks.workunit.client.0.smithi044.stdout:6/152: chown d2/d8/c15 159436 1 2024-04-25T22:03:17.514 INFO:tasks.workunit.client.0.smithi044.stdout:8/195: dwrite f17 [0,4194304] 0 2024-04-25T22:03:17.515 INFO:tasks.workunit.client.0.smithi044.stdout:0/70: mkdir d8/df/d17 0 2024-04-25T22:03:17.515 INFO:tasks.workunit.client.0.smithi044.stdout:8/196: chown d2a/d32/f33 1780 1 2024-04-25T22:03:17.516 INFO:tasks.workunit.client.0.smithi044.stdout:6/153: unlink d2/d8/f1c 0 2024-04-25T22:03:17.516 INFO:tasks.workunit.client.0.smithi044.stdout:8/197: unlink f28 0 2024-04-25T22:03:17.516 INFO:tasks.workunit.client.0.smithi044.stdout:0/71: rename d8/d15/f16 to d8/f18 0 2024-04-25T22:03:17.517 INFO:tasks.workunit.client.0.smithi044.stdout:8/198: fdatasync d2a/d32/f35 0 2024-04-25T22:03:17.517 INFO:tasks.workunit.client.0.smithi044.stdout:0/72: fsync f1 0 2024-04-25T22:03:17.517 INFO:tasks.workunit.client.0.smithi044.stdout:8/199: dread - d2a/d39/f3a zero size 2024-04-25T22:03:17.519 INFO:tasks.workunit.client.0.smithi044.stdout:8/200: chown d2a/d32/l38 7313 1 2024-04-25T22:03:17.519 INFO:tasks.workunit.client.0.smithi044.stdout:8/201: write d2a/f2e [214745,94421] 0 2024-04-25T22:03:17.520 INFO:tasks.workunit.client.0.smithi044.stdout:8/202: link f24 d2a/d32/f3b 0 2024-04-25T22:03:17.521 INFO:tasks.workunit.client.0.smithi044.stdout:8/203: link d2a/d39/f3a d2a/f3c 0 2024-04-25T22:03:17.522 INFO:tasks.workunit.client.0.smithi044.stdout:8/204: write f1f [709774,108371] 0 2024-04-25T22:03:17.523 INFO:tasks.workunit.client.0.smithi044.stdout:8/205: stat d2a/f31 0 2024-04-25T22:03:17.525 INFO:tasks.workunit.client.0.smithi044.stdout:4/65: truncate fa 991483 0 2024-04-25T22:03:17.526 INFO:tasks.workunit.client.0.smithi044.stdout:3/79: truncate d0/f6 96844 0 2024-04-25T22:03:17.526 INFO:tasks.workunit.client.0.smithi044.stdout:8/206: creat d2a/d32/f3d x:0 0 0 2024-04-25T22:03:17.527 INFO:tasks.workunit.client.0.smithi044.stdout:4/66: creat dd/d19/f21 x:0 0 0 2024-04-25T22:03:17.527 INFO:tasks.workunit.client.0.smithi044.stdout:0/73: dwrite d8/da/f13 [0,4194304] 0 2024-04-25T22:03:17.528 INFO:tasks.workunit.client.0.smithi044.stdout:9/121: truncate d4/d7/fd 2638784 0 2024-04-25T22:03:17.528 INFO:tasks.workunit.client.0.smithi044.stdout:5/50: fdatasync f0 0 2024-04-25T22:03:17.529 INFO:tasks.workunit.client.0.smithi044.stdout:5/51: rmdir d2 39 2024-04-25T22:03:17.529 INFO:tasks.workunit.client.0.smithi044.stdout:0/74: link d8/da/c14 d8/da/c19 0 2024-04-25T22:03:17.530 INFO:tasks.workunit.client.0.smithi044.stdout:1/81: fsync d3/d7/f17 0 2024-04-25T22:03:17.530 INFO:tasks.workunit.client.0.smithi044.stdout:5/52: write d2/d5/fe [374657,106206] 0 2024-04-25T22:03:17.530 INFO:tasks.workunit.client.0.smithi044.stdout:1/82: fdatasync d3/d7/f17 0 2024-04-25T22:03:17.530 INFO:tasks.workunit.client.0.smithi044.stdout:0/75: write d8/f9 [781920,101912] 0 2024-04-25T22:03:17.531 INFO:tasks.workunit.client.0.smithi044.stdout:1/83: unlink d3/d7/f10 0 2024-04-25T22:03:17.531 INFO:tasks.workunit.client.0.smithi044.stdout:5/53: write d2/f4 [2095216,111769] 0 2024-04-25T22:03:17.537 INFO:tasks.workunit.client.0.smithi044.stdout:5/54: dread d2/f4 [0,4194304] 0 2024-04-25T22:03:17.537 INFO:tasks.workunit.client.0.smithi044.stdout:1/84: dread d3/d7/f17 [0,4194304] 0 2024-04-25T22:03:17.537 INFO:tasks.workunit.client.0.smithi044.stdout:1/85: mknod d3/c19 0 2024-04-25T22:03:17.539 INFO:tasks.workunit.client.0.smithi044.stdout:5/55: mknod d2/d5/c10 0 2024-04-25T22:03:17.542 INFO:tasks.workunit.client.0.smithi044.stdout:0/76: dwrite f1 [0,4194304] 0 2024-04-25T22:03:17.543 INFO:tasks.workunit.client.0.smithi044.stdout:1/86: rename c2 to d3/d7/c1a 0 2024-04-25T22:03:17.543 INFO:tasks.workunit.client.0.smithi044.stdout:9/122: dread d4/f23 [0,4194304] 0 2024-04-25T22:03:17.546 INFO:tasks.workunit.client.0.smithi044.stdout:1/87: write d3/d7/db/f15 [281560,62824] 0 2024-04-25T22:03:17.546 INFO:tasks.workunit.client.0.smithi044.stdout:0/77: link d8/da/c19 d8/da/c1a 0 2024-04-25T22:03:17.546 INFO:tasks.workunit.client.0.smithi044.stdout:5/56: read f0 [449020,115986] 0 2024-04-25T22:03:17.546 INFO:tasks.workunit.client.0.smithi044.stdout:9/123: mkdir d4/d7/d18/d2d 0 2024-04-25T22:03:17.550 INFO:tasks.workunit.client.0.smithi044.stdout:0/78: write d8/df/f10 [755490,97529] 0 2024-04-25T22:03:17.550 INFO:tasks.workunit.client.0.smithi044.stdout:9/124: chown d4/d7/c20 78445344 1 2024-04-25T22:03:17.553 INFO:tasks.workunit.client.0.smithi044.stdout:5/57: rename d2/d5/cb to d2/d5/c11 0 2024-04-25T22:03:17.553 INFO:tasks.workunit.client.0.smithi044.stdout:0/79: creat d8/df/f1b x:0 0 0 2024-04-25T22:03:17.553 INFO:tasks.workunit.client.0.smithi044.stdout:9/125: rename d4/d7/d22 to d4/d7/d18/d2e 0 2024-04-25T22:03:17.553 INFO:tasks.workunit.client.0.smithi044.stdout:0/80: mkdir d8/d1c 0 2024-04-25T22:03:17.554 INFO:tasks.workunit.client.0.smithi044.stdout:9/126: symlink d4/l2f 0 2024-04-25T22:03:17.554 INFO:tasks.workunit.client.0.smithi044.stdout:5/58: dread f0 [0,4194304] 0 2024-04-25T22:03:17.555 INFO:tasks.workunit.client.0.smithi044.stdout:0/81: truncate d8/f18 2226964 0 2024-04-25T22:03:17.556 INFO:tasks.workunit.client.0.smithi044.stdout:0/82: creat d8/f1d x:0 0 0 2024-04-25T22:03:17.557 INFO:tasks.workunit.client.0.smithi044.stdout:1/88: dwrite d3/d7/f17 [4194304,4194304] 0 2024-04-25T22:03:17.557 INFO:tasks.workunit.client.0.smithi044.stdout:5/59: mknod d2/c12 0 2024-04-25T22:03:17.560 INFO:tasks.workunit.client.0.smithi044.stdout:1/89: chown d3/d7/db/l11 837 1 2024-04-25T22:03:17.560 INFO:tasks.workunit.client.0.smithi044.stdout:2/127: fdatasync d7/f11 0 2024-04-25T22:03:17.562 INFO:tasks.workunit.client.0.smithi044.stdout:5/60: fsync d2/d5/fe 0 2024-04-25T22:03:17.562 INFO:tasks.workunit.client.0.smithi044.stdout:6/154: truncate d2/d8/f1b 4046023 0 2024-04-25T22:03:17.562 INFO:tasks.workunit.client.0.smithi044.stdout:1/90: fdatasync d3/d7/db/f15 0 2024-04-25T22:03:17.563 INFO:tasks.workunit.client.0.smithi044.stdout:3/80: truncate d0/f6 525654 0 2024-04-25T22:03:17.563 INFO:tasks.workunit.client.0.smithi044.stdout:2/128: write d7/f15 [2683913,51561] 0 2024-04-25T22:03:17.564 INFO:tasks.workunit.client.0.smithi044.stdout:6/155: readlink d2/d8/l14 0 2024-04-25T22:03:17.565 INFO:tasks.workunit.client.0.smithi044.stdout:6/156: write d2/fd [1130587,34755] 0 2024-04-25T22:03:17.565 INFO:tasks.workunit.client.0.smithi044.stdout:3/81: link d0/l17 d0/d13/d1c/l1e 0 2024-04-25T22:03:17.566 INFO:tasks.workunit.client.0.smithi044.stdout:9/127: dwrite d4/f1f [0,4194304] 0 2024-04-25T22:03:17.567 INFO:tasks.workunit.client.0.smithi044.stdout:2/129: sync 2024-04-25T22:03:17.569 INFO:tasks.workunit.client.0.smithi044.stdout:9/128: mknod d4/d7/d18/d2d/c30 0 2024-04-25T22:03:17.569 INFO:tasks.workunit.client.0.smithi044.stdout:8/207: dwrite f4 [0,4194304] 0 2024-04-25T22:03:17.572 INFO:tasks.workunit.client.0.smithi044.stdout:9/129: write d4/ff [3887136,80602] 0 2024-04-25T22:03:17.572 INFO:tasks.workunit.client.0.smithi044.stdout:4/67: truncate f4 3361293 0 2024-04-25T22:03:17.572 INFO:tasks.workunit.client.0.smithi044.stdout:4/68: sync 2024-04-25T22:03:17.572 INFO:tasks.workunit.client.0.smithi044.stdout:8/208: write d2a/f31 [450568,116398] 0 2024-04-25T22:03:17.573 INFO:tasks.workunit.client.0.smithi044.stdout:4/69: fdatasync dd/f17 0 2024-04-25T22:03:17.573 INFO:tasks.workunit.client.0.smithi044.stdout:9/130: write d4/f2b [956186,130753] 0 2024-04-25T22:03:17.573 INFO:tasks.workunit.client.0.smithi044.stdout:1/91: dwrite d3/d7/db/f15 [0,4194304] 0 2024-04-25T22:03:17.574 INFO:tasks.workunit.client.0.smithi044.stdout:8/209: read f2 [851980,125640] 0 2024-04-25T22:03:17.574 INFO:tasks.workunit.client.0.smithi044.stdout:4/70: write dd/f1b [114805,108290] 0 2024-04-25T22:03:17.574 INFO:tasks.workunit.client.0.smithi044.stdout:3/82: dread d0/d1/fe [0,4194304] 0 2024-04-25T22:03:17.574 INFO:tasks.workunit.client.0.smithi044.stdout:8/210: chown l14 548329 1 2024-04-25T22:03:17.575 INFO:tasks.workunit.client.0.smithi044.stdout:1/92: symlink d3/d7/db/l1b 0 2024-04-25T22:03:17.575 INFO:tasks.workunit.client.0.smithi044.stdout:9/131: symlink d4/d7/d18/d2e/l31 0 2024-04-25T22:03:17.576 INFO:tasks.workunit.client.0.smithi044.stdout:4/71: symlink dd/d19/l22 0 2024-04-25T22:03:17.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:17.573+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:17.576 INFO:tasks.workunit.client.0.smithi044.stdout:1/93: write d3/d7/db/f15 [4610592,85293] 0 2024-04-25T22:03:17.577 INFO:tasks.workunit.client.0.smithi044.stdout:4/72: dread - dd/d19/f1d zero size 2024-04-25T22:03:17.577 INFO:tasks.workunit.client.0.smithi044.stdout:1/94: chown d3/la 1300 1 2024-04-25T22:03:17.578 INFO:tasks.workunit.client.0.smithi044.stdout:4/73: mknod dd/d19/c23 0 2024-04-25T22:03:17.578 INFO:tasks.workunit.client.0.smithi044.stdout:1/95: creat d3/d7/f1c x:0 0 0 2024-04-25T22:03:17.579 INFO:tasks.workunit.client.0.smithi044.stdout:9/132: creat d4/f32 x:0 0 0 2024-04-25T22:03:17.579 INFO:tasks.workunit.client.0.smithi044.stdout:1/96: creat d3/d7/db/f1d x:0 0 0 2024-04-25T22:03:17.580 INFO:tasks.workunit.client.0.smithi044.stdout:1/97: rename d3/d7/f1c to d3/d7/f1e 0 2024-04-25T22:03:17.582 INFO:tasks.workunit.client.0.smithi044.stdout:3/83: dwrite d0/d2/f10 [4194304,4194304] 0 2024-04-25T22:03:17.583 INFO:tasks.workunit.client.0.smithi044.stdout:3/84: chown d0/f6 4207921 1 2024-04-25T22:03:17.587 INFO:tasks.workunit.client.0.smithi044.stdout:1/98: dwrite d3/d7/db/f1d [0,4194304] 0 2024-04-25T22:03:17.588 INFO:tasks.workunit.client.0.smithi044.stdout:1/99: symlink d3/l1f 0 2024-04-25T22:03:17.592 INFO:tasks.workunit.client.0.smithi044.stdout:1/100: dread d3/d7/db/f15 [0,4194304] 0 2024-04-25T22:03:17.593 INFO:tasks.workunit.client.0.smithi044.stdout:1/101: creat d3/d7/f20 x:0 0 0 2024-04-25T22:03:17.593 INFO:tasks.workunit.client.0.smithi044.stdout:9/133: dread d4/f2b [0,4194304] 0 2024-04-25T22:03:17.593 INFO:tasks.workunit.client.0.smithi044.stdout:1/102: symlink d3/d7/db/l21 0 2024-04-25T22:03:17.594 INFO:tasks.workunit.client.0.smithi044.stdout:1/103: fsync d3/d7/f8 0 2024-04-25T22:03:17.594 INFO:tasks.workunit.client.0.smithi044.stdout:1/104: write d3/d7/f17 [1671325,74569] 0 2024-04-25T22:03:17.596 INFO:tasks.workunit.client.0.smithi044.stdout:1/105: write d3/d7/f1e [961821,113955] 0 2024-04-25T22:03:17.596 INFO:tasks.workunit.client.0.smithi044.stdout:1/106: readlink d3/d7/db/l21 0 2024-04-25T22:03:17.597 INFO:tasks.workunit.client.0.smithi044.stdout:1/107: symlink d3/l22 0 2024-04-25T22:03:17.598 INFO:tasks.workunit.client.0.smithi044.stdout:3/85: truncate d0/d2/f3 785303 0 2024-04-25T22:03:17.599 INFO:tasks.workunit.client.0.smithi044.stdout:5/61: rename d2/d5/c11 to d2/d5/c13 0 2024-04-25T22:03:17.600 INFO:tasks.workunit.client.0.smithi044.stdout:5/62: mknod d2/c14 0 2024-04-25T22:03:17.601 INFO:tasks.workunit.client.0.smithi044.stdout:9/134: dwrite d4/f1f [4194304,4194304] 0 2024-04-25T22:03:17.602 INFO:tasks.workunit.client.0.smithi044.stdout:9/135: chown d4/d7/d18/l28 52 1 2024-04-25T22:03:17.603 INFO:tasks.workunit.client.0.smithi044.stdout:9/136: creat d4/d7/f33 x:0 0 0 2024-04-25T22:03:17.605 INFO:tasks.workunit.client.0.smithi044.stdout:1/108: dread d3/d7/db/f1d [0,4194304] 0 2024-04-25T22:03:17.607 INFO:tasks.workunit.client.0.smithi044.stdout:2/130: truncate f6 32460 0 2024-04-25T22:03:17.607 INFO:tasks.workunit.client.0.smithi044.stdout:1/109: creat d3/d7/f23 x:0 0 0 2024-04-25T22:03:17.607 INFO:tasks.workunit.client.0.smithi044.stdout:9/137: write d4/d7/fd [1437763,14024] 0 2024-04-25T22:03:17.607 INFO:tasks.workunit.client.0.smithi044.stdout:7/51: dwrite f6 [0,4194304] 0 2024-04-25T22:03:17.608 INFO:tasks.workunit.client.0.smithi044.stdout:4/74: getdents dd/d19 0 2024-04-25T22:03:17.608 INFO:tasks.workunit.client.0.smithi044.stdout:1/110: dread - d3/d7/f23 zero size 2024-04-25T22:03:17.610 INFO:tasks.workunit.client.0.smithi044.stdout:7/52: unlink l3 0 2024-04-25T22:03:17.610 INFO:tasks.workunit.client.0.smithi044.stdout:6/157: write d2/d8/f1b [1037296,34240] 0 2024-04-25T22:03:17.611 INFO:tasks.workunit.client.0.smithi044.stdout:5/63: chown d2/d5/c13 83 1 2024-04-25T22:03:17.611 INFO:tasks.workunit.client.0.smithi044.stdout:3/86: truncate d0/d2/f10 7894805 0 2024-04-25T22:03:17.612 INFO:tasks.workunit.client.0.smithi044.stdout:6/158: creat d2/d8/d13/f36 x:0 0 0 2024-04-25T22:03:17.612 INFO:tasks.workunit.client.0.smithi044.stdout:5/64: symlink d2/l15 0 2024-04-25T22:03:17.612 INFO:tasks.workunit.client.0.smithi044.stdout:7/53: write f9 [801549,17122] 0 2024-04-25T22:03:17.615 INFO:tasks.workunit.client.0.smithi044.stdout:6/159: creat d2/d23/f37 x:0 0 0 2024-04-25T22:03:17.616 INFO:tasks.workunit.client.0.smithi044.stdout:3/87: unlink d0/d1/d15/df/l5 0 2024-04-25T22:03:17.616 INFO:tasks.workunit.client.0.smithi044.stdout:3/88: stat d0/d1/l9 0 2024-04-25T22:03:17.616 INFO:tasks.workunit.client.0.smithi044.stdout:8/211: dwrite d2a/d32/f3b [0,4194304] 0 2024-04-25T22:03:17.618 INFO:tasks.workunit.client.0.smithi044.stdout:0/83: dwrite d8/f18 [0,4194304] 0 2024-04-25T22:03:17.622 INFO:tasks.workunit.client.0.smithi044.stdout:8/212: chown d2a/d32/f34 91 1 2024-04-25T22:03:17.622 INFO:tasks.workunit.client.0.smithi044.stdout:2/131: rename f6 to d7/f22 0 2024-04-25T22:03:17.623 INFO:tasks.workunit.client.0.smithi044.stdout:9/138: dread d4/d7/fc [0,4194304] 0 2024-04-25T22:03:17.623 INFO:tasks.workunit.client.0.smithi044.stdout:3/89: mkdir d0/d1/d15/df/d12/dd/d1f 0 2024-04-25T22:03:17.624 INFO:tasks.workunit.client.0.smithi044.stdout:0/84: link f0 d8/d15/f1e 0 2024-04-25T22:03:17.625 INFO:tasks.workunit.client.0.smithi044.stdout:8/213: unlink l26 0 2024-04-25T22:03:17.625 INFO:tasks.workunit.client.0.smithi044.stdout:9/139: fdatasync d4/f32 0 2024-04-25T22:03:17.625 INFO:tasks.workunit.client.0.smithi044.stdout:4/75: rename dd/l18 to dd/d19/l24 0 2024-04-25T22:03:17.625 INFO:tasks.workunit.client.0.smithi044.stdout:2/132: symlink d7/l23 0 2024-04-25T22:03:17.627 INFO:tasks.workunit.client.0.smithi044.stdout:4/76: dread - dd/d19/f1d zero size 2024-04-25T22:03:17.627 INFO:tasks.workunit.client.0.smithi044.stdout:1/111: rename d3/d7/db/l21 to d3/d7/l24 0 2024-04-25T22:03:17.627 INFO:tasks.workunit.client.0.smithi044.stdout:8/214: write f22 [1027803,44220] 0 2024-04-25T22:03:17.628 INFO:tasks.workunit.client.0.smithi044.stdout:5/65: dwrite d2/f4 [0,4194304] 0 2024-04-25T22:03:17.628 INFO:tasks.workunit.client.0.smithi044.stdout:3/90: write d0/d2/f10 [6968970,102227] 0 2024-04-25T22:03:17.628 INFO:tasks.workunit.client.0.smithi044.stdout:6/160: dread d2/d8/d12/f19 [0,4194304] 0 2024-04-25T22:03:17.628 INFO:tasks.workunit.client.0.smithi044.stdout:0/85: truncate d8/da/f13 5108162 0 2024-04-25T22:03:17.629 INFO:tasks.workunit.client.0.smithi044.stdout:0/86: chown l5 3281 1 2024-04-25T22:03:17.629 INFO:tasks.workunit.client.0.smithi044.stdout:9/140: fdatasync d4/d7/fc 0 2024-04-25T22:03:17.629 INFO:tasks.workunit.client.0.smithi044.stdout:1/112: rmdir d3/d7 39 2024-04-25T22:03:17.629 INFO:tasks.workunit.client.0.smithi044.stdout:7/54: dwrite f6 [0,4194304] 0 2024-04-25T22:03:17.630 INFO:tasks.workunit.client.0.smithi044.stdout:8/215: mkdir d2a/d32/d3e 0 2024-04-25T22:03:17.630 INFO:tasks.workunit.client.0.smithi044.stdout:2/133: creat d7/d8/db/f24 x:0 0 0 2024-04-25T22:03:17.630 INFO:tasks.workunit.client.0.smithi044.stdout:4/77: mknod dd/d19/c25 0 2024-04-25T22:03:17.631 INFO:tasks.workunit.client.0.smithi044.stdout:8/216: chown f19 0 1 2024-04-25T22:03:17.631 INFO:tasks.workunit.client.0.smithi044.stdout:0/87: creat d8/d15/f1f x:0 0 0 2024-04-25T22:03:17.632 INFO:tasks.workunit.client.0.smithi044.stdout:7/55: rename f6 to fa 0 2024-04-25T22:03:17.632 INFO:tasks.workunit.client.0.smithi044.stdout:2/134: read - d7/d8/db/f24 zero size 2024-04-25T22:03:17.632 INFO:tasks.workunit.client.0.smithi044.stdout:9/141: creat d4/d7/d18/d2e/f34 x:0 0 0 2024-04-25T22:03:17.632 INFO:tasks.workunit.client.0.smithi044.stdout:6/161: rename d2/d8/d12/l25 to d2/d8/d12/d1d/l38 0 2024-04-25T22:03:17.633 INFO:tasks.workunit.client.0.smithi044.stdout:1/113: mknod d3/c25 0 2024-04-25T22:03:17.633 INFO:tasks.workunit.client.0.smithi044.stdout:8/217: mknod d2a/d39/c3f 0 2024-04-25T22:03:17.634 INFO:tasks.workunit.client.0.smithi044.stdout:7/56: creat fb x:0 0 0 2024-04-25T22:03:17.634 INFO:tasks.workunit.client.0.smithi044.stdout:3/91: dread d0/f6 [0,4194304] 0 2024-04-25T22:03:17.634 INFO:tasks.workunit.client.0.smithi044.stdout:9/142: fdatasync d4/f2b 0 2024-04-25T22:03:17.635 INFO:tasks.workunit.client.0.smithi044.stdout:2/135: write d7/d16/f17 [566294,24267] 0 2024-04-25T22:03:17.635 INFO:tasks.workunit.client.0.smithi044.stdout:7/57: mknod cc 0 2024-04-25T22:03:17.635 INFO:tasks.workunit.client.0.smithi044.stdout:6/162: write d2/d8/d12/d27/f2d [1613145,83601] 0 2024-04-25T22:03:17.636 INFO:tasks.workunit.client.0.smithi044.stdout:1/114: chown d3/d7/l13 22106718 1 2024-04-25T22:03:17.636 INFO:tasks.workunit.client.0.smithi044.stdout:9/143: chown d4/d7/l1e 164 1 2024-04-25T22:03:17.638 INFO:tasks.workunit.client.0.smithi044.stdout:1/115: write d3/d7/f8 [5111091,121080] 0 2024-04-25T22:03:17.638 INFO:tasks.workunit.client.0.smithi044.stdout:3/92: creat d0/f20 x:0 0 0 2024-04-25T22:03:17.639 INFO:tasks.workunit.client.0.smithi044.stdout:6/163: creat d2/d8/d11/f39 x:0 0 0 2024-04-25T22:03:17.640 INFO:tasks.workunit.client.0.smithi044.stdout:3/93: stat d0/d2/c8 0 2024-04-25T22:03:17.641 INFO:tasks.workunit.client.0.smithi044.stdout:9/144: write d4/d7/f8 [2537754,17490] 0 2024-04-25T22:03:17.642 INFO:tasks.workunit.client.0.smithi044.stdout:4/78: dwrite dd/f1c [0,4194304] 0 2024-04-25T22:03:17.643 INFO:tasks.workunit.client.0.smithi044.stdout:6/164: creat d2/f3a x:0 0 0 2024-04-25T22:03:17.647 INFO:tasks.workunit.client.0.smithi044.stdout:3/94: dread d0/d2/f3 [0,4194304] 0 2024-04-25T22:03:17.647 INFO:tasks.workunit.client.0.smithi044.stdout:5/66: truncate d2/f4 3938297 0 2024-04-25T22:03:17.647 INFO:tasks.workunit.client.0.smithi044.stdout:2/136: dread d7/f11 [0,4194304] 0 2024-04-25T22:03:17.648 INFO:tasks.workunit.client.0.smithi044.stdout:9/145: mknod d4/d7/d18/c35 0 2024-04-25T22:03:17.649 INFO:tasks.workunit.client.0.smithi044.stdout:0/88: dwrite f3 [0,4194304] 0 2024-04-25T22:03:17.653 INFO:tasks.workunit.client.0.smithi044.stdout:4/79: symlink dd/d19/l26 0 2024-04-25T22:03:17.654 INFO:tasks.workunit.client.0.smithi044.stdout:7/58: dwrite f9 [0,4194304] 0 2024-04-25T22:03:17.654 INFO:tasks.workunit.client.0.smithi044.stdout:2/137: creat d7/f25 x:0 0 0 2024-04-25T22:03:17.654 INFO:tasks.workunit.client.0.smithi044.stdout:5/67: creat d2/d5/f16 x:0 0 0 2024-04-25T22:03:17.654 INFO:tasks.workunit.client.0.smithi044.stdout:8/218: dwrite d2a/d32/f33 [4194304,4194304] 0 2024-04-25T22:03:17.654 INFO:tasks.workunit.client.0.smithi044.stdout:0/89: mkdir d8/d20 0 2024-04-25T22:03:17.654 INFO:tasks.workunit.client.0.smithi044.stdout:9/146: mknod d4/d7/c36 0 2024-04-25T22:03:17.657 INFO:tasks.workunit.client.0.smithi044.stdout:4/80: unlink f4 0 2024-04-25T22:03:17.657 INFO:tasks.workunit.client.0.smithi044.stdout:1/116: dwrite d3/d7/f23 [0,4194304] 0 2024-04-25T22:03:17.657 INFO:tasks.workunit.client.0.smithi044.stdout:0/90: truncate d8/f9 1229988 0 2024-04-25T22:03:17.657 INFO:tasks.workunit.client.0.smithi044.stdout:5/68: write d2/d5/f9 [101633,5533] 0 2024-04-25T22:03:17.658 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:17.658 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:17.658 INFO:tasks.workunit.client.0.smithi044.stdout:9/147: chown d4/ff 29 1 2024-04-25T22:03:17.659 INFO:tasks.workunit.client.0.smithi044.stdout:2/138: unlink d7/f22 0 2024-04-25T22:03:17.662 INFO:tasks.workunit.client.0.smithi044.stdout:1/117: fdatasync d3/d7/f1e 0 2024-04-25T22:03:17.662 INFO:tasks.workunit.client.0.smithi044.stdout:5/69: creat d2/d5/f17 x:0 0 0 2024-04-25T22:03:17.663 INFO:tasks.workunit.client.0.smithi044.stdout:0/91: write d8/d15/f1f [973326,129344] 0 2024-04-25T22:03:17.663 INFO:tasks.workunit.client.0.smithi044.stdout:9/148: truncate d4/f23 1848011 0 2024-04-25T22:03:17.667 INFO:tasks.workunit.client.0.smithi044.stdout:0/92: mknod d8/c21 0 2024-04-25T22:03:17.667 INFO:tasks.workunit.client.0.smithi044.stdout:6/165: dwrite d2/d8/d12/d27/f2d [0,4194304] 0 2024-04-25T22:03:17.668 INFO:tasks.workunit.client.0.smithi044.stdout:9/149: stat d4/d7/c24 0 2024-04-25T22:03:17.668 INFO:tasks.workunit.client.0.smithi044.stdout:3/95: dwrite d0/d1/fe [0,4194304] 0 2024-04-25T22:03:17.669 INFO:tasks.workunit.client.0.smithi044.stdout:0/93: readlink d8/da/l12 0 2024-04-25T22:03:17.670 INFO:tasks.workunit.client.0.smithi044.stdout:7/59: dwrite fb [0,4194304] 0 2024-04-25T22:03:17.671 INFO:tasks.workunit.client.0.smithi044.stdout:9/150: unlink d4/d7/fd 0 2024-04-25T22:03:17.672 INFO:tasks.workunit.client.0.smithi044.stdout:3/96: unlink d0/d2/f10 0 2024-04-25T22:03:17.674 INFO:tasks.workunit.client.0.smithi044.stdout:8/219: dwrite f27 [0,4194304] 0 2024-04-25T22:03:17.674 INFO:tasks.workunit.client.0.smithi044.stdout:4/81: getdents dd/d19 0 2024-04-25T22:03:17.675 INFO:tasks.workunit.client.0.smithi044.stdout:1/118: truncate d3/d7/f17 8087744 0 2024-04-25T22:03:17.675 INFO:tasks.workunit.client.0.smithi044.stdout:0/94: rename d8/da/ce to d8/da/c22 0 2024-04-25T22:03:17.676 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:17.668+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:17.677 INFO:tasks.workunit.client.0.smithi044.stdout:8/220: symlink d2a/l40 0 2024-04-25T22:03:17.677 INFO:tasks.workunit.client.0.smithi044.stdout:3/97: rename d0/d1/d15/df/d12/dd/d1f to d0/d1/d15/df/d21 0 2024-04-25T22:03:17.679 INFO:tasks.workunit.client.0.smithi044.stdout:1/119: truncate d3/d7/db/f15 5500505 0 2024-04-25T22:03:17.679 INFO:tasks.workunit.client.0.smithi044.stdout:5/70: dwrite d2/d5/f9 [0,4194304] 0 2024-04-25T22:03:17.680 INFO:tasks.workunit.client.0.smithi044.stdout:8/221: getdents d2a/d32/d3e 0 2024-04-25T22:03:17.681 INFO:tasks.workunit.client.0.smithi044.stdout:6/166: dread d2/d8/d12/d1d/f32 [0,4194304] 0 2024-04-25T22:03:17.682 INFO:tasks.workunit.client.0.smithi044.stdout:3/98: creat d0/d1/d15/df/d12/dd/f22 x:0 0 0 2024-04-25T22:03:17.682 INFO:tasks.workunit.client.0.smithi044.stdout:5/71: write d2/f4 [1195023,87460] 0 2024-04-25T22:03:17.683 INFO:tasks.workunit.client.0.smithi044.stdout:8/222: creat d2a/d32/f41 x:0 0 0 2024-04-25T22:03:17.683 INFO:tasks.workunit.client.0.smithi044.stdout:6/167: stat d2/d8/d13/f36 0 2024-04-25T22:03:17.683 INFO:tasks.workunit.client.0.smithi044.stdout:1/120: creat d3/f26 x:0 0 0 2024-04-25T22:03:17.685 INFO:tasks.workunit.client.0.smithi044.stdout:9/151: dwrite d4/d7/fc [0,4194304] 0 2024-04-25T22:03:17.685 INFO:tasks.workunit.client.0.smithi044.stdout:1/121: write d3/d7/f20 [140384,10780] 0 2024-04-25T22:03:17.685 INFO:tasks.workunit.client.0.smithi044.stdout:5/72: creat d2/d5/f18 x:0 0 0 2024-04-25T22:03:17.685 INFO:tasks.workunit.client.0.smithi044.stdout:3/99: dread d0/d2/f3 [0,4194304] 0 2024-04-25T22:03:17.686 INFO:tasks.workunit.client.0.smithi044.stdout:9/152: mkdir d4/d37 0 2024-04-25T22:03:17.687 INFO:tasks.workunit.client.0.smithi044.stdout:3/100: read - d0/f20 zero size 2024-04-25T22:03:17.688 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:17.689 INFO:tasks.workunit.client.0.smithi044.stdout:9/153: write d4/f23 [2192451,56110] 0 2024-04-25T22:03:17.689 INFO:tasks.workunit.client.0.smithi044.stdout:0/95: dwrite f1 [0,4194304] 0 2024-04-25T22:03:17.689 INFO:tasks.workunit.client.0.smithi044.stdout:3/101: mkdir d0/d1/d15/d23 0 2024-04-25T22:03:17.689 INFO:tasks.workunit.client.0.smithi044.stdout:0/96: symlink d8/d15/l23 0 2024-04-25T22:03:17.690 INFO:tasks.workunit.client.0.smithi044.stdout:9/154: creat d4/d7/d18/d2d/f38 x:0 0 0 2024-04-25T22:03:17.690 INFO:tasks.workunit.client.0.smithi044.stdout:3/102: symlink d0/l24 0 2024-04-25T22:03:17.691 INFO:tasks.workunit.client.0.smithi044.stdout:8/223: dread f8 [0,4194304] 0 2024-04-25T22:03:17.691 INFO:tasks.workunit.client.0.smithi044.stdout:0/97: chown d8/da/lb 63 1 2024-04-25T22:03:17.692 INFO:tasks.workunit.client.0.smithi044.stdout:8/224: mkdir d2a/d39/d42 0 2024-04-25T22:03:17.692 INFO:tasks.workunit.client.0.smithi044.stdout:0/98: mkdir d8/d24 0 2024-04-25T22:03:17.693 INFO:tasks.workunit.client.0.smithi044.stdout:8/225: rename d2a/d39 to d2a/d39/d43 22 2024-04-25T22:03:17.694 INFO:tasks.workunit.client.0.smithi044.stdout:0/99: rmdir d8/d1c 0 2024-04-25T22:03:17.694 INFO:tasks.workunit.client.0.smithi044.stdout:7/60: dread f0 [4194304,4194304] 0 2024-04-25T22:03:17.695 INFO:tasks.workunit.client.0.smithi044.stdout:8/226: creat d2a/d32/d3e/f44 x:0 0 0 2024-04-25T22:03:17.695 INFO:tasks.workunit.client.0.smithi044.stdout:6/168: dwrite d2/d8/f1b [0,4194304] 0 2024-04-25T22:03:17.696 INFO:tasks.workunit.client.0.smithi044.stdout:0/100: mknod d8/d20/c25 0 2024-04-25T22:03:17.698 INFO:tasks.workunit.client.0.smithi044.stdout:0/101: rmdir d8/df 39 2024-04-25T22:03:17.698 INFO:tasks.workunit.client.0.smithi044.stdout:7/61: write f0 [4182095,82572] 0 2024-04-25T22:03:17.698 INFO:tasks.workunit.client.0.smithi044.stdout:3/103: dread d0/d1/fe [0,4194304] 0 2024-04-25T22:03:17.699 INFO:tasks.workunit.client.0.smithi044.stdout:6/169: write d2/d8/d11/f16 [4292147,3603] 0 2024-04-25T22:03:17.699 INFO:tasks.workunit.client.0.smithi044.stdout:3/104: chown d0/d2 18365509 1 2024-04-25T22:03:17.700 INFO:tasks.workunit.client.0.smithi044.stdout:3/105: stat d0/d1/l9 0 2024-04-25T22:03:17.701 INFO:tasks.workunit.client.0.smithi044.stdout:9/155: dwrite d4/d7/d18/d2d/f38 [0,4194304] 0 2024-04-25T22:03:17.701 INFO:tasks.workunit.client.0.smithi044.stdout:3/106: fdatasync d0/f6 0 2024-04-25T22:03:17.703 INFO:tasks.workunit.client.0.smithi044.stdout:3/107: truncate d0/f20 839331 0 2024-04-25T22:03:17.703 INFO:tasks.workunit.client.0.smithi044.stdout:8/227: dread d2a/d32/f34 [0,4194304] 0 2024-04-25T22:03:17.704 INFO:tasks.workunit.client.0.smithi044.stdout:7/62: dread fa [0,4194304] 0 2024-04-25T22:03:17.705 INFO:tasks.workunit.client.0.smithi044.stdout:9/156: dread f3 [0,4194304] 0 2024-04-25T22:03:17.707 INFO:tasks.workunit.client.0.smithi044.stdout:9/157: write d4/d7/fc [181501,18875] 0 2024-04-25T22:03:17.707 INFO:tasks.workunit.client.0.smithi044.stdout:6/170: fsync d2/d8/d12/d27/f2d 0 2024-04-25T22:03:17.707 INFO:tasks.workunit.client.0.smithi044.stdout:5/73: read d2/d5/fe [62497,126863] 0 2024-04-25T22:03:17.708 INFO:tasks.workunit.client.0.smithi044.stdout:5/74: rename f0 to d2/f19 0 2024-04-25T22:03:17.709 INFO:tasks.workunit.client.0.smithi044.stdout:9/158: rename d4/d7/fc to d4/d7/f39 0 2024-04-25T22:03:17.710 INFO:tasks.workunit.client.0.smithi044.stdout:5/75: symlink d2/l1a 0 2024-04-25T22:03:17.710 INFO:tasks.workunit.client.0.smithi044.stdout:7/63: dread fb [0,4194304] 0 2024-04-25T22:03:17.710 INFO:tasks.workunit.client.0.smithi044.stdout:6/171: rename d2/d8/d12/d1d to d2/d8/d11/d3b 0 2024-04-25T22:03:17.710 INFO:tasks.workunit.client.0.smithi044.stdout:9/159: mkdir d4/d7/d18/d3a 0 2024-04-25T22:03:17.710 INFO:tasks.workunit.client.0.smithi044.stdout:5/76: creat d2/d5/f1b x:0 0 0 2024-04-25T22:03:17.711 INFO:tasks.workunit.client.0.smithi044.stdout:9/160: write d4/f23 [1139358,109876] 0 2024-04-25T22:03:17.711 INFO:tasks.workunit.client.0.smithi044.stdout:8/228: dwrite d2a/d32/f34 [0,4194304] 0 2024-04-25T22:03:17.712 INFO:tasks.workunit.client.0.smithi044.stdout:5/77: rename d2/l8 to d2/d5/l1c 0 2024-04-25T22:03:17.712 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:03:17.713 INFO:tasks.workunit.client.0.smithi044.stdout:5/78: creat d2/f1d x:0 0 0 2024-04-25T22:03:17.713 INFO:tasks.workunit.client.0.smithi044.stdout:9/161: creat d4/f3b x:0 0 0 2024-04-25T22:03:17.714 INFO:tasks.workunit.client.0.smithi044.stdout:9/162: rmdir d4 39 2024-04-25T22:03:17.714 INFO:tasks.workunit.client.0.smithi044.stdout:5/79: write d2/d5/f1b [74569,84236] 0 2024-04-25T22:03:17.716 INFO:tasks.workunit.client.0.smithi044.stdout:9/163: chown d4/d7/d18/c26 6470343 1 2024-04-25T22:03:17.716 INFO:tasks.workunit.client.0.smithi044.stdout:9/164: dread - d4/d7/f33 zero size 2024-04-25T22:03:17.718 INFO:tasks.workunit.client.0.smithi044.stdout:7/64: dwrite f0 [4194304,4194304] 0 2024-04-25T22:03:17.719 INFO:tasks.workunit.client.0.smithi044.stdout:7/65: unlink fb 0 2024-04-25T22:03:17.720 INFO:tasks.workunit.client.0.smithi044.stdout:9/165: dread d4/f2b [0,4194304] 0 2024-04-25T22:03:17.720 INFO:tasks.workunit.client.0.smithi044.stdout:8/229: dwrite f8 [0,4194304] 0 2024-04-25T22:03:17.720 INFO:tasks.workunit.client.0.smithi044.stdout:7/66: symlink ld 0 2024-04-25T22:03:17.720 INFO:tasks.workunit.client.0.smithi044.stdout:7/67: rmdir - no directory 2024-04-25T22:03:17.721 INFO:tasks.workunit.client.0.smithi044.stdout:5/80: dread d2/f4 [0,4194304] 0 2024-04-25T22:03:17.721 INFO:tasks.workunit.client.0.smithi044.stdout:2/139: sync 2024-04-25T22:03:17.721 INFO:tasks.workunit.client.0.smithi044.stdout:4/82: sync 2024-04-25T22:03:17.722 INFO:tasks.workunit.client.0.smithi044.stdout:7/68: rename l7 to le 0 2024-04-25T22:03:17.723 INFO:tasks.workunit.client.0.smithi044.stdout:2/140: mkdir d7/d8/d1c/d26 0 2024-04-25T22:03:17.723 INFO:tasks.workunit.client.0.smithi044.stdout:5/81: unlink d2/d5/fe 0 2024-04-25T22:03:17.723 INFO:tasks.workunit.client.0.smithi044.stdout:4/83: creat dd/d19/f27 x:0 0 0 2024-04-25T22:03:17.723 INFO:tasks.workunit.client.0.smithi044.stdout:7/69: mknod cf 0 2024-04-25T22:03:17.723 INFO:tasks.workunit.client.0.smithi044.stdout:8/230: creat d2a/f45 x:0 0 0 2024-04-25T22:03:17.724 INFO:tasks.workunit.client.0.smithi044.stdout:4/84: chown dd/f17 187834 1 2024-04-25T22:03:17.724 INFO:tasks.workunit.client.0.smithi044.stdout:7/70: chown f9 221 1 2024-04-25T22:03:17.724 INFO:tasks.workunit.client.0.smithi044.stdout:8/231: chown fd 1952 1 2024-04-25T22:03:17.725 INFO:tasks.workunit.client.0.smithi044.stdout:8/232: creat d2a/d32/d3e/f46 x:0 0 0 2024-04-25T22:03:17.725 INFO:tasks.workunit.client.0.smithi044.stdout:9/166: dread f3 [0,4194304] 0 2024-04-25T22:03:17.726 INFO:tasks.workunit.client.0.smithi044.stdout:8/233: write d2a/f45 [929895,100549] 0 2024-04-25T22:03:17.727 INFO:tasks.workunit.client.0.smithi044.stdout:8/234: symlink d2a/d39/d42/l47 0 2024-04-25T22:03:17.727 INFO:tasks.workunit.client.0.smithi044.stdout:8/235: chown d2a/d32/f33 4900 1 2024-04-25T22:03:17.728 INFO:tasks.workunit.client.0.smithi044.stdout:4/85: dread dd/f11 [0,4194304] 0 2024-04-25T22:03:17.728 INFO:tasks.workunit.client.0.smithi044.stdout:8/236: unlink f19 0 2024-04-25T22:03:17.729 INFO:tasks.workunit.client.0.smithi044.stdout:8/237: write f17 [1471575,88296] 0 2024-04-25T22:03:17.729 INFO:tasks.workunit.client.0.smithi044.stdout:4/86: creat dd/f28 x:0 0 0 2024-04-25T22:03:17.730 INFO:tasks.workunit.client.0.smithi044.stdout:3/108: write d0/f6 [312380,88135] 0 2024-04-25T22:03:17.731 INFO:tasks.workunit.client.0.smithi044.stdout:8/238: chown f2 312273 1 2024-04-25T22:03:17.731 INFO:tasks.workunit.client.0.smithi044.stdout:4/87: write dd/d19/f27 [526030,73928] 0 2024-04-25T22:03:17.732 INFO:tasks.workunit.client.0.smithi044.stdout:8/239: write d2a/f36 [272519,25755] 0 2024-04-25T22:03:17.732 INFO:tasks.workunit.client.0.smithi044.stdout:4/88: write dd/f28 [509117,52536] 0 2024-04-25T22:03:17.733 INFO:tasks.workunit.client.0.smithi044.stdout:3/109: getdents d0/d1/d15/df 0 2024-04-25T22:03:17.733 INFO:tasks.workunit.client.0.smithi044.stdout:4/89: symlink dd/d19/l29 0 2024-04-25T22:03:17.734 INFO:tasks.workunit.client.0.smithi044.stdout:1/122: dread d3/d7/f17 [4194304,4194304] 0 2024-04-25T22:03:17.735 INFO:tasks.workunit.client.0.smithi044.stdout:3/110: mknod d0/d13/d1c/c25 0 2024-04-25T22:03:17.735 INFO:tasks.workunit.client.0.smithi044.stdout:0/102: dwrite d8/d15/f1e [0,4194304] 0 2024-04-25T22:03:17.738 INFO:tasks.workunit.client.0.smithi044.stdout:3/111: getdents d0/d1/d15/df/d12/dd 0 2024-04-25T22:03:17.738 INFO:tasks.workunit.client.0.smithi044.stdout:8/240: dread f24 [0,4194304] 0 2024-04-25T22:03:17.738 INFO:tasks.workunit.client.0.smithi044.stdout:1/123: chown d3/d7/c1a 972 1 2024-04-25T22:03:17.739 INFO:tasks.workunit.client.0.smithi044.stdout:3/112: write d0/d2/f3 [140598,70] 0 2024-04-25T22:03:17.740 INFO:tasks.workunit.client.0.smithi044.stdout:1/124: rename c1 to d3/d7/db/c27 0 2024-04-25T22:03:17.740 INFO:tasks.workunit.client.0.smithi044.stdout:0/103: dread f6 [0,4194304] 0 2024-04-25T22:03:17.742 INFO:tasks.workunit.client.0.smithi044.stdout:1/125: symlink d3/d7/l28 0 2024-04-25T22:03:17.742 INFO:tasks.workunit.client.0.smithi044.stdout:0/104: read f1 [3498497,103044] 0 2024-04-25T22:03:17.743 INFO:tasks.workunit.client.0.smithi044.stdout:3/113: link d0/l17 d0/l26 0 2024-04-25T22:03:17.744 INFO:tasks.workunit.client.0.smithi044.stdout:4/90: dwrite dd/ff [0,4194304] 0 2024-04-25T22:03:17.744 INFO:tasks.workunit.client.0.smithi044.stdout:2/141: dread d7/d16/f17 [0,4194304] 0 2024-04-25T22:03:17.744 INFO:tasks.workunit.client.0.smithi044.stdout:0/105: stat d8/da/c1a 0 2024-04-25T22:03:17.744 INFO:tasks.workunit.client.0.smithi044.stdout:9/167: fsync d4/d7/d18/d2d/f38 0 2024-04-25T22:03:17.746 INFO:tasks.workunit.client.0.smithi044.stdout:3/114: dread d0/f6 [0,4194304] 0 2024-04-25T22:03:17.746 INFO:tasks.workunit.client.0.smithi044.stdout:0/106: rename d8/f1d to d8/d24/f26 0 2024-04-25T22:03:17.747 INFO:tasks.workunit.client.0.smithi044.stdout:4/91: link dd/d19/f21 dd/f2a 0 2024-04-25T22:03:17.747 INFO:tasks.workunit.client.0.smithi044.stdout:2/142: link d7/f1b d7/d8/d1c/f27 0 2024-04-25T22:03:17.747 INFO:tasks.workunit.client.0.smithi044.stdout:8/241: dwrite f23 [0,4194304] 0 2024-04-25T22:03:17.748 INFO:tasks.workunit.client.0.smithi044.stdout:0/107: creat d8/d20/f27 x:0 0 0 2024-04-25T22:03:17.748 INFO:tasks.workunit.client.0.smithi044.stdout:4/92: creat dd/d19/f2b x:0 0 0 2024-04-25T22:03:17.749 INFO:tasks.workunit.client.0.smithi044.stdout:0/108: creat d8/d24/f28 x:0 0 0 2024-04-25T22:03:17.749 INFO:tasks.workunit.client.0.smithi044.stdout:8/242: rename d2a/f3c to d2a/d32/f48 0 2024-04-25T22:03:17.751 INFO:tasks.workunit.client.0.smithi044.stdout:4/93: rename dd/f28 to dd/d19/f2c 0 2024-04-25T22:03:17.751 INFO:tasks.workunit.client.0.smithi044.stdout:8/243: rename f1e to d2a/d39/d42/f49 0 2024-04-25T22:03:17.755 INFO:tasks.workunit.client.0.smithi044.stdout:3/115: dwrite d0/d2/f3 [0,4194304] 0 2024-04-25T22:03:17.758 INFO:tasks.workunit.client.0.smithi044.stdout:3/116: mknod d0/d1/d15/d23/c27 0 2024-04-25T22:03:17.758 INFO:tasks.workunit.client.0.smithi044.stdout:0/109: dwrite d8/d15/f1e [0,4194304] 0 2024-04-25T22:03:17.760 INFO:tasks.workunit.client.0.smithi044.stdout:0/110: unlink d8/da/fd 0 2024-04-25T22:03:17.761 INFO:tasks.workunit.client.0.smithi044.stdout:8/244: dwrite f8 [4194304,4194304] 0 2024-04-25T22:03:17.761 INFO:tasks.workunit.client.0.smithi044.stdout:3/117: mkdir d0/d1/d15/df/d12/dd/d28 0 2024-04-25T22:03:17.762 INFO:tasks.workunit.client.0.smithi044.stdout:8/245: read f23 [1948675,129467] 0 2024-04-25T22:03:17.764 INFO:tasks.workunit.client.0.smithi044.stdout:5/82: getdents d2 0 2024-04-25T22:03:17.765 INFO:tasks.workunit.client.0.smithi044.stdout:7/71: readlink le 0 2024-04-25T22:03:17.768 INFO:tasks.workunit.client.0.smithi044.stdout:3/118: dread d0/d1/fe [0,4194304] 0 2024-04-25T22:03:17.768 INFO:tasks.workunit.client.0.smithi044.stdout:1/126: truncate d3/d7/f23 482939 0 2024-04-25T22:03:17.770 INFO:tasks.workunit.client.0.smithi044.stdout:0/111: dwrite f1 [0,4194304] 0 2024-04-25T22:03:17.770 INFO:tasks.workunit.client.0.smithi044.stdout:5/83: getdents d2/d5 0 2024-04-25T22:03:17.771 INFO:tasks.workunit.client.0.smithi044.stdout:3/119: creat d0/d1/d15/df/d12/f29 x:0 0 0 2024-04-25T22:03:17.771 INFO:tasks.workunit.client.0.smithi044.stdout:5/84: creat d2/d5/f1e x:0 0 0 2024-04-25T22:03:17.771 INFO:tasks.workunit.client.0.smithi044.stdout:0/112: write d8/d24/f26 [503072,57013] 0 2024-04-25T22:03:17.772 INFO:tasks.workunit.client.0.smithi044.stdout:5/85: rename d2/d5/f1e to d2/d5/f1f 0 2024-04-25T22:03:17.773 INFO:tasks.workunit.client.0.smithi044.stdout:5/86: creat d2/f20 x:0 0 0 2024-04-25T22:03:17.774 INFO:tasks.workunit.client.0.smithi044.stdout:0/113: creat d8/df/f29 x:0 0 0 2024-04-25T22:03:17.774 INFO:tasks.workunit.client.0.smithi044.stdout:1/127: fsync d3/d7/f23 0 2024-04-25T22:03:17.774 INFO:tasks.workunit.client.0.smithi044.stdout:7/72: truncate f0 4221 0 2024-04-25T22:03:17.776 INFO:tasks.workunit.client.0.smithi044.stdout:1/128: fsync d3/d7/f8 0 2024-04-25T22:03:17.776 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:17.772+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:17.777 INFO:tasks.workunit.client.0.smithi044.stdout:1/129: write d3/f26 [350612,123581] 0 2024-04-25T22:03:17.778 INFO:tasks.workunit.client.0.smithi044.stdout:9/168: dwrite d4/f32 [0,4194304] 0 2024-04-25T22:03:17.778 INFO:tasks.workunit.client.0.smithi044.stdout:1/130: fdatasync d3/d7/f1e 0 2024-04-25T22:03:17.779 INFO:tasks.workunit.client.0.smithi044.stdout:7/73: write f0 [666529,100627] 0 2024-04-25T22:03:17.780 INFO:tasks.workunit.client.0.smithi044.stdout:7/74: chown cc 950864 1 2024-04-25T22:03:17.780 INFO:tasks.workunit.client.0.smithi044.stdout:3/120: dwrite d0/f20 [0,4194304] 0 2024-04-25T22:03:17.781 INFO:tasks.workunit.client.0.smithi044.stdout:5/87: dread d2/d5/f1b [0,4194304] 0 2024-04-25T22:03:17.782 INFO:tasks.workunit.client.0.smithi044.stdout:7/75: symlink l10 0 2024-04-25T22:03:17.786 INFO:tasks.workunit.client.0.smithi044.stdout:5/88: mkdir d2/d5/d21 0 2024-04-25T22:03:17.786 INFO:tasks.workunit.client.0.smithi044.stdout:3/121: write d0/d2/f3 [287643,100531] 0 2024-04-25T22:03:17.786 INFO:tasks.workunit.client.0.smithi044.stdout:7/76: link c2 c11 0 2024-04-25T22:03:17.786 INFO:tasks.workunit.client.0.smithi044.stdout:5/89: mknod d2/d5/c22 0 2024-04-25T22:03:17.786 INFO:tasks.workunit.client.0.smithi044.stdout:3/122: mknod d0/d1/d15/c2a 0 2024-04-25T22:03:17.786 INFO:tasks.workunit.client.0.smithi044.stdout:0/114: dwrite d8/df/f1b [0,4194304] 0 2024-04-25T22:03:17.787 INFO:tasks.workunit.client.0.smithi044.stdout:1/131: write d3/d7/f23 [468078,37324] 0 2024-04-25T22:03:17.787 INFO:tasks.workunit.client.0.smithi044.stdout:5/90: write d2/f19 [629789,21193] 0 2024-04-25T22:03:17.787 INFO:tasks.workunit.client.0.smithi044.stdout:3/123: creat d0/d13/d1c/f2b x:0 0 0 2024-04-25T22:03:17.788 INFO:tasks.workunit.client.0.smithi044.stdout:1/132: mkdir d3/d7/d29 0 2024-04-25T22:03:17.789 INFO:tasks.workunit.client.0.smithi044.stdout:5/91: truncate d2/d5/f17 1001140 0 2024-04-25T22:03:17.790 INFO:tasks.workunit.client.0.smithi044.stdout:5/92: dread - d2/d5/f1f zero size 2024-04-25T22:03:17.791 INFO:tasks.workunit.client.0.smithi044.stdout:9/169: dwrite d4/d7/d18/d2d/f38 [0,4194304] 0 2024-04-25T22:03:17.791 INFO:tasks.workunit.client.0.smithi044.stdout:1/133: write d3/d7/db/f15 [1033604,129559] 0 2024-04-25T22:03:17.792 INFO:tasks.workunit.client.0.smithi044.stdout:3/124: getdents d0/d1/d15/df/d12/dd 0 2024-04-25T22:03:17.792 INFO:tasks.workunit.client.0.smithi044.stdout:9/170: rmdir d4/d7 39 2024-04-25T22:03:17.792 INFO:tasks.workunit.client.0.smithi044.stdout:1/134: chown d3/d7 3795 1 2024-04-25T22:03:17.793 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:03:17.793 INFO:tasks.workunit.client.0.smithi044.stdout:3/125: chown d0/d13/d1c/f2b 482014 1 2024-04-25T22:03:17.795 INFO:tasks.workunit.client.0.smithi044.stdout:1/135: write d3/d7/db/f15 [3123986,93089] 0 2024-04-25T22:03:17.795 INFO:tasks.workunit.client.0.smithi044.stdout:7/77: dwrite f0 [0,4194304] 0 2024-04-25T22:03:17.797 INFO:tasks.workunit.client.0.smithi044.stdout:7/78: write f0 [1014897,35345] 0 2024-04-25T22:03:17.797 INFO:tasks.workunit.client.0.smithi044.stdout:1/136: dread d3/d7/f23 [0,4194304] 0 2024-04-25T22:03:17.797 INFO:tasks.workunit.client.0.smithi044.stdout:7/79: creat f12 x:0 0 0 2024-04-25T22:03:17.802 INFO:tasks.workunit.client.0.smithi044.stdout:5/93: dwrite d2/d5/f17 [0,4194304] 0 2024-04-25T22:03:17.804 INFO:tasks.workunit.client.0.smithi044.stdout:3/126: dwrite d0/d1/fe [4194304,4194304] 0 2024-04-25T22:03:17.805 INFO:tasks.workunit.client.0.smithi044.stdout:3/127: chown d0/d1/d15/df/d12/dd/l14 126 1 2024-04-25T22:03:17.806 INFO:tasks.workunit.client.0.smithi044.stdout:1/137: dwrite d3/d7/db/f1d [0,4194304] 0 2024-04-25T22:03:17.807 INFO:tasks.workunit.client.0.smithi044.stdout:3/128: dread - d0/d1/d15/df/d12/dd/f22 zero size 2024-04-25T22:03:17.807 INFO:tasks.workunit.client.0.smithi044.stdout:5/94: mkdir d2/d5/d21/d23 0 2024-04-25T22:03:17.807 INFO:tasks.workunit.client.0.smithi044.stdout:5/95: truncate d2/f1d 28930 0 2024-04-25T22:03:17.807 INFO:tasks.workunit.client.0.smithi044.stdout:3/129: write d0/d1/fe [1983320,110898] 0 2024-04-25T22:03:17.809 INFO:tasks.workunit.client.0.smithi044.stdout:1/138: link d3/d7/f1e d3/d7/f2a 0 2024-04-25T22:03:17.809 INFO:tasks.workunit.client.0.smithi044.stdout:5/96: write d2/d5/f1b [341416,25932] 0 2024-04-25T22:03:17.811 INFO:tasks.workunit.client.0.smithi044.stdout:3/130: creat d0/d1/d15/df/d12/dd/d11/f2c x:0 0 0 2024-04-25T22:03:17.811 INFO:tasks.workunit.client.0.smithi044.stdout:5/97: creat d2/f24 x:0 0 0 2024-04-25T22:03:17.811 INFO:tasks.workunit.client.0.smithi044.stdout:9/171: truncate d4/ff 3171798 0 2024-04-25T22:03:17.812 INFO:tasks.workunit.client.0.smithi044.stdout:7/80: getdents . 0 2024-04-25T22:03:17.813 INFO:tasks.workunit.client.0.smithi044.stdout:3/131: dread - d0/d1/d15/df/d12/dd/d11/f2c zero size 2024-04-25T22:03:17.813 INFO:tasks.workunit.client.0.smithi044.stdout:1/139: mkdir d3/d2b 0 2024-04-25T22:03:17.814 INFO:tasks.workunit.client.0.smithi044.stdout:3/132: write d0/d1/d15/df/d12/dd/f22 [203187,63054] 0 2024-04-25T22:03:17.815 INFO:tasks.workunit.client.0.smithi044.stdout:9/172: mknod d4/d7/d18/d3a/c3c 0 2024-04-25T22:03:17.816 INFO:tasks.workunit.client.0.smithi044.stdout:1/140: rmdir d3 39 2024-04-25T22:03:17.817 INFO:tasks.workunit.client.0.smithi044.stdout:9/173: mkdir d4/d3d 0 2024-04-25T22:03:17.817 INFO:tasks.workunit.client.0.smithi044.stdout:1/141: creat d3/d7/f2c x:0 0 0 2024-04-25T22:03:17.818 INFO:tasks.workunit.client.0.smithi044.stdout:1/142: rename d3/d2b to d3/d7/d29/d2d 0 2024-04-25T22:03:17.820 INFO:tasks.workunit.client.0.smithi044.stdout:7/81: dwrite fa [0,4194304] 0 2024-04-25T22:03:17.820 INFO:tasks.workunit.client.0.smithi044.stdout:3/133: dread d0/f6 [0,4194304] 0 2024-04-25T22:03:17.823 INFO:tasks.workunit.client.0.smithi044.stdout:6/172: sync 2024-04-25T22:03:17.823 INFO:tasks.workunit.client.0.smithi044.stdout:5/98: truncate d2/d5/f1b 345453 0 2024-04-25T22:03:17.825 INFO:tasks.workunit.client.0.smithi044.stdout:5/99: truncate d2/f20 82191 0 2024-04-25T22:03:17.826 INFO:tasks.workunit.client.0.smithi044.stdout:6/173: creat d2/d8/d11/d2a/f3c x:0 0 0 2024-04-25T22:03:17.826 INFO:tasks.workunit.client.0.smithi044.stdout:7/82: dread f9 [0,4194304] 0 2024-04-25T22:03:17.828 INFO:tasks.workunit.client.0.smithi044.stdout:5/100: write d2/f1d [446468,71817] 0 2024-04-25T22:03:17.828 INFO:tasks.workunit.client.0.smithi044.stdout:7/83: chown cf 173413 1 2024-04-25T22:03:17.828 INFO:tasks.workunit.client.0.smithi044.stdout:9/174: chown d4/ff 11636 1 2024-04-25T22:03:17.829 INFO:tasks.workunit.client.0.smithi044.stdout:7/84: creat f13 x:0 0 0 2024-04-25T22:03:17.829 INFO:tasks.workunit.client.0.smithi044.stdout:7/85: rmdir - no directory 2024-04-25T22:03:17.830 INFO:tasks.workunit.client.0.smithi044.stdout:1/143: dwrite d3/d7/db/f1d [0,4194304] 0 2024-04-25T22:03:17.830 INFO:tasks.workunit.client.0.smithi044.stdout:5/101: read d2/f1d [471132,75152] 0 2024-04-25T22:03:17.831 INFO:tasks.workunit.client.0.smithi044.stdout:6/174: write d2/d8/d12/d27/f31 [13293,14418] 0 2024-04-25T22:03:17.832 INFO:tasks.workunit.client.0.smithi044.stdout:5/102: chown d2/d5/lc 43 1 2024-04-25T22:03:17.832 INFO:tasks.workunit.client.0.smithi044.stdout:9/175: creat d4/d7/d18/d3a/f3e x:0 0 0 2024-04-25T22:03:17.833 INFO:tasks.workunit.client.0.smithi044.stdout:3/134: dwrite d0/d1/d15/df/d12/f29 [0,4194304] 0 2024-04-25T22:03:17.833 INFO:tasks.workunit.client.0.smithi044.stdout:1/144: chown d3/d7/db/cd 1090001822 1 2024-04-25T22:03:17.833 INFO:tasks.workunit.client.0.smithi044.stdout:6/175: chown d2/d8/d11/d3b/f24 3457002 1 2024-04-25T22:03:17.835 INFO:tasks.workunit.client.0.smithi044.stdout:1/145: truncate d3/d7/f17 3951020 0 2024-04-25T22:03:17.835 INFO:tasks.workunit.client.0.smithi044.stdout:9/176: getdents d4/d3d 0 2024-04-25T22:03:17.836 INFO:tasks.workunit.client.0.smithi044.stdout:3/135: fdatasync d0/d13/d1c/f2b 0 2024-04-25T22:03:17.836 INFO:tasks.workunit.client.0.smithi044.stdout:5/103: dread - d2/d5/f16 zero size 2024-04-25T22:03:17.837 INFO:tasks.workunit.client.0.smithi044.stdout:7/86: dread f5 [0,4194304] 0 2024-04-25T22:03:17.839 INFO:tasks.workunit.client.0.smithi044.stdout:1/146: truncate d3/d7/f1e 213789 0 2024-04-25T22:03:17.839 INFO:tasks.workunit.client.0.smithi044.stdout:3/136: write d0/f6 [3355407,102336] 0 2024-04-25T22:03:17.839 INFO:tasks.workunit.client.0.smithi044.stdout:9/177: rename d4/f2b to d4/d7/d18/d2e/f3f 0 2024-04-25T22:03:17.840 INFO:tasks.workunit.client.0.smithi044.stdout:7/87: creat f14 x:0 0 0 2024-04-25T22:03:17.840 INFO:tasks.workunit.client.0.smithi044.stdout:9/178: stat d4/d7/d18/d2d/c30 0 2024-04-25T22:03:17.841 INFO:tasks.workunit.client.0.smithi044.stdout:7/88: fdatasync f12 0 2024-04-25T22:03:17.841 INFO:tasks.workunit.client.0.smithi044.stdout:6/176: dread d2/d8/f1b [0,4194304] 0 2024-04-25T22:03:17.841 INFO:tasks.workunit.client.0.smithi044.stdout:9/179: truncate d4/ff 4187718 0 2024-04-25T22:03:17.843 INFO:tasks.workunit.client.0.smithi044.stdout:7/89: creat f15 x:0 0 0 2024-04-25T22:03:17.843 INFO:tasks.workunit.client.0.smithi044.stdout:9/180: readlink d4/l12 0 2024-04-25T22:03:17.844 INFO:tasks.workunit.client.0.smithi044.stdout:7/90: creat f16 x:0 0 0 2024-04-25T22:03:17.845 INFO:tasks.workunit.client.0.smithi044.stdout:9/181: dread - d4/f3b zero size 2024-04-25T22:03:17.845 INFO:tasks.workunit.client.0.smithi044.stdout:6/177: link d2/d23/f28 d2/d8/d13/f3d 0 2024-04-25T22:03:17.846 INFO:tasks.workunit.client.0.smithi044.stdout:5/104: dwrite d2/f24 [0,4194304] 0 2024-04-25T22:03:17.847 INFO:tasks.workunit.client.0.smithi044.stdout:7/91: rename c11 to c17 0 2024-04-25T22:03:17.848 INFO:tasks.workunit.client.0.smithi044.stdout:7/92: dread - f12 zero size 2024-04-25T22:03:17.849 INFO:tasks.workunit.client.0.smithi044.stdout:1/147: dwrite d3/d7/db/f15 [0,4194304] 0 2024-04-25T22:03:17.849 INFO:tasks.workunit.client.0.smithi044.stdout:5/105: rename d2/d5/l1c to d2/d5/d21/l25 0 2024-04-25T22:03:17.850 INFO:tasks.workunit.client.0.smithi044.stdout:6/178: creat d2/d23/d30/f3e x:0 0 0 2024-04-25T22:03:17.850 INFO:tasks.workunit.client.0.smithi044.stdout:3/137: dwrite d0/d2/f3 [4194304,4194304] 0 2024-04-25T22:03:17.851 INFO:tasks.workunit.client.0.smithi044.stdout:5/106: write d2/d5/f17 [2676047,108967] 0 2024-04-25T22:03:17.852 INFO:tasks.workunit.client.0.smithi044.stdout:6/179: symlink d2/d23/l3f 0 2024-04-25T22:03:17.853 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:17.853 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:17.854 INFO:tasks.workunit.client.0.smithi044.stdout:6/180: dread - d2/d8/d11/d2a/f3c zero size 2024-04-25T22:03:17.854 INFO:tasks.workunit.client.0.smithi044.stdout:5/107: mkdir d2/d5/d21/d26 0 2024-04-25T22:03:17.856 INFO:tasks.workunit.client.0.smithi044.stdout:6/181: mknod d2/d8/d12/d27/c40 0 2024-04-25T22:03:17.857 INFO:tasks.workunit.client.0.smithi044.stdout:6/182: creat d2/d8/f41 x:0 0 0 2024-04-25T22:03:17.858 INFO:tasks.workunit.client.0.smithi044.stdout:7/93: dwrite f9 [0,4194304] 0 2024-04-25T22:03:17.858 INFO:tasks.workunit.client.0.smithi044.stdout:7/94: readlink l10 0 2024-04-25T22:03:17.859 INFO:tasks.workunit.client.0.smithi044.stdout:7/95: write f12 [409653,68388] 0 2024-04-25T22:03:17.860 INFO:tasks.workunit.client.0.smithi044.stdout:6/183: rmdir d2/d8/d11/d3b 39 2024-04-25T22:03:17.860 INFO:tasks.workunit.client.0.smithi044.stdout:7/96: mknod c18 0 2024-04-25T22:03:17.860 INFO:tasks.workunit.client.0.smithi044.stdout:7/97: rmdir - no directory 2024-04-25T22:03:17.861 INFO:tasks.workunit.client.0.smithi044.stdout:6/184: write d2/d23/d30/f3e [1024639,64694] 0 2024-04-25T22:03:17.861 INFO:tasks.workunit.client.0.smithi044.stdout:9/182: write d4/ff [2060919,39023] 0 2024-04-25T22:03:17.862 INFO:tasks.workunit.client.0.smithi044.stdout:1/148: write d3/d7/f2a [1123627,27023] 0 2024-04-25T22:03:17.862 INFO:tasks.workunit.client.0.smithi044.stdout:6/185: mknod d2/d8/d12/d27/c42 0 2024-04-25T22:03:17.862 INFO:tasks.workunit.client.0.smithi044.stdout:9/183: write d4/d7/f33 [230502,22707] 0 2024-04-25T22:03:17.867 INFO:tasks.workunit.client.0.smithi044.stdout:1/149: write d3/f26 [172826,109077] 0 2024-04-25T22:03:17.868 INFO:tasks.workunit.client.0.smithi044.stdout:6/186: mknod d2/c43 0 2024-04-25T22:03:17.874 INFO:tasks.workunit.client.0.smithi044.stdout:3/138: fsync d0/d1/fe 0 2024-04-25T22:03:17.874 INFO:tasks.workunit.client.0.smithi044.stdout:9/184: fsync d4/d7/d18/d2e/f3f 0 2024-04-25T22:03:17.874 INFO:tasks.workunit.client.0.smithi044.stdout:1/150: symlink d3/d7/db/l2e 0 2024-04-25T22:03:17.874 INFO:tasks.workunit.client.0.smithi044.stdout:6/187: mkdir d2/d23/d44 0 2024-04-25T22:03:17.874 INFO:tasks.workunit.client.0.smithi044.stdout:1/151: stat d3/d7/db/f1d 0 2024-04-25T22:03:17.875 INFO:tasks.workunit.client.0.smithi044.stdout:3/139: write d0/d2/f3 [3931316,46682] 0 2024-04-25T22:03:17.875 INFO:tasks.workunit.client.0.smithi044.stdout:9/185: creat d4/f40 x:0 0 0 2024-04-25T22:03:17.876 INFO:tasks.workunit.client.0.smithi044.stdout:6/188: write d2/d8/d11/d3b/f32 [2145648,105249] 0 2024-04-25T22:03:17.876 INFO:tasks.workunit.client.0.smithi044.stdout:3/140: truncate d0/d1/fe 6150278 0 2024-04-25T22:03:17.877 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:17.872+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:17.878 INFO:tasks.workunit.client.0.smithi044.stdout:6/189: read d2/d8/d13/f3d [401666,126881] 0 2024-04-25T22:03:17.879 INFO:tasks.workunit.client.0.smithi044.stdout:3/141: rename d0/d1/d15/l1a to d0/d1/d15/l2d 0 2024-04-25T22:03:17.880 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:17.880 INFO:tasks.workunit.client.0.smithi044.stdout:6/190: creat d2/d8/d12/d27/f45 x:0 0 0 2024-04-25T22:03:17.880 INFO:tasks.workunit.client.0.smithi044.stdout:3/142: rename d0/d13/d1c/l1e to d0/d13/d1c/l2e 0 2024-04-25T22:03:17.881 INFO:tasks.workunit.client.0.smithi044.stdout:6/191: creat d2/d8/d12/f46 x:0 0 0 2024-04-25T22:03:17.882 INFO:tasks.workunit.client.0.smithi044.stdout:3/143: rmdir d0/d1/d15/df/d12/dd/d11 39 2024-04-25T22:03:17.883 INFO:tasks.workunit.client.0.smithi044.stdout:1/152: dwrite d3/d7/f23 [0,4194304] 0 2024-04-25T22:03:17.884 INFO:tasks.workunit.client.0.smithi044.stdout:9/186: dread d4/d7/d18/d2d/f38 [0,4194304] 0 2024-04-25T22:03:17.884 INFO:tasks.workunit.client.0.smithi044.stdout:6/192: write d2/d8/d12/f19 [2265969,119265] 0 2024-04-25T22:03:17.884 INFO:tasks.workunit.client.0.smithi044.stdout:3/144: write d0/d1/d15/df/d12/f29 [1017554,9243] 0 2024-04-25T22:03:17.884 INFO:tasks.workunit.client.0.smithi044.stdout:1/153: chown d3/d7/db/cd 1240297 1 2024-04-25T22:03:17.886 INFO:tasks.workunit.client.0.smithi044.stdout:1/154: creat d3/d7/f2f x:0 0 0 2024-04-25T22:03:17.887 INFO:tasks.workunit.client.0.smithi044.stdout:1/155: write d3/d7/f23 [1855566,24961] 0 2024-04-25T22:03:17.890 INFO:tasks.workunit.client.0.smithi044.stdout:1/156: rename d3/d7/d29/d2d to d3/d30 0 2024-04-25T22:03:17.892 INFO:tasks.workunit.client.0.smithi044.stdout:1/157: write d3/d7/f8 [4586421,110862] 0 2024-04-25T22:03:17.892 INFO:tasks.workunit.client.0.smithi044.stdout:6/193: dwrite d2/d23/f37 [0,4194304] 0 2024-04-25T22:03:17.892 INFO:tasks.workunit.client.0.smithi044.stdout:9/187: dwrite d4/f32 [0,4194304] 0 2024-04-25T22:03:17.894 INFO:tasks.workunit.client.0.smithi044.stdout:9/188: fsync d4/d7/d18/d3a/f3e 0 2024-04-25T22:03:17.894 INFO:tasks.workunit.client.0.smithi044.stdout:6/194: creat d2/d23/d30/f47 x:0 0 0 2024-04-25T22:03:17.894 INFO:tasks.workunit.client.0.smithi044.stdout:9/189: fsync d4/f23 0 2024-04-25T22:03:17.896 INFO:tasks.workunit.client.0.smithi044.stdout:6/195: truncate d2/d8/d12/d27/f45 151494 0 2024-04-25T22:03:17.898 INFO:tasks.workunit.client.0.smithi044.stdout:9/190: dread d4/f23 [0,4194304] 0 2024-04-25T22:03:17.900 INFO:tasks.workunit.client.0.smithi044.stdout:9/191: rename d4/d7/d18/d2e/l31 to d4/d3d/l41 0 2024-04-25T22:03:17.901 INFO:tasks.workunit.client.0.smithi044.stdout:6/196: dread d2/d8/d12/d27/f31 [0,4194304] 0 2024-04-25T22:03:17.902 INFO:tasks.workunit.client.0.smithi044.stdout:6/197: creat d2/d8/d12/f48 x:0 0 0 2024-04-25T22:03:17.902 INFO:tasks.workunit.client.0.smithi044.stdout:6/198: unlink d2/d8/f41 0 2024-04-25T22:03:17.906 INFO:tasks.workunit.client.0.smithi044.stdout:7/98: fsync f9 0 2024-04-25T22:03:17.907 INFO:tasks.workunit.client.0.smithi044.stdout:7/99: truncate f15 792838 0 2024-04-25T22:03:17.907 INFO:tasks.workunit.client.0.smithi044.stdout:9/192: dwrite d4/ff [0,4194304] 0 2024-04-25T22:03:17.918 INFO:tasks.workunit.client.0.smithi044.stdout:7/100: unlink f16 0 2024-04-25T22:03:17.918 INFO:tasks.workunit.client.0.smithi044.stdout:1/158: getdents d3/d7 0 2024-04-25T22:03:17.919 INFO:tasks.workunit.client.0.smithi044.stdout:9/193: rename d4/ff to d4/d7/d18/d2e/f42 0 2024-04-25T22:03:17.919 INFO:tasks.workunit.client.0.smithi044.stdout:6/199: mkdir d2/d8/d12/d49 0 2024-04-25T22:03:17.920 INFO:tasks.workunit.client.0.smithi044.stdout:1/159: read d3/d7/db/f1d [355113,91875] 0 2024-04-25T22:03:17.921 INFO:tasks.workunit.client.0.smithi044.stdout:9/194: mknod d4/d3d/c43 0 2024-04-25T22:03:17.921 INFO:tasks.workunit.client.0.smithi044.stdout:6/200: readlink d2/d8/d11/d3b/l38 0 2024-04-25T22:03:17.924 INFO:tasks.workunit.client.0.smithi044.stdout:3/145: dwrite d0/d1/fe [0,4194304] 0 2024-04-25T22:03:17.928 INFO:tasks.workunit.client.0.smithi044.stdout:7/101: dwrite f0 [0,4194304] 0 2024-04-25T22:03:17.928 INFO:tasks.workunit.client.0.smithi044.stdout:7/102: write fa [3547574,98916] 0 2024-04-25T22:03:17.928 INFO:tasks.workunit.client.0.smithi044.stdout:1/160: rename d3/d7/f2c to d3/d30/f31 0 2024-04-25T22:03:17.928 INFO:tasks.workunit.client.0.smithi044.stdout:6/201: mknod d2/d8/d11/d2a/c4a 0 2024-04-25T22:03:17.930 INFO:tasks.workunit.client.0.smithi044.stdout:3/146: dread d0/d2/f3 [0,4194304] 0 2024-04-25T22:03:17.931 INFO:tasks.workunit.client.0.smithi044.stdout:6/202: mkdir d2/d8/d13/d4b 0 2024-04-25T22:03:17.931 INFO:tasks.workunit.client.0.smithi044.stdout:1/161: unlink d3/d7/db/cd 0 2024-04-25T22:03:17.932 INFO:tasks.workunit.client.0.smithi044.stdout:9/195: dread d4/d7/d18/d2e/f42 [0,4194304] 0 2024-04-25T22:03:17.933 INFO:tasks.workunit.client.0.smithi044.stdout:9/196: mknod d4/c44 0 2024-04-25T22:03:17.934 INFO:tasks.workunit.client.0.smithi044.stdout:6/203: write d2/d8/d12/d27/f45 [905771,97293] 0 2024-04-25T22:03:17.934 INFO:tasks.workunit.client.0.smithi044.stdout:3/147: symlink d0/d1/d15/df/d12/dd/d28/l2f 0 2024-04-25T22:03:17.935 INFO:tasks.workunit.client.0.smithi044.stdout:7/103: dread f9 [0,4194304] 0 2024-04-25T22:03:17.935 INFO:tasks.workunit.client.0.smithi044.stdout:1/162: dread d3/d7/f20 [0,4194304] 0 2024-04-25T22:03:17.935 INFO:tasks.workunit.client.0.smithi044.stdout:9/197: write d4/d7/d18/d2e/f3f [481864,105630] 0 2024-04-25T22:03:17.936 INFO:tasks.workunit.client.0.smithi044.stdout:7/104: chown l10 40 1 2024-04-25T22:03:17.936 INFO:tasks.workunit.client.0.smithi044.stdout:1/163: chown d3 10958203 1 2024-04-25T22:03:17.936 INFO:tasks.workunit.client.0.smithi044.stdout:3/148: truncate d0/d13/d1c/f2b 600879 0 2024-04-25T22:03:17.936 INFO:tasks.workunit.client.0.smithi044.stdout:7/105: write fa [3125501,22684] 0 2024-04-25T22:03:17.937 INFO:tasks.workunit.client.0.smithi044.stdout:1/164: fsync d3/d7/db/f15 0 2024-04-25T22:03:17.937 INFO:tasks.workunit.client.0.smithi044.stdout:9/198: rename d4/d7/d18/d2e/f42 to d4/d37/f45 0 2024-04-25T22:03:17.937 INFO:tasks.workunit.client.0.smithi044.stdout:2/143: sync 2024-04-25T22:03:17.938 INFO:tasks.workunit.client.0.smithi044.stdout:1/165: fdatasync d3/d7/f2a 0 2024-04-25T22:03:17.939 INFO:tasks.workunit.client.0.smithi044.stdout:2/144: creat d7/d8/db/f28 x:0 0 0 2024-04-25T22:03:17.940 INFO:tasks.workunit.client.0.smithi044.stdout:6/204: dread d2/d8/d13/f3d [0,4194304] 0 2024-04-25T22:03:17.940 INFO:tasks.workunit.client.0.smithi044.stdout:1/166: symlink d3/d7/d29/l32 0 2024-04-25T22:03:17.940 INFO:tasks.workunit.client.0.smithi044.stdout:9/199: write d4/d7/d18/d2d/f38 [2199822,98224] 0 2024-04-25T22:03:17.941 INFO:tasks.workunit.client.0.smithi044.stdout:1/167: symlink d3/d30/l33 0 2024-04-25T22:03:17.942 INFO:tasks.workunit.client.0.smithi044.stdout:2/145: link d7/d16/l13 d7/l29 0 2024-04-25T22:03:17.942 INFO:tasks.workunit.client.0.smithi044.stdout:6/205: symlink d2/d8/d11/d2a/l4c 0 2024-04-25T22:03:17.942 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:17.943 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:17.943 INFO:tasks.workunit.client.0.smithi044.stdout:2/146: fdatasync d7/f25 0 2024-04-25T22:03:17.943 INFO:tasks.workunit.client.0.smithi044.stdout:9/200: creat d4/d7/d18/d3a/f46 x:0 0 0 2024-04-25T22:03:17.944 INFO:tasks.workunit.client.0.smithi044.stdout:3/149: dread d0/d1/d15/df/d12/f29 [0,4194304] 0 2024-04-25T22:03:17.944 INFO:tasks.workunit.client.0.smithi044.stdout:6/206: symlink d2/d8/d11/d3b/l4d 0 2024-04-25T22:03:17.944 INFO:tasks.workunit.client.0.smithi044.stdout:2/147: getdents d7/d8/d1c/d26 0 2024-04-25T22:03:17.945 INFO:tasks.workunit.client.0.smithi044.stdout:7/106: dwrite f0 [0,4194304] 0 2024-04-25T22:03:17.945 INFO:tasks.workunit.client.0.smithi044.stdout:9/201: write d4/d7/d18/d2d/f38 [555016,27715] 0 2024-04-25T22:03:17.945 INFO:tasks.workunit.client.0.smithi044.stdout:2/148: mknod d7/d8/db/c2a 0 2024-04-25T22:03:17.946 INFO:tasks.workunit.client.0.smithi044.stdout:7/107: symlink l19 0 2024-04-25T22:03:17.947 INFO:tasks.workunit.client.0.smithi044.stdout:2/149: mknod d7/d8/c2b 0 2024-04-25T22:03:17.947 INFO:tasks.workunit.client.0.smithi044.stdout:6/207: creat d2/d8/d11/f4e x:0 0 0 2024-04-25T22:03:17.948 INFO:tasks.workunit.client.0.smithi044.stdout:9/202: write d4/f1f [862437,10239] 0 2024-04-25T22:03:17.948 INFO:tasks.workunit.client.0.smithi044.stdout:2/150: mkdir d7/d16/d2c 0 2024-04-25T22:03:17.948 INFO:tasks.workunit.client.0.smithi044.stdout:9/203: stat d4/d7/d18/d3a/c3c 0 2024-04-25T22:03:17.949 INFO:tasks.workunit.client.0.smithi044.stdout:3/150: truncate d0/d1/d15/df/d12/dd/d11/f2c 991126 0 2024-04-25T22:03:17.950 INFO:tasks.workunit.client.0.smithi044.stdout:3/151: fsync d0/d2/f3 0 2024-04-25T22:03:17.950 INFO:tasks.workunit.client.0.smithi044.stdout:9/204: rename d4/d7/cb to d4/d7/d18/d2e/c47 0 2024-04-25T22:03:17.951 INFO:tasks.workunit.client.0.smithi044.stdout:9/205: unlink d4/d7/d18/c35 0 2024-04-25T22:03:17.952 INFO:tasks.workunit.client.0.smithi044.stdout:3/152: link d0/d1/d15/df/d12/f29 d0/d13/d1c/f30 0 2024-04-25T22:03:17.953 INFO:tasks.workunit.client.0.smithi044.stdout:9/206: creat d4/d7/d18/d2e/f48 x:0 0 0 2024-04-25T22:03:17.954 INFO:tasks.workunit.client.0.smithi044.stdout:7/108: truncate f15 262737 0 2024-04-25T22:03:17.954 INFO:tasks.workunit.client.0.smithi044.stdout:9/207: mknod d4/d7/d18/d2e/c49 0 2024-04-25T22:03:17.955 INFO:tasks.workunit.client.0.smithi044.stdout:3/153: truncate d0/f6 4509026 0 2024-04-25T22:03:17.955 INFO:tasks.workunit.client.0.smithi044.stdout:7/109: chown cf 3 1 2024-04-25T22:03:17.957 INFO:tasks.workunit.client.0.smithi044.stdout:6/208: dwrite d2/d23/d30/f3e [0,4194304] 0 2024-04-25T22:03:17.957 INFO:tasks.workunit.client.0.smithi044.stdout:7/110: chown c18 477269284 1 2024-04-25T22:03:17.957 INFO:tasks.workunit.client.0.smithi044.stdout:9/208: mknod d4/d7/d18/d2e/c4a 0 2024-04-25T22:03:17.958 INFO:tasks.workunit.client.0.smithi044.stdout:7/111: symlink l1a 0 2024-04-25T22:03:17.959 INFO:tasks.workunit.client.0.smithi044.stdout:6/209: write d2/d8/d11/f16 [756733,84663] 0 2024-04-25T22:03:17.959 INFO:tasks.workunit.client.0.smithi044.stdout:7/112: unlink f5 0 2024-04-25T22:03:17.960 INFO:tasks.workunit.client.0.smithi044.stdout:2/151: dwrite d7/f1b [0,4194304] 0 2024-04-25T22:03:17.960 INFO:tasks.workunit.client.0.smithi044.stdout:6/210: readlink d2/d23/l2e 0 2024-04-25T22:03:17.960 INFO:tasks.workunit.client.0.smithi044.stdout:7/113: chown l10 221585 1 2024-04-25T22:03:17.962 INFO:tasks.workunit.client.0.smithi044.stdout:6/211: chown d2/d8/d12 6976 1 2024-04-25T22:03:17.963 INFO:tasks.workunit.client.0.smithi044.stdout:2/152: rmdir d7/d16 39 2024-04-25T22:03:17.964 INFO:tasks.workunit.client.0.smithi044.stdout:2/153: dread - d7/f25 zero size 2024-04-25T22:03:17.964 INFO:tasks.workunit.client.0.smithi044.stdout:6/212: mkdir d2/d8/d11/d3b/d4f 0 2024-04-25T22:03:17.965 INFO:tasks.workunit.client.0.smithi044.stdout:6/213: fsync d2/d8/d13/f36 0 2024-04-25T22:03:17.965 INFO:tasks.workunit.client.0.smithi044.stdout:9/209: dread d4/f23 [0,4194304] 0 2024-04-25T22:03:17.968 INFO:tasks.workunit.client.0.smithi044.stdout:3/154: dwrite d0/d13/d1c/f2b [0,4194304] 0 2024-04-25T22:03:17.969 INFO:tasks.workunit.client.0.smithi044.stdout:3/155: truncate d0/f20 4778776 0 2024-04-25T22:03:17.969 INFO:tasks.workunit.client.0.smithi044.stdout:1/168: dread d3/d7/f8 [0,4194304] 0 2024-04-25T22:03:17.970 INFO:tasks.workunit.client.0.smithi044.stdout:2/154: mkdir d7/d16/d2d 0 2024-04-25T22:03:17.970 INFO:tasks.workunit.client.0.smithi044.stdout:6/214: creat d2/d8/d11/d3b/d4f/f50 x:0 0 0 2024-04-25T22:03:17.971 INFO:tasks.workunit.client.0.smithi044.stdout:3/156: fdatasync d0/f6 0 2024-04-25T22:03:17.972 INFO:tasks.workunit.client.0.smithi044.stdout:2/155: chown d7/d8/db/c2a 0 1 2024-04-25T22:03:17.972 INFO:tasks.workunit.client.0.smithi044.stdout:6/215: mkdir d2/d8/d12/d51 0 2024-04-25T22:03:17.972 INFO:tasks.workunit.client.0.smithi044.stdout:3/157: write d0/f20 [993277,30615] 0 2024-04-25T22:03:17.973 INFO:tasks.workunit.client.0.smithi044.stdout:1/169: getdents d3 0 2024-04-25T22:03:17.973 INFO:tasks.workunit.client.0.smithi044.stdout:9/210: dwrite d4/f23 [0,4194304] 0 2024-04-25T22:03:17.973 INFO:tasks.workunit.client.0.smithi044.stdout:2/156: mkdir d7/d8/db/d2e 0 2024-04-25T22:03:17.974 INFO:tasks.workunit.client.0.smithi044.stdout:3/158: creat d0/f31 x:0 0 0 2024-04-25T22:03:17.974 INFO:tasks.workunit.client.0.smithi044.stdout:1/170: rename d3/d7/f1e to d3/f34 0 2024-04-25T22:03:17.975 INFO:tasks.workunit.client.0.smithi044.stdout:9/211: mkdir d4/d4b 0 2024-04-25T22:03:17.975 INFO:tasks.workunit.client.0.smithi044.stdout:2/157: write d7/d8/d1c/f27 [1249322,6721] 0 2024-04-25T22:03:17.975 INFO:tasks.workunit.client.0.smithi044.stdout:6/216: mkdir d2/d8/d12/d1f/d52 0 2024-04-25T22:03:17.976 INFO:tasks.workunit.client.0.smithi044.stdout:6/217: fdatasync d2/d8/d11/f21 0 2024-04-25T22:03:17.977 INFO:tasks.workunit.client.0.smithi044.stdout:3/159: rename d0/d1/d15/df/d12/dd/d28/l2f to d0/d1/d15/df/d12/dd/d11/l32 0 2024-04-25T22:03:17.977 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:17.976+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:17.978 INFO:tasks.workunit.client.0.smithi044.stdout:3/160: rmdir d0/d1/d15/d23 39 2024-04-25T22:03:17.978 INFO:tasks.workunit.client.0.smithi044.stdout:2/158: rename d7/d8/db/f28 to d7/d8/db/d2e/f2f 0 2024-04-25T22:03:17.978 INFO:tasks.workunit.client.0.smithi044.stdout:9/212: dread d4/d7/f33 [0,4194304] 0 2024-04-25T22:03:17.978 INFO:tasks.workunit.client.0.smithi044.stdout:6/218: fdatasync d2/f3a 0 2024-04-25T22:03:17.979 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:17.979 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:17.979 INFO:tasks.workunit.client.0.smithi044.stdout:3/161: creat d0/d1/d15/df/f33 x:0 0 0 2024-04-25T22:03:17.979 INFO:tasks.workunit.client.0.smithi044.stdout:9/213: creat d4/d7/d18/d2e/f4c x:0 0 0 2024-04-25T22:03:17.980 INFO:tasks.workunit.client.0.smithi044.stdout:6/219: rename d2/d8/d11/f4e to d2/d23/d30/f53 0 2024-04-25T22:03:17.980 INFO:tasks.workunit.client.0.smithi044.stdout:3/162: rename d0/d1/d15/df/d21 to d0/d1/d34 0 2024-04-25T22:03:17.981 INFO:tasks.workunit.client.0.smithi044.stdout:3/163: rmdir d0 39 2024-04-25T22:03:17.981 INFO:tasks.workunit.client.0.smithi044.stdout:6/220: creat d2/d8/d13/d4b/f54 x:0 0 0 2024-04-25T22:03:17.982 INFO:tasks.workunit.client.0.smithi044.stdout:3/164: chown d0/d2/f3 72 1 2024-04-25T22:03:17.983 INFO:tasks.workunit.client.0.smithi044.stdout:2/159: dread d7/f11 [0,4194304] 0 2024-04-25T22:03:17.983 INFO:tasks.workunit.client.0.smithi044.stdout:6/221: truncate d2/d8/d13/f36 302579 0 2024-04-25T22:03:17.984 INFO:tasks.workunit.client.0.smithi044.stdout:3/165: unlink d0/d2/f3 0 2024-04-25T22:03:17.984 INFO:tasks.workunit.client.0.smithi044.stdout:1/171: dread d3/d7/f2a [0,4194304] 0 2024-04-25T22:03:17.985 INFO:tasks.workunit.client.0.smithi044.stdout:2/160: symlink d7/d16/d2c/l30 0 2024-04-25T22:03:17.985 INFO:tasks.workunit.client.0.smithi044.stdout:3/166: mkdir d0/d1/d15/df/d12/dd/d35 0 2024-04-25T22:03:17.985 INFO:tasks.workunit.client.0.smithi044.stdout:6/222: rename d2/d8/d12/c10 to d2/c55 0 2024-04-25T22:03:17.986 INFO:tasks.workunit.client.0.smithi044.stdout:2/161: creat d7/f31 x:0 0 0 2024-04-25T22:03:17.986 INFO:tasks.workunit.client.0.smithi044.stdout:3/167: readlink d0/d1/d15/df/d12/l19 0 2024-04-25T22:03:17.986 INFO:tasks.workunit.client.0.smithi044.stdout:6/223: symlink d2/d8/d12/d49/l56 0 2024-04-25T22:03:17.989 INFO:tasks.workunit.client.0.smithi044.stdout:6/224: chown d2/d8/d12/d27/c40 28607 1 2024-04-25T22:03:17.990 INFO:tasks.workunit.client.0.smithi044.stdout:6/225: write d2/d8/d12/f19 [1729509,44075] 0 2024-04-25T22:03:17.991 INFO:tasks.workunit.client.0.smithi044.stdout:2/162: dread d7/f11 [0,4194304] 0 2024-04-25T22:03:17.994 INFO:tasks.workunit.client.0.smithi044.stdout:1/172: dwrite d3/d7/f8 [4194304,4194304] 0 2024-04-25T22:03:17.994 INFO:tasks.workunit.client.0.smithi044.stdout:2/163: stat d7/d8/c1a 0 2024-04-25T22:03:17.994 INFO:tasks.workunit.client.0.smithi044.stdout:6/226: dread d2/d8/d12/d27/f2d [0,4194304] 0 2024-04-25T22:03:17.995 INFO:tasks.workunit.client.0.smithi044.stdout:1/173: creat d3/d7/d29/f35 x:0 0 0 2024-04-25T22:03:17.996 INFO:tasks.workunit.client.0.smithi044.stdout:9/214: getdents d4/d7/d18/d2e 0 2024-04-25T22:03:17.996 INFO:tasks.workunit.client.0.smithi044.stdout:3/168: truncate d0/d13/d1c/f2b 4155513 0 2024-04-25T22:03:17.996 INFO:tasks.workunit.client.0.smithi044.stdout:6/227: symlink d2/d8/d11/d3b/d4f/l57 0 2024-04-25T22:03:17.997 INFO:tasks.workunit.client.0.smithi044.stdout:2/164: creat d7/f32 x:0 0 0 2024-04-25T22:03:17.997 INFO:tasks.workunit.client.0.smithi044.stdout:2/165: chown d7/c1f 758 1 2024-04-25T22:03:17.997 INFO:tasks.workunit.client.0.smithi044.stdout:9/215: write d4/d7/f33 [271675,25538] 0 2024-04-25T22:03:17.999 INFO:tasks.workunit.client.0.smithi044.stdout:6/228: link d2/d23/f37 d2/d8/d11/d3b/f58 0 2024-04-25T22:03:17.999 INFO:tasks.workunit.client.0.smithi044.stdout:9/216: read - d4/d7/d18/d3a/f3e zero size 2024-04-25T22:03:18.000 INFO:tasks.workunit.client.0.smithi044.stdout:9/217: creat d4/d7/f4d x:0 0 0 2024-04-25T22:03:18.001 INFO:tasks.workunit.client.0.smithi044.stdout:6/229: symlink d2/d8/d11/d3b/d4f/l59 0 2024-04-25T22:03:18.002 INFO:tasks.workunit.client.0.smithi044.stdout:9/218: write d4/d7/d18/d2e/f3f [1092632,35432] 0 2024-04-25T22:03:18.002 INFO:tasks.workunit.client.0.smithi044.stdout:3/169: mkdir d0/d1/d15/df/d12/dd/d35/d36 0 2024-04-25T22:03:18.002 INFO:tasks.workunit.client.0.smithi044.stdout:1/174: dwrite d3/d7/f2f [0,4194304] 0 2024-04-25T22:03:18.003 INFO:tasks.workunit.client.0.smithi044.stdout:9/219: dread - d4/d7/d18/d3a/f3e zero size 2024-04-25T22:03:18.003 INFO:tasks.workunit.client.0.smithi044.stdout:6/230: fdatasync d2/d8/d11/f21 0 2024-04-25T22:03:18.004 INFO:tasks.workunit.client.0.smithi044.stdout:4/94: sync 2024-04-25T22:03:18.004 INFO:tasks.workunit.client.0.smithi044.stdout:8/246: sync 2024-04-25T22:03:18.004 INFO:tasks.workunit.client.0.smithi044.stdout:0/115: sync 2024-04-25T22:03:18.004 INFO:tasks.workunit.client.0.smithi044.stdout:5/108: sync 2024-04-25T22:03:18.005 INFO:tasks.workunit.client.0.smithi044.stdout:0/116: chown d8/d15 1219 1 2024-04-25T22:03:18.006 INFO:tasks.workunit.client.0.smithi044.stdout:1/175: mknod d3/c36 0 2024-04-25T22:03:18.006 INFO:tasks.workunit.client.0.smithi044.stdout:5/109: mkdir d2/d5/d27 0 2024-04-25T22:03:18.008 INFO:tasks.workunit.client.0.smithi044.stdout:0/117: creat d8/d15/f2a x:0 0 0 2024-04-25T22:03:18.008 INFO:tasks.workunit.client.0.smithi044.stdout:8/247: mkdir d2a/d4a 0 2024-04-25T22:03:18.008 INFO:tasks.workunit.client.0.smithi044.stdout:4/95: creat dd/d19/f2d x:0 0 0 2024-04-25T22:03:18.008 INFO:tasks.workunit.client.0.smithi044.stdout:0/118: readlink l5 0 2024-04-25T22:03:18.008 INFO:tasks.workunit.client.0.smithi044.stdout:2/166: dwrite d7/d8/db/d2e/f2f [0,4194304] 0 2024-04-25T22:03:18.009 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:18.009 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:18.015 INFO:tasks.workunit.client.0.smithi044.stdout:0/119: unlink d8/cc 0 2024-04-25T22:03:18.015 INFO:tasks.workunit.client.0.smithi044.stdout:1/176: link d3/d7/d29/f35 d3/f37 0 2024-04-25T22:03:18.018 INFO:tasks.workunit.client.0.smithi044.stdout:7/114: dread f15 [0,4194304] 0 2024-04-25T22:03:18.019 INFO:tasks.workunit.client.0.smithi044.stdout:3/170: dwrite d0/d1/d15/df/d12/dd/d11/f2c [0,4194304] 0 2024-04-25T22:03:18.022 INFO:tasks.workunit.client.0.smithi044.stdout:0/120: creat d8/f2b x:0 0 0 2024-04-25T22:03:18.022 INFO:tasks.workunit.client.0.smithi044.stdout:4/96: getdents dd 0 2024-04-25T22:03:18.023 INFO:tasks.workunit.client.0.smithi044.stdout:6/231: dwrite d2/d23/d30/f53 [0,4194304] 0 2024-04-25T22:03:18.024 INFO:tasks.workunit.client.0.smithi044.stdout:0/121: read f6 [3971033,6573] 0 2024-04-25T22:03:18.024 INFO:tasks.workunit.client.0.smithi044.stdout:4/97: rename dd to dd/d2e 22 2024-04-25T22:03:18.026 INFO:tasks.workunit.client.0.smithi044.stdout:5/110: dwrite d2/d5/f16 [0,4194304] 0 2024-04-25T22:03:18.027 INFO:tasks.workunit.client.0.smithi044.stdout:7/115: getdents . 0 2024-04-25T22:03:18.027 INFO:tasks.workunit.client.0.smithi044.stdout:9/220: dwrite d4/d7/f39 [4194304,4194304] 0 2024-04-25T22:03:18.028 INFO:tasks.workunit.client.0.smithi044.stdout:6/232: rename d2/d8 to d2/d23/d5a 0 2024-04-25T22:03:18.028 INFO:tasks.workunit.client.0.smithi044.stdout:1/177: link d3/l22 d3/d7/l38 0 2024-04-25T22:03:18.029 INFO:tasks.workunit.client.0.smithi044.stdout:7/116: write f9 [245356,46226] 0 2024-04-25T22:03:18.030 INFO:tasks.workunit.client.0.smithi044.stdout:9/221: fsync d4/d7/d18/d2e/f34 0 2024-04-25T22:03:18.030 INFO:tasks.workunit.client.0.smithi044.stdout:0/122: creat d8/df/d17/f2c x:0 0 0 2024-04-25T22:03:18.030 INFO:tasks.workunit.client.0.smithi044.stdout:8/248: dwrite d2a/d32/f41 [0,4194304] 0 2024-04-25T22:03:18.031 INFO:tasks.workunit.client.0.smithi044.stdout:5/111: write d2/d5/f17 [2344773,100217] 0 2024-04-25T22:03:18.031 INFO:tasks.workunit.client.0.smithi044.stdout:2/167: dwrite d7/f32 [0,4194304] 0 2024-04-25T22:03:18.031 INFO:tasks.workunit.client.0.smithi044.stdout:4/98: rename dd/c1e to dd/d19/c2f 0 2024-04-25T22:03:18.032 INFO:tasks.workunit.client.0.smithi044.stdout:4/99: rename dd to dd/d30 22 2024-04-25T22:03:18.033 INFO:tasks.workunit.client.0.smithi044.stdout:8/249: unlink c21 0 2024-04-25T22:03:18.033 INFO:tasks.workunit.client.0.smithi044.stdout:9/222: rmdir d4/d37 39 2024-04-25T22:03:18.034 INFO:tasks.workunit.client.0.smithi044.stdout:4/100: fsync dd/f17 0 2024-04-25T22:03:18.035 INFO:tasks.workunit.client.0.smithi044.stdout:4/101: stat dd/l13 0 2024-04-25T22:03:18.035 INFO:tasks.workunit.client.0.smithi044.stdout:8/250: rmdir d2a/d39 39 2024-04-25T22:03:18.035 INFO:tasks.workunit.client.0.smithi044.stdout:6/233: chown d2/d23/d5a/d12/d27 7 1 2024-04-25T22:03:18.036 INFO:tasks.workunit.client.0.smithi044.stdout:5/112: rmdir d2/d5/d21/d23 0 2024-04-25T22:03:18.036 INFO:tasks.workunit.client.0.smithi044.stdout:9/223: write d4/d7/f33 [689597,93041] 0 2024-04-25T22:03:18.037 INFO:tasks.workunit.client.0.smithi044.stdout:2/168: rename d7/f25 to d7/d8/d1c/f33 0 2024-04-25T22:03:18.040 INFO:tasks.workunit.client.0.smithi044.stdout:1/178: dread d3/d7/f23 [0,4194304] 0 2024-04-25T22:03:18.040 INFO:tasks.workunit.client.0.smithi044.stdout:6/234: write d2/d23/d5a/d12/f46 [89526,22652] 0 2024-04-25T22:03:18.040 INFO:tasks.workunit.client.0.smithi044.stdout:8/251: creat d2a/d4a/f4b x:0 0 0 2024-04-25T22:03:18.041 INFO:tasks.workunit.client.0.smithi044.stdout:4/102: write dd/f2a [336862,1779] 0 2024-04-25T22:03:18.041 INFO:tasks.workunit.client.0.smithi044.stdout:3/171: dwrite d0/d1/fe [0,4194304] 0 2024-04-25T22:03:18.042 INFO:tasks.workunit.client.0.smithi044.stdout:2/169: creat d7/d8/db/d2e/f34 x:0 0 0 2024-04-25T22:03:18.042 INFO:tasks.workunit.client.0.smithi044.stdout:7/117: dread f0 [0,4194304] 0 2024-04-25T22:03:18.042 INFO:tasks.workunit.client.0.smithi044.stdout:4/103: write fc [3965308,112158] 0 2024-04-25T22:03:18.043 INFO:tasks.workunit.client.0.smithi044.stdout:9/224: mknod d4/d4b/c4e 0 2024-04-25T22:03:18.044 INFO:tasks.workunit.client.0.smithi044.stdout:0/123: dread f6 [0,4194304] 0 2024-04-25T22:03:18.045 INFO:tasks.workunit.client.0.smithi044.stdout:8/252: mknod d2a/d32/c4c 0 2024-04-25T22:03:18.046 INFO:tasks.workunit.client.0.smithi044.stdout:6/235: write d2/d23/d5a/d11/f21 [1621293,78044] 0 2024-04-25T22:03:18.046 INFO:tasks.workunit.client.0.smithi044.stdout:7/118: write f0 [1104514,84649] 0 2024-04-25T22:03:18.047 INFO:tasks.workunit.client.0.smithi044.stdout:2/170: link d7/c1e d7/d8/db/d2e/c35 0 2024-04-25T22:03:18.048 INFO:tasks.workunit.client.0.smithi044.stdout:0/124: fsync d8/d24/f28 0 2024-04-25T22:03:18.050 INFO:tasks.workunit.client.0.smithi044.stdout:6/236: creat d2/d23/d5a/d12/d49/f5b x:0 0 0 2024-04-25T22:03:18.051 INFO:tasks.workunit.client.0.smithi044.stdout:0/125: readlink d8/da/lb 0 2024-04-25T22:03:18.051 INFO:tasks.workunit.client.0.smithi044.stdout:2/171: rename d7/f18 to d7/d8/db/f36 0 2024-04-25T22:03:18.052 INFO:tasks.workunit.client.0.smithi044.stdout:4/104: dread dd/ff [0,4194304] 0 2024-04-25T22:03:18.052 INFO:tasks.workunit.client.0.smithi044.stdout:1/179: dwrite d3/f26 [0,4194304] 0 2024-04-25T22:03:18.053 INFO:tasks.workunit.client.0.smithi044.stdout:3/172: dread d0/d13/d1c/f2b [0,4194304] 0 2024-04-25T22:03:18.053 INFO:tasks.workunit.client.0.smithi044.stdout:0/126: fsync d8/f9 0 2024-04-25T22:03:18.053 INFO:tasks.workunit.client.0.smithi044.stdout:8/253: dread fd [0,4194304] 0 2024-04-25T22:03:18.054 INFO:tasks.workunit.client.0.smithi044.stdout:9/225: dread d4/d7/d18/d2d/f38 [0,4194304] 0 2024-04-25T22:03:18.054 INFO:tasks.workunit.client.0.smithi044.stdout:6/237: write d2/d23/d5a/d11/f21 [4523939,21912] 0 2024-04-25T22:03:18.054 INFO:tasks.workunit.client.0.smithi044.stdout:4/105: unlink dd/f1c 0 2024-04-25T22:03:18.054 INFO:tasks.workunit.client.0.smithi044.stdout:1/180: fdatasync d3/d30/f31 0 2024-04-25T22:03:18.055 INFO:tasks.workunit.client.0.smithi044.stdout:0/127: dread - d8/f11 zero size 2024-04-25T22:03:18.055 INFO:tasks.workunit.client.0.smithi044.stdout:6/238: stat d2/d23/l2e 0 2024-04-25T22:03:18.055 INFO:tasks.workunit.client.0.smithi044.stdout:9/226: dread - d4/f40 zero size 2024-04-25T22:03:18.056 INFO:tasks.workunit.client.0.smithi044.stdout:1/181: dread d3/d7/f20 [0,4194304] 0 2024-04-25T22:03:18.056 INFO:tasks.workunit.client.0.smithi044.stdout:0/128: truncate d8/f9 2062563 0 2024-04-25T22:03:18.056 INFO:tasks.workunit.client.0.smithi044.stdout:4/106: read dd/d19/f27 [401003,120424] 0 2024-04-25T22:03:18.056 INFO:tasks.workunit.client.0.smithi044.stdout:9/227: stat d4/d7/l9 0 2024-04-25T22:03:18.056 INFO:tasks.workunit.client.0.smithi044.stdout:6/239: write d2/d23/d5a/d12/f46 [178818,12247] 0 2024-04-25T22:03:18.058 INFO:tasks.workunit.client.0.smithi044.stdout:6/240: write d2/d23/d5a/d12/d27/f2d [4841026,58973] 0 2024-04-25T22:03:18.058 INFO:tasks.workunit.client.0.smithi044.stdout:9/228: creat d4/d7/d18/f4f x:0 0 0 2024-04-25T22:03:18.059 INFO:tasks.workunit.client.0.smithi044.stdout:4/107: rename dd/l10 to dd/l31 0 2024-04-25T22:03:18.060 INFO:tasks.workunit.client.0.smithi044.stdout:9/229: read f3 [6047419,98397] 0 2024-04-25T22:03:18.060 INFO:tasks.workunit.client.0.smithi044.stdout:4/108: rmdir dd 39 2024-04-25T22:03:18.060 INFO:tasks.workunit.client.0.smithi044.stdout:6/241: dread - d2/d23/d5a/d12/d49/f5b zero size 2024-04-25T22:03:18.061 INFO:tasks.workunit.client.0.smithi044.stdout:4/109: fsync dd/f2a 0 2024-04-25T22:03:18.061 INFO:tasks.workunit.client.0.smithi044.stdout:6/242: rmdir d2 39 2024-04-25T22:03:18.062 INFO:tasks.workunit.client.0.smithi044.stdout:0/129: dread d8/d15/f1f [0,4194304] 0 2024-04-25T22:03:18.062 INFO:tasks.workunit.client.0.smithi044.stdout:0/130: chown d8 650 1 2024-04-25T22:03:18.062 INFO:tasks.workunit.client.0.smithi044.stdout:5/113: dread d2/f1d [0,4194304] 0 2024-04-25T22:03:18.063 INFO:tasks.workunit.client.0.smithi044.stdout:3/173: dwrite d0/d1/fe [4194304,4194304] 0 2024-04-25T22:03:18.063 INFO:tasks.workunit.client.0.smithi044.stdout:4/110: truncate dd/d19/f2d 985409 0 2024-04-25T22:03:18.064 INFO:tasks.workunit.client.0.smithi044.stdout:0/131: symlink d8/df/l2d 0 2024-04-25T22:03:18.064 INFO:tasks.workunit.client.0.smithi044.stdout:6/243: mknod d2/d23/d5a/d13/d4b/c5c 0 2024-04-25T22:03:18.064 INFO:tasks.workunit.client.0.smithi044.stdout:4/111: fsync dd/ff 0 2024-04-25T22:03:18.064 INFO:tasks.workunit.client.0.smithi044.stdout:5/114: rename d2/d5/c13 to d2/c28 0 2024-04-25T22:03:18.065 INFO:tasks.workunit.client.0.smithi044.stdout:6/244: rmdir d2/d23/d44 0 2024-04-25T22:03:18.065 INFO:tasks.workunit.client.0.smithi044.stdout:0/132: write d8/df/d17/f2c [604218,72879] 0 2024-04-25T22:03:18.066 INFO:tasks.workunit.client.0.smithi044.stdout:6/245: fsync d2/d23/f37 0 2024-04-25T22:03:18.067 INFO:tasks.workunit.client.0.smithi044.stdout:6/246: read d2/d23/d30/f3e [256587,57348] 0 2024-04-25T22:03:18.068 INFO:tasks.workunit.client.0.smithi044.stdout:9/230: dwrite d4/d7/f4d [0,4194304] 0 2024-04-25T22:03:18.070 INFO:tasks.workunit.client.0.smithi044.stdout:0/133: getdents d8/d24 0 2024-04-25T22:03:18.070 INFO:tasks.workunit.client.0.smithi044.stdout:6/247: write d2/d23/d5a/d12/d27/f31 [950864,127910] 0 2024-04-25T22:03:18.070 INFO:tasks.workunit.client.0.smithi044.stdout:9/231: mknod d4/d37/c50 0 2024-04-25T22:03:18.072 INFO:tasks.workunit.client.0.smithi044.stdout:9/232: rmdir d4/d7/d18/d3a 39 2024-04-25T22:03:18.073 INFO:tasks.workunit.client.0.smithi044.stdout:9/233: readlink d4/d7/l25 0 2024-04-25T22:03:18.074 INFO:tasks.workunit.client.0.smithi044.stdout:5/115: dwrite d2/d5/f1b [0,4194304] 0 2024-04-25T22:03:18.075 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:18.075 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:03:18.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:03:18.075 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:18.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.075 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T22:03:18.075 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:18.075 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.086315655, 2024-04-25T22:03:18.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.180276931, 2024-04-25T22:03:18.075 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.075 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.075 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4 2024-04-25T22:03:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:18.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983834+0000", 2024-04-25T22:03:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2900000000000001e-06 2024-04-25T22:03:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991787+0000", 2024-04-25T22:03:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079521690000000003 2024-04-25T22:03:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991826+0000", 2024-04-25T22:03:18.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9258999999999998e-05 2024-04-25T22:03:18.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991845+0000", 2024-04-25T22:03:18.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9360000000000001e-05 2024-04-25T22:03:18.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992058+0000", 2024-04-25T22:03:18.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212559 2024-04-25T22:03:18.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992213+0000", 2024-04-25T22:03:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015520700000000001 2024-04-25T22:03:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992414+0000", 2024-04-25T22:03:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020049 2024-04-25T22:03:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162511+0000", 2024-04-25T22:03:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.17009782900000001 2024-04-25T22:03:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163967+0000", 2024-04-25T22:03:18.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001455752 2024-04-25T22:03:18.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164045+0000", 2024-04-25T22:03:18.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7415000000000003e-05 2024-04-25T22:03:18.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164109+0000", 2024-04-25T22:03:18.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4601e-05 2024-04-25T22:03:18.080 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 25.986857507, 2024-04-25T22:03:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.12612672599999999, 2024-04-25T22:03:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2024-04-25T22:03:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083293+0000", 2024-04-25T22:03:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6630000000000002e-06 2024-04-25T22:03:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086619+0000", 2024-04-25T22:03:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033261699999999998 2024-04-25T22:03:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086647+0000", 2024-04-25T22:03:18.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8085999999999998e-05 2024-04-25T22:03:18.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086665+0000", 2024-04-25T22:03:18.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:03:18.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086870+0000", 2024-04-25T22:03:18.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020488599999999999 2024-04-25T22:03:18.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087110+0000", 2024-04-25T22:03:18.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024093199999999999 2024-04-25T22:03:18.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087310+0000", 2024-04-25T22:03:18.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000199936 2024-04-25T22:03:18.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207766+0000", 2024-04-25T22:03:18.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.120456035 2024-04-25T22:03:18.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209358+0000", 2024-04-25T22:03:18.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015912369999999999 2024-04-25T22:03:18.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209390+0000", 2024-04-25T22:03:18.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2434999999999997e-05 2024-04-25T22:03:18.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209417+0000", 2024-04-25T22:03:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6936000000000001e-05 2024-04-25T22:03:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6847 4.16 4:68767fd1:::10000001f4f.00000000:head [write 0~7212] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.376676194, 2024-04-25T22:03:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0208302119999999, 2024-04-25T22:03:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.087 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:18.088 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:18.088 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.088 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6847 2024-04-25T22:03:18.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.088 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:18.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693473+0000", 2024-04-25T22:03:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.75e-06 2024-04-25T22:03:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693490+0000", 2024-04-25T22:03:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6540000000000001e-05 2024-04-25T22:03:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693509+0000", 2024-04-25T22:03:18.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9536999999999999e-05 2024-04-25T22:03:18.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693522+0000", 2024-04-25T22:03:18.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2099000000000001e-05 2024-04-25T22:03:18.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693677+0000", 2024-04-25T22:03:18.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015516799999999999 2024-04-25T22:03:18.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693705+0000", 2024-04-25T22:03:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8663e-05 2024-04-25T22:03:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705551+0000", 2024-04-25T22:03:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.011845495 2024-04-25T22:03:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705942+0000", 2024-04-25T22:03:18.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00039080099999999997 2024-04-25T22:03:18.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:18.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.706151+0000", 2024-04-25T22:03:18.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000209457 2024-04-25T22:03:18.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711141+0000", 2024-04-25T22:03:18.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049901240000000003 2024-04-25T22:03:18.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714005+0000", 2024-04-25T22:03:18.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028642229999999999 2024-04-25T22:03:18.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714180+0000", 2024-04-25T22:03:18.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017433699999999999 2024-04-25T22:03:18.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714302+0000", 2024-04-25T22:03:18.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122018 2024-04-25T22:03:18.093 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.093 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.094 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.094 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6960 4.16 4:6823d322:::10000001fd2.00000000:head [write 0~150] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:18.094 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:18.094 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.099672096000001, 2024-04-25T22:03:18.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.74417278899999995, 2024-04-25T22:03:18.094 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.094 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.094 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.094 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:18.094 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:18.094 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.094 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6960 2024-04-25T22:03:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970478+0000", 2024-04-25T22:03:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.939e-06 2024-04-25T22:03:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970488+0000", 2024-04-25T22:03:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9699999999999994e-06 2024-04-25T22:03:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970524+0000", 2024-04-25T22:03:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5963000000000001e-05 2024-04-25T22:03:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970537+0000", 2024-04-25T22:03:18.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.31e-05 2024-04-25T22:03:18.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970701+0000", 2024-04-25T22:03:18.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164177 2024-04-25T22:03:18.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:18.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970718+0000", 2024-04-25T22:03:18.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7323e-05 2024-04-25T22:03:18.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707632+0000", 2024-04-25T22:03:18.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.73691394300000002 2024-04-25T22:03:18.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707924+0000", 2024-04-25T22:03:18.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029223299999999998 2024-04-25T22:03:18.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:18.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.708389+0000", 2024-04-25T22:03:18.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046429300000000001 2024-04-25T22:03:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029039830000000002 2024-04-25T22:03:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714409+0000", 2024-04-25T22:03:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031159260000000002 2024-04-25T22:03:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714538+0000", 2024-04-25T22:03:18.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012952100000000001 2024-04-25T22:03:18.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714649+0000", 2024-04-25T22:03:18.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110418 2024-04-25T22:03:18.100 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.100 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.100 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.100 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7039 4.16 4:6919637e:::10000002032.00000000:head [write 0~2968] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:18.100 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:18.100 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 12.913625591000001, 2024-04-25T22:03:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.56024932199999999, 2024-04-25T22:03:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7039 2024-04-25T22:03:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:18.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:18.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156523+0000", 2024-04-25T22:03:18.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2130000000000001e-06 2024-04-25T22:03:18.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156530+0000", 2024-04-25T22:03:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9090000000000003e-06 2024-04-25T22:03:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156544+0000", 2024-04-25T22:03:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3271999999999999e-05 2024-04-25T22:03:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156551+0000", 2024-04-25T22:03:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4970000000000004e-06 2024-04-25T22:03:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156639+0000", 2024-04-25T22:03:18.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7638000000000004e-05 2024-04-25T22:03:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156649+0000", 2024-04-25T22:03:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0536e-05 2024-04-25T22:03:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709515+0000", 2024-04-25T22:03:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.55286568999999997 2024-04-25T22:03:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709836+0000", 2024-04-25T22:03:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032078899999999998 2024-04-25T22:03:18.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.710271+0000", 2024-04-25T22:03:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043530000000000001 2024-04-25T22:03:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716576+0000", 2024-04-25T22:03:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063045050000000002 2024-04-25T22:03:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716605+0000", 2024-04-25T22:03:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8949e-05 2024-04-25T22:03:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716706+0000", 2024-04-25T22:03:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101765 2024-04-25T22:03:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716772+0000", 2024-04-25T22:03:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5259000000000007e-05 2024-04-25T22:03:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7065 4.16 4:697a9f10:::10000002050.00000000:head [write 0~16297] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:18.106 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 12.856009643, 2024-04-25T22:03:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.50307290800000004, 2024-04-25T22:03:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7065 2024-04-25T22:03:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:18.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:18.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214139+0000", 2024-04-25T22:03:18.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.186e-06 2024-04-25T22:03:18.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214170+0000", 2024-04-25T22:03:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0419000000000001e-05 2024-04-25T22:03:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214186+0000", 2024-04-25T22:03:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6526000000000001e-05 2024-04-25T22:03:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214194+0000", 2024-04-25T22:03:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6769999999999995e-06 2024-04-25T22:03:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214380+0000", 2024-04-25T22:03:18.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018580699999999999 2024-04-25T22:03:18.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:18.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214399+0000", 2024-04-25T22:03:18.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9446e-05 2024-04-25T22:03:18.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711402+0000", 2024-04-25T22:03:18.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.497002901 2024-04-25T22:03:18.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711822+0000", 2024-04-25T22:03:18.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00041989399999999997 2024-04-25T22:03:18.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:18.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.712017+0000", 2024-04-25T22:03:18.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019540700000000001 2024-04-25T22:03:18.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716792+0000", 2024-04-25T22:03:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047748210000000003 2024-04-25T22:03:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716937+0000", 2024-04-25T22:03:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014479099999999999 2024-04-25T22:03:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717081+0000", 2024-04-25T22:03:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014412100000000001 2024-04-25T22:03:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717211+0000", 2024-04-25T22:03:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012991200000000001 2024-04-25T22:03:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7089 4.16 4:6868fcac:::1000000206b.00000000:head [write 0~5386] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 12.796455649, 2024-04-25T22:03:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44658810700000001, 2024-04-25T22:03:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7089 2024-04-25T22:03:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:18.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273695+0000", 2024-04-25T22:03:18.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.463e-06 2024-04-25T22:03:18.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273712+0000", 2024-04-25T22:03:18.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7842999999999998e-05 2024-04-25T22:03:18.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273742+0000", 2024-04-25T22:03:18.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9039000000000001e-05 2024-04-25T22:03:18.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273756+0000", 2024-04-25T22:03:18.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4406999999999999e-05 2024-04-25T22:03:18.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273943+0000", 2024-04-25T22:03:18.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018708 2024-04-25T22:03:18.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:18.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273961+0000", 2024-04-25T22:03:18.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7977000000000001e-05 2024-04-25T22:03:18.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714748+0000", 2024-04-25T22:03:18.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.440786605 2024-04-25T22:03:18.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715013+0000", 2024-04-25T22:03:18.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026558300000000001 2024-04-25T22:03:18.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715309+0000", 2024-04-25T22:03:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000295715 2024-04-25T22:03:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.719035+0000", 2024-04-25T22:03:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037256310000000001 2024-04-25T22:03:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720142+0000", 2024-04-25T22:03:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001107053 2024-04-25T22:03:18.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720221+0000", 2024-04-25T22:03:18.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9832000000000004e-05 2024-04-25T22:03:18.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720280+0000", 2024-04-25T22:03:18.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8879000000000003e-05 2024-04-25T22:03:18.119 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.119 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.119 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.120 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7090 4.16 4:69dc3034:::1000000206c.00000000:head [write 0~957] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:18.120 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:18.120 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 12.793831319000001, 2024-04-25T22:03:18.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44572077100000002, 2024-04-25T22:03:18.120 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.120 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.120 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.120 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:18.120 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:18.120 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.120 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7090 2024-04-25T22:03:18.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.120 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:18.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:18.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276319+0000", 2024-04-25T22:03:18.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3429999999999998e-06 2024-04-25T22:03:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276330+0000", 2024-04-25T22:03:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1567e-05 2024-04-25T22:03:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276362+0000", 2024-04-25T22:03:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1863000000000003e-05 2024-04-25T22:03:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276377+0000", 2024-04-25T22:03:18.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5102999999999999e-05 2024-04-25T22:03:18.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276564+0000", 2024-04-25T22:03:18.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018629700000000001 2024-04-25T22:03:18.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:18.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276583+0000", 2024-04-25T22:03:18.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9743000000000001e-05 2024-04-25T22:03:18.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717354+0000", 2024-04-25T22:03:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44077094900000002 2024-04-25T22:03:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717723+0000", 2024-04-25T22:03:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036839099999999998 2024-04-25T22:03:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.718097+0000", 2024-04-25T22:03:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037392099999999999 2024-04-25T22:03:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720305+0000", 2024-04-25T22:03:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022084439999999999 2024-04-25T22:03:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721866+0000", 2024-04-25T22:03:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015610260000000001 2024-04-25T22:03:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721944+0000", 2024-04-25T22:03:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7961999999999997e-05 2024-04-25T22:03:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.722037+0000", 2024-04-25T22:03:18.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3162e-05 2024-04-25T22:03:18.126 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.126 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.126 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.126 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:261 3.1d 3:bf8dcf43:::200.00000008:head [write 3727070~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:18.126 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682317+0000", 2024-04-25T22:03:18.126 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.3878304690000007, 2024-04-25T22:03:18.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.090430008000000006, 2024-04-25T22:03:18.126 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.126 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682317+0000", 2024-04-25T22:03:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682317+0000", 2024-04-25T22:03:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682319+0000", 2024-04-25T22:03:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1570000000000001e-06 2024-04-25T22:03:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682333+0000", 2024-04-25T22:03:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4070000000000001e-05 2024-04-25T22:03:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682354+0000", 2024-04-25T22:03:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0916000000000001e-05 2024-04-25T22:03:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682367+0000", 2024-04-25T22:03:18.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3560000000000001e-05 2024-04-25T22:03:18.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.767445+0000", 2024-04-25T22:03:18.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085078215999999998 2024-04-25T22:03:18.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.767588+0000", 2024-04-25T22:03:18.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000142824 2024-04-25T22:03:18.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.767781+0000", 2024-04-25T22:03:18.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019285099999999999 2024-04-25T22:03:18.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772528+0000", 2024-04-25T22:03:18.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047471010000000001 2024-04-25T22:03:18.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772558+0000", 2024-04-25T22:03:18.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0355999999999999e-05 2024-04-25T22:03:18.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772667+0000", 2024-04-25T22:03:18.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108859 2024-04-25T22:03:18.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772747+0000", 2024-04-25T22:03:18.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0098000000000005e-05 2024-04-25T22:03:18.131 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.131 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.131 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.132 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:262 3.1d 3:bf8dcf43:::200.00000008:head [write 3728472~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:18.132 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682382+0000", 2024-04-25T22:03:18.132 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.3877655699999991, 2024-04-25T22:03:18.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.09080241, 2024-04-25T22:03:18.132 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.132 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.132 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.132 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682382+0000", 2024-04-25T22:03:18.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682382+0000", 2024-04-25T22:03:18.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682383+0000", 2024-04-25T22:03:18.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:03:18.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682390+0000", 2024-04-25T22:03:18.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5629999999999997e-06 2024-04-25T22:03:18.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682410+0000", 2024-04-25T22:03:18.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0477000000000001e-05 2024-04-25T22:03:18.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682424+0000", 2024-04-25T22:03:18.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3216e-05 2024-04-25T22:03:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.768876+0000", 2024-04-25T22:03:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.086452575000000004 2024-04-25T22:03:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.769130+0000", 2024-04-25T22:03:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025331900000000001 2024-04-25T22:03:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.769501+0000", 2024-04-25T22:03:18.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037142099999999998 2024-04-25T22:03:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772761+0000", 2024-04-25T22:03:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032599510000000001 2024-04-25T22:03:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.772901+0000", 2024-04-25T22:03:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014047500000000001 2024-04-25T22:03:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.773057+0000", 2024-04-25T22:03:18.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015578799999999999 2024-04-25T22:03:18.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.773185+0000", 2024-04-25T22:03:18.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012751799999999999 2024-04-25T22:03:18.137 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.137 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.137 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.137 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:263 3.1d 3:bf8dcf43:::200.00000008:head [write 3729875~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:18.137 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682439+0000", 2024-04-25T22:03:18.137 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.3877085109999996, 2024-04-25T22:03:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093602454000000002, 2024-04-25T22:03:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682439+0000", 2024-04-25T22:03:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682439+0000", 2024-04-25T22:03:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682440+0000", 2024-04-25T22:03:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.06e-06 2024-04-25T22:03:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682469+0000", 2024-04-25T22:03:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8269999999999999e-05 2024-04-25T22:03:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682490+0000", 2024-04-25T22:03:18.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1702999999999999e-05 2024-04-25T22:03:18.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682504+0000", 2024-04-25T22:03:18.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.394e-05 2024-04-25T22:03:18.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.770262+0000", 2024-04-25T22:03:18.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087757522000000004 2024-04-25T22:03:18.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.770501+0000", 2024-04-25T22:03:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000239612 2024-04-25T22:03:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.770841+0000", 2024-04-25T22:03:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034001499999999999 2024-04-25T22:03:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.774702+0000", 2024-04-25T22:03:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038608660000000001 2024-04-25T22:03:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.775840+0000", 2024-04-25T22:03:18.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001137299 2024-04-25T22:03:18.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.775935+0000", 2024-04-25T22:03:18.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5785000000000005e-05 2024-04-25T22:03:18.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.776042+0000", 2024-04-25T22:03:18.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106382 2024-04-25T22:03:18.142 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.142 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.143 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.143 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:264 3.1d 3:bf8dcf43:::200.00000008:head [write 3731277~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:18.143 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682521+0000", 2024-04-25T22:03:18.143 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.3876271320000004, 2024-04-25T22:03:18.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.09716756, 2024-04-25T22:03:18.143 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.143 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.143 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.143 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682521+0000", 2024-04-25T22:03:18.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682521+0000", 2024-04-25T22:03:18.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682522+0000", 2024-04-25T22:03:18.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.074e-06 2024-04-25T22:03:18.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682529+0000", 2024-04-25T22:03:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7630000000000003e-06 2024-04-25T22:03:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682573+0000", 2024-04-25T22:03:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4499000000000002e-05 2024-04-25T22:03:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682592+0000", 2024-04-25T22:03:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9323000000000001e-05 2024-04-25T22:03:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.773315+0000", 2024-04-25T22:03:18.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.090722811 2024-04-25T22:03:18.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.773542+0000", 2024-04-25T22:03:18.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00022711899999999999 2024-04-25T22:03:18.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.773723+0000", 2024-04-25T22:03:18.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000180321 2024-04-25T22:03:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779406+0000", 2024-04-25T22:03:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005683474 2024-04-25T22:03:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779531+0000", 2024-04-25T22:03:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000125208 2024-04-25T22:03:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779622+0000", 2024-04-25T22:03:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0643000000000006e-05 2024-04-25T22:03:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779688+0000", 2024-04-25T22:03:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6324999999999999e-05 2024-04-25T22:03:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:265 3.1d 3:bf8dcf43:::200.00000008:head [write 3732680~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682617+0000", 2024-04-25T22:03:18.148 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.3875310600000006, 2024-04-25T22:03:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.097415482999999997, 2024-04-25T22:03:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682617+0000", 2024-04-25T22:03:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682617+0000", 2024-04-25T22:03:18.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682618+0000", 2024-04-25T22:03:18.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:03:18.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682625+0000", 2024-04-25T22:03:18.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4059999999999999e-06 2024-04-25T22:03:18.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682643+0000", 2024-04-25T22:03:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7476e-05 2024-04-25T22:03:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682656+0000", 2024-04-25T22:03:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.311e-05 2024-04-25T22:03:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.774784+0000", 2024-04-25T22:03:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.092128053000000001 2024-04-25T22:03:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.774912+0000", 2024-04-25T22:03:18.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012798099999999999 2024-04-25T22:03:18.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.775095+0000", 2024-04-25T22:03:18.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000182607 2024-04-25T22:03:18.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779418+0000", 2024-04-25T22:03:18.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043234390000000001 2024-04-25T22:03:18.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779841+0000", 2024-04-25T22:03:18.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042321999999999998 2024-04-25T22:03:18.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779937+0000", 2024-04-25T22:03:18.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5402000000000006e-05 2024-04-25T22:03:18.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.780032+0000", 2024-04-25T22:03:18.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5564999999999997e-05 2024-04-25T22:03:18.153 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:266 3.1d 3:bf8dcf43:::200.00000008:head [write 3734079~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682671+0000", 2024-04-25T22:03:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.3874764170000002, 2024-04-25T22:03:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.100589284, 2024-04-25T22:03:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682671+0000", 2024-04-25T22:03:18.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682671+0000", 2024-04-25T22:03:18.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682672+0000", 2024-04-25T22:03:18.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:03:18.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682687+0000", 2024-04-25T22:03:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.418e-05 2024-04-25T22:03:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682704+0000", 2024-04-25T22:03:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7139e-05 2024-04-25T22:03:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682719+0000", 2024-04-25T22:03:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4776999999999999e-05 2024-04-25T22:03:18.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.776110+0000", 2024-04-25T22:03:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093391199999999994 2024-04-25T22:03:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.776237+0000", 2024-04-25T22:03:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012748800000000001 2024-04-25T22:03:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.776502+0000", 2024-04-25T22:03:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026474300000000001 2024-04-25T22:03:18.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.780083+0000", 2024-04-25T22:03:18.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035809190000000001 2024-04-25T22:03:18.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.783012+0000", 2024-04-25T22:03:18.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029288790000000001 2024-04-25T22:03:18.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.783173+0000", 2024-04-25T22:03:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016134799999999999 2024-04-25T22:03:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.783261+0000", 2024-04-25T22:03:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7558000000000004e-05 2024-04-25T22:03:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:281 3.1d 3:bf8dcf43:::200.00000008:head [write 3787969~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.716485+0000", 2024-04-25T22:03:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.3536628020000006, 2024-04-25T22:03:18.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.092100435999999994, 2024-04-25T22:03:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.716485+0000", 2024-04-25T22:03:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.716485+0000", 2024-04-25T22:03:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.716487+0000", 2024-04-25T22:03:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.57e-06 2024-04-25T22:03:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.716496+0000", 2024-04-25T22:03:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5899999999999997e-06 2024-04-25T22:03:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.716522+0000", 2024-04-25T22:03:18.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5443e-05 2024-04-25T22:03:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.716538+0000", 2024-04-25T22:03:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6345999999999999e-05 2024-04-25T22:03:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.801998+0000", 2024-04-25T22:03:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085460227 2024-04-25T22:03:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.802119+0000", 2024-04-25T22:03:18.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121271 2024-04-25T22:03:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.802369+0000", 2024-04-25T22:03:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000249473 2024-04-25T22:03:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.805116+0000", 2024-04-25T22:03:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0027474349999999999 2024-04-25T22:03:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.808433+0000", 2024-04-25T22:03:18.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033163369999999999 2024-04-25T22:03:18.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.808518+0000", 2024-04-25T22:03:18.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4964999999999997e-05 2024-04-25T22:03:18.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.808585+0000", 2024-04-25T22:03:18.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7779000000000003e-05 2024-04-25T22:03:18.164 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.164 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.164 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:284 3.1d 3:bf8dcf43:::200.00000008:head [write 3799544~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.720779+0000", 2024-04-25T22:03:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.3493687869999995, 2024-04-25T22:03:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093008417999999995, 2024-04-25T22:03:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720779+0000", 2024-04-25T22:03:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720779+0000", 2024-04-25T22:03:18.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720781+0000", 2024-04-25T22:03:18.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.547e-06 2024-04-25T22:03:18.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720790+0000", 2024-04-25T22:03:18.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6860000000000001e-06 2024-04-25T22:03:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720804+0000", 2024-04-25T22:03:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3997e-05 2024-04-25T22:03:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.720818+0000", 2024-04-25T22:03:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3550000000000001e-05 2024-04-25T22:03:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.806993+0000", 2024-04-25T22:03:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.086174915000000005 2024-04-25T22:03:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.807196+0000", 2024-04-25T22:03:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020306999999999999 2024-04-25T22:03:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.807425+0000", 2024-04-25T22:03:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00022923400000000001 2024-04-25T22:03:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.810916+0000", 2024-04-25T22:03:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034910700000000002 2024-04-25T22:03:18.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.813593+0000", 2024-04-25T22:03:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0026773420000000001 2024-04-25T22:03:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.813691+0000", 2024-04-25T22:03:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7071999999999995e-05 2024-04-25T22:03:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.813787+0000", 2024-04-25T22:03:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6935000000000006e-05 2024-04-25T22:03:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.169 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.170 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.170 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:285 3.1d 3:bf8dcf43:::200.00000008:head [write 3802501~5840 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-25T22:03:18.170 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.726839+0000", 2024-04-25T22:03:18.170 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.3433083830000001, 2024-04-25T22:03:18.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.092249908000000005, 2024-04-25T22:03:18.170 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.170 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.170 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.170 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.726839+0000", 2024-04-25T22:03:18.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.726839+0000", 2024-04-25T22:03:18.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.726842+0000", 2024-04-25T22:03:18.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:18.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.726866+0000", 2024-04-25T22:03:18.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3697e-05 2024-04-25T22:03:18.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.726898+0000", 2024-04-25T22:03:18.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2645999999999999e-05 2024-04-25T22:03:18.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.726920+0000", 2024-04-25T22:03:18.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759999999999998e-05 2024-04-25T22:03:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.809050+0000", 2024-04-25T22:03:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082129949999999993 2024-04-25T22:03:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.809212+0000", 2024-04-25T22:03:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000162285 2024-04-25T22:03:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.809512+0000", 2024-04-25T22:03:18.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030005800000000002 2024-04-25T22:03:18.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.818674+0000", 2024-04-25T22:03:18.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0091618240000000007 2024-04-25T22:03:18.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.818950+0000", 2024-04-25T22:03:18.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027553000000000001 2024-04-25T22:03:18.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.819036+0000", 2024-04-25T22:03:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5999000000000001e-05 2024-04-25T22:03:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.819089+0000", 2024-04-25T22:03:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3538999999999997e-05 2024-04-25T22:03:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.175 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:10642 4.35 4:ae7b229b:::100000030a9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:18.176 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.493805+0000", 2024-04-25T22:03:18.176 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.5763431419999998, 2024-04-25T22:03:18.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13451306399999999, 2024-04-25T22:03:18.176 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.176 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.176 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.176 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:18.176 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:18.176 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.176 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10642 2024-04-25T22:03:18.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.176 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.493805+0000", 2024-04-25T22:03:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.493805+0000", 2024-04-25T22:03:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.493807+0000", 2024-04-25T22:03:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2129999999999998e-06 2024-04-25T22:03:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502392+0000", 2024-04-25T22:03:18.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085850079999999999 2024-04-25T22:03:18.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502428+0000", 2024-04-25T22:03:18.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5952999999999999e-05 2024-04-25T22:03:18.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502447+0000", 2024-04-25T22:03:18.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9565999999999999e-05 2024-04-25T22:03:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502595+0000", 2024-04-25T22:03:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014737499999999999 2024-04-25T22:03:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502851+0000", 2024-04-25T22:03:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025651299999999999 2024-04-25T22:03:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.503238+0000", 2024-04-25T22:03:18.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038642800000000002 2024-04-25T22:03:18.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.627850+0000", 2024-04-25T22:03:18.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.12461184 2024-04-25T22:03:18.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628046+0000", 2024-04-25T22:03:18.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019659500000000001 2024-04-25T22:03:18.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628184+0000", 2024-04-25T22:03:18.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000137532 2024-04-25T22:03:18.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628318+0000", 2024-04-25T22:03:18.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000134041 2024-04-25T22:03:18.181 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.181 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.181 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.181 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:10647 4.35 4:ae7b229b:::100000030a9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:18.181 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:18.182 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.540786625, 2024-04-25T22:03:18.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14506126, 2024-04-25T22:03:18.182 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.182 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.182 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.182 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:18.182 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:18.182 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.182 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10647 2024-04-25T22:03:18.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.182 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529364+0000", 2024-04-25T22:03:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.286e-06 2024-04-25T22:03:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538917+0000", 2024-04-25T22:03:18.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0095530010000000002 2024-04-25T22:03:18.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538955+0000", 2024-04-25T22:03:18.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:03:18.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538977+0000", 2024-04-25T22:03:18.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.105e-05 2024-04-25T22:03:18.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568092+0000", 2024-04-25T22:03:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029115604999999999 2024-04-25T22:03:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568243+0000", 2024-04-25T22:03:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000151044 2024-04-25T22:03:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568498+0000", 2024-04-25T22:03:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025517399999999999 2024-04-25T22:03:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628005+0000", 2024-04-25T22:03:18.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059506991000000002 2024-04-25T22:03:18.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:18.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674273+0000", 2024-04-25T22:03:18.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.046267233999999997 2024-04-25T22:03:18.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674357+0000", 2024-04-25T22:03:18.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4745000000000003e-05 2024-04-25T22:03:18.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674422+0000", 2024-04-25T22:03:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5160999999999995e-05 2024-04-25T22:03:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:10651 4.b e64/16 4:d2207142:::100000030bf.00000000:head v 64'182, mlcod=64'180)", 2024-04-25T22:03:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.604132+0000", 2024-04-25T22:03:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.4660162909999999, 2024-04-25T22:03:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.105085936, 2024-04-25T22:03:18.187 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:18.188 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:18.188 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.188 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:18.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:18.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.604132+0000", 2024-04-25T22:03:18.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:18.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.604132+0000", 2024-04-25T22:03:18.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:18.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.604133+0000", 2024-04-25T22:03:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:03:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.608939+0000", 2024-04-25T22:03:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004806009 2024-04-25T22:03:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.608965+0000", 2024-04-25T22:03:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.639e-05 2024-04-25T22:03:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.608978+0000", 2024-04-25T22:03:18.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2666999999999999e-05 2024-04-25T22:03:18.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:18.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.609113+0000", 2024-04-25T22:03:18.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000135575 2024-04-25T22:03:18.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:18.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.609198+0000", 2024-04-25T22:03:18.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4899000000000001e-05 2024-04-25T22:03:18.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:18.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.709157+0000", 2024-04-25T22:03:18.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.099958796000000003 2024-04-25T22:03:18.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:18.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:18.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:18.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.709217+0000", 2024-04-25T22:03:18.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0553000000000001e-05 2024-04-25T22:03:18.191 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.191 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.191 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.192 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:18.192 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:18.192 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:18.198 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:18.199 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:18.192+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:18.224 INFO:tasks.workunit.client.0.smithi044.stdout:3/174: dwrite d0/d1/d15/df/d12/dd/d11/f2c [0,4194304] 0 2024-04-25T22:03:18.224 INFO:tasks.workunit.client.0.smithi044.stdout:6/248: dread d2/d23/d5a/d11/d3b/f58 [0,4194304] 0 2024-04-25T22:03:18.224 INFO:tasks.workunit.client.0.smithi044.stdout:4/112: read fc [936891,122542] 0 2024-04-25T22:03:18.224 INFO:tasks.workunit.client.0.smithi044.stdout:0/134: dread d8/f9 [0,4194304] 0 2024-04-25T22:03:18.224 INFO:tasks.workunit.client.0.smithi044.stdout:3/175: write d0/f20 [4257316,117219] 0 2024-04-25T22:03:18.225 INFO:tasks.workunit.client.0.smithi044.stdout:4/113: rename dd/d19/f2c to dd/d19/f32 0 2024-04-25T22:03:18.225 INFO:tasks.workunit.client.0.smithi044.stdout:0/135: creat d8/d15/f2e x:0 0 0 2024-04-25T22:03:18.225 INFO:tasks.workunit.client.0.smithi044.stdout:3/176: rename d0/f6 to d0/d13/f37 0 2024-04-25T22:03:18.225 INFO:tasks.workunit.client.0.smithi044.stdout:9/234: dwrite d4/d7/d18/d3a/f46 [0,4194304] 0 2024-04-25T22:03:18.225 INFO:tasks.workunit.client.0.smithi044.stdout:5/116: dwrite d2/d5/f9 [0,4194304] 0 2024-04-25T22:03:18.225 INFO:tasks.workunit.client.0.smithi044.stdout:5/117: unlink d2/f1d 0 2024-04-25T22:03:18.225 INFO:tasks.workunit.client.0.smithi044.stdout:9/235: write d4/f40 [286165,101686] 0 2024-04-25T22:03:18.225 INFO:tasks.workunit.client.0.smithi044.stdout:5/118: truncate d2/f19 1305149 0 2024-04-25T22:03:18.225 INFO:tasks.workunit.client.0.smithi044.stdout:9/236: write d4/d7/d18/d2e/f34 [903430,74164] 0 2024-04-25T22:03:18.225 INFO:tasks.workunit.client.0.smithi044.stdout:6/249: dwrite d2/d23/d5a/d12/d27/f2d [0,4194304] 0 2024-04-25T22:03:18.225 INFO:tasks.workunit.client.0.smithi044.stdout:9/237: write d4/d7/f33 [1661546,108252] 0 2024-04-25T22:03:18.226 INFO:tasks.workunit.client.0.smithi044.stdout:6/250: creat d2/d23/d5a/d12/d49/f5d x:0 0 0 2024-04-25T22:03:18.226 INFO:tasks.workunit.client.0.smithi044.stdout:6/251: mkdir d2/d23/d5a/d13/d4b/d5e 0 2024-04-25T22:03:18.226 INFO:tasks.workunit.client.0.smithi044.stdout:6/252: readlink d2/d23/l3f 0 2024-04-25T22:03:18.226 INFO:tasks.workunit.client.0.smithi044.stdout:6/253: creat d2/d23/d5a/d13/f5f x:0 0 0 2024-04-25T22:03:18.226 INFO:tasks.workunit.client.0.smithi044.stdout:6/254: chown d2/d23/d5a/d13 6095 1 2024-04-25T22:03:18.226 INFO:tasks.workunit.client.0.smithi044.stdout:4/114: read dd/f1b [191288,99341] 0 2024-04-25T22:03:18.226 INFO:tasks.workunit.client.0.smithi044.stdout:1/182: dwrite d3/d7/f17 [0,4194304] 0 2024-04-25T22:03:18.226 INFO:tasks.workunit.client.0.smithi044.stdout:2/172: truncate d7/d8/db/d2e/f2f 1054049 0 2024-04-25T22:03:18.227 INFO:tasks.workunit.client.0.smithi044.stdout:1/183: creat d3/d7/d29/f39 x:0 0 0 2024-04-25T22:03:18.227 INFO:tasks.workunit.client.0.smithi044.stdout:4/115: dwrite fc [0,4194304] 0 2024-04-25T22:03:18.227 INFO:tasks.workunit.client.0.smithi044.stdout:5/119: truncate d2/f4 3246057 0 2024-04-25T22:03:18.227 INFO:tasks.workunit.client.0.smithi044.stdout:0/136: write d8/da/f13 [281181,40592] 0 2024-04-25T22:03:18.227 INFO:tasks.workunit.client.0.smithi044.stdout:1/184: rmdir d3 39 2024-04-25T22:03:18.227 INFO:tasks.workunit.client.0.smithi044.stdout:4/116: write fc [3907231,9577] 0 2024-04-25T22:03:18.227 INFO:tasks.workunit.client.0.smithi044.stdout:2/173: creat d7/d8/db/f37 x:0 0 0 2024-04-25T22:03:18.227 INFO:tasks.workunit.client.0.smithi044.stdout:0/137: mknod d8/d15/c2f 0 2024-04-25T22:03:18.227 INFO:tasks.workunit.client.0.smithi044.stdout:4/117: symlink dd/d19/l33 0 2024-04-25T22:03:18.227 INFO:tasks.workunit.client.0.smithi044.stdout:9/238: truncate d4/d7/f4d 309117 0 2024-04-25T22:03:18.228 INFO:tasks.workunit.client.0.smithi044.stdout:3/177: truncate d0/f31 9550 0 2024-04-25T22:03:18.228 INFO:tasks.workunit.client.0.smithi044.stdout:1/185: write d3/d7/f2f [69854,67529] 0 2024-04-25T22:03:18.228 INFO:tasks.workunit.client.0.smithi044.stdout:4/118: readlink dd/l31 0 2024-04-25T22:03:18.228 INFO:tasks.workunit.client.0.smithi044.stdout:0/138: dread f6 [0,4194304] 0 2024-04-25T22:03:18.228 INFO:tasks.workunit.client.0.smithi044.stdout:9/239: creat d4/d7/d18/d2d/f51 x:0 0 0 2024-04-25T22:03:18.228 INFO:tasks.workunit.client.0.smithi044.stdout:1/186: rename d3/l6 to d3/d7/l3a 0 2024-04-25T22:03:18.228 INFO:tasks.workunit.client.0.smithi044.stdout:3/178: creat d0/f38 x:0 0 0 2024-04-25T22:03:18.228 INFO:tasks.workunit.client.0.smithi044.stdout:1/187: dread - d3/d7/d29/f35 zero size 2024-04-25T22:03:18.228 INFO:tasks.workunit.client.0.smithi044.stdout:9/240: unlink d4/f23 0 2024-04-25T22:03:18.228 INFO:tasks.workunit.client.0.smithi044.stdout:1/188: fsync d3/d7/f20 0 2024-04-25T22:03:18.229 INFO:tasks.workunit.client.0.smithi044.stdout:3/179: fdatasync d0/d13/f37 0 2024-04-25T22:03:18.229 INFO:tasks.workunit.client.0.smithi044.stdout:1/189: chown d3/d7/f8 1594803468 1 2024-04-25T22:03:18.229 INFO:tasks.workunit.client.0.smithi044.stdout:9/241: getdents d4/d7/d18/d2e 0 2024-04-25T22:03:18.229 INFO:tasks.workunit.client.0.smithi044.stdout:9/242: mkdir d4/d7/d52 0 2024-04-25T22:03:18.229 INFO:tasks.workunit.client.0.smithi044.stdout:2/174: dwrite d7/d16/f20 [0,4194304] 0 2024-04-25T22:03:18.229 INFO:tasks.workunit.client.0.smithi044.stdout:2/175: mkdir d7/d8/db/d2e/d38 0 2024-04-25T22:03:18.229 INFO:tasks.workunit.client.0.smithi044.stdout:9/243: rename d4/d7/d18/d2d/c30 to d4/d7/d18/d3a/c53 0 2024-04-25T22:03:18.229 INFO:tasks.workunit.client.0.smithi044.stdout:2/176: dread - d7/d8/db/f24 zero size 2024-04-25T22:03:18.229 INFO:tasks.workunit.client.0.smithi044.stdout:9/244: truncate d4/f40 1168949 0 2024-04-25T22:03:18.229 INFO:tasks.workunit.client.0.smithi044.stdout:9/245: readlink d4/d7/l25 0 2024-04-25T22:03:18.229 INFO:tasks.workunit.client.0.smithi044.stdout:0/139: dwrite d8/df/f1b [0,4194304] 0 2024-04-25T22:03:18.230 INFO:tasks.workunit.client.0.smithi044.stdout:2/177: creat d7/d8/db/f39 x:0 0 0 2024-04-25T22:03:18.230 INFO:tasks.workunit.client.0.smithi044.stdout:9/246: mkdir d4/d37/d54 0 2024-04-25T22:03:18.230 INFO:tasks.workunit.client.0.smithi044.stdout:0/140: unlink d8/d15/c2f 0 2024-04-25T22:03:18.230 INFO:tasks.workunit.client.0.smithi044.stdout:3/180: dwrite d0/d1/fe [0,4194304] 0 2024-04-25T22:03:18.230 INFO:tasks.workunit.client.0.smithi044.stdout:0/141: creat d8/d15/f30 x:0 0 0 2024-04-25T22:03:18.230 INFO:tasks.workunit.client.0.smithi044.stdout:9/247: rename d4/c44 to d4/d7/c55 0 2024-04-25T22:03:18.230 INFO:tasks.workunit.client.0.smithi044.stdout:0/142: rename d8/d15/f2a to d8/d20/f31 0 2024-04-25T22:03:18.230 INFO:tasks.workunit.client.0.smithi044.stdout:7/119: read f12 [351493,122712] 0 2024-04-25T22:03:18.230 INFO:tasks.workunit.client.0.smithi044.stdout:2/178: dread d7/f32 [0,4194304] 0 2024-04-25T22:03:18.230 INFO:tasks.workunit.client.0.smithi044.stdout:0/143: mknod d8/d20/c32 0 2024-04-25T22:03:18.231 INFO:tasks.workunit.client.0.smithi044.stdout:0/144: stat f3 0 2024-04-25T22:03:18.231 INFO:tasks.workunit.client.0.smithi044.stdout:0/145: getdents d8/d24 0 2024-04-25T22:03:18.231 INFO:tasks.workunit.client.0.smithi044.stdout:9/248: dwrite d4/f40 [0,4194304] 0 2024-04-25T22:03:18.231 INFO:tasks.workunit.client.0.smithi044.stdout:0/146: rename d8/df/f1b to d8/df/d17/f33 0 2024-04-25T22:03:18.231 INFO:tasks.workunit.client.0.smithi044.stdout:9/249: truncate d4/f1a 2528559 0 2024-04-25T22:03:18.231 INFO:tasks.workunit.client.0.smithi044.stdout:3/181: dwrite d0/f38 [0,4194304] 0 2024-04-25T22:03:18.231 INFO:tasks.workunit.client.0.smithi044.stdout:0/147: write d8/df/d17/f33 [3212693,11924] 0 2024-04-25T22:03:18.231 INFO:tasks.workunit.client.0.smithi044.stdout:0/148: symlink d8/df/d17/l34 0 2024-04-25T22:03:18.231 INFO:tasks.workunit.client.0.smithi044.stdout:2/179: dwrite d7/d8/d1c/f21 [0,4194304] 0 2024-04-25T22:03:18.231 INFO:tasks.workunit.client.0.smithi044.stdout:0/149: rmdir d8/df/d17 39 2024-04-25T22:03:18.232 INFO:tasks.workunit.client.0.smithi044.stdout:2/180: fsync d7/d8/db/f24 0 2024-04-25T22:03:18.232 INFO:tasks.workunit.client.0.smithi044.stdout:0/150: symlink d8/d15/l35 0 2024-04-25T22:03:18.232 INFO:tasks.workunit.client.0.smithi044.stdout:2/181: write f0 [3014379,33834] 0 2024-04-25T22:03:18.232 INFO:tasks.workunit.client.0.smithi044.stdout:2/182: write d7/f1b [2523347,105860] 0 2024-04-25T22:03:18.232 INFO:tasks.workunit.client.0.smithi044.stdout:9/250: dwrite f3 [0,4194304] 0 2024-04-25T22:03:18.232 INFO:tasks.workunit.client.0.smithi044.stdout:2/183: chown d7/cd 558540755 1 2024-04-25T22:03:18.232 INFO:tasks.workunit.client.0.smithi044.stdout:9/251: read d4/d37/f45 [2552742,55158] 0 2024-04-25T22:03:18.232 INFO:tasks.workunit.client.0.smithi044.stdout:2/184: creat d7/d16/d2d/f3a x:0 0 0 2024-04-25T22:03:18.232 INFO:tasks.workunit.client.0.smithi044.stdout:3/182: dread d0/f20 [4194304,4194304] 0 2024-04-25T22:03:18.232 INFO:tasks.workunit.client.0.smithi044.stdout:9/252: unlink d4/d7/d18/d2e/f48 0 2024-04-25T22:03:18.232 INFO:tasks.workunit.client.0.smithi044.stdout:2/185: stat d7/d16/d2d/f3a 0 2024-04-25T22:03:18.232 INFO:tasks.workunit.client.0.smithi044.stdout:3/183: mkdir d0/d1/d15/df/d12/d39 0 2024-04-25T22:03:18.233 INFO:tasks.workunit.client.0.smithi044.stdout:9/253: write d4/d7/d18/f4f [924483,11914] 0 2024-04-25T22:03:18.233 INFO:tasks.workunit.client.0.smithi044.stdout:0/151: dread d8/df/d17/f33 [0,4194304] 0 2024-04-25T22:03:18.233 INFO:tasks.workunit.client.0.smithi044.stdout:3/184: write d0/f31 [277342,41889] 0 2024-04-25T22:03:18.233 INFO:tasks.workunit.client.0.smithi044.stdout:3/185: unlink d0/d1/d15/df/f33 0 2024-04-25T22:03:18.233 INFO:tasks.workunit.client.0.smithi044.stdout:9/254: creat d4/d7/d18/f56 x:0 0 0 2024-04-25T22:03:18.233 INFO:tasks.workunit.client.0.smithi044.stdout:2/186: dread d7/f32 [0,4194304] 0 2024-04-25T22:03:18.233 INFO:tasks.workunit.client.0.smithi044.stdout:3/186: symlink d0/d1/d15/df/d12/dd/d35/l3a 0 2024-04-25T22:03:18.233 INFO:tasks.workunit.client.0.smithi044.stdout:9/255: dread - d4/d7/d18/d3a/f3e zero size 2024-04-25T22:03:18.233 INFO:tasks.workunit.client.0.smithi044.stdout:3/187: write d0/f31 [1310087,8750] 0 2024-04-25T22:03:18.233 INFO:tasks.workunit.client.0.smithi044.stdout:2/187: creat d7/d16/d2c/f3b x:0 0 0 2024-04-25T22:03:18.233 INFO:tasks.workunit.client.0.smithi044.stdout:2/188: chown d7/c1f 234599915 1 2024-04-25T22:03:18.233 INFO:tasks.workunit.client.0.smithi044.stdout:3/188: unlink d0/d1/d15/df/c1b 0 2024-04-25T22:03:18.234 INFO:tasks.workunit.client.0.smithi044.stdout:9/256: creat d4/f57 x:0 0 0 2024-04-25T22:03:18.234 INFO:tasks.workunit.client.0.smithi044.stdout:0/152: dwrite d8/df/d17/f2c [0,4194304] 0 2024-04-25T22:03:18.234 INFO:tasks.workunit.client.0.smithi044.stdout:3/189: symlink d0/d1/d15/df/l3b 0 2024-04-25T22:03:18.234 INFO:tasks.workunit.client.0.smithi044.stdout:9/257: write d4/d7/d18/f4f [1010651,12382] 0 2024-04-25T22:03:18.234 INFO:tasks.workunit.client.0.smithi044.stdout:2/189: link d7/d8/l19 d7/d16/l3c 0 2024-04-25T22:03:18.234 INFO:tasks.workunit.client.0.smithi044.stdout:0/153: chown d8/da/lb 4100344 1 2024-04-25T22:03:18.234 INFO:tasks.workunit.client.0.smithi044.stdout:2/190: mknod d7/d16/d2d/c3d 0 2024-04-25T22:03:18.234 INFO:tasks.workunit.client.0.smithi044.stdout:9/258: rename d4/d7/d52 to d4/d3d/d58 0 2024-04-25T22:03:18.234 INFO:tasks.workunit.client.0.smithi044.stdout:9/259: chown d4/l12 1909 1 2024-04-25T22:03:18.234 INFO:tasks.workunit.client.0.smithi044.stdout:3/190: link d0/d1/d15/l2d d0/d13/d1c/l3c 0 2024-04-25T22:03:18.235 INFO:tasks.workunit.client.0.smithi044.stdout:2/191: link d7/f14 d7/d8/f3e 0 2024-04-25T22:03:18.235 INFO:tasks.workunit.client.0.smithi044.stdout:9/260: rename d4/f3b to d4/d37/f59 0 2024-04-25T22:03:18.235 INFO:tasks.workunit.client.0.smithi044.stdout:2/192: creat d7/f3f x:0 0 0 2024-04-25T22:03:18.235 INFO:tasks.workunit.client.0.smithi044.stdout:3/191: symlink d0/d1/d15/df/d12/dd/d35/l3d 0 2024-04-25T22:03:18.235 INFO:tasks.workunit.client.0.smithi044.stdout:9/261: truncate d4/d7/f33 2401242 0 2024-04-25T22:03:18.235 INFO:tasks.workunit.client.0.smithi044.stdout:2/193: symlink d7/d16/d2d/l40 0 2024-04-25T22:03:18.235 INFO:tasks.workunit.client.0.smithi044.stdout:2/194: write d7/d16/d2d/f3a [275283,57441] 0 2024-04-25T22:03:18.235 INFO:tasks.workunit.client.0.smithi044.stdout:2/195: creat d7/d8/d1c/f41 x:0 0 0 2024-04-25T22:03:18.235 INFO:tasks.workunit.client.0.smithi044.stdout:9/262: rename d4/d7/d18/d3a/f3e to d4/d7/d18/f5a 0 2024-04-25T22:03:18.235 INFO:tasks.workunit.client.0.smithi044.stdout:9/263: dwrite d4/d7/f33 [0,4194304] 0 2024-04-25T22:03:18.235 INFO:tasks.workunit.client.0.smithi044.stdout:9/264: symlink d4/d37/l5b 0 2024-04-25T22:03:18.235 INFO:tasks.workunit.client.0.smithi044.stdout:9/265: chown d4/d7/c20 205 1 2024-04-25T22:03:18.236 INFO:tasks.workunit.client.0.smithi044.stdout:9/266: rename d4/d7/f33 to d4/f5c 0 2024-04-25T22:03:18.236 INFO:tasks.workunit.client.0.smithi044.stdout:9/267: dwrite d4/d7/d18/d2e/f34 [0,4194304] 0 2024-04-25T22:03:18.236 INFO:tasks.workunit.client.0.smithi044.stdout:9/268: creat d4/d7/d18/d2e/f5d x:0 0 0 2024-04-25T22:03:18.236 INFO:tasks.workunit.client.0.smithi044.stdout:9/269: mkdir d4/d5e 0 2024-04-25T22:03:18.236 INFO:tasks.workunit.client.0.smithi044.stdout:9/270: creat d4/d7/d18/d3a/f5f x:0 0 0 2024-04-25T22:03:18.236 INFO:tasks.workunit.client.0.smithi044.stdout:8/254: dread f0 [0,4194304] 0 2024-04-25T22:03:18.236 INFO:tasks.workunit.client.0.smithi044.stdout:9/271: dread d4/d7/d18/d2e/f34 [0,4194304] 0 2024-04-25T22:03:18.236 INFO:tasks.workunit.client.0.smithi044.stdout:8/255: write f25 [50750,65356] 0 2024-04-25T22:03:18.236 INFO:tasks.workunit.client.0.smithi044.stdout:8/256: fdatasync f8 0 2024-04-25T22:03:18.236 INFO:tasks.workunit.client.0.smithi044.stdout:1/190: write d3/f37 [89514,101051] 0 2024-04-25T22:03:18.236 INFO:tasks.workunit.client.0.smithi044.stdout:9/272: mknod d4/d7/d18/d3a/c60 0 2024-04-25T22:03:18.236 INFO:tasks.workunit.client.0.smithi044.stdout:7/120: truncate f0 2331267 0 2024-04-25T22:03:18.237 INFO:tasks.workunit.client.0.smithi044.stdout:0/154: fsync d8/df/d17/f33 0 2024-04-25T22:03:18.237 INFO:tasks.workunit.client.0.smithi044.stdout:8/257: mknod d2a/d32/c4d 0 2024-04-25T22:03:18.237 INFO:tasks.workunit.client.0.smithi044.stdout:1/191: read d3/d7/f2f [1802256,9138] 0 2024-04-25T22:03:18.237 INFO:tasks.workunit.client.0.smithi044.stdout:7/121: write f14 [233875,93973] 0 2024-04-25T22:03:18.237 INFO:tasks.workunit.client.0.smithi044.stdout:9/273: dread - d4/d7/d18/f56 zero size 2024-04-25T22:03:18.237 INFO:tasks.workunit.client.0.smithi044.stdout:7/122: unlink c18 0 2024-04-25T22:03:18.237 INFO:tasks.workunit.client.0.smithi044.stdout:8/258: creat d2a/f4e x:0 0 0 2024-04-25T22:03:18.237 INFO:tasks.workunit.client.0.smithi044.stdout:0/155: rename d8/da/l12 to d8/d15/l36 0 2024-04-25T22:03:18.237 INFO:tasks.workunit.client.0.smithi044.stdout:1/192: chown d3/d7/f23 61541351 1 2024-04-25T22:03:18.237 INFO:tasks.workunit.client.0.smithi044.stdout:4/119: dwrite fa [0,4194304] 0 2024-04-25T22:03:18.237 INFO:tasks.workunit.client.0.smithi044.stdout:1/193: mknod d3/d30/c3b 0 2024-04-25T22:03:18.238 INFO:tasks.workunit.client.0.smithi044.stdout:1/194: rmdir d3/d7 39 2024-04-25T22:03:18.238 INFO:tasks.workunit.client.0.smithi044.stdout:1/195: link d3/d7/f23 d3/d7/db/f3c 0 2024-04-25T22:03:18.238 INFO:tasks.workunit.client.0.smithi044.stdout:0/156: mknod d8/df/c37 0 2024-04-25T22:03:18.238 INFO:tasks.workunit.client.0.smithi044.stdout:0/157: rmdir d8/d20 39 2024-04-25T22:03:18.238 INFO:tasks.workunit.client.0.smithi044.stdout:1/196: rename d3/d7/f17 to d3/d7/f3d 0 2024-04-25T22:03:18.238 INFO:tasks.workunit.client.0.smithi044.stdout:0/158: creat d8/d20/f38 x:0 0 0 2024-04-25T22:03:18.238 INFO:tasks.workunit.client.0.smithi044.stdout:1/197: write d3/d7/f2a [1521965,110699] 0 2024-04-25T22:03:18.238 INFO:tasks.workunit.client.0.smithi044.stdout:8/259: dwrite f0 [0,4194304] 0 2024-04-25T22:03:18.238 INFO:tasks.workunit.client.0.smithi044.stdout:7/123: dread f14 [0,4194304] 0 2024-04-25T22:03:18.238 INFO:tasks.workunit.client.0.smithi044.stdout:2/196: truncate d7/d16/f20 4075123 0 2024-04-25T22:03:18.238 INFO:tasks.workunit.client.0.smithi044.stdout:8/260: read - d2a/d32/d3e/f44 zero size 2024-04-25T22:03:18.239 INFO:tasks.workunit.client.0.smithi044.stdout:4/120: dwrite dd/d19/f32 [0,4194304] 0 2024-04-25T22:03:18.239 INFO:tasks.workunit.client.0.smithi044.stdout:0/159: rename d8/df/d17/f2c to d8/d15/f39 0 2024-04-25T22:03:18.239 INFO:tasks.workunit.client.0.smithi044.stdout:4/121: chown dd/d19/l22 24645 1 2024-04-25T22:03:18.239 INFO:tasks.workunit.client.0.smithi044.stdout:2/197: creat d7/d16/d2c/f42 x:0 0 0 2024-04-25T22:03:18.239 INFO:tasks.workunit.client.0.smithi044.stdout:7/124: link cc c1b 0 2024-04-25T22:03:18.239 INFO:tasks.workunit.client.0.smithi044.stdout:0/160: fdatasync f0 0 2024-04-25T22:03:18.239 INFO:tasks.workunit.client.0.smithi044.stdout:8/261: fdatasync d2a/d32/f35 0 2024-04-25T22:03:18.239 INFO:tasks.workunit.client.0.smithi044.stdout:7/125: mkdir d1c 0 2024-04-25T22:03:18.239 INFO:tasks.workunit.client.0.smithi044.stdout:2/198: stat d7/d8/ce 0 2024-04-25T22:03:18.239 INFO:tasks.workunit.client.0.smithi044.stdout:8/262: stat f17 0 2024-04-25T22:03:18.239 INFO:tasks.workunit.client.0.smithi044.stdout:1/198: dread d3/f26 [0,4194304] 0 2024-04-25T22:03:18.240 INFO:tasks.workunit.client.0.smithi044.stdout:8/263: fdatasync d2a/f2d 0 2024-04-25T22:03:18.240 INFO:tasks.workunit.client.0.smithi044.stdout:7/126: symlink d1c/l1d 0 2024-04-25T22:03:18.240 INFO:tasks.workunit.client.0.smithi044.stdout:3/192: dwrite d0/d13/d1c/f30 [0,4194304] 0 2024-04-25T22:03:18.240 INFO:tasks.workunit.client.0.smithi044.stdout:1/199: readlink d3/d7/db/l11 0 2024-04-25T22:03:18.240 INFO:tasks.workunit.client.0.smithi044.stdout:2/199: mkdir d7/d8/d1c/d26/d43 0 2024-04-25T22:03:18.240 INFO:tasks.workunit.client.0.smithi044.stdout:8/264: read - d2a/d32/f3d zero size 2024-04-25T22:03:18.240 INFO:tasks.workunit.client.0.smithi044.stdout:7/127: fdatasync f12 0 2024-04-25T22:03:18.240 INFO:tasks.workunit.client.0.smithi044.stdout:5/120: dwrite d2/f4 [0,4194304] 0 2024-04-25T22:03:18.240 INFO:tasks.workunit.client.0.smithi044.stdout:1/200: creat d3/d30/f3e x:0 0 0 2024-04-25T22:03:18.240 INFO:tasks.workunit.client.0.smithi044.stdout:5/121: chown d2/l1a 504628 1 2024-04-25T22:03:18.240 INFO:tasks.workunit.client.0.smithi044.stdout:8/265: mknod d2a/d32/c4f 0 2024-04-25T22:03:18.241 INFO:tasks.workunit.client.0.smithi044.stdout:3/193: creat d0/d1/d15/df/d12/dd/d28/f3e x:0 0 0 2024-04-25T22:03:18.241 INFO:tasks.workunit.client.0.smithi044.stdout:2/200: unlink d7/d8/d1c/f27 0 2024-04-25T22:03:18.241 INFO:tasks.workunit.client.0.smithi044.stdout:5/122: rename d2/d5/cf to d2/c29 0 2024-04-25T22:03:18.241 INFO:tasks.workunit.client.0.smithi044.stdout:0/161: dwrite d8/d20/f38 [0,4194304] 0 2024-04-25T22:03:18.241 INFO:tasks.workunit.client.0.smithi044.stdout:2/201: mkdir d7/d8/d1c/d26/d44 0 2024-04-25T22:03:18.241 INFO:tasks.workunit.client.0.smithi044.stdout:8/266: creat d2a/d32/d3e/f50 x:0 0 0 2024-04-25T22:03:18.241 INFO:tasks.workunit.client.0.smithi044.stdout:8/267: readlink d2a/d32/l38 0 2024-04-25T22:03:18.241 INFO:tasks.workunit.client.0.smithi044.stdout:6/255: sync 2024-04-25T22:03:18.241 INFO:tasks.workunit.client.0.smithi044.stdout:4/122: sync 2024-04-25T22:03:18.241 INFO:tasks.workunit.client.0.smithi044.stdout:5/123: mkdir d2/d5/d27/d2a 0 2024-04-25T22:03:18.241 INFO:tasks.workunit.client.0.smithi044.stdout:2/202: dread - d7/d8/db/f24 zero size 2024-04-25T22:03:18.242 INFO:tasks.workunit.client.0.smithi044.stdout:8/268: chown d2a/f2f 30 1 2024-04-25T22:03:18.242 INFO:tasks.workunit.client.0.smithi044.stdout:2/203: chown d7/d8/db/c10 9424561 1 2024-04-25T22:03:18.242 INFO:tasks.workunit.client.0.smithi044.stdout:8/269: unlink f12 0 2024-04-25T22:03:18.242 INFO:tasks.workunit.client.0.smithi044.stdout:1/201: dread d3/d7/d29/f35 [0,4194304] 0 2024-04-25T22:03:18.242 INFO:tasks.workunit.client.0.smithi044.stdout:8/270: write d2a/d32/f35 [269971,49492] 0 2024-04-25T22:03:18.242 INFO:tasks.workunit.client.0.smithi044.stdout:6/256: link d2/d23/d5a/d11/f39 d2/d23/d5a/d11/f60 0 2024-04-25T22:03:18.242 INFO:tasks.workunit.client.0.smithi044.stdout:2/204: link d7/c1e d7/d16/c45 0 2024-04-25T22:03:18.242 INFO:tasks.workunit.client.0.smithi044.stdout:6/257: rmdir d2/d23/d5a/d12 39 2024-04-25T22:03:18.242 INFO:tasks.workunit.client.0.smithi044.stdout:8/271: creat d2a/d39/f51 x:0 0 0 2024-04-25T22:03:18.242 INFO:tasks.workunit.client.0.smithi044.stdout:6/258: stat d2/c55 0 2024-04-25T22:03:18.242 INFO:tasks.workunit.client.0.smithi044.stdout:2/205: write d7/d8/db/f36 [1862839,86040] 0 2024-04-25T22:03:18.242 INFO:tasks.workunit.client.0.smithi044.stdout:8/272: write d2a/d39/f51 [965968,35009] 0 2024-04-25T22:03:18.243 INFO:tasks.workunit.client.0.smithi044.stdout:2/206: read d7/f32 [3321871,11568] 0 2024-04-25T22:03:18.243 INFO:tasks.workunit.client.0.smithi044.stdout:0/162: dwrite d8/df/d17/f33 [0,4194304] 0 2024-04-25T22:03:18.243 INFO:tasks.workunit.client.0.smithi044.stdout:3/194: dwrite d0/d1/d15/df/d12/dd/d11/f2c [0,4194304] 0 2024-04-25T22:03:18.243 INFO:tasks.workunit.client.0.smithi044.stdout:2/207: chown d7/d8/db 20194910 1 2024-04-25T22:03:18.243 INFO:tasks.workunit.client.0.smithi044.stdout:5/124: dwrite d2/d5/f18 [0,4194304] 0 2024-04-25T22:03:18.243 INFO:tasks.workunit.client.0.smithi044.stdout:8/273: mkdir d2a/d52 0 2024-04-25T22:03:18.243 INFO:tasks.workunit.client.0.smithi044.stdout:8/274: link d2a/d39/f51 d2a/d32/f53 0 2024-04-25T22:03:18.243 INFO:tasks.workunit.client.0.smithi044.stdout:8/275: chown f22 34 1 2024-04-25T22:03:18.243 INFO:tasks.workunit.client.0.smithi044.stdout:0/163: creat d8/d24/f3a x:0 0 0 2024-04-25T22:03:18.243 INFO:tasks.workunit.client.0.smithi044.stdout:8/276: creat d2a/d32/d3e/f54 x:0 0 0 2024-04-25T22:03:18.244 INFO:tasks.workunit.client.0.smithi044.stdout:1/202: dread d3/f34 [0,4194304] 0 2024-04-25T22:03:18.244 INFO:tasks.workunit.client.0.smithi044.stdout:3/195: write d0/d1/d15/df/d12/dd/d11/f2c [3195543,33670] 0 2024-04-25T22:03:18.244 INFO:tasks.workunit.client.0.smithi044.stdout:1/203: chown d3/f34 0 1 2024-04-25T22:03:18.244 INFO:tasks.workunit.client.0.smithi044.stdout:3/196: stat d0/d1/d15/df/d12/dd/f22 0 2024-04-25T22:03:18.244 INFO:tasks.workunit.client.0.smithi044.stdout:6/259: dwrite d2/d23/d5a/d12/d49/f5d [0,4194304] 0 2024-04-25T22:03:18.244 INFO:tasks.workunit.client.0.smithi044.stdout:6/260: chown d2/d23/d5a/d12 62594 1 2024-04-25T22:03:18.244 INFO:tasks.workunit.client.0.smithi044.stdout:2/208: dwrite d7/f31 [0,4194304] 0 2024-04-25T22:03:18.244 INFO:tasks.workunit.client.0.smithi044.stdout:0/164: creat d8/f3b x:0 0 0 2024-04-25T22:03:18.244 INFO:tasks.workunit.client.0.smithi044.stdout:1/204: mkdir d3/d30/d3f 0 2024-04-25T22:03:18.244 INFO:tasks.workunit.client.0.smithi044.stdout:2/209: chown d7/d16/f17 913 1 2024-04-25T22:03:18.244 INFO:tasks.workunit.client.0.smithi044.stdout:6/261: creat d2/d23/d5a/d11/d2a/f61 x:0 0 0 2024-04-25T22:03:18.245 INFO:tasks.workunit.client.0.smithi044.stdout:0/165: fdatasync d8/d15/f1f 0 2024-04-25T22:03:18.245 INFO:tasks.workunit.client.0.smithi044.stdout:1/205: creat d3/d7/f40 x:0 0 0 2024-04-25T22:03:18.245 INFO:tasks.workunit.client.0.smithi044.stdout:6/262: write d2/d23/d5a/f1b [1473974,47287] 0 2024-04-25T22:03:18.245 INFO:tasks.workunit.client.0.smithi044.stdout:1/206: mknod d3/d30/c41 0 2024-04-25T22:03:18.245 INFO:tasks.workunit.client.0.smithi044.stdout:9/274: dread d4/f1f [4194304,4194304] 0 2024-04-25T22:03:18.245 INFO:tasks.workunit.client.0.smithi044.stdout:8/277: dwrite fd [0,4194304] 0 2024-04-25T22:03:18.245 INFO:tasks.workunit.client.0.smithi044.stdout:2/210: rmdir d7/d8/db/d2e/d38 0 2024-04-25T22:03:18.251 INFO:tasks.workunit.client.0.smithi044.stdout:3/197: dwrite d0/d1/d15/df/d12/dd/f22 [0,4194304] 0 2024-04-25T22:03:18.251 INFO:tasks.workunit.client.0.smithi044.stdout:0/166: getdents d8/df/d17 0 2024-04-25T22:03:18.251 INFO:tasks.workunit.client.0.smithi044.stdout:6/263: creat d2/d23/d5a/f62 x:0 0 0 2024-04-25T22:03:18.251 INFO:tasks.workunit.client.0.smithi044.stdout:3/198: write d0/f31 [2119851,60261] 0 2024-04-25T22:03:18.251 INFO:tasks.workunit.client.0.smithi044.stdout:0/167: write f3 [604122,99672] 0 2024-04-25T22:03:18.251 INFO:tasks.workunit.client.0.smithi044.stdout:0/168: mknod d8/d15/c3c 0 2024-04-25T22:03:18.251 INFO:tasks.workunit.client.0.smithi044.stdout:3/199: unlink d0/d2/c8 0 2024-04-25T22:03:18.252 INFO:tasks.workunit.client.0.smithi044.stdout:0/169: chown d8/df/l2d 129 1 2024-04-25T22:03:18.252 INFO:tasks.workunit.client.0.smithi044.stdout:6/264: write d2/d23/d5a/d11/d2a/f3c [659836,128648] 0 2024-04-25T22:03:18.252 INFO:tasks.workunit.client.0.smithi044.stdout:3/200: creat d0/d1/d15/df/d12/dd/d28/f3f x:0 0 0 2024-04-25T22:03:18.252 INFO:tasks.workunit.client.0.smithi044.stdout:0/170: chown d8/da/c14 204 1 2024-04-25T22:03:18.252 INFO:tasks.workunit.client.0.smithi044.stdout:0/171: chown d8/d24/f26 218 1 2024-04-25T22:03:18.252 INFO:tasks.workunit.client.0.smithi044.stdout:6/265: dread - d2/d23/d30/f47 zero size 2024-04-25T22:03:18.252 INFO:tasks.workunit.client.0.smithi044.stdout:2/211: dwrite d7/f32 [4194304,4194304] 0 2024-04-25T22:03:18.252 INFO:tasks.workunit.client.0.smithi044.stdout:3/201: creat d0/d1/d15/d23/f40 x:0 0 0 2024-04-25T22:03:18.252 INFO:tasks.workunit.client.0.smithi044.stdout:6/266: dread - d2/d23/d5a/d11/d2a/f61 zero size 2024-04-25T22:03:18.252 INFO:tasks.workunit.client.0.smithi044.stdout:2/212: creat d7/d8/d1c/d26/d44/f46 x:0 0 0 2024-04-25T22:03:18.252 INFO:tasks.workunit.client.0.smithi044.stdout:2/213: write d7/d8/db/f36 [2541530,49746] 0 2024-04-25T22:03:18.252 INFO:tasks.workunit.client.0.smithi044.stdout:0/172: dread f6 [0,4194304] 0 2024-04-25T22:03:18.253 INFO:tasks.workunit.client.0.smithi044.stdout:3/202: link d0/d1/d15/df/d12/f29 d0/d1/d15/df/d12/dd/d11/f41 0 2024-04-25T22:03:18.253 INFO:tasks.workunit.client.0.smithi044.stdout:2/214: chown d7/la 504197728 1 2024-04-25T22:03:18.253 INFO:tasks.workunit.client.0.smithi044.stdout:2/215: mknod d7/d16/c47 0 2024-04-25T22:03:18.253 INFO:tasks.workunit.client.0.smithi044.stdout:0/173: rename d8/da/f13 to d8/df/d17/f3d 0 2024-04-25T22:03:18.253 INFO:tasks.workunit.client.0.smithi044.stdout:3/203: mkdir d0/d1/d15/df/d12/dd/d11/d42 0 2024-04-25T22:03:18.253 INFO:tasks.workunit.client.0.smithi044.stdout:0/174: symlink d8/d15/l3e 0 2024-04-25T22:03:18.253 INFO:tasks.workunit.client.0.smithi044.stdout:1/207: write d3/d7/f23 [3523671,62738] 0 2024-04-25T22:03:18.254 INFO:tasks.workunit.client.0.smithi044.stdout:3/204: stat d0/d1/d15/df/d12/dd/f22 0 2024-04-25T22:03:18.254 INFO:tasks.workunit.client.0.smithi044.stdout:1/208: fsync d3/d7/f20 0 2024-04-25T22:03:18.254 INFO:tasks.workunit.client.0.smithi044.stdout:0/175: mkdir d8/df/d3f 0 2024-04-25T22:03:18.254 INFO:tasks.workunit.client.0.smithi044.stdout:7/128: write f0 [256764,64609] 0 2024-04-25T22:03:18.254 INFO:tasks.workunit.client.0.smithi044.stdout:1/209: mkdir d3/d7/db/d42 0 2024-04-25T22:03:18.254 INFO:tasks.workunit.client.0.smithi044.stdout:3/205: mkdir d0/d1/d15/df/d12/dd/d11/d43 0 2024-04-25T22:03:18.254 INFO:tasks.workunit.client.0.smithi044.stdout:1/210: mkdir d3/d7/d29/d43 0 2024-04-25T22:03:18.254 INFO:tasks.workunit.client.0.smithi044.stdout:3/206: unlink d0/d1/d15/df/d12/dd/f22 0 2024-04-25T22:03:18.255 INFO:tasks.workunit.client.0.smithi044.stdout:0/176: dread d8/df/d17/f33 [0,4194304] 0 2024-04-25T22:03:18.255 INFO:tasks.workunit.client.0.smithi044.stdout:0/177: write f6 [3409350,121428] 0 2024-04-25T22:03:18.255 INFO:tasks.workunit.client.0.smithi044.stdout:8/278: dread d2a/d32/f35 [0,4194304] 0 2024-04-25T22:03:18.255 INFO:tasks.workunit.client.0.smithi044.stdout:0/178: rmdir d8/df/d3f 0 2024-04-25T22:03:18.255 INFO:tasks.workunit.client.0.smithi044.stdout:1/211: dwrite d3/d7/db/f3c [0,4194304] 0 2024-04-25T22:03:18.255 INFO:tasks.workunit.client.0.smithi044.stdout:7/129: truncate f9 1935801 0 2024-04-25T22:03:18.255 INFO:tasks.workunit.client.0.smithi044.stdout:0/179: creat d8/df/f40 x:0 0 0 2024-04-25T22:03:18.255 INFO:tasks.workunit.client.0.smithi044.stdout:3/207: dwrite d0/d1/d15/df/d12/dd/d11/f41 [0,4194304] 0 2024-04-25T22:03:18.255 INFO:tasks.workunit.client.0.smithi044.stdout:0/180: write f0 [3582353,68398] 0 2024-04-25T22:03:18.258 INFO:tasks.workunit.client.0.smithi044.stdout:0/181: creat d8/df/f41 x:0 0 0 2024-04-25T22:03:18.258 INFO:tasks.workunit.client.0.smithi044.stdout:8/279: dwrite d2a/d4a/f4b [0,4194304] 0 2024-04-25T22:03:18.258 INFO:tasks.workunit.client.0.smithi044.stdout:3/208: mkdir d0/d1/d15/df/d12/dd/d11/d43/d44 0 2024-04-25T22:03:18.258 INFO:tasks.workunit.client.0.smithi044.stdout:0/182: rmdir d8/da 39 2024-04-25T22:03:18.258 INFO:tasks.workunit.client.0.smithi044.stdout:4/123: sync 2024-04-25T22:03:18.258 INFO:tasks.workunit.client.0.smithi044.stdout:2/216: sync 2024-04-25T22:03:18.258 INFO:tasks.workunit.client.0.smithi044.stdout:6/267: sync 2024-04-25T22:03:18.258 INFO:tasks.workunit.client.0.smithi044.stdout:7/130: sync 2024-04-25T22:03:18.258 INFO:tasks.workunit.client.0.smithi044.stdout:5/125: sync 2024-04-25T22:03:18.258 INFO:tasks.workunit.client.0.smithi044.stdout:0/183: creat d8/d15/f42 x:0 0 0 2024-04-25T22:03:18.259 INFO:tasks.workunit.client.0.smithi044.stdout:0/184: write d8/f2b [61813,65533] 0 2024-04-25T22:03:18.259 INFO:tasks.workunit.client.0.smithi044.stdout:7/131: mknod d1c/c1e 0 2024-04-25T22:03:18.259 INFO:tasks.workunit.client.0.smithi044.stdout:2/217: mkdir d7/d8/d48 0 2024-04-25T22:03:18.259 INFO:tasks.workunit.client.0.smithi044.stdout:5/126: unlink d2/d5/f1b 0 2024-04-25T22:03:18.259 INFO:tasks.workunit.client.0.smithi044.stdout:6/268: truncate d2/d23/f37 2832120 0 2024-04-25T22:03:18.259 INFO:tasks.workunit.client.0.smithi044.stdout:3/209: rename d0/d1/d15/df/d12/dd/d11/f41 to d0/d1/d15/df/d12/dd/d35/d36/f45 0 2024-04-25T22:03:18.259 INFO:tasks.workunit.client.0.smithi044.stdout:1/212: dwrite d3/d7/db/f1d [0,4194304] 0 2024-04-25T22:03:18.261 INFO:tasks.workunit.client.0.smithi044.stdout:3/210: chown d0/f31 31518 1 2024-04-25T22:03:18.261 INFO:tasks.workunit.client.0.smithi044.stdout:2/218: creat d7/d16/d2c/f49 x:0 0 0 2024-04-25T22:03:18.261 INFO:tasks.workunit.client.0.smithi044.stdout:1/213: dread - d3/d7/f40 zero size 2024-04-25T22:03:18.261 INFO:tasks.workunit.client.0.smithi044.stdout:0/185: mknod d8/d24/c43 0 2024-04-25T22:03:18.261 INFO:tasks.workunit.client.0.smithi044.stdout:6/269: truncate d2/d23/d5a/d11/f39 669391 0 2024-04-25T22:03:18.262 INFO:tasks.workunit.client.0.smithi044.stdout:5/127: fdatasync d2/d5/f9 0 2024-04-25T22:03:18.262 INFO:tasks.workunit.client.0.smithi044.stdout:1/214: chown d3/l1f 15336 1 2024-04-25T22:03:18.264 INFO:tasks.workunit.client.0.smithi044.stdout:5/128: mknod d2/c2b 0 2024-04-25T22:03:18.264 INFO:tasks.workunit.client.0.smithi044.stdout:5/129: dread - d2/d5/f1f zero size 2024-04-25T22:03:18.265 INFO:tasks.workunit.client.0.smithi044.stdout:4/124: dwrite dd/f1b [0,4194304] 0 2024-04-25T22:03:18.265 INFO:tasks.workunit.client.0.smithi044.stdout:1/215: mknod d3/d30/d3f/c44 0 2024-04-25T22:03:18.265 INFO:tasks.workunit.client.0.smithi044.stdout:5/130: write d2/d5/f1f [341048,91587] 0 2024-04-25T22:03:18.266 INFO:tasks.workunit.client.0.smithi044.stdout:8/280: dwrite d2a/f36 [0,4194304] 0 2024-04-25T22:03:18.266 INFO:tasks.workunit.client.0.smithi044.stdout:3/211: unlink d0/d13/d1c/l2e 0 2024-04-25T22:03:18.267 INFO:tasks.workunit.client.0.smithi044.stdout:4/125: rename fc to dd/f34 0 2024-04-25T22:03:18.268 INFO:tasks.workunit.client.0.smithi044.stdout:8/281: write f25 [982814,101423] 0 2024-04-25T22:03:18.269 INFO:tasks.workunit.client.0.smithi044.stdout:5/131: mkdir d2/d5/d21/d26/d2c 0 2024-04-25T22:03:18.269 INFO:tasks.workunit.client.0.smithi044.stdout:3/212: rename d0 to d0/d46 22 2024-04-25T22:03:18.270 INFO:tasks.workunit.client.0.smithi044.stdout:4/126: fsync dd/d19/f2d 0 2024-04-25T22:03:18.270 INFO:tasks.workunit.client.0.smithi044.stdout:8/282: readlink d2a/d32/l38 0 2024-04-25T22:03:18.270 INFO:tasks.workunit.client.0.smithi044.stdout:5/132: rmdir d2/d5/d21 39 2024-04-25T22:03:18.270 INFO:tasks.workunit.client.0.smithi044.stdout:4/127: mkdir dd/d35 0 2024-04-25T22:03:18.271 INFO:tasks.workunit.client.0.smithi044.stdout:0/186: dwrite d8/f11 [0,4194304] 0 2024-04-25T22:03:18.271 INFO:tasks.workunit.client.0.smithi044.stdout:3/213: chown d0/d1/d15/df/d12/dd/d35/d36/f45 623 1 2024-04-25T22:03:18.272 INFO:tasks.workunit.client.0.smithi044.stdout:0/187: fsync d8/d24/f26 0 2024-04-25T22:03:18.272 INFO:tasks.workunit.client.0.smithi044.stdout:1/216: link d3/d7/db/l2e d3/d30/l45 0 2024-04-25T22:03:18.272 INFO:tasks.workunit.client.0.smithi044.stdout:5/133: creat d2/d5/d21/f2d x:0 0 0 2024-04-25T22:03:18.273 INFO:tasks.workunit.client.0.smithi044.stdout:3/214: symlink d0/d1/d15/df/d12/dd/d11/d43/l47 0 2024-04-25T22:03:18.273 INFO:tasks.workunit.client.0.smithi044.stdout:1/217: creat d3/d7/db/f46 x:0 0 0 2024-04-25T22:03:18.274 INFO:tasks.workunit.client.0.smithi044.stdout:0/188: rename d8/d15/f1e to d8/df/d17/f44 0 2024-04-25T22:03:18.276 INFO:tasks.workunit.client.0.smithi044.stdout:3/215: mkdir d0/d1/d34/d48 0 2024-04-25T22:03:18.276 INFO:tasks.workunit.client.0.smithi044.stdout:9/275: dread d4/d7/f39 [0,4194304] 0 2024-04-25T22:03:18.277 INFO:tasks.workunit.client.0.smithi044.stdout:4/128: truncate dd/d19/f2d 255254 0 2024-04-25T22:03:18.278 INFO:tasks.workunit.client.0.smithi044.stdout:3/216: creat d0/d1/d15/df/d12/f49 x:0 0 0 2024-04-25T22:03:18.278 INFO:tasks.workunit.client.0.smithi044.stdout:7/132: write f9 [837620,53805] 0 2024-04-25T22:03:18.278 INFO:tasks.workunit.client.0.smithi044.stdout:8/283: dread d2a/f2e [0,4194304] 0 2024-04-25T22:03:18.278 INFO:tasks.workunit.client.0.smithi044.stdout:1/218: getdents d3/d7/db 0 2024-04-25T22:03:18.278 INFO:tasks.workunit.client.0.smithi044.stdout:9/276: fdatasync d4/f1a 0 2024-04-25T22:03:18.279 INFO:tasks.workunit.client.0.smithi044.stdout:7/133: read f0 [273718,45692] 0 2024-04-25T22:03:18.279 INFO:tasks.workunit.client.0.smithi044.stdout:4/129: creat dd/f36 x:0 0 0 2024-04-25T22:03:18.279 INFO:tasks.workunit.client.0.smithi044.stdout:1/219: chown d3/d7/f2a 57 1 2024-04-25T22:03:18.281 INFO:tasks.workunit.client.0.smithi044.stdout:4/130: chown fa 1524 1 2024-04-25T22:03:18.281 INFO:tasks.workunit.client.0.smithi044.stdout:9/277: write d4/f1f [6821721,23606] 0 2024-04-25T22:03:18.282 INFO:tasks.workunit.client.0.smithi044.stdout:4/131: fdatasync dd/ff 0 2024-04-25T22:03:18.282 INFO:tasks.workunit.client.0.smithi044.stdout:7/134: rename f13 to d1c/f1f 0 2024-04-25T22:03:18.283 INFO:tasks.workunit.client.0.smithi044.stdout:5/134: dread d2/f20 [0,4194304] 0 2024-04-25T22:03:18.283 INFO:tasks.workunit.client.0.smithi044.stdout:7/135: creat d1c/f20 x:0 0 0 2024-04-25T22:03:18.285 INFO:tasks.workunit.client.0.smithi044.stdout:4/132: creat dd/d35/f37 x:0 0 0 2024-04-25T22:03:18.285 INFO:tasks.workunit.client.0.smithi044.stdout:9/278: truncate d4/d7/d18/d2e/f3f 2031502 0 2024-04-25T22:03:18.286 INFO:tasks.workunit.client.0.smithi044.stdout:5/135: write d2/d5/f17 [4453403,12490] 0 2024-04-25T22:03:18.288 INFO:tasks.workunit.client.0.smithi044.stdout:0/189: dwrite f6 [0,4194304] 0 2024-04-25T22:03:18.289 INFO:tasks.workunit.client.0.smithi044.stdout:8/284: dread f2 [0,4194304] 0 2024-04-25T22:03:18.290 INFO:tasks.workunit.client.0.smithi044.stdout:4/133: write dd/d35/f37 [1015190,49726] 0 2024-04-25T22:03:18.290 INFO:tasks.workunit.client.0.smithi044.stdout:7/136: rename d1c/f1f to d1c/f21 0 2024-04-25T22:03:18.290 INFO:tasks.workunit.client.0.smithi044.stdout:6/270: dwrite d2/d23/f37 [0,4194304] 0 2024-04-25T22:03:18.290 INFO:tasks.workunit.client.0.smithi044.stdout:9/279: dread - d4/d7/d18/d3a/f5f zero size 2024-04-25T22:03:18.291 INFO:tasks.workunit.client.0.smithi044.stdout:0/190: dread - d8/d20/f31 zero size 2024-04-25T22:03:18.291 INFO:tasks.workunit.client.0.smithi044.stdout:5/136: rename d2/c14 to d2/d5/d27/c2e 0 2024-04-25T22:03:18.292 INFO:tasks.workunit.client.0.smithi044.stdout:8/285: readlink d2a/d39/d42/l47 0 2024-04-25T22:03:18.292 INFO:tasks.workunit.client.0.smithi044.stdout:3/217: dwrite d0/d13/d1c/f2b [0,4194304] 0 2024-04-25T22:03:18.293 INFO:tasks.workunit.client.0.smithi044.stdout:5/137: sync 2024-04-25T22:03:18.293 INFO:tasks.workunit.client.0.smithi044.stdout:1/220: dwrite d3/d7/f40 [0,4194304] 0 2024-04-25T22:03:18.293 INFO:tasks.workunit.client.0.smithi044.stdout:4/134: mkdir dd/d19/d38 0 2024-04-25T22:03:18.293 INFO:tasks.workunit.client.0.smithi044.stdout:8/286: creat d2a/d39/f55 x:0 0 0 2024-04-25T22:03:18.294 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:18.292+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:18.294 INFO:tasks.workunit.client.0.smithi044.stdout:8/287: chown d2a/d4a 19 1 2024-04-25T22:03:18.294 INFO:tasks.workunit.client.0.smithi044.stdout:6/271: mkdir d2/d23/d5a/d12/d51/d63 0 2024-04-25T22:03:18.298 INFO:tasks.workunit.client.0.smithi044.stdout:9/280: write d4/f1f [7113922,69579] 0 2024-04-25T22:03:18.299 INFO:tasks.workunit.client.0.smithi044.stdout:4/135: creat dd/d19/d38/f39 x:0 0 0 2024-04-25T22:03:18.300 INFO:tasks.workunit.client.0.smithi044.stdout:7/137: dwrite f9 [0,4194304] 0 2024-04-25T22:03:18.301 INFO:tasks.workunit.client.0.smithi044.stdout:6/272: mknod d2/d23/d5a/d13/d4b/c64 0 2024-04-25T22:03:18.301 INFO:tasks.workunit.client.0.smithi044.stdout:9/281: symlink d4/d3d/d58/l61 0 2024-04-25T22:03:18.301 INFO:tasks.workunit.client.0.smithi044.stdout:8/288: creat d2a/d4a/f56 x:0 0 0 2024-04-25T22:03:18.301 INFO:tasks.workunit.client.0.smithi044.stdout:5/138: creat d2/d5/f2f x:0 0 0 2024-04-25T22:03:18.302 INFO:tasks.workunit.client.0.smithi044.stdout:7/138: rmdir d1c 39 2024-04-25T22:03:18.302 INFO:tasks.workunit.client.0.smithi044.stdout:4/136: mkdir dd/d3a 0 2024-04-25T22:03:18.302 INFO:tasks.workunit.client.0.smithi044.stdout:8/289: mkdir d2a/d32/d57 0 2024-04-25T22:03:18.303 INFO:tasks.workunit.client.0.smithi044.stdout:7/139: mkdir d1c/d22 0 2024-04-25T22:03:18.303 INFO:tasks.workunit.client.0.smithi044.stdout:6/273: symlink d2/d23/d5a/d11/d3b/d4f/l65 0 2024-04-25T22:03:18.304 INFO:tasks.workunit.client.0.smithi044.stdout:9/282: write d4/d7/d18/f5a [721671,39344] 0 2024-04-25T22:03:18.304 INFO:tasks.workunit.client.0.smithi044.stdout:8/290: symlink d2a/d32/l58 0 2024-04-25T22:03:18.304 INFO:tasks.workunit.client.0.smithi044.stdout:7/140: unlink ld 0 2024-04-25T22:03:18.305 INFO:tasks.workunit.client.0.smithi044.stdout:3/218: dwrite d0/d1/d15/df/d12/dd/d11/f2c [0,4194304] 0 2024-04-25T22:03:18.306 INFO:tasks.workunit.client.0.smithi044.stdout:8/291: write fa [742287,124626] 0 2024-04-25T22:03:18.306 INFO:tasks.workunit.client.0.smithi044.stdout:7/141: chown c2 8173068 1 2024-04-25T22:03:18.308 INFO:tasks.workunit.client.0.smithi044.stdout:3/219: rmdir d0/d1/d15/d23 39 2024-04-25T22:03:18.308 INFO:tasks.workunit.client.0.smithi044.stdout:9/283: rename d4/f1f to d4/d7/d18/d2d/f62 0 2024-04-25T22:03:18.309 INFO:tasks.workunit.client.0.smithi044.stdout:1/221: dwrite d3/d7/db/f1d [0,4194304] 0 2024-04-25T22:03:18.309 INFO:tasks.workunit.client.0.smithi044.stdout:6/274: rename d2/d23/d5a/d11/d2a/c4a to d2/d23/d5a/d13/c66 0 2024-04-25T22:03:18.310 INFO:tasks.workunit.client.0.smithi044.stdout:5/139: dread d2/d5/f16 [0,4194304] 0 2024-04-25T22:03:18.310 INFO:tasks.workunit.client.0.smithi044.stdout:1/222: write d3/d7/f20 [570223,107032] 0 2024-04-25T22:03:18.310 INFO:tasks.workunit.client.0.smithi044.stdout:5/140: sync 2024-04-25T22:03:18.310 INFO:tasks.workunit.client.0.smithi044.stdout:3/220: mkdir d0/d1/d15/df/d12/dd/d4a 0 2024-04-25T22:03:18.311 INFO:tasks.workunit.client.0.smithi044.stdout:1/223: write d3/d7/f20 [822324,78110] 0 2024-04-25T22:03:18.311 INFO:tasks.workunit.client.0.smithi044.stdout:5/141: truncate d2/d5/f17 4966355 0 2024-04-25T22:03:18.311 INFO:tasks.workunit.client.0.smithi044.stdout:3/221: write d0/d13/d1c/f2b [4366001,80475] 0 2024-04-25T22:03:18.312 INFO:tasks.workunit.client.0.smithi044.stdout:5/142: unlink d2/d5/c10 0 2024-04-25T22:03:18.312 INFO:tasks.workunit.client.0.smithi044.stdout:1/224: write d3/d7/f2f [1984337,70920] 0 2024-04-25T22:03:18.313 INFO:tasks.workunit.client.0.smithi044.stdout:3/222: readlink d0/d1/d15/df/d12/dd/d11/d43/l47 0 2024-04-25T22:03:18.313 INFO:tasks.workunit.client.0.smithi044.stdout:5/143: chown d2/l1a 1167 1 2024-04-25T22:03:18.313 INFO:tasks.workunit.client.0.smithi044.stdout:1/225: symlink d3/d7/d29/l47 0 2024-04-25T22:03:18.314 INFO:tasks.workunit.client.0.smithi044.stdout:5/144: chown d2/l15 950013294 1 2024-04-25T22:03:18.314 INFO:tasks.workunit.client.0.smithi044.stdout:6/275: read d2/d23/d5a/d11/f39 [626184,24817] 0 2024-04-25T22:03:18.315 INFO:tasks.workunit.client.0.smithi044.stdout:3/223: symlink d0/d1/d15/df/d12/dd/d11/d43/d44/l4b 0 2024-04-25T22:03:18.316 INFO:tasks.workunit.client.0.smithi044.stdout:0/191: truncate f1 3298526 0 2024-04-25T22:03:18.316 INFO:tasks.workunit.client.0.smithi044.stdout:9/284: dwrite d4/f5c [0,4194304] 0 2024-04-25T22:03:18.317 INFO:tasks.workunit.client.0.smithi044.stdout:3/224: mknod d0/d13/d1c/c4c 0 2024-04-25T22:03:18.318 INFO:tasks.workunit.client.0.smithi044.stdout:0/192: unlink d8/d24/c43 0 2024-04-25T22:03:18.318 INFO:tasks.workunit.client.0.smithi044.stdout:4/137: read dd/d35/f37 [87066,15965] 0 2024-04-25T22:03:18.318 INFO:tasks.workunit.client.0.smithi044.stdout:9/285: stat d4/d3d/c43 0 2024-04-25T22:03:18.319 INFO:tasks.workunit.client.0.smithi044.stdout:6/276: link d2/d23/d5a/d12/d49/f5b d2/d23/d5a/d13/d4b/f67 0 2024-04-25T22:03:18.320 INFO:tasks.workunit.client.0.smithi044.stdout:1/226: dread d3/d7/db/f3c [0,4194304] 0 2024-04-25T22:03:18.320 INFO:tasks.workunit.client.0.smithi044.stdout:4/138: rmdir dd/d3a 0 2024-04-25T22:03:18.320 INFO:tasks.workunit.client.0.smithi044.stdout:6/277: chown d2/d23/d5a/d12/d49 42516064 1 2024-04-25T22:03:18.321 INFO:tasks.workunit.client.0.smithi044.stdout:9/286: fsync d4/d7/d18/d2d/f38 0 2024-04-25T22:03:18.322 INFO:tasks.workunit.client.0.smithi044.stdout:1/227: symlink d3/d30/d3f/l48 0 2024-04-25T22:03:18.322 INFO:tasks.workunit.client.0.smithi044.stdout:5/145: dwrite d2/f20 [0,4194304] 0 2024-04-25T22:03:18.322 INFO:tasks.workunit.client.0.smithi044.stdout:6/278: dread - d2/d23/d5a/d13/f5f zero size 2024-04-25T22:03:18.324 INFO:tasks.workunit.client.0.smithi044.stdout:1/228: truncate d3/f37 576107 0 2024-04-25T22:03:18.325 INFO:tasks.workunit.client.0.smithi044.stdout:5/146: dread - d2/d5/d21/f2d zero size 2024-04-25T22:03:18.326 INFO:tasks.workunit.client.0.smithi044.stdout:6/279: rename d2/d23/d5a/d11/d3b/d4f to d2/d23/d5a/d13/d68 0 2024-04-25T22:03:18.327 INFO:tasks.workunit.client.0.smithi044.stdout:8/292: dread d2a/f45 [0,4194304] 0 2024-04-25T22:03:18.328 INFO:tasks.workunit.client.0.smithi044.stdout:1/229: chown d3/d7/f23 453458434 1 2024-04-25T22:03:18.329 INFO:tasks.workunit.client.0.smithi044.stdout:8/293: chown d2a/d39/d42 9 1 2024-04-25T22:03:18.330 INFO:tasks.workunit.client.0.smithi044.stdout:6/280: creat d2/d23/d30/f69 x:0 0 0 2024-04-25T22:03:18.330 INFO:tasks.workunit.client.0.smithi044.stdout:2/219: dread d7/d16/f17 [0,4194304] 0 2024-04-25T22:03:18.330 INFO:tasks.workunit.client.0.smithi044.stdout:1/230: readlink d3/d7/d29/l47 0 2024-04-25T22:03:18.332 INFO:tasks.workunit.client.0.smithi044.stdout:0/193: dwrite d8/df/d17/f33 [0,4194304] 0 2024-04-25T22:03:18.333 INFO:tasks.workunit.client.0.smithi044.stdout:8/294: write d2a/d4a/f4b [2943796,66128] 0 2024-04-25T22:03:18.333 INFO:tasks.workunit.client.0.smithi044.stdout:2/220: write d7/f3f [950591,13592] 0 2024-04-25T22:03:18.334 INFO:tasks.workunit.client.0.smithi044.stdout:3/225: dwrite d0/d1/d15/df/d12/dd/d11/f2c [0,4194304] 0 2024-04-25T22:03:18.334 INFO:tasks.workunit.client.0.smithi044.stdout:9/287: dwrite d4/d7/d18/d2e/f5d [0,4194304] 0 2024-04-25T22:03:18.334 INFO:tasks.workunit.client.0.smithi044.stdout:6/281: chown d2/d23/d5a/d11/d2a/f3c 522557707 1 2024-04-25T22:03:18.334 INFO:tasks.workunit.client.0.smithi044.stdout:4/139: dwrite dd/d19/f27 [0,4194304] 0 2024-04-25T22:03:18.336 INFO:tasks.workunit.client.0.smithi044.stdout:2/221: write d7/f15 [1664552,8675] 0 2024-04-25T22:03:18.336 INFO:tasks.workunit.client.0.smithi044.stdout:1/231: chown d3/d7/d29/l47 2845151 1 2024-04-25T22:03:18.336 INFO:tasks.workunit.client.0.smithi044.stdout:8/295: write d2a/f4e [724763,91371] 0 2024-04-25T22:03:18.336 INFO:tasks.workunit.client.0.smithi044.stdout:6/282: read - d2/d23/d5a/d12/f48 zero size 2024-04-25T22:03:18.337 INFO:tasks.workunit.client.0.smithi044.stdout:0/194: write d8/d24/f28 [836369,114209] 0 2024-04-25T22:03:18.337 INFO:tasks.workunit.client.0.smithi044.stdout:0/195: fsync d8/d20/f38 0 2024-04-25T22:03:18.337 INFO:tasks.workunit.client.0.smithi044.stdout:3/226: creat d0/d1/d15/df/d12/dd/d11/d42/f4d x:0 0 0 2024-04-25T22:03:18.338 INFO:tasks.workunit.client.0.smithi044.stdout:5/147: dread d2/d5/f18 [0,4194304] 0 2024-04-25T22:03:18.339 INFO:tasks.workunit.client.0.smithi044.stdout:0/196: chown d8/f3b 87553445 1 2024-04-25T22:03:18.339 INFO:tasks.workunit.client.0.smithi044.stdout:9/288: write d4/d7/f8 [1777746,30527] 0 2024-04-25T22:03:18.339 INFO:tasks.workunit.client.0.smithi044.stdout:8/296: chown d2a/d32/c4d 5591 1 2024-04-25T22:03:18.340 INFO:tasks.workunit.client.0.smithi044.stdout:0/197: stat d8/f9 0 2024-04-25T22:03:18.342 INFO:tasks.workunit.client.0.smithi044.stdout:4/140: creat dd/f3b x:0 0 0 2024-04-25T22:03:18.343 INFO:tasks.workunit.client.0.smithi044.stdout:3/227: creat d0/d1/d15/df/d12/dd/f4e x:0 0 0 2024-04-25T22:03:18.343 INFO:tasks.workunit.client.0.smithi044.stdout:9/289: creat d4/d7/f63 x:0 0 0 2024-04-25T22:03:18.343 INFO:tasks.workunit.client.0.smithi044.stdout:1/232: creat d3/f49 x:0 0 0 2024-04-25T22:03:18.344 INFO:tasks.workunit.client.0.smithi044.stdout:0/198: stat d8/da/lb 0 2024-04-25T22:03:18.345 INFO:tasks.workunit.client.0.smithi044.stdout:2/222: dwrite d7/d16/f20 [0,4194304] 0 2024-04-25T22:03:18.346 INFO:tasks.workunit.client.0.smithi044.stdout:0/199: mkdir d8/df/d17/d45 0 2024-04-25T22:03:18.346 INFO:tasks.workunit.client.0.smithi044.stdout:1/233: write d3/d7/f20 [320740,117456] 0 2024-04-25T22:03:18.346 INFO:tasks.workunit.client.0.smithi044.stdout:2/223: chown d7 242 1 2024-04-25T22:03:18.347 INFO:tasks.workunit.client.0.smithi044.stdout:9/290: dread d4/d7/f4d [0,4194304] 0 2024-04-25T22:03:18.347 INFO:tasks.workunit.client.0.smithi044.stdout:0/200: rmdir d8/d20 39 2024-04-25T22:03:18.347 INFO:tasks.workunit.client.0.smithi044.stdout:1/234: dread - d3/d30/f31 zero size 2024-04-25T22:03:18.347 INFO:tasks.workunit.client.0.smithi044.stdout:6/283: dwrite d2/d23/d5a/d12/d27/f2d [0,4194304] 0 2024-04-25T22:03:18.349 INFO:tasks.workunit.client.0.smithi044.stdout:8/297: dwrite f25 [0,4194304] 0 2024-04-25T22:03:18.350 INFO:tasks.workunit.client.0.smithi044.stdout:8/298: chown d2a/d39/d42/f49 1440073096 1 2024-04-25T22:03:18.350 INFO:tasks.workunit.client.0.smithi044.stdout:0/201: rename d8/d20/c32 to d8/df/d17/c46 0 2024-04-25T22:03:18.351 INFO:tasks.workunit.client.0.smithi044.stdout:1/235: creat d3/f4a x:0 0 0 2024-04-25T22:03:18.351 INFO:tasks.workunit.client.0.smithi044.stdout:8/299: rmdir d2a/d32 39 2024-04-25T22:03:18.352 INFO:tasks.workunit.client.0.smithi044.stdout:0/202: symlink d8/df/d17/d45/l47 0 2024-04-25T22:03:18.352 INFO:tasks.workunit.client.0.smithi044.stdout:8/300: symlink d2a/l59 0 2024-04-25T22:03:18.352 INFO:tasks.workunit.client.0.smithi044.stdout:9/291: dread d4/d37/f45 [0,4194304] 0 2024-04-25T22:03:18.353 INFO:tasks.workunit.client.0.smithi044.stdout:9/292: chown d4/l6 822 1 2024-04-25T22:03:18.353 INFO:tasks.workunit.client.0.smithi044.stdout:8/301: dread d2a/d32/f35 [0,4194304] 0 2024-04-25T22:03:18.354 INFO:tasks.workunit.client.0.smithi044.stdout:9/293: mkdir d4/d5e/d64 0 2024-04-25T22:03:18.355 INFO:tasks.workunit.client.0.smithi044.stdout:6/284: dwrite d2/d23/d5a/f1b [0,4194304] 0 2024-04-25T22:03:18.357 INFO:tasks.workunit.client.0.smithi044.stdout:9/294: creat d4/d5e/d64/f65 x:0 0 0 2024-04-25T22:03:18.358 INFO:tasks.workunit.client.0.smithi044.stdout:6/285: rename d2/d23/d5a/d12/d51 to d2/d23/d6a 0 2024-04-25T22:03:18.359 INFO:tasks.workunit.client.0.smithi044.stdout:1/236: dwrite d3/f49 [0,4194304] 0 2024-04-25T22:03:18.360 INFO:tasks.workunit.client.0.smithi044.stdout:0/203: dwrite d8/d15/f42 [0,4194304] 0 2024-04-25T22:03:18.360 INFO:tasks.workunit.client.0.smithi044.stdout:6/286: mknod d2/d23/d5a/d11/d3b/c6b 0 2024-04-25T22:03:18.362 INFO:tasks.workunit.client.0.smithi044.stdout:0/204: creat d8/d24/f48 x:0 0 0 2024-04-25T22:03:18.362 INFO:tasks.workunit.client.0.smithi044.stdout:8/302: dwrite d2a/d39/f55 [0,4194304] 0 2024-04-25T22:03:18.363 INFO:tasks.workunit.client.0.smithi044.stdout:6/287: write d2/d23/d5a/d11/d2a/f3c [633030,45209] 0 2024-04-25T22:03:18.363 INFO:tasks.workunit.client.0.smithi044.stdout:5/148: truncate d2/d5/f1f 131099 0 2024-04-25T22:03:18.363 INFO:tasks.workunit.client.0.smithi044.stdout:4/141: truncate dd/d35/f37 1004150 0 2024-04-25T22:03:18.364 INFO:tasks.workunit.client.0.smithi044.stdout:0/205: chown d8/df/d17/f3d 126 1 2024-04-25T22:03:18.364 INFO:tasks.workunit.client.0.smithi044.stdout:8/303: write d2a/d32/f33 [3471839,48815] 0 2024-04-25T22:03:18.364 INFO:tasks.workunit.client.0.smithi044.stdout:5/149: readlink d2/d5/lc 0 2024-04-25T22:03:18.365 INFO:tasks.workunit.client.0.smithi044.stdout:3/228: dread d0/d13/d1c/f2b [4194304,4194304] 0 2024-04-25T22:03:18.365 INFO:tasks.workunit.client.0.smithi044.stdout:4/142: write dd/d19/f21 [369463,52374] 0 2024-04-25T22:03:18.365 INFO:tasks.workunit.client.0.smithi044.stdout:0/206: write d8/df/f40 [276690,11639] 0 2024-04-25T22:03:18.368 INFO:tasks.workunit.client.0.smithi044.stdout:3/229: mknod d0/d1/d15/df/d12/dd/d11/d43/d44/c4f 0 2024-04-25T22:03:18.369 INFO:tasks.workunit.client.0.smithi044.stdout:0/207: creat d8/da/f49 x:0 0 0 2024-04-25T22:03:18.369 INFO:tasks.workunit.client.0.smithi044.stdout:3/230: chown d0/d1/d15/df/d12/d39 414612126 1 2024-04-25T22:03:18.369 INFO:tasks.workunit.client.0.smithi044.stdout:7/142: dread fa [0,4194304] 0 2024-04-25T22:03:18.369 INFO:tasks.workunit.client.0.smithi044.stdout:7/143: readlink l19 0 2024-04-25T22:03:18.369 INFO:tasks.workunit.client.0.smithi044.stdout:0/208: creat d8/df/d17/d45/f4a x:0 0 0 2024-04-25T22:03:18.370 INFO:tasks.workunit.client.0.smithi044.stdout:7/144: chown f14 125342 1 2024-04-25T22:03:18.370 INFO:tasks.workunit.client.0.smithi044.stdout:3/231: dread - d0/d1/d15/df/d12/dd/f4e zero size 2024-04-25T22:03:18.370 INFO:tasks.workunit.client.0.smithi044.stdout:0/209: rename d8/df/c37 to d8/c4b 0 2024-04-25T22:03:18.371 INFO:tasks.workunit.client.0.smithi044.stdout:0/210: chown d8/da/c22 277463933 1 2024-04-25T22:03:18.372 INFO:tasks.workunit.client.0.smithi044.stdout:4/143: dwrite dd/d19/f32 [4194304,4194304] 0 2024-04-25T22:03:18.372 INFO:tasks.workunit.client.0.smithi044.stdout:4/144: chown dd/f3b 458936 1 2024-04-25T22:03:18.373 INFO:tasks.workunit.client.0.smithi044.stdout:6/288: read d2/fd [1901695,79666] 0 2024-04-25T22:03:18.374 INFO:tasks.workunit.client.0.smithi044.stdout:3/232: dread d0/d1/d15/df/d12/f29 [0,4194304] 0 2024-04-25T22:03:18.375 INFO:tasks.workunit.client.0.smithi044.stdout:6/289: rename d2/d23/d5a/d11/c26 to d2/d23/d5a/d13/d4b/d5e/c6c 0 2024-04-25T22:03:18.378 INFO:tasks.workunit.client.0.smithi044.stdout:4/145: dwrite fa [0,4194304] 0 2024-04-25T22:03:18.378 INFO:tasks.workunit.client.0.smithi044.stdout:4/146: read - dd/f36 zero size 2024-04-25T22:03:18.379 INFO:tasks.workunit.client.0.smithi044.stdout:4/147: rmdir dd 39 2024-04-25T22:03:18.379 INFO:tasks.workunit.client.0.smithi044.stdout:0/211: fdatasync d8/f11 0 2024-04-25T22:03:18.380 INFO:tasks.workunit.client.0.smithi044.stdout:6/290: dread d2/d23/d5a/f1b [0,4194304] 0 2024-04-25T22:03:18.380 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:18.380 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:18.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.380 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11263 4.4 4:22be2a9e:::10000003224.00000000:head [write 1984337~70920 in=70920b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.380 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.314979+0000", 2024-04-25T22:03:18.380 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.063462419000000006, 2024-04-25T22:03:18.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063485653000000003, 2024-04-25T22:03:18.380 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.381 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.381 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:18.381 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.381 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.381 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.381 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11263 2024-04-25T22:03:18.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.381 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.314979+0000", 2024-04-25T22:03:18.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.314979+0000", 2024-04-25T22:03:18.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.314979+0000", 2024-04-25T22:03:18.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4099999999999998e-07 2024-04-25T22:03:18.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.315017+0000", 2024-04-25T22:03:18.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7400000000000001e-05 2024-04-25T22:03:18.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.315045+0000", 2024-04-25T22:03:18.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8126000000000001e-05 2024-04-25T22:03:18.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.315053+0000", 2024-04-25T22:03:18.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4479999999999994e-06 2024-04-25T22:03:18.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.327014+0000", 2024-04-25T22:03:18.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011960719999999999 2024-04-25T22:03:18.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.327104+0000", 2024-04-25T22:03:18.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9908999999999996e-05 2024-04-25T22:03:18.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.327254+0000", 2024-04-25T22:03:18.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015003400000000001 2024-04-25T22:03:18.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.329191+0000", 2024-04-25T22:03:18.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019371779999999999 2024-04-25T22:03:18.385 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.385 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.385 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.385 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11289 4.37 4:ef2cf08c:::100000031bd.00000000:head [write 320740~117456 in=117456b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.385 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.350481+0000", 2024-04-25T22:03:18.385 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.027960154000000001, 2024-04-25T22:03:18.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028037557000000001, 2024-04-25T22:03:18.386 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.386 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.386 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:18.386 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.386 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.386 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.386 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11289 2024-04-25T22:03:18.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.386 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.350481+0000", 2024-04-25T22:03:18.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.350481+0000", 2024-04-25T22:03:18.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.350481+0000", 2024-04-25T22:03:18.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3900000000000005e-07 2024-04-25T22:03:18.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.350556+0000", 2024-04-25T22:03:18.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4375000000000005e-05 2024-04-25T22:03:18.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.350565+0000", 2024-04-25T22:03:18.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.115e-06 2024-04-25T22:03:18.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.350571+0000", 2024-04-25T22:03:18.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9680000000000003e-06 2024-04-25T22:03:18.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.367058+0000", 2024-04-25T22:03:18.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016486812999999999 2024-04-25T22:03:18.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.367145+0000", 2024-04-25T22:03:18.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6904999999999995e-05 2024-04-25T22:03:18.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.367281+0000", 2024-04-25T22:03:18.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013627100000000001 2024-04-25T22:03:18.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.377170+0000", 2024-04-25T22:03:18.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0098890839999999994 2024-04-25T22:03:18.390 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.390 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.390 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.390 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11219 4.4 4:210cd53e:::100000031ff.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.390 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:18.390 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.12540728400000001, 2024-04-25T22:03:18.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12553075399999999, 2024-04-25T22:03:18.391 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.391 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.391 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:18.391 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.391 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.391 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.391 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11219 2024-04-25T22:03:18.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.391 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:18.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:18.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253035+0000", 2024-04-25T22:03:18.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.322e-06 2024-04-25T22:03:18.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258145+0000", 2024-04-25T22:03:18.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051095669999999998 2024-04-25T22:03:18.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258163+0000", 2024-04-25T22:03:18.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8377999999999999e-05 2024-04-25T22:03:18.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258174+0000", 2024-04-25T22:03:18.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0925e-05 2024-04-25T22:03:18.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270495+0000", 2024-04-25T22:03:18.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012321354 2024-04-25T22:03:18.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270581+0000", 2024-04-25T22:03:18.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5741999999999993e-05 2024-04-25T22:03:18.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270717+0000", 2024-04-25T22:03:18.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013571500000000001 2024-04-25T22:03:18.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326599+0000", 2024-04-25T22:03:18.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055882026000000001 2024-04-25T22:03:18.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.395 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.395 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11290 4.3b 4:dd7ebf8a:::1000000317c.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.395 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.350581+0000", 2024-04-25T22:03:18.395 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.027859505, 2024-04-25T22:03:18.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028028193, 2024-04-25T22:03:18.395 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.395 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.395 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:18.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.396 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.396 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11290 2024-04-25T22:03:18.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.396 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.350581+0000", 2024-04-25T22:03:18.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.350581+0000", 2024-04-25T22:03:18.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.350582+0000", 2024-04-25T22:03:18.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0999999999999998e-07 2024-04-25T22:03:18.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.358672+0000", 2024-04-25T22:03:18.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080902669999999999 2024-04-25T22:03:18.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.358690+0000", 2024-04-25T22:03:18.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7946999999999999e-05 2024-04-25T22:03:18.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.358701+0000", 2024-04-25T22:03:18.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0729e-05 2024-04-25T22:03:18.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.359479+0000", 2024-04-25T22:03:18.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00077768599999999998 2024-04-25T22:03:18.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.359576+0000", 2024-04-25T22:03:18.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7312000000000006e-05 2024-04-25T22:03:18.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.359721+0000", 2024-04-25T22:03:18.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014521400000000001 2024-04-25T22:03:18.399 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.399 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.399 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.399 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:916 3.13 e65/15 3:cb3d3880:::200.0000000d:head v 65'136, mlcod=65'128)", 2024-04-25T22:03:18.399 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.362660+0000", 2024-04-25T22:03:18.399 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.015780737999999999, 2024-04-25T22:03:18.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015989237999999999, 2024-04-25T22:03:18.399 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.399 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.400 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:03:18.400 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.362660+0000", 2024-04-25T22:03:18.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.362660+0000", 2024-04-25T22:03:18.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.362661+0000", 2024-04-25T22:03:18.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.057e-06 2024-04-25T22:03:18.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.362675+0000", 2024-04-25T22:03:18.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3726999999999999e-05 2024-04-25T22:03:18.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.362689+0000", 2024-04-25T22:03:18.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3766e-05 2024-04-25T22:03:18.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.362699+0000", 2024-04-25T22:03:18.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7329999999999998e-06 2024-04-25T22:03:18.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.362769+0000", 2024-04-25T22:03:18.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0772999999999995e-05 2024-04-25T22:03:18.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.362795+0000", 2024-04-25T22:03:18.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5984000000000001e-05 2024-04-25T22:03:18.404 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.404 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.404 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.404 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4564.0:11284 4.3b e65/49)", 2024-04-25T22:03:18.404 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.362993+0000", 2024-04-25T22:03:18.404 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.015448175, 2024-04-25T22:03:18.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015687787000000002, 2024-04-25T22:03:18.404 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.404 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.404 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:18.405 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.362993+0000", 2024-04-25T22:03:18.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.362993+0000", 2024-04-25T22:03:18.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.362993+0000", 2024-04-25T22:03:18.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1099999999999995e-07 2024-04-25T22:03:18.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.362997+0000", 2024-04-25T22:03:18.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5429999999999998e-06 2024-04-25T22:03:18.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.363005+0000", 2024-04-25T22:03:18.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5110000000000003e-06 2024-04-25T22:03:18.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.363011+0000", 2024-04-25T22:03:18.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5690000000000004e-06 2024-04-25T22:03:18.407 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.407 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.407 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.407 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:917 3.13 e65/15)", 2024-04-25T22:03:18.407 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.363195+0000", 2024-04-25T22:03:18.407 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.015246465000000001, 2024-04-25T22:03:18.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015510704, 2024-04-25T22:03:18.407 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.407 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.407 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:18.407 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.363195+0000", 2024-04-25T22:03:18.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.363195+0000", 2024-04-25T22:03:18.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.363195+0000", 2024-04-25T22:03:18.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:03:18.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.363210+0000", 2024-04-25T22:03:18.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4694e-05 2024-04-25T22:03:18.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.363219+0000", 2024-04-25T22:03:18.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8829999999999995e-06 2024-04-25T22:03:18.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.363224+0000", 2024-04-25T22:03:18.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8030000000000002e-06 2024-04-25T22:03:18.410 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.410 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.410 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.410 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11291 4.2d 4:b5e5ddcf:::100000030f1.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.410 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.359452+0000", 2024-04-25T22:03:18.410 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018989256999999999, 2024-04-25T22:03:18.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019283605999999998, 2024-04-25T22:03:18.410 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.411 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.411 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:18.411 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.411 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.411 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.411 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11291 2024-04-25T22:03:18.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.411 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.359452+0000", 2024-04-25T22:03:18.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.359452+0000", 2024-04-25T22:03:18.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.359453+0000", 2024-04-25T22:03:18.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.142e-06 2024-04-25T22:03:18.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.365470+0000", 2024-04-25T22:03:18.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060174139999999996 2024-04-25T22:03:18.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.365488+0000", 2024-04-25T22:03:18.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7243000000000001e-05 2024-04-25T22:03:18.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.365500+0000", 2024-04-25T22:03:18.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2595999999999999e-05 2024-04-25T22:03:18.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.365583+0000", 2024-04-25T22:03:18.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2985999999999995e-05 2024-04-25T22:03:18.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.365708+0000", 2024-04-25T22:03:18.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012459299999999999 2024-04-25T22:03:18.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.365852+0000", 2024-04-25T22:03:18.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000144055 2024-04-25T22:03:18.414 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.414 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.414 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.415 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11246 4.4 4:22371326:::10000003207.00000000:head [write 0~4194304 [2@4155513] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.415 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.293743+0000", 2024-04-25T22:03:18.415 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.084698338999999997, 2024-04-25T22:03:18.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.085034236999999999, 2024-04-25T22:03:18.415 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.415 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.415 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:18.415 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.415 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.415 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.415 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11246 2024-04-25T22:03:18.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.416 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.293743+0000", 2024-04-25T22:03:18.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.293743+0000", 2024-04-25T22:03:18.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.293744+0000", 2024-04-25T22:03:18.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.745e-06 2024-04-25T22:03:18.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.301055+0000", 2024-04-25T22:03:18.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073101349999999997 2024-04-25T22:03:18.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.301077+0000", 2024-04-25T22:03:18.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2325000000000001e-05 2024-04-25T22:03:18.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.301089+0000", 2024-04-25T22:03:18.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2319e-05 2024-04-25T22:03:18.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.301169+0000", 2024-04-25T22:03:18.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9890999999999998e-05 2024-04-25T22:03:18.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.301858+0000", 2024-04-25T22:03:18.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00068852099999999999 2024-04-25T22:03:18.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.301998+0000", 2024-04-25T22:03:18.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014076200000000001 2024-04-25T22:03:18.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.328567+0000", 2024-04-25T22:03:18.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026568623 2024-04-25T22:03:18.419 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.419 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.419 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.419 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11275 4.1c 4:38b085a0:::1000000320b.00000000:head [write 0~3407872 in=3407872b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.419 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.334224+0000", 2024-04-25T22:03:18.420 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.044217065999999999, 2024-04-25T22:03:18.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044597087000000001, 2024-04-25T22:03:18.420 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.420 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.420 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:18.420 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.420 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.420 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.420 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11275 2024-04-25T22:03:18.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.420 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.334224+0000", 2024-04-25T22:03:18.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.334224+0000", 2024-04-25T22:03:18.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.334226+0000", 2024-04-25T22:03:18.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6729999999999999e-06 2024-04-25T22:03:18.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.340512+0000", 2024-04-25T22:03:18.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.006286186 2024-04-25T22:03:18.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.340530+0000", 2024-04-25T22:03:18.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8272999999999999e-05 2024-04-25T22:03:18.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.340541+0000", 2024-04-25T22:03:18.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0659000000000001e-05 2024-04-25T22:03:18.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.353630+0000", 2024-04-25T22:03:18.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013089213000000001 2024-04-25T22:03:18.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.353690+0000", 2024-04-25T22:03:18.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0489000000000003e-05 2024-04-25T22:03:18.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.353777+0000", 2024-04-25T22:03:18.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6458999999999993e-05 2024-04-25T22:03:18.423 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.423 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.423 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.424 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:918 3.13 e65/15)", 2024-04-25T22:03:18.424 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.368711+0000", 2024-04-25T22:03:18.424 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0097304399999999999, 2024-04-25T22:03:18.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010147757, 2024-04-25T22:03:18.424 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.424 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.424 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:18.424 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368711+0000", 2024-04-25T22:03:18.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368711+0000", 2024-04-25T22:03:18.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368712+0000", 2024-04-25T22:03:18.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.06e-06 2024-04-25T22:03:18.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368726+0000", 2024-04-25T22:03:18.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3957e-05 2024-04-25T22:03:18.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368733+0000", 2024-04-25T22:03:18.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6680000000000001e-06 2024-04-25T22:03:18.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368739+0000", 2024-04-25T22:03:18.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6060000000000002e-06 2024-04-25T22:03:18.426 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.426 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.426 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.426 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:919 3.13 e65/15)", 2024-04-25T22:03:18.427 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.368749+0000", 2024-04-25T22:03:18.427 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0096922050000000006, 2024-04-25T22:03:18.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010133886, 2024-04-25T22:03:18.427 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.427 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.427 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:18.427 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368749+0000", 2024-04-25T22:03:18.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368749+0000", 2024-04-25T22:03:18.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368749+0000", 2024-04-25T22:03:18.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2899999999999999e-07 2024-04-25T22:03:18.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368760+0000", 2024-04-25T22:03:18.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0363000000000001e-05 2024-04-25T22:03:18.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368766+0000", 2024-04-25T22:03:18.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3829999999999997e-06 2024-04-25T22:03:18.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368771+0000", 2024-04-25T22:03:18.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7090000000000001e-06 2024-04-25T22:03:18.429 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.429 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.429 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.429 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:920 3.13 e65/15)", 2024-04-25T22:03:18.429 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.368778+0000", 2024-04-25T22:03:18.429 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0096628879999999997, 2024-04-25T22:03:18.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010128955, 2024-04-25T22:03:18.430 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.430 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.430 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:18.430 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368778+0000", 2024-04-25T22:03:18.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368778+0000", 2024-04-25T22:03:18.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368778+0000", 2024-04-25T22:03:18.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0199999999999998e-07 2024-04-25T22:03:18.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368783+0000", 2024-04-25T22:03:18.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1470000000000003e-06 2024-04-25T22:03:18.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368789+0000", 2024-04-25T22:03:18.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0430000000000004e-06 2024-04-25T22:03:18.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368793+0000", 2024-04-25T22:03:18.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4100000000000001e-06 2024-04-25T22:03:18.432 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.432 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.432 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.432 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:921 3.13 e65/15)", 2024-04-25T22:03:18.432 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.368800+0000", 2024-04-25T22:03:18.432 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0096411399999999994, 2024-04-25T22:03:18.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010131651, 2024-04-25T22:03:18.432 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.433 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.433 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:18.433 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368800+0000", 2024-04-25T22:03:18.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368800+0000", 2024-04-25T22:03:18.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368800+0000", 2024-04-25T22:03:18.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9299999999999999e-07 2024-04-25T22:03:18.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368820+0000", 2024-04-25T22:03:18.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9602e-05 2024-04-25T22:03:18.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368827+0000", 2024-04-25T22:03:18.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0879999999999997e-06 2024-04-25T22:03:18.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368832+0000", 2024-04-25T22:03:18.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9910000000000002e-06 2024-04-25T22:03:18.435 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.435 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.435 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.435 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:922 3.13 e65/15)", 2024-04-25T22:03:18.435 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.368841+0000", 2024-04-25T22:03:18.435 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0096001449999999992, 2024-04-25T22:03:18.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010114728, 2024-04-25T22:03:18.435 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.435 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.436 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:18.436 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368841+0000", 2024-04-25T22:03:18.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368841+0000", 2024-04-25T22:03:18.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368841+0000", 2024-04-25T22:03:18.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0499999999999999e-07 2024-04-25T22:03:18.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368845+0000", 2024-04-25T22:03:18.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2749999999999997e-06 2024-04-25T22:03:18.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368852+0000", 2024-04-25T22:03:18.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1959999999999996e-06 2024-04-25T22:03:18.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.368856+0000", 2024-04-25T22:03:18.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7700000000000001e-06 2024-04-25T22:03:18.438 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.438 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.438 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.438 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4564.0:11219 4.4 e65/16)", 2024-04-25T22:03:18.438 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.370067+0000", 2024-04-25T22:03:18.438 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0083735879999999995, 2024-04-25T22:03:18.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089164740000000006, 2024-04-25T22:03:18.438 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.438 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.439 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:18.439 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.370067+0000", 2024-04-25T22:03:18.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.370067+0000", 2024-04-25T22:03:18.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.370068+0000", 2024-04-25T22:03:18.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5099999999999999e-07 2024-04-25T22:03:18.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.370073+0000", 2024-04-25T22:03:18.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6569999999999996e-06 2024-04-25T22:03:18.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.370081+0000", 2024-04-25T22:03:18.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9859999999999994e-06 2024-04-25T22:03:18.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.370085+0000", 2024-04-25T22:03:18.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2370000000000003e-06 2024-04-25T22:03:18.441 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.441 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.441 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.441 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11279 4.1c 4.5a10d1c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.441 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.341536+0000", 2024-04-25T22:03:18.441 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.036904995000000003, 2024-04-25T22:03:18.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037474198, 2024-04-25T22:03:18.441 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.441 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.441 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:18.441 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.442 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.442 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.442 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11279 2024-04-25T22:03:18.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.442 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341536+0000", 2024-04-25T22:03:18.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341536+0000", 2024-04-25T22:03:18.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341537+0000", 2024-04-25T22:03:18.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8599999999999998e-07 2024-04-25T22:03:18.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341856+0000", 2024-04-25T22:03:18.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031902100000000001 2024-04-25T22:03:18.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341865+0000", 2024-04-25T22:03:18.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8769999999999999e-06 2024-04-25T22:03:18.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341872+0000", 2024-04-25T22:03:18.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9500000000000004e-06 2024-04-25T22:03:18.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.444 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.444 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4564.0:11246 4.4 e65/16)", 2024-04-25T22:03:18.444 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.370095+0000", 2024-04-25T22:03:18.444 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0083464209999999997, 2024-04-25T22:03:18.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089435569999999995, 2024-04-25T22:03:18.445 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.445 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.445 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:18.445 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.370095+0000", 2024-04-25T22:03:18.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.370095+0000", 2024-04-25T22:03:18.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.370095+0000", 2024-04-25T22:03:18.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.05e-07 2024-04-25T22:03:18.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.370096+0000", 2024-04-25T22:03:18.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.42e-06 2024-04-25T22:03:18.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.370099+0000", 2024-04-25T22:03:18.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1549999999999999e-06 2024-04-25T22:03:18.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.370102+0000", 2024-04-25T22:03:18.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.667e-06 2024-04-25T22:03:18.447 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.447 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.447 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.447 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4564.0:11263 4.4 e65/16)", 2024-04-25T22:03:18.447 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.370105+0000", 2024-04-25T22:03:18.447 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0083356490000000005, 2024-04-25T22:03:18.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089567610000000006, 2024-04-25T22:03:18.447 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.447 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.448 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:18.448 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.370105+0000", 2024-04-25T22:03:18.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.370105+0000", 2024-04-25T22:03:18.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.370105+0000", 2024-04-25T22:03:18.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.23e-07 2024-04-25T22:03:18.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.370107+0000", 2024-04-25T22:03:18.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.065e-06 2024-04-25T22:03:18.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.370109+0000", 2024-04-25T22:03:18.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7580000000000001e-06 2024-04-25T22:03:18.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.370112+0000", 2024-04-25T22:03:18.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.599e-06 2024-04-25T22:03:18.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.450 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.450 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:923 3.13 e65/15)", 2024-04-25T22:03:18.450 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.373216+0000", 2024-04-25T22:03:18.450 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0052245420000000004, 2024-04-25T22:03:18.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0058699190000000004, 2024-04-25T22:03:18.450 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.450 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.450 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:18.450 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.373216+0000", 2024-04-25T22:03:18.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.373216+0000", 2024-04-25T22:03:18.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.373218+0000", 2024-04-25T22:03:18.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1820000000000001e-06 2024-04-25T22:03:18.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.373237+0000", 2024-04-25T22:03:18.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9766e-05 2024-04-25T22:03:18.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.373249+0000", 2024-04-25T22:03:18.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1838000000000001e-05 2024-04-25T22:03:18.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.373258+0000", 2024-04-25T22:03:18.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0340000000000002e-06 2024-04-25T22:03:18.452 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.452 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.453 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.453 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11280 4.2f 4:f4126cad:::10000003280.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.453 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.341886+0000", 2024-04-25T22:03:18.453 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.036555418999999999, 2024-04-25T22:03:18.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037229224999999998, 2024-04-25T22:03:18.453 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.453 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.453 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:18.453 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.453 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.453 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.453 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11280 2024-04-25T22:03:18.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.454 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341886+0000", 2024-04-25T22:03:18.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341886+0000", 2024-04-25T22:03:18.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341886+0000", 2024-04-25T22:03:18.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1999999999999998e-07 2024-04-25T22:03:18.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.349422+0000", 2024-04-25T22:03:18.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075357640000000004 2024-04-25T22:03:18.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.349574+0000", 2024-04-25T22:03:18.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015163899999999999 2024-04-25T22:03:18.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.349589+0000", 2024-04-25T22:03:18.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5534000000000001e-05 2024-04-25T22:03:18.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.349668+0000", 2024-04-25T22:03:18.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9118999999999999e-05 2024-04-25T22:03:18.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.349878+0000", 2024-04-25T22:03:18.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020909800000000001 2024-04-25T22:03:18.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.350054+0000", 2024-04-25T22:03:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017620299999999999 2024-04-25T22:03:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.377455+0000", 2024-04-25T22:03:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027401055000000001 2024-04-25T22:03:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4564.0:11301 4.35 e65/16 4:addad63f:::100000030d7.00000000:head v 65'178, mlcod=65'176)", 2024-04-25T22:03:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.373896+0000", 2024-04-25T22:03:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0045449430000000001, 2024-04-25T22:03:18.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0052607219999999998, 2024-04-25T22:03:18.458 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.458 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.458 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:03:18.458 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.373896+0000", 2024-04-25T22:03:18.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.373896+0000", 2024-04-25T22:03:18.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.373897+0000", 2024-04-25T22:03:18.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0999999999999998e-07 2024-04-25T22:03:18.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.373947+0000", 2024-04-25T22:03:18.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0722e-05 2024-04-25T22:03:18.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.373957+0000", 2024-04-25T22:03:18.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6930000000000002e-06 2024-04-25T22:03:18.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.373964+0000", 2024-04-25T22:03:18.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.579e-06 2024-04-25T22:03:18.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.374020+0000", 2024-04-25T22:03:18.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6475999999999999e-05 2024-04-25T22:03:18.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.374047+0000", 2024-04-25T22:03:18.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6562000000000001e-05 2024-04-25T22:03:18.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.461 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.461 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11252 4.1c 4:38b085a0:::1000000320b.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.461 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.307595+0000", 2024-04-25T22:03:18.461 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.070846444999999994, 2024-04-25T22:03:18.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.071595181999999993, 2024-04-25T22:03:18.461 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.461 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.461 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:18.461 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.461 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.462 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.462 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11252 2024-04-25T22:03:18.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.462 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.307595+0000", 2024-04-25T22:03:18.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.307595+0000", 2024-04-25T22:03:18.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.307596+0000", 2024-04-25T22:03:18.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.967e-06 2024-04-25T22:03:18.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.314692+0000", 2024-04-25T22:03:18.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070956830000000002 2024-04-25T22:03:18.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.314709+0000", 2024-04-25T22:03:18.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7181999999999999e-05 2024-04-25T22:03:18.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.314718+0000", 2024-04-25T22:03:18.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8000000000000004e-06 2024-04-25T22:03:18.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.327027+0000", 2024-04-25T22:03:18.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012308708999999999 2024-04-25T22:03:18.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.327109+0000", 2024-04-25T22:03:18.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2087000000000002e-05 2024-04-25T22:03:18.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.327254+0000", 2024-04-25T22:03:18.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014501600000000001 2024-04-25T22:03:18.465 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.465 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.465 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.465 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:924 3.13 e65/15)", 2024-04-25T22:03:18.465 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.375740+0000", 2024-04-25T22:03:18.466 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0027013369999999998, 2024-04-25T22:03:18.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0034865899999999999, 2024-04-25T22:03:18.466 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.466 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.466 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:18.466 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.375740+0000", 2024-04-25T22:03:18.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.375740+0000", 2024-04-25T22:03:18.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.375741+0000", 2024-04-25T22:03:18.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3200000000000001e-06 2024-04-25T22:03:18.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.375749+0000", 2024-04-25T22:03:18.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1759999999999993e-06 2024-04-25T22:03:18.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.375764+0000", 2024-04-25T22:03:18.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4893e-05 2024-04-25T22:03:18.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.375772+0000", 2024-04-25T22:03:18.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7100000000000007e-06 2024-04-25T22:03:18.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.468 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.468 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11293 4.3f 4:fc0d2b13:::10000003140.00000000:head [write 0~4194304 [2@4046023] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.468 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.371842+0000", 2024-04-25T22:03:18.468 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0065994499999999998, 2024-04-25T22:03:18.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074121830000000001, 2024-04-25T22:03:18.469 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.469 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.469 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:18.469 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.469 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.469 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.469 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11293 2024-04-25T22:03:18.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.469 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.371842+0000", 2024-04-25T22:03:18.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.371842+0000", 2024-04-25T22:03:18.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.371843+0000", 2024-04-25T22:03:18.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.313e-06 2024-04-25T22:03:18.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.375863+0000", 2024-04-25T22:03:18.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040204810000000002 2024-04-25T22:03:18.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.375888+0000", 2024-04-25T22:03:18.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4913999999999999e-05 2024-04-25T22:03:18.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.375897+0000", 2024-04-25T22:03:18.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7350000000000002e-06 2024-04-25T22:03:18.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.376322+0000", 2024-04-25T22:03:18.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042526400000000001 2024-04-25T22:03:18.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.376458+0000", 2024-04-25T22:03:18.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000136117 2024-04-25T22:03:18.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.376598+0000", 2024-04-25T22:03:18.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013961999999999999 2024-04-25T22:03:18.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.472 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.473 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.473 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:925 3.13 e65/15)", 2024-04-25T22:03:18.473 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.376298+0000", 2024-04-25T22:03:18.473 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0021434140000000002, 2024-04-25T22:03:18.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029929330000000001, 2024-04-25T22:03:18.473 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.473 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.473 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:18.473 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.376298+0000", 2024-04-25T22:03:18.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.376298+0000", 2024-04-25T22:03:18.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.376298+0000", 2024-04-25T22:03:18.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7999999999999995e-07 2024-04-25T22:03:18.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.376307+0000", 2024-04-25T22:03:18.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5490000000000006e-06 2024-04-25T22:03:18.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.376315+0000", 2024-04-25T22:03:18.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0069999999999997e-06 2024-04-25T22:03:18.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.376320+0000", 2024-04-25T22:03:18.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1309999999999997e-06 2024-04-25T22:03:18.475 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.475 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.476 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.476 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11284 4.3b 4:de898292:::100000031fc.00000000:head [write 836369~114209 in=114209b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.476 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.350361+0000", 2024-04-25T22:03:18.476 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.028079521, 2024-04-25T22:03:18.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028966004, 2024-04-25T22:03:18.476 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.476 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.476 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:18.476 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.476 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.476 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.476 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11284 2024-04-25T22:03:18.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.477 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.350361+0000", 2024-04-25T22:03:18.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.350361+0000", 2024-04-25T22:03:18.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.350363+0000", 2024-04-25T22:03:18.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1119999999999999e-06 2024-04-25T22:03:18.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.350440+0000", 2024-04-25T22:03:18.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7423999999999996e-05 2024-04-25T22:03:18.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.350450+0000", 2024-04-25T22:03:18.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9289999999999993e-06 2024-04-25T22:03:18.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.350458+0000", 2024-04-25T22:03:18.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7880000000000007e-06 2024-04-25T22:03:18.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.354361+0000", 2024-04-25T22:03:18.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039030990000000002 2024-04-25T22:03:18.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.354558+0000", 2024-04-25T22:03:18.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000197658 2024-04-25T22:03:18.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.354743+0000", 2024-04-25T22:03:18.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018501100000000001 2024-04-25T22:03:18.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.357918+0000", 2024-04-25T22:03:18.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031747630000000002 2024-04-25T22:03:18.480 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.480 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.480 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.480 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4564.0:11289 4.37 e65/16 ondisk, result = 0)", 2024-04-25T22:03:18.481 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.379155+0000", 2024-04-25T22:03:18.481 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9992857, 2024-04-25T22:03:18.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021408899999999999, 2024-04-25T22:03:18.481 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.481 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.481 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:03:18.481 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.379155+0000", 2024-04-25T22:03:18.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.379155+0000", 2024-04-25T22:03:18.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.379156+0000", 2024-04-25T22:03:18.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3820000000000001e-06 2024-04-25T22:03:18.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.379163+0000", 2024-04-25T22:03:18.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8059999999999997e-06 2024-04-25T22:03:18.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.379194+0000", 2024-04-25T22:03:18.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1198999999999997e-05 2024-04-25T22:03:18.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.379205+0000", 2024-04-25T22:03:18.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0234999999999999e-05 2024-04-25T22:03:18.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.379261+0000", 2024-04-25T22:03:18.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6484999999999999e-05 2024-04-25T22:03:18.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.379270+0000", 2024-04-25T22:03:18.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9460000000000004e-06 2024-04-25T22:03:18.484 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.484 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.484 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.484 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.484 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-04-25T22:03:18.484 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 28 2024-04-25T22:03:18.484 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:18.486 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:18.480+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:18.487 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:18.507 INFO:tasks.workunit.client.0.smithi044.stdout:6/291: fsync d2/d23/d5a/d12/d49/f5b 0 2024-04-25T22:03:18.507 INFO:tasks.workunit.client.0.smithi044.stdout:6/292: getdents d2/d23/d5a/d13 0 2024-04-25T22:03:18.507 INFO:tasks.workunit.client.0.smithi044.stdout:0/212: dread d8/f11 [0,4194304] 0 2024-04-25T22:03:18.507 INFO:tasks.workunit.client.0.smithi044.stdout:6/293: getdents d2 0 2024-04-25T22:03:18.507 INFO:tasks.workunit.client.0.smithi044.stdout:6/294: read d2/d23/d5a/d11/d3b/f58 [1626287,35683] 0 2024-04-25T22:03:18.507 INFO:tasks.workunit.client.0.smithi044.stdout:6/295: mknod d2/d23/d5a/d13/d68/c6d 0 2024-04-25T22:03:18.507 INFO:tasks.workunit.client.0.smithi044.stdout:6/296: getdents d2/d23/d5a/d12/d1f 0 2024-04-25T22:03:18.507 INFO:tasks.workunit.client.0.smithi044.stdout:6/297: dread d2/d23/d5a/d13/f36 [0,4194304] 0 2024-04-25T22:03:18.507 INFO:tasks.workunit.client.0.smithi044.stdout:0/213: dread d8/d15/f1f [0,4194304] 0 2024-04-25T22:03:18.507 INFO:tasks.workunit.client.0.smithi044.stdout:6/298: mknod d2/d23/d5a/d12/d49/c6e 0 2024-04-25T22:03:18.508 INFO:tasks.workunit.client.0.smithi044.stdout:2/224: truncate d7/d16/f20 4172744 0 2024-04-25T22:03:18.508 INFO:tasks.workunit.client.0.smithi044.stdout:2/225: fdatasync d7/d8/d1c/f33 0 2024-04-25T22:03:18.508 INFO:tasks.workunit.client.0.smithi044.stdout:6/299: mkdir d2/d23/d5a/d11/d2a/d6f 0 2024-04-25T22:03:18.508 INFO:tasks.workunit.client.0.smithi044.stdout:0/214: write d8/df/d17/f33 [4518252,24202] 0 2024-04-25T22:03:18.508 INFO:tasks.workunit.client.0.smithi044.stdout:2/226: mknod d7/d16/d2c/c4a 0 2024-04-25T22:03:18.508 INFO:tasks.workunit.client.0.smithi044.stdout:6/300: read d2/d23/d5a/d12/d27/f2d [183850,15071] 0 2024-04-25T22:03:18.508 INFO:tasks.workunit.client.0.smithi044.stdout:0/215: creat d8/d20/f4c x:0 0 0 2024-04-25T22:03:18.508 INFO:tasks.workunit.client.0.smithi044.stdout:2/227: chown d7/d8/db 212866 1 2024-04-25T22:03:18.508 INFO:tasks.workunit.client.0.smithi044.stdout:2/228: mkdir d7/d16/d4b 0 2024-04-25T22:03:18.508 INFO:tasks.workunit.client.0.smithi044.stdout:0/216: creat d8/f4d x:0 0 0 2024-04-25T22:03:18.508 INFO:tasks.workunit.client.0.smithi044.stdout:2/229: readlink d7/la 0 2024-04-25T22:03:18.508 INFO:tasks.workunit.client.0.smithi044.stdout:2/230: fsync d7/d16/d2c/f3b 0 2024-04-25T22:03:18.508 INFO:tasks.workunit.client.0.smithi044.stdout:6/301: dread d2/d23/d5a/d12/d27/f2d [4194304,4194304] 0 2024-04-25T22:03:18.508 INFO:tasks.workunit.client.0.smithi044.stdout:0/217: dwrite d8/df/f10 [0,4194304] 0 2024-04-25T22:03:18.508 INFO:tasks.workunit.client.0.smithi044.stdout:4/148: dread dd/d19/f2d [0,4194304] 0 2024-04-25T22:03:18.509 INFO:tasks.workunit.client.0.smithi044.stdout:4/149: rename dd/d19/d38 to dd/d19/d38/d3c 22 2024-04-25T22:03:18.509 INFO:tasks.workunit.client.0.smithi044.stdout:6/302: truncate d2/d23/d5a/d12/f48 1035388 0 2024-04-25T22:03:18.509 INFO:tasks.workunit.client.0.smithi044.stdout:0/218: creat d8/df/f4e x:0 0 0 2024-04-25T22:03:18.509 INFO:tasks.workunit.client.0.smithi044.stdout:2/231: dwrite d7/f31 [0,4194304] 0 2024-04-25T22:03:18.509 INFO:tasks.workunit.client.0.smithi044.stdout:6/303: rename d2/d23/d5a/d11/d2a/d6f to d2/d23/d5a/d12/d70 0 2024-04-25T22:03:18.509 INFO:tasks.workunit.client.0.smithi044.stdout:6/304: creat d2/d23/d5a/d11/d3b/f71 x:0 0 0 2024-04-25T22:03:18.509 INFO:tasks.workunit.client.0.smithi044.stdout:6/305: readlink d2/d23/l2e 0 2024-04-25T22:03:18.509 INFO:tasks.workunit.client.0.smithi044.stdout:1/237: dread d3/d7/f20 [0,4194304] 0 2024-04-25T22:03:18.509 INFO:tasks.workunit.client.0.smithi044.stdout:7/145: sync 2024-04-25T22:03:18.509 INFO:tasks.workunit.client.0.smithi044.stdout:7/146: stat c17 0 2024-04-25T22:03:18.509 INFO:tasks.workunit.client.0.smithi044.stdout:9/295: truncate d4/f40 2075476 0 2024-04-25T22:03:18.509 INFO:tasks.workunit.client.0.smithi044.stdout:0/219: dwrite d8/f2b [0,4194304] 0 2024-04-25T22:03:18.509 INFO:tasks.workunit.client.0.smithi044.stdout:2/232: dwrite d7/d8/db/f39 [0,4194304] 0 2024-04-25T22:03:18.509 INFO:tasks.workunit.client.0.smithi044.stdout:7/147: creat d1c/d22/f23 x:0 0 0 2024-04-25T22:03:18.510 INFO:tasks.workunit.client.0.smithi044.stdout:2/233: mkdir d7/d8/db/d4c 0 2024-04-25T22:03:18.510 INFO:tasks.workunit.client.0.smithi044.stdout:3/233: write d0/d13/f37 [902023,70776] 0 2024-04-25T22:03:18.510 INFO:tasks.workunit.client.0.smithi044.stdout:0/220: mkdir d8/df/d17/d45/d4f 0 2024-04-25T22:03:18.510 INFO:tasks.workunit.client.0.smithi044.stdout:6/306: dwrite d2/d23/d5a/d13/f36 [0,4194304] 0 2024-04-25T22:03:18.510 INFO:tasks.workunit.client.0.smithi044.stdout:2/234: write d7/d16/d2c/f49 [940889,90819] 0 2024-04-25T22:03:18.510 INFO:tasks.workunit.client.0.smithi044.stdout:0/221: chown d8/df/d17/c46 325 1 2024-04-25T22:03:18.510 INFO:tasks.workunit.client.0.smithi044.stdout:6/307: rmdir d2/d23/d5a/d12 39 2024-04-25T22:03:18.510 INFO:tasks.workunit.client.0.smithi044.stdout:1/238: truncate d3/d7/f20 768339 0 2024-04-25T22:03:18.510 INFO:tasks.workunit.client.0.smithi044.stdout:3/234: write d0/d1/d15/df/d12/f49 [485594,57672] 0 2024-04-25T22:03:18.510 INFO:tasks.workunit.client.0.smithi044.stdout:7/148: read f0 [1761539,129494] 0 2024-04-25T22:03:18.510 INFO:tasks.workunit.client.0.smithi044.stdout:3/235: write d0/d1/d15/df/d12/dd/d11/f2c [1437022,113662] 0 2024-04-25T22:03:18.510 INFO:tasks.workunit.client.0.smithi044.stdout:5/150: write d2/d5/f1f [324643,8394] 0 2024-04-25T22:03:18.510 INFO:tasks.workunit.client.0.smithi044.stdout:7/149: chown c17 11194989 1 2024-04-25T22:03:18.510 INFO:tasks.workunit.client.0.smithi044.stdout:3/236: readlink d0/d1/l9 0 2024-04-25T22:03:18.511 INFO:tasks.workunit.client.0.smithi044.stdout:0/222: dwrite d8/d15/f30 [0,4194304] 0 2024-04-25T22:03:18.511 INFO:tasks.workunit.client.0.smithi044.stdout:1/239: dwrite d3/f34 [0,4194304] 0 2024-04-25T22:03:18.511 INFO:tasks.workunit.client.0.smithi044.stdout:4/150: dwrite dd/d35/f37 [0,4194304] 0 2024-04-25T22:03:18.511 INFO:tasks.workunit.client.0.smithi044.stdout:0/223: write f3 [4681349,130282] 0 2024-04-25T22:03:18.511 INFO:tasks.workunit.client.0.smithi044.stdout:1/240: write d3/f49 [440213,11698] 0 2024-04-25T22:03:18.511 INFO:tasks.workunit.client.0.smithi044.stdout:4/151: dread - dd/f36 zero size 2024-04-25T22:03:18.511 INFO:tasks.workunit.client.0.smithi044.stdout:0/224: chown d8/df/f29 1708969 1 2024-04-25T22:03:18.511 INFO:tasks.workunit.client.0.smithi044.stdout:1/241: read d3/d7/db/f1d [416430,84258] 0 2024-04-25T22:03:18.511 INFO:tasks.workunit.client.0.smithi044.stdout:9/296: truncate d4/d7/d18/d3a/f46 436764 0 2024-04-25T22:03:18.511 INFO:tasks.workunit.client.0.smithi044.stdout:8/304: fsync f25 0 2024-04-25T22:03:18.511 INFO:tasks.workunit.client.0.smithi044.stdout:3/237: rename d0/d1/d15/df/d12/dd/d35/l3a to d0/d1/d15/df/d12/dd/d11/d43/l50 0 2024-04-25T22:03:18.511 INFO:tasks.workunit.client.0.smithi044.stdout:4/152: creat dd/d19/f3d x:0 0 0 2024-04-25T22:03:18.511 INFO:tasks.workunit.client.0.smithi044.stdout:0/225: creat d8/df/d17/d45/f50 x:0 0 0 2024-04-25T22:03:18.511 INFO:tasks.workunit.client.0.smithi044.stdout:9/297: mkdir d4/d3d/d66 0 2024-04-25T22:03:18.511 INFO:tasks.workunit.client.0.smithi044.stdout:1/242: write d3/f26 [4628853,123347] 0 2024-04-25T22:03:18.512 INFO:tasks.workunit.client.0.smithi044.stdout:8/305: mkdir d2a/d39/d5a 0 2024-04-25T22:03:18.512 INFO:tasks.workunit.client.0.smithi044.stdout:4/153: creat dd/d35/f3e x:0 0 0 2024-04-25T22:03:18.512 INFO:tasks.workunit.client.0.smithi044.stdout:0/226: truncate d8/df/f29 771830 0 2024-04-25T22:03:18.512 INFO:tasks.workunit.client.0.smithi044.stdout:9/298: dread - d4/d7/f63 zero size 2024-04-25T22:03:18.512 INFO:tasks.workunit.client.0.smithi044.stdout:0/227: stat d8/da 0 2024-04-25T22:03:18.512 INFO:tasks.workunit.client.0.smithi044.stdout:4/154: unlink dd/d19/c23 0 2024-04-25T22:03:18.512 INFO:tasks.workunit.client.0.smithi044.stdout:0/228: mkdir d8/d15/d51 0 2024-04-25T22:03:18.512 INFO:tasks.workunit.client.0.smithi044.stdout:8/306: mknod d2a/d39/c5b 0 2024-04-25T22:03:18.512 INFO:tasks.workunit.client.0.smithi044.stdout:0/229: chown d8/da/c1a 145761 1 2024-04-25T22:03:18.512 INFO:tasks.workunit.client.0.smithi044.stdout:4/155: link dd/d19/l29 dd/l3f 0 2024-04-25T22:03:18.512 INFO:tasks.workunit.client.0.smithi044.stdout:0/230: link d8/da/c1a d8/df/d17/d45/d4f/c52 0 2024-04-25T22:03:18.512 INFO:tasks.workunit.client.0.smithi044.stdout:0/231: mknod d8/d15/c53 0 2024-04-25T22:03:18.512 INFO:tasks.workunit.client.0.smithi044.stdout:1/243: dread d3/d7/f2f [0,4194304] 0 2024-04-25T22:03:18.512 INFO:tasks.workunit.client.0.smithi044.stdout:1/244: read d3/f26 [3299301,57381] 0 2024-04-25T22:03:18.512 INFO:tasks.workunit.client.0.smithi044.stdout:8/307: dread f2 [0,4194304] 0 2024-04-25T22:03:18.513 INFO:tasks.workunit.client.0.smithi044.stdout:8/308: chown c1d 4107333 1 2024-04-25T22:03:18.513 INFO:tasks.workunit.client.0.smithi044.stdout:5/151: truncate d2/d5/f17 2323304 0 2024-04-25T22:03:18.513 INFO:tasks.workunit.client.0.smithi044.stdout:3/238: rename d0/d1/d15/df/d12 to d0/d1/d15/d51 0 2024-04-25T22:03:18.513 INFO:tasks.workunit.client.0.smithi044.stdout:8/309: link d2a/d4a/f4b d2a/d39/f5c 0 2024-04-25T22:03:18.513 INFO:tasks.workunit.client.0.smithi044.stdout:2/235: dread d7/f3f [0,4194304] 0 2024-04-25T22:03:18.513 INFO:tasks.workunit.client.0.smithi044.stdout:7/150: dread f0 [0,4194304] 0 2024-04-25T22:03:18.513 INFO:tasks.workunit.client.0.smithi044.stdout:9/299: rename d4/d7/l19 to d4/d37/l67 0 2024-04-25T22:03:18.513 INFO:tasks.workunit.client.0.smithi044.stdout:4/156: dwrite dd/f1b [0,4194304] 0 2024-04-25T22:03:18.513 INFO:tasks.workunit.client.0.smithi044.stdout:5/152: creat d2/d5/d27/d2a/f30 x:0 0 0 2024-04-25T22:03:18.513 INFO:tasks.workunit.client.0.smithi044.stdout:2/236: mknod d7/d16/d2c/c4d 0 2024-04-25T22:03:18.513 INFO:tasks.workunit.client.0.smithi044.stdout:5/153: fsync d2/f19 0 2024-04-25T22:03:18.513 INFO:tasks.workunit.client.0.smithi044.stdout:9/300: fsync d4/f1a 0 2024-04-25T22:03:18.513 INFO:tasks.workunit.client.0.smithi044.stdout:2/237: fsync d7/d8/db/f36 0 2024-04-25T22:03:18.513 INFO:tasks.workunit.client.0.smithi044.stdout:7/151: rename c17 to d1c/d22/c24 0 2024-04-25T22:03:18.514 INFO:tasks.workunit.client.0.smithi044.stdout:1/245: dread d3/d7/db/f3c [0,4194304] 0 2024-04-25T22:03:18.514 INFO:tasks.workunit.client.0.smithi044.stdout:4/157: truncate dd/f11 4434142 0 2024-04-25T22:03:18.514 INFO:tasks.workunit.client.0.smithi044.stdout:7/152: creat d1c/d22/f25 x:0 0 0 2024-04-25T22:03:18.514 INFO:tasks.workunit.client.0.smithi044.stdout:9/301: write d4/d7/d18/d2e/f5d [1817455,99856] 0 2024-04-25T22:03:18.514 INFO:tasks.workunit.client.0.smithi044.stdout:5/154: link d2/c2b d2/c31 0 2024-04-25T22:03:18.514 INFO:tasks.workunit.client.0.smithi044.stdout:1/246: mkdir d3/d4b 0 2024-04-25T22:03:18.514 INFO:tasks.workunit.client.0.smithi044.stdout:7/153: rename l10 to d1c/l26 0 2024-04-25T22:03:18.514 INFO:tasks.workunit.client.0.smithi044.stdout:9/302: chown d4/d7/c20 7160 1 2024-04-25T22:03:18.514 INFO:tasks.workunit.client.0.smithi044.stdout:7/154: fdatasync f9 0 2024-04-25T22:03:18.514 INFO:tasks.workunit.client.0.smithi044.stdout:5/155: dread - d2/d5/f2f zero size 2024-04-25T22:03:18.514 INFO:tasks.workunit.client.0.smithi044.stdout:1/247: symlink d3/d7/d29/l4c 0 2024-04-25T22:03:18.514 INFO:tasks.workunit.client.0.smithi044.stdout:1/248: stat d3/f49 0 2024-04-25T22:03:18.514 INFO:tasks.workunit.client.0.smithi044.stdout:0/232: sync 2024-04-25T22:03:18.514 INFO:tasks.workunit.client.0.smithi044.stdout:4/158: getdents dd/d19 0 2024-04-25T22:03:18.515 INFO:tasks.workunit.client.0.smithi044.stdout:3/239: dwrite d0/d1/d15/d23/f40 [0,4194304] 0 2024-04-25T22:03:18.515 INFO:tasks.workunit.client.0.smithi044.stdout:2/238: write d7/f1b [3375126,114843] 0 2024-04-25T22:03:18.515 INFO:tasks.workunit.client.0.smithi044.stdout:1/249: symlink d3/d7/d29/l4d 0 2024-04-25T22:03:18.515 INFO:tasks.workunit.client.0.smithi044.stdout:5/156: dread d2/f20 [0,4194304] 0 2024-04-25T22:03:18.515 INFO:tasks.workunit.client.0.smithi044.stdout:7/155: link c1b d1c/c27 0 2024-04-25T22:03:18.515 INFO:tasks.workunit.client.0.smithi044.stdout:1/250: mknod d3/d7/c4e 0 2024-04-25T22:03:18.515 INFO:tasks.workunit.client.0.smithi044.stdout:0/233: creat d8/df/f54 x:0 0 0 2024-04-25T22:03:18.515 INFO:tasks.workunit.client.0.smithi044.stdout:2/239: rename d7/d8/db to d7/d16/d2d/d4e 0 2024-04-25T22:03:18.515 INFO:tasks.workunit.client.0.smithi044.stdout:3/240: unlink d0/d13/d1c/l3c 0 2024-04-25T22:03:18.515 INFO:tasks.workunit.client.0.smithi044.stdout:4/159: getdents dd/d19 0 2024-04-25T22:03:18.515 INFO:tasks.workunit.client.0.smithi044.stdout:2/240: stat d7/f32 0 2024-04-25T22:03:18.515 INFO:tasks.workunit.client.0.smithi044.stdout:7/156: write f14 [537138,46633] 0 2024-04-25T22:03:18.515 INFO:tasks.workunit.client.0.smithi044.stdout:5/157: creat d2/d5/d21/f32 x:0 0 0 2024-04-25T22:03:18.515 INFO:tasks.workunit.client.0.smithi044.stdout:9/303: dwrite d4/d7/d18/d2d/f38 [0,4194304] 0 2024-04-25T22:03:18.515 INFO:tasks.workunit.client.0.smithi044.stdout:4/160: readlink l8 0 2024-04-25T22:03:18.515 INFO:tasks.workunit.client.0.smithi044.stdout:7/157: readlink le 0 2024-04-25T22:03:18.516 INFO:tasks.workunit.client.0.smithi044.stdout:1/251: read d3/d7/f8 [7915547,7431] 0 2024-04-25T22:03:18.516 INFO:tasks.workunit.client.0.smithi044.stdout:3/241: creat d0/d1/d15/d51/dd/d35/f52 x:0 0 0 2024-04-25T22:03:18.516 INFO:tasks.workunit.client.0.smithi044.stdout:7/158: fsync d1c/d22/f25 0 2024-04-25T22:03:18.516 INFO:tasks.workunit.client.0.smithi044.stdout:3/242: creat d0/d1/d15/d51/dd/d28/f53 x:0 0 0 2024-04-25T22:03:18.516 INFO:tasks.workunit.client.0.smithi044.stdout:4/161: unlink dd/d19/f21 0 2024-04-25T22:03:18.516 INFO:tasks.workunit.client.0.smithi044.stdout:6/308: dread d2/d23/d5a/d12/f19 [0,4194304] 0 2024-04-25T22:03:18.516 INFO:tasks.workunit.client.0.smithi044.stdout:0/234: getdents d8/d24 0 2024-04-25T22:03:18.516 INFO:tasks.workunit.client.0.smithi044.stdout:7/159: mkdir d1c/d22/d28 0 2024-04-25T22:03:18.516 INFO:tasks.workunit.client.0.smithi044.stdout:6/309: unlink d2/d23/l2e 0 2024-04-25T22:03:18.516 INFO:tasks.workunit.client.0.smithi044.stdout:0/235: write d8/d20/f31 [302120,55630] 0 2024-04-25T22:03:18.516 INFO:tasks.workunit.client.0.smithi044.stdout:4/162: link dd/d19/c2f dd/d19/c40 0 2024-04-25T22:03:18.516 INFO:tasks.workunit.client.0.smithi044.stdout:4/163: rmdir dd 39 2024-04-25T22:03:18.516 INFO:tasks.workunit.client.0.smithi044.stdout:1/252: dwrite d3/f4a [0,4194304] 0 2024-04-25T22:03:18.516 INFO:tasks.workunit.client.0.smithi044.stdout:2/241: dwrite d7/d16/f20 [0,4194304] 0 2024-04-25T22:03:18.517 INFO:tasks.workunit.client.0.smithi044.stdout:5/158: dwrite d2/d5/f16 [0,4194304] 0 2024-04-25T22:03:18.517 INFO:tasks.workunit.client.0.smithi044.stdout:6/310: link d2/d23/d5a/d12/d49/f5d d2/d23/d5a/d13/d68/f72 0 2024-04-25T22:03:18.517 INFO:tasks.workunit.client.0.smithi044.stdout:4/164: chown dd/d19/l26 14435224 1 2024-04-25T22:03:18.517 INFO:tasks.workunit.client.0.smithi044.stdout:9/304: dwrite d4/d7/d18/d3a/f5f [0,4194304] 0 2024-04-25T22:03:18.517 INFO:tasks.workunit.client.0.smithi044.stdout:5/159: readlink d2/d5/lc 0 2024-04-25T22:03:18.517 INFO:tasks.workunit.client.0.smithi044.stdout:2/242: unlink d7/d16/l13 0 2024-04-25T22:03:18.517 INFO:tasks.workunit.client.0.smithi044.stdout:7/160: dwrite d1c/f20 [0,4194304] 0 2024-04-25T22:03:18.517 INFO:tasks.workunit.client.0.smithi044.stdout:6/311: truncate d2/d23/d30/f3e 1636889 0 2024-04-25T22:03:18.517 INFO:tasks.workunit.client.0.smithi044.stdout:5/160: rename d2/l15 to d2/d5/l33 0 2024-04-25T22:03:18.517 INFO:tasks.workunit.client.0.smithi044.stdout:7/161: mknod d1c/c29 0 2024-04-25T22:03:18.517 INFO:tasks.workunit.client.0.smithi044.stdout:2/243: creat d7/d8/d48/f4f x:0 0 0 2024-04-25T22:03:18.517 INFO:tasks.workunit.client.0.smithi044.stdout:3/243: sync 2024-04-25T22:03:18.517 INFO:tasks.workunit.client.0.smithi044.stdout:7/162: write fa [3415920,121127] 0 2024-04-25T22:03:18.517 INFO:tasks.workunit.client.0.smithi044.stdout:2/244: chown d7/d16/d2d/d4e/c1d 4033 1 2024-04-25T22:03:18.517 INFO:tasks.workunit.client.0.smithi044.stdout:2/245: chown d7/d8/d1c/d26 1482262 1 2024-04-25T22:03:18.518 INFO:tasks.workunit.client.0.smithi044.stdout:8/310: dread f27 [0,4194304] 0 2024-04-25T22:03:18.518 INFO:tasks.workunit.client.0.smithi044.stdout:0/236: dwrite f3 [0,4194304] 0 2024-04-25T22:03:18.518 INFO:tasks.workunit.client.0.smithi044.stdout:7/163: mkdir d1c/d22/d2a 0 2024-04-25T22:03:18.518 INFO:tasks.workunit.client.0.smithi044.stdout:3/244: unlink d0/d1/d15/df/c18 0 2024-04-25T22:03:18.518 INFO:tasks.workunit.client.0.smithi044.stdout:2/246: mkdir d7/d16/d2c/d50 0 2024-04-25T22:03:18.518 INFO:tasks.workunit.client.0.smithi044.stdout:8/311: rename f4 to d2a/d32/f5d 0 2024-04-25T22:03:18.518 INFO:tasks.workunit.client.0.smithi044.stdout:3/245: write d0/d1/fe [7254593,20294] 0 2024-04-25T22:03:18.518 INFO:tasks.workunit.client.0.smithi044.stdout:7/164: creat d1c/f2b x:0 0 0 2024-04-25T22:03:18.518 INFO:tasks.workunit.client.0.smithi044.stdout:0/237: mkdir d8/da/d55 0 2024-04-25T22:03:18.518 INFO:tasks.workunit.client.0.smithi044.stdout:2/247: symlink d7/d16/d2d/l51 0 2024-04-25T22:03:18.518 INFO:tasks.workunit.client.0.smithi044.stdout:3/246: rmdir d0/d1/d15/df 39 2024-04-25T22:03:18.518 INFO:tasks.workunit.client.0.smithi044.stdout:7/165: creat d1c/f2c x:0 0 0 2024-04-25T22:03:18.518 INFO:tasks.workunit.client.0.smithi044.stdout:3/247: fdatasync d0/d1/d15/d51/dd/f4e 0 2024-04-25T22:03:18.518 INFO:tasks.workunit.client.0.smithi044.stdout:0/238: creat d8/df/d17/d45/d4f/f56 x:0 0 0 2024-04-25T22:03:18.519 INFO:tasks.workunit.client.0.smithi044.stdout:5/161: dwrite d2/d5/f18 [0,4194304] 0 2024-04-25T22:03:18.519 INFO:tasks.workunit.client.0.smithi044.stdout:3/248: read - d0/d1/d15/d51/dd/d35/f52 zero size 2024-04-25T22:03:18.519 INFO:tasks.workunit.client.0.smithi044.stdout:5/162: readlink d2/d5/lc 0 2024-04-25T22:03:18.519 INFO:tasks.workunit.client.0.smithi044.stdout:0/239: fsync d8/df/d17/f44 0 2024-04-25T22:03:18.519 INFO:tasks.workunit.client.0.smithi044.stdout:3/249: dread - d0/d1/d15/d51/dd/d28/f3f zero size 2024-04-25T22:03:18.519 INFO:tasks.workunit.client.0.smithi044.stdout:5/163: read d2/d5/f16 [1009593,33456] 0 2024-04-25T22:03:18.519 INFO:tasks.workunit.client.0.smithi044.stdout:3/250: fsync d0/d13/d1c/f30 0 2024-04-25T22:03:18.519 INFO:tasks.workunit.client.0.smithi044.stdout:5/164: truncate d2/d5/f9 3012622 0 2024-04-25T22:03:18.519 INFO:tasks.workunit.client.0.smithi044.stdout:5/165: rmdir d2 39 2024-04-25T22:03:18.519 INFO:tasks.workunit.client.0.smithi044.stdout:3/251: write d0/d1/d15/d51/dd/d28/f3e [777152,35819] 0 2024-04-25T22:03:18.519 INFO:tasks.workunit.client.0.smithi044.stdout:0/240: dread d8/df/f40 [0,4194304] 0 2024-04-25T22:03:18.519 INFO:tasks.workunit.client.0.smithi044.stdout:0/241: mkdir d8/d20/d57 0 2024-04-25T22:03:18.519 INFO:tasks.workunit.client.0.smithi044.stdout:3/252: symlink d0/d1/d15/df/l54 0 2024-04-25T22:03:18.519 INFO:tasks.workunit.client.0.smithi044.stdout:8/312: dwrite d2a/d32/f33 [0,4194304] 0 2024-04-25T22:03:18.519 INFO:tasks.workunit.client.0.smithi044.stdout:0/242: unlink d8/d20/f27 0 2024-04-25T22:03:18.520 INFO:tasks.workunit.client.0.smithi044.stdout:4/165: creat dd/f41 x:0 0 0 2024-04-25T22:03:18.520 INFO:tasks.workunit.client.0.smithi044.stdout:8/313: mkdir d2a/d32/d57/d5e 0 2024-04-25T22:03:18.520 INFO:tasks.workunit.client.0.smithi044.stdout:3/253: read d0/d1/fe [1869081,29869] 0 2024-04-25T22:03:18.520 INFO:tasks.workunit.client.0.smithi044.stdout:8/314: write d2a/d32/f41 [1031788,76957] 0 2024-04-25T22:03:18.520 INFO:tasks.workunit.client.0.smithi044.stdout:3/254: mknod d0/d1/d15/d51/d39/c55 0 2024-04-25T22:03:18.520 INFO:tasks.workunit.client.0.smithi044.stdout:3/255: readlink d0/d1/d15/df/l3b 0 2024-04-25T22:03:18.520 INFO:tasks.workunit.client.0.smithi044.stdout:3/256: mkdir d0/d1/d15/d51/d56 0 2024-04-25T22:03:18.520 INFO:tasks.workunit.client.0.smithi044.stdout:5/166: getdents d2/d5 0 2024-04-25T22:03:18.520 INFO:tasks.workunit.client.0.smithi044.stdout:4/166: dwrite dd/d19/f32 [4194304,4194304] 0 2024-04-25T22:03:18.520 INFO:tasks.workunit.client.0.smithi044.stdout:7/166: truncate d1c/f20 1916348 0 2024-04-25T22:03:18.520 INFO:tasks.workunit.client.0.smithi044.stdout:2/248: sync 2024-04-25T22:03:18.520 INFO:tasks.workunit.client.0.smithi044.stdout:3/257: sync 2024-04-25T22:03:18.520 INFO:tasks.workunit.client.0.smithi044.stdout:7/167: creat d1c/d22/d2a/f2d x:0 0 0 2024-04-25T22:03:18.520 INFO:tasks.workunit.client.0.smithi044.stdout:7/168: mknod d1c/d22/d28/c2e 0 2024-04-25T22:03:18.520 INFO:tasks.workunit.client.0.smithi044.stdout:6/312: dwrite d2/d23/d5a/d12/d49/f5d [0,4194304] 0 2024-04-25T22:03:18.521 INFO:tasks.workunit.client.0.smithi044.stdout:6/313: readlink d2/d23/l3f 0 2024-04-25T22:03:18.521 INFO:tasks.workunit.client.0.smithi044.stdout:4/167: dread dd/d19/f27 [0,4194304] 0 2024-04-25T22:03:18.521 INFO:tasks.workunit.client.0.smithi044.stdout:0/243: truncate d8/d15/f30 954039 0 2024-04-25T22:03:18.521 INFO:tasks.workunit.client.0.smithi044.stdout:7/169: creat d1c/f2f x:0 0 0 2024-04-25T22:03:18.521 INFO:tasks.workunit.client.0.smithi044.stdout:4/168: symlink dd/d19/d38/l42 0 2024-04-25T22:03:18.521 INFO:tasks.workunit.client.0.smithi044.stdout:2/249: write d7/d16/d2d/f3a [960388,24408] 0 2024-04-25T22:03:18.521 INFO:tasks.workunit.client.0.smithi044.stdout:7/170: mkdir d1c/d22/d28/d30 0 2024-04-25T22:03:18.521 INFO:tasks.workunit.client.0.smithi044.stdout:4/169: unlink dd/d19/l29 0 2024-04-25T22:03:18.521 INFO:tasks.workunit.client.0.smithi044.stdout:9/305: dread d4/d7/d18/f5a [0,4194304] 0 2024-04-25T22:03:18.521 INFO:tasks.workunit.client.0.smithi044.stdout:2/250: fdatasync d7/d8/d1c/f41 0 2024-04-25T22:03:18.521 INFO:tasks.workunit.client.0.smithi044.stdout:7/171: mknod d1c/d22/d2a/c31 0 2024-04-25T22:03:18.521 INFO:tasks.workunit.client.0.smithi044.stdout:4/170: chown dd/d19/l33 11213 1 2024-04-25T22:03:18.521 INFO:tasks.workunit.client.0.smithi044.stdout:8/315: dread fa [0,4194304] 0 2024-04-25T22:03:18.521 INFO:tasks.workunit.client.0.smithi044.stdout:9/306: creat d4/d3d/f68 x:0 0 0 2024-04-25T22:03:18.526 INFO:tasks.workunit.client.0.smithi044.stdout:5/167: dwrite d2/d5/f17 [0,4194304] 0 2024-04-25T22:03:18.526 INFO:tasks.workunit.client.0.smithi044.stdout:1/253: dread d3/d7/db/f15 [0,4194304] 0 2024-04-25T22:03:18.526 INFO:tasks.workunit.client.0.smithi044.stdout:4/171: fdatasync dd/d35/f3e 0 2024-04-25T22:03:18.526 INFO:tasks.workunit.client.0.smithi044.stdout:9/307: readlink d4/d7/l25 0 2024-04-25T22:03:18.526 INFO:tasks.workunit.client.0.smithi044.stdout:2/251: write d7/d16/d2d/d4e/f37 [292995,72058] 0 2024-04-25T22:03:18.526 INFO:tasks.workunit.client.0.smithi044.stdout:3/258: truncate d0/d1/d15/d51/dd/d11/f2c 913309 0 2024-04-25T22:03:18.526 INFO:tasks.workunit.client.0.smithi044.stdout:7/172: mkdir d1c/d22/d28/d30/d32 0 2024-04-25T22:03:18.526 INFO:tasks.workunit.client.0.smithi044.stdout:8/316: link d2a/f31 d2a/d4a/f5f 0 2024-04-25T22:03:18.526 INFO:tasks.workunit.client.0.smithi044.stdout:3/259: mknod d0/d13/c57 0 2024-04-25T22:03:18.526 INFO:tasks.workunit.client.0.smithi044.stdout:3/260: sync 2024-04-25T22:03:18.526 INFO:tasks.workunit.client.0.smithi044.stdout:4/172: creat dd/d19/d38/f43 x:0 0 0 2024-04-25T22:03:18.526 INFO:tasks.workunit.client.0.smithi044.stdout:0/244: dwrite d8/df/f29 [0,4194304] 0 2024-04-25T22:03:18.526 INFO:tasks.workunit.client.0.smithi044.stdout:7/173: fdatasync d1c/d22/d2a/f2d 0 2024-04-25T22:03:18.527 INFO:tasks.workunit.client.0.smithi044.stdout:1/254: rename d3/d7/d29/l47 to d3/d7/db/l4f 0 2024-04-25T22:03:18.527 INFO:tasks.workunit.client.0.smithi044.stdout:5/168: creat d2/d5/d21/d26/d2c/f34 x:0 0 0 2024-04-25T22:03:18.527 INFO:tasks.workunit.client.0.smithi044.stdout:8/317: write f2 [3696102,14506] 0 2024-04-25T22:03:18.527 INFO:tasks.workunit.client.0.smithi044.stdout:4/173: stat dd/d19/f1d 0 2024-04-25T22:03:18.527 INFO:tasks.workunit.client.0.smithi044.stdout:2/252: truncate d7/d16/d2c/f42 21394 0 2024-04-25T22:03:18.527 INFO:tasks.workunit.client.0.smithi044.stdout:3/261: creat d0/d1/d34/f58 x:0 0 0 2024-04-25T22:03:18.527 INFO:tasks.workunit.client.0.smithi044.stdout:1/255: readlink d3/l1f 0 2024-04-25T22:03:18.527 INFO:tasks.workunit.client.0.smithi044.stdout:5/169: mkdir d2/d35 0 2024-04-25T22:03:18.527 INFO:tasks.workunit.client.0.smithi044.stdout:6/314: write d2/d23/d30/f3e [1075181,119875] 0 2024-04-25T22:03:18.527 INFO:tasks.workunit.client.0.smithi044.stdout:5/170: read d2/f20 [1603122,57988] 0 2024-04-25T22:03:18.527 INFO:tasks.workunit.client.0.smithi044.stdout:0/245: truncate d8/d20/f31 1194755 0 2024-04-25T22:03:18.527 INFO:tasks.workunit.client.0.smithi044.stdout:5/171: write d2/d5/f1f [912335,127884] 0 2024-04-25T22:03:18.527 INFO:tasks.workunit.client.0.smithi044.stdout:7/174: rename d1c/d22/d2a to d1c/d22/d28/d30/d32/d33 0 2024-04-25T22:03:18.527 INFO:tasks.workunit.client.0.smithi044.stdout:8/318: mknod d2a/d32/c60 0 2024-04-25T22:03:18.527 INFO:tasks.workunit.client.0.smithi044.stdout:8/319: readlink l14 0 2024-04-25T22:03:18.528 INFO:tasks.workunit.client.0.smithi044.stdout:8/320: sync 2024-04-25T22:03:18.528 INFO:tasks.workunit.client.0.smithi044.stdout:2/253: write d7/f15 [2229687,26416] 0 2024-04-25T22:03:18.528 INFO:tasks.workunit.client.0.smithi044.stdout:0/246: rename d8/d15/l3e to d8/d20/l58 0 2024-04-25T22:03:18.528 INFO:tasks.workunit.client.0.smithi044.stdout:5/172: dread - d2/d5/d21/f2d zero size 2024-04-25T22:03:18.528 INFO:tasks.workunit.client.0.smithi044.stdout:9/308: dread d4/d7/d18/d2d/f38 [0,4194304] 0 2024-04-25T22:03:18.528 INFO:tasks.workunit.client.0.smithi044.stdout:7/175: chown d1c/d22/d28/d30/d32/d33 6853 1 2024-04-25T22:03:18.528 INFO:tasks.workunit.client.0.smithi044.stdout:7/176: creat d1c/d22/f34 x:0 0 0 2024-04-25T22:03:18.528 INFO:tasks.workunit.client.0.smithi044.stdout:2/254: mknod d7/d16/d4b/c52 0 2024-04-25T22:03:18.528 INFO:tasks.workunit.client.0.smithi044.stdout:5/173: unlink d2/c31 0 2024-04-25T22:03:18.528 INFO:tasks.workunit.client.0.smithi044.stdout:9/309: write d4/d7/f39 [7088398,125130] 0 2024-04-25T22:03:18.528 INFO:tasks.workunit.client.0.smithi044.stdout:0/247: truncate d8/d15/f2e 518266 0 2024-04-25T22:03:18.528 INFO:tasks.workunit.client.0.smithi044.stdout:4/174: dwrite dd/d35/f37 [0,4194304] 0 2024-04-25T22:03:18.528 INFO:tasks.workunit.client.0.smithi044.stdout:7/177: readlink d1c/l1d 0 2024-04-25T22:03:18.528 INFO:tasks.workunit.client.0.smithi044.stdout:0/248: read d8/f2b [3964197,38828] 0 2024-04-25T22:03:18.529 INFO:tasks.workunit.client.0.smithi044.stdout:9/310: mknod d4/d3d/d58/c69 0 2024-04-25T22:03:18.529 INFO:tasks.workunit.client.0.smithi044.stdout:1/256: dwrite d3/d30/f31 [0,4194304] 0 2024-04-25T22:03:18.529 INFO:tasks.workunit.client.0.smithi044.stdout:3/262: dwrite d0/d1/d34/f58 [0,4194304] 0 2024-04-25T22:03:18.529 INFO:tasks.workunit.client.0.smithi044.stdout:4/175: stat dd 0 2024-04-25T22:03:18.529 INFO:tasks.workunit.client.0.smithi044.stdout:8/321: dwrite f17 [0,4194304] 0 2024-04-25T22:03:18.530 INFO:tasks.workunit.client.0.smithi044.stdout:3/263: write d0/f38 [3316583,91544] 0 2024-04-25T22:03:18.532 INFO:tasks.workunit.client.0.smithi044.stdout:5/174: dwrite d2/f4 [0,4194304] 0 2024-04-25T22:03:18.533 INFO:tasks.workunit.client.0.smithi044.stdout:2/255: truncate d7/f11 3658629 0 2024-04-25T22:03:18.533 INFO:tasks.workunit.client.0.smithi044.stdout:9/311: rename d4/d3d/c43 to d4/d5e/c6a 0 2024-04-25T22:03:18.533 INFO:tasks.workunit.client.0.smithi044.stdout:2/256: chown d7/d8/d48/f4f 1 1 2024-04-25T22:03:18.533 INFO:tasks.workunit.client.0.smithi044.stdout:7/178: dwrite d1c/f2b [0,4194304] 0 2024-04-25T22:03:18.534 INFO:tasks.workunit.client.0.smithi044.stdout:8/322: creat d2a/d32/f61 x:0 0 0 2024-04-25T22:03:18.534 INFO:tasks.workunit.client.0.smithi044.stdout:7/179: read d1c/f20 [1910417,119858] 0 2024-04-25T22:03:18.534 INFO:tasks.workunit.client.0.smithi044.stdout:2/257: chown d7/d16/d2c/c4a 15651018 1 2024-04-25T22:03:18.535 INFO:tasks.workunit.client.0.smithi044.stdout:0/249: creat d8/da/f59 x:0 0 0 2024-04-25T22:03:18.535 INFO:tasks.workunit.client.0.smithi044.stdout:4/176: unlink dd/d19/f2d 0 2024-04-25T22:03:18.535 INFO:tasks.workunit.client.0.smithi044.stdout:5/175: rename d2/d5/d21/f32 to d2/d5/d27/f36 0 2024-04-25T22:03:18.536 INFO:tasks.workunit.client.0.smithi044.stdout:3/264: getdents d0/d1/d15/d51/dd/d4a 0 2024-04-25T22:03:18.536 INFO:tasks.workunit.client.0.smithi044.stdout:1/257: dread d3/d7/f40 [0,4194304] 0 2024-04-25T22:03:18.536 INFO:tasks.workunit.client.0.smithi044.stdout:1/258: readlink d3/d7/l18 0 2024-04-25T22:03:18.537 INFO:tasks.workunit.client.0.smithi044.stdout:0/250: creat d8/d20/f5a x:0 0 0 2024-04-25T22:03:18.537 INFO:tasks.workunit.client.0.smithi044.stdout:3/265: chown d0/d1/d15/d51/dd/d11/d43/l47 296129358 1 2024-04-25T22:03:18.537 INFO:tasks.workunit.client.0.smithi044.stdout:4/177: write dd/f11 [2315314,91830] 0 2024-04-25T22:03:18.537 INFO:tasks.workunit.client.0.smithi044.stdout:4/178: sync 2024-04-25T22:03:18.537 INFO:tasks.workunit.client.0.smithi044.stdout:0/251: fdatasync d8/d15/f39 0 2024-04-25T22:03:18.538 INFO:tasks.workunit.client.0.smithi044.stdout:7/180: link f14 d1c/d22/d28/f35 0 2024-04-25T22:03:18.538 INFO:tasks.workunit.client.0.smithi044.stdout:5/176: write d2/d5/f17 [2698992,51662] 0 2024-04-25T22:03:18.538 INFO:tasks.workunit.client.0.smithi044.stdout:1/259: mkdir d3/d7/d29/d50 0 2024-04-25T22:03:18.538 INFO:tasks.workunit.client.0.smithi044.stdout:3/266: write d0/d1/d15/d51/dd/d28/f3e [24970,30026] 0 2024-04-25T22:03:18.539 INFO:tasks.workunit.client.0.smithi044.stdout:5/177: fdatasync d2/d5/f1f 0 2024-04-25T22:03:18.539 INFO:tasks.workunit.client.0.smithi044.stdout:4/179: fsync dd/f36 0 2024-04-25T22:03:18.539 INFO:tasks.workunit.client.0.smithi044.stdout:1/260: dread - d3/d30/f3e zero size 2024-04-25T22:03:18.540 INFO:tasks.workunit.client.0.smithi044.stdout:5/178: chown d2/d5/d21/d26/d2c 284138403 1 2024-04-25T22:03:18.540 INFO:tasks.workunit.client.0.smithi044.stdout:4/180: dread - dd/d19/f1d zero size 2024-04-25T22:03:18.540 INFO:tasks.workunit.client.0.smithi044.stdout:7/181: creat d1c/d22/d28/d30/f36 x:0 0 0 2024-04-25T22:03:18.540 INFO:tasks.workunit.client.0.smithi044.stdout:0/252: rmdir d8/d20/d57 0 2024-04-25T22:03:18.542 INFO:tasks.workunit.client.0.smithi044.stdout:7/182: symlink d1c/l37 0 2024-04-25T22:03:18.542 INFO:tasks.workunit.client.0.smithi044.stdout:4/181: write dd/d19/f27 [4416994,88055] 0 2024-04-25T22:03:18.542 INFO:tasks.workunit.client.0.smithi044.stdout:5/179: mkdir d2/d5/d21/d26/d2c/d37 0 2024-04-25T22:03:18.543 INFO:tasks.workunit.client.0.smithi044.stdout:8/323: dwrite f22 [0,4194304] 0 2024-04-25T22:03:18.543 INFO:tasks.workunit.client.0.smithi044.stdout:0/253: stat d8/da/f49 0 2024-04-25T22:03:18.543 INFO:tasks.workunit.client.0.smithi044.stdout:8/324: sync 2024-04-25T22:03:18.543 INFO:tasks.workunit.client.0.smithi044.stdout:7/183: creat d1c/f38 x:0 0 0 2024-04-25T22:03:18.545 INFO:tasks.workunit.client.0.smithi044.stdout:5/180: chown d2/d5/f18 30 1 2024-04-25T22:03:18.545 INFO:tasks.workunit.client.0.smithi044.stdout:8/325: chown d2a/d39/c3f 24888616 1 2024-04-25T22:03:18.545 INFO:tasks.workunit.client.0.smithi044.stdout:4/182: rename dd/l13 to dd/d35/l44 0 2024-04-25T22:03:18.545 INFO:tasks.workunit.client.0.smithi044.stdout:5/181: dread - d2/d5/f2f zero size 2024-04-25T22:03:18.546 INFO:tasks.workunit.client.0.smithi044.stdout:5/182: mkdir d2/d5/d21/d38 0 2024-04-25T22:03:18.546 INFO:tasks.workunit.client.0.smithi044.stdout:8/326: creat d2a/f62 x:0 0 0 2024-04-25T22:03:18.546 INFO:tasks.workunit.client.0.smithi044.stdout:6/315: dwrite d2/d23/d5a/d11/f39 [0,4194304] 0 2024-04-25T22:03:18.547 INFO:tasks.workunit.client.0.smithi044.stdout:8/327: write d2a/d32/f61 [588422,90796] 0 2024-04-25T22:03:18.547 INFO:tasks.workunit.client.0.smithi044.stdout:8/328: write fd [4397838,59129] 0 2024-04-25T22:03:18.548 INFO:tasks.workunit.client.0.smithi044.stdout:6/316: rmdir d2/d23/d5a/d12/d1f/d52 0 2024-04-25T22:03:18.548 INFO:tasks.workunit.client.0.smithi044.stdout:8/329: chown d2a/d32/f34 858 1 2024-04-25T22:03:18.549 INFO:tasks.workunit.client.0.smithi044.stdout:3/267: fdatasync d0/f38 0 2024-04-25T22:03:18.550 INFO:tasks.workunit.client.0.smithi044.stdout:6/317: symlink d2/d23/d5a/d11/d3b/l73 0 2024-04-25T22:03:18.550 INFO:tasks.workunit.client.0.smithi044.stdout:8/330: symlink d2a/d32/d57/l63 0 2024-04-25T22:03:18.551 INFO:tasks.workunit.client.0.smithi044.stdout:0/254: dwrite d8/d20/f31 [0,4194304] 0 2024-04-25T22:03:18.553 INFO:tasks.workunit.client.0.smithi044.stdout:6/318: readlink d2/l29 0 2024-04-25T22:03:18.553 INFO:tasks.workunit.client.0.smithi044.stdout:3/268: write d0/d1/d15/d51/f29 [4853299,15505] 0 2024-04-25T22:03:18.553 INFO:tasks.workunit.client.0.smithi044.stdout:8/331: creat d2a/d4a/f64 x:0 0 0 2024-04-25T22:03:18.553 INFO:tasks.workunit.client.0.smithi044.stdout:6/319: write d2/f3a [514015,101288] 0 2024-04-25T22:03:18.554 INFO:tasks.workunit.client.0.smithi044.stdout:8/332: write f24 [4133500,46558] 0 2024-04-25T22:03:18.554 INFO:tasks.workunit.client.0.smithi044.stdout:6/320: stat d2/d23/d5a/d13/d68/l59 0 2024-04-25T22:03:18.554 INFO:tasks.workunit.client.0.smithi044.stdout:5/183: dwrite d2/d5/f16 [0,4194304] 0 2024-04-25T22:03:18.556 INFO:tasks.workunit.client.0.smithi044.stdout:8/333: symlink d2a/l65 0 2024-04-25T22:03:18.556 INFO:tasks.workunit.client.0.smithi044.stdout:0/255: link d8/df/d17/d45/d4f/c52 d8/df/d17/d45/d4f/c5b 0 2024-04-25T22:03:18.556 INFO:tasks.workunit.client.0.smithi044.stdout:0/256: chown d8/d20 10680533 1 2024-04-25T22:03:18.556 INFO:tasks.workunit.client.0.smithi044.stdout:8/334: read - d2a/d4a/f64 zero size 2024-04-25T22:03:18.556 INFO:tasks.workunit.client.0.smithi044.stdout:5/184: dread - d2/d5/d27/f36 zero size 2024-04-25T22:03:18.556 INFO:tasks.workunit.client.0.smithi044.stdout:8/335: write f22 [2934222,92609] 0 2024-04-25T22:03:18.556 INFO:tasks.workunit.client.0.smithi044.stdout:5/185: creat d2/d5/f39 x:0 0 0 2024-04-25T22:03:18.556 INFO:tasks.workunit.client.0.smithi044.stdout:8/336: readlink d2a/l65 0 2024-04-25T22:03:18.558 INFO:tasks.workunit.client.0.smithi044.stdout:0/257: creat d8/da/d55/f5c x:0 0 0 2024-04-25T22:03:18.560 INFO:tasks.workunit.client.0.smithi044.stdout:8/337: getdents d2a/d32/d3e 0 2024-04-25T22:03:18.560 INFO:tasks.workunit.client.0.smithi044.stdout:5/186: write d2/d5/d21/d26/d2c/f34 [216367,93799] 0 2024-04-25T22:03:18.560 INFO:tasks.workunit.client.0.smithi044.stdout:0/258: fdatasync d8/d24/f28 0 2024-04-25T22:03:18.561 INFO:tasks.workunit.client.0.smithi044.stdout:5/187: stat d2/d5 0 2024-04-25T22:03:18.561 INFO:tasks.workunit.client.0.smithi044.stdout:8/338: chown d2a/d4a/f64 377 1 2024-04-25T22:03:18.562 INFO:tasks.workunit.client.0.smithi044.stdout:5/188: mkdir d2/d5/d27/d2a/d3a 0 2024-04-25T22:03:18.562 INFO:tasks.workunit.client.0.smithi044.stdout:3/269: dwrite d0/d1/d15/d51/dd/d28/f53 [0,4194304] 0 2024-04-25T22:03:18.563 INFO:tasks.workunit.client.0.smithi044.stdout:0/259: link d8/f4d d8/df/f5d 0 2024-04-25T22:03:18.563 INFO:tasks.workunit.client.0.smithi044.stdout:8/339: mkdir d2a/d39/d5a/d66 0 2024-04-25T22:03:18.563 INFO:tasks.workunit.client.0.smithi044.stdout:5/189: mknod d2/d5/d27/d2a/c3b 0 2024-04-25T22:03:18.564 INFO:tasks.workunit.client.0.smithi044.stdout:3/270: rmdir d0/d1/d15/d51/d56 0 2024-04-25T22:03:18.564 INFO:tasks.workunit.client.0.smithi044.stdout:8/340: symlink d2a/d32/l67 0 2024-04-25T22:03:18.564 INFO:tasks.workunit.client.0.smithi044.stdout:0/260: write d8/da/d55/f5c [1030749,35009] 0 2024-04-25T22:03:18.564 INFO:tasks.workunit.client.0.smithi044.stdout:5/190: write d2/d5/f39 [39006,117776] 0 2024-04-25T22:03:18.565 INFO:tasks.workunit.client.0.smithi044.stdout:5/191: stat d2 0 2024-04-25T22:03:18.565 INFO:tasks.workunit.client.0.smithi044.stdout:8/341: mkdir d2a/d39/d42/d68 0 2024-04-25T22:03:18.566 INFO:tasks.workunit.client.0.smithi044.stdout:5/192: creat d2/f3c x:0 0 0 2024-04-25T22:03:18.566 INFO:tasks.workunit.client.0.smithi044.stdout:8/342: mknod d2a/c69 0 2024-04-25T22:03:18.567 INFO:tasks.workunit.client.0.smithi044.stdout:8/343: creat d2a/d32/d3e/f6a x:0 0 0 2024-04-25T22:03:18.569 INFO:tasks.workunit.client.0.smithi044.stdout:3/271: dread d0/d1/d15/d51/dd/d35/d36/f45 [0,4194304] 0 2024-04-25T22:03:18.570 INFO:tasks.workunit.client.0.smithi044.stdout:3/272: truncate d0/d1/d15/d51/dd/f4e 224467 0 2024-04-25T22:03:18.571 INFO:tasks.workunit.client.0.smithi044.stdout:0/261: dwrite d8/df/d17/d45/f50 [0,4194304] 0 2024-04-25T22:03:18.572 INFO:tasks.workunit.client.0.smithi044.stdout:5/193: dread d2/d5/f18 [0,4194304] 0 2024-04-25T22:03:18.572 INFO:tasks.workunit.client.0.smithi044.stdout:3/273: mknod d0/d1/d15/d51/dd/d11/d42/c59 0 2024-04-25T22:03:18.573 INFO:tasks.workunit.client.0.smithi044.stdout:5/194: write d2/d5/f1f [2023105,104876] 0 2024-04-25T22:03:18.573 INFO:tasks.workunit.client.0.smithi044.stdout:3/274: write d0/d1/d15/d23/f40 [3740124,53237] 0 2024-04-25T22:03:18.575 INFO:tasks.workunit.client.0.smithi044.stdout:7/184: truncate f14 298277 0 2024-04-25T22:03:18.575 INFO:tasks.workunit.client.0.smithi044.stdout:9/312: truncate d4/d7/d18/d2e/f3f 1185177 0 2024-04-25T22:03:18.576 INFO:tasks.workunit.client.0.smithi044.stdout:8/344: rename d2a/d4a to d2a/d39/d42/d68/d6b 0 2024-04-25T22:03:18.577 INFO:tasks.workunit.client.0.smithi044.stdout:6/321: write d2/d23/f28 [1350159,92606] 0 2024-04-25T22:03:18.577 INFO:tasks.workunit.client.0.smithi044.stdout:6/322: sync 2024-04-25T22:03:18.578 INFO:tasks.workunit.client.0.smithi044.stdout:9/313: write d4/d37/f45 [1222762,4567] 0 2024-04-25T22:03:18.578 INFO:tasks.workunit.client.0.smithi044.stdout:4/183: write dd/f34 [4536919,29866] 0 2024-04-25T22:03:18.579 INFO:tasks.workunit.client.0.smithi044.stdout:8/345: rename c1b to d2a/d32/d57/c6c 0 2024-04-25T22:03:18.579 INFO:tasks.workunit.client.0.smithi044.stdout:3/275: dread d0/d1/d15/d51/dd/d28/f53 [0,4194304] 0 2024-04-25T22:03:18.579 INFO:tasks.workunit.client.0.smithi044.stdout:9/314: readlink d4/d7/l14 0 2024-04-25T22:03:18.580 INFO:tasks.workunit.client.0.smithi044.stdout:9/315: symlink d4/d37/l6b 0 2024-04-25T22:03:18.580 INFO:tasks.workunit.client.0.smithi044.stdout:4/184: symlink dd/d19/d38/l45 0 2024-04-25T22:03:18.580 INFO:tasks.workunit.client.0.smithi044.stdout:8/346: truncate f25 149955 0 2024-04-25T22:03:18.581 INFO:tasks.workunit.client.0.smithi044.stdout:5/195: dwrite d2/f4 [4194304,4194304] 0 2024-04-25T22:03:18.582 INFO:tasks.workunit.client.0.smithi044.stdout:9/316: creat d4/d7/d18/d3a/f6c x:0 0 0 2024-04-25T22:03:18.582 INFO:tasks.workunit.client.0.smithi044.stdout:5/196: mknod d2/c3d 0 2024-04-25T22:03:18.583 INFO:tasks.workunit.client.0.smithi044.stdout:4/185: link dd/d19/f3d dd/f46 0 2024-04-25T22:03:18.583 INFO:tasks.workunit.client.0.smithi044.stdout:9/317: write d4/d3d/f68 [19347,66346] 0 2024-04-25T22:03:18.584 INFO:tasks.workunit.client.0.smithi044.stdout:8/347: rename d2a/d32/l38 to d2a/d39/d42/d68/d6b/l6d 0 2024-04-25T22:03:18.584 INFO:tasks.workunit.client.0.smithi044.stdout:3/276: read d0/d13/d1c/f2b [3429790,94163] 0 2024-04-25T22:03:18.584 INFO:tasks.workunit.client.0.smithi044.stdout:0/262: write f1 [1482983,118959] 0 2024-04-25T22:03:18.584 INFO:tasks.workunit.client.0.smithi044.stdout:4/186: dread - dd/d19/f1d zero size 2024-04-25T22:03:18.585 INFO:tasks.workunit.client.0.smithi044.stdout:9/318: mknod d4/d37/c6d 0 2024-04-25T22:03:18.586 INFO:tasks.workunit.client.0.smithi044.stdout:8/348: mkdir d2a/d39/d42/d68/d6b/d6e 0 2024-04-25T22:03:18.587 INFO:tasks.workunit.client.0.smithi044.stdout:3/277: write d0/d1/d15/d51/dd/d35/f52 [537876,49975] 0 2024-04-25T22:03:18.587 INFO:tasks.workunit.client.0.smithi044.stdout:6/323: dwrite d2/fd [0,4194304] 0 2024-04-25T22:03:18.587 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:18.584+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:18.588 INFO:tasks.workunit.client.0.smithi044.stdout:8/349: mknod d2a/d32/d57/d5e/c6f 0 2024-04-25T22:03:18.589 INFO:tasks.workunit.client.0.smithi044.stdout:6/324: truncate d2/d23/d5a/f62 915641 0 2024-04-25T22:03:18.590 INFO:tasks.workunit.client.0.smithi044.stdout:0/263: dread f3 [0,4194304] 0 2024-04-25T22:03:18.590 INFO:tasks.workunit.client.0.smithi044.stdout:8/350: link d2a/d32/f48 d2a/d39/f70 0 2024-04-25T22:03:18.591 INFO:tasks.workunit.client.0.smithi044.stdout:8/351: write fd [3473106,45502] 0 2024-04-25T22:03:18.592 INFO:tasks.workunit.client.0.smithi044.stdout:5/197: dread d2/d5/f17 [0,4194304] 0 2024-04-25T22:03:18.592 INFO:tasks.workunit.client.0.smithi044.stdout:5/198: fdatasync d2/f19 0 2024-04-25T22:03:18.594 INFO:tasks.workunit.client.0.smithi044.stdout:0/264: rename d8/d15/l36 to d8/d24/l5e 0 2024-04-25T22:03:18.594 INFO:tasks.workunit.client.0.smithi044.stdout:9/319: dwrite d4/d7/d18/d3a/f6c [0,4194304] 0 2024-04-25T22:03:18.594 INFO:tasks.workunit.client.0.smithi044.stdout:5/199: mknod d2/d5/d27/d2a/d3a/c3e 0 2024-04-25T22:03:18.594 INFO:tasks.workunit.client.0.smithi044.stdout:0/265: fsync d8/df/f29 0 2024-04-25T22:03:18.595 INFO:tasks.workunit.client.0.smithi044.stdout:5/200: creat d2/d35/f3f x:0 0 0 2024-04-25T22:03:18.595 INFO:tasks.workunit.client.0.smithi044.stdout:9/320: write d4/d7/d18/d2e/f5d [4206109,74952] 0 2024-04-25T22:03:18.595 INFO:tasks.workunit.client.0.smithi044.stdout:0/266: mknod d8/d20/c5f 0 2024-04-25T22:03:18.596 INFO:tasks.workunit.client.0.smithi044.stdout:9/321: write d4/d3d/f68 [931220,33255] 0 2024-04-25T22:03:18.596 INFO:tasks.workunit.client.0.smithi044.stdout:0/267: mkdir d8/da/d60 0 2024-04-25T22:03:18.598 INFO:tasks.workunit.client.0.smithi044.stdout:0/268: unlink d8/da/f49 0 2024-04-25T22:03:18.598 INFO:tasks.workunit.client.0.smithi044.stdout:9/322: chown d4/d7/d18/d2d/f51 1897 1 2024-04-25T22:03:18.598 INFO:tasks.workunit.client.0.smithi044.stdout:8/352: dwrite f6 [0,4194304] 0 2024-04-25T22:03:18.599 INFO:tasks.workunit.client.0.smithi044.stdout:8/353: fdatasync d2a/d39/f70 0 2024-04-25T22:03:18.599 INFO:tasks.workunit.client.0.smithi044.stdout:0/269: rename d8/d20/f4c to d8/da/f61 0 2024-04-25T22:03:18.600 INFO:tasks.workunit.client.0.smithi044.stdout:9/323: write d4/d7/f4d [48853,104807] 0 2024-04-25T22:03:18.600 INFO:tasks.workunit.client.0.smithi044.stdout:8/354: fdatasync d2a/d32/f48 0 2024-04-25T22:03:18.600 INFO:tasks.workunit.client.0.smithi044.stdout:0/270: creat d8/da/d55/f62 x:0 0 0 2024-04-25T22:03:18.601 INFO:tasks.workunit.client.0.smithi044.stdout:8/355: mknod d2a/d39/d5a/c71 0 2024-04-25T22:03:18.602 INFO:tasks.workunit.client.0.smithi044.stdout:1/261: dread d3/d7/f3d [0,4194304] 0 2024-04-25T22:03:18.602 INFO:tasks.workunit.client.0.smithi044.stdout:9/324: link d4/d4b/c4e d4/d5e/d64/c6e 0 2024-04-25T22:03:18.603 INFO:tasks.workunit.client.0.smithi044.stdout:8/356: creat d2a/d52/f72 x:0 0 0 2024-04-25T22:03:18.605 INFO:tasks.workunit.client.0.smithi044.stdout:8/357: readlink d2a/l65 0 2024-04-25T22:03:18.605 INFO:tasks.workunit.client.0.smithi044.stdout:9/325: chown d4/d7/d18/d2e/c4a 246880 1 2024-04-25T22:03:18.605 INFO:tasks.workunit.client.0.smithi044.stdout:1/262: link d3/d7/l28 d3/l51 0 2024-04-25T22:03:18.606 INFO:tasks.workunit.client.0.smithi044.stdout:8/358: mknod d2a/d39/d5a/d66/c73 0 2024-04-25T22:03:18.606 INFO:tasks.workunit.client.0.smithi044.stdout:1/263: creat d3/d7/d29/d43/f52 x:0 0 0 2024-04-25T22:03:18.607 INFO:tasks.workunit.client.0.smithi044.stdout:0/271: dwrite f0 [0,4194304] 0 2024-04-25T22:03:18.608 INFO:tasks.workunit.client.0.smithi044.stdout:0/272: fsync f3 0 2024-04-25T22:03:18.611 INFO:tasks.workunit.client.0.smithi044.stdout:9/326: dwrite d4/d7/d18/d2d/f51 [0,4194304] 0 2024-04-25T22:03:18.614 INFO:tasks.workunit.client.0.smithi044.stdout:1/264: dwrite d3/d7/db/f3c [0,4194304] 0 2024-04-25T22:03:18.616 INFO:tasks.workunit.client.0.smithi044.stdout:1/265: mkdir d3/d53 0 2024-04-25T22:03:18.617 INFO:tasks.workunit.client.0.smithi044.stdout:0/273: dwrite d8/f3b [0,4194304] 0 2024-04-25T22:03:18.617 INFO:tasks.workunit.client.0.smithi044.stdout:1/266: mkdir d3/d54 0 2024-04-25T22:03:18.618 INFO:tasks.workunit.client.0.smithi044.stdout:4/187: dread dd/ff [0,4194304] 0 2024-04-25T22:03:18.619 INFO:tasks.workunit.client.0.smithi044.stdout:4/188: creat dd/d35/f47 x:0 0 0 2024-04-25T22:03:18.621 INFO:tasks.workunit.client.0.smithi044.stdout:4/189: dread - dd/f41 zero size 2024-04-25T22:03:18.622 INFO:tasks.workunit.client.0.smithi044.stdout:4/190: creat dd/f48 x:0 0 0 2024-04-25T22:03:18.623 INFO:tasks.workunit.client.0.smithi044.stdout:4/191: creat dd/d19/f49 x:0 0 0 2024-04-25T22:03:18.624 INFO:tasks.workunit.client.0.smithi044.stdout:0/274: dwrite d8/d15/f39 [0,4194304] 0 2024-04-25T22:03:18.624 INFO:tasks.workunit.client.0.smithi044.stdout:4/192: rmdir dd/d19/d38 39 2024-04-25T22:03:18.624 INFO:tasks.workunit.client.0.smithi044.stdout:1/267: dwrite d3/d30/f31 [0,4194304] 0 2024-04-25T22:03:18.626 INFO:tasks.workunit.client.0.smithi044.stdout:4/193: write dd/d19/f2b [372320,84942] 0 2024-04-25T22:03:18.626 INFO:tasks.workunit.client.0.smithi044.stdout:2/258: truncate d7/f11 197039 0 2024-04-25T22:03:18.626 INFO:tasks.workunit.client.0.smithi044.stdout:4/194: dread - dd/f41 zero size 2024-04-25T22:03:18.627 INFO:tasks.workunit.client.0.smithi044.stdout:2/259: mknod d7/d8/d1c/d26/c53 0 2024-04-25T22:03:18.628 INFO:tasks.workunit.client.0.smithi044.stdout:4/195: write dd/f1b [4529472,9651] 0 2024-04-25T22:03:18.629 INFO:tasks.workunit.client.0.smithi044.stdout:2/260: truncate d7/d16/d2d/d4e/f37 879981 0 2024-04-25T22:03:18.629 INFO:tasks.workunit.client.0.smithi044.stdout:4/196: link dd/d35/f47 dd/d35/f4a 0 2024-04-25T22:03:18.630 INFO:tasks.workunit.client.0.smithi044.stdout:3/278: sync 2024-04-25T22:03:18.630 INFO:tasks.workunit.client.0.smithi044.stdout:2/261: chown d7/d16/d2d/d4e/c2a 40206 1 2024-04-25T22:03:18.631 INFO:tasks.workunit.client.0.smithi044.stdout:2/262: rmdir d7/d16/d2c 39 2024-04-25T22:03:18.633 INFO:tasks.workunit.client.0.smithi044.stdout:2/263: rename d7/d8/d1c/d26/d44/f46 to d7/d16/f54 0 2024-04-25T22:03:18.633 INFO:tasks.workunit.client.0.smithi044.stdout:1/268: dwrite d3/f49 [4194304,4194304] 0 2024-04-25T22:03:18.635 INFO:tasks.workunit.client.0.smithi044.stdout:2/264: mkdir d7/d16/d2d/d4e/d2e/d55 0 2024-04-25T22:03:18.635 INFO:tasks.workunit.client.0.smithi044.stdout:1/269: mknod d3/c55 0 2024-04-25T22:03:18.635 INFO:tasks.workunit.client.0.smithi044.stdout:2/265: chown d7/d16/d2d/l51 29176724 1 2024-04-25T22:03:18.636 INFO:tasks.workunit.client.0.smithi044.stdout:2/266: dread - d7/d8/f3e zero size 2024-04-25T22:03:18.636 INFO:tasks.workunit.client.0.smithi044.stdout:1/270: rename d3/d30/f3e to d3/d7/db/f56 0 2024-04-25T22:03:18.636 INFO:tasks.workunit.client.0.smithi044.stdout:3/279: dwrite d0/d1/d15/d51/f49 [0,4194304] 0 2024-04-25T22:03:18.636 INFO:tasks.workunit.client.0.smithi044.stdout:1/271: fsync d3/d7/db/f15 0 2024-04-25T22:03:18.637 INFO:tasks.workunit.client.0.smithi044.stdout:1/272: read d3/f49 [6559869,84431] 0 2024-04-25T22:03:18.638 INFO:tasks.workunit.client.0.smithi044.stdout:3/280: write d0/f20 [3759598,6051] 0 2024-04-25T22:03:18.638 INFO:tasks.workunit.client.0.smithi044.stdout:2/267: write d7/d16/f17 [1164522,6920] 0 2024-04-25T22:03:18.638 INFO:tasks.workunit.client.0.smithi044.stdout:1/273: creat d3/d7/f57 x:0 0 0 2024-04-25T22:03:18.639 INFO:tasks.workunit.client.0.smithi044.stdout:2/268: chown d7/d16/d2d/d4e/d2e/f2f 500188 1 2024-04-25T22:03:18.639 INFO:tasks.workunit.client.0.smithi044.stdout:1/274: fsync d3/d7/f20 0 2024-04-25T22:03:18.639 INFO:tasks.workunit.client.0.smithi044.stdout:2/269: creat d7/d8/d1c/d26/f56 x:0 0 0 2024-04-25T22:03:18.639 INFO:tasks.workunit.client.0.smithi044.stdout:3/281: truncate d0/d1/d15/d51/dd/d11/d42/f4d 723434 0 2024-04-25T22:03:18.642 INFO:tasks.workunit.client.0.smithi044.stdout:1/275: dread d3/d7/db/f15 [0,4194304] 0 2024-04-25T22:03:18.642 INFO:tasks.workunit.client.0.smithi044.stdout:1/276: mknod d3/d7/db/c58 0 2024-04-25T22:03:18.643 INFO:tasks.workunit.client.0.smithi044.stdout:1/277: mkdir d3/d59 0 2024-04-25T22:03:18.646 INFO:tasks.workunit.client.0.smithi044.stdout:1/278: dread d3/d30/f31 [0,4194304] 0 2024-04-25T22:03:18.647 INFO:tasks.workunit.client.0.smithi044.stdout:7/185: dread d1c/d22/d28/f35 [0,4194304] 0 2024-04-25T22:03:18.648 INFO:tasks.workunit.client.0.smithi044.stdout:7/186: write d1c/f20 [161631,14479] 0 2024-04-25T22:03:18.649 INFO:tasks.workunit.client.0.smithi044.stdout:1/279: dread d3/d7/f40 [0,4194304] 0 2024-04-25T22:03:18.652 INFO:tasks.workunit.client.0.smithi044.stdout:1/280: dread d3/f49 [4194304,4194304] 0 2024-04-25T22:03:18.653 INFO:tasks.workunit.client.0.smithi044.stdout:3/282: dread d0/d1/d15/d51/dd/d11/f2c [0,4194304] 0 2024-04-25T22:03:18.654 INFO:tasks.workunit.client.0.smithi044.stdout:3/283: rmdir d0/d1/d15/d51/dd/d4a 0 2024-04-25T22:03:18.659 INFO:tasks.workunit.client.0.smithi044.stdout:5/201: truncate d2/d5/f16 3267084 0 2024-04-25T22:03:18.659 INFO:tasks.workunit.client.0.smithi044.stdout:3/284: dwrite d0/f38 [4194304,4194304] 0 2024-04-25T22:03:18.660 INFO:tasks.workunit.client.0.smithi044.stdout:0/275: getdents d8/da/d55 0 2024-04-25T22:03:18.661 INFO:tasks.workunit.client.0.smithi044.stdout:5/202: link d2/f4 d2/d5/d27/f40 0 2024-04-25T22:03:18.661 INFO:tasks.workunit.client.0.smithi044.stdout:0/276: creat d8/df/d17/d45/f63 x:0 0 0 2024-04-25T22:03:18.663 INFO:tasks.workunit.client.0.smithi044.stdout:3/285: rename d0/d1/d15/d51/f49 to d0/d1/d15/d51/d39/f5a 0 2024-04-25T22:03:18.664 INFO:tasks.workunit.client.0.smithi044.stdout:9/327: dwrite d4/d7/d18/d2e/f3f [0,4194304] 0 2024-04-25T22:03:18.664 INFO:tasks.workunit.client.0.smithi044.stdout:0/277: rename d8 to d8/df/d17/d45/d4f/d64 22 2024-04-25T22:03:18.665 INFO:tasks.workunit.client.0.smithi044.stdout:9/328: dread d4/d7/d18/f5a [0,4194304] 0 2024-04-25T22:03:18.665 INFO:tasks.workunit.client.0.smithi044.stdout:5/203: creat d2/d5/f41 x:0 0 0 2024-04-25T22:03:18.666 INFO:tasks.workunit.client.0.smithi044.stdout:0/278: mkdir d8/d15/d51/d65 0 2024-04-25T22:03:18.666 INFO:tasks.workunit.client.0.smithi044.stdout:7/187: truncate d1c/f2b 3754742 0 2024-04-25T22:03:18.667 INFO:tasks.workunit.client.0.smithi044.stdout:9/329: mknod d4/d37/d54/c6f 0 2024-04-25T22:03:18.667 INFO:tasks.workunit.client.0.smithi044.stdout:5/204: fdatasync d2/d5/f18 0 2024-04-25T22:03:18.667 INFO:tasks.workunit.client.0.smithi044.stdout:0/279: getdents d8/d15 0 2024-04-25T22:03:18.667 INFO:tasks.workunit.client.0.smithi044.stdout:9/330: mkdir d4/d7/d18/d2d/d70 0 2024-04-25T22:03:18.668 INFO:tasks.workunit.client.0.smithi044.stdout:5/205: write d2/f20 [3092075,84344] 0 2024-04-25T22:03:18.668 INFO:tasks.workunit.client.0.smithi044.stdout:0/280: unlink d8/df/d17/c46 0 2024-04-25T22:03:18.668 INFO:tasks.workunit.client.0.smithi044.stdout:0/281: fsync f1 0 2024-04-25T22:03:18.669 INFO:tasks.workunit.client.0.smithi044.stdout:5/206: creat d2/d5/d27/d2a/f42 x:0 0 0 2024-04-25T22:03:18.670 INFO:tasks.workunit.client.0.smithi044.stdout:9/331: creat d4/d7/d18/d2d/d70/f71 x:0 0 0 2024-04-25T22:03:18.671 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:18.671 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:18.671 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:03:18.671 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:03:18.671 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:18.673 INFO:tasks.workunit.client.0.smithi044.stdout:1/281: dwrite d3/d7/db/f1d [0,4194304] 0 2024-04-25T22:03:18.673 INFO:tasks.workunit.client.0.smithi044.stdout:1/282: fdatasync d3/f4a 0 2024-04-25T22:03:18.674 INFO:tasks.workunit.client.0.smithi044.stdout:0/282: dwrite d8/f3b [0,4194304] 0 2024-04-25T22:03:18.675 INFO:tasks.workunit.client.0.smithi044.stdout:0/283: write d8/df/f29 [2262524,31980] 0 2024-04-25T22:03:18.677 INFO:tasks.workunit.client.0.smithi044.stdout:9/332: dwrite d4/d7/d18/d2d/f38 [0,4194304] 0 2024-04-25T22:03:18.678 INFO:tasks.workunit.client.0.smithi044.stdout:9/333: write d4/d7/d18/d2e/f4c [739143,74472] 0 2024-04-25T22:03:18.678 INFO:tasks.workunit.client.0.smithi044.stdout:1/283: dread d3/d7/db/f1d [0,4194304] 0 2024-04-25T22:03:18.679 INFO:tasks.workunit.client.0.smithi044.stdout:9/334: mkdir d4/d5e/d72 0 2024-04-25T22:03:18.679 INFO:tasks.workunit.client.0.smithi044.stdout:6/325: sync 2024-04-25T22:03:18.679 INFO:tasks.workunit.client.0.smithi044.stdout:8/359: sync 2024-04-25T22:03:18.680 INFO:tasks.workunit.client.0.smithi044.stdout:1/284: write d3/d7/f2f [4444586,127408] 0 2024-04-25T22:03:18.680 INFO:tasks.workunit.client.0.smithi044.stdout:8/360: symlink d2a/d32/d57/l74 0 2024-04-25T22:03:18.680 INFO:tasks.workunit.client.0.smithi044.stdout:1/285: creat d3/d30/d3f/f5a x:0 0 0 2024-04-25T22:03:18.681 INFO:tasks.workunit.client.0.smithi044.stdout:6/326: write d2/d23/d5a/d12/d49/f5d [1876444,16371] 0 2024-04-25T22:03:18.681 INFO:tasks.workunit.client.0.smithi044.stdout:8/361: chown d2a/d32/d3e/f46 2 1 2024-04-25T22:03:18.682 INFO:tasks.workunit.client.0.smithi044.stdout:8/362: readlink l14 0 2024-04-25T22:03:18.682 INFO:tasks.workunit.client.0.smithi044.stdout:9/335: truncate d4/d7/d18/d3a/f46 648997 0 2024-04-25T22:03:18.682 INFO:tasks.workunit.client.0.smithi044.stdout:6/327: unlink d2/d23/c2f 0 2024-04-25T22:03:18.683 INFO:tasks.workunit.client.0.smithi044.stdout:9/336: mkdir d4/d7/d18/d2e/d73 0 2024-04-25T22:03:18.684 INFO:tasks.workunit.client.0.smithi044.stdout:0/284: dwrite d8/df/d17/f3d [0,4194304] 0 2024-04-25T22:03:18.686 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:18.687 INFO:tasks.workunit.client.0.smithi044.stdout:9/337: link d4/d7/f4d d4/d37/f74 0 2024-04-25T22:03:18.688 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:18.685+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:18.688 INFO:tasks.workunit.client.0.smithi044.stdout:1/286: dwrite d3/f49 [0,4194304] 0 2024-04-25T22:03:18.689 INFO:tasks.workunit.client.0.smithi044.stdout:9/338: creat d4/d7/d18/d2e/d73/f75 x:0 0 0 2024-04-25T22:03:18.690 INFO:tasks.workunit.client.0.smithi044.stdout:1/287: dread - d3/d30/d3f/f5a zero size 2024-04-25T22:03:18.691 INFO:tasks.workunit.client.0.smithi044.stdout:0/285: dread d8/f2b [0,4194304] 0 2024-04-25T22:03:18.691 INFO:tasks.workunit.client.0.smithi044.stdout:9/339: rename d4/d37/c6d to d4/d7/d18/d2d/d70/c76 0 2024-04-25T22:03:18.691 INFO:tasks.workunit.client.0.smithi044.stdout:1/288: write d3/d7/f57 [898772,105456] 0 2024-04-25T22:03:18.692 INFO:tasks.workunit.client.0.smithi044.stdout:8/363: dwrite d2a/d32/f5d [4194304,4194304] 0 2024-04-25T22:03:18.692 INFO:tasks.workunit.client.0.smithi044.stdout:8/364: readlink l29 0 2024-04-25T22:03:18.692 INFO:tasks.workunit.client.0.smithi044.stdout:8/365: chown d2a/d39/d5a 140 1 2024-04-25T22:03:18.692 INFO:tasks.workunit.client.0.smithi044.stdout:1/289: write d3/d7/db/f15 [3046019,83684] 0 2024-04-25T22:03:18.692 INFO:tasks.workunit.client.0.smithi044.stdout:6/328: dwrite d2/d23/d5a/d11/f16 [0,4194304] 0 2024-04-25T22:03:18.693 INFO:tasks.workunit.client.0.smithi044.stdout:9/340: symlink d4/l77 0 2024-04-25T22:03:18.693 INFO:tasks.workunit.client.0.smithi044.stdout:1/290: mknod d3/d7/db/d42/c5b 0 2024-04-25T22:03:18.694 INFO:tasks.workunit.client.0.smithi044.stdout:8/366: rename d2a/d39/d42/d68/d6b/f5f to d2a/d32/d3e/f75 0 2024-04-25T22:03:18.694 INFO:tasks.workunit.client.0.smithi044.stdout:9/341: mknod d4/d3d/c78 0 2024-04-25T22:03:18.695 INFO:tasks.workunit.client.0.smithi044.stdout:8/367: symlink d2a/d32/l76 0 2024-04-25T22:03:18.695 INFO:tasks.workunit.client.0.smithi044.stdout:9/342: write d4/d7/d18/d2d/f38 [523650,61329] 0 2024-04-25T22:03:18.697 INFO:tasks.workunit.client.0.smithi044.stdout:3/286: dread d0/f20 [0,4194304] 0 2024-04-25T22:03:18.697 INFO:tasks.workunit.client.0.smithi044.stdout:0/286: dwrite d8/d24/f28 [0,4194304] 0 2024-04-25T22:03:18.698 INFO:tasks.workunit.client.0.smithi044.stdout:9/343: mkdir d4/d7/d79 0 2024-04-25T22:03:18.699 INFO:tasks.workunit.client.0.smithi044.stdout:5/207: getdents d2/d5/d27 0 2024-04-25T22:03:18.699 INFO:tasks.workunit.client.0.smithi044.stdout:3/287: fsync d0/d13/f37 0 2024-04-25T22:03:18.700 INFO:tasks.workunit.client.0.smithi044.stdout:9/344: write d4/d7/d18/d3a/f5f [3374919,104411] 0 2024-04-25T22:03:18.700 INFO:tasks.workunit.client.0.smithi044.stdout:5/208: write d2/f3c [994537,58619] 0 2024-04-25T22:03:18.701 INFO:tasks.workunit.client.0.smithi044.stdout:0/287: mknod d8/da/d60/c66 0 2024-04-25T22:03:18.703 INFO:tasks.workunit.client.0.smithi044.stdout:9/345: write d4/d7/d18/f4f [736205,120028] 0 2024-04-25T22:03:18.704 INFO:tasks.workunit.client.0.smithi044.stdout:4/197: sync 2024-04-25T22:03:18.706 INFO:tasks.workunit.client.0.smithi044.stdout:7/188: write d1c/f2b [2174717,21903] 0 2024-04-25T22:03:18.706 INFO:tasks.workunit.client.0.smithi044.stdout:8/368: dwrite f0 [0,4194304] 0 2024-04-25T22:03:18.706 INFO:tasks.workunit.client.0.smithi044.stdout:2/270: dwrite d7/f14 [0,4194304] 0 2024-04-25T22:03:18.706 INFO:tasks.workunit.client.0.smithi044.stdout:1/291: dwrite d3/d7/db/f1d [4194304,4194304] 0 2024-04-25T22:03:18.707 INFO:tasks.workunit.client.0.smithi044.stdout:7/189: chown d1c/d22 603499582 1 2024-04-25T22:03:18.708 INFO:tasks.workunit.client.0.smithi044.stdout:4/198: creat dd/f4b x:0 0 0 2024-04-25T22:03:18.708 INFO:tasks.workunit.client.0.smithi044.stdout:1/292: stat d3/d7 0 2024-04-25T22:03:18.708 INFO:tasks.workunit.client.0.smithi044.stdout:2/271: write d7/f15 [1413648,37126] 0 2024-04-25T22:03:18.709 INFO:tasks.workunit.client.0.smithi044.stdout:8/369: mkdir d2a/d77 0 2024-04-25T22:03:18.709 INFO:tasks.workunit.client.0.smithi044.stdout:4/199: chown dd/f4b 124037 1 2024-04-25T22:03:18.711 INFO:tasks.workunit.client.0.smithi044.stdout:8/370: truncate d2a/f45 1660617 0 2024-04-25T22:03:18.711 INFO:tasks.workunit.client.0.smithi044.stdout:8/371: chown c1d 2068056097 1 2024-04-25T22:03:18.713 INFO:tasks.workunit.client.0.smithi044.stdout:4/200: mkdir dd/d19/d38/d4c 0 2024-04-25T22:03:18.714 INFO:tasks.workunit.client.0.smithi044.stdout:2/272: getdents d7/d16 0 2024-04-25T22:03:18.714 INFO:tasks.workunit.client.0.smithi044.stdout:4/201: readlink dd/l15 0 2024-04-25T22:03:18.714 INFO:tasks.workunit.client.0.smithi044.stdout:7/190: link d1c/d22/d28/d30/f36 d1c/d22/d28/d30/d32/f39 0 2024-04-25T22:03:18.714 INFO:tasks.workunit.client.0.smithi044.stdout:5/209: dwrite d2/d5/f16 [0,4194304] 0 2024-04-25T22:03:18.714 INFO:tasks.workunit.client.0.smithi044.stdout:0/288: dwrite d8/d15/f39 [4194304,4194304] 0 2024-04-25T22:03:18.714 INFO:tasks.workunit.client.0.smithi044.stdout:4/202: write dd/f17 [776322,112696] 0 2024-04-25T22:03:18.715 INFO:tasks.workunit.client.0.smithi044.stdout:0/289: stat d8/df/d17/l34 0 2024-04-25T22:03:18.715 INFO:tasks.workunit.client.0.smithi044.stdout:0/290: chown f1 25990525 1 2024-04-25T22:03:18.715 INFO:tasks.workunit.client.0.smithi044.stdout:3/288: truncate d0/d13/d1c/f2b 3401462 0 2024-04-25T22:03:18.716 INFO:tasks.workunit.client.0.smithi044.stdout:2/273: getdents d7/d16/d2d/d4e/d4c 0 2024-04-25T22:03:18.718 INFO:tasks.workunit.client.0.smithi044.stdout:2/274: rename d7/d16/d2d/d4e/d2e/d55 to d7/d16/d2d/d57 0 2024-04-25T22:03:18.718 INFO:tasks.workunit.client.0.smithi044.stdout:3/289: mknod d0/d1/d15/d51/dd/d35/c5b 0 2024-04-25T22:03:18.720 INFO:tasks.workunit.client.0.smithi044.stdout:2/275: mknod d7/d16/d2c/c58 0 2024-04-25T22:03:18.722 INFO:tasks.workunit.client.0.smithi044.stdout:7/191: dwrite f12 [0,4194304] 0 2024-04-25T22:03:18.722 INFO:tasks.workunit.client.0.smithi044.stdout:9/346: truncate d4/d7/d18/d2e/f5d 2916040 0 2024-04-25T22:03:18.722 INFO:tasks.workunit.client.0.smithi044.stdout:7/192: creat d1c/f3a x:0 0 0 2024-04-25T22:03:18.723 INFO:tasks.workunit.client.0.smithi044.stdout:9/347: getdents d4/d5e 0 2024-04-25T22:03:18.725 INFO:tasks.workunit.client.0.smithi044.stdout:7/193: mknod d1c/d22/d28/d30/c3b 0 2024-04-25T22:03:18.725 INFO:tasks.workunit.client.0.smithi044.stdout:7/194: readlink le 0 2024-04-25T22:03:18.731 INFO:tasks.workunit.client.0.smithi044.stdout:7/195: dwrite d1c/f2b [0,4194304] 0 2024-04-25T22:03:18.731 INFO:tasks.workunit.client.0.smithi044.stdout:7/196: dread - d1c/d22/f23 zero size 2024-04-25T22:03:18.732 INFO:tasks.workunit.client.0.smithi044.stdout:7/197: symlink d1c/l3c 0 2024-04-25T22:03:18.733 INFO:tasks.workunit.client.0.smithi044.stdout:8/372: dread d2a/d32/d3e/f75 [0,4194304] 0 2024-04-25T22:03:18.734 INFO:tasks.workunit.client.0.smithi044.stdout:8/373: readlink d2a/d32/d57/l74 0 2024-04-25T22:03:18.734 INFO:tasks.workunit.client.0.smithi044.stdout:8/374: chown d2a/d32/l76 28 1 2024-04-25T22:03:18.734 INFO:tasks.workunit.client.0.smithi044.stdout:8/375: creat d2a/d39/d42/f78 x:0 0 0 2024-04-25T22:03:18.735 INFO:tasks.workunit.client.0.smithi044.stdout:8/376: dread - d2a/d39/d42/d68/d6b/f64 zero size 2024-04-25T22:03:18.737 INFO:tasks.workunit.client.0.smithi044.stdout:7/198: dwrite fa [0,4194304] 0 2024-04-25T22:03:18.738 INFO:tasks.workunit.client.0.smithi044.stdout:7/199: creat d1c/d22/d28/f3d x:0 0 0 2024-04-25T22:03:18.751 INFO:tasks.workunit.client.0.smithi044.stdout:5/210: fsync d2/f3c 0 2024-04-25T22:03:18.753 INFO:tasks.workunit.client.0.smithi044.stdout:0/291: truncate d8/f18 4115280 0 2024-04-25T22:03:18.769 INFO:tasks.workunit.client.0.smithi044.stdout:6/329: dread d2/d23/d30/f53 [0,4194304] 0 2024-04-25T22:03:18.770 INFO:tasks.workunit.client.0.smithi044.stdout:6/330: fdatasync d2/d23/d5a/d12/d1f/f20 0 2024-04-25T22:03:18.771 INFO:tasks.workunit.client.0.smithi044.stdout:1/293: sync 2024-04-25T22:03:18.771 INFO:tasks.workunit.client.0.smithi044.stdout:4/203: sync 2024-04-25T22:03:18.774 INFO:tasks.workunit.client.0.smithi044.stdout:6/331: creat d2/d23/d5a/d12/d1f/f74 x:0 0 0 2024-04-25T22:03:18.774 INFO:tasks.workunit.client.0.smithi044.stdout:1/294: readlink d3/d7/l13 0 2024-04-25T22:03:18.774 INFO:tasks.workunit.client.0.smithi044.stdout:6/332: rmdir d2/d23/d5a/d12/d49 39 2024-04-25T22:03:18.774 INFO:tasks.workunit.client.0.smithi044.stdout:1/295: mkdir d3/d59/d5c 0 2024-04-25T22:03:18.774 INFO:tasks.workunit.client.0.smithi044.stdout:8/377: dread d2a/f2f [0,4194304] 0 2024-04-25T22:03:18.774 INFO:tasks.workunit.client.0.smithi044.stdout:6/333: stat d2/c55 0 2024-04-25T22:03:18.774 INFO:tasks.workunit.client.0.smithi044.stdout:2/276: dread d7/f15 [0,4194304] 0 2024-04-25T22:03:18.775 INFO:tasks.workunit.client.0.smithi044.stdout:1/296: read d3/d7/f23 [2508143,36188] 0 2024-04-25T22:03:18.775 INFO:tasks.workunit.client.0.smithi044.stdout:8/378: creat d2a/d32/f79 x:0 0 0 2024-04-25T22:03:18.775 INFO:tasks.workunit.client.0.smithi044.stdout:8/379: chown d2a/f2f 735343131 1 2024-04-25T22:03:18.775 INFO:tasks.workunit.client.0.smithi044.stdout:4/204: truncate dd/f3b 413520 0 2024-04-25T22:03:18.775 INFO:tasks.workunit.client.0.smithi044.stdout:2/277: write d7/f1b [1818627,16997] 0 2024-04-25T22:03:18.775 INFO:tasks.workunit.client.0.smithi044.stdout:1/297: mkdir d3/d7/db/d5d 0 2024-04-25T22:03:18.776 INFO:tasks.workunit.client.0.smithi044.stdout:8/380: write f17 [2331696,109562] 0 2024-04-25T22:03:18.776 INFO:tasks.workunit.client.0.smithi044.stdout:4/205: fdatasync dd/f36 0 2024-04-25T22:03:18.776 INFO:tasks.workunit.client.0.smithi044.stdout:8/381: creat d2a/d32/d3e/f7a x:0 0 0 2024-04-25T22:03:18.777 INFO:tasks.workunit.client.0.smithi044.stdout:2/278: rename d7/d16/d2c/f49 to d7/d16/d2d/d4e/f59 0 2024-04-25T22:03:18.777 INFO:tasks.workunit.client.0.smithi044.stdout:4/206: symlink dd/d35/l4d 0 2024-04-25T22:03:18.777 INFO:tasks.workunit.client.0.smithi044.stdout:4/207: write fa [3049667,91645] 0 2024-04-25T22:03:18.778 INFO:tasks.workunit.client.0.smithi044.stdout:8/382: mkdir d2a/d39/d42/d68/d6b/d7b 0 2024-04-25T22:03:18.778 INFO:tasks.workunit.client.0.smithi044.stdout:4/208: stat dd/d35 0 2024-04-25T22:03:18.779 INFO:tasks.workunit.client.0.smithi044.stdout:3/290: truncate d0/f31 883858 0 2024-04-25T22:03:18.779 INFO:tasks.workunit.client.0.smithi044.stdout:2/279: creat d7/d8/d1c/d26/f5a x:0 0 0 2024-04-25T22:03:18.779 INFO:tasks.workunit.client.0.smithi044.stdout:5/211: truncate d2/d5/f1f 1724875 0 2024-04-25T22:03:18.780 INFO:tasks.workunit.client.0.smithi044.stdout:3/291: rmdir d0 39 2024-04-25T22:03:18.782 INFO:tasks.workunit.client.0.smithi044.stdout:8/383: dread - d2a/d32/f3d zero size 2024-04-25T22:03:18.782 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-25T22:03:18.782 INFO:tasks.workunit.client.0.smithi044.stdout:8/384: write d2a/f62 [92627,120798] 0 2024-04-25T22:03:18.783 INFO:tasks.workunit.client.0.smithi044.stdout:2/280: rename d7/d8/d1c/d26/d43 to d7/d5b 0 2024-04-25T22:03:18.783 INFO:tasks.workunit.client.0.smithi044.stdout:5/212: read d2/f19 [997201,110703] 0 2024-04-25T22:03:18.785 INFO:tasks.workunit.client.0.smithi044.stdout:5/213: truncate d2/f3c 2052976 0 2024-04-25T22:03:18.786 INFO:tasks.workunit.client.0.smithi044.stdout:1/298: dwrite d3/d7/db/f1d [0,4194304] 0 2024-04-25T22:03:18.786 INFO:tasks.workunit.client.0.smithi044.stdout:4/209: dwrite dd/ff [0,4194304] 0 2024-04-25T22:03:18.787 INFO:tasks.workunit.client.0.smithi044.stdout:2/281: write d7/d16/d2d/d4e/d2e/f2f [1878807,63199] 0 2024-04-25T22:03:18.787 INFO:tasks.workunit.client.0.smithi044.stdout:1/299: chown d3/f49 8304 1 2024-04-25T22:03:18.787 INFO:tasks.workunit.client.0.smithi044.stdout:4/210: write dd/d19/f1d [24540,41169] 0 2024-04-25T22:03:18.789 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:18.780+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:18.789 INFO:tasks.workunit.client.0.smithi044.stdout:2/282: truncate d7/d16/d2c/f42 271370 0 2024-04-25T22:03:18.790 INFO:tasks.workunit.client.0.smithi044.stdout:5/214: creat d2/d5/d21/f43 x:0 0 0 2024-04-25T22:03:18.791 INFO:tasks.workunit.client.0.smithi044.stdout:4/211: mknod dd/d35/c4e 0 2024-04-25T22:03:18.791 INFO:tasks.workunit.client.0.smithi044.stdout:5/215: stat d2/d5/f39 0 2024-04-25T22:03:18.791 INFO:tasks.workunit.client.0.smithi044.stdout:3/292: write d0/d1/d15/d51/dd/d11/f2c [1442354,130088] 0 2024-04-25T22:03:18.794 INFO:tasks.workunit.client.0.smithi044.stdout:8/385: truncate d2a/d39/d42/f49 853456 0 2024-04-25T22:03:18.794 INFO:tasks.workunit.client.0.smithi044.stdout:2/283: write d7/d16/d2d/d4e/d2e/f2f [2392080,66808] 0 2024-04-25T22:03:18.794 INFO:tasks.workunit.client.0.smithi044.stdout:8/386: write d2a/d32/f3d [496839,47543] 0 2024-04-25T22:03:18.797 INFO:tasks.workunit.client.0.smithi044.stdout:8/387: chown f8 176354 1 2024-04-25T22:03:18.797 INFO:tasks.workunit.client.0.smithi044.stdout:1/300: dwrite d3/d7/db/f15 [0,4194304] 0 2024-04-25T22:03:18.797 INFO:tasks.workunit.client.0.smithi044.stdout:5/216: read d2/f3c [1646750,56277] 0 2024-04-25T22:03:18.797 INFO:tasks.workunit.client.0.smithi044.stdout:2/284: write d7/d8/f3e [4933877,16632] 0 2024-04-25T22:03:18.798 INFO:tasks.workunit.client.0.smithi044.stdout:3/293: truncate d0/d13/d1c/f2b 1479885 0 2024-04-25T22:03:18.800 INFO:tasks.workunit.client.0.smithi044.stdout:9/348: dread f3 [0,4194304] 0 2024-04-25T22:03:18.801 INFO:tasks.workunit.client.0.smithi044.stdout:2/285: creat d7/d8/d1c/f5c x:0 0 0 2024-04-25T22:03:18.802 INFO:tasks.workunit.client.0.smithi044.stdout:4/212: dwrite dd/f4b [0,4194304] 0 2024-04-25T22:03:18.803 INFO:tasks.workunit.client.0.smithi044.stdout:3/294: creat d0/f5c x:0 0 0 2024-04-25T22:03:18.804 INFO:tasks.workunit.client.0.smithi044.stdout:9/349: creat d4/d7/d18/f7a x:0 0 0 2024-04-25T22:03:18.804 INFO:tasks.workunit.client.0.smithi044.stdout:6/334: dread d2/d23/d5a/d11/d3b/f58 [0,4194304] 0 2024-04-25T22:03:18.804 INFO:tasks.workunit.client.0.smithi044.stdout:2/286: write d7/d16/d2d/d4e/f39 [1139251,126697] 0 2024-04-25T22:03:18.807 INFO:tasks.workunit.client.0.smithi044.stdout:6/335: creat d2/f75 x:0 0 0 2024-04-25T22:03:18.809 INFO:tasks.workunit.client.0.smithi044.stdout:9/350: chown d4/d7/d18/f4f 7 1 2024-04-25T22:03:18.809 INFO:tasks.workunit.client.0.smithi044.stdout:9/351: dread - d4/d7/f63 zero size 2024-04-25T22:03:18.809 INFO:tasks.workunit.client.0.smithi044.stdout:3/295: mkdir d0/d1/d15/df/d5d 0 2024-04-25T22:03:18.809 INFO:tasks.workunit.client.0.smithi044.stdout:5/217: dwrite d2/d5/f17 [0,4194304] 0 2024-04-25T22:03:18.809 INFO:tasks.workunit.client.0.smithi044.stdout:1/301: dwrite d3/d7/d29/f35 [0,4194304] 0 2024-04-25T22:03:18.810 INFO:tasks.workunit.client.0.smithi044.stdout:9/352: fsync d4/d7/d18/d3a/f6c 0 2024-04-25T22:03:18.810 INFO:tasks.workunit.client.0.smithi044.stdout:1/302: write d3/d7/f57 [312811,60757] 0 2024-04-25T22:03:18.811 INFO:tasks.workunit.client.0.smithi044.stdout:9/353: fsync d4/d7/d18/f4f 0 2024-04-25T22:03:18.811 INFO:tasks.workunit.client.0.smithi044.stdout:5/218: mknod d2/d5/d27/d2a/d3a/c44 0 2024-04-25T22:03:18.811 INFO:tasks.workunit.client.0.smithi044.stdout:3/296: creat d0/d1/d15/d51/dd/d28/f5e x:0 0 0 2024-04-25T22:03:18.811 INFO:tasks.workunit.client.0.smithi044.stdout:9/354: write d4/d7/d18/d2d/f51 [4316865,112268] 0 2024-04-25T22:03:18.811 INFO:tasks.workunit.client.0.smithi044.stdout:3/297: fsync d0/d1/d15/d51/dd/d11/d42/f4d 0 2024-04-25T22:03:18.811 INFO:tasks.workunit.client.0.smithi044.stdout:9/355: stat d4/d5e 0 2024-04-25T22:03:18.812 INFO:tasks.workunit.client.0.smithi044.stdout:5/219: write d2/f3c [2471836,110833] 0 2024-04-25T22:03:18.812 INFO:tasks.workunit.client.0.smithi044.stdout:3/298: write d0/d1/d15/d51/dd/d28/f3f [785008,116800] 0 2024-04-25T22:03:18.812 INFO:tasks.workunit.client.0.smithi044.stdout:5/220: write d2/d5/d27/d2a/f30 [869680,84761] 0 2024-04-25T22:03:18.813 INFO:tasks.workunit.client.0.smithi044.stdout:3/299: creat d0/d1/d34/d48/f5f x:0 0 0 2024-04-25T22:03:18.813 INFO:tasks.workunit.client.0.smithi044.stdout:3/300: stat d0 0 2024-04-25T22:03:18.813 INFO:tasks.workunit.client.0.smithi044.stdout:5/221: chown d2/d5/d21/d26/d2c/d37 28 1 2024-04-25T22:03:18.815 INFO:tasks.workunit.client.0.smithi044.stdout:2/287: write d7/f11 [705144,112745] 0 2024-04-25T22:03:18.816 INFO:tasks.workunit.client.0.smithi044.stdout:5/222: link d2/d5/d27/f36 d2/d35/f45 0 2024-04-25T22:03:18.816 INFO:tasks.workunit.client.0.smithi044.stdout:6/336: mknod d2/d23/d5a/d13/c76 0 2024-04-25T22:03:18.818 INFO:tasks.workunit.client.0.smithi044.stdout:1/303: dwrite d3/d7/db/f56 [0,4194304] 0 2024-04-25T22:03:18.818 INFO:tasks.workunit.client.0.smithi044.stdout:6/337: readlink d2/d23/l3f 0 2024-04-25T22:03:18.818 INFO:tasks.workunit.client.0.smithi044.stdout:5/223: write d2/d5/f18 [4954046,121330] 0 2024-04-25T22:03:18.819 INFO:tasks.workunit.client.0.smithi044.stdout:6/338: chown d2/d23/d5a/c22 50650794 1 2024-04-25T22:03:18.819 INFO:tasks.workunit.client.0.smithi044.stdout:1/304: creat d3/f5e x:0 0 0 2024-04-25T22:03:18.819 INFO:tasks.workunit.client.0.smithi044.stdout:4/213: dwrite dd/d19/f3d [0,4194304] 0 2024-04-25T22:03:18.821 INFO:tasks.workunit.client.0.smithi044.stdout:6/339: mkdir d2/d23/d5a/d12/d49/d77 0 2024-04-25T22:03:18.821 INFO:tasks.workunit.client.0.smithi044.stdout:4/214: symlink dd/l4f 0 2024-04-25T22:03:18.824 INFO:tasks.workunit.client.0.smithi044.stdout:6/340: truncate d2/d23/d5a/d11/d3b/f24 1100705 0 2024-04-25T22:03:18.824 INFO:tasks.workunit.client.0.smithi044.stdout:1/305: symlink d3/d30/d3f/l5f 0 2024-04-25T22:03:18.824 INFO:tasks.workunit.client.0.smithi044.stdout:4/215: creat dd/d19/f50 x:0 0 0 2024-04-25T22:03:18.824 INFO:tasks.workunit.client.0.smithi044.stdout:2/288: dwrite d7/d8/d1c/d26/f56 [0,4194304] 0 2024-04-25T22:03:18.825 INFO:tasks.workunit.client.0.smithi044.stdout:6/341: unlink d2/d23/d5a/d12/d1f/f74 0 2024-04-25T22:03:18.825 INFO:tasks.workunit.client.0.smithi044.stdout:1/306: symlink d3/d7/d29/d43/l60 0 2024-04-25T22:03:18.825 INFO:tasks.workunit.client.0.smithi044.stdout:4/216: mknod dd/d35/c51 0 2024-04-25T22:03:18.825 INFO:tasks.workunit.client.0.smithi044.stdout:6/342: write d2/d23/d30/f47 [714193,7578] 0 2024-04-25T22:03:18.825 INFO:tasks.workunit.client.0.smithi044.stdout:2/289: rename d7/d8/d1c/f41 to d7/d16/d4b/f5d 0 2024-04-25T22:03:18.826 INFO:tasks.workunit.client.0.smithi044.stdout:6/343: stat d2/d23/d5a/d13/d4b/f67 0 2024-04-25T22:03:18.827 INFO:tasks.workunit.client.0.smithi044.stdout:2/290: write d7/d16/d2d/d4e/d2e/f2f [774990,96226] 0 2024-04-25T22:03:18.827 INFO:tasks.workunit.client.0.smithi044.stdout:6/344: write d2/d23/d5a/d13/f5f [1032576,55367] 0 2024-04-25T22:03:18.827 INFO:tasks.workunit.client.0.smithi044.stdout:2/291: write d7/d16/d2c/f3b [499604,102700] 0 2024-04-25T22:03:18.828 INFO:tasks.workunit.client.0.smithi044.stdout:1/307: truncate d3/d7/d29/d43/f52 308642 0 2024-04-25T22:03:18.828 INFO:tasks.workunit.client.0.smithi044.stdout:6/345: mknod d2/c78 0 2024-04-25T22:03:18.829 INFO:tasks.workunit.client.0.smithi044.stdout:1/308: unlink d3/d7/db/l1b 0 2024-04-25T22:03:18.830 INFO:tasks.workunit.client.0.smithi044.stdout:6/346: rename d2/d23/f37 to d2/d23/d5a/d13/d68/f79 0 2024-04-25T22:03:18.831 INFO:tasks.workunit.client.0.smithi044.stdout:6/347: chown d2/d23/d5a/d13/f3d 115 1 2024-04-25T22:03:18.831 INFO:tasks.workunit.client.0.smithi044.stdout:4/217: dwrite dd/f34 [0,4194304] 0 2024-04-25T22:03:18.832 INFO:tasks.workunit.client.0.smithi044.stdout:6/348: chown d2/d23/d5a/d13/d68/c6d 110861 1 2024-04-25T22:03:18.833 INFO:tasks.workunit.client.0.smithi044.stdout:1/309: dread d3/d7/f3d [0,4194304] 0 2024-04-25T22:03:18.834 INFO:tasks.workunit.client.0.smithi044.stdout:6/349: creat d2/d23/d5a/d12/f7a x:0 0 0 2024-04-25T22:03:18.835 INFO:tasks.workunit.client.0.smithi044.stdout:1/310: fsync d3/d7/d29/f39 0 2024-04-25T22:03:18.835 INFO:tasks.workunit.client.0.smithi044.stdout:2/292: dwrite d7/d16/d2d/d4e/f36 [0,4194304] 0 2024-04-25T22:03:18.836 INFO:tasks.workunit.client.0.smithi044.stdout:6/350: mkdir d2/d23/d5a/d13/d68/d7b 0 2024-04-25T22:03:18.836 INFO:tasks.workunit.client.0.smithi044.stdout:1/311: creat d3/f61 x:0 0 0 2024-04-25T22:03:18.836 INFO:tasks.workunit.client.0.smithi044.stdout:2/293: mkdir d7/d8/d1c/d26/d5e 0 2024-04-25T22:03:18.837 INFO:tasks.workunit.client.0.smithi044.stdout:1/312: read - d3/f5e zero size 2024-04-25T22:03:18.838 INFO:tasks.workunit.client.0.smithi044.stdout:6/351: symlink d2/d23/d5a/l7c 0 2024-04-25T22:03:18.838 INFO:tasks.workunit.client.0.smithi044.stdout:2/294: write d7/d16/d2d/d4e/f59 [808421,22580] 0 2024-04-25T22:03:18.839 INFO:tasks.workunit.client.0.smithi044.stdout:6/352: mknod d2/d23/d5a/d11/d2a/c7d 0 2024-04-25T22:03:18.839 INFO:tasks.workunit.client.0.smithi044.stdout:4/218: dwrite dd/d35/f37 [0,4194304] 0 2024-04-25T22:03:18.843 INFO:tasks.workunit.client.0.smithi044.stdout:1/313: dwrite d3/d7/d29/d43/f52 [0,4194304] 0 2024-04-25T22:03:18.845 INFO:tasks.workunit.client.0.smithi044.stdout:1/314: creat d3/d59/d5c/f62 x:0 0 0 2024-04-25T22:03:18.845 INFO:tasks.workunit.client.0.smithi044.stdout:1/315: dread - d3/d30/d3f/f5a zero size 2024-04-25T22:03:18.846 INFO:tasks.workunit.client.0.smithi044.stdout:6/353: dwrite d2/d23/d5a/d12/f48 [0,4194304] 0 2024-04-25T22:03:18.846 INFO:tasks.workunit.client.0.smithi044.stdout:1/316: symlink d3/d7/db/l63 0 2024-04-25T22:03:18.847 INFO:tasks.workunit.client.0.smithi044.stdout:1/317: creat d3/d7/db/d42/f64 x:0 0 0 2024-04-25T22:03:18.850 INFO:tasks.workunit.client.0.smithi044.stdout:6/354: dread d2/d23/d5a/d13/d68/f79 [0,4194304] 0 2024-04-25T22:03:18.851 INFO:tasks.workunit.client.0.smithi044.stdout:1/318: dread d3/f37 [0,4194304] 0 2024-04-25T22:03:18.853 INFO:tasks.workunit.client.0.smithi044.stdout:1/319: link d3/d7/d29/f35 d3/d54/f65 0 2024-04-25T22:03:18.853 INFO:tasks.workunit.client.0.smithi044.stdout:5/224: dwrite d2/f4 [4194304,4194304] 0 2024-04-25T22:03:18.853 INFO:tasks.workunit.client.0.smithi044.stdout:1/320: write d3/f5e [494581,1518] 0 2024-04-25T22:03:18.854 INFO:tasks.workunit.client.0.smithi044.stdout:5/225: chown d2/d5/d21/f43 346325 1 2024-04-25T22:03:18.855 INFO:tasks.workunit.client.0.smithi044.stdout:4/219: truncate dd/f34 2673244 0 2024-04-25T22:03:18.856 INFO:tasks.workunit.client.0.smithi044.stdout:5/226: symlink d2/d5/d21/d26/l46 0 2024-04-25T22:03:18.856 INFO:tasks.workunit.client.0.smithi044.stdout:4/220: rmdir dd/d35 39 2024-04-25T22:03:18.857 INFO:tasks.workunit.client.0.smithi044.stdout:6/355: dwrite d2/d23/d5a/f62 [0,4194304] 0 2024-04-25T22:03:18.858 INFO:tasks.workunit.client.0.smithi044.stdout:5/227: fdatasync d2/d5/f1f 0 2024-04-25T22:03:18.858 INFO:tasks.workunit.client.0.smithi044.stdout:4/221: truncate dd/d35/f4a 691416 0 2024-04-25T22:03:18.858 INFO:tasks.workunit.client.0.smithi044.stdout:6/356: creat d2/d23/d5a/d11/d3b/f7e x:0 0 0 2024-04-25T22:03:18.860 INFO:tasks.workunit.client.0.smithi044.stdout:6/357: write d2/d23/d5a/d11/f21 [461513,51365] 0 2024-04-25T22:03:18.860 INFO:tasks.workunit.client.0.smithi044.stdout:8/388: dread fd [0,4194304] 0 2024-04-25T22:03:18.860 INFO:tasks.workunit.client.0.smithi044.stdout:4/222: write dd/d19/f50 [935790,43681] 0 2024-04-25T22:03:18.862 INFO:tasks.workunit.client.0.smithi044.stdout:7/200: sync 2024-04-25T22:03:18.862 INFO:tasks.workunit.client.0.smithi044.stdout:8/389: creat d2a/d39/d42/d68/d6b/f7c x:0 0 0 2024-04-25T22:03:18.864 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.864 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.775523394, 2024-04-25T22:03:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.865 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.765522631, 2024-04-25T22:03:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:18.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:18.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:18.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.877 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.761358356999999, 2024-04-25T22:03:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:18.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:18.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:18.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:18.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.759762039999998, 2024-04-25T22:03:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.884 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:18.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:18.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:18.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.70297579, 2024-04-25T22:03:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.889 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:18.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.687331524000001, 2024-04-25T22:03:18.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:18.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.682492833000001, 2024-04-25T22:03:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.901 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:18.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:18.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:178 3.1e 3:7bf7e7b5:::200.00000006:head [write 1096809~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681133+0000", 2024-04-25T22:03:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.179935350999999, 2024-04-25T22:03:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099654375000000003, 2024-04-25T22:03:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.907 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681133+0000", 2024-04-25T22:03:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681133+0000", 2024-04-25T22:03:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681134+0000", 2024-04-25T22:03:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2699999999999999e-07 2024-04-25T22:03:18.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681139+0000", 2024-04-25T22:03:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.276e-06 2024-04-25T22:03:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681148+0000", 2024-04-25T22:03:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8130000000000002e-06 2024-04-25T22:03:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681155+0000", 2024-04-25T22:03:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0859999999999996e-06 2024-04-25T22:03:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.774610+0000", 2024-04-25T22:03:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.093455287999999997 2024-04-25T22:03:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.774856+0000", 2024-04-25T22:03:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000245772 2024-04-25T22:03:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.775244+0000", 2024-04-25T22:03:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038779599999999998 2024-04-25T22:03:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779955+0000", 2024-04-25T22:03:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047115910000000002 2024-04-25T22:03:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780656+0000", 2024-04-25T22:03:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070111200000000005 2024-04-25T22:03:18.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780733+0000", 2024-04-25T22:03:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6601999999999996e-05 2024-04-25T22:03:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780787+0000", 2024-04-25T22:03:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4311999999999998e-05 2024-04-25T22:03:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:179 3.1e 3:7bf7e7b5:::200.00000006:head [write 1098209~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681170+0000", 2024-04-25T22:03:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.179898594999999, 2024-04-25T22:03:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.099820701999999997, 2024-04-25T22:03:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681170+0000", 2024-04-25T22:03:18.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681170+0000", 2024-04-25T22:03:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681171+0000", 2024-04-25T22:03:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4e-07 2024-04-25T22:03:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681175+0000", 2024-04-25T22:03:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7330000000000003e-06 2024-04-25T22:03:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681185+0000", 2024-04-25T22:03:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2730000000000008e-06 2024-04-25T22:03:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681192+0000", 2024-04-25T22:03:18.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3000000000000004e-06 2024-04-25T22:03:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.776664+0000", 2024-04-25T22:03:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095471850999999996 2024-04-25T22:03:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.776895+0000", 2024-04-25T22:03:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023155199999999999 2024-04-25T22:03:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.777244+0000", 2024-04-25T22:03:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034912300000000001 2024-04-25T22:03:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779962+0000", 2024-04-25T22:03:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027177870000000002 2024-04-25T22:03:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780870+0000", 2024-04-25T22:03:18.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00090743499999999995 2024-04-25T22:03:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780939+0000", 2024-04-25T22:03:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9678999999999995e-05 2024-04-25T22:03:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.780990+0000", 2024-04-25T22:03:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1128999999999998e-05 2024-04-25T22:03:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:180 3.1e 3:7bf7e7b5:::200.00000006:head [write 1099615~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-25T22:03:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:04.681201+0000", 2024-04-25T22:03:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.179867078999999, 2024-04-25T22:03:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.100014121, 2024-04-25T22:03:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681201+0000", 2024-04-25T22:03:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681201+0000", 2024-04-25T22:03:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681202+0000", 2024-04-25T22:03:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2600000000000001e-07 2024-04-25T22:03:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681206+0000", 2024-04-25T22:03:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7799999999999998e-06 2024-04-25T22:03:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681215+0000", 2024-04-25T22:03:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7630000000000006e-06 2024-04-25T22:03:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.681222+0000", 2024-04-25T22:03:18.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0740000000000004e-06 2024-04-25T22:03:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778720+0000", 2024-04-25T22:03:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.097498243999999998 2024-04-25T22:03:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.778839+0000", 2024-04-25T22:03:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011882799999999999 2024-04-25T22:03:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.779028+0000", 2024-04-25T22:03:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018962300000000001 2024-04-25T22:03:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781006+0000", 2024-04-25T22:03:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019778640000000002 2024-04-25T22:03:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781093+0000", 2024-04-25T22:03:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6802e-05 2024-04-25T22:03:18.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781164+0000", 2024-04-25T22:03:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0925000000000003e-05 2024-04-25T22:03:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:04.781215+0000", 2024-04-25T22:03:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1391999999999999e-05 2024-04-25T22:03:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10648 4.33 4:cc614d18:::100000030cb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.323889522, 2024-04-25T22:03:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13001143300000001, 2024-04-25T22:03:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10648 2024-04-25T22:03:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.925 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537181+0000", 2024-04-25T22:03:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.782e-06 2024-04-25T22:03:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541681+0000", 2024-04-25T22:03:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045008460000000002 2024-04-25T22:03:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541692+0000", 2024-04-25T22:03:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0726e-05 2024-04-25T22:03:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541698+0000", 2024-04-25T22:03:18.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-04-25T22:03:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541771+0000", 2024-04-25T22:03:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3070000000000003e-05 2024-04-25T22:03:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542021+0000", 2024-04-25T22:03:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025059799999999999 2024-04-25T22:03:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542246+0000", 2024-04-25T22:03:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022471000000000001 2024-04-25T22:03:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.579359+0000", 2024-04-25T22:03:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037113211 2024-04-25T22:03:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667067+0000", 2024-04-25T22:03:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087707255999999997 2024-04-25T22:03:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667134+0000", 2024-04-25T22:03:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7862999999999997e-05 2024-04-25T22:03:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667190+0000", 2024-04-25T22:03:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5698000000000001e-05 2024-04-25T22:03:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10651 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.2641137440000003, 2024-04-25T22:03:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11324606800000001, 2024-04-25T22:03:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10651 2024-04-25T22:03:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596957+0000", 2024-04-25T22:03:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-04-25T22:03:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601272+0000", 2024-04-25T22:03:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004314834 2024-04-25T22:03:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601291+0000", 2024-04-25T22:03:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9380000000000001e-05 2024-04-25T22:03:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601302+0000", 2024-04-25T22:03:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0416e-05 2024-04-25T22:03:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.603978+0000", 2024-04-25T22:03:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026763109999999998 2024-04-25T22:03:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604327+0000", 2024-04-25T22:03:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034881099999999998 2024-04-25T22:03:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604571+0000", 2024-04-25T22:03:18.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024436100000000001 2024-04-25T22:03:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644439+0000", 2024-04-25T22:03:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039868270999999997 2024-04-25T22:03:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710091+0000", 2024-04-25T22:03:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.065651910999999993 2024-04-25T22:03:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710144+0000", 2024-04-25T22:03:18.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2444999999999997e-05 2024-04-25T22:03:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710201+0000", 2024-04-25T22:03:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6839999999999998e-05 2024-04-25T22:03:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10654 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.2542868809999996, 2024-04-25T22:03:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.103958778, 2024-04-25T22:03:18.936 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10654 2024-04-25T22:03:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606782+0000", 2024-04-25T22:03:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1699999999999999e-07 2024-04-25T22:03:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611155+0000", 2024-04-25T22:03:18.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043728580000000003 2024-04-25T22:03:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611173+0000", 2024-04-25T22:03:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8267e-05 2024-04-25T22:03:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611183+0000", 2024-04-25T22:03:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9250000000000007e-06 2024-04-25T22:03:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644642+0000", 2024-04-25T22:03:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033458976000000001 2024-04-25T22:03:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644739+0000", 2024-04-25T22:03:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7189999999999996e-05 2024-04-25T22:03:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644864+0000", 2024-04-25T22:03:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000124867 2024-04-25T22:03:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.672556+0000", 2024-04-25T22:03:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027691653 2024-04-25T22:03:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710668+0000", 2024-04-25T22:03:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038111956000000002 2024-04-25T22:03:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710703+0000", 2024-04-25T22:03:18.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5577000000000002e-05 2024-04-25T22:03:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710740+0000", 2024-04-25T22:03:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7092000000000003e-05 2024-04-25T22:03:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11078 4.4 4:22be2a9e:::10000003224.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:18.942 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.85716026000000001, 2024-04-25T22:03:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.112294177, 2024-04-25T22:03:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11078 2024-04-25T22:03:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003909+0000", 2024-04-25T22:03:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2750000000000001e-06 2024-04-25T22:03:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009939+0000", 2024-04-25T22:03:18.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060293309999999998 2024-04-25T22:03:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009961+0000", 2024-04-25T22:03:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1889999999999999e-05 2024-04-25T22:03:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009976+0000", 2024-04-25T22:03:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5642e-05 2024-04-25T22:03:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042803+0000", 2024-04-25T22:03:18.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032827299999999997 2024-04-25T22:03:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042911+0000", 2024-04-25T22:03:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107747 2024-04-25T22:03:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042990+0000", 2024-04-25T22:03:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8832999999999996e-05 2024-04-25T22:03:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.088710+0000", 2024-04-25T22:03:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045720129999999998 2024-04-25T22:03:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116108+0000", 2024-04-25T22:03:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027397388000000002 2024-04-25T22:03:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116164+0000", 2024-04-25T22:03:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6283000000000003e-05 2024-04-25T22:03:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116202+0000", 2024-04-25T22:03:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8358000000000001e-05 2024-04-25T22:03:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11080 4.1c 4:38b085a0:::1000000320b.00000000:head [write 0~3407872] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.018498+0000", 2024-04-25T22:03:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.84257043799999998, 2024-04-25T22:03:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.100973307, 2024-04-25T22:03:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11080 2024-04-25T22:03:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.018498+0000", 2024-04-25T22:03:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.018498+0000", 2024-04-25T22:03:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.018500+0000", 2024-04-25T22:03:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1880000000000001e-06 2024-04-25T22:03:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.023241+0000", 2024-04-25T22:03:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047406280000000002 2024-04-25T22:03:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.023264+0000", 2024-04-25T22:03:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.285e-05 2024-04-25T22:03:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.023275+0000", 2024-04-25T22:03:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1094000000000001e-05 2024-04-25T22:03:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042832+0000", 2024-04-25T22:03:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019557801 2024-04-25T22:03:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042960+0000", 2024-04-25T22:03:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012794 2024-04-25T22:03:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.043075+0000", 2024-04-25T22:03:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011514399999999999 2024-04-25T22:03:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.070765+0000", 2024-04-25T22:03:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027689028000000001 2024-04-25T22:03:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.119371+0000", 2024-04-25T22:03:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048606308000000001 2024-04-25T22:03:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.119430+0000", 2024-04-25T22:03:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9083999999999999e-05 2024-04-25T22:03:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.119471+0000", 2024-04-25T22:03:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1242000000000003e-05 2024-04-25T22:03:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11195 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.64379814300000004, 2024-04-25T22:03:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1095062, 2024-04-25T22:03:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.954 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11195 2024-04-25T22:03:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217272+0000", 2024-04-25T22:03:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.533e-06 2024-04-25T22:03:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217385+0000", 2024-04-25T22:03:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113533 2024-04-25T22:03:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217396+0000", 2024-04-25T22:03:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0682e-05 2024-04-25T22:03:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217402+0000", 2024-04-25T22:03:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:03:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238476+0000", 2024-04-25T22:03:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021073312 2024-04-25T22:03:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238558+0000", 2024-04-25T22:03:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2193000000000004e-05 2024-04-25T22:03:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238695+0000", 2024-04-25T22:03:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013737800000000001 2024-04-25T22:03:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292860+0000", 2024-04-25T22:03:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054165224999999997 2024-04-25T22:03:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326638+0000", 2024-04-25T22:03:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033777517999999999 2024-04-25T22:03:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326686+0000", 2024-04-25T22:03:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8062000000000002e-05 2024-04-25T22:03:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326776+0000", 2024-04-25T22:03:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0393e-05 2024-04-25T22:03:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.959 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11197 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3195543~33670] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.64365615899999995, 2024-04-25T22:03:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953929499999999, 2024-04-25T22:03:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.960 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11197 2024-04-25T22:03:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217413+0000", 2024-04-25T22:03:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5600000000000005e-07 2024-04-25T22:03:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217445+0000", 2024-04-25T22:03:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2240999999999998e-05 2024-04-25T22:03:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217453+0000", 2024-04-25T22:03:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6070000000000002e-06 2024-04-25T22:03:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217458+0000", 2024-04-25T22:03:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3630000000000002e-06 2024-04-25T22:03:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240891+0000", 2024-04-25T22:03:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023432637999999999 2024-04-25T22:03:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240990+0000", 2024-04-25T22:03:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8995999999999999e-05 2024-04-25T22:03:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241123+0000", 2024-04-25T22:03:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013371699999999999 2024-04-25T22:03:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292866+0000", 2024-04-25T22:03:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051742332000000002 2024-04-25T22:03:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326849+0000", 2024-04-25T22:03:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033983140000000002 2024-04-25T22:03:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326908+0000", 2024-04-25T22:03:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8842999999999999e-05 2024-04-25T22:03:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326951+0000", 2024-04-25T22:03:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3761999999999999e-05 2024-04-25T22:03:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11198 4.4 4:22c4fea3:::10000003262.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.6436018, 2024-04-25T22:03:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12381273600000001, 2024-04-25T22:03:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11198 2024-04-25T22:03:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217467+0000", 2024-04-25T22:03:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4499999999999997e-07 2024-04-25T22:03:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225449+0000", 2024-04-25T22:03:18.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079819439999999995 2024-04-25T22:03:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225466+0000", 2024-04-25T22:03:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6602000000000001e-05 2024-04-25T22:03:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225477+0000", 2024-04-25T22:03:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1603000000000001e-05 2024-04-25T22:03:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240866+0000", 2024-04-25T22:03:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015388389000000001 2024-04-25T22:03:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241081+0000", 2024-04-25T22:03:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021577400000000001 2024-04-25T22:03:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241212+0000", 2024-04-25T22:03:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013073499999999999 2024-04-25T22:03:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292876+0000", 2024-04-25T22:03:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051663584999999998 2024-04-25T22:03:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341159+0000", 2024-04-25T22:03:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048283421999999999 2024-04-25T22:03:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341222+0000", 2024-04-25T22:03:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:03:18.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341279+0000", 2024-04-25T22:03:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6780999999999997e-05 2024-04-25T22:03:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11207 4.4 4:233f6309:::10000003211.00000000:head [write 659836~128648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:18.971 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.62698380300000001, 2024-04-25T22:03:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10732727, 2024-04-25T22:03:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11207 2024-04-25T22:03:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:18.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234085+0000", 2024-04-25T22:03:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0399999999999995e-07 2024-04-25T22:03:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234550+0000", 2024-04-25T22:03:18.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000464909 2024-04-25T22:03:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234561+0000", 2024-04-25T22:03:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0744000000000001e-05 2024-04-25T22:03:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234569+0000", 2024-04-25T22:03:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6890000000000004e-06 2024-04-25T22:03:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267197+0000", 2024-04-25T22:03:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032628182999999998 2024-04-25T22:03:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267297+0000", 2024-04-25T22:03:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100222 2024-04-25T22:03:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267393+0000", 2024-04-25T22:03:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6275999999999998e-05 2024-04-25T22:03:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292880+0000", 2024-04-25T22:03:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025487058999999999 2024-04-25T22:03:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341326+0000", 2024-04-25T22:03:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048446031000000001 2024-04-25T22:03:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341374+0000", 2024-04-25T22:03:18.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7632000000000001e-05 2024-04-25T22:03:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341412+0000", 2024-04-25T22:03:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7821000000000003e-05 2024-04-25T22:03:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11219 4.4 4:210cd53e:::100000031ff.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:18.977 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.60803459299999996, 2024-04-25T22:03:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13181403, 2024-04-25T22:03:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11219 2024-04-25T22:03:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:18.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253035+0000", 2024-04-25T22:03:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.322e-06 2024-04-25T22:03:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258145+0000", 2024-04-25T22:03:18.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051095669999999998 2024-04-25T22:03:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258163+0000", 2024-04-25T22:03:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8377999999999999e-05 2024-04-25T22:03:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258174+0000", 2024-04-25T22:03:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0925e-05 2024-04-25T22:03:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:18.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270495+0000", 2024-04-25T22:03:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012321354 2024-04-25T22:03:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270581+0000", 2024-04-25T22:03:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5741999999999993e-05 2024-04-25T22:03:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270717+0000", 2024-04-25T22:03:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013571500000000001 2024-04-25T22:03:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326599+0000", 2024-04-25T22:03:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055882026000000001 2024-04-25T22:03:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384753+0000", 2024-04-25T22:03:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058154527999999997 2024-04-25T22:03:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384805+0000", 2024-04-25T22:03:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1592999999999999e-05 2024-04-25T22:03:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:18.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384848+0000", 2024-04-25T22:03:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2880000000000003e-05 2024-04-25T22:03:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:18.983 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:18.983 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:18.984 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:03:18.984 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:03:18.984 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-04-25T22:03:18.984 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2024-04-25T22:03:18.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:18.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:18.981+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:18.998 INFO:tasks.workunit.client.0.smithi044.stdout:8/390: chown d2a/d39/f5c 0 1 2024-04-25T22:03:18.998 INFO:tasks.workunit.client.0.smithi044.stdout:4/223: dread dd/d19/f1d [0,4194304] 0 2024-04-25T22:03:18.998 INFO:tasks.workunit.client.0.smithi044.stdout:7/201: creat d1c/d22/d28/d30/d32/d33/f3e x:0 0 0 2024-04-25T22:03:18.998 INFO:tasks.workunit.client.0.smithi044.stdout:8/391: mknod d2a/d39/c7d 0 2024-04-25T22:03:18.998 INFO:tasks.workunit.client.0.smithi044.stdout:4/224: rmdir dd 39 2024-04-25T22:03:18.998 INFO:tasks.workunit.client.0.smithi044.stdout:1/321: dwrite d3/d7/db/f3c [0,4194304] 0 2024-04-25T22:03:18.998 INFO:tasks.workunit.client.0.smithi044.stdout:8/392: dread - d2a/d32/d3e/f54 zero size 2024-04-25T22:03:18.998 INFO:tasks.workunit.client.0.smithi044.stdout:7/202: write d1c/d22/d28/f3d [79338,21992] 0 2024-04-25T22:03:18.999 INFO:tasks.workunit.client.0.smithi044.stdout:5/228: dwrite d2/d5/f2f [0,4194304] 0 2024-04-25T22:03:18.999 INFO:tasks.workunit.client.0.smithi044.stdout:7/203: read - d1c/d22/f34 zero size 2024-04-25T22:03:18.999 INFO:tasks.workunit.client.0.smithi044.stdout:1/322: mknod d3/d7/d29/d50/c66 0 2024-04-25T22:03:18.999 INFO:tasks.workunit.client.0.smithi044.stdout:8/393: dread d2a/f45 [0,4194304] 0 2024-04-25T22:03:18.999 INFO:tasks.workunit.client.0.smithi044.stdout:8/394: symlink d2a/d32/l7e 0 2024-04-25T22:03:18.999 INFO:tasks.workunit.client.0.smithi044.stdout:8/395: fdatasync d2a/f36 0 2024-04-25T22:03:18.999 INFO:tasks.workunit.client.0.smithi044.stdout:8/396: symlink d2a/d77/l7f 0 2024-04-25T22:03:18.999 INFO:tasks.workunit.client.0.smithi044.stdout:8/397: write d2a/d32/f5d [5791020,71602] 0 2024-04-25T22:03:18.999 INFO:tasks.workunit.client.0.smithi044.stdout:8/398: mkdir d2a/d39/d42/d80 0 2024-04-25T22:03:18.999 INFO:tasks.workunit.client.0.smithi044.stdout:8/399: symlink d2a/d39/d42/d68/d6b/d7b/l81 0 2024-04-25T22:03:18.999 INFO:tasks.workunit.client.0.smithi044.stdout:6/358: dread d2/d23/d5a/d13/f36 [0,4194304] 0 2024-04-25T22:03:18.999 INFO:tasks.workunit.client.0.smithi044.stdout:6/359: chown d2/c7 112 1 2024-04-25T22:03:18.999 INFO:tasks.workunit.client.0.smithi044.stdout:6/360: mkdir d2/d23/d5a/d12/d49/d7f 0 2024-04-25T22:03:18.999 INFO:tasks.workunit.client.0.smithi044.stdout:6/361: creat d2/d23/d5a/d11/d2a/f80 x:0 0 0 2024-04-25T22:03:18.999 INFO:tasks.workunit.client.0.smithi044.stdout:5/229: getdents d2/d5/d21/d26 0 2024-04-25T22:03:18.999 INFO:tasks.workunit.client.0.smithi044.stdout:5/230: write d2/d5/f18 [4503032,61570] 0 2024-04-25T22:03:19.000 INFO:tasks.workunit.client.0.smithi044.stdout:5/231: unlink d2/d5/d27/d2a/d3a/c44 0 2024-04-25T22:03:19.000 INFO:tasks.workunit.client.0.smithi044.stdout:5/232: dread - d2/d35/f45 zero size 2024-04-25T22:03:19.000 INFO:tasks.workunit.client.0.smithi044.stdout:5/233: symlink d2/d5/d27/l47 0 2024-04-25T22:03:19.000 INFO:tasks.workunit.client.0.smithi044.stdout:5/234: readlink d2/d5/l33 0 2024-04-25T22:03:19.000 INFO:tasks.workunit.client.0.smithi044.stdout:5/235: mkdir d2/d5/d27/d2a/d48 0 2024-04-25T22:03:19.000 INFO:tasks.workunit.client.0.smithi044.stdout:5/236: creat d2/d5/d21/f49 x:0 0 0 2024-04-25T22:03:19.000 INFO:tasks.workunit.client.0.smithi044.stdout:5/237: fsync d2/d5/f2f 0 2024-04-25T22:03:19.000 INFO:tasks.workunit.client.0.smithi044.stdout:6/362: dread d2/d23/d5a/d12/f19 [0,4194304] 0 2024-04-25T22:03:19.000 INFO:tasks.workunit.client.0.smithi044.stdout:6/363: rmdir d2/d23/d5a/d12/d49/d77 0 2024-04-25T22:03:19.000 INFO:tasks.workunit.client.0.smithi044.stdout:6/364: dread d2/d23/d5a/d12/d27/f31 [0,4194304] 0 2024-04-25T22:03:19.000 INFO:tasks.workunit.client.0.smithi044.stdout:6/365: symlink d2/d23/d5a/d13/d4b/l81 0 2024-04-25T22:03:19.000 INFO:tasks.workunit.client.0.smithi044.stdout:5/238: dread d2/d5/f9 [0,4194304] 0 2024-04-25T22:03:19.000 INFO:tasks.workunit.client.0.smithi044.stdout:5/239: write d2/d5/f41 [457741,124067] 0 2024-04-25T22:03:19.000 INFO:tasks.workunit.client.0.smithi044.stdout:5/240: dwrite d2/d5/f2f [0,4194304] 0 2024-04-25T22:03:19.000 INFO:tasks.workunit.client.0.smithi044.stdout:5/241: creat d2/d35/f4a x:0 0 0 2024-04-25T22:03:19.001 INFO:tasks.workunit.client.0.smithi044.stdout:5/242: write d2/f24 [3412768,110794] 0 2024-04-25T22:03:19.001 INFO:tasks.workunit.client.0.smithi044.stdout:5/243: rename d2/c2b to d2/d5/d21/c4b 0 2024-04-25T22:03:19.001 INFO:tasks.workunit.client.0.smithi044.stdout:5/244: creat d2/d5/d21/d26/d2c/f4c x:0 0 0 2024-04-25T22:03:19.001 INFO:tasks.workunit.client.0.smithi044.stdout:5/245: truncate d2/d5/f18 2363879 0 2024-04-25T22:03:19.001 INFO:tasks.workunit.client.0.smithi044.stdout:3/301: sync 2024-04-25T22:03:19.001 INFO:tasks.workunit.client.0.smithi044.stdout:0/292: sync 2024-04-25T22:03:19.001 INFO:tasks.workunit.client.0.smithi044.stdout:9/356: sync 2024-04-25T22:03:19.001 INFO:tasks.workunit.client.0.smithi044.stdout:0/293: readlink d8/df/d17/d45/l47 0 2024-04-25T22:03:19.001 INFO:tasks.workunit.client.0.smithi044.stdout:0/294: fsync d8/f11 0 2024-04-25T22:03:19.001 INFO:tasks.workunit.client.0.smithi044.stdout:3/302: mkdir d0/d1/d15/d23/d60 0 2024-04-25T22:03:19.001 INFO:tasks.workunit.client.0.smithi044.stdout:9/357: rename d4/d7/d18/d2e/d73/f75 to d4/d37/f7b 0 2024-04-25T22:03:19.001 INFO:tasks.workunit.client.0.smithi044.stdout:9/358: creat d4/d7/d18/d2e/d73/f7c x:0 0 0 2024-04-25T22:03:19.001 INFO:tasks.workunit.client.0.smithi044.stdout:3/303: rename d0/f20 to d0/d1/d15/d51/dd/f61 0 2024-04-25T22:03:19.002 INFO:tasks.workunit.client.0.smithi044.stdout:3/304: fdatasync d0/f38 0 2024-04-25T22:03:19.002 INFO:tasks.workunit.client.0.smithi044.stdout:9/359: chown d4/d7/d18/d2d/f51 42312771 1 2024-04-25T22:03:19.002 INFO:tasks.workunit.client.0.smithi044.stdout:9/360: write d4/f57 [363292,96919] 0 2024-04-25T22:03:19.002 INFO:tasks.workunit.client.0.smithi044.stdout:3/305: symlink d0/d1/d15/df/d5d/l62 0 2024-04-25T22:03:19.002 INFO:tasks.workunit.client.0.smithi044.stdout:3/306: stat d0/d1/d15/df/d5d/l62 0 2024-04-25T22:03:19.002 INFO:tasks.workunit.client.0.smithi044.stdout:5/246: dwrite d2/d35/f45 [0,4194304] 0 2024-04-25T22:03:19.002 INFO:tasks.workunit.client.0.smithi044.stdout:5/247: fsync d2/d5/d27/d2a/f30 0 2024-04-25T22:03:19.002 INFO:tasks.workunit.client.0.smithi044.stdout:0/295: dwrite d8/d15/f2e [0,4194304] 0 2024-04-25T22:03:19.002 INFO:tasks.workunit.client.0.smithi044.stdout:9/361: fsync d4/d7/d18/d2e/d73/f7c 0 2024-04-25T22:03:19.002 INFO:tasks.workunit.client.0.smithi044.stdout:3/307: getdents d0 0 2024-04-25T22:03:19.002 INFO:tasks.workunit.client.0.smithi044.stdout:5/248: getdents d2 0 2024-04-25T22:03:19.002 INFO:tasks.workunit.client.0.smithi044.stdout:9/362: creat d4/d7/d79/f7d x:0 0 0 2024-04-25T22:03:19.002 INFO:tasks.workunit.client.0.smithi044.stdout:3/308: symlink d0/d1/d15/d51/dd/d28/l63 0 2024-04-25T22:03:19.002 INFO:tasks.workunit.client.0.smithi044.stdout:5/249: truncate d2/d5/d27/d2a/f42 583666 0 2024-04-25T22:03:19.002 INFO:tasks.workunit.client.0.smithi044.stdout:9/363: write d4/d7/d18/d3a/f5f [5233335,85579] 0 2024-04-25T22:03:19.003 INFO:tasks.workunit.client.0.smithi044.stdout:5/250: creat d2/d5/d21/d26/d2c/d37/f4d x:0 0 0 2024-04-25T22:03:19.003 INFO:tasks.workunit.client.0.smithi044.stdout:9/364: rename d4/d7/d79/f7d to d4/d7/d79/f7e 0 2024-04-25T22:03:19.003 INFO:tasks.workunit.client.0.smithi044.stdout:9/365: write d4/d5e/d64/f65 [1534,122249] 0 2024-04-25T22:03:19.003 INFO:tasks.workunit.client.0.smithi044.stdout:5/251: write d2/d5/d21/d26/d2c/f4c [366807,91681] 0 2024-04-25T22:03:19.003 INFO:tasks.workunit.client.0.smithi044.stdout:9/366: fdatasync d4/d3d/f68 0 2024-04-25T22:03:19.003 INFO:tasks.workunit.client.0.smithi044.stdout:0/296: dwrite d8/f11 [4194304,4194304] 0 2024-04-25T22:03:19.003 INFO:tasks.workunit.client.0.smithi044.stdout:9/367: chown d4/d37/l5b 3324 1 2024-04-25T22:03:19.003 INFO:tasks.workunit.client.0.smithi044.stdout:5/252: rmdir d2/d5/d21/d26/d2c/d37 39 2024-04-25T22:03:19.003 INFO:tasks.workunit.client.0.smithi044.stdout:0/297: symlink d8/da/d55/l67 0 2024-04-25T22:03:19.003 INFO:tasks.workunit.client.0.smithi044.stdout:5/253: readlink d2/d5/lc 0 2024-04-25T22:03:19.003 INFO:tasks.workunit.client.0.smithi044.stdout:0/298: rename d8/f18 to d8/f68 0 2024-04-25T22:03:19.003 INFO:tasks.workunit.client.0.smithi044.stdout:0/299: symlink d8/df/d17/d45/l69 0 2024-04-25T22:03:19.003 INFO:tasks.workunit.client.0.smithi044.stdout:9/368: dwrite d4/d7/d18/d2d/f51 [0,4194304] 0 2024-04-25T22:03:19.003 INFO:tasks.workunit.client.0.smithi044.stdout:5/254: truncate d2/d5/f16 2602049 0 2024-04-25T22:03:19.004 INFO:tasks.workunit.client.0.smithi044.stdout:0/300: dread d8/d24/f26 [0,4194304] 0 2024-04-25T22:03:19.004 INFO:tasks.workunit.client.0.smithi044.stdout:5/255: write d2/d5/f9 [1874473,11202] 0 2024-04-25T22:03:19.004 INFO:tasks.workunit.client.0.smithi044.stdout:0/301: rename d8/df/f29 to d8/d20/f6a 0 2024-04-25T22:03:19.004 INFO:tasks.workunit.client.0.smithi044.stdout:3/309: dread d0/d1/d15/d51/dd/d35/d36/f45 [0,4194304] 0 2024-04-25T22:03:19.004 INFO:tasks.workunit.client.0.smithi044.stdout:0/302: chown d8/df/d17/f33 464 1 2024-04-25T22:03:19.004 INFO:tasks.workunit.client.0.smithi044.stdout:0/303: chown d8/da/d55/f5c 90651175 1 2024-04-25T22:03:19.004 INFO:tasks.workunit.client.0.smithi044.stdout:3/310: mknod d0/d1/d15/d23/c64 0 2024-04-25T22:03:19.004 INFO:tasks.workunit.client.0.smithi044.stdout:0/304: truncate d8/d15/f30 741089 0 2024-04-25T22:03:19.004 INFO:tasks.workunit.client.0.smithi044.stdout:5/256: dwrite d2/d5/d21/d26/d2c/f4c [0,4194304] 0 2024-04-25T22:03:19.004 INFO:tasks.workunit.client.0.smithi044.stdout:5/257: chown d2/d5/f39 483 1 2024-04-25T22:03:19.004 INFO:tasks.workunit.client.0.smithi044.stdout:5/258: chown d2/f24 235496426 1 2024-04-25T22:03:19.004 INFO:tasks.workunit.client.0.smithi044.stdout:3/311: dwrite d0/d1/d15/d51/dd/d28/f53 [0,4194304] 0 2024-04-25T22:03:19.004 INFO:tasks.workunit.client.0.smithi044.stdout:5/259: dwrite d2/d5/d21/d26/d2c/d37/f4d [0,4194304] 0 2024-04-25T22:03:19.004 INFO:tasks.workunit.client.0.smithi044.stdout:5/260: truncate d2/d5/d21/f2d 397346 0 2024-04-25T22:03:19.004 INFO:tasks.workunit.client.0.smithi044.stdout:5/261: fsync d2/d5/f39 0 2024-04-25T22:03:19.005 INFO:tasks.workunit.client.0.smithi044.stdout:5/262: mknod d2/d5/d27/c4e 0 2024-04-25T22:03:19.005 INFO:tasks.workunit.client.0.smithi044.stdout:5/263: write d2/f3c [1579852,102629] 0 2024-04-25T22:03:19.005 INFO:tasks.workunit.client.0.smithi044.stdout:5/264: dread d2/d35/f45 [0,4194304] 0 2024-04-25T22:03:19.005 INFO:tasks.workunit.client.0.smithi044.stdout:5/265: link d2/d35/f3f d2/d5/d27/d2a/d48/f4f 0 2024-04-25T22:03:19.005 INFO:tasks.workunit.client.0.smithi044.stdout:5/266: chown d2/f19 570092 1 2024-04-25T22:03:19.005 INFO:tasks.workunit.client.0.smithi044.stdout:5/267: mknod d2/d35/c50 0 2024-04-25T22:03:19.005 INFO:tasks.workunit.client.0.smithi044.stdout:5/268: write d2/d5/f17 [4558134,79600] 0 2024-04-25T22:03:19.005 INFO:tasks.workunit.client.0.smithi044.stdout:5/269: fsync d2/d5/f1f 0 2024-04-25T22:03:19.005 INFO:tasks.workunit.client.0.smithi044.stdout:5/270: truncate d2/d5/d21/d26/d2c/f34 1268161 0 2024-04-25T22:03:19.005 INFO:tasks.workunit.client.0.smithi044.stdout:5/271: creat d2/d5/d27/f51 x:0 0 0 2024-04-25T22:03:19.007 INFO:tasks.workunit.client.0.smithi044.stdout:5/272: mkdir d2/d5/d21/d38/d52 0 2024-04-25T22:03:19.007 INFO:tasks.workunit.client.0.smithi044.stdout:5/273: rmdir d2 39 2024-04-25T22:03:19.007 INFO:tasks.workunit.client.0.smithi044.stdout:5/274: creat d2/d5/d21/d38/f53 x:0 0 0 2024-04-25T22:03:19.007 INFO:tasks.workunit.client.0.smithi044.stdout:5/275: symlink d2/d5/d27/d2a/d48/l54 0 2024-04-25T22:03:19.007 INFO:tasks.workunit.client.0.smithi044.stdout:5/276: write d2/d5/d27/d2a/d48/f4f [767883,83135] 0 2024-04-25T22:03:19.007 INFO:tasks.workunit.client.0.smithi044.stdout:9/369: dread d4/f1a [0,4194304] 0 2024-04-25T22:03:19.007 INFO:tasks.workunit.client.0.smithi044.stdout:0/305: dread d8/d20/f31 [0,4194304] 0 2024-04-25T22:03:19.007 INFO:tasks.workunit.client.0.smithi044.stdout:9/370: creat d4/f7f x:0 0 0 2024-04-25T22:03:19.007 INFO:tasks.workunit.client.0.smithi044.stdout:9/371: write d4/d7/d18/f7a [436866,14230] 0 2024-04-25T22:03:19.008 INFO:tasks.workunit.client.0.smithi044.stdout:5/277: dwrite d2/d5/f41 [0,4194304] 0 2024-04-25T22:03:19.010 INFO:tasks.workunit.client.0.smithi044.stdout:0/306: dwrite d8/f9 [0,4194304] 0 2024-04-25T22:03:19.012 INFO:tasks.workunit.client.0.smithi044.stdout:9/372: dread d4/d3d/f68 [0,4194304] 0 2024-04-25T22:03:19.013 INFO:tasks.workunit.client.0.smithi044.stdout:9/373: write d4/d7/d18/d2d/f38 [2228538,123206] 0 2024-04-25T22:03:19.014 INFO:tasks.workunit.client.0.smithi044.stdout:0/307: unlink d8/d24/l5e 0 2024-04-25T22:03:19.015 INFO:tasks.workunit.client.0.smithi044.stdout:9/374: fsync d4/d7/f63 0 2024-04-25T22:03:19.015 INFO:tasks.workunit.client.0.smithi044.stdout:4/225: sync 2024-04-25T22:03:19.015 INFO:tasks.workunit.client.0.smithi044.stdout:1/323: sync 2024-04-25T22:03:19.015 INFO:tasks.workunit.client.0.smithi044.stdout:6/366: sync 2024-04-25T22:03:19.015 INFO:tasks.workunit.client.0.smithi044.stdout:2/295: sync 2024-04-25T22:03:19.015 INFO:tasks.workunit.client.0.smithi044.stdout:7/204: sync 2024-04-25T22:03:19.015 INFO:tasks.workunit.client.0.smithi044.stdout:8/400: sync 2024-04-25T22:03:19.018 INFO:tasks.workunit.client.0.smithi044.stdout:7/205: fdatasync d1c/d22/f25 0 2024-04-25T22:03:19.018 INFO:tasks.workunit.client.0.smithi044.stdout:4/226: dread - dd/d35/f3e zero size 2024-04-25T22:03:19.018 INFO:tasks.workunit.client.0.smithi044.stdout:6/367: mknod d2/d23/d5a/d11/d2a/c82 0 2024-04-25T22:03:19.018 INFO:tasks.workunit.client.0.smithi044.stdout:7/206: write d1c/f2f [484924,107110] 0 2024-04-25T22:03:19.018 INFO:tasks.workunit.client.0.smithi044.stdout:4/227: dread - dd/d35/f3e zero size 2024-04-25T22:03:19.019 INFO:tasks.workunit.client.0.smithi044.stdout:8/401: getdents d2a/d39/d42/d68/d6b 0 2024-04-25T22:03:19.019 INFO:tasks.workunit.client.0.smithi044.stdout:9/375: mknod d4/d5e/c80 0 2024-04-25T22:03:19.019 INFO:tasks.workunit.client.0.smithi044.stdout:7/207: symlink d1c/d22/d28/l3f 0 2024-04-25T22:03:19.019 INFO:tasks.workunit.client.0.smithi044.stdout:6/368: fsync d2/d23/d5a/d12/f19 0 2024-04-25T22:03:19.019 INFO:tasks.workunit.client.0.smithi044.stdout:7/208: mknod d1c/c40 0 2024-04-25T22:03:19.020 INFO:tasks.workunit.client.0.smithi044.stdout:8/402: mkdir d2a/d82 0 2024-04-25T22:03:19.020 INFO:tasks.workunit.client.0.smithi044.stdout:9/376: mknod d4/d7/d18/c81 0 2024-04-25T22:03:19.021 INFO:tasks.workunit.client.0.smithi044.stdout:7/209: creat d1c/d22/d28/f41 x:0 0 0 2024-04-25T22:03:19.021 INFO:tasks.workunit.client.0.smithi044.stdout:6/369: mknod d2/d23/d5a/d12/d49/c83 0 2024-04-25T22:03:19.022 INFO:tasks.workunit.client.0.smithi044.stdout:4/228: dread dd/f17 [0,4194304] 0 2024-04-25T22:03:19.022 INFO:tasks.workunit.client.0.smithi044.stdout:9/377: creat d4/d5e/d64/f82 x:0 0 0 2024-04-25T22:03:19.022 INFO:tasks.workunit.client.0.smithi044.stdout:8/403: symlink d2a/d39/d42/d68/d6b/d6e/l83 0 2024-04-25T22:03:19.024 INFO:tasks.workunit.client.0.smithi044.stdout:9/378: fdatasync d4/f40 0 2024-04-25T22:03:19.024 INFO:tasks.workunit.client.0.smithi044.stdout:6/370: truncate d2/d23/d5a/d13/d68/f50 528936 0 2024-04-25T22:03:19.024 INFO:tasks.workunit.client.0.smithi044.stdout:2/296: dwrite d7/f31 [0,4194304] 0 2024-04-25T22:03:19.024 INFO:tasks.workunit.client.0.smithi044.stdout:8/404: mkdir d2a/d39/d42/d68/d6b/d6e/d84 0 2024-04-25T22:03:19.028 INFO:tasks.workunit.client.0.smithi044.stdout:2/297: dread - d7/d16/f54 zero size 2024-04-25T22:03:19.028 INFO:tasks.workunit.client.0.smithi044.stdout:9/379: rename d4/d5e/d64/f65 to d4/d3d/d58/f83 0 2024-04-25T22:03:19.028 INFO:tasks.workunit.client.0.smithi044.stdout:8/405: write d2a/d32/d3e/f7a [929799,19781] 0 2024-04-25T22:03:19.028 INFO:tasks.workunit.client.0.smithi044.stdout:7/210: truncate d1c/f20 1654959 0 2024-04-25T22:03:19.028 INFO:tasks.workunit.client.0.smithi044.stdout:7/211: dread - d1c/f2c zero size 2024-04-25T22:03:19.030 INFO:tasks.workunit.client.0.smithi044.stdout:4/229: dwrite dd/d35/f47 [0,4194304] 0 2024-04-25T22:03:19.031 INFO:tasks.workunit.client.0.smithi044.stdout:4/230: truncate dd/f46 4490168 0 2024-04-25T22:03:19.032 INFO:tasks.workunit.client.0.smithi044.stdout:4/231: mkdir dd/d35/d52 0 2024-04-25T22:03:19.034 INFO:tasks.workunit.client.0.smithi044.stdout:7/212: dread d1c/d22/d28/f35 [0,4194304] 0 2024-04-25T22:03:19.034 INFO:tasks.workunit.client.0.smithi044.stdout:9/380: rename d4/d5e to d4/d37/d54/d84 0 2024-04-25T22:03:19.035 INFO:tasks.workunit.client.0.smithi044.stdout:2/298: rename d7/d16/d2d/d4e/d4c to d7/d8/d5f 0 2024-04-25T22:03:19.035 INFO:tasks.workunit.client.0.smithi044.stdout:7/213: creat d1c/d22/d28/d30/d32/f42 x:0 0 0 2024-04-25T22:03:19.036 INFO:tasks.workunit.client.0.smithi044.stdout:2/299: symlink d7/d16/d2d/d57/l60 0 2024-04-25T22:03:19.037 INFO:tasks.workunit.client.0.smithi044.stdout:8/406: truncate f23 462259 0 2024-04-25T22:03:19.037 INFO:tasks.workunit.client.0.smithi044.stdout:7/214: rmdir d1c/d22/d28/d30/d32/d33 39 2024-04-25T22:03:19.038 INFO:tasks.workunit.client.0.smithi044.stdout:8/407: mknod d2a/c85 0 2024-04-25T22:03:19.038 INFO:tasks.workunit.client.0.smithi044.stdout:2/300: truncate d7/d16/f17 2017813 0 2024-04-25T22:03:19.039 INFO:tasks.workunit.client.0.smithi044.stdout:4/232: dwrite dd/f4b [0,4194304] 0 2024-04-25T22:03:19.039 INFO:tasks.workunit.client.0.smithi044.stdout:8/408: write d2a/d39/f55 [4270548,4262] 0 2024-04-25T22:03:19.039 INFO:tasks.workunit.client.0.smithi044.stdout:7/215: getdents d1c/d22 0 2024-04-25T22:03:19.040 INFO:tasks.workunit.client.0.smithi044.stdout:2/301: creat d7/d16/d2c/f61 x:0 0 0 2024-04-25T22:03:19.042 INFO:tasks.workunit.client.0.smithi044.stdout:9/381: dwrite d4/f57 [0,4194304] 0 2024-04-25T22:03:19.045 INFO:tasks.workunit.client.0.smithi044.stdout:9/382: mknod d4/d37/d54/d84/d72/c85 0 2024-04-25T22:03:19.045 INFO:tasks.workunit.client.0.smithi044.stdout:5/278: dread d2/f24 [0,4194304] 0 2024-04-25T22:03:19.045 INFO:tasks.workunit.client.0.smithi044.stdout:8/409: write d2a/d32/f35 [920441,21516] 0 2024-04-25T22:03:19.046 INFO:tasks.workunit.client.0.smithi044.stdout:9/383: mkdir d4/d4b/d86 0 2024-04-25T22:03:19.047 INFO:tasks.workunit.client.0.smithi044.stdout:5/279: creat d2/d5/d27/d2a/d3a/f55 x:0 0 0 2024-04-25T22:03:19.048 INFO:tasks.workunit.client.0.smithi044.stdout:8/410: symlink d2a/d82/l86 0 2024-04-25T22:03:19.048 INFO:tasks.workunit.client.0.smithi044.stdout:9/384: fdatasync d4/f5c 0 2024-04-25T22:03:19.048 INFO:tasks.workunit.client.0.smithi044.stdout:7/216: dwrite d1c/d22/f25 [0,4194304] 0 2024-04-25T22:03:19.049 INFO:tasks.workunit.client.0.smithi044.stdout:4/233: dread dd/ff [0,4194304] 0 2024-04-25T22:03:19.050 INFO:tasks.workunit.client.0.smithi044.stdout:5/280: mkdir d2/d5/d21/d38/d52/d56 0 2024-04-25T22:03:19.050 INFO:tasks.workunit.client.0.smithi044.stdout:9/385: creat d4/d37/d54/d84/d72/f87 x:0 0 0 2024-04-25T22:03:19.050 INFO:tasks.workunit.client.0.smithi044.stdout:4/234: dread - dd/f41 zero size 2024-04-25T22:03:19.050 INFO:tasks.workunit.client.0.smithi044.stdout:8/411: dread d2a/d32/d3e/f75 [0,4194304] 0 2024-04-25T22:03:19.051 INFO:tasks.workunit.client.0.smithi044.stdout:4/235: readlink dd/d35/l4d 0 2024-04-25T22:03:19.051 INFO:tasks.workunit.client.0.smithi044.stdout:7/217: dread - d1c/d22/d28/d30/d32/d33/f2d zero size 2024-04-25T22:03:19.052 INFO:tasks.workunit.client.0.smithi044.stdout:2/302: dwrite d7/d16/f17 [0,4194304] 0 2024-04-25T22:03:19.052 INFO:tasks.workunit.client.0.smithi044.stdout:4/236: truncate dd/f41 811778 0 2024-04-25T22:03:19.053 INFO:tasks.workunit.client.0.smithi044.stdout:9/386: mkdir d4/d3d/d88 0 2024-04-25T22:03:19.054 INFO:tasks.workunit.client.0.smithi044.stdout:1/324: dread d3/d30/f31 [0,4194304] 0 2024-04-25T22:03:19.054 INFO:tasks.workunit.client.0.smithi044.stdout:2/303: creat d7/d8/f62 x:0 0 0 2024-04-25T22:03:19.056 INFO:tasks.workunit.client.0.smithi044.stdout:1/325: write d3/f34 [4743333,39334] 0 2024-04-25T22:03:19.056 INFO:tasks.workunit.client.0.smithi044.stdout:2/304: creat d7/d8/d48/f63 x:0 0 0 2024-04-25T22:03:19.056 INFO:tasks.workunit.client.0.smithi044.stdout:7/218: creat d1c/d22/d28/d30/d32/f43 x:0 0 0 2024-04-25T22:03:19.056 INFO:tasks.workunit.client.0.smithi044.stdout:9/387: getdents d4/d7/d18/d3a 0 2024-04-25T22:03:19.057 INFO:tasks.workunit.client.0.smithi044.stdout:7/219: readlink d1c/l26 0 2024-04-25T22:03:19.057 INFO:tasks.workunit.client.0.smithi044.stdout:1/326: write d3/f61 [843015,108974] 0 2024-04-25T22:03:19.058 INFO:tasks.workunit.client.0.smithi044.stdout:2/305: rmdir d7/d16/d2d/d57 39 2024-04-25T22:03:19.059 INFO:tasks.workunit.client.0.smithi044.stdout:5/281: dwrite d2/d5/f41 [4194304,4194304] 0 2024-04-25T22:03:19.059 INFO:tasks.workunit.client.0.smithi044.stdout:7/220: write d1c/d22/d28/f41 [428144,65492] 0 2024-04-25T22:03:19.061 INFO:tasks.workunit.client.0.smithi044.stdout:8/412: dwrite d2a/f45 [0,4194304] 0 2024-04-25T22:03:19.061 INFO:tasks.workunit.client.0.smithi044.stdout:7/221: symlink d1c/d22/d28/d30/d32/d33/l44 0 2024-04-25T22:03:19.061 INFO:tasks.workunit.client.0.smithi044.stdout:7/222: creat d1c/f45 x:0 0 0 2024-04-25T22:03:19.062 INFO:tasks.workunit.client.0.smithi044.stdout:2/306: rename d7/d8/l19 to d7/l64 0 2024-04-25T22:03:19.062 INFO:tasks.workunit.client.0.smithi044.stdout:7/223: write d1c/f2f [938975,60960] 0 2024-04-25T22:03:19.063 INFO:tasks.workunit.client.0.smithi044.stdout:2/307: write d7/d16/d2d/d4e/d2e/f2f [772133,122789] 0 2024-04-25T22:03:19.063 INFO:tasks.workunit.client.0.smithi044.stdout:2/308: stat d7 0 2024-04-25T22:03:19.063 INFO:tasks.workunit.client.0.smithi044.stdout:7/224: fsync d1c/d22/d28/d30/f36 0 2024-04-25T22:03:19.063 INFO:tasks.workunit.client.0.smithi044.stdout:1/327: dread d3/d30/f31 [0,4194304] 0 2024-04-25T22:03:19.064 INFO:tasks.workunit.client.0.smithi044.stdout:9/388: read d4/d7/d18/d2d/f38 [2159217,23878] 0 2024-04-25T22:03:19.064 INFO:tasks.workunit.client.0.smithi044.stdout:7/225: creat d1c/d22/d28/d30/f46 x:0 0 0 2024-04-25T22:03:19.064 INFO:tasks.workunit.client.0.smithi044.stdout:1/328: mknod d3/d4b/c67 0 2024-04-25T22:03:19.065 INFO:tasks.workunit.client.0.smithi044.stdout:2/309: write d7/d16/d2d/d4e/f37 [639836,60863] 0 2024-04-25T22:03:19.065 INFO:tasks.workunit.client.0.smithi044.stdout:7/226: fdatasync d1c/f45 0 2024-04-25T22:03:19.066 INFO:tasks.workunit.client.0.smithi044.stdout:9/389: mknod d4/d3d/d66/c89 0 2024-04-25T22:03:19.066 INFO:tasks.workunit.client.0.smithi044.stdout:2/310: write d7/d16/d2d/d4e/d2e/f34 [317150,116175] 0 2024-04-25T22:03:19.067 INFO:tasks.workunit.client.0.smithi044.stdout:1/329: getdents d3/d30 0 2024-04-25T22:03:19.067 INFO:tasks.workunit.client.0.smithi044.stdout:1/330: creat d3/d30/d3f/f68 x:0 0 0 2024-04-25T22:03:19.068 INFO:tasks.workunit.client.0.smithi044.stdout:2/311: write d7/d16/d2c/f42 [663802,30287] 0 2024-04-25T22:03:19.068 INFO:tasks.workunit.client.0.smithi044.stdout:2/312: symlink d7/d8/d1c/l65 0 2024-04-25T22:03:19.069 INFO:tasks.workunit.client.0.smithi044.stdout:2/313: write d7/d16/d4b/f5d [693281,14429] 0 2024-04-25T22:03:19.073 INFO:tasks.workunit.client.0.smithi044.stdout:1/331: dwrite d3/d7/f8 [0,4194304] 0 2024-04-25T22:03:19.074 INFO:tasks.workunit.client.0.smithi044.stdout:7/227: write d1c/d22/d28/d30/f36 [206410,31342] 0 2024-04-25T22:03:19.074 INFO:tasks.workunit.client.0.smithi044.stdout:1/332: creat d3/d7/f69 x:0 0 0 2024-04-25T22:03:19.074 INFO:tasks.workunit.client.0.smithi044.stdout:7/228: creat d1c/f47 x:0 0 0 2024-04-25T22:03:19.075 INFO:tasks.workunit.client.0.smithi044.stdout:7/229: chown d1c/d22/d28/c2e 21337142 1 2024-04-25T22:03:19.080 INFO:tasks.workunit.client.0.smithi044.stdout:1/333: dwrite d3/d7/db/f1d [0,4194304] 0 2024-04-25T22:03:19.081 INFO:tasks.workunit.client.0.smithi044.stdout:1/334: symlink d3/d7/d29/d43/l6a 0 2024-04-25T22:03:19.081 INFO:tasks.workunit.client.0.smithi044.stdout:1/335: rmdir d3/d7/d29/d50 39 2024-04-25T22:03:19.082 INFO:tasks.workunit.client.0.smithi044.stdout:1/336: fsync d3/f26 0 2024-04-25T22:03:19.084 INFO:tasks.workunit.client.0.smithi044.stdout:3/312: sync 2024-04-25T22:03:19.085 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:19.081+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:19.088 INFO:tasks.workunit.client.0.smithi044.stdout:6/371: dread d2/d23/d5a/d12/d1f/f20 [0,4194304] 0 2024-04-25T22:03:19.089 INFO:tasks.workunit.client.0.smithi044.stdout:7/230: dread d1c/f2f [0,4194304] 0 2024-04-25T22:03:19.089 INFO:tasks.workunit.client.0.smithi044.stdout:7/231: read - d1c/f45 zero size 2024-04-25T22:03:19.090 INFO:tasks.workunit.client.0.smithi044.stdout:7/232: chown d1c/f3a 2932 1 2024-04-25T22:03:19.091 INFO:tasks.workunit.client.0.smithi044.stdout:1/337: dread d3/d7/f57 [0,4194304] 0 2024-04-25T22:03:19.091 INFO:tasks.workunit.client.0.smithi044.stdout:3/313: dwrite d0/d1/d15/d51/dd/f4e [0,4194304] 0 2024-04-25T22:03:19.092 INFO:tasks.workunit.client.0.smithi044.stdout:1/338: symlink d3/d30/d3f/l6b 0 2024-04-25T22:03:19.095 INFO:tasks.workunit.client.0.smithi044.stdout:6/372: dwrite d2/d23/d5a/d11/d2a/f3c [0,4194304] 0 2024-04-25T22:03:19.095 INFO:tasks.workunit.client.0.smithi044.stdout:3/314: dread d0/d1/d15/d51/dd/d35/d36/f45 [0,4194304] 0 2024-04-25T22:03:19.096 INFO:tasks.workunit.client.0.smithi044.stdout:6/373: creat d2/d23/d6a/f84 x:0 0 0 2024-04-25T22:03:19.097 INFO:tasks.workunit.client.0.smithi044.stdout:6/374: write d2/d23/d5a/d13/f5f [693135,113443] 0 2024-04-25T22:03:19.103 INFO:tasks.workunit.client.0.smithi044.stdout:6/375: dread d2/d23/d30/f47 [0,4194304] 0 2024-04-25T22:03:19.104 INFO:tasks.workunit.client.0.smithi044.stdout:6/376: unlink d2/d23/d5a/d13/c76 0 2024-04-25T22:03:19.104 INFO:tasks.workunit.client.0.smithi044.stdout:6/377: readlink d2/d23/d5a/l2b 0 2024-04-25T22:03:19.105 INFO:tasks.workunit.client.0.smithi044.stdout:6/378: fdatasync d2/d23/d5a/d11/f60 0 2024-04-25T22:03:19.107 INFO:tasks.workunit.client.0.smithi044.stdout:7/233: dread d1c/d22/d28/d30/d32/f39 [0,4194304] 0 2024-04-25T22:03:19.112 INFO:tasks.workunit.client.0.smithi044.stdout:1/339: dread d3/d7/f40 [0,4194304] 0 2024-04-25T22:03:19.113 INFO:tasks.workunit.client.0.smithi044.stdout:1/340: chown d3/d30/d3f/f68 0 1 2024-04-25T22:03:19.114 INFO:tasks.workunit.client.0.smithi044.stdout:7/234: dwrite d1c/f2b [0,4194304] 0 2024-04-25T22:03:19.114 INFO:tasks.workunit.client.0.smithi044.stdout:1/341: dread - d3/d30/d3f/f68 zero size 2024-04-25T22:03:19.115 INFO:tasks.workunit.client.0.smithi044.stdout:7/235: stat d1c/d22/d28/l3f 0 2024-04-25T22:03:19.115 INFO:tasks.workunit.client.0.smithi044.stdout:9/390: dread d4/d7/d18/d2d/f38 [0,4194304] 0 2024-04-25T22:03:19.116 INFO:tasks.workunit.client.0.smithi044.stdout:7/236: symlink d1c/d22/d28/d30/l48 0 2024-04-25T22:03:19.116 INFO:tasks.workunit.client.0.smithi044.stdout:1/342: write d3/f37 [1931591,104339] 0 2024-04-25T22:03:19.116 INFO:tasks.workunit.client.0.smithi044.stdout:6/379: dread d2/d23/f28 [0,4194304] 0 2024-04-25T22:03:19.116 INFO:tasks.workunit.client.0.smithi044.stdout:9/391: chown d4/d37/d54/d84/d64 14198985 1 2024-04-25T22:03:19.117 INFO:tasks.workunit.client.0.smithi044.stdout:9/392: read d4/d3d/f68 [175932,35248] 0 2024-04-25T22:03:19.117 INFO:tasks.workunit.client.0.smithi044.stdout:1/343: truncate d3/d7/d29/d43/f52 4827294 0 2024-04-25T22:03:19.118 INFO:tasks.workunit.client.0.smithi044.stdout:1/344: chown d3/d7/db/f46 5763 1 2024-04-25T22:03:19.118 INFO:tasks.workunit.client.0.smithi044.stdout:7/237: creat d1c/d22/f49 x:0 0 0 2024-04-25T22:03:19.118 INFO:tasks.workunit.client.0.smithi044.stdout:9/393: rmdir d4/d7/d18/d2e 39 2024-04-25T22:03:19.119 INFO:tasks.workunit.client.0.smithi044.stdout:7/238: mkdir d1c/d22/d4a 0 2024-04-25T22:03:19.119 INFO:tasks.workunit.client.0.smithi044.stdout:9/394: symlink d4/d7/d79/l8a 0 2024-04-25T22:03:19.120 INFO:tasks.workunit.client.0.smithi044.stdout:9/395: mkdir d4/d7/d18/d3a/d8b 0 2024-04-25T22:03:19.120 INFO:tasks.workunit.client.0.smithi044.stdout:7/239: write d1c/d22/d28/d30/d32/f42 [282727,62614] 0 2024-04-25T22:03:19.120 INFO:tasks.workunit.client.0.smithi044.stdout:9/396: fdatasync d4/f40 0 2024-04-25T22:03:19.121 INFO:tasks.workunit.client.0.smithi044.stdout:1/345: link d3/d30/d3f/f5a d3/d7/d29/f6c 0 2024-04-25T22:03:19.121 INFO:tasks.workunit.client.0.smithi044.stdout:1/346: unlink d3/f5e 0 2024-04-25T22:03:19.122 INFO:tasks.workunit.client.0.smithi044.stdout:7/240: rename d1c/d22/d28/d30/d32/d33/l44 to d1c/d22/d28/d30/l4b 0 2024-04-25T22:03:19.122 INFO:tasks.workunit.client.0.smithi044.stdout:1/347: fdatasync d3/f61 0 2024-04-25T22:03:19.122 INFO:tasks.workunit.client.0.smithi044.stdout:9/397: truncate d4/d7/d18/d3a/f6c 177473 0 2024-04-25T22:03:19.122 INFO:tasks.workunit.client.0.smithi044.stdout:1/348: fsync d3/d7/db/f15 0 2024-04-25T22:03:19.123 INFO:tasks.workunit.client.0.smithi044.stdout:7/241: rmdir d1c/d22/d28/d30/d32/d33 39 2024-04-25T22:03:19.123 INFO:tasks.workunit.client.0.smithi044.stdout:9/398: dread - d4/d7/d79/f7e zero size 2024-04-25T22:03:19.123 INFO:tasks.workunit.client.0.smithi044.stdout:9/399: truncate d4/f7f 853487 0 2024-04-25T22:03:19.124 INFO:tasks.workunit.client.0.smithi044.stdout:9/400: dread - d4/d7/d18/f56 zero size 2024-04-25T22:03:19.125 INFO:tasks.workunit.client.0.smithi044.stdout:9/401: chown d4/d3d/d58 83695 1 2024-04-25T22:03:19.125 INFO:tasks.workunit.client.0.smithi044.stdout:7/242: truncate d1c/d22/d28/d30/d32/d33/f3e 239905 0 2024-04-25T22:03:19.126 INFO:tasks.workunit.client.0.smithi044.stdout:7/243: mknod d1c/d22/d28/d30/c4c 0 2024-04-25T22:03:19.126 INFO:tasks.workunit.client.0.smithi044.stdout:6/380: write d2/d23/d5a/d13/d4b/f67 [616487,131021] 0 2024-04-25T22:03:19.126 INFO:tasks.workunit.client.0.smithi044.stdout:9/402: dread - d4/d7/d18/d2e/d73/f7c zero size 2024-04-25T22:03:19.127 INFO:tasks.workunit.client.0.smithi044.stdout:3/315: dread d0/f38 [4194304,4194304] 0 2024-04-25T22:03:19.127 INFO:tasks.workunit.client.0.smithi044.stdout:7/244: symlink d1c/d22/d4a/l4d 0 2024-04-25T22:03:19.128 INFO:tasks.workunit.client.0.smithi044.stdout:9/403: fdatasync d4/d7/f4d 0 2024-04-25T22:03:19.130 INFO:tasks.workunit.client.0.smithi044.stdout:6/381: link d2/d23/d5a/l7c d2/d23/d5a/d13/d4b/d5e/l85 0 2024-04-25T22:03:19.131 INFO:tasks.workunit.client.0.smithi044.stdout:7/245: truncate d1c/d22/d28/d30/d32/f43 971556 0 2024-04-25T22:03:19.131 INFO:tasks.workunit.client.0.smithi044.stdout:6/382: readlink d2/d23/l3f 0 2024-04-25T22:03:19.132 INFO:tasks.workunit.client.0.smithi044.stdout:1/349: dwrite d3/d7/f20 [0,4194304] 0 2024-04-25T22:03:19.134 INFO:tasks.workunit.client.0.smithi044.stdout:9/404: dwrite d4/d7/f39 [0,4194304] 0 2024-04-25T22:03:19.134 INFO:tasks.workunit.client.0.smithi044.stdout:6/383: symlink d2/d23/d5a/d13/d68/d7b/l86 0 2024-04-25T22:03:19.135 INFO:tasks.workunit.client.0.smithi044.stdout:6/384: chown d2/d23 4791 1 2024-04-25T22:03:19.136 INFO:tasks.workunit.client.0.smithi044.stdout:6/385: dread - d2/d23/d5a/d11/d2a/f61 zero size 2024-04-25T22:03:19.137 INFO:tasks.workunit.client.0.smithi044.stdout:6/386: creat d2/d23/d5a/d12/d1f/f87 x:0 0 0 2024-04-25T22:03:19.140 INFO:tasks.workunit.client.0.smithi044.stdout:9/405: write d4/d7/d18/d2e/f5d [1823250,120328] 0 2024-04-25T22:03:19.140 INFO:tasks.workunit.client.0.smithi044.stdout:1/350: dwrite d3/d30/f31 [0,4194304] 0 2024-04-25T22:03:19.141 INFO:tasks.workunit.client.0.smithi044.stdout:6/387: creat d2/d23/d5a/d11/f88 x:0 0 0 2024-04-25T22:03:19.141 INFO:tasks.workunit.client.0.smithi044.stdout:9/406: creat d4/f8c x:0 0 0 2024-04-25T22:03:19.141 INFO:tasks.workunit.client.0.smithi044.stdout:1/351: write d3/d7/db/f1d [8587241,93068] 0 2024-04-25T22:03:19.142 INFO:tasks.workunit.client.0.smithi044.stdout:1/352: chown d3/c55 332841 1 2024-04-25T22:03:19.142 INFO:tasks.workunit.client.0.smithi044.stdout:9/407: mkdir d4/d3d/d58/d8d 0 2024-04-25T22:03:19.143 INFO:tasks.workunit.client.0.smithi044.stdout:9/408: truncate d4/f40 449569 0 2024-04-25T22:03:19.143 INFO:tasks.workunit.client.0.smithi044.stdout:9/409: readlink d4/d37/l6b 0 2024-04-25T22:03:19.144 INFO:tasks.workunit.client.0.smithi044.stdout:9/410: creat d4/d7/d79/f8e x:0 0 0 2024-04-25T22:03:19.144 INFO:tasks.workunit.client.0.smithi044.stdout:9/411: rmdir d4/d4b 39 2024-04-25T22:03:19.145 INFO:tasks.workunit.client.0.smithi044.stdout:9/412: unlink d4/d7/d18/f56 0 2024-04-25T22:03:19.146 INFO:tasks.workunit.client.0.smithi044.stdout:9/413: write d4/f7f [688339,130250] 0 2024-04-25T22:03:19.147 INFO:tasks.workunit.client.0.smithi044.stdout:6/388: dwrite d2/d23/d5a/d13/d68/f79 [0,4194304] 0 2024-04-25T22:03:19.147 INFO:tasks.workunit.client.0.smithi044.stdout:9/414: creat d4/d7/d18/d2d/f8f x:0 0 0 2024-04-25T22:03:19.148 INFO:tasks.workunit.client.0.smithi044.stdout:9/415: write d4/d7/d18/d2e/f4c [1090696,7261] 0 2024-04-25T22:03:19.148 INFO:tasks.workunit.client.0.smithi044.stdout:0/308: sync 2024-04-25T22:03:19.148 INFO:tasks.workunit.client.0.smithi044.stdout:2/314: sync 2024-04-25T22:03:19.149 INFO:tasks.workunit.client.0.smithi044.stdout:5/282: sync 2024-04-25T22:03:19.149 INFO:tasks.workunit.client.0.smithi044.stdout:8/413: sync 2024-04-25T22:03:19.149 INFO:tasks.workunit.client.0.smithi044.stdout:4/237: sync 2024-04-25T22:03:19.149 INFO:tasks.workunit.client.0.smithi044.stdout:7/246: sync 2024-04-25T22:03:19.149 INFO:tasks.workunit.client.0.smithi044.stdout:7/247: read d1c/d22/f25 [1848933,2289] 0 2024-04-25T22:03:19.150 INFO:tasks.workunit.client.0.smithi044.stdout:4/238: write dd/d19/d38/f39 [129856,52300] 0 2024-04-25T22:03:19.152 INFO:tasks.workunit.client.0.smithi044.stdout:0/309: rmdir d8/df/d17 39 2024-04-25T22:03:19.152 INFO:tasks.workunit.client.0.smithi044.stdout:8/414: creat d2a/d77/f87 x:0 0 0 2024-04-25T22:03:19.152 INFO:tasks.workunit.client.0.smithi044.stdout:5/283: creat d2/d5/d21/d26/f57 x:0 0 0 2024-04-25T22:03:19.152 INFO:tasks.workunit.client.0.smithi044.stdout:4/239: rmdir dd/d19 39 2024-04-25T22:03:19.152 INFO:tasks.workunit.client.0.smithi044.stdout:2/315: write d7/f1b [588204,95712] 0 2024-04-25T22:03:19.152 INFO:tasks.workunit.client.0.smithi044.stdout:9/416: creat d4/d7/d18/d3a/d8b/f90 x:0 0 0 2024-04-25T22:03:19.152 INFO:tasks.workunit.client.0.smithi044.stdout:0/310: chown d8/d20/f6a 20 1 2024-04-25T22:03:19.154 INFO:tasks.workunit.client.0.smithi044.stdout:4/240: chown dd/d19/d38/l42 264767285 1 2024-04-25T22:03:19.154 INFO:tasks.workunit.client.0.smithi044.stdout:2/316: readlink d7/d16/d2d/d57/l60 0 2024-04-25T22:03:19.154 INFO:tasks.workunit.client.0.smithi044.stdout:8/415: link d2a/d32/f79 d2a/d39/d42/f88 0 2024-04-25T22:03:19.154 INFO:tasks.workunit.client.0.smithi044.stdout:5/284: creat d2/d5/d21/d26/d2c/d37/f58 x:0 0 0 2024-04-25T22:03:19.155 INFO:tasks.workunit.client.0.smithi044.stdout:9/417: symlink d4/d4b/l91 0 2024-04-25T22:03:19.155 INFO:tasks.workunit.client.0.smithi044.stdout:3/316: dread d0/d1/d15/d51/d39/f5a [0,4194304] 0 2024-04-25T22:03:19.156 INFO:tasks.workunit.client.0.smithi044.stdout:0/311: truncate d8/d24/f28 4719654 0 2024-04-25T22:03:19.157 INFO:tasks.workunit.client.0.smithi044.stdout:3/317: mknod d0/c65 0 2024-04-25T22:03:19.160 INFO:tasks.workunit.client.0.smithi044.stdout:6/389: dwrite d2/d23/d5a/d11/f16 [4194304,4194304] 0 2024-04-25T22:03:19.160 INFO:tasks.workunit.client.0.smithi044.stdout:4/241: mknod dd/d35/d52/c53 0 2024-04-25T22:03:19.160 INFO:tasks.workunit.client.0.smithi044.stdout:7/248: dwrite d1c/d22/f23 [0,4194304] 0 2024-04-25T22:03:19.160 INFO:tasks.workunit.client.0.smithi044.stdout:8/416: mknod d2a/d39/d42/d68/d6b/c89 0 2024-04-25T22:03:19.160 INFO:tasks.workunit.client.0.smithi044.stdout:5/285: write d2/d5/d21/f2d [375459,74901] 0 2024-04-25T22:03:19.161 INFO:tasks.workunit.client.0.smithi044.stdout:8/417: write f6 [1463320,47674] 0 2024-04-25T22:03:19.161 INFO:tasks.workunit.client.0.smithi044.stdout:7/249: mkdir d1c/d22/d28/d4e 0 2024-04-25T22:03:19.161 INFO:tasks.workunit.client.0.smithi044.stdout:4/242: write dd/f41 [258800,13567] 0 2024-04-25T22:03:19.161 INFO:tasks.workunit.client.0.smithi044.stdout:5/286: write d2/d5/d21/f43 [217686,109008] 0 2024-04-25T22:03:19.162 INFO:tasks.workunit.client.0.smithi044.stdout:4/243: fdatasync dd/d35/f37 0 2024-04-25T22:03:19.162 INFO:tasks.workunit.client.0.smithi044.stdout:6/390: creat d2/d23/d5a/d12/d49/f89 x:0 0 0 2024-04-25T22:03:19.163 INFO:tasks.workunit.client.0.smithi044.stdout:5/287: chown d2/d5/d27/c4e 241059 1 2024-04-25T22:03:19.165 INFO:tasks.workunit.client.0.smithi044.stdout:0/312: link d8/df/f4e d8/d15/d51/d65/f6b 0 2024-04-25T22:03:19.166 INFO:tasks.workunit.client.0.smithi044.stdout:9/418: dwrite d4/f57 [0,4194304] 0 2024-04-25T22:03:19.166 INFO:tasks.workunit.client.0.smithi044.stdout:8/418: creat d2a/d32/d57/d5e/f8a x:0 0 0 2024-04-25T22:03:19.166 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:19.166 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:19.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.166 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11816 4.37 e66/16 4:ef2cf08c:::100000031bd.00000000:head v 66'189, mlcod=66'187)", 2024-04-25T22:03:19.166 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:19.138223+0000", 2024-04-25T22:03:19.167 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.027278080999999999, 2024-04-25T22:03:19.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.027305843999999999, 2024-04-25T22:03:19.167 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.167 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.167 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:19.167 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.138223+0000", 2024-04-25T22:03:19.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.138223+0000", 2024-04-25T22:03:19.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.138223+0000", 2024-04-25T22:03:19.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5099999999999999e-07 2024-04-25T22:03:19.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.142460+0000", 2024-04-25T22:03:19.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042363829999999998 2024-04-25T22:03:19.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.142472+0000", 2024-04-25T22:03:19.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1934e-05 2024-04-25T22:03:19.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.142478+0000", 2024-04-25T22:03:19.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9490000000000001e-06 2024-04-25T22:03:19.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.142575+0000", 2024-04-25T22:03:19.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7139000000000006e-05 2024-04-25T22:03:19.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.142618+0000", 2024-04-25T22:03:19.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3476000000000002e-05 2024-04-25T22:03:19.170 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.170 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.170 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.170 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11818 4.27 e66/49 4:e48405d9:::1000000312b.00000000:head v 66'185, mlcod=65'183)", 2024-04-25T22:03:19.170 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:19.143848+0000", 2024-04-25T22:03:19.170 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.021652899, 2024-04-25T22:03:19.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.021751289, 2024-04-25T22:03:19.170 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.170 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.171 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:19.171 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.143848+0000", 2024-04-25T22:03:19.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.143848+0000", 2024-04-25T22:03:19.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.143849+0000", 2024-04-25T22:03:19.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.23e-07 2024-04-25T22:03:19.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.149215+0000", 2024-04-25T22:03:19.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0053660219999999998 2024-04-25T22:03:19.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.149241+0000", 2024-04-25T22:03:19.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.622e-05 2024-04-25T22:03:19.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.149256+0000", 2024-04-25T22:03:19.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4822e-05 2024-04-25T22:03:19.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.149357+0000", 2024-04-25T22:03:19.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010140399999999999 2024-04-25T22:03:19.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.149383+0000", 2024-04-25T22:03:19.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6171999999999999e-05 2024-04-25T22:03:19.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.173 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.174 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.174 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11822 4.9 e66/49 4:93301cc4:::10000003210.00000000:head v 66'209, mlcod=66'207)", 2024-04-25T22:03:19.174 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:19.145612+0000", 2024-04-25T22:03:19.174 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.019888876, 2024-04-25T22:03:19.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.020049329000000001, 2024-04-25T22:03:19.174 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.174 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.174 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:19.174 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.145612+0000", 2024-04-25T22:03:19.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.145612+0000", 2024-04-25T22:03:19.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.145613+0000", 2024-04-25T22:03:19.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.23e-07 2024-04-25T22:03:19.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.151676+0000", 2024-04-25T22:03:19.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0060629400000000002 2024-04-25T22:03:19.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.151694+0000", 2024-04-25T22:03:19.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8195000000000001e-05 2024-04-25T22:03:19.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.151703+0000", 2024-04-25T22:03:19.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.577e-06 2024-04-25T22:03:19.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.151759+0000", 2024-04-25T22:03:19.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5822000000000002e-05 2024-04-25T22:03:19.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.151775+0000", 2024-04-25T22:03:19.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5608999999999999e-05 2024-04-25T22:03:19.177 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.177 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.177 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.177 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:1190 4.1 e66/49 4:815c640e:::10000003221.00000000:head v 66'179, mlcod=66'177)", 2024-04-25T22:03:19.177 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:19.164389+0000", 2024-04-25T22:03:19.177 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00111141, 2024-04-25T22:03:19.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001332279, 2024-04-25T22:03:19.178 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.178 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:19.178 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.164389+0000", 2024-04-25T22:03:19.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.164389+0000", 2024-04-25T22:03:19.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.164391+0000", 2024-04-25T22:03:19.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.237e-06 2024-04-25T22:03:19.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.164415+0000", 2024-04-25T22:03:19.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4003999999999999e-05 2024-04-25T22:03:19.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.164472+0000", 2024-04-25T22:03:19.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7309000000000003e-05 2024-04-25T22:03:19.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.164507+0000", 2024-04-25T22:03:19.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4728999999999999e-05 2024-04-25T22:03:19.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.164629+0000", 2024-04-25T22:03:19.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012246199999999999 2024-04-25T22:03:19.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.164655+0000", 2024-04-25T22:03:19.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6163999999999999e-05 2024-04-25T22:03:19.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.181 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.181 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-25T22:03:19.181 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 4 2024-04-25T22:03:19.181 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:19.183 INFO:tasks.workunit.client.0.smithi044.stdout:5/288: symlink d2/d5/d27/l59 0 2024-04-25T22:03:19.183 INFO:tasks.workunit.client.0.smithi044.stdout:0/313: chown d8/df/d17/d45/d4f 92 1 2024-04-25T22:03:19.183 INFO:tasks.workunit.client.0.smithi044.stdout:8/419: creat d2a/d39/d42/d68/d6b/d7b/f8b x:0 0 0 2024-04-25T22:03:19.183 INFO:tasks.workunit.client.0.smithi044.stdout:4/244: write dd/d35/f3e [691934,5784] 0 2024-04-25T22:03:19.183 INFO:tasks.workunit.client.0.smithi044.stdout:0/314: stat d8/da/d55/f62 0 2024-04-25T22:03:19.183 INFO:tasks.workunit.client.0.smithi044.stdout:6/391: dwrite d2/d23/d5a/d12/d49/f89 [0,4194304] 0 2024-04-25T22:03:19.183 INFO:tasks.workunit.client.0.smithi044.stdout:5/289: stat d2/d5/d21/d26/d2c/d37 0 2024-04-25T22:03:19.183 INFO:tasks.workunit.client.0.smithi044.stdout:9/419: getdents d4/d37 0 2024-04-25T22:03:19.183 INFO:tasks.workunit.client.0.smithi044.stdout:8/420: rename d2a/d39/c5b to d2a/d39/d42/d68/d6b/c8c 0 2024-04-25T22:03:19.183 INFO:tasks.workunit.client.0.smithi044.stdout:0/315: write f1 [3489752,65725] 0 2024-04-25T22:03:19.184 INFO:tasks.workunit.client.0.smithi044.stdout:4/245: chown dd/f46 3390572 1 2024-04-25T22:03:19.184 INFO:tasks.workunit.client.0.smithi044.stdout:7/250: dwrite d1c/f2f [0,4194304] 0 2024-04-25T22:03:19.184 INFO:tasks.workunit.client.0.smithi044.stdout:7/251: readlink l19 0 2024-04-25T22:03:19.184 INFO:tasks.workunit.client.0.smithi044.stdout:3/318: dwrite d0/d1/d15/d51/f29 [0,4194304] 0 2024-04-25T22:03:19.184 INFO:tasks.workunit.client.0.smithi044.stdout:6/392: symlink d2/d23/d5a/d12/d1f/l8a 0 2024-04-25T22:03:19.184 INFO:tasks.workunit.client.0.smithi044.stdout:4/246: mknod dd/d19/d38/c54 0 2024-04-25T22:03:19.184 INFO:tasks.workunit.client.0.smithi044.stdout:9/420: mknod d4/d7/d18/d2e/c92 0 2024-04-25T22:03:19.185 INFO:tasks.workunit.client.0.smithi044.stdout:7/252: dwrite d1c/d22/d28/d30/f46 [0,4194304] 0 2024-04-25T22:03:19.185 INFO:tasks.workunit.client.0.smithi044.stdout:8/421: write f2 [2904206,12846] 0 2024-04-25T22:03:19.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:19.187 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:19.184+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:19.187 INFO:tasks.workunit.client.0.smithi044.stdout:8/422: rmdir d2a 39 2024-04-25T22:03:19.187 INFO:tasks.workunit.client.0.smithi044.stdout:7/253: unlink d1c/l37 0 2024-04-25T22:03:19.188 INFO:tasks.workunit.client.0.smithi044.stdout:6/393: symlink d2/d23/d5a/d12/l8b 0 2024-04-25T22:03:19.188 INFO:tasks.workunit.client.0.smithi044.stdout:9/421: write d4/d7/d18/f5a [695668,62768] 0 2024-04-25T22:03:19.188 INFO:tasks.workunit.client.0.smithi044.stdout:4/247: rename dd/d19/d38/f39 to dd/f55 0 2024-04-25T22:03:19.188 INFO:tasks.workunit.client.0.smithi044.stdout:1/353: dread d3/f34 [0,4194304] 0 2024-04-25T22:03:19.188 INFO:tasks.workunit.client.0.smithi044.stdout:4/248: write dd/d19/f32 [2158606,34525] 0 2024-04-25T22:03:19.189 INFO:tasks.workunit.client.0.smithi044.stdout:7/254: rename f14 to d1c/d22/d4a/f4f 0 2024-04-25T22:03:19.189 INFO:tasks.workunit.client.0.smithi044.stdout:9/422: mkdir d4/d3d/d66/d93 0 2024-04-25T22:03:19.190 INFO:tasks.workunit.client.0.smithi044.stdout:7/255: dread - d1c/f47 zero size 2024-04-25T22:03:19.192 INFO:tasks.workunit.client.0.smithi044.stdout:9/423: fdatasync d4/d7/d18/d2e/d73/f7c 0 2024-04-25T22:03:19.192 INFO:tasks.workunit.client.0.smithi044.stdout:0/316: write d8/f68 [2399763,98329] 0 2024-04-25T22:03:19.192 INFO:tasks.workunit.client.0.smithi044.stdout:4/249: mknod dd/d19/c56 0 2024-04-25T22:03:19.192 INFO:tasks.workunit.client.0.smithi044.stdout:1/354: creat d3/f6d x:0 0 0 2024-04-25T22:03:19.193 INFO:tasks.workunit.client.0.smithi044.stdout:7/256: creat d1c/f50 x:0 0 0 2024-04-25T22:03:19.194 INFO:tasks.workunit.client.0.smithi044.stdout:7/257: readlink d1c/l1d 0 2024-04-25T22:03:19.194 INFO:tasks.workunit.client.0.smithi044.stdout:3/319: dwrite d0/d1/d15/d51/d39/f5a [4194304,4194304] 0 2024-04-25T22:03:19.194 INFO:tasks.workunit.client.0.smithi044.stdout:5/290: dread d2/d5/d27/d2a/d48/f4f [0,4194304] 0 2024-04-25T22:03:19.195 INFO:tasks.workunit.client.0.smithi044.stdout:8/423: truncate d2a/f45 2797388 0 2024-04-25T22:03:19.195 INFO:tasks.workunit.client.0.smithi044.stdout:0/317: unlink d8/df/f4e 0 2024-04-25T22:03:19.196 INFO:tasks.workunit.client.0.smithi044.stdout:9/424: mkdir d4/d7/d18/d2e/d94 0 2024-04-25T22:03:19.196 INFO:tasks.workunit.client.0.smithi044.stdout:4/250: symlink dd/d35/d52/l57 0 2024-04-25T22:03:19.196 INFO:tasks.workunit.client.0.smithi044.stdout:6/394: dwrite d2/d23/d5a/d12/d27/f45 [0,4194304] 0 2024-04-25T22:03:19.196 INFO:tasks.workunit.client.0.smithi044.stdout:7/258: mknod d1c/d22/d28/c51 0 2024-04-25T22:03:19.202 INFO:tasks.workunit.client.0.smithi044.stdout:4/251: fsync dd/f34 0 2024-04-25T22:03:19.204 INFO:tasks.workunit.client.0.smithi044.stdout:4/252: stat dd/d19/f2b 0 2024-04-25T22:03:19.206 INFO:tasks.workunit.client.0.smithi044.stdout:7/259: truncate d1c/f20 1899128 0 2024-04-25T22:03:19.210 INFO:tasks.workunit.client.0.smithi044.stdout:9/425: dwrite d4/d7/d18/d2d/f51 [4194304,4194304] 0 2024-04-25T22:03:19.210 INFO:tasks.workunit.client.0.smithi044.stdout:0/318: getdents d8/d15/d51/d65 0 2024-04-25T22:03:19.210 INFO:tasks.workunit.client.0.smithi044.stdout:3/320: dwrite d0/f38 [4194304,4194304] 0 2024-04-25T22:03:19.212 INFO:tasks.workunit.client.0.smithi044.stdout:1/355: dwrite d3/d7/db/d42/f64 [0,4194304] 0 2024-04-25T22:03:19.213 INFO:tasks.workunit.client.0.smithi044.stdout:5/291: dwrite d2/d5/d21/f2d [0,4194304] 0 2024-04-25T22:03:19.214 INFO:tasks.workunit.client.0.smithi044.stdout:9/426: getdents d4/d3d/d88 0 2024-04-25T22:03:19.215 INFO:tasks.workunit.client.0.smithi044.stdout:3/321: symlink d0/d1/d15/d51/d39/l66 0 2024-04-25T22:03:19.216 INFO:tasks.workunit.client.0.smithi044.stdout:1/356: symlink d3/l6e 0 2024-04-25T22:03:19.218 INFO:tasks.workunit.client.0.smithi044.stdout:6/395: dwrite d2/f3a [0,4194304] 0 2024-04-25T22:03:19.219 INFO:tasks.workunit.client.0.smithi044.stdout:8/424: dwrite d2a/d32/f48 [0,4194304] 0 2024-04-25T22:03:19.220 INFO:tasks.workunit.client.0.smithi044.stdout:7/260: write f15 [82916,45482] 0 2024-04-25T22:03:19.220 INFO:tasks.workunit.client.0.smithi044.stdout:9/427: unlink d4/d7/d79/f7e 0 2024-04-25T22:03:19.221 INFO:tasks.workunit.client.0.smithi044.stdout:3/322: creat d0/d2/f67 x:0 0 0 2024-04-25T22:03:19.222 INFO:tasks.workunit.client.0.smithi044.stdout:5/292: write d2/d5/d27/d2a/f42 [1339619,35480] 0 2024-04-25T22:03:19.226 INFO:tasks.workunit.client.0.smithi044.stdout:8/425: write d2a/d52/f72 [683533,37828] 0 2024-04-25T22:03:19.226 INFO:tasks.workunit.client.0.smithi044.stdout:4/253: dwrite dd/f17 [0,4194304] 0 2024-04-25T22:03:19.226 INFO:tasks.workunit.client.0.smithi044.stdout:1/357: truncate d3/d30/d3f/f68 267928 0 2024-04-25T22:03:19.226 INFO:tasks.workunit.client.0.smithi044.stdout:5/293: creat d2/d5/d27/d2a/d48/f5a x:0 0 0 2024-04-25T22:03:19.227 INFO:tasks.workunit.client.0.smithi044.stdout:7/261: stat d1c/d22/d28/d30/d32/f39 0 2024-04-25T22:03:19.230 INFO:tasks.workunit.client.0.smithi044.stdout:4/254: rename dd/d35/f3e to dd/d35/f58 0 2024-04-25T22:03:19.230 INFO:tasks.workunit.client.0.smithi044.stdout:8/426: truncate d2a/d32/d3e/f54 1015663 0 2024-04-25T22:03:19.231 INFO:tasks.workunit.client.0.smithi044.stdout:5/294: mkdir d2/d5b 0 2024-04-25T22:03:19.231 INFO:tasks.workunit.client.0.smithi044.stdout:4/255: stat dd/d19/l26 0 2024-04-25T22:03:19.231 INFO:tasks.workunit.client.0.smithi044.stdout:2/317: dread d7/f32 [0,4194304] 0 2024-04-25T22:03:19.231 INFO:tasks.workunit.client.0.smithi044.stdout:1/358: rename d3/d7/db/l2e to d3/d7/db/d42/l6f 0 2024-04-25T22:03:19.231 INFO:tasks.workunit.client.0.smithi044.stdout:0/319: dwrite d8/df/d17/d45/f4a [0,4194304] 0 2024-04-25T22:03:19.232 INFO:tasks.workunit.client.0.smithi044.stdout:7/262: creat d1c/d22/d28/d30/d32/f52 x:0 0 0 2024-04-25T22:03:19.233 INFO:tasks.workunit.client.0.smithi044.stdout:2/318: creat d7/d8/d1c/d26/d44/f66 x:0 0 0 2024-04-25T22:03:19.233 INFO:tasks.workunit.client.0.smithi044.stdout:8/427: mknod d2a/d39/d42/d68/d6b/d6e/d84/c8d 0 2024-04-25T22:03:19.234 INFO:tasks.workunit.client.0.smithi044.stdout:0/320: write d8/f11 [3716857,38098] 0 2024-04-25T22:03:19.235 INFO:tasks.workunit.client.0.smithi044.stdout:4/256: read dd/f3b [36278,58432] 0 2024-04-25T22:03:19.235 INFO:tasks.workunit.client.0.smithi044.stdout:9/428: dwrite d4/d7/d18/d2d/f8f [0,4194304] 0 2024-04-25T22:03:19.235 INFO:tasks.workunit.client.0.smithi044.stdout:2/319: write d7/d8/f3e [4792720,99545] 0 2024-04-25T22:03:19.235 INFO:tasks.workunit.client.0.smithi044.stdout:5/295: mkdir d2/d5/d27/d2a/d5c 0 2024-04-25T22:03:19.235 INFO:tasks.workunit.client.0.smithi044.stdout:8/428: mkdir d2a/d39/d5a/d8e 0 2024-04-25T22:03:19.236 INFO:tasks.workunit.client.0.smithi044.stdout:0/321: creat d8/d20/f6c x:0 0 0 2024-04-25T22:03:19.237 INFO:tasks.workunit.client.0.smithi044.stdout:4/257: symlink dd/d35/d52/l59 0 2024-04-25T22:03:19.237 INFO:tasks.workunit.client.0.smithi044.stdout:2/320: unlink d7/d8/d1c/d26/d44/f66 0 2024-04-25T22:03:19.238 INFO:tasks.workunit.client.0.smithi044.stdout:9/429: rename d4/d7/d18/d2d/d70/f71 to d4/d37/d54/d84/d72/f95 0 2024-04-25T22:03:19.239 INFO:tasks.workunit.client.0.smithi044.stdout:9/430: chown d4/d3d/d58 1885742 1 2024-04-25T22:03:19.240 INFO:tasks.workunit.client.0.smithi044.stdout:1/359: dwrite d3/d7/f69 [0,4194304] 0 2024-04-25T22:03:19.240 INFO:tasks.workunit.client.0.smithi044.stdout:2/321: read d7/d16/d2d/f3a [663005,8431] 0 2024-04-25T22:03:19.243 INFO:tasks.workunit.client.0.smithi044.stdout:1/360: write d3/d7/f3d [2690795,102907] 0 2024-04-25T22:03:19.244 INFO:tasks.workunit.client.0.smithi044.stdout:8/429: dwrite f6 [0,4194304] 0 2024-04-25T22:03:19.247 INFO:tasks.workunit.client.0.smithi044.stdout:7/263: fsync d1c/d22/d28/d30/f46 0 2024-04-25T22:03:19.248 INFO:tasks.workunit.client.0.smithi044.stdout:1/361: dread d3/d7/f40 [0,4194304] 0 2024-04-25T22:03:19.248 INFO:tasks.workunit.client.0.smithi044.stdout:8/430: rename d2a/l40 to d2a/d39/d42/d80/l8f 0 2024-04-25T22:03:19.248 INFO:tasks.workunit.client.0.smithi044.stdout:5/296: getdents d2 0 2024-04-25T22:03:19.249 INFO:tasks.workunit.client.0.smithi044.stdout:2/322: dwrite d7/d16/d2d/f3a [0,4194304] 0 2024-04-25T22:03:19.249 INFO:tasks.workunit.client.0.smithi044.stdout:5/297: fdatasync d2/f3c 0 2024-04-25T22:03:19.250 INFO:tasks.workunit.client.0.smithi044.stdout:1/362: write d3/d30/f31 [3683830,109991] 0 2024-04-25T22:03:19.251 INFO:tasks.workunit.client.0.smithi044.stdout:8/431: mkdir d2a/d32/d90 0 2024-04-25T22:03:19.251 INFO:tasks.workunit.client.0.smithi044.stdout:1/363: symlink d3/d59/d5c/l70 0 2024-04-25T22:03:19.251 INFO:tasks.workunit.client.0.smithi044.stdout:2/323: unlink d7/cd 0 2024-04-25T22:03:19.251 INFO:tasks.workunit.client.0.smithi044.stdout:5/298: mknod d2/d5b/c5d 0 2024-04-25T22:03:19.251 INFO:tasks.workunit.client.0.smithi044.stdout:5/299: chown d2 4036598 1 2024-04-25T22:03:19.252 INFO:tasks.workunit.client.0.smithi044.stdout:2/324: unlink d7/f11 0 2024-04-25T22:03:19.252 INFO:tasks.workunit.client.0.smithi044.stdout:7/264: link d1c/d22/d28/c2e d1c/d22/d28/d30/c53 0 2024-04-25T22:03:19.252 INFO:tasks.workunit.client.0.smithi044.stdout:5/300: fdatasync d2/d5/f17 0 2024-04-25T22:03:19.253 INFO:tasks.workunit.client.0.smithi044.stdout:1/364: mknod d3/d53/c71 0 2024-04-25T22:03:19.255 INFO:tasks.workunit.client.0.smithi044.stdout:8/432: dread d2a/d32/f48 [0,4194304] 0 2024-04-25T22:03:19.256 INFO:tasks.workunit.client.0.smithi044.stdout:5/301: creat d2/d5/f5e x:0 0 0 2024-04-25T22:03:19.256 INFO:tasks.workunit.client.0.smithi044.stdout:2/325: link d7/f15 d7/d8/d1c/f67 0 2024-04-25T22:03:19.256 INFO:tasks.workunit.client.0.smithi044.stdout:1/365: mkdir d3/d72 0 2024-04-25T22:03:19.256 INFO:tasks.workunit.client.0.smithi044.stdout:8/433: readlink d2a/d32/l58 0 2024-04-25T22:03:19.257 INFO:tasks.workunit.client.0.smithi044.stdout:8/434: read d2a/d32/f34 [4011661,73358] 0 2024-04-25T22:03:19.258 INFO:tasks.workunit.client.0.smithi044.stdout:5/302: mkdir d2/d5/d27/d2a/d5c/d5f 0 2024-04-25T22:03:19.258 INFO:tasks.workunit.client.0.smithi044.stdout:2/326: rename d7/d16/d2c/l30 to d7/d16/d2d/d4e/l68 0 2024-04-25T22:03:19.258 INFO:tasks.workunit.client.0.smithi044.stdout:3/323: sync 2024-04-25T22:03:19.259 INFO:tasks.workunit.client.0.smithi044.stdout:6/396: sync 2024-04-25T22:03:19.259 INFO:tasks.workunit.client.0.smithi044.stdout:1/366: link d3/d4b/c67 d3/d7/d29/d43/c73 0 2024-04-25T22:03:19.260 INFO:tasks.workunit.client.0.smithi044.stdout:8/435: getdents d2a/d39/d5a/d66 0 2024-04-25T22:03:19.260 INFO:tasks.workunit.client.0.smithi044.stdout:3/324: mknod d0/d1/d15/d51/dd/d11/c68 0 2024-04-25T22:03:19.261 INFO:tasks.workunit.client.0.smithi044.stdout:7/265: dwrite f0 [0,4194304] 0 2024-04-25T22:03:19.261 INFO:tasks.workunit.client.0.smithi044.stdout:6/397: creat d2/d23/d5a/d13/d4b/f8c x:0 0 0 2024-04-25T22:03:19.261 INFO:tasks.workunit.client.0.smithi044.stdout:9/431: dread d4/d7/d18/f5a [0,4194304] 0 2024-04-25T22:03:19.261 INFO:tasks.workunit.client.0.smithi044.stdout:2/327: rename d7/d16/d2d/f3a to d7/d8/d1c/f69 0 2024-04-25T22:03:19.262 INFO:tasks.workunit.client.0.smithi044.stdout:6/398: mkdir d2/d23/d5a/d12/d27/d8d 0 2024-04-25T22:03:19.265 INFO:tasks.workunit.client.0.smithi044.stdout:9/432: write d4/d7/d18/d2e/f4c [1748953,24873] 0 2024-04-25T22:03:19.265 INFO:tasks.workunit.client.0.smithi044.stdout:6/399: stat d2/d23/d6a 0 2024-04-25T22:03:19.265 INFO:tasks.workunit.client.0.smithi044.stdout:3/325: creat d0/d1/d15/d51/dd/d11/f69 x:0 0 0 2024-04-25T22:03:19.265 INFO:tasks.workunit.client.0.smithi044.stdout:6/400: readlink d2/d23/l3f 0 2024-04-25T22:03:19.265 INFO:tasks.workunit.client.0.smithi044.stdout:8/436: rename d2a/d32/d3e/f50 to d2a/d39/d42/d68/f91 0 2024-04-25T22:03:19.265 INFO:tasks.workunit.client.0.smithi044.stdout:3/326: symlink d0/d1/l6a 0 2024-04-25T22:03:19.265 INFO:tasks.workunit.client.0.smithi044.stdout:3/327: chown d0/d1/d15/d51/dd/f61 480771873 1 2024-04-25T22:03:19.265 INFO:tasks.workunit.client.0.smithi044.stdout:6/401: unlink d2/d23/d5a/l2b 0 2024-04-25T22:03:19.266 INFO:tasks.workunit.client.0.smithi044.stdout:3/328: readlink d0/d1/l6a 0 2024-04-25T22:03:19.266 INFO:tasks.workunit.client.0.smithi044.stdout:7/266: truncate d1c/d22/d28/d30/d32/d33/f2d 942826 0 2024-04-25T22:03:19.267 INFO:tasks.workunit.client.0.smithi044.stdout:7/267: mknod d1c/d22/d4a/c54 0 2024-04-25T22:03:19.267 INFO:tasks.workunit.client.0.smithi044.stdout:6/402: mkdir d2/d23/d5a/d13/d68/d8e 0 2024-04-25T22:03:19.267 INFO:tasks.workunit.client.0.smithi044.stdout:3/329: creat d0/d1/d15/d51/dd/d11/d43/d44/f6b x:0 0 0 2024-04-25T22:03:19.268 INFO:tasks.workunit.client.0.smithi044.stdout:7/268: write f9 [457990,76842] 0 2024-04-25T22:03:19.269 INFO:tasks.workunit.client.0.smithi044.stdout:2/328: dwrite d7/d16/d2c/f3b [0,4194304] 0 2024-04-25T22:03:19.269 INFO:tasks.workunit.client.0.smithi044.stdout:2/329: stat d7/f31 0 2024-04-25T22:03:19.270 INFO:tasks.workunit.client.0.smithi044.stdout:3/330: truncate d0/d13/d1c/f30 5075679 0 2024-04-25T22:03:19.270 INFO:tasks.workunit.client.0.smithi044.stdout:7/269: rmdir d1c/d22/d28/d30/d32/d33 39 2024-04-25T22:03:19.270 INFO:tasks.workunit.client.0.smithi044.stdout:6/403: truncate d2/d23/d5a/d11/f39 285116 0 2024-04-25T22:03:19.271 INFO:tasks.workunit.client.0.smithi044.stdout:0/322: dread d8/df/d17/d45/f50 [0,4194304] 0 2024-04-25T22:03:19.271 INFO:tasks.workunit.client.0.smithi044.stdout:3/331: mkdir d0/d13/d6c 0 2024-04-25T22:03:19.271 INFO:tasks.workunit.client.0.smithi044.stdout:2/330: creat d7/d8/d48/f6a x:0 0 0 2024-04-25T22:03:19.271 INFO:tasks.workunit.client.0.smithi044.stdout:3/332: chown d0/f38 898001704 1 2024-04-25T22:03:19.272 INFO:tasks.workunit.client.0.smithi044.stdout:0/323: creat d8/da/d55/f6d x:0 0 0 2024-04-25T22:03:19.272 INFO:tasks.workunit.client.0.smithi044.stdout:2/331: rmdir d7/d8/d48 39 2024-04-25T22:03:19.273 INFO:tasks.workunit.client.0.smithi044.stdout:6/404: symlink d2/d23/d5a/d12/d49/d7f/l8f 0 2024-04-25T22:03:19.273 INFO:tasks.workunit.client.0.smithi044.stdout:7/270: creat d1c/d22/d28/d30/d32/f55 x:0 0 0 2024-04-25T22:03:19.274 INFO:tasks.workunit.client.0.smithi044.stdout:0/324: mknod d8/df/d17/d45/d4f/c6e 0 2024-04-25T22:03:19.274 INFO:tasks.workunit.client.0.smithi044.stdout:6/405: symlink d2/d23/d5a/d13/d4b/l90 0 2024-04-25T22:03:19.274 INFO:tasks.workunit.client.0.smithi044.stdout:7/271: chown d1c/d22/d4a/f4f 107 1 2024-04-25T22:03:19.275 INFO:tasks.workunit.client.0.smithi044.stdout:6/406: fdatasync d2/d23/d5a/d13/d68/f79 0 2024-04-25T22:03:19.275 INFO:tasks.workunit.client.0.smithi044.stdout:0/325: chown d8/df/d17/d45/d4f/c6e 31801023 1 2024-04-25T22:03:19.276 INFO:tasks.workunit.client.0.smithi044.stdout:7/272: symlink d1c/d22/d4a/l56 0 2024-04-25T22:03:19.276 INFO:tasks.workunit.client.0.smithi044.stdout:0/326: chown d8/d20 0 1 2024-04-25T22:03:19.278 INFO:tasks.workunit.client.0.smithi044.stdout:7/273: mkdir d1c/d22/d28/d57 0 2024-04-25T22:03:19.279 INFO:tasks.workunit.client.0.smithi044.stdout:0/327: chown d8/df/d17/d45/d4f/c52 3622141 1 2024-04-25T22:03:19.280 INFO:tasks.workunit.client.0.smithi044.stdout:0/328: read - d8/d20/f5a zero size 2024-04-25T22:03:19.281 INFO:tasks.workunit.client.0.smithi044.stdout:4/258: dread dd/f11 [0,4194304] 0 2024-04-25T22:03:19.281 INFO:tasks.workunit.client.0.smithi044.stdout:3/333: dwrite d0/d1/d15/d51/dd/d35/f52 [0,4194304] 0 2024-04-25T22:03:19.281 INFO:tasks.workunit.client.0.smithi044.stdout:7/274: fsync d1c/d22/d28/d30/d32/f52 0 2024-04-25T22:03:19.282 INFO:tasks.workunit.client.0.smithi044.stdout:3/334: stat d0/d1/fe 0 2024-04-25T22:03:19.283 INFO:tasks.workunit.client.0.smithi044.stdout:2/332: dwrite d7/d16/d2d/d4e/d2e/f2f [0,4194304] 0 2024-04-25T22:03:19.284 INFO:tasks.workunit.client.0.smithi044.stdout:7/275: creat d1c/d22/d28/f58 x:0 0 0 2024-04-25T22:03:19.284 INFO:tasks.workunit.client.0.smithi044.stdout:0/329: getdents d8/da/d60 0 2024-04-25T22:03:19.285 INFO:tasks.workunit.client.0.smithi044.stdout:4/259: write dd/d19/f1d [702853,19282] 0 2024-04-25T22:03:19.285 INFO:tasks.workunit.client.0.smithi044.stdout:7/276: fsync fa 0 2024-04-25T22:03:19.286 INFO:tasks.workunit.client.0.smithi044.stdout:2/333: unlink d7/d16/d2c/f42 0 2024-04-25T22:03:19.286 INFO:tasks.workunit.client.0.smithi044.stdout:0/330: chown d8/f2b 1338 1 2024-04-25T22:03:19.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:19.281+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:19.287 INFO:tasks.workunit.client.0.smithi044.stdout:8/437: dread f2 [0,4194304] 0 2024-04-25T22:03:19.287 INFO:tasks.workunit.client.0.smithi044.stdout:4/260: dread dd/f3b [0,4194304] 0 2024-04-25T22:03:19.287 INFO:tasks.workunit.client.0.smithi044.stdout:8/438: mkdir d2a/d39/d5a/d92 0 2024-04-25T22:03:19.289 INFO:tasks.workunit.client.0.smithi044.stdout:4/261: getdents dd/d35/d52 0 2024-04-25T22:03:19.289 INFO:tasks.workunit.client.0.smithi044.stdout:6/407: dwrite d2/d23/d5a/d13/f5f [0,4194304] 0 2024-04-25T22:03:19.289 INFO:tasks.workunit.client.0.smithi044.stdout:7/277: fsync d1c/f21 0 2024-04-25T22:03:19.290 INFO:tasks.workunit.client.0.smithi044.stdout:8/439: write d2a/d39/d42/d68/d6b/f64 [641292,19274] 0 2024-04-25T22:03:19.291 INFO:tasks.workunit.client.0.smithi044.stdout:6/408: rmdir d2/d23/d5a/d12/d27 39 2024-04-25T22:03:19.292 INFO:tasks.workunit.client.0.smithi044.stdout:4/262: chown dd/d19/d38/c54 5175 1 2024-04-25T22:03:19.292 INFO:tasks.workunit.client.0.smithi044.stdout:8/440: readlink d2a/d39/d42/d68/d6b/l6d 0 2024-04-25T22:03:19.294 INFO:tasks.workunit.client.0.smithi044.stdout:3/335: dwrite d0/d1/d15/d51/dd/d11/d43/d44/f6b [0,4194304] 0 2024-04-25T22:03:19.294 INFO:tasks.workunit.client.0.smithi044.stdout:8/441: mknod d2a/d39/d5a/d8e/c93 0 2024-04-25T22:03:19.295 INFO:tasks.workunit.client.0.smithi044.stdout:8/442: chown d2a/d39/d42/d68 0 1 2024-04-25T22:03:19.296 INFO:tasks.workunit.client.0.smithi044.stdout:7/278: dread d1c/d22/f25 [0,4194304] 0 2024-04-25T22:03:19.296 INFO:tasks.workunit.client.0.smithi044.stdout:4/263: mknod dd/d19/c5a 0 2024-04-25T22:03:19.296 INFO:tasks.workunit.client.0.smithi044.stdout:3/336: stat d0/d1/d15/d51/dd/d11/d43 0 2024-04-25T22:03:19.297 INFO:tasks.workunit.client.0.smithi044.stdout:4/264: chown dd/d19/c40 12320578 1 2024-04-25T22:03:19.297 INFO:tasks.workunit.client.0.smithi044.stdout:0/331: dwrite d8/d24/f28 [0,4194304] 0 2024-04-25T22:03:19.298 INFO:tasks.workunit.client.0.smithi044.stdout:8/443: chown d2a/d39/d5a/d66 1 1 2024-04-25T22:03:19.299 INFO:tasks.workunit.client.0.smithi044.stdout:7/279: mkdir d1c/d22/d28/d30/d32/d33/d59 0 2024-04-25T22:03:19.301 INFO:tasks.workunit.client.0.smithi044.stdout:4/265: link dd/d19/f2b dd/d35/d52/f5b 0 2024-04-25T22:03:19.302 INFO:tasks.workunit.client.0.smithi044.stdout:4/266: write dd/d19/f27 [1569281,61412] 0 2024-04-25T22:03:19.302 INFO:tasks.workunit.client.0.smithi044.stdout:6/409: dwrite d2/d23/d5a/d11/d3b/f58 [4194304,4194304] 0 2024-04-25T22:03:19.303 INFO:tasks.workunit.client.0.smithi044.stdout:7/280: chown d1c/f20 462143 1 2024-04-25T22:03:19.303 INFO:tasks.workunit.client.0.smithi044.stdout:3/337: dread d0/d13/d1c/f30 [0,4194304] 0 2024-04-25T22:03:19.305 INFO:tasks.workunit.client.0.smithi044.stdout:4/267: creat dd/d19/d38/f5c x:0 0 0 2024-04-25T22:03:19.305 INFO:tasks.workunit.client.0.smithi044.stdout:6/410: unlink d2/d23/d5a/d13/d4b/l90 0 2024-04-25T22:03:19.305 INFO:tasks.workunit.client.0.smithi044.stdout:7/281: chown d1c/d22/f34 53388689 1 2024-04-25T22:03:19.306 INFO:tasks.workunit.client.0.smithi044.stdout:6/411: mknod d2/d23/d30/c91 0 2024-04-25T22:03:19.307 INFO:tasks.workunit.client.0.smithi044.stdout:4/268: creat dd/d19/d38/f5d x:0 0 0 2024-04-25T22:03:19.307 INFO:tasks.workunit.client.0.smithi044.stdout:7/282: chown d1c/d22/d4a/c54 36 1 2024-04-25T22:03:19.307 INFO:tasks.workunit.client.0.smithi044.stdout:4/269: readlink dd/d19/l1f 0 2024-04-25T22:03:19.307 INFO:tasks.workunit.client.0.smithi044.stdout:8/444: dwrite d2a/d32/f41 [4194304,4194304] 0 2024-04-25T22:03:19.308 INFO:tasks.workunit.client.0.smithi044.stdout:7/283: creat d1c/d22/d28/d57/f5a x:0 0 0 2024-04-25T22:03:19.309 INFO:tasks.workunit.client.0.smithi044.stdout:8/445: write d2a/f31 [532171,83447] 0 2024-04-25T22:03:19.309 INFO:tasks.workunit.client.0.smithi044.stdout:7/284: write f15 [292651,109191] 0 2024-04-25T22:03:19.310 INFO:tasks.workunit.client.0.smithi044.stdout:4/270: write dd/d19/f50 [380881,113903] 0 2024-04-25T22:03:19.311 INFO:tasks.workunit.client.0.smithi044.stdout:8/446: creat d2a/d32/d57/d5e/f94 x:0 0 0 2024-04-25T22:03:19.311 INFO:tasks.workunit.client.0.smithi044.stdout:7/285: mknod d1c/d22/d4a/c5b 0 2024-04-25T22:03:19.313 INFO:tasks.workunit.client.0.smithi044.stdout:7/286: dread - d1c/d22/d28/d30/d32/f52 zero size 2024-04-25T22:03:19.313 INFO:tasks.workunit.client.0.smithi044.stdout:3/338: dread d0/d1/d15/d51/dd/d28/f3e [0,4194304] 0 2024-04-25T22:03:19.314 INFO:tasks.workunit.client.0.smithi044.stdout:6/412: dwrite d2/d23/d5a/d12/f19 [0,4194304] 0 2024-04-25T22:03:19.314 INFO:tasks.workunit.client.0.smithi044.stdout:7/287: creat d1c/d22/f5c x:0 0 0 2024-04-25T22:03:19.314 INFO:tasks.workunit.client.0.smithi044.stdout:5/303: getdents d2/d5/d27/d2a/d5c 0 2024-04-25T22:03:19.315 INFO:tasks.workunit.client.0.smithi044.stdout:6/413: stat d2/d23/d5a/d13/d4b/f67 0 2024-04-25T22:03:19.317 INFO:tasks.workunit.client.0.smithi044.stdout:1/367: truncate d3/f49 3275141 0 2024-04-25T22:03:19.318 INFO:tasks.workunit.client.0.smithi044.stdout:9/433: write d4/d7/d18/d3a/f46 [1689530,14406] 0 2024-04-25T22:03:19.319 INFO:tasks.workunit.client.0.smithi044.stdout:7/288: dread d1c/d22/d28/d30/d32/f43 [0,4194304] 0 2024-04-25T22:03:19.320 INFO:tasks.workunit.client.0.smithi044.stdout:5/304: rename d2/d5/d27/f40 to d2/d5/d21/d38/f60 0 2024-04-25T22:03:19.320 INFO:tasks.workunit.client.0.smithi044.stdout:2/334: truncate d7/d16/d2d/d4e/f39 3745871 0 2024-04-25T22:03:19.321 INFO:tasks.workunit.client.0.smithi044.stdout:1/368: creat d3/d59/d5c/f74 x:0 0 0 2024-04-25T22:03:19.321 INFO:tasks.workunit.client.0.smithi044.stdout:9/434: write d4/f5c [2890859,105118] 0 2024-04-25T22:03:19.321 INFO:tasks.workunit.client.0.smithi044.stdout:4/271: dwrite dd/f48 [0,4194304] 0 2024-04-25T22:03:19.321 INFO:tasks.workunit.client.0.smithi044.stdout:7/289: write d1c/f45 [515591,31864] 0 2024-04-25T22:03:19.321 INFO:tasks.workunit.client.0.smithi044.stdout:5/305: chown d2/ca 883758016 1 2024-04-25T22:03:19.322 INFO:tasks.workunit.client.0.smithi044.stdout:4/272: creat dd/d35/f5e x:0 0 0 2024-04-25T22:03:19.322 INFO:tasks.workunit.client.0.smithi044.stdout:2/335: mkdir d7/d16/d2d/d4e/d2e/d6b 0 2024-04-25T22:03:19.322 INFO:tasks.workunit.client.0.smithi044.stdout:1/369: stat d3/d7/db/c27 0 2024-04-25T22:03:19.323 INFO:tasks.workunit.client.0.smithi044.stdout:5/306: write d2/d5/f17 [4219004,98396] 0 2024-04-25T22:03:19.324 INFO:tasks.workunit.client.0.smithi044.stdout:1/370: symlink d3/d4b/l75 0 2024-04-25T22:03:19.324 INFO:tasks.workunit.client.0.smithi044.stdout:1/371: write d3/f4a [3111432,118677] 0 2024-04-25T22:03:19.330 INFO:tasks.workunit.client.0.smithi044.stdout:7/290: dwrite f12 [0,4194304] 0 2024-04-25T22:03:19.331 INFO:tasks.workunit.client.0.smithi044.stdout:9/435: dwrite d4/d7/d18/f5a [0,4194304] 0 2024-04-25T22:03:19.331 INFO:tasks.workunit.client.0.smithi044.stdout:4/273: dread dd/d35/f58 [0,4194304] 0 2024-04-25T22:03:19.334 INFO:tasks.workunit.client.0.smithi044.stdout:9/436: creat d4/d37/d54/d84/d64/f96 x:0 0 0 2024-04-25T22:03:19.334 INFO:tasks.workunit.client.0.smithi044.stdout:7/291: mkdir d1c/d22/d28/d30/d32/d5d 0 2024-04-25T22:03:19.335 INFO:tasks.workunit.client.0.smithi044.stdout:5/307: dwrite d2/d5/d27/d2a/d3a/f55 [0,4194304] 0 2024-04-25T22:03:19.337 INFO:tasks.workunit.client.0.smithi044.stdout:1/372: dwrite d3/d7/f3d [0,4194304] 0 2024-04-25T22:03:19.337 INFO:tasks.workunit.client.0.smithi044.stdout:9/437: mkdir d4/d37/d54/d84/d72/d97 0 2024-04-25T22:03:19.337 INFO:tasks.workunit.client.0.smithi044.stdout:7/292: fdatasync d1c/d22/d28/f41 0 2024-04-25T22:03:19.337 INFO:tasks.workunit.client.0.smithi044.stdout:1/373: readlink d3/d30/d3f/l48 0 2024-04-25T22:03:19.338 INFO:tasks.workunit.client.0.smithi044.stdout:1/374: write d3/d7/f2f [1198664,111782] 0 2024-04-25T22:03:19.338 INFO:tasks.workunit.client.0.smithi044.stdout:7/293: rename d1c/f20 to d1c/d22/d28/d4e/f5e 0 2024-04-25T22:03:19.339 INFO:tasks.workunit.client.0.smithi044.stdout:1/375: write d3/d7/db/f15 [1815432,22458] 0 2024-04-25T22:03:19.339 INFO:tasks.workunit.client.0.smithi044.stdout:7/294: creat d1c/d22/d28/d4e/f5f x:0 0 0 2024-04-25T22:03:19.340 INFO:tasks.workunit.client.0.smithi044.stdout:2/336: dwrite d7/d8/d1c/f33 [0,4194304] 0 2024-04-25T22:03:19.340 INFO:tasks.workunit.client.0.smithi044.stdout:7/295: chown d1c/c40 3888763 1 2024-04-25T22:03:19.340 INFO:tasks.workunit.client.0.smithi044.stdout:1/376: mkdir d3/d54/d76 0 2024-04-25T22:03:19.341 INFO:tasks.workunit.client.0.smithi044.stdout:1/377: stat d3/c19 0 2024-04-25T22:03:19.341 INFO:tasks.workunit.client.0.smithi044.stdout:7/296: creat d1c/d22/d28/d57/f60 x:0 0 0 2024-04-25T22:03:19.342 INFO:tasks.workunit.client.0.smithi044.stdout:1/378: write d3/d7/d29/f39 [922593,70349] 0 2024-04-25T22:03:19.343 INFO:tasks.workunit.client.0.smithi044.stdout:7/297: creat d1c/d22/d28/d4e/f61 x:0 0 0 2024-04-25T22:03:19.343 INFO:tasks.workunit.client.0.smithi044.stdout:1/379: creat d3/d7/db/d42/f77 x:0 0 0 2024-04-25T22:03:19.344 INFO:tasks.workunit.client.0.smithi044.stdout:1/380: write d3/d7/db/f46 [256704,18656] 0 2024-04-25T22:03:19.345 INFO:tasks.workunit.client.0.smithi044.stdout:9/438: dread d4/d7/d18/f5a [0,4194304] 0 2024-04-25T22:03:19.345 INFO:tasks.workunit.client.0.smithi044.stdout:1/381: getdents d3/d7/db/d5d 0 2024-04-25T22:03:19.346 INFO:tasks.workunit.client.0.smithi044.stdout:9/439: read d4/d7/d18/d2d/f8f [4008369,104006] 0 2024-04-25T22:03:19.346 INFO:tasks.workunit.client.0.smithi044.stdout:1/382: stat d3/d7/f57 0 2024-04-25T22:03:19.347 INFO:tasks.workunit.client.0.smithi044.stdout:9/440: chown d4/d7/d18/d2d/f38 399609727 1 2024-04-25T22:03:19.347 INFO:tasks.workunit.client.0.smithi044.stdout:1/383: dread - d3/d59/d5c/f74 zero size 2024-04-25T22:03:19.347 INFO:tasks.workunit.client.0.smithi044.stdout:0/332: dread d8/f68 [0,4194304] 0 2024-04-25T22:03:19.347 INFO:tasks.workunit.client.0.smithi044.stdout:9/441: readlink d4/d37/l6b 0 2024-04-25T22:03:19.348 INFO:tasks.workunit.client.0.smithi044.stdout:1/384: write d3/d7/db/f56 [4160086,70049] 0 2024-04-25T22:03:19.349 INFO:tasks.workunit.client.0.smithi044.stdout:9/442: symlink d4/d7/l98 0 2024-04-25T22:03:19.349 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:19.349 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:19.349 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:03:19.349 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:03:19.349 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:19.350 INFO:tasks.workunit.client.0.smithi044.stdout:3/339: truncate d0/d1/d15/d51/dd/f4e 1221254 0 2024-04-25T22:03:19.351 INFO:tasks.workunit.client.0.smithi044.stdout:1/385: creat d3/d53/f78 x:0 0 0 2024-04-25T22:03:19.351 INFO:tasks.workunit.client.0.smithi044.stdout:1/386: sync 2024-04-25T22:03:19.351 INFO:tasks.workunit.client.0.smithi044.stdout:1/387: fsync d3/d7/f69 0 2024-04-25T22:03:19.352 INFO:tasks.workunit.client.0.smithi044.stdout:1/388: getdents d3/d30/d3f 0 2024-04-25T22:03:19.353 INFO:tasks.workunit.client.0.smithi044.stdout:1/389: stat d3/d7/d29/l4d 0 2024-04-25T22:03:19.354 INFO:tasks.workunit.client.0.smithi044.stdout:4/274: write dd/f3b [51217,118268] 0 2024-04-25T22:03:19.354 INFO:tasks.workunit.client.0.smithi044.stdout:5/308: truncate d2/d5/f2f 655112 0 2024-04-25T22:03:19.355 INFO:tasks.workunit.client.0.smithi044.stdout:5/309: sync 2024-04-25T22:03:19.355 INFO:tasks.workunit.client.0.smithi044.stdout:4/275: truncate dd/d19/d38/f5c 957282 0 2024-04-25T22:03:19.356 INFO:tasks.workunit.client.0.smithi044.stdout:5/310: creat d2/d5/d21/f61 x:0 0 0 2024-04-25T22:03:19.356 INFO:tasks.workunit.client.0.smithi044.stdout:4/276: rmdir dd/d19/d38 39 2024-04-25T22:03:19.356 INFO:tasks.workunit.client.0.smithi044.stdout:5/311: rename d2/d5/f41 to d2/d5/d27/f62 0 2024-04-25T22:03:19.357 INFO:tasks.workunit.client.0.smithi044.stdout:1/390: dread d3/d7/f3d [0,4194304] 0 2024-04-25T22:03:19.358 INFO:tasks.workunit.client.0.smithi044.stdout:5/312: creat d2/d5/d27/d2a/d5c/d5f/f63 x:0 0 0 2024-04-25T22:03:19.358 INFO:tasks.workunit.client.0.smithi044.stdout:1/391: write d3/d7/f2a [4323503,126488] 0 2024-04-25T22:03:19.359 INFO:tasks.workunit.client.0.smithi044.stdout:1/392: chown d3/d7/db/f56 504395 1 2024-04-25T22:03:19.362 INFO:tasks.workunit.client.0.smithi044.stdout:4/277: dwrite dd/f4b [0,4194304] 0 2024-04-25T22:03:19.363 INFO:tasks.workunit.client.0.smithi044.stdout:4/278: creat dd/d35/f5f x:0 0 0 2024-04-25T22:03:19.363 INFO:tasks.workunit.client.0.smithi044.stdout:4/279: fdatasync dd/d35/f47 0 2024-04-25T22:03:19.366 INFO:tasks.workunit.client.0.smithi044.stdout:4/280: creat dd/d35/d52/f60 x:0 0 0 2024-04-25T22:03:19.366 INFO:tasks.workunit.client.0.smithi044.stdout:4/281: rmdir dd/d19/d38/d4c 0 2024-04-25T22:03:19.366 INFO:tasks.workunit.client.0.smithi044.stdout:4/282: read - dd/d35/d52/f60 zero size 2024-04-25T22:03:19.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:19.371 INFO:tasks.workunit.client.0.smithi044.stdout:3/340: dread d0/d1/d34/f58 [0,4194304] 0 2024-04-25T22:03:19.372 INFO:tasks.workunit.client.0.smithi044.stdout:4/283: dwrite dd/d35/f47 [4194304,4194304] 0 2024-04-25T22:03:19.372 INFO:tasks.workunit.client.0.smithi044.stdout:3/341: mknod d0/d13/d1c/c6d 0 2024-04-25T22:03:19.373 INFO:tasks.workunit.client.0.smithi044.stdout:4/284: mkdir dd/d35/d52/d61 0 2024-04-25T22:03:19.373 INFO:tasks.workunit.client.0.smithi044.stdout:4/285: rmdir dd 39 2024-04-25T22:03:19.374 INFO:tasks.workunit.client.0.smithi044.stdout:3/342: write d0/d1/d34/f58 [5091752,11953] 0 2024-04-25T22:03:19.375 INFO:tasks.workunit.client.0.smithi044.stdout:3/343: unlink d0/d1/d15/d51/dd/d11/f2c 0 2024-04-25T22:03:19.376 INFO:tasks.workunit.client.0.smithi044.stdout:3/344: rename d0/d1/l9 to d0/d1/d15/d51/d39/l6e 0 2024-04-25T22:03:19.377 INFO:tasks.workunit.client.0.smithi044.stdout:3/345: rename d0/d1/d15 to d0/d1/d15/d51/dd/d11/d42/d6f 22 2024-04-25T22:03:19.379 INFO:tasks.workunit.client.0.smithi044.stdout:4/286: dwrite fa [0,4194304] 0 2024-04-25T22:03:19.380 INFO:tasks.workunit.client.0.smithi044.stdout:2/337: truncate d7/d16/d2c/f3b 1686952 0 2024-04-25T22:03:19.381 INFO:tasks.workunit.client.0.smithi044.stdout:0/333: truncate d8/d24/f28 3897189 0 2024-04-25T22:03:19.382 INFO:tasks.workunit.client.0.smithi044.stdout:2/338: symlink d7/d16/d2d/d57/l6c 0 2024-04-25T22:03:19.384 INFO:tasks.workunit.client.0.smithi044.stdout:0/334: write d8/da/f59 [61830,29043] 0 2024-04-25T22:03:19.384 INFO:tasks.workunit.client.0.smithi044.stdout:3/346: dwrite d0/f5c [0,4194304] 0 2024-04-25T22:03:19.384 INFO:tasks.workunit.client.0.smithi044.stdout:2/339: link d7/d8/d1c/f33 d7/d16/d2c/f6d 0 2024-04-25T22:03:19.385 INFO:tasks.workunit.client.0.smithi044.stdout:3/347: mkdir d0/d70 0 2024-04-25T22:03:19.387 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:19.384+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:19.388 INFO:tasks.workunit.client.0.smithi044.stdout:3/348: chown d0/d1/d15/c1d 118300 1 2024-04-25T22:03:19.390 INFO:tasks.workunit.client.0.smithi044.stdout:4/287: dwrite dd/f11 [4194304,4194304] 0 2024-04-25T22:03:19.392 INFO:tasks.workunit.client.0.smithi044.stdout:3/349: chown d0/l24 92169785 1 2024-04-25T22:03:19.393 INFO:tasks.workunit.client.0.smithi044.stdout:7/298: dwrite d1c/d22/d28/d4e/f5e [0,4194304] 0 2024-04-25T22:03:19.393 INFO:tasks.workunit.client.0.smithi044.stdout:8/447: dread d2a/f36 [0,4194304] 0 2024-04-25T22:03:19.394 INFO:tasks.workunit.client.0.smithi044.stdout:7/299: stat cf 0 2024-04-25T22:03:19.395 INFO:tasks.workunit.client.0.smithi044.stdout:5/313: dwrite d2/d5/f2f [0,4194304] 0 2024-04-25T22:03:19.395 INFO:tasks.workunit.client.0.smithi044.stdout:8/448: chown f23 100255 1 2024-04-25T22:03:19.396 INFO:tasks.workunit.client.0.smithi044.stdout:0/335: dwrite f6 [0,4194304] 0 2024-04-25T22:03:19.396 INFO:tasks.workunit.client.0.smithi044.stdout:7/300: chown d1c/d22/f34 6623 1 2024-04-25T22:03:19.397 INFO:tasks.workunit.client.0.smithi044.stdout:9/443: dread d4/d7/d18/d2e/f3f [0,4194304] 0 2024-04-25T22:03:19.397 INFO:tasks.workunit.client.0.smithi044.stdout:5/314: fsync d2/d5/d27/d2a/d5c/d5f/f63 0 2024-04-25T22:03:19.398 INFO:tasks.workunit.client.0.smithi044.stdout:7/301: rename d1c/d22/d28/f35 to d1c/d22/d4a/f62 0 2024-04-25T22:03:19.398 INFO:tasks.workunit.client.0.smithi044.stdout:5/315: chown d2/d5/d21/d26/d2c/f4c 102 1 2024-04-25T22:03:19.399 INFO:tasks.workunit.client.0.smithi044.stdout:4/288: dread dd/f17 [0,4194304] 0 2024-04-25T22:03:19.400 INFO:tasks.workunit.client.0.smithi044.stdout:9/444: read d4/f40 [60641,2192] 0 2024-04-25T22:03:19.400 INFO:tasks.workunit.client.0.smithi044.stdout:9/445: chown d4/d7/d18/d3a/d8b 89 1 2024-04-25T22:03:19.402 INFO:tasks.workunit.client.0.smithi044.stdout:5/316: rename d2/d5/cd to d2/d5/d21/c64 0 2024-04-25T22:03:19.402 INFO:tasks.workunit.client.0.smithi044.stdout:4/289: getdents dd 0 2024-04-25T22:03:19.403 INFO:tasks.workunit.client.0.smithi044.stdout:7/302: dread f0 [0,4194304] 0 2024-04-25T22:03:19.404 INFO:tasks.workunit.client.0.smithi044.stdout:7/303: chown d1c/d22/f5c 9 1 2024-04-25T22:03:19.406 INFO:tasks.workunit.client.0.smithi044.stdout:4/290: mknod dd/d19/d38/c62 0 2024-04-25T22:03:19.407 INFO:tasks.workunit.client.0.smithi044.stdout:3/350: write d0/f31 [518011,36772] 0 2024-04-25T22:03:19.407 INFO:tasks.workunit.client.0.smithi044.stdout:7/304: getdents d1c 0 2024-04-25T22:03:19.408 INFO:tasks.workunit.client.0.smithi044.stdout:4/291: symlink dd/d19/d38/l63 0 2024-04-25T22:03:19.409 INFO:tasks.workunit.client.0.smithi044.stdout:9/446: dwrite d4/f32 [0,4194304] 0 2024-04-25T22:03:19.409 INFO:tasks.workunit.client.0.smithi044.stdout:3/351: unlink d0/d1/d15/d51/f29 0 2024-04-25T22:03:19.410 INFO:tasks.workunit.client.0.smithi044.stdout:9/447: stat d4/d7/d18/d2e/d94 0 2024-04-25T22:03:19.410 INFO:tasks.workunit.client.0.smithi044.stdout:4/292: creat dd/d19/d38/f64 x:0 0 0 2024-04-25T22:03:19.411 INFO:tasks.workunit.client.0.smithi044.stdout:3/352: write d0/d1/d15/d51/dd/d28/f3f [1028422,8917] 0 2024-04-25T22:03:19.412 INFO:tasks.workunit.client.0.smithi044.stdout:5/317: dwrite d2/d5/d21/d26/d2c/f4c [0,4194304] 0 2024-04-25T22:03:19.412 INFO:tasks.workunit.client.0.smithi044.stdout:5/318: readlink d2/d5/l33 0 2024-04-25T22:03:19.412 INFO:tasks.workunit.client.0.smithi044.stdout:2/340: dread d7/d8/d1c/f67 [0,4194304] 0 2024-04-25T22:03:19.413 INFO:tasks.workunit.client.0.smithi044.stdout:0/336: dread d8/da/f59 [0,4194304] 0 2024-04-25T22:03:19.414 INFO:tasks.workunit.client.0.smithi044.stdout:4/293: rename dd/d19/c2f to dd/d35/d52/c65 0 2024-04-25T22:03:19.414 INFO:tasks.workunit.client.0.smithi044.stdout:3/353: mkdir d0/d1/d15/df/d5d/d71 0 2024-04-25T22:03:19.414 INFO:tasks.workunit.client.0.smithi044.stdout:5/319: symlink d2/d5/d27/d2a/d3a/l65 0 2024-04-25T22:03:19.414 INFO:tasks.workunit.client.0.smithi044.stdout:2/341: unlink d7/d8/d1c/f21 0 2024-04-25T22:03:19.416 INFO:tasks.workunit.client.0.smithi044.stdout:3/354: write d0/d1/d15/d51/dd/d35/f52 [2214103,103897] 0 2024-04-25T22:03:19.417 INFO:tasks.workunit.client.0.smithi044.stdout:0/337: mknod d8/da/d60/c6f 0 2024-04-25T22:03:19.417 INFO:tasks.workunit.client.0.smithi044.stdout:5/320: rename d2/d5/d27/d2a/d3a/l65 to d2/l66 0 2024-04-25T22:03:19.417 INFO:tasks.workunit.client.0.smithi044.stdout:4/294: creat dd/d35/d52/d61/f66 x:0 0 0 2024-04-25T22:03:19.417 INFO:tasks.workunit.client.0.smithi044.stdout:2/342: symlink d7/d16/d2d/d4e/d2e/d6b/l6e 0 2024-04-25T22:03:19.418 INFO:tasks.workunit.client.0.smithi044.stdout:3/355: chown d0/d1/d15/d51/dd/d28/l63 43 1 2024-04-25T22:03:19.419 INFO:tasks.workunit.client.0.smithi044.stdout:4/295: write dd/f4b [298989,130693] 0 2024-04-25T22:03:19.419 INFO:tasks.workunit.client.0.smithi044.stdout:9/448: dwrite d4/d7/d79/f8e [0,4194304] 0 2024-04-25T22:03:19.421 INFO:tasks.workunit.client.0.smithi044.stdout:7/305: dread d1c/d22/d28/d30/d32/f39 [0,4194304] 0 2024-04-25T22:03:19.421 INFO:tasks.workunit.client.0.smithi044.stdout:5/321: write d2/d5/d21/d26/d2c/f34 [1781625,39131] 0 2024-04-25T22:03:19.424 INFO:tasks.workunit.client.0.smithi044.stdout:5/322: creat d2/d5/d27/d2a/d5c/f67 x:0 0 0 2024-04-25T22:03:19.426 INFO:tasks.workunit.client.0.smithi044.stdout:5/323: symlink d2/d5/l68 0 2024-04-25T22:03:19.430 INFO:tasks.workunit.client.0.smithi044.stdout:0/338: dwrite d8/df/f54 [0,4194304] 0 2024-04-25T22:03:19.431 INFO:tasks.workunit.client.0.smithi044.stdout:2/343: dwrite d7/d16/d2d/d4e/f37 [0,4194304] 0 2024-04-25T22:03:19.431 INFO:tasks.workunit.client.0.smithi044.stdout:5/324: rmdir d2/d5/d21/d26/d2c 39 2024-04-25T22:03:19.431 INFO:tasks.workunit.client.0.smithi044.stdout:9/449: dwrite d4/d7/d18/d2e/f4c [0,4194304] 0 2024-04-25T22:03:19.431 INFO:tasks.workunit.client.0.smithi044.stdout:2/344: write d7/f3f [1124170,3238] 0 2024-04-25T22:03:19.431 INFO:tasks.workunit.client.0.smithi044.stdout:0/339: truncate d8/d15/d51/d65/f6b 757281 0 2024-04-25T22:03:19.431 INFO:tasks.workunit.client.0.smithi044.stdout:5/325: write d2/d5/d21/d26/d2c/f34 [144662,90377] 0 2024-04-25T22:03:19.432 INFO:tasks.workunit.client.0.smithi044.stdout:0/340: symlink d8/d24/l70 0 2024-04-25T22:03:19.432 INFO:tasks.workunit.client.0.smithi044.stdout:9/450: rename d4/d7/d18/d2d/f8f to d4/d4b/d86/f99 0 2024-04-25T22:03:19.432 INFO:tasks.workunit.client.0.smithi044.stdout:2/345: creat d7/d8/f6f x:0 0 0 2024-04-25T22:03:19.432 INFO:tasks.workunit.client.0.smithi044.stdout:0/341: dread d8/da/f59 [0,4194304] 0 2024-04-25T22:03:19.433 INFO:tasks.workunit.client.0.smithi044.stdout:9/451: write d4/d7/d18/f7a [436736,51097] 0 2024-04-25T22:03:19.433 INFO:tasks.workunit.client.0.smithi044.stdout:2/346: mkdir d7/d8/d5f/d70 0 2024-04-25T22:03:19.433 INFO:tasks.workunit.client.0.smithi044.stdout:0/342: chown d8/d15/d51/d65/f6b 19 1 2024-04-25T22:03:19.434 INFO:tasks.workunit.client.0.smithi044.stdout:9/452: chown d4/d7/d18/f5a 24484 1 2024-04-25T22:03:19.435 INFO:teuthology.orchestra.run.smithi044.stdout:moved 0 / 210 (0%) 2024-04-25T22:03:19.435 INFO:teuthology.orchestra.run.smithi044.stdout:avg 70 2024-04-25T22:03:19.435 INFO:teuthology.orchestra.run.smithi044.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-04-25T22:03:19.435 INFO:teuthology.orchestra.run.smithi044.stdout:min osd.2 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-04-25T22:03:19.435 INFO:teuthology.orchestra.run.smithi044.stdout:max osd.1 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-04-25T22:03:19.435 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:03:19.435 INFO:teuthology.orchestra.run.smithi044.stdout:oload 1000 2024-04-25T22:03:19.435 INFO:teuthology.orchestra.run.smithi044.stdout:max_change 3 2024-04-25T22:03:19.435 INFO:teuthology.orchestra.run.smithi044.stdout:max_change_osds 4 2024-04-25T22:03:19.435 INFO:teuthology.orchestra.run.smithi044.stdout:average_utilization 0.0010 2024-04-25T22:03:19.435 INFO:teuthology.orchestra.run.smithi044.stdout:overload_utilization 0.0104 2024-04-25T22:03:19.436 INFO:teuthology.orchestra.run.smithi044.stderr:no change 2024-04-25T22:03:19.436 INFO:tasks.workunit.client.0.smithi044.stdout:0/343: write d8/da/f59 [776177,47626] 0 2024-04-25T22:03:19.436 INFO:tasks.workunit.client.0.smithi044.stdout:2/347: link d7/d16/d2d/d4e/f36 d7/d8/d1c/d26/d44/f71 0 2024-04-25T22:03:19.436 INFO:tasks.workunit.client.0.smithi044.stdout:4/296: dread dd/f34 [0,4194304] 0 2024-04-25T22:03:19.436 INFO:tasks.workunit.client.0.smithi044.stdout:6/414: dread d2/d23/d5a/d13/d68/f72 [0,4194304] 0 2024-04-25T22:03:19.437 INFO:tasks.workunit.client.0.smithi044.stdout:4/297: fsync dd/d19/f27 0 2024-04-25T22:03:19.437 INFO:tasks.workunit.client.0.smithi044.stdout:9/453: mkdir d4/d7/d18/d2d/d70/d9a 0 2024-04-25T22:03:19.437 INFO:tasks.workunit.client.0.smithi044.stdout:0/344: rename d8/d24/f26 to d8/d15/d51/f71 0 2024-04-25T22:03:19.437 INFO:tasks.workunit.client.0.smithi044.stdout:4/298: chown dd/d35/d52/l59 0 1 2024-04-25T22:03:19.438 INFO:tasks.workunit.client.0.smithi044.stdout:9/454: mkdir d4/d37/d9b 0 2024-04-25T22:03:19.438 INFO:tasks.workunit.client.0.smithi044.stdout:9/455: creat d4/d3d/f9c x:0 0 0 2024-04-25T22:03:19.439 INFO:tasks.workunit.client.0.smithi044.stdout:9/456: fsync d4/d7/d18/d2d/f38 0 2024-04-25T22:03:19.441 INFO:tasks.workunit.client.0.smithi044.stdout:9/457: rename d4/d7/d18/d2d/f51 to d4/d37/d54/d84/d72/d97/f9d 0 2024-04-25T22:03:19.442 INFO:tasks.workunit.client.0.smithi044.stdout:9/458: creat d4/d37/d54/d84/d64/f9e x:0 0 0 2024-04-25T22:03:19.443 INFO:tasks.workunit.client.0.smithi044.stdout:6/415: dwrite d2/d23/d5a/d13/d4b/f54 [0,4194304] 0 2024-04-25T22:03:19.444 INFO:tasks.workunit.client.0.smithi044.stdout:9/459: write d4/d37/d54/d84/d64/f9e [504406,60979] 0 2024-04-25T22:03:19.444 INFO:tasks.workunit.client.0.smithi044.stdout:4/299: dwrite dd/d19/f32 [0,4194304] 0 2024-04-25T22:03:19.445 INFO:tasks.workunit.client.0.smithi044.stdout:9/460: mkdir d4/d7/d18/d9f 0 2024-04-25T22:03:19.446 INFO:tasks.workunit.client.0.smithi044.stdout:6/416: mkdir d2/d23/d5a/d13/d4b/d5e/d92 0 2024-04-25T22:03:19.446 INFO:tasks.workunit.client.0.smithi044.stdout:4/300: mknod dd/d19/c67 0 2024-04-25T22:03:19.446 INFO:tasks.workunit.client.0.smithi044.stdout:9/461: stat d4/d37/d54/d84/c6a 0 2024-04-25T22:03:19.447 INFO:tasks.workunit.client.0.smithi044.stdout:6/417: write d2/d23/d5a/d13/d4b/f8c [1030121,62977] 0 2024-04-25T22:03:19.447 INFO:tasks.workunit.client.0.smithi044.stdout:4/301: write dd/d19/f3d [1033543,120381] 0 2024-04-25T22:03:19.447 INFO:tasks.workunit.client.0.smithi044.stdout:4/302: stat dd/d19/c20 0 2024-04-25T22:03:19.448 INFO:tasks.workunit.client.0.smithi044.stdout:6/418: write d2/d23/d5a/f1b [4940271,18548] 0 2024-04-25T22:03:19.449 INFO:tasks.workunit.client.0.smithi044.stdout:4/303: symlink dd/d35/d52/d61/l68 0 2024-04-25T22:03:19.450 INFO:tasks.workunit.client.0.smithi044.stdout:6/419: rename d2 to d2/d23/d5a/d12/d93 22 2024-04-25T22:03:19.452 INFO:tasks.workunit.client.0.smithi044.stdout:3/356: dread d0/d1/d15/d23/f40 [0,4194304] 0 2024-04-25T22:03:19.452 INFO:tasks.workunit.client.0.smithi044.stdout:6/420: getdents d2/d23 0 2024-04-25T22:03:19.452 INFO:tasks.workunit.client.0.smithi044.stdout:3/357: fsync d0/d13/f37 0 2024-04-25T22:03:19.453 INFO:tasks.workunit.client.0.smithi044.stdout:3/358: fsync d0/f38 0 2024-04-25T22:03:19.453 INFO:tasks.workunit.client.0.smithi044.stdout:6/421: mkdir d2/d23/d5a/d12/d1f/d94 0 2024-04-25T22:03:19.453 INFO:tasks.workunit.client.0.smithi044.stdout:9/462: dwrite d4/d3d/f68 [0,4194304] 0 2024-04-25T22:03:19.453 INFO:tasks.workunit.client.0.smithi044.stdout:6/422: dread - d2/d23/d5a/d11/f88 zero size 2024-04-25T22:03:19.454 INFO:tasks.workunit.client.0.smithi044.stdout:3/359: mknod d0/d1/d15/c72 0 2024-04-25T22:03:19.455 INFO:tasks.workunit.client.0.smithi044.stdout:6/423: creat d2/d23/d5a/d12/d70/f95 x:0 0 0 2024-04-25T22:03:19.455 INFO:tasks.workunit.client.0.smithi044.stdout:6/424: fdatasync d2/d23/d5a/d12/f19 0 2024-04-25T22:03:19.456 INFO:tasks.workunit.client.0.smithi044.stdout:6/425: unlink d2/d23/d5a/d12/d70/f95 0 2024-04-25T22:03:19.458 INFO:tasks.workunit.client.0.smithi044.stdout:6/426: unlink d2/d23/d5a/d12/d49/d7f/l8f 0 2024-04-25T22:03:19.459 INFO:tasks.workunit.client.0.smithi044.stdout:9/463: dwrite d4/f7f [0,4194304] 0 2024-04-25T22:03:19.465 INFO:tasks.workunit.client.0.smithi044.stdout:8/449: dread d2a/f2f [0,4194304] 0 2024-04-25T22:03:19.467 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-04-25T22:03:19.467 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 1.0 2024-04-25T22:03:19.467 INFO:tasks.workunit.client.0.smithi044.stdout:8/450: write d2a/d32/d57/d5e/f8a [536510,28703] 0 2024-04-25T22:03:19.468 INFO:tasks.workunit.client.0.smithi044.stdout:8/451: write d2a/d52/f72 [1523679,75390] 0 2024-04-25T22:03:19.468 INFO:tasks.workunit.client.0.smithi044.stdout:8/452: getdents d2a/d39/d5a/d8e 0 2024-04-25T22:03:19.469 INFO:tasks.workunit.client.0.smithi044.stdout:1/393: dread d3/d7/f2f [0,4194304] 0 2024-04-25T22:03:19.473 INFO:tasks.workunit.client.0.smithi044.stdout:2/348: sync 2024-04-25T22:03:19.480 INFO:tasks.workunit.client.0.smithi044.stdout:7/306: write d1c/d22/d4a/f62 [809194,129252] 0 2024-04-25T22:03:19.480 INFO:tasks.workunit.client.0.smithi044.stdout:7/307: dread - d1c/d22/f49 zero size 2024-04-25T22:03:19.481 INFO:tasks.workunit.client.0.smithi044.stdout:5/326: write d2/d5/f16 [458112,87482] 0 2024-04-25T22:03:19.482 INFO:tasks.workunit.client.0.smithi044.stdout:0/345: write d8/f2b [4112723,60243] 0 2024-04-25T22:03:19.482 INFO:tasks.workunit.client.0.smithi044.stdout:4/304: truncate dd/f11 8081514 0 2024-04-25T22:03:19.483 INFO:tasks.workunit.client.0.smithi044.stdout:6/427: stat d2/d23/d5a/d13/d4b/d5e/d92 0 2024-04-25T22:03:19.484 INFO:tasks.workunit.client.0.smithi044.stdout:5/327: write d2/d5/d27/f36 [4010963,47939] 0 2024-04-25T22:03:19.484 INFO:tasks.workunit.client.0.smithi044.stdout:3/360: write d0/d13/d1c/f30 [2571435,79585] 0 2024-04-25T22:03:19.484 INFO:tasks.workunit.client.0.smithi044.stdout:9/464: write d4/f1a [2994883,57797] 0 2024-04-25T22:03:19.485 INFO:tasks.workunit.client.0.smithi044.stdout:9/465: rmdir d4/d7/d18/d2e 39 2024-04-25T22:03:19.485 INFO:tasks.workunit.client.0.smithi044.stdout:3/361: creat d0/d70/f73 x:0 0 0 2024-04-25T22:03:19.486 INFO:tasks.workunit.client.0.smithi044.stdout:6/428: link d2/d23/d5a/d12/f19 d2/d23/d6a/f96 0 2024-04-25T22:03:19.486 INFO:tasks.workunit.client.0.smithi044.stdout:5/328: mknod d2/d5/d27/d2a/d5c/d5f/c69 0 2024-04-25T22:03:19.486 INFO:tasks.workunit.client.0.smithi044.stdout:1/394: truncate d3/f34 4243520 0 2024-04-25T22:03:19.488 INFO:tasks.workunit.client.0.smithi044.stdout:5/329: unlink d2/d5/d27/d2a/d48/f4f 0 2024-04-25T22:03:19.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:19.485+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:19.489 INFO:tasks.workunit.client.0.smithi044.stdout:6/429: fdatasync d2/d23/d5a/d12/d49/f5b 0 2024-04-25T22:03:19.489 INFO:tasks.workunit.client.0.smithi044.stdout:1/395: symlink d3/d72/l79 0 2024-04-25T22:03:19.489 INFO:tasks.workunit.client.0.smithi044.stdout:3/362: truncate d0/d70/f73 210714 0 2024-04-25T22:03:19.491 INFO:tasks.workunit.client.0.smithi044.stdout:6/430: stat d2/d23/d5a/d13/f5f 0 2024-04-25T22:03:19.491 INFO:tasks.workunit.client.0.smithi044.stdout:1/396: symlink d3/d30/d3f/l7a 0 2024-04-25T22:03:19.491 INFO:tasks.workunit.client.0.smithi044.stdout:9/466: dread d4/d7/d18/f4f [0,4194304] 0 2024-04-25T22:03:19.493 INFO:tasks.workunit.client.0.smithi044.stdout:0/346: dwrite d8/df/f5d [0,4194304] 0 2024-04-25T22:03:19.493 INFO:tasks.workunit.client.0.smithi044.stdout:6/431: chown d2/d23/d30/f3e 17892489 1 2024-04-25T22:03:19.493 INFO:tasks.workunit.client.0.smithi044.stdout:4/305: dwrite dd/d35/d52/f5b [0,4194304] 0 2024-04-25T22:03:19.493 INFO:tasks.workunit.client.0.smithi044.stdout:1/397: mkdir d3/d7/db/d42/d7b 0 2024-04-25T22:03:19.493 INFO:tasks.workunit.client.0.smithi044.stdout:3/363: mkdir d0/d1/d15/df/d5d/d71/d74 0 2024-04-25T22:03:19.494 INFO:tasks.workunit.client.0.smithi044.stdout:4/306: creat dd/f69 x:0 0 0 2024-04-25T22:03:19.494 INFO:tasks.workunit.client.0.smithi044.stdout:0/347: symlink d8/df/l72 0 2024-04-25T22:03:19.495 INFO:tasks.workunit.client.0.smithi044.stdout:3/364: rename d0/d1/d15/d51 to d0/d1/d15/d51/dd/d28/d75 22 2024-04-25T22:03:19.495 INFO:tasks.workunit.client.0.smithi044.stdout:3/365: fsync d0/d70/f73 0 2024-04-25T22:03:19.496 INFO:tasks.workunit.client.0.smithi044.stdout:6/432: chown d2/d23/d5a/d12/d27/c40 11 1 2024-04-25T22:03:19.497 INFO:tasks.workunit.client.0.smithi044.stdout:0/348: creat d8/da/d60/f73 x:0 0 0 2024-04-25T22:03:19.497 INFO:tasks.workunit.client.0.smithi044.stdout:6/433: fsync d2/d23/d5a/f62 0 2024-04-25T22:03:19.497 INFO:tasks.workunit.client.0.smithi044.stdout:3/366: unlink d0/d70/f73 0 2024-04-25T22:03:19.498 INFO:tasks.workunit.client.0.smithi044.stdout:3/367: read d0/d1/d15/d51/dd/d35/f52 [1009609,80270] 0 2024-04-25T22:03:19.499 INFO:tasks.workunit.client.0.smithi044.stdout:8/453: dread f8 [4194304,4194304] 0 2024-04-25T22:03:19.500 INFO:tasks.workunit.client.0.smithi044.stdout:4/307: creat dd/d35/d52/f6a x:0 0 0 2024-04-25T22:03:19.500 INFO:tasks.workunit.client.0.smithi044.stdout:8/454: creat d2a/d39/d42/d68/d6b/d7b/f95 x:0 0 0 2024-04-25T22:03:19.501 INFO:tasks.workunit.client.0.smithi044.stdout:4/308: dread - dd/f36 zero size 2024-04-25T22:03:19.501 INFO:tasks.workunit.client.0.smithi044.stdout:1/398: write d3/d30/d3f/f5a [991173,22724] 0 2024-04-25T22:03:19.501 INFO:tasks.workunit.client.0.smithi044.stdout:8/455: dread - d2a/d32/d3e/f6a zero size 2024-04-25T22:03:19.502 INFO:tasks.workunit.client.0.smithi044.stdout:3/368: read d0/d13/f37 [4191149,39299] 0 2024-04-25T22:03:19.502 INFO:tasks.workunit.client.0.smithi044.stdout:2/349: dread d7/d16/f20 [0,4194304] 0 2024-04-25T22:03:19.503 INFO:tasks.workunit.client.0.smithi044.stdout:1/399: write d3/d53/f78 [415897,45846] 0 2024-04-25T22:03:19.503 INFO:tasks.workunit.client.0.smithi044.stdout:9/467: read d4/d7/d18/d2e/f34 [2296561,129615] 0 2024-04-25T22:03:19.503 INFO:tasks.workunit.client.0.smithi044.stdout:4/309: symlink dd/d35/d52/l6b 0 2024-04-25T22:03:19.503 INFO:tasks.workunit.client.0.smithi044.stdout:6/434: truncate d2/d23/d5a/d11/d3b/f32 3936699 0 2024-04-25T22:03:19.504 INFO:tasks.workunit.client.0.smithi044.stdout:8/456: creat d2a/d39/d42/d68/d6b/d6e/d84/f96 x:0 0 0 2024-04-25T22:03:19.504 INFO:tasks.workunit.client.0.smithi044.stdout:3/369: readlink d0/l26 0 2024-04-25T22:03:19.504 INFO:tasks.workunit.client.0.smithi044.stdout:8/457: stat d2a/d32/f3d 0 2024-04-25T22:03:19.504 INFO:tasks.workunit.client.0.smithi044.stdout:4/310: fdatasync dd/d35/d52/f6a 0 2024-04-25T22:03:19.505 INFO:tasks.workunit.client.0.smithi044.stdout:9/468: write d4/d37/f59 [334419,27973] 0 2024-04-25T22:03:19.505 INFO:tasks.workunit.client.0.smithi044.stdout:2/350: rename d7/f14 to d7/d16/d4b/f72 0 2024-04-25T22:03:19.505 INFO:tasks.workunit.client.0.smithi044.stdout:6/435: fsync d2/d23/d5a/d13/d68/f50 0 2024-04-25T22:03:19.505 INFO:tasks.workunit.client.0.smithi044.stdout:8/458: creat d2a/d39/f97 x:0 0 0 2024-04-25T22:03:19.506 INFO:tasks.workunit.client.0.smithi044.stdout:2/351: write d7/f31 [1173852,1723] 0 2024-04-25T22:03:19.506 INFO:tasks.workunit.client.0.smithi044.stdout:4/311: dread - dd/d19/d38/f5d zero size 2024-04-25T22:03:19.506 INFO:tasks.workunit.client.0.smithi044.stdout:9/469: rmdir d4/d37/d9b 0 2024-04-25T22:03:19.508 INFO:tasks.workunit.client.0.smithi044.stdout:8/459: fsync d2a/d39/d42/f49 0 2024-04-25T22:03:19.508 INFO:tasks.workunit.client.0.smithi044.stdout:9/470: truncate d4/d7/d18/d2e/d73/f7c 795539 0 2024-04-25T22:03:19.509 INFO:tasks.workunit.client.0.smithi044.stdout:8/460: creat d2a/d32/d57/f98 x:0 0 0 2024-04-25T22:03:19.510 INFO:tasks.workunit.client.0.smithi044.stdout:3/370: dread d0/f5c [0,4194304] 0 2024-04-25T22:03:19.510 INFO:tasks.workunit.client.0.smithi044.stdout:9/471: write d4/d7/d18/d2e/f5d [2319467,106428] 0 2024-04-25T22:03:19.512 INFO:tasks.workunit.client.0.smithi044.stdout:8/461: write d2a/d39/d42/d68/d6b/d7b/f95 [434795,5461] 0 2024-04-25T22:03:19.514 INFO:tasks.workunit.client.0.smithi044.stdout:9/472: mknod d4/d7/d18/d2d/ca0 0 2024-04-25T22:03:19.515 INFO:tasks.workunit.client.0.smithi044.stdout:0/349: dread d8/d20/f31 [0,4194304] 0 2024-04-25T22:03:19.515 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:19.515 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:03:19.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:03:19.515 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:19.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.516 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:4 4.32 e51/16 4:4def72d4:::10000000003.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:03:19.516 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:19.516 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.519837612, 2024-04-25T22:03:19.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10987878, 2024-04-25T22:03:19.516 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.516 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.516 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:19.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:19.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992461+0000", 2024-04-25T22:03:19.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5780000000000001e-06 2024-04-25T22:03:19.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997784+0000", 2024-04-25T22:03:19.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005323627 2024-04-25T22:03:19.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997815+0000", 2024-04-25T22:03:19.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0066999999999999e-05 2024-04-25T22:03:19.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997830+0000", 2024-04-25T22:03:19.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5290000000000001e-05 2024-04-25T22:03:19.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997927+0000", 2024-04-25T22:03:19.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7391000000000003e-05 2024-04-25T22:03:19.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997947+0000", 2024-04-25T22:03:19.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0259999999999999e-05 2024-04-25T22:03:19.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102225+0000", 2024-04-25T22:03:19.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10427777100000001 2024-04-25T22:03:19.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102337+0000", 2024-04-25T22:03:19.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000111796 2024-04-25T22:03:19.521 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.521 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.521 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.521 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:6 4.13 e51/16 4:cbe72331:::10000000003.00000002:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:19.521 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:19.521 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.425023628000002, 2024-04-25T22:03:19.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.11536371400000001, 2024-04-25T22:03:19.521 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.521 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.522 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:19.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:19.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087273+0000", 2024-04-25T22:03:19.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:03:19.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089358+0000", 2024-04-25T22:03:19.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0020848170000000001 2024-04-25T22:03:19.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089372+0000", 2024-04-25T22:03:19.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.452e-05 2024-04-25T22:03:19.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089381+0000", 2024-04-25T22:03:19.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5979999999999997e-06 2024-04-25T22:03:19.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089486+0000", 2024-04-25T22:03:19.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105573 2024-04-25T22:03:19.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089536+0000", 2024-04-25T22:03:19.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9505000000000001e-05 2024-04-25T22:03:19.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202556+0000", 2024-04-25T22:03:19.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.113020169 2024-04-25T22:03:19.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202636+0000", 2024-04-25T22:03:19.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9814000000000005e-05 2024-04-25T22:03:19.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.525 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.525 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:5 4.10 e51/16 4:09a4c37f:::10000000003.00000001:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:19.525 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:19.525 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.412447710999999, 2024-04-25T22:03:19.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.110104358, 2024-04-25T22:03:19.525 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.526 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.526 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:19.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:19.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099849+0000", 2024-04-25T22:03:19.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7000000000000003e-07 2024-04-25T22:03:19.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108349+0000", 2024-04-25T22:03:19.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085003230000000006 2024-04-25T22:03:19.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108391+0000", 2024-04-25T22:03:19.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2011999999999997e-05 2024-04-25T22:03:19.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108415+0000", 2024-04-25T22:03:19.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3702000000000001e-05 2024-04-25T22:03:19.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108504+0000", 2024-04-25T22:03:19.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8684999999999995e-05 2024-04-25T22:03:19.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108520+0000", 2024-04-25T22:03:19.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5931999999999999e-05 2024-04-25T22:03:19.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209918+0000", 2024-04-25T22:03:19.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.101398696 2024-04-25T22:03:19.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209952+0000", 2024-04-25T22:03:19.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4038000000000002e-05 2024-04-25T22:03:19.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.529 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.529 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11 4.28 e51/49 4:177a762d:::10000000201.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:19.529 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:19.530 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.403745785000002, 2024-04-25T22:03:19.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098799331000000004, 2024-04-25T22:03:19.530 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.530 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.530 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:19.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:19.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108551+0000", 2024-04-25T22:03:19.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0699999999999996e-07 2024-04-25T22:03:19.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108576+0000", 2024-04-25T22:03:19.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4856000000000001e-05 2024-04-25T22:03:19.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108593+0000", 2024-04-25T22:03:19.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7125999999999998e-05 2024-04-25T22:03:19.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108609+0000", 2024-04-25T22:03:19.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6535999999999999e-05 2024-04-25T22:03:19.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108713+0000", 2024-04-25T22:03:19.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010344999999999999 2024-04-25T22:03:19.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108762+0000", 2024-04-25T22:03:19.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8711000000000002e-05 2024-04-25T22:03:19.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207305+0000", 2024-04-25T22:03:19.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098543566999999999 2024-04-25T22:03:19.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207349+0000", 2024-04-25T22:03:19.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4178000000000003e-05 2024-04-25T22:03:19.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.534 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:12 4.28 e51/49 4:15246602:::10000000202.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:03:19.534 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:19.534 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.403664494000001, 2024-04-25T22:03:19.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098749009999999998, 2024-04-25T22:03:19.534 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.534 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.534 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:19.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:19.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108632+0000", 2024-04-25T22:03:19.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2699999999999999e-07 2024-04-25T22:03:19.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108647+0000", 2024-04-25T22:03:19.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4585e-05 2024-04-25T22:03:19.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108667+0000", 2024-04-25T22:03:19.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9887000000000001e-05 2024-04-25T22:03:19.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108680+0000", 2024-04-25T22:03:19.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3249e-05 2024-04-25T22:03:19.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109917+0000", 2024-04-25T22:03:19.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012367050000000001 2024-04-25T22:03:19.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109961+0000", 2024-04-25T22:03:19.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4029000000000001e-05 2024-04-25T22:03:19.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207351+0000", 2024-04-25T22:03:19.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.097390791000000004 2024-04-25T22:03:19.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207380+0000", 2024-04-25T22:03:19.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9037e-05 2024-04-25T22:03:19.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.538 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:8 4.3b e51/49 4:deccbd37:::100000001fe.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:19.538 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:19.538 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.403599589999999, 2024-04-25T22:03:19.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090839771, 2024-04-25T22:03:19.538 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.538 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.538 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:19.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:19.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108697+0000", 2024-04-25T22:03:19.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1399999999999997e-07 2024-04-25T22:03:19.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108712+0000", 2024-04-25T22:03:19.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4772e-05 2024-04-25T22:03:19.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108728+0000", 2024-04-25T22:03:19.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5943e-05 2024-04-25T22:03:19.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108740+0000", 2024-04-25T22:03:19.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.235e-05 2024-04-25T22:03:19.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108797+0000", 2024-04-25T22:03:19.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6879000000000002e-05 2024-04-25T22:03:19.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108812+0000", 2024-04-25T22:03:19.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5268999999999999e-05 2024-04-25T22:03:19.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199495+0000", 2024-04-25T22:03:19.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090683071000000004 2024-04-25T22:03:19.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199536+0000", 2024-04-25T22:03:19.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0873e-05 2024-04-25T22:03:19.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.542 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.542 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:6909 4.6 4:631b09cd:::10000001f99.00000000:head [write 0~1706] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:19.542 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.879622+0000", 2024-04-25T22:03:19.542 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.632674079999999, 2024-04-25T22:03:19.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83167118299999998, 2024-04-25T22:03:19.542 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.542 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.542 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:19.543 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:19.543 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:19.543 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 6909 2024-04-25T22:03:19.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.543 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879622+0000", 2024-04-25T22:03:19.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879622+0000", 2024-04-25T22:03:19.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879624+0000", 2024-04-25T22:03:19.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.429e-06 2024-04-25T22:03:19.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879639+0000", 2024-04-25T22:03:19.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4534e-05 2024-04-25T22:03:19.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879669+0000", 2024-04-25T22:03:19.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0349e-05 2024-04-25T22:03:19.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879684+0000", 2024-04-25T22:03:19.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:03:19.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879767+0000", 2024-04-25T22:03:19.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3410000000000003e-05 2024-04-25T22:03:19.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:19.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879783+0000", 2024-04-25T22:03:19.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5378000000000001e-05 2024-04-25T22:03:19.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.700268+0000", 2024-04-25T22:03:19.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.82048565699999998 2024-04-25T22:03:19.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.700627+0000", 2024-04-25T22:03:19.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035847800000000002 2024-04-25T22:03:19.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:19.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.700977+0000", 2024-04-25T22:03:19.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035024699999999998 2024-04-25T22:03:19.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:19.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.704901+0000", 2024-04-25T22:03:19.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039243230000000004 2024-04-25T22:03:19.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:19.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711150+0000", 2024-04-25T22:03:19.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0062490519999999997 2024-04-25T22:03:19.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711230+0000", 2024-04-25T22:03:19.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9370999999999996e-05 2024-04-25T22:03:19.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:19.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3221999999999999e-05 2024-04-25T22:03:19.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.548 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.549 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:6922 4.6 4:62b4ea5c:::10000001fab.00000000:head [write 0~7953] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:19.549 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.902807+0000", 2024-04-25T22:03:19.549 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.609488853, 2024-04-25T22:03:19.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80868129799999999, 2024-04-25T22:03:19.549 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.549 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.549 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:19.549 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:19.549 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:19.549 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 6922 2024-04-25T22:03:19.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.549 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902807+0000", 2024-04-25T22:03:19.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902807+0000", 2024-04-25T22:03:19.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902809+0000", 2024-04-25T22:03:19.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4099999999999998e-06 2024-04-25T22:03:19.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902830+0000", 2024-04-25T22:03:19.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0381999999999999e-05 2024-04-25T22:03:19.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902852+0000", 2024-04-25T22:03:19.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2357e-05 2024-04-25T22:03:19.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902864+0000", 2024-04-25T22:03:19.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2329e-05 2024-04-25T22:03:19.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902923+0000", 2024-04-25T22:03:19.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8485e-05 2024-04-25T22:03:19.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:19.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902930+0000", 2024-04-25T22:03:19.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4200000000000001e-06 2024-04-25T22:03:19.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.702506+0000", 2024-04-25T22:03:19.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.79957517899999997 2024-04-25T22:03:19.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.702674+0000", 2024-04-25T22:03:19.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016807200000000001 2024-04-25T22:03:19.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:19.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.702860+0000", 2024-04-25T22:03:19.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018624200000000001 2024-04-25T22:03:19.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:19.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706186+0000", 2024-04-25T22:03:19.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033265619999999999 2024-04-25T22:03:19.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:19.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711369+0000", 2024-04-25T22:03:19.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005182496 2024-04-25T22:03:19.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711436+0000", 2024-04-25T22:03:19.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7135e-05 2024-04-25T22:03:19.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711488+0000", 2024-04-25T22:03:19.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2228999999999997e-05 2024-04-25T22:03:19.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.555 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.555 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:6926 4.6 4:62749b46:::10000001faf.00000000:head [write 0~2676] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:19.555 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.908574+0000", 2024-04-25T22:03:19.555 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.603722005, 2024-04-25T22:03:19.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.803246511, 2024-04-25T22:03:19.555 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.555 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:19.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:19.556 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:19.556 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 6926 2024-04-25T22:03:19.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.556 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908574+0000", 2024-04-25T22:03:19.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908574+0000", 2024-04-25T22:03:19.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908576+0000", 2024-04-25T22:03:19.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.784e-06 2024-04-25T22:03:19.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908585+0000", 2024-04-25T22:03:19.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6420000000000002e-06 2024-04-25T22:03:19.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908609+0000", 2024-04-25T22:03:19.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3303e-05 2024-04-25T22:03:19.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908622+0000", 2024-04-25T22:03:19.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3783e-05 2024-04-25T22:03:19.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908730+0000", 2024-04-25T22:03:19.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107831 2024-04-25T22:03:19.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:19.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908748+0000", 2024-04-25T22:03:19.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7909000000000001e-05 2024-04-25T22:03:19.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.703586+0000", 2024-04-25T22:03:19.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.794838131 2024-04-25T22:03:19.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.703854+0000", 2024-04-25T22:03:19.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026782299999999999 2024-04-25T22:03:19.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:19.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.704060+0000", 2024-04-25T22:03:19.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020576200000000001 2024-04-25T22:03:19.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:19.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711121+0000", 2024-04-25T22:03:19.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070615510000000001 2024-04-25T22:03:19.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:19.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711705+0000", 2024-04-25T22:03:19.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00058315899999999998 2024-04-25T22:03:19.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711769+0000", 2024-04-25T22:03:19.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4877999999999998e-05 2024-04-25T22:03:19.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711820+0000", 2024-04-25T22:03:19.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0955000000000003e-05 2024-04-25T22:03:19.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.561 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.561 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7057 4.6 4:63cd8154:::10000002047.00000000:head [write 0~2047] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:19.561 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.194487+0000", 2024-04-25T22:03:19.561 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.317809094999999, 2024-04-25T22:03:19.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.51749014100000001, 2024-04-25T22:03:19.561 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.562 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:19.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:19.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:19.562 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7057 2024-04-25T22:03:19.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.562 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194487+0000", 2024-04-25T22:03:19.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194487+0000", 2024-04-25T22:03:19.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194489+0000", 2024-04-25T22:03:19.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-04-25T22:03:19.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194499+0000", 2024-04-25T22:03:19.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0117e-05 2024-04-25T22:03:19.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194522+0000", 2024-04-25T22:03:19.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2925000000000002e-05 2024-04-25T22:03:19.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194541+0000", 2024-04-25T22:03:19.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9137e-05 2024-04-25T22:03:19.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194712+0000", 2024-04-25T22:03:19.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000170602 2024-04-25T22:03:19.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:19.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194743+0000", 2024-04-25T22:03:19.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1479000000000001e-05 2024-04-25T22:03:19.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.704997+0000", 2024-04-25T22:03:19.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.51025366000000005 2024-04-25T22:03:19.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.705197+0000", 2024-04-25T22:03:19.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020022799999999999 2024-04-25T22:03:19.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:19.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.705399+0000", 2024-04-25T22:03:19.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020160499999999999 2024-04-25T22:03:19.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:19.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711586+0000", 2024-04-25T22:03:19.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061875350000000001 2024-04-25T22:03:19.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:19.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711841+0000", 2024-04-25T22:03:19.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025510300000000001 2024-04-25T22:03:19.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711906+0000", 2024-04-25T22:03:19.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4381999999999994e-05 2024-04-25T22:03:19.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711977+0000", 2024-04-25T22:03:19.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1295000000000001e-05 2024-04-25T22:03:19.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.567 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.567 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7114 4.6 4:63547153:::10000002086.00000000:head [write 0~67896] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:19.567 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.411903+0000", 2024-04-25T22:03:19.567 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.100392511000001, 2024-04-25T22:03:19.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.301551715, 2024-04-25T22:03:19.568 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.568 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.568 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:19.568 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:19.568 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:19.568 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7114 2024-04-25T22:03:19.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.568 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.411903+0000", 2024-04-25T22:03:19.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.411903+0000", 2024-04-25T22:03:19.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.411906+0000", 2024-04-25T22:03:19.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9469999999999999e-06 2024-04-25T22:03:19.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412184+0000", 2024-04-25T22:03:19.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027727600000000002 2024-04-25T22:03:19.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412215+0000", 2024-04-25T22:03:19.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1899000000000001e-05 2024-04-25T22:03:19.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412230+0000", 2024-04-25T22:03:19.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4703e-05 2024-04-25T22:03:19.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412384+0000", 2024-04-25T22:03:19.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015366300000000001 2024-04-25T22:03:19.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:19.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412405+0000", 2024-04-25T22:03:19.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0936000000000001e-05 2024-04-25T22:03:19.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706266+0000", 2024-04-25T22:03:19.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.29386084299999998 2024-04-25T22:03:19.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706440+0000", 2024-04-25T22:03:19.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174759 2024-04-25T22:03:19.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:19.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706655+0000", 2024-04-25T22:03:19.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021489100000000001 2024-04-25T22:03:19.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:19.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711675+0000", 2024-04-25T22:03:19.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050198639999999997 2024-04-25T22:03:19.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:19.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.713316+0000", 2024-04-25T22:03:19.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016410280000000001 2024-04-25T22:03:19.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.713391+0000", 2024-04-25T22:03:19.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5065e-05 2024-04-25T22:03:19.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.713455+0000", 2024-04-25T22:03:19.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3841000000000001e-05 2024-04-25T22:03:19.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.573 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.573 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7117 4.6 4:60a5b603:::10000002089.00000000:head [write 0~12740] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:19.573 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.421192+0000", 2024-04-25T22:03:19.574 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.091104113, 2024-04-25T22:03:19.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.29400416200000001, 2024-04-25T22:03:19.574 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.574 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:19.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:19.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:19.574 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7117 2024-04-25T22:03:19.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.574 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421192+0000", 2024-04-25T22:03:19.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421192+0000", 2024-04-25T22:03:19.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421194+0000", 2024-04-25T22:03:19.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3700000000000002e-06 2024-04-25T22:03:19.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421247+0000", 2024-04-25T22:03:19.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2539e-05 2024-04-25T22:03:19.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421278+0000", 2024-04-25T22:03:19.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1392e-05 2024-04-25T22:03:19.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421293+0000", 2024-04-25T22:03:19.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5133000000000001e-05 2024-04-25T22:03:19.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421487+0000", 2024-04-25T22:03:19.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019340899999999999 2024-04-25T22:03:19.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:19.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421506+0000", 2024-04-25T22:03:19.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9568999999999998e-05 2024-04-25T22:03:19.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.709232+0000", 2024-04-25T22:03:19.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.28772543699999997 2024-04-25T22:03:19.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.709416+0000", 2024-04-25T22:03:19.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000184019 2024-04-25T22:03:19.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:19.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.709668+0000", 2024-04-25T22:03:19.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025279000000000002 2024-04-25T22:03:19.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:19.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712068+0000", 2024-04-25T22:03:19.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002399558 2024-04-25T22:03:19.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:19.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.715072+0000", 2024-04-25T22:03:19.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030037800000000002 2024-04-25T22:03:19.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.715143+0000", 2024-04-25T22:03:19.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1000999999999993e-05 2024-04-25T22:03:19.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.715196+0000", 2024-04-25T22:03:19.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3164999999999997e-05 2024-04-25T22:03:19.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.579 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.580 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7136 4.6 4:60bfd03c:::100000020a0.00000000:head [write 0~1357] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:19.580 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.489503+0000", 2024-04-25T22:03:19.580 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.022793232, 2024-04-25T22:03:19.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.22876102600000001, 2024-04-25T22:03:19.580 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.580 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.580 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:19.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:19.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:19.580 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7136 2024-04-25T22:03:19.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.580 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489503+0000", 2024-04-25T22:03:19.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489503+0000", 2024-04-25T22:03:19.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489505+0000", 2024-04-25T22:03:19.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.486e-06 2024-04-25T22:03:19.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489517+0000", 2024-04-25T22:03:19.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.217e-05 2024-04-25T22:03:19.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489544+0000", 2024-04-25T22:03:19.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6852999999999999e-05 2024-04-25T22:03:19.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489559+0000", 2024-04-25T22:03:19.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:03:19.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489705+0000", 2024-04-25T22:03:19.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014583 2024-04-25T22:03:19.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:19.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489722+0000", 2024-04-25T22:03:19.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7376000000000001e-05 2024-04-25T22:03:19.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712122+0000", 2024-04-25T22:03:19.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.22239948300000001 2024-04-25T22:03:19.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712376+0000", 2024-04-25T22:03:19.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025398700000000001 2024-04-25T22:03:19.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:19.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712639+0000", 2024-04-25T22:03:19.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026326300000000002 2024-04-25T22:03:19.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:19.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.714861+0000", 2024-04-25T22:03:19.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00222236 2024-04-25T22:03:19.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:19.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.718091+0000", 2024-04-25T22:03:19.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032294400000000001 2024-04-25T22:03:19.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.718197+0000", 2024-04-25T22:03:19.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010655 2024-04-25T22:03:19.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.718264+0000", 2024-04-25T22:03:19.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6482000000000005e-05 2024-04-25T22:03:19.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.586 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.586 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:299 3.0 3:02ac1934:::200.00000009:head [write 0~3532922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T22:03:19.586 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:10.968409+0000", 2024-04-25T22:03:19.586 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.5438872079999992, 2024-04-25T22:03:19.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.094675465, 2024-04-25T22:03:19.586 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.586 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.586 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.586 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.968409+0000", 2024-04-25T22:03:19.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.968409+0000", 2024-04-25T22:03:19.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.968411+0000", 2024-04-25T22:03:19.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.012e-06 2024-04-25T22:03:19.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974350+0000", 2024-04-25T22:03:19.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059392259999999997 2024-04-25T22:03:19.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974375+0000", 2024-04-25T22:03:19.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:03:19.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974386+0000", 2024-04-25T22:03:19.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0900000000000001e-05 2024-04-25T22:03:19.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974473+0000", 2024-04-25T22:03:19.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6942999999999997e-05 2024-04-25T22:03:19.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974562+0000", 2024-04-25T22:03:19.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8744000000000003e-05 2024-04-25T22:03:19.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:19.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974706+0000", 2024-04-25T22:03:19.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014392499999999999 2024-04-25T22:03:19.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:19.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.020272+0000", 2024-04-25T22:03:19.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.045566723000000003 2024-04-25T22:03:19.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:19.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.062890+0000", 2024-04-25T22:03:19.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042617796999999999 2024-04-25T22:03:19.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.063008+0000", 2024-04-25T22:03:19.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011757 2024-04-25T22:03:19.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.063084+0000", 2024-04-25T22:03:19.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6395000000000003e-05 2024-04-25T22:03:19.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.591 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.591 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:10648 4.33 e64/49 4:cc614d18:::100000030cb.00000000:head v 64'159, mlcod=64'157)", 2024-04-25T22:03:19.591 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:13.541451+0000", 2024-04-25T22:03:19.591 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.9708452569999997, 2024-04-25T22:03:19.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.120967456, 2024-04-25T22:03:19.591 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.591 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.591 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.591 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.541451+0000", 2024-04-25T22:03:19.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.541451+0000", 2024-04-25T22:03:19.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.541453+0000", 2024-04-25T22:03:19.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3530000000000002e-06 2024-04-25T22:03:19.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.545862+0000", 2024-04-25T22:03:19.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004409451 2024-04-25T22:03:19.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.545895+0000", 2024-04-25T22:03:19.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2811999999999997e-05 2024-04-25T22:03:19.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.545918+0000", 2024-04-25T22:03:19.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2407000000000001e-05 2024-04-25T22:03:19.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.546085+0000", 2024-04-25T22:03:19.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000167159 2024-04-25T22:03:19.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.546149+0000", 2024-04-25T22:03:19.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4208999999999995e-05 2024-04-25T22:03:19.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.662281+0000", 2024-04-25T22:03:19.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.116132255 2024-04-25T22:03:19.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.662418+0000", 2024-04-25T22:03:19.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013681000000000001 2024-04-25T22:03:19.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.595 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.595 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11198 4.4 e65/16 4:22c4fea3:::10000003262.00000000:head v 65'175, mlcod=65'172)", 2024-04-25T22:03:19.595 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:18.240473+0000", 2024-04-25T22:03:19.595 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.2718226969999999, 2024-04-25T22:03:19.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.099381791999999997, 2024-04-25T22:03:19.595 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.596 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.596 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.240473+0000", 2024-04-25T22:03:19.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.240473+0000", 2024-04-25T22:03:19.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.240474+0000", 2024-04-25T22:03:19.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1299999999999999e-07 2024-04-25T22:03:19.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.247661+0000", 2024-04-25T22:03:19.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0071873630000000004 2024-04-25T22:03:19.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.247677+0000", 2024-04-25T22:03:19.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5624000000000002e-05 2024-04-25T22:03:19.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.247687+0000", 2024-04-25T22:03:19.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9089999999999995e-06 2024-04-25T22:03:19.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.259136+0000", 2024-04-25T22:03:19.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011449002999999999 2024-04-25T22:03:19.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.259154+0000", 2024-04-25T22:03:19.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7849000000000001e-05 2024-04-25T22:03:19.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.339805+0000", 2024-04-25T22:03:19.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.080651013999999993 2024-04-25T22:03:19.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.339855+0000", 2024-04-25T22:03:19.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0317e-05 2024-04-25T22:03:19.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.599 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.599 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11219 4.4 e65/16 4:210cd53e:::100000031ff.00000000:head v 65'177, mlcod=65'173)", 2024-04-25T22:03:19.599 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:18.271403+0000", 2024-04-25T22:03:19.600 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.240893062, 2024-04-25T22:03:19.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.093770510000000001, 2024-04-25T22:03:19.600 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.600 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.600 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.600 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.271403+0000", 2024-04-25T22:03:19.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.271403+0000", 2024-04-25T22:03:19.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.271403+0000", 2024-04-25T22:03:19.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8999999999999998e-07 2024-04-25T22:03:19.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.275340+0000", 2024-04-25T22:03:19.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039364889999999996 2024-04-25T22:03:19.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.275354+0000", 2024-04-25T22:03:19.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4864e-05 2024-04-25T22:03:19.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.275362+0000", 2024-04-25T22:03:19.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9710000000000004e-06 2024-04-25T22:03:19.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.283340+0000", 2024-04-25T22:03:19.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0079778739999999994 2024-04-25T22:03:19.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.283361+0000", 2024-04-25T22:03:19.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1214999999999999e-05 2024-04-25T22:03:19.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.365136+0000", 2024-04-25T22:03:19.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.081774327999999993 2024-04-25T22:03:19.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.365173+0000", 2024-04-25T22:03:19.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-04-25T22:03:19.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.603 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.604 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:11419 4.6 4:6132b542:::100000032bb.00000000:head [write 0~3932160 [2@1004150]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:19.604 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:18.522062+0000", 2024-04-25T22:03:19.604 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.99023418500000004, 2024-04-25T22:03:19.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.091966376000000002, 2024-04-25T22:03:19.604 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:19.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:19.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:19.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 11419 2024-04-25T22:03:19.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.604 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.522062+0000", 2024-04-25T22:03:19.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.522062+0000", 2024-04-25T22:03:19.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.522063+0000", 2024-04-25T22:03:19.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.288e-06 2024-04-25T22:03:19.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527453+0000", 2024-04-25T22:03:19.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0053895530000000001 2024-04-25T22:03:19.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527469+0000", 2024-04-25T22:03:19.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:03:19.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527477+0000", 2024-04-25T22:03:19.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2320000000000001e-06 2024-04-25T22:03:19.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527541+0000", 2024-04-25T22:03:19.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3628999999999997e-05 2024-04-25T22:03:19.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527614+0000", 2024-04-25T22:03:19.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3479000000000006e-05 2024-04-25T22:03:19.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:19.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527727+0000", 2024-04-25T22:03:19.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113094 2024-04-25T22:03:19.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:19.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.547917+0000", 2024-04-25T22:03:19.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.020189983000000002 2024-04-25T22:03:19.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:19.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.613903+0000", 2024-04-25T22:03:19.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065985492000000007 2024-04-25T22:03:19.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.613968+0000", 2024-04-25T22:03:19.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5815000000000006e-05 2024-04-25T22:03:19.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.614028+0000", 2024-04-25T22:03:19.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9667999999999999e-05 2024-04-25T22:03:19.609 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.609 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.609 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.609 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:11421 4.6 4:6132b542:::100000032bb.00000000:head [write 3932160~262144 [2@1004150]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:19.609 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:18.527499+0000", 2024-04-25T22:03:19.609 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.98479705699999998, 2024-04-25T22:03:19.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.086691641, 2024-04-25T22:03:19.609 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.609 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:19.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:19.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:19.610 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 11421 2024-04-25T22:03:19.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.610 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527499+0000", 2024-04-25T22:03:19.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527499+0000", 2024-04-25T22:03:19.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527501+0000", 2024-04-25T22:03:19.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7600000000000001e-06 2024-04-25T22:03:19.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527714+0000", 2024-04-25T22:03:19.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000213919 2024-04-25T22:03:19.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527726+0000", 2024-04-25T22:03:19.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1114000000000001e-05 2024-04-25T22:03:19.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527734+0000", 2024-04-25T22:03:19.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6489999999999997e-06 2024-04-25T22:03:19.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.545454+0000", 2024-04-25T22:03:19.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017720058 2024-04-25T22:03:19.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.545551+0000", 2024-04-25T22:03:19.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6978000000000006e-05 2024-04-25T22:03:19.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:19.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.545713+0000", 2024-04-25T22:03:19.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016178199999999999 2024-04-25T22:03:19.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:19.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.551069+0000", 2024-04-25T22:03:19.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0053559519999999998 2024-04-25T22:03:19.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:19.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.614075+0000", 2024-04-25T22:03:19.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063006329999999999 2024-04-25T22:03:19.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.614148+0000", 2024-04-25T22:03:19.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2821e-05 2024-04-25T22:03:19.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.614190+0000", 2024-04-25T22:03:19.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2277999999999997e-05 2024-04-25T22:03:19.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.614 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.615 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11868 4.3f e66/49 4:ffca00d8:::1000000326a.00000001:head v 66'190, mlcod=66'188)", 2024-04-25T22:03:19.615 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:19.231425+0000", 2024-04-25T22:03:19.615 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.28087083699999998, 2024-04-25T22:03:19.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.097996501, 2024-04-25T22:03:19.615 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:19.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:19.615 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:19.615 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:19.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:19.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.231425+0000", 2024-04-25T22:03:19.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:19.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.231425+0000", 2024-04-25T22:03:19.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:19.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:19.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.231426+0000", 2024-04-25T22:03:19.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.147e-06 2024-04-25T22:03:19.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:19.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.238249+0000", 2024-04-25T22:03:19.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068231810000000002 2024-04-25T22:03:19.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:19.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.238259+0000", 2024-04-25T22:03:19.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9059999999999997e-06 2024-04-25T22:03:19.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.238270+0000", 2024-04-25T22:03:19.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.11e-05 2024-04-25T22:03:19.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:19.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.253394+0000", 2024-04-25T22:03:19.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015123559999999999 2024-04-25T22:03:19.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:19.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.253419+0000", 2024-04-25T22:03:19.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4989000000000001e-05 2024-04-25T22:03:19.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:19.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.329383+0000", 2024-04-25T22:03:19.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.075963944000000005 2024-04-25T22:03:19.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:19.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:19.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:19.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.329422+0000", 2024-04-25T22:03:19.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8674000000000003e-05 2024-04-25T22:03:19.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.619 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:19.619 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:19.619 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:19.621 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:19.612+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:19.621 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:19.640 INFO:tasks.workunit.client.0.smithi044.stdout:6/436: dwrite d2/d23/d5a/d12/f48 [4194304,4194304] 0 2024-04-25T22:03:19.640 INFO:tasks.workunit.client.0.smithi044.stdout:8/462: mknod d2a/d82/c99 0 2024-04-25T22:03:19.640 INFO:tasks.workunit.client.0.smithi044.stdout:9/473: fdatasync d4/d7/d18/d3a/f46 0 2024-04-25T22:03:19.640 INFO:tasks.workunit.client.0.smithi044.stdout:4/312: dwrite dd/d19/d38/f64 [0,4194304] 0 2024-04-25T22:03:19.641 INFO:tasks.workunit.client.0.smithi044.stdout:0/350: symlink d8/df/d17/l74 0 2024-04-25T22:03:19.641 INFO:tasks.workunit.client.0.smithi044.stdout:0/351: symlink d8/df/d17/l75 0 2024-04-25T22:03:19.641 INFO:tasks.workunit.client.0.smithi044.stdout:2/352: dwrite d7/d16/d2d/d4e/d2e/f34 [0,4194304] 0 2024-04-25T22:03:19.641 INFO:tasks.workunit.client.0.smithi044.stdout:8/463: rename d2a/f2d to d2a/d39/d42/d80/f9a 0 2024-04-25T22:03:19.641 INFO:tasks.workunit.client.0.smithi044.stdout:4/313: link dd/d35/f5e dd/f6c 0 2024-04-25T22:03:19.641 INFO:tasks.workunit.client.0.smithi044.stdout:2/353: mknod d7/d16/d2d/d4e/d2e/d6b/c73 0 2024-04-25T22:03:19.641 INFO:tasks.workunit.client.0.smithi044.stdout:8/464: creat d2a/d32/f9b x:0 0 0 2024-04-25T22:03:19.641 INFO:tasks.workunit.client.0.smithi044.stdout:9/474: dwrite d4/f32 [0,4194304] 0 2024-04-25T22:03:19.641 INFO:tasks.workunit.client.0.smithi044.stdout:2/354: mknod d7/d16/c74 0 2024-04-25T22:03:19.641 INFO:tasks.workunit.client.0.smithi044.stdout:8/465: fdatasync d2a/d32/d57/d5e/f8a 0 2024-04-25T22:03:19.641 INFO:tasks.workunit.client.0.smithi044.stdout:4/314: read - dd/f36 zero size 2024-04-25T22:03:19.641 INFO:tasks.workunit.client.0.smithi044.stdout:9/475: fdatasync d4/d7/d18/d2e/f5d 0 2024-04-25T22:03:19.641 INFO:tasks.workunit.client.0.smithi044.stdout:6/437: write d2/d23/d5a/d11/f39 [879812,38454] 0 2024-04-25T22:03:19.641 INFO:tasks.workunit.client.0.smithi044.stdout:8/466: chown d2a/f36 7074137 1 2024-04-25T22:03:19.642 INFO:tasks.workunit.client.0.smithi044.stdout:6/438: chown d2/d23/d5a/d13/f36 527005214 1 2024-04-25T22:03:19.642 INFO:tasks.workunit.client.0.smithi044.stdout:0/352: dwrite f0 [0,4194304] 0 2024-04-25T22:03:19.642 INFO:tasks.workunit.client.0.smithi044.stdout:8/467: mknod d2a/d39/d42/d68/d6b/d6e/d84/c9c 0 2024-04-25T22:03:19.642 INFO:tasks.workunit.client.0.smithi044.stdout:9/476: rmdir d4/d37/d54/d84/d72/d97 39 2024-04-25T22:03:19.642 INFO:tasks.workunit.client.0.smithi044.stdout:8/468: write d2a/f62 [1147586,85248] 0 2024-04-25T22:03:19.642 INFO:tasks.workunit.client.0.smithi044.stdout:6/439: creat d2/d23/d5a/d12/d49/d7f/f97 x:0 0 0 2024-04-25T22:03:19.642 INFO:tasks.workunit.client.0.smithi044.stdout:2/355: stat d7/d16/d2d/d4e/d2e/c35 0 2024-04-25T22:03:19.642 INFO:tasks.workunit.client.0.smithi044.stdout:8/469: mknod d2a/d52/c9d 0 2024-04-25T22:03:19.642 INFO:tasks.workunit.client.0.smithi044.stdout:6/440: write d2/d23/d5a/d13/d4b/f67 [1788798,11771] 0 2024-04-25T22:03:19.642 INFO:tasks.workunit.client.0.smithi044.stdout:8/470: getdents d2a/d82 0 2024-04-25T22:03:19.642 INFO:tasks.workunit.client.0.smithi044.stdout:6/441: mkdir d2/d23/d5a/d12/d49/d7f/d98 0 2024-04-25T22:03:19.642 INFO:tasks.workunit.client.0.smithi044.stdout:4/315: dwrite dd/f34 [0,4194304] 0 2024-04-25T22:03:19.642 INFO:tasks.workunit.client.0.smithi044.stdout:8/471: link d2a/d39/c7d d2a/d82/c9e 0 2024-04-25T22:03:19.642 INFO:tasks.workunit.client.0.smithi044.stdout:6/442: truncate d2/d23/d6a/f84 360012 0 2024-04-25T22:03:19.643 INFO:tasks.workunit.client.0.smithi044.stdout:8/472: creat d2a/d39/d42/f9f x:0 0 0 2024-04-25T22:03:19.643 INFO:tasks.workunit.client.0.smithi044.stdout:8/473: read d2a/f2f [3578148,47271] 0 2024-04-25T22:03:19.643 INFO:tasks.workunit.client.0.smithi044.stdout:4/316: rename dd/f34 to dd/d19/f6d 0 2024-04-25T22:03:19.643 INFO:tasks.workunit.client.0.smithi044.stdout:8/474: creat d2a/d32/d3e/fa0 x:0 0 0 2024-04-25T22:03:19.643 INFO:tasks.workunit.client.0.smithi044.stdout:2/356: dwrite d7/d8/d1c/d26/f5a [0,4194304] 0 2024-04-25T22:03:19.643 INFO:tasks.workunit.client.0.smithi044.stdout:6/443: rename d2/cc to d2/d23/d5a/d11/d2a/c99 0 2024-04-25T22:03:19.643 INFO:tasks.workunit.client.0.smithi044.stdout:2/357: write d7/f31 [1609484,118799] 0 2024-04-25T22:03:19.643 INFO:tasks.workunit.client.0.smithi044.stdout:8/475: truncate d2a/d39/d42/f49 57027 0 2024-04-25T22:03:19.643 INFO:tasks.workunit.client.0.smithi044.stdout:4/317: mknod dd/d35/d52/d61/c6e 0 2024-04-25T22:03:19.643 INFO:tasks.workunit.client.0.smithi044.stdout:2/358: write d7/d16/f20 [400076,1019] 0 2024-04-25T22:03:19.643 INFO:tasks.workunit.client.0.smithi044.stdout:8/476: chown d2a/d82/c99 4 1 2024-04-25T22:03:19.643 INFO:tasks.workunit.client.0.smithi044.stdout:4/318: dread - dd/d19/d38/f5d zero size 2024-04-25T22:03:19.643 INFO:tasks.workunit.client.0.smithi044.stdout:8/477: symlink d2a/d32/d57/la1 0 2024-04-25T22:03:19.643 INFO:tasks.workunit.client.0.smithi044.stdout:2/359: mkdir d7/d16/d2c/d75 0 2024-04-25T22:03:19.643 INFO:tasks.workunit.client.0.smithi044.stdout:6/444: truncate d2/d23/d5a/d11/d3b/f71 825413 0 2024-04-25T22:03:19.644 INFO:tasks.workunit.client.0.smithi044.stdout:4/319: truncate dd/f2a 222069 0 2024-04-25T22:03:19.644 INFO:tasks.workunit.client.0.smithi044.stdout:4/320: dread - dd/f36 zero size 2024-04-25T22:03:19.644 INFO:tasks.workunit.client.0.smithi044.stdout:8/478: creat d2a/d32/d90/fa2 x:0 0 0 2024-04-25T22:03:19.644 INFO:tasks.workunit.client.0.smithi044.stdout:2/360: creat d7/d8/d5f/f76 x:0 0 0 2024-04-25T22:03:19.644 INFO:tasks.workunit.client.0.smithi044.stdout:2/361: mkdir d7/d8/d1c/d77 0 2024-04-25T22:03:19.644 INFO:tasks.workunit.client.0.smithi044.stdout:8/479: creat d2a/d39/d42/d68/fa3 x:0 0 0 2024-04-25T22:03:19.644 INFO:tasks.workunit.client.0.smithi044.stdout:2/362: fsync d7/d16/d4b/f72 0 2024-04-25T22:03:19.644 INFO:tasks.workunit.client.0.smithi044.stdout:8/480: rename d2a/d32/d3e/f46 to d2a/d39/d42/d68/d6b/d7b/fa4 0 2024-04-25T22:03:19.644 INFO:tasks.workunit.client.0.smithi044.stdout:8/481: chown d2a/d39 419481184 1 2024-04-25T22:03:19.644 INFO:tasks.workunit.client.0.smithi044.stdout:2/363: getdents d7/d16/d2d 0 2024-04-25T22:03:19.644 INFO:tasks.workunit.client.0.smithi044.stdout:8/482: creat d2a/d39/d42/d68/d6b/d6e/fa5 x:0 0 0 2024-04-25T22:03:19.644 INFO:tasks.workunit.client.0.smithi044.stdout:8/483: write f1f [1295381,11204] 0 2024-04-25T22:03:19.644 INFO:tasks.workunit.client.0.smithi044.stdout:8/484: truncate f23 595181 0 2024-04-25T22:03:19.644 INFO:tasks.workunit.client.0.smithi044.stdout:8/485: creat d2a/d82/fa6 x:0 0 0 2024-04-25T22:03:19.644 INFO:tasks.workunit.client.0.smithi044.stdout:8/486: readlink d2a/d32/l58 0 2024-04-25T22:03:19.645 INFO:tasks.workunit.client.0.smithi044.stdout:8/487: fdatasync d2a/d39/d42/d68/d6b/d7b/f8b 0 2024-04-25T22:03:19.645 INFO:tasks.workunit.client.0.smithi044.stdout:2/364: dread d7/d8/d1c/d26/f5a [0,4194304] 0 2024-04-25T22:03:19.645 INFO:tasks.workunit.client.0.smithi044.stdout:8/488: creat d2a/d82/fa7 x:0 0 0 2024-04-25T22:03:19.645 INFO:tasks.workunit.client.0.smithi044.stdout:8/489: creat d2a/d39/d42/d68/d6b/d6e/fa8 x:0 0 0 2024-04-25T22:03:19.645 INFO:tasks.workunit.client.0.smithi044.stdout:2/365: rename d7/d8/d1c/d26 to d7/d16/d2d/d4e/d2e/d6b/d78 0 2024-04-25T22:03:19.645 INFO:tasks.workunit.client.0.smithi044.stdout:2/366: truncate d7/d8/f6f 802579 0 2024-04-25T22:03:19.645 INFO:tasks.workunit.client.0.smithi044.stdout:8/490: dread d2a/d32/f3d [0,4194304] 0 2024-04-25T22:03:19.645 INFO:tasks.workunit.client.0.smithi044.stdout:8/491: creat d2a/d39/d42/d68/d6b/d7b/fa9 x:0 0 0 2024-04-25T22:03:19.645 INFO:tasks.workunit.client.0.smithi044.stdout:8/492: getdents d2a/d32/d90 0 2024-04-25T22:03:19.645 INFO:tasks.workunit.client.0.smithi044.stdout:8/493: chown fa 0 1 2024-04-25T22:03:19.645 INFO:tasks.workunit.client.0.smithi044.stdout:8/494: chown d2a/d32/c4f 99937520 1 2024-04-25T22:03:19.645 INFO:tasks.workunit.client.0.smithi044.stdout:8/495: creat d2a/d39/faa x:0 0 0 2024-04-25T22:03:19.645 INFO:tasks.workunit.client.0.smithi044.stdout:9/477: dread d4/d7/d18/d2e/d73/f7c [0,4194304] 0 2024-04-25T22:03:19.645 INFO:tasks.workunit.client.0.smithi044.stdout:1/400: sync 2024-04-25T22:03:19.645 INFO:tasks.workunit.client.0.smithi044.stdout:7/308: sync 2024-04-25T22:03:19.646 INFO:tasks.workunit.client.0.smithi044.stdout:3/371: dread d0/d1/fe [0,4194304] 0 2024-04-25T22:03:19.646 INFO:tasks.workunit.client.0.smithi044.stdout:7/309: mknod d1c/d22/d28/d30/d32/c63 0 2024-04-25T22:03:19.646 INFO:tasks.workunit.client.0.smithi044.stdout:6/445: dread d2/d23/d5a/d11/d3b/f58 [0,4194304] 0 2024-04-25T22:03:19.646 INFO:tasks.workunit.client.0.smithi044.stdout:6/446: chown d2/d23/d5a/c15 8 1 2024-04-25T22:03:19.646 INFO:tasks.workunit.client.0.smithi044.stdout:9/478: dwrite d4/d3d/d58/f83 [0,4194304] 0 2024-04-25T22:03:19.646 INFO:tasks.workunit.client.0.smithi044.stdout:6/447: symlink d2/d23/d5a/d12/d1f/d94/l9a 0 2024-04-25T22:03:19.646 INFO:tasks.workunit.client.0.smithi044.stdout:8/496: dread fd [0,4194304] 0 2024-04-25T22:03:19.646 INFO:tasks.workunit.client.0.smithi044.stdout:6/448: write d2/d23/d5a/d13/d4b/f67 [2243357,44236] 0 2024-04-25T22:03:19.646 INFO:tasks.workunit.client.0.smithi044.stdout:6/449: link d2/d23/d5a/d11/d3b/l4d d2/d23/d5a/d12/d49/d7f/l9b 0 2024-04-25T22:03:19.646 INFO:tasks.workunit.client.0.smithi044.stdout:6/450: chown d2/d23/d5a/d13/c1a 15 1 2024-04-25T22:03:19.646 INFO:tasks.workunit.client.0.smithi044.stdout:2/367: dread d7/d16/f17 [0,4194304] 0 2024-04-25T22:03:19.646 INFO:tasks.workunit.client.0.smithi044.stdout:8/497: dwrite d2a/d82/fa6 [0,4194304] 0 2024-04-25T22:03:19.646 INFO:tasks.workunit.client.0.smithi044.stdout:3/372: dread d0/d1/d15/d51/dd/f61 [0,4194304] 0 2024-04-25T22:03:19.646 INFO:tasks.workunit.client.0.smithi044.stdout:2/368: rename d7/d8/f6f to d7/d16/d2d/f79 0 2024-04-25T22:03:19.646 INFO:tasks.workunit.client.0.smithi044.stdout:6/451: write d2/d23/d5a/d12/f19 [2120396,52966] 0 2024-04-25T22:03:19.647 INFO:tasks.workunit.client.0.smithi044.stdout:3/373: stat d0/d1/d34/d48/f5f 0 2024-04-25T22:03:19.647 INFO:tasks.workunit.client.0.smithi044.stdout:8/498: rename d2a/d32/d90 to d2a/d39/d5a/d92/dab 0 2024-04-25T22:03:19.647 INFO:tasks.workunit.client.0.smithi044.stdout:2/369: readlink d7/d16/l3c 0 2024-04-25T22:03:19.647 INFO:tasks.workunit.client.0.smithi044.stdout:3/374: mkdir d0/d1/d15/d51/dd/d11/d42/d76 0 2024-04-25T22:03:19.647 INFO:tasks.workunit.client.0.smithi044.stdout:8/499: readlink d2a/d39/d42/d80/l8f 0 2024-04-25T22:03:19.647 INFO:tasks.workunit.client.0.smithi044.stdout:8/500: creat d2a/fac x:0 0 0 2024-04-25T22:03:19.647 INFO:tasks.workunit.client.0.smithi044.stdout:3/375: getdents d0/d1/d15/d51/dd/d11/d43 0 2024-04-25T22:03:19.647 INFO:tasks.workunit.client.0.smithi044.stdout:8/501: chown d2a/fac 3 1 2024-04-25T22:03:19.647 INFO:tasks.workunit.client.0.smithi044.stdout:8/502: readlink d2a/d39/d42/d68/d6b/l6d 0 2024-04-25T22:03:19.647 INFO:tasks.workunit.client.0.smithi044.stdout:4/321: dread dd/d19/f27 [0,4194304] 0 2024-04-25T22:03:19.647 INFO:tasks.workunit.client.0.smithi044.stdout:4/322: link dd/d19/f2b dd/f6f 0 2024-04-25T22:03:19.647 INFO:tasks.workunit.client.0.smithi044.stdout:4/323: write dd/f46 [5332163,2933] 0 2024-04-25T22:03:19.647 INFO:tasks.workunit.client.0.smithi044.stdout:3/376: dwrite d0/d1/d15/d51/dd/f61 [0,4194304] 0 2024-04-25T22:03:19.647 INFO:tasks.workunit.client.0.smithi044.stdout:4/324: chown dd/l4f 3373 1 2024-04-25T22:03:19.647 INFO:tasks.workunit.client.0.smithi044.stdout:4/325: stat dd/c14 0 2024-04-25T22:03:19.648 INFO:tasks.workunit.client.0.smithi044.stdout:8/503: truncate f1f 602734 0 2024-04-25T22:03:19.648 INFO:tasks.workunit.client.0.smithi044.stdout:2/370: truncate d7/d16/d2d/d4e/d2e/d6b/d78/f56 1354921 0 2024-04-25T22:03:19.648 INFO:tasks.workunit.client.0.smithi044.stdout:8/504: chown d2a/d39/d42/d68/d6b/c8c 123658293 1 2024-04-25T22:03:19.648 INFO:tasks.workunit.client.0.smithi044.stdout:2/371: mknod d7/d16/d2d/d4e/d2e/d6b/d78/c7a 0 2024-04-25T22:03:19.648 INFO:tasks.workunit.client.0.smithi044.stdout:3/377: dread d0/d1/d15/d51/dd/d35/f52 [0,4194304] 0 2024-04-25T22:03:19.648 INFO:tasks.workunit.client.0.smithi044.stdout:8/505: chown d2a/d39/d42/d68/d6b/d6e/d84/c9c 57258 1 2024-04-25T22:03:19.648 INFO:tasks.workunit.client.0.smithi044.stdout:2/372: write d7/d8/d1c/f67 [3048261,99626] 0 2024-04-25T22:03:19.648 INFO:tasks.workunit.client.0.smithi044.stdout:1/401: dread d3/d7/db/d42/f64 [0,4194304] 0 2024-04-25T22:03:19.648 INFO:tasks.workunit.client.0.smithi044.stdout:3/378: chown d0/d1/d15/df/d5d/d71/d74 2 1 2024-04-25T22:03:19.648 INFO:tasks.workunit.client.0.smithi044.stdout:4/326: dread dd/d19/d38/f5c [0,4194304] 0 2024-04-25T22:03:19.648 INFO:tasks.workunit.client.0.smithi044.stdout:8/506: mknod d2a/d32/d57/cad 0 2024-04-25T22:03:19.648 INFO:tasks.workunit.client.0.smithi044.stdout:1/402: mknod d3/d7/db/d5d/c7c 0 2024-04-25T22:03:19.648 INFO:tasks.workunit.client.0.smithi044.stdout:8/507: creat d2a/d77/fae x:0 0 0 2024-04-25T22:03:19.648 INFO:tasks.workunit.client.0.smithi044.stdout:4/327: mknod dd/d35/d52/d61/c70 0 2024-04-25T22:03:19.648 INFO:tasks.workunit.client.0.smithi044.stdout:3/379: write d0/d1/d15/d51/dd/d35/f52 [3001865,113735] 0 2024-04-25T22:03:19.649 INFO:tasks.workunit.client.0.smithi044.stdout:4/328: mknod dd/d35/c71 0 2024-04-25T22:03:19.649 INFO:tasks.workunit.client.0.smithi044.stdout:3/380: fsync d0/d1/d15/d51/d39/f5a 0 2024-04-25T22:03:19.649 INFO:tasks.workunit.client.0.smithi044.stdout:1/403: rmdir d3/d7/db/d42/d7b 0 2024-04-25T22:03:19.649 INFO:tasks.workunit.client.0.smithi044.stdout:1/404: write d3/f6d [672408,11014] 0 2024-04-25T22:03:19.649 INFO:tasks.workunit.client.0.smithi044.stdout:3/381: write d0/d1/d15/d51/dd/d35/f52 [1261034,67906] 0 2024-04-25T22:03:19.649 INFO:tasks.workunit.client.0.smithi044.stdout:1/405: symlink d3/d7/db/d5d/l7d 0 2024-04-25T22:03:19.649 INFO:tasks.workunit.client.0.smithi044.stdout:3/382: write d0/d13/d1c/f30 [3243964,29448] 0 2024-04-25T22:03:19.649 INFO:tasks.workunit.client.0.smithi044.stdout:8/508: dread f2 [0,4194304] 0 2024-04-25T22:03:19.649 INFO:tasks.workunit.client.0.smithi044.stdout:8/509: creat d2a/d39/faf x:0 0 0 2024-04-25T22:03:19.649 INFO:tasks.workunit.client.0.smithi044.stdout:8/510: chown d2a/d39/d42/d68/d6b/d6e/fa8 1019003 1 2024-04-25T22:03:19.649 INFO:tasks.workunit.client.0.smithi044.stdout:4/329: dread dd/d19/f50 [0,4194304] 0 2024-04-25T22:03:19.649 INFO:tasks.workunit.client.0.smithi044.stdout:8/511: fsync f24 0 2024-04-25T22:03:19.649 INFO:tasks.workunit.client.0.smithi044.stdout:3/383: write d0/f31 [1642848,53038] 0 2024-04-25T22:03:19.649 INFO:tasks.workunit.client.0.smithi044.stdout:3/384: readlink d0/d1/l6a 0 2024-04-25T22:03:19.649 INFO:tasks.workunit.client.0.smithi044.stdout:8/512: write d2a/f62 [1410970,67968] 0 2024-04-25T22:03:19.650 INFO:tasks.workunit.client.0.smithi044.stdout:8/513: fsync d2a/d39/f97 0 2024-04-25T22:03:19.650 INFO:tasks.workunit.client.0.smithi044.stdout:3/385: symlink d0/d1/d15/df/l77 0 2024-04-25T22:03:19.650 INFO:tasks.workunit.client.0.smithi044.stdout:3/386: mkdir d0/d70/d78 0 2024-04-25T22:03:19.650 INFO:tasks.workunit.client.0.smithi044.stdout:8/514: truncate d2a/d32/f9b 40110 0 2024-04-25T22:03:19.650 INFO:tasks.workunit.client.0.smithi044.stdout:1/406: dwrite d3/d7/db/f56 [0,4194304] 0 2024-04-25T22:03:19.650 INFO:tasks.workunit.client.0.smithi044.stdout:3/387: write d0/d1/d15/d51/dd/d11/d43/d44/f6b [1840479,95345] 0 2024-04-25T22:03:19.650 INFO:tasks.workunit.client.0.smithi044.stdout:1/407: rename d3/d7/d29/d43/l60 to d3/d72/l7e 0 2024-04-25T22:03:19.650 INFO:tasks.workunit.client.0.smithi044.stdout:3/388: mkdir d0/d1/d79 0 2024-04-25T22:03:19.650 INFO:tasks.workunit.client.0.smithi044.stdout:1/408: mkdir d3/d7/db/d5d/d7f 0 2024-04-25T22:03:19.650 INFO:tasks.workunit.client.0.smithi044.stdout:4/330: dwrite dd/d19/f32 [0,4194304] 0 2024-04-25T22:03:19.650 INFO:tasks.workunit.client.0.smithi044.stdout:3/389: write d0/d1/d15/d51/dd/d28/f3f [1380171,32886] 0 2024-04-25T22:03:19.650 INFO:tasks.workunit.client.0.smithi044.stdout:3/390: readlink d0/d1/d15/l2d 0 2024-04-25T22:03:19.650 INFO:tasks.workunit.client.0.smithi044.stdout:4/331: mkdir dd/d19/d72 0 2024-04-25T22:03:19.650 INFO:tasks.workunit.client.0.smithi044.stdout:4/332: unlink dd/d19/f50 0 2024-04-25T22:03:19.650 INFO:tasks.workunit.client.0.smithi044.stdout:8/515: dwrite d2a/d39/d42/d68/d6b/f64 [0,4194304] 0 2024-04-25T22:03:19.651 INFO:tasks.workunit.client.0.smithi044.stdout:3/391: symlink d0/d1/d15/df/d5d/d71/d74/l7a 0 2024-04-25T22:03:19.651 INFO:tasks.workunit.client.0.smithi044.stdout:8/516: chown d2a/c2b 445312 1 2024-04-25T22:03:19.651 INFO:tasks.workunit.client.0.smithi044.stdout:3/392: read d0/d1/fe [5457275,1397] 0 2024-04-25T22:03:19.651 INFO:tasks.workunit.client.0.smithi044.stdout:5/330: sync 2024-04-25T22:03:19.651 INFO:tasks.workunit.client.0.smithi044.stdout:0/353: sync 2024-04-25T22:03:19.651 INFO:tasks.workunit.client.0.smithi044.stdout:8/517: creat d2a/d32/d57/d5e/fb0 x:0 0 0 2024-04-25T22:03:19.651 INFO:tasks.workunit.client.0.smithi044.stdout:7/310: sync 2024-04-25T22:03:19.651 INFO:tasks.workunit.client.0.smithi044.stdout:9/479: sync 2024-04-25T22:03:19.651 INFO:tasks.workunit.client.0.smithi044.stdout:6/452: sync 2024-04-25T22:03:19.651 INFO:tasks.workunit.client.0.smithi044.stdout:4/333: getdents dd/d19/d38 0 2024-04-25T22:03:19.651 INFO:tasks.workunit.client.0.smithi044.stdout:5/331: readlink d2/l66 0 2024-04-25T22:03:19.651 INFO:tasks.workunit.client.0.smithi044.stdout:8/518: dread - d2a/d32/d3e/f6a zero size 2024-04-25T22:03:19.651 INFO:tasks.workunit.client.0.smithi044.stdout:4/334: chown dd/d35/f5e 0 1 2024-04-25T22:03:19.651 INFO:tasks.workunit.client.0.smithi044.stdout:8/519: symlink d2a/d52/lb1 0 2024-04-25T22:03:19.651 INFO:tasks.workunit.client.0.smithi044.stdout:7/311: creat d1c/d22/d4a/f64 x:0 0 0 2024-04-25T22:03:19.651 INFO:tasks.workunit.client.0.smithi044.stdout:6/453: chown d2/d23/d5a/d12/d49/d7f/f97 3294181 1 2024-04-25T22:03:19.652 INFO:tasks.workunit.client.0.smithi044.stdout:1/409: dwrite d3/d7/f20 [0,4194304] 0 2024-04-25T22:03:19.652 INFO:tasks.workunit.client.0.smithi044.stdout:5/332: dread - d2/d5/d27/f51 zero size 2024-04-25T22:03:19.652 INFO:tasks.workunit.client.0.smithi044.stdout:4/335: creat dd/d35/d52/d61/f73 x:0 0 0 2024-04-25T22:03:19.652 INFO:tasks.workunit.client.0.smithi044.stdout:8/520: write f0 [2119213,25390] 0 2024-04-25T22:03:19.652 INFO:tasks.workunit.client.0.smithi044.stdout:6/454: fdatasync d2/d23/d5a/d13/f3d 0 2024-04-25T22:03:19.652 INFO:tasks.workunit.client.0.smithi044.stdout:1/410: rmdir d3/d59 39 2024-04-25T22:03:19.652 INFO:tasks.workunit.client.0.smithi044.stdout:4/336: fsync dd/f6c 0 2024-04-25T22:03:19.652 INFO:tasks.workunit.client.0.smithi044.stdout:5/333: write d2/f4 [6074484,67555] 0 2024-04-25T22:03:19.652 INFO:tasks.workunit.client.0.smithi044.stdout:7/312: truncate d1c/d22/d28/d57/f5a 354007 0 2024-04-25T22:03:19.652 INFO:tasks.workunit.client.0.smithi044.stdout:4/337: rename cb to dd/d35/d52/d61/c74 0 2024-04-25T22:03:19.652 INFO:tasks.workunit.client.0.smithi044.stdout:3/393: dwrite d0/d13/f37 [0,4194304] 0 2024-04-25T22:03:19.652 INFO:tasks.workunit.client.0.smithi044.stdout:7/313: write d1c/d22/d4a/f64 [298672,66704] 0 2024-04-25T22:03:19.652 INFO:tasks.workunit.client.0.smithi044.stdout:4/338: write dd/f1b [134765,87811] 0 2024-04-25T22:03:19.652 INFO:tasks.workunit.client.0.smithi044.stdout:7/314: chown d1c/d22/d28/d30 0 1 2024-04-25T22:03:19.652 INFO:tasks.workunit.client.0.smithi044.stdout:6/455: write d2/d23/d5a/d11/d3b/f58 [1603038,119439] 0 2024-04-25T22:03:19.653 INFO:tasks.workunit.client.0.smithi044.stdout:8/521: getdents d2a 0 2024-04-25T22:03:19.653 INFO:tasks.workunit.client.0.smithi044.stdout:3/394: creat d0/d1/d15/d51/dd/d35/f7b x:0 0 0 2024-04-25T22:03:19.653 INFO:tasks.workunit.client.0.smithi044.stdout:4/339: rename dd/d19/c1a to dd/d35/d52/d61/c75 0 2024-04-25T22:03:19.653 INFO:tasks.workunit.client.0.smithi044.stdout:0/354: truncate d8/d20/f31 3806233 0 2024-04-25T22:03:19.653 INFO:tasks.workunit.client.0.smithi044.stdout:3/395: rmdir d0/d1/d15/d51/dd/d11/d43 39 2024-04-25T22:03:19.653 INFO:tasks.workunit.client.0.smithi044.stdout:8/522: rename d2a/d32/d3e/fa0 to d2a/d39/d42/d68/d6b/d6e/fb2 0 2024-04-25T22:03:19.653 INFO:tasks.workunit.client.0.smithi044.stdout:4/340: fdatasync dd/d19/f2b 0 2024-04-25T22:03:19.656 INFO:tasks.workunit.client.0.smithi044.stdout:8/523: creat d2a/d52/fb3 x:0 0 0 2024-04-25T22:03:19.656 INFO:tasks.workunit.client.0.smithi044.stdout:6/456: rename d2/d23/d5a/d12/d49/d7f/d98 to d2/d23/d5a/d13/d4b/d5e/d9c 0 2024-04-25T22:03:19.656 INFO:tasks.workunit.client.0.smithi044.stdout:5/334: dwrite d2/d35/f3f [0,4194304] 0 2024-04-25T22:03:19.656 INFO:tasks.workunit.client.0.smithi044.stdout:3/396: getdents d0/d13/d1c 0 2024-04-25T22:03:19.656 INFO:tasks.workunit.client.0.smithi044.stdout:5/335: rmdir d2 39 2024-04-25T22:03:19.656 INFO:tasks.workunit.client.0.smithi044.stdout:3/397: rmdir d0/d1 39 2024-04-25T22:03:19.656 INFO:tasks.workunit.client.0.smithi044.stdout:7/315: dwrite d1c/d22/d28/d30/d32/f42 [0,4194304] 0 2024-04-25T22:03:19.656 INFO:tasks.workunit.client.0.smithi044.stdout:6/457: getdents d2/d23 0 2024-04-25T22:03:19.656 INFO:tasks.workunit.client.0.smithi044.stdout:7/316: chown d1c/d22/d28/d57/f60 844 1 2024-04-25T22:03:19.656 INFO:tasks.workunit.client.0.smithi044.stdout:9/480: dread d4/d7/d18/d2d/f38 [0,4194304] 0 2024-04-25T22:03:19.656 INFO:tasks.workunit.client.0.smithi044.stdout:7/317: fsync d1c/d22/f5c 0 2024-04-25T22:03:19.657 INFO:tasks.workunit.client.0.smithi044.stdout:4/341: dread dd/d19/f6d [0,4194304] 0 2024-04-25T22:03:19.657 INFO:tasks.workunit.client.0.smithi044.stdout:9/481: mknod d4/d37/d54/ca1 0 2024-04-25T22:03:19.657 INFO:tasks.workunit.client.0.smithi044.stdout:6/458: write d2/d23/d5a/d12/d27/f2d [5683742,4032] 0 2024-04-25T22:03:19.657 INFO:tasks.workunit.client.0.smithi044.stdout:7/318: creat d1c/d22/d28/d30/d32/d33/f65 x:0 0 0 2024-04-25T22:03:19.657 INFO:tasks.workunit.client.0.smithi044.stdout:4/342: mkdir dd/d35/d52/d61/d76 0 2024-04-25T22:03:19.657 INFO:tasks.workunit.client.0.smithi044.stdout:6/459: mknod d2/d23/d5a/d12/d49/d7f/c9d 0 2024-04-25T22:03:19.657 INFO:tasks.workunit.client.0.smithi044.stdout:9/482: symlink d4/d7/d18/la2 0 2024-04-25T22:03:19.657 INFO:tasks.workunit.client.0.smithi044.stdout:7/319: read d1c/d22/d28/d4e/f5e [124302,38477] 0 2024-04-25T22:03:19.657 INFO:tasks.workunit.client.0.smithi044.stdout:4/343: unlink dd/d19/l1f 0 2024-04-25T22:03:19.657 INFO:tasks.workunit.client.0.smithi044.stdout:7/320: mkdir d1c/d22/d28/d66 0 2024-04-25T22:03:19.657 INFO:tasks.workunit.client.0.smithi044.stdout:7/321: write f12 [4224043,72763] 0 2024-04-25T22:03:19.657 INFO:tasks.workunit.client.0.smithi044.stdout:4/344: write dd/d35/d52/f60 [900324,8840] 0 2024-04-25T22:03:19.657 INFO:tasks.workunit.client.0.smithi044.stdout:9/483: creat d4/d3d/d66/d93/fa3 x:0 0 0 2024-04-25T22:03:19.657 INFO:tasks.workunit.client.0.smithi044.stdout:7/322: mknod d1c/d22/d28/d4e/c67 0 2024-04-25T22:03:19.657 INFO:tasks.workunit.client.0.smithi044.stdout:6/460: link d2/d23/d30/c91 d2/d23/d5a/d11/c9e 0 2024-04-25T22:03:19.658 INFO:tasks.workunit.client.0.smithi044.stdout:7/323: chown c1b 123179 1 2024-04-25T22:03:19.658 INFO:tasks.workunit.client.0.smithi044.stdout:7/324: mknod d1c/d22/d28/d4e/c68 0 2024-04-25T22:03:19.658 INFO:tasks.workunit.client.0.smithi044.stdout:4/345: dread dd/f11 [4194304,4194304] 0 2024-04-25T22:03:19.658 INFO:tasks.workunit.client.0.smithi044.stdout:7/325: unlink d1c/d22/c24 0 2024-04-25T22:03:19.658 INFO:tasks.workunit.client.0.smithi044.stdout:7/326: stat d1c/d22/d28/d4e/c68 0 2024-04-25T22:03:19.659 INFO:tasks.workunit.client.0.smithi044.stdout:8/524: dread d2a/d32/d3e/f54 [0,4194304] 0 2024-04-25T22:03:19.659 INFO:tasks.workunit.client.0.smithi044.stdout:7/327: symlink d1c/l69 0 2024-04-25T22:03:19.660 INFO:tasks.workunit.client.0.smithi044.stdout:8/525: creat d2a/d32/d57/d5e/fb4 x:0 0 0 2024-04-25T22:03:19.661 INFO:tasks.workunit.client.0.smithi044.stdout:6/461: dwrite d2/d23/d5a/d12/f7a [0,4194304] 0 2024-04-25T22:03:19.661 INFO:tasks.workunit.client.0.smithi044.stdout:7/328: dread d1c/d22/d28/f3d [0,4194304] 0 2024-04-25T22:03:19.662 INFO:tasks.workunit.client.0.smithi044.stdout:4/346: dread dd/f6f [0,4194304] 0 2024-04-25T22:03:19.662 INFO:tasks.workunit.client.0.smithi044.stdout:8/526: truncate d2a/d77/fae 540069 0 2024-04-25T22:03:19.663 INFO:tasks.workunit.client.0.smithi044.stdout:7/329: mkdir d1c/d22/d28/d4e/d6a 0 2024-04-25T22:03:19.666 INFO:tasks.workunit.client.0.smithi044.stdout:3/398: write d0/d1/d15/d51/dd/f4e [456480,20783] 0 2024-04-25T22:03:19.666 INFO:tasks.workunit.client.0.smithi044.stdout:9/484: write d4/d7/f4d [361148,65995] 0 2024-04-25T22:03:19.666 INFO:tasks.workunit.client.0.smithi044.stdout:7/330: write d1c/d22/d28/d30/f46 [4345061,10276] 0 2024-04-25T22:03:19.668 INFO:tasks.workunit.client.0.smithi044.stdout:9/485: unlink d4/d7/d18/f7a 0 2024-04-25T22:03:19.668 INFO:tasks.workunit.client.0.smithi044.stdout:6/462: getdents d2/d23/d5a/d12/d1f/d94 0 2024-04-25T22:03:19.669 INFO:tasks.workunit.client.0.smithi044.stdout:3/399: getdents d0/d13 0 2024-04-25T22:03:19.669 INFO:tasks.workunit.client.0.smithi044.stdout:4/347: dwrite dd/f46 [4194304,4194304] 0 2024-04-25T22:03:19.670 INFO:tasks.workunit.client.0.smithi044.stdout:8/527: dwrite d2a/d32/d57/d5e/fb0 [0,4194304] 0 2024-04-25T22:03:19.672 INFO:tasks.workunit.client.0.smithi044.stdout:3/400: mkdir d0/d70/d7c 0 2024-04-25T22:03:19.672 INFO:tasks.workunit.client.0.smithi044.stdout:1/411: dread d3/d7/db/f3c [0,4194304] 0 2024-04-25T22:03:19.673 INFO:tasks.workunit.client.0.smithi044.stdout:3/401: write d0/d1/d15/d51/dd/f4e [459270,109194] 0 2024-04-25T22:03:19.677 INFO:tasks.workunit.client.0.smithi044.stdout:0/355: dread f1 [0,4194304] 0 2024-04-25T22:03:19.677 INFO:tasks.workunit.client.0.smithi044.stdout:1/412: getdents d3/d7/d29/d43 0 2024-04-25T22:03:19.678 INFO:tasks.workunit.client.0.smithi044.stdout:7/331: dread d1c/d22/d28/d30/d32/d33/f3e [0,4194304] 0 2024-04-25T22:03:19.681 INFO:tasks.workunit.client.0.smithi044.stdout:4/348: dwrite fa [0,4194304] 0 2024-04-25T22:03:19.681 INFO:tasks.workunit.client.0.smithi044.stdout:7/332: rmdir d1c/d22/d28/d57 39 2024-04-25T22:03:19.681 INFO:tasks.workunit.client.0.smithi044.stdout:6/463: dwrite d2/d23/d5a/d11/f21 [0,4194304] 0 2024-04-25T22:03:19.681 INFO:tasks.workunit.client.0.smithi044.stdout:8/528: dwrite f0 [0,4194304] 0 2024-04-25T22:03:19.681 INFO:tasks.workunit.client.0.smithi044.stdout:1/413: link d3/d7/db/d42/f77 d3/d30/d3f/f80 0 2024-04-25T22:03:19.685 INFO:tasks.workunit.client.0.smithi044.stdout:4/349: link dd/d19/f1d dd/d19/d38/f77 0 2024-04-25T22:03:19.685 INFO:tasks.workunit.client.0.smithi044.stdout:6/464: symlink d2/d23/d5a/d13/d4b/d5e/l9f 0 2024-04-25T22:03:19.685 INFO:tasks.workunit.client.0.smithi044.stdout:2/373: sync 2024-04-25T22:03:19.685 INFO:tasks.workunit.client.0.smithi044.stdout:4/350: fdatasync dd/d19/f49 0 2024-04-25T22:03:19.685 INFO:tasks.workunit.client.0.smithi044.stdout:2/374: write d7/f31 [2632204,38162] 0 2024-04-25T22:03:19.686 INFO:tasks.workunit.client.0.smithi044.stdout:9/486: dwrite d4/d7/d18/d2e/d73/f7c [0,4194304] 0 2024-04-25T22:03:19.686 INFO:tasks.workunit.client.0.smithi044.stdout:1/414: mkdir d3/d7/d81 0 2024-04-25T22:03:19.686 INFO:tasks.workunit.client.0.smithi044.stdout:6/465: write d2/d23/d5a/d11/d3b/f7e [496007,90780] 0 2024-04-25T22:03:19.688 INFO:tasks.workunit.client.0.smithi044.stdout:7/333: creat d1c/d22/f6b x:0 0 0 2024-04-25T22:03:19.688 INFO:tasks.workunit.client.0.smithi044.stdout:6/466: write d2/d23/d5a/d11/d3b/f71 [433704,29900] 0 2024-04-25T22:03:19.688 INFO:tasks.workunit.client.0.smithi044.stdout:9/487: write d4/d7/d18/d3a/d8b/f90 [843716,4967] 0 2024-04-25T22:03:19.689 INFO:tasks.workunit.client.0.smithi044.stdout:1/415: rename d3/d30/d3f/l5f to d3/d54/d76/l82 0 2024-04-25T22:03:19.691 INFO:tasks.workunit.client.0.smithi044.stdout:8/529: dwrite d2a/f36 [4194304,4194304] 0 2024-04-25T22:03:19.691 INFO:tasks.workunit.client.0.smithi044.stdout:1/416: mkdir d3/d7/d83 0 2024-04-25T22:03:19.691 INFO:tasks.workunit.client.0.smithi044.stdout:6/467: creat d2/d23/d30/fa0 x:0 0 0 2024-04-25T22:03:19.692 INFO:tasks.workunit.client.0.smithi044.stdout:9/488: rmdir d4/d7/d18/d2d/d70/d9a 0 2024-04-25T22:03:19.692 INFO:tasks.workunit.client.0.smithi044.stdout:1/417: chown d3/d7/f2f 1780614399 1 2024-04-25T22:03:19.693 INFO:tasks.workunit.client.0.smithi044.stdout:9/489: symlink d4/d37/d54/d84/la4 0 2024-04-25T22:03:19.693 INFO:tasks.workunit.client.0.smithi044.stdout:7/334: symlink d1c/d22/d28/l6c 0 2024-04-25T22:03:19.693 INFO:tasks.workunit.client.0.smithi044.stdout:1/418: truncate d3/d30/d3f/f5a 1743023 0 2024-04-25T22:03:19.693 INFO:tasks.workunit.client.0.smithi044.stdout:7/335: readlink d1c/l1d 0 2024-04-25T22:03:19.694 INFO:tasks.workunit.client.0.smithi044.stdout:7/336: chown d1c/d22/d28/d30/d32 31271 1 2024-04-25T22:03:19.694 INFO:tasks.workunit.client.0.smithi044.stdout:1/419: creat d3/d7/d29/d50/f84 x:0 0 0 2024-04-25T22:03:19.695 INFO:tasks.workunit.client.0.smithi044.stdout:7/337: symlink d1c/d22/d28/d4e/d6a/l6d 0 2024-04-25T22:03:19.695 INFO:tasks.workunit.client.0.smithi044.stdout:7/338: fdatasync d1c/f2c 0 2024-04-25T22:03:19.695 INFO:tasks.workunit.client.0.smithi044.stdout:7/339: readlink d1c/l3c 0 2024-04-25T22:03:19.698 INFO:tasks.workunit.client.0.smithi044.stdout:7/340: mkdir d1c/d22/d28/d66/d6e 0 2024-04-25T22:03:19.702 INFO:tasks.workunit.client.0.smithi044.stdout:3/402: truncate d0/f5c 3811889 0 2024-04-25T22:03:19.703 INFO:tasks.workunit.client.0.smithi044.stdout:3/403: symlink d0/d1/d15/df/d5d/d71/d74/l7d 0 2024-04-25T22:03:19.709 INFO:tasks.workunit.client.0.smithi044.stdout:3/404: dwrite d0/d13/d1c/f30 [0,4194304] 0 2024-04-25T22:03:19.710 INFO:tasks.workunit.client.0.smithi044.stdout:3/405: creat d0/d1/f7e x:0 0 0 2024-04-25T22:03:19.710 INFO:tasks.workunit.client.0.smithi044.stdout:3/406: creat d0/d13/f7f x:0 0 0 2024-04-25T22:03:19.717 INFO:tasks.workunit.client.0.smithi044.stdout:3/407: dwrite d0/d1/fe [0,4194304] 0 2024-04-25T22:03:19.718 INFO:tasks.workunit.client.0.smithi044.stdout:3/408: mknod d0/d1/c80 0 2024-04-25T22:03:19.718 INFO:tasks.workunit.client.0.smithi044.stdout:9/490: dread d4/d37/d54/d84/d72/d97/f9d [4194304,4194304] 0 2024-04-25T22:03:19.720 INFO:tasks.workunit.client.0.smithi044.stdout:3/409: mkdir d0/d1/d15/d81 0 2024-04-25T22:03:19.720 INFO:tasks.workunit.client.0.smithi044.stdout:9/491: rmdir d4/d3d/d58/d8d 0 2024-04-25T22:03:19.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:19.717+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:19.721 INFO:tasks.workunit.client.0.smithi044.stdout:3/410: chown d0/d1/d15/d51/dd/d35/f52 3433 1 2024-04-25T22:03:19.721 INFO:tasks.workunit.client.0.smithi044.stdout:9/492: write d4/d37/d54/d84/d64/f96 [519556,15717] 0 2024-04-25T22:03:19.721 INFO:tasks.workunit.client.0.smithi044.stdout:9/493: mkdir d4/d3d/da5 0 2024-04-25T22:03:19.722 INFO:tasks.workunit.client.0.smithi044.stdout:3/411: unlink d0/d1/d15/d51/dd/d11/d43/d44/c4f 0 2024-04-25T22:03:19.725 INFO:tasks.workunit.client.0.smithi044.stdout:9/494: dread d4/d7/d18/d2d/f38 [0,4194304] 0 2024-04-25T22:03:19.726 INFO:tasks.workunit.client.0.smithi044.stdout:9/495: symlink d4/d3d/d66/d93/la6 0 2024-04-25T22:03:19.728 INFO:tasks.workunit.client.0.smithi044.stdout:9/496: stat d4/d7/d18/d3a/c53 0 2024-04-25T22:03:19.729 INFO:tasks.workunit.client.0.smithi044.stdout:4/351: dread dd/ff [0,4194304] 0 2024-04-25T22:03:19.729 INFO:tasks.workunit.client.0.smithi044.stdout:9/497: link d4/d7/d18/d3a/c53 d4/d4b/ca7 0 2024-04-25T22:03:19.730 INFO:tasks.workunit.client.0.smithi044.stdout:4/352: rmdir dd/d19 39 2024-04-25T22:03:19.731 INFO:tasks.workunit.client.0.smithi044.stdout:9/498: rename d4/l2f to d4/d3d/da5/la8 0 2024-04-25T22:03:19.731 INFO:tasks.workunit.client.0.smithi044.stdout:9/499: fdatasync d4/d37/d54/d84/d64/f96 0 2024-04-25T22:03:19.732 INFO:tasks.workunit.client.0.smithi044.stdout:9/500: creat d4/d7/fa9 x:0 0 0 2024-04-25T22:03:19.734 INFO:tasks.workunit.client.0.smithi044.stdout:9/501: chown d4/d7/d18/d2e/f3f 0 1 2024-04-25T22:03:19.734 INFO:tasks.workunit.client.0.smithi044.stdout:3/412: dread d0/f31 [0,4194304] 0 2024-04-25T22:03:19.735 INFO:tasks.workunit.client.0.smithi044.stdout:9/502: stat d4/d37/f74 0 2024-04-25T22:03:19.735 INFO:tasks.workunit.client.0.smithi044.stdout:3/413: rmdir d0/d1/d34 39 2024-04-25T22:03:19.735 INFO:tasks.workunit.client.0.smithi044.stdout:9/503: creat d4/d4b/faa x:0 0 0 2024-04-25T22:03:19.736 INFO:tasks.workunit.client.0.smithi044.stdout:3/414: write d0/d1/d15/d51/dd/d28/f3f [273356,59734] 0 2024-04-25T22:03:19.736 INFO:tasks.workunit.client.0.smithi044.stdout:4/353: dwrite dd/f4b [0,4194304] 0 2024-04-25T22:03:19.736 INFO:tasks.workunit.client.0.smithi044.stdout:5/336: sync 2024-04-25T22:03:19.738 INFO:tasks.workunit.client.0.smithi044.stdout:5/337: mkdir d2/d5/d6a 0 2024-04-25T22:03:19.738 INFO:tasks.workunit.client.0.smithi044.stdout:4/354: truncate dd/d19/f27 3706264 0 2024-04-25T22:03:19.740 INFO:tasks.workunit.client.0.smithi044.stdout:0/356: dread d8/f11 [0,4194304] 0 2024-04-25T22:03:19.741 INFO:tasks.workunit.client.0.smithi044.stdout:9/504: dread d4/d3d/f68 [0,4194304] 0 2024-04-25T22:03:19.741 INFO:tasks.workunit.client.0.smithi044.stdout:0/357: write d8/da/d55/f6d [803509,78743] 0 2024-04-25T22:03:19.743 INFO:tasks.workunit.client.0.smithi044.stdout:0/358: unlink d8/d15/d51/d65/f6b 0 2024-04-25T22:03:19.743 INFO:tasks.workunit.client.0.smithi044.stdout:3/415: dwrite d0/d13/f7f [0,4194304] 0 2024-04-25T22:03:19.743 INFO:tasks.workunit.client.0.smithi044.stdout:0/359: chown d8/d15/d51 6654596 1 2024-04-25T22:03:19.747 INFO:tasks.workunit.client.0.smithi044.stdout:6/468: dread d2/d23/d5a/d11/d3b/f32 [0,4194304] 0 2024-04-25T22:03:19.748 INFO:tasks.workunit.client.0.smithi044.stdout:6/469: write d2/d23/d5a/d13/d68/f50 [937864,2982] 0 2024-04-25T22:03:19.749 INFO:tasks.workunit.client.0.smithi044.stdout:0/360: dwrite d8/df/d17/f44 [0,4194304] 0 2024-04-25T22:03:19.750 INFO:tasks.workunit.client.0.smithi044.stdout:0/361: write d8/df/f41 [674097,38962] 0 2024-04-25T22:03:19.750 INFO:tasks.workunit.client.0.smithi044.stdout:6/470: creat d2/d23/d5a/d12/d27/d8d/fa1 x:0 0 0 2024-04-25T22:03:19.750 INFO:tasks.workunit.client.0.smithi044.stdout:0/362: rename d8/d20/f38 to d8/df/d17/f76 0 2024-04-25T22:03:19.751 INFO:tasks.workunit.client.0.smithi044.stdout:0/363: creat d8/da/d55/f77 x:0 0 0 2024-04-25T22:03:19.752 INFO:tasks.workunit.client.0.smithi044.stdout:9/505: read d4/d7/d18/d3a/f6c [107518,12691] 0 2024-04-25T22:03:19.752 INFO:tasks.workunit.client.0.smithi044.stdout:0/364: write d8/d15/f42 [1504423,89058] 0 2024-04-25T22:03:19.752 INFO:tasks.workunit.client.0.smithi044.stdout:9/506: readlink d4/l12 0 2024-04-25T22:03:19.752 INFO:tasks.workunit.client.0.smithi044.stdout:0/365: dread - d8/df/d17/d45/f63 zero size 2024-04-25T22:03:19.757 INFO:tasks.workunit.client.0.smithi044.stdout:5/338: read d2/d5/d27/d2a/f30 [863138,94098] 0 2024-04-25T22:03:19.767 INFO:tasks.workunit.client.0.smithi044.stdout:2/375: truncate d7/d16/d2c/f6d 2108664 0 2024-04-25T22:03:19.767 INFO:tasks.workunit.client.0.smithi044.stdout:8/530: write d2a/d32/f79 [425347,31468] 0 2024-04-25T22:03:19.767 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:19.768 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:19.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.768 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:12310 4.8 4:134aee0d:::10000003159.00000000:head [read 1048576~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:19.768 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:19.765429+0000", 2024-04-25T22:03:19.768 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.001562134, 2024-04-25T22:03:19.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001595522, 2024-04-25T22:03:19.768 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:19.768 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:19.768 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-25T22:03:19.768 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:19.768 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:19.768 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:19.768 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 12310 2024-04-25T22:03:19.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.769 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:19.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:19.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.765429+0000", 2024-04-25T22:03:19.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:19.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:19.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.765429+0000", 2024-04-25T22:03:19.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:19.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:19.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.765430+0000", 2024-04-25T22:03:19.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0839999999999999e-06 2024-04-25T22:03:19.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:19.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.765434+0000", 2024-04-25T22:03:19.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5120000000000002e-06 2024-04-25T22:03:19.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:19.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.765450+0000", 2024-04-25T22:03:19.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5364999999999999e-05 2024-04-25T22:03:19.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.765457+0000", 2024-04-25T22:03:19.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5800000000000003e-06 2024-04-25T22:03:19.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:19.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.765517+0000", 2024-04-25T22:03:19.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9237999999999998e-05 2024-04-25T22:03:19.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:19.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.765596+0000", 2024-04-25T22:03:19.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9332000000000005e-05 2024-04-25T22:03:19.771 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:19.771 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:19.772 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:19.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.772 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:12311 4.d 4:b3d14401:::10000003269.00000000:head [read 1048576~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:19.772 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:19.765807+0000", 2024-04-25T22:03:19.772 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.001183765, 2024-04-25T22:03:19.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00130524, 2024-04-25T22:03:19.772 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:19.772 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:19.772 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-25T22:03:19.772 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:19.772 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:19.772 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:19.772 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 12311 2024-04-25T22:03:19.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.773 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:19.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:19.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.765807+0000", 2024-04-25T22:03:19.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:19.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:19.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.765807+0000", 2024-04-25T22:03:19.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:19.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:19.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.765808+0000", 2024-04-25T22:03:19.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0109999999999999e-06 2024-04-25T22:03:19.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:19.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.765816+0000", 2024-04-25T22:03:19.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7789999999999996e-06 2024-04-25T22:03:19.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:19.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.765830+0000", 2024-04-25T22:03:19.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4561e-05 2024-04-25T22:03:19.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.765839+0000", 2024-04-25T22:03:19.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1780000000000003e-06 2024-04-25T22:03:19.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:19.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.765885+0000", 2024-04-25T22:03:19.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5867e-05 2024-04-25T22:03:19.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:19.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.765927+0000", 2024-04-25T22:03:19.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2969999999999997e-05 2024-04-25T22:03:19.775 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:19.775 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:19.776 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:19.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.776 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:12290 4.29 e66/16 4:96c7c60a:::10000003366.00000000:head v 66'173, mlcod=66'171)", 2024-04-25T22:03:19.776 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:19.747655+0000", 2024-04-25T22:03:19.776 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.019336094000000002, 2024-04-25T22:03:19.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019530713000000002, 2024-04-25T22:03:19.776 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:19.776 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:19.776 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-25T22:03:19.776 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:19.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:19.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.747655+0000", 2024-04-25T22:03:19.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:19.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:19.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.747655+0000", 2024-04-25T22:03:19.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:19.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:19.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.747656+0000", 2024-04-25T22:03:19.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4440000000000001e-06 2024-04-25T22:03:19.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:19.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.755821+0000", 2024-04-25T22:03:19.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081647449999999993 2024-04-25T22:03:19.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:19.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.755839+0000", 2024-04-25T22:03:19.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7538e-05 2024-04-25T22:03:19.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.755847+0000", 2024-04-25T22:03:19.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4859999999999997e-06 2024-04-25T22:03:19.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:19.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.755916+0000", 2024-04-25T22:03:19.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9280000000000001e-05 2024-04-25T22:03:19.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:19.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.755931+0000", 2024-04-25T22:03:19.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.502e-05 2024-04-25T22:03:19.779 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:19.779 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:19.779 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:19.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.779 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:12297 4.35 4:ae7b229b:::100000030a9.00000000:head [write 0~4194304 [3@119153] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:19.780 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:19.749672+0000", 2024-04-25T22:03:19.780 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.017319145000000001, 2024-04-25T22:03:19.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017586092000000001, 2024-04-25T22:03:19.780 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:19.780 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:19.780 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:19.780 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:19.780 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:19.780 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:19.780 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 12297 2024-04-25T22:03:19.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.780 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:19.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:19.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.749672+0000", 2024-04-25T22:03:19.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:19.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:19.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.749672+0000", 2024-04-25T22:03:19.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:19.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:19.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.749674+0000", 2024-04-25T22:03:19.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6790000000000001e-06 2024-04-25T22:03:19.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:19.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.757032+0000", 2024-04-25T22:03:19.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073578150000000002 2024-04-25T22:03:19.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:19.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.757045+0000", 2024-04-25T22:03:19.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3008e-05 2024-04-25T22:03:19.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:19.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.757052+0000", 2024-04-25T22:03:19.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.844e-06 2024-04-25T22:03:19.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:19.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.757114+0000", 2024-04-25T22:03:19.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1740000000000002e-05 2024-04-25T22:03:19.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:19.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.757218+0000", 2024-04-25T22:03:19.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010432799999999999 2024-04-25T22:03:19.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:19.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:19.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:19.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.757314+0000", 2024-04-25T22:03:19.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5543000000000003e-05 2024-04-25T22:03:19.783 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:19.784 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:19.784 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:19.784 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:19.784 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:03:19.784 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 4 2024-04-25T22:03:19.784 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:19.784 INFO:tasks.workunit.client.0.smithi044.stdout:8/531: symlink d2a/d32/lb5 0 2024-04-25T22:03:19.785 INFO:tasks.workunit.client.0.smithi044.stdout:8/532: write fa [783414,34967] 0 2024-04-25T22:03:19.785 INFO:tasks.workunit.client.0.smithi044.stdout:0/366: dread d8/df/d17/f3d [0,4194304] 0 2024-04-25T22:03:19.785 INFO:tasks.workunit.client.0.smithi044.stdout:1/420: sync 2024-04-25T22:03:19.785 INFO:tasks.workunit.client.0.smithi044.stdout:7/341: sync 2024-04-25T22:03:19.786 INFO:tasks.workunit.client.0.smithi044.stdout:9/507: dread d4/d37/d54/d84/d72/d97/f9d [0,4194304] 0 2024-04-25T22:03:19.786 INFO:tasks.workunit.client.0.smithi044.stdout:9/508: stat d4/d7/d18/d2e/c49 0 2024-04-25T22:03:19.786 INFO:tasks.workunit.client.0.smithi044.stdout:7/342: write d1c/d22/f23 [559875,24868] 0 2024-04-25T22:03:19.786 INFO:tasks.workunit.client.0.smithi044.stdout:9/509: unlink d4/d3d/d66/d93/fa3 0 2024-04-25T22:03:19.786 INFO:tasks.workunit.client.0.smithi044.stdout:4/355: dwrite dd/d19/d38/f5c [0,4194304] 0 2024-04-25T22:03:19.787 INFO:tasks.workunit.client.0.smithi044.stdout:4/356: chown fa 4668163 1 2024-04-25T22:03:19.789 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:19.790 INFO:tasks.workunit.client.0.smithi044.stdout:0/367: dwrite d8/d20/f5a [0,4194304] 0 2024-04-25T22:03:19.790 INFO:tasks.workunit.client.0.smithi044.stdout:4/357: mkdir dd/d35/d78 0 2024-04-25T22:03:19.790 INFO:tasks.workunit.client.0.smithi044.stdout:6/471: rename c1 to d2/d23/d5a/d13/d4b/d5e/d9c/ca2 0 2024-04-25T22:03:19.790 INFO:tasks.workunit.client.0.smithi044.stdout:3/416: creat d0/f82 x:0 0 0 2024-04-25T22:03:19.791 INFO:tasks.workunit.client.0.smithi044.stdout:4/358: mkdir dd/d19/d72/d79 0 2024-04-25T22:03:19.791 INFO:tasks.workunit.client.0.smithi044.stdout:6/472: write d2/d23/d30/fa0 [88909,50433] 0 2024-04-25T22:03:19.792 INFO:tasks.workunit.client.0.smithi044.stdout:6/473: stat d2/d23/d5a/d12/d27/f31 0 2024-04-25T22:03:19.793 INFO:tasks.workunit.client.0.smithi044.stdout:6/474: stat d2/d23/d5a 0 2024-04-25T22:03:19.793 INFO:tasks.workunit.client.0.smithi044.stdout:5/339: dwrite d2/d5/f18 [0,4194304] 0 2024-04-25T22:03:19.793 INFO:tasks.workunit.client.0.smithi044.stdout:4/359: rename dd/d19/d38/c62 to dd/d35/d52/c7a 0 2024-04-25T22:03:19.794 INFO:tasks.workunit.client.0.smithi044.stdout:7/343: dwrite d1c/f2f [0,4194304] 0 2024-04-25T22:03:19.794 INFO:tasks.workunit.client.0.smithi044.stdout:5/340: fdatasync d2/d5/d21/d38/f60 0 2024-04-25T22:03:19.794 INFO:tasks.workunit.client.0.smithi044.stdout:6/475: write d2/d23/d5a/d12/d27/f31 [1140443,42826] 0 2024-04-25T22:03:19.795 INFO:tasks.workunit.client.0.smithi044.stdout:7/344: dread - d1c/d22/f5c zero size 2024-04-25T22:03:19.796 INFO:tasks.workunit.client.0.smithi044.stdout:2/376: dread d7/f31 [0,4194304] 0 2024-04-25T22:03:19.797 INFO:tasks.workunit.client.0.smithi044.stdout:5/341: write d2/f19 [1062867,64041] 0 2024-04-25T22:03:19.797 INFO:tasks.workunit.client.0.smithi044.stdout:6/476: write d2/d23/d5a/d12/d27/f45 [2113218,8166] 0 2024-04-25T22:03:19.798 INFO:tasks.workunit.client.0.smithi044.stdout:5/342: mkdir d2/d5/d21/d6b 0 2024-04-25T22:03:19.800 INFO:tasks.workunit.client.0.smithi044.stdout:1/421: truncate d3/d7/db/f56 2267736 0 2024-04-25T22:03:19.800 INFO:tasks.workunit.client.0.smithi044.stdout:8/533: dread d2a/d39/f3a [0,4194304] 0 2024-04-25T22:03:19.801 INFO:tasks.workunit.client.0.smithi044.stdout:9/510: write d4/d7/d18/d2e/f4c [4158763,83693] 0 2024-04-25T22:03:19.802 INFO:tasks.workunit.client.0.smithi044.stdout:3/417: getdents d0 0 2024-04-25T22:03:19.804 INFO:tasks.workunit.client.0.smithi044.stdout:0/368: truncate d8/df/d17/f76 22177 0 2024-04-25T22:03:19.804 INFO:tasks.workunit.client.0.smithi044.stdout:7/345: dread d1c/d22/d4a/f62 [0,4194304] 0 2024-04-25T22:03:19.805 INFO:tasks.workunit.client.0.smithi044.stdout:6/477: dread d2/d23/d5a/d11/d3b/f58 [0,4194304] 0 2024-04-25T22:03:19.805 INFO:tasks.workunit.client.0.smithi044.stdout:9/511: chown d4/d37/d54/d84/d64/f9e 10479 1 2024-04-25T22:03:19.805 INFO:tasks.workunit.client.0.smithi044.stdout:4/360: getdents dd/d35/d52 0 2024-04-25T22:03:19.806 INFO:tasks.workunit.client.0.smithi044.stdout:2/377: dwrite d7/d16/f17 [4194304,4194304] 0 2024-04-25T22:03:19.807 INFO:tasks.workunit.client.0.smithi044.stdout:8/534: truncate d2a/d39/d42/d68/d6b/d6e/d84/f96 945438 0 2024-04-25T22:03:19.808 INFO:tasks.workunit.client.0.smithi044.stdout:3/418: write d0/d1/d15/d51/dd/d35/d36/f45 [3688809,88375] 0 2024-04-25T22:03:19.808 INFO:tasks.workunit.client.0.smithi044.stdout:6/478: symlink d2/d23/d5a/d12/d70/la3 0 2024-04-25T22:03:19.809 INFO:tasks.workunit.client.0.smithi044.stdout:9/512: unlink d4/d7/d18/d2d/ca0 0 2024-04-25T22:03:19.810 INFO:tasks.workunit.client.0.smithi044.stdout:5/343: dwrite d2/d5/d21/f49 [0,4194304] 0 2024-04-25T22:03:19.810 INFO:tasks.workunit.client.0.smithi044.stdout:8/535: mkdir d2a/d82/db6 0 2024-04-25T22:03:19.810 INFO:tasks.workunit.client.0.smithi044.stdout:2/378: unlink d7/d16/d2d/d4e/d2e/d6b/l6e 0 2024-04-25T22:03:19.811 INFO:tasks.workunit.client.0.smithi044.stdout:4/361: link dd/d19/f6d dd/d35/d52/f7b 0 2024-04-25T22:03:19.811 INFO:tasks.workunit.client.0.smithi044.stdout:3/419: write d0/d1/d15/d51/dd/d35/d36/f45 [5764648,24450] 0 2024-04-25T22:03:19.812 INFO:tasks.workunit.client.0.smithi044.stdout:9/513: symlink d4/d3d/da5/lab 0 2024-04-25T22:03:19.812 INFO:tasks.workunit.client.0.smithi044.stdout:2/379: write d7/f3f [2072057,123861] 0 2024-04-25T22:03:19.814 INFO:tasks.workunit.client.0.smithi044.stdout:4/362: mknod dd/d35/d52/d61/d76/c7c 0 2024-04-25T22:03:19.815 INFO:tasks.workunit.client.0.smithi044.stdout:5/344: creat d2/d5/d21/d38/d52/f6c x:0 0 0 2024-04-25T22:03:19.815 INFO:tasks.workunit.client.0.smithi044.stdout:3/420: chown d0/d1/d15/d51/dd/d11/d42/f4d 120 1 2024-04-25T22:03:19.816 INFO:tasks.workunit.client.0.smithi044.stdout:0/369: dwrite d8/da/d55/f6d [0,4194304] 0 2024-04-25T22:03:19.816 INFO:tasks.workunit.client.0.smithi044.stdout:2/380: chown d7/d16/d2c/f6d 2301 1 2024-04-25T22:03:19.817 INFO:tasks.workunit.client.0.smithi044.stdout:3/421: stat d0/d1/c80 0 2024-04-25T22:03:19.817 INFO:tasks.workunit.client.0.smithi044.stdout:9/514: getdents d4/d7/d79 0 2024-04-25T22:03:19.818 INFO:tasks.workunit.client.0.smithi044.stdout:7/346: dwrite d1c/d22/d28/d30/d32/d33/f65 [0,4194304] 0 2024-04-25T22:03:19.818 INFO:tasks.workunit.client.0.smithi044.stdout:2/381: mkdir d7/d7b 0 2024-04-25T22:03:19.818 INFO:tasks.workunit.client.0.smithi044.stdout:3/422: stat d0/d13/d1c/c4c 0 2024-04-25T22:03:19.819 INFO:tasks.workunit.client.0.smithi044.stdout:9/515: chown d4/d7/d18/d2e 228204 1 2024-04-25T22:03:19.819 INFO:tasks.workunit.client.0.smithi044.stdout:8/536: dread d2a/d39/f3a [0,4194304] 0 2024-04-25T22:03:19.821 INFO:tasks.workunit.client.0.smithi044.stdout:7/347: write d1c/d22/d28/d30/d32/f55 [597601,60769] 0 2024-04-25T22:03:19.822 INFO:tasks.workunit.client.0.smithi044.stdout:4/363: write dd/d19/f27 [1568339,124523] 0 2024-04-25T22:03:19.823 INFO:tasks.workunit.client.0.smithi044.stdout:8/537: read - d2a/d39/d42/d68/d6b/d7b/f8b zero size 2024-04-25T22:03:19.823 INFO:tasks.workunit.client.0.smithi044.stdout:2/382: symlink d7/d16/d2d/d57/l7c 0 2024-04-25T22:03:19.824 INFO:tasks.workunit.client.0.smithi044.stdout:4/364: readlink dd/l16 0 2024-04-25T22:03:19.825 INFO:tasks.workunit.client.0.smithi044.stdout:0/370: dread d8/f11 [0,4194304] 0 2024-04-25T22:03:19.825 INFO:tasks.workunit.client.0.smithi044.stdout:9/516: write d4/d7/d18/d3a/f6c [420111,446] 0 2024-04-25T22:03:19.826 INFO:tasks.workunit.client.0.smithi044.stdout:2/383: link d7/l64 d7/d5b/l7d 0 2024-04-25T22:03:19.826 INFO:tasks.workunit.client.0.smithi044.stdout:1/422: dwrite d3/d7/db/f56 [0,4194304] 0 2024-04-25T22:03:19.827 INFO:tasks.workunit.client.0.smithi044.stdout:9/517: chown d4/f40 268016762 1 2024-04-25T22:03:19.827 INFO:tasks.workunit.client.0.smithi044.stdout:7/348: dread d1c/d22/d28/d30/d32/f43 [0,4194304] 0 2024-04-25T22:03:19.828 INFO:tasks.workunit.client.0.smithi044.stdout:4/365: write dd/d19/f27 [3022878,129448] 0 2024-04-25T22:03:19.828 INFO:tasks.workunit.client.0.smithi044.stdout:2/384: fdatasync d7/d16/f20 0 2024-04-25T22:03:19.828 INFO:tasks.workunit.client.0.smithi044.stdout:0/371: chown d8/d20/f31 1492640 1 2024-04-25T22:03:19.829 INFO:tasks.workunit.client.0.smithi044.stdout:7/349: fdatasync d1c/f47 0 2024-04-25T22:03:19.829 INFO:tasks.workunit.client.0.smithi044.stdout:6/479: dread d2/d23/d5a/d13/d4b/f8c [0,4194304] 0 2024-04-25T22:03:19.829 INFO:tasks.workunit.client.0.smithi044.stdout:9/518: mkdir d4/d4b/dac 0 2024-04-25T22:03:19.829 INFO:tasks.workunit.client.0.smithi044.stdout:3/423: dwrite d0/d1/d15/d23/f40 [0,4194304] 0 2024-04-25T22:03:19.829 INFO:tasks.workunit.client.0.smithi044.stdout:9/519: fsync d4/f40 0 2024-04-25T22:03:19.831 INFO:tasks.workunit.client.0.smithi044.stdout:0/372: write d8/f3b [2205642,110193] 0 2024-04-25T22:03:19.831 INFO:tasks.workunit.client.0.smithi044.stdout:6/480: chown d2/d23/d5a/c22 387530 1 2024-04-25T22:03:19.832 INFO:tasks.workunit.client.0.smithi044.stdout:7/350: write d1c/d22/d28/d30/d32/f42 [737106,75317] 0 2024-04-25T22:03:19.832 INFO:tasks.workunit.client.0.smithi044.stdout:4/366: creat dd/d19/d72/f7d x:0 0 0 2024-04-25T22:03:19.832 INFO:tasks.workunit.client.0.smithi044.stdout:1/423: rename d3/d7/d29/d50 to d3/d7/d29/d43/d85 0 2024-04-25T22:03:19.833 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:19.832+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:19.833 INFO:tasks.workunit.client.0.smithi044.stdout:3/424: creat d0/d1/d79/f83 x:0 0 0 2024-04-25T22:03:19.833 INFO:tasks.workunit.client.0.smithi044.stdout:6/481: creat d2/d23/d5a/d12/d1f/fa4 x:0 0 0 2024-04-25T22:03:19.834 INFO:tasks.workunit.client.0.smithi044.stdout:0/373: mkdir d8/d78 0 2024-04-25T22:03:19.834 INFO:tasks.workunit.client.0.smithi044.stdout:8/538: dwrite d2a/f2f [0,4194304] 0 2024-04-25T22:03:19.835 INFO:tasks.workunit.client.0.smithi044.stdout:7/351: write d1c/d22/d28/d4e/f5e [501163,128171] 0 2024-04-25T22:03:19.838 INFO:tasks.workunit.client.0.smithi044.stdout:6/482: chown d2/d23/d5a/d11/d2a/c82 13625128 1 2024-04-25T22:03:19.838 INFO:tasks.workunit.client.0.smithi044.stdout:0/374: fdatasync d8/d20/f6a 0 2024-04-25T22:03:19.838 INFO:tasks.workunit.client.0.smithi044.stdout:1/424: creat d3/d30/d3f/f86 x:0 0 0 2024-04-25T22:03:19.838 INFO:tasks.workunit.client.0.smithi044.stdout:0/375: creat d8/d15/d51/f79 x:0 0 0 2024-04-25T22:03:19.838 INFO:tasks.workunit.client.0.smithi044.stdout:1/425: mknod d3/d7/d81/c87 0 2024-04-25T22:03:19.839 INFO:tasks.workunit.client.0.smithi044.stdout:7/352: rename d1c/d22/d28/d30/d32/c63 to d1c/d22/c6f 0 2024-04-25T22:03:19.840 INFO:tasks.workunit.client.0.smithi044.stdout:9/520: dwrite d4/f8c [0,4194304] 0 2024-04-25T22:03:19.840 INFO:tasks.workunit.client.0.smithi044.stdout:0/376: creat d8/da/f7a x:0 0 0 2024-04-25T22:03:19.840 INFO:tasks.workunit.client.0.smithi044.stdout:1/426: chown d3/f49 1026 1 2024-04-25T22:03:19.841 INFO:tasks.workunit.client.0.smithi044.stdout:0/377: dread - d8/d20/f6c zero size 2024-04-25T22:03:19.841 INFO:tasks.workunit.client.0.smithi044.stdout:7/353: chown d1c/d22/d28/d4e/c68 0 1 2024-04-25T22:03:19.841 INFO:tasks.workunit.client.0.smithi044.stdout:1/427: chown d3/d7/l13 14238698 1 2024-04-25T22:03:19.841 INFO:tasks.workunit.client.0.smithi044.stdout:4/367: dwrite dd/d35/d52/f60 [0,4194304] 0 2024-04-25T22:03:19.842 INFO:tasks.workunit.client.0.smithi044.stdout:0/378: dread - d8/d20/f6c zero size 2024-04-25T22:03:19.845 INFO:tasks.workunit.client.0.smithi044.stdout:4/368: stat dd/l12 0 2024-04-25T22:03:19.845 INFO:tasks.workunit.client.0.smithi044.stdout:0/379: unlink d8/d24/l70 0 2024-04-25T22:03:19.845 INFO:tasks.workunit.client.0.smithi044.stdout:1/428: symlink d3/d7/d29/l88 0 2024-04-25T22:03:19.845 INFO:tasks.workunit.client.0.smithi044.stdout:9/521: getdents d4/d4b/d86 0 2024-04-25T22:03:19.845 INFO:tasks.workunit.client.0.smithi044.stdout:7/354: link d1c/d22/d28/l6c d1c/d22/d28/d4e/d6a/l70 0 2024-04-25T22:03:19.846 INFO:tasks.workunit.client.0.smithi044.stdout:1/429: mknod d3/d30/c89 0 2024-04-25T22:03:19.846 INFO:tasks.workunit.client.0.smithi044.stdout:4/369: truncate dd/d35/d52/d61/f66 763209 0 2024-04-25T22:03:19.846 INFO:tasks.workunit.client.0.smithi044.stdout:0/380: fdatasync d8/d15/f30 0 2024-04-25T22:03:19.849 INFO:tasks.workunit.client.0.smithi044.stdout:4/370: dread dd/d35/d52/d61/f66 [0,4194304] 0 2024-04-25T22:03:19.849 INFO:tasks.workunit.client.0.smithi044.stdout:0/381: symlink d8/l7b 0 2024-04-25T22:03:19.849 INFO:tasks.workunit.client.0.smithi044.stdout:1/430: dread d3/d30/d3f/f68 [0,4194304] 0 2024-04-25T22:03:19.850 INFO:tasks.workunit.client.0.smithi044.stdout:0/382: unlink d8/l7b 0 2024-04-25T22:03:19.851 INFO:tasks.workunit.client.0.smithi044.stdout:4/371: truncate dd/d35/d52/f7b 5003794 0 2024-04-25T22:03:19.851 INFO:tasks.workunit.client.0.smithi044.stdout:3/425: truncate d0/d13/f37 3742257 0 2024-04-25T22:03:19.852 INFO:tasks.workunit.client.0.smithi044.stdout:2/385: dwrite d7/d16/d2d/d4e/f36 [0,4194304] 0 2024-04-25T22:03:19.852 INFO:tasks.workunit.client.0.smithi044.stdout:4/372: chown dd/d19/f27 665901 1 2024-04-25T22:03:19.853 INFO:tasks.workunit.client.0.smithi044.stdout:2/386: symlink d7/d16/d4b/l7e 0 2024-04-25T22:03:19.853 INFO:tasks.workunit.client.0.smithi044.stdout:3/426: unlink d0/d1/d15/c72 0 2024-04-25T22:03:19.856 INFO:tasks.workunit.client.0.smithi044.stdout:2/387: symlink d7/d16/l7f 0 2024-04-25T22:03:19.856 INFO:tasks.workunit.client.0.smithi044.stdout:9/522: dwrite d4/d3d/f68 [0,4194304] 0 2024-04-25T22:03:19.856 INFO:tasks.workunit.client.0.smithi044.stdout:3/427: creat d0/d70/f84 x:0 0 0 2024-04-25T22:03:19.856 INFO:tasks.workunit.client.0.smithi044.stdout:4/373: rmdir dd/d19/d38 39 2024-04-25T22:03:19.857 INFO:tasks.workunit.client.0.smithi044.stdout:2/388: chown d7/d8/d1c/f67 42604 1 2024-04-25T22:03:19.857 INFO:tasks.workunit.client.0.smithi044.stdout:3/428: mkdir d0/d2/d85 0 2024-04-25T22:03:19.858 INFO:tasks.workunit.client.0.smithi044.stdout:9/523: fdatasync d4/d37/d54/d84/d72/d97/f9d 0 2024-04-25T22:03:19.859 INFO:tasks.workunit.client.0.smithi044.stdout:8/539: read f25 [30544,622] 0 2024-04-25T22:03:19.859 INFO:tasks.workunit.client.0.smithi044.stdout:7/355: dwrite d1c/d22/d28/d30/d32/f43 [0,4194304] 0 2024-04-25T22:03:19.860 INFO:tasks.workunit.client.0.smithi044.stdout:8/540: fsync f6 0 2024-04-25T22:03:19.860 INFO:tasks.workunit.client.0.smithi044.stdout:5/345: dread d2/d5/d21/f2d [0,4194304] 0 2024-04-25T22:03:19.860 INFO:tasks.workunit.client.0.smithi044.stdout:7/356: creat d1c/d22/f71 x:0 0 0 2024-04-25T22:03:19.861 INFO:tasks.workunit.client.0.smithi044.stdout:3/429: rename d0/d13/d1c/f30 to d0/d1/d15/f86 0 2024-04-25T22:03:19.861 INFO:tasks.workunit.client.0.smithi044.stdout:8/541: truncate d2a/d39/d5a/d92/dab/fa2 872766 0 2024-04-25T22:03:19.861 INFO:tasks.workunit.client.0.smithi044.stdout:5/346: truncate d2/d5/d27/f51 195815 0 2024-04-25T22:03:19.862 INFO:tasks.workunit.client.0.smithi044.stdout:5/347: chown d2/d5/d27/d2a/f42 48140248 1 2024-04-25T22:03:19.863 INFO:tasks.workunit.client.0.smithi044.stdout:4/374: getdents dd/d35/d52/d61/d76 0 2024-04-25T22:03:19.863 INFO:tasks.workunit.client.0.smithi044.stdout:7/357: write d1c/d22/d4a/f4f [478913,101660] 0 2024-04-25T22:03:19.863 INFO:tasks.workunit.client.0.smithi044.stdout:3/430: creat d0/d1/d15/d81/f87 x:0 0 0 2024-04-25T22:03:19.864 INFO:tasks.workunit.client.0.smithi044.stdout:5/348: rmdir d2/d5b 39 2024-04-25T22:03:19.864 INFO:tasks.workunit.client.0.smithi044.stdout:4/375: chown dd/d35/f5e 4163662 1 2024-04-25T22:03:19.864 INFO:tasks.workunit.client.0.smithi044.stdout:7/358: write d1c/f45 [773672,37247] 0 2024-04-25T22:03:19.865 INFO:tasks.workunit.client.0.smithi044.stdout:5/349: symlink d2/d5/d27/d2a/d48/l6d 0 2024-04-25T22:03:19.865 INFO:tasks.workunit.client.0.smithi044.stdout:4/376: mknod dd/d19/c7e 0 2024-04-25T22:03:19.865 INFO:tasks.workunit.client.0.smithi044.stdout:3/431: unlink d0/d1/d15/d51/dd/d11/c68 0 2024-04-25T22:03:19.865 INFO:tasks.workunit.client.0.smithi044.stdout:7/359: creat d1c/d22/d4a/f72 x:0 0 0 2024-04-25T22:03:19.866 INFO:tasks.workunit.client.0.smithi044.stdout:5/350: creat d2/d5/d6a/f6e x:0 0 0 2024-04-25T22:03:19.866 INFO:tasks.workunit.client.0.smithi044.stdout:7/360: chown d1c/d22/d28/d4e/d6a/l70 956431172 1 2024-04-25T22:03:19.867 INFO:tasks.workunit.client.0.smithi044.stdout:4/377: read dd/f17 [513866,60760] 0 2024-04-25T22:03:19.867 INFO:tasks.workunit.client.0.smithi044.stdout:5/351: rename d2/c3d to d2/d5/d27/d2a/c6f 0 2024-04-25T22:03:19.867 INFO:tasks.workunit.client.0.smithi044.stdout:7/361: chown d1c/d22/d28/d4e 3984100 1 2024-04-25T22:03:19.868 INFO:tasks.workunit.client.0.smithi044.stdout:5/352: truncate d2/f3c 2715404 0 2024-04-25T22:03:19.868 INFO:tasks.workunit.client.0.smithi044.stdout:5/353: write d2/f4 [6143278,99444] 0 2024-04-25T22:03:19.869 INFO:tasks.workunit.client.0.smithi044.stdout:5/354: mkdir d2/d5/d27/d2a/d70 0 2024-04-25T22:03:19.871 INFO:tasks.workunit.client.0.smithi044.stdout:5/355: rename d2/d5/d21/l25 to d2/d5/d27/d2a/d5c/d5f/l71 0 2024-04-25T22:03:19.873 INFO:tasks.workunit.client.0.smithi044.stdout:4/378: dwrite dd/d35/f37 [0,4194304] 0 2024-04-25T22:03:19.873 INFO:tasks.workunit.client.0.smithi044.stdout:2/389: write d7/d16/d2c/f6d [327649,127807] 0 2024-04-25T22:03:19.873 INFO:tasks.workunit.client.0.smithi044.stdout:8/542: truncate d2a/d32/f33 5025212 0 2024-04-25T22:03:19.874 INFO:tasks.workunit.client.0.smithi044.stdout:7/362: truncate d1c/d22/f23 241658 0 2024-04-25T22:03:19.876 INFO:tasks.workunit.client.0.smithi044.stdout:8/543: mknod d2a/d52/cb7 0 2024-04-25T22:03:19.877 INFO:tasks.workunit.client.0.smithi044.stdout:4/379: mkdir dd/d19/d72/d79/d7f 0 2024-04-25T22:03:19.877 INFO:tasks.workunit.client.0.smithi044.stdout:2/390: readlink d7/d16/d2d/l40 0 2024-04-25T22:03:19.878 INFO:tasks.workunit.client.0.smithi044.stdout:8/544: mknod d2a/d52/cb8 0 2024-04-25T22:03:19.878 INFO:tasks.workunit.client.0.smithi044.stdout:5/356: dwrite d2/d5/d21/d38/f53 [0,4194304] 0 2024-04-25T22:03:19.879 INFO:tasks.workunit.client.0.smithi044.stdout:6/483: dread d2/d23/d5a/d12/d27/f45 [0,4194304] 0 2024-04-25T22:03:19.879 INFO:tasks.workunit.client.0.smithi044.stdout:8/545: write f6 [145239,43205] 0 2024-04-25T22:03:19.879 INFO:tasks.workunit.client.0.smithi044.stdout:2/391: mknod d7/d8/c80 0 2024-04-25T22:03:19.879 INFO:tasks.workunit.client.0.smithi044.stdout:5/357: read d2/d35/f3f [1557297,4554] 0 2024-04-25T22:03:19.880 INFO:tasks.workunit.client.0.smithi044.stdout:6/484: fsync d2/d23/d5a/d11/d2a/f61 0 2024-04-25T22:03:19.881 INFO:tasks.workunit.client.0.smithi044.stdout:2/392: write d7/d8/d1c/f33 [2620316,72815] 0 2024-04-25T22:03:19.881 INFO:tasks.workunit.client.0.smithi044.stdout:5/358: mknod d2/d5/d27/d2a/d3a/c72 0 2024-04-25T22:03:19.882 INFO:tasks.workunit.client.0.smithi044.stdout:6/485: symlink d2/d23/d5a/d11/d2a/la5 0 2024-04-25T22:03:19.882 INFO:tasks.workunit.client.0.smithi044.stdout:7/363: dwrite d1c/d22/d28/d30/d32/f52 [0,4194304] 0 2024-04-25T22:03:19.882 INFO:tasks.workunit.client.0.smithi044.stdout:5/359: chown d2/d5b/c5d 1489268 1 2024-04-25T22:03:19.883 INFO:tasks.workunit.client.0.smithi044.stdout:7/364: chown d1c/d22/d28/d30/d32/f52 1381 1 2024-04-25T22:03:19.884 INFO:tasks.workunit.client.0.smithi044.stdout:6/486: creat d2/d23/d5a/d13/d68/d8e/fa6 x:0 0 0 2024-04-25T22:03:19.884 INFO:tasks.workunit.client.0.smithi044.stdout:7/365: write d1c/d22/f49 [270519,26848] 0 2024-04-25T22:03:19.885 INFO:tasks.workunit.client.0.smithi044.stdout:6/487: unlink d2/d23/d5a/d13/d4b/c5c 0 2024-04-25T22:03:19.885 INFO:tasks.workunit.client.0.smithi044.stdout:2/393: dread d7/d16/d2d/d4e/f36 [0,4194304] 0 2024-04-25T22:03:19.886 INFO:tasks.workunit.client.0.smithi044.stdout:6/488: mkdir d2/d23/d5a/d13/d4b/da7 0 2024-04-25T22:03:19.886 INFO:tasks.workunit.client.0.smithi044.stdout:2/394: rename d7/d16/d2d to d7/d7b/d81 0 2024-04-25T22:03:19.887 INFO:tasks.workunit.client.0.smithi044.stdout:6/489: mknod d2/d23/d5a/d12/d1f/d94/ca8 0 2024-04-25T22:03:19.887 INFO:tasks.workunit.client.0.smithi044.stdout:2/395: dread - d7/d8/d48/f63 zero size 2024-04-25T22:03:19.887 INFO:tasks.workunit.client.0.smithi044.stdout:6/490: fdatasync d2/d23/d5a/d13/f5f 0 2024-04-25T22:03:19.888 INFO:tasks.workunit.client.0.smithi044.stdout:2/396: creat d7/d16/d4b/f82 x:0 0 0 2024-04-25T22:03:19.889 INFO:tasks.workunit.client.0.smithi044.stdout:0/383: read d8/df/d17/d45/f50 [3133290,53360] 0 2024-04-25T22:03:19.889 INFO:tasks.workunit.client.0.smithi044.stdout:8/546: dread d2a/d39/d42/f49 [0,4194304] 0 2024-04-25T22:03:19.889 INFO:tasks.workunit.client.0.smithi044.stdout:0/384: truncate d8/da/d55/f77 15818 0 2024-04-25T22:03:19.890 INFO:tasks.workunit.client.0.smithi044.stdout:8/547: chown d2a/d82/c99 0 1 2024-04-25T22:03:19.890 INFO:tasks.workunit.client.0.smithi044.stdout:0/385: mkdir d8/d24/d7c 0 2024-04-25T22:03:19.891 INFO:tasks.workunit.client.0.smithi044.stdout:8/548: symlink d2a/d39/lb9 0 2024-04-25T22:03:19.891 INFO:tasks.workunit.client.0.smithi044.stdout:0/386: creat d8/d20/f7d x:0 0 0 2024-04-25T22:03:19.892 INFO:tasks.workunit.client.0.smithi044.stdout:5/360: readlink d2/d5/d27/d2a/d5c/d5f/l71 0 2024-04-25T22:03:19.901 INFO:tasks.workunit.client.0.smithi044.stdout:2/397: truncate d7/d7b/d81/d4e/d2e/f2f 1125062 0 2024-04-25T22:03:19.902 INFO:tasks.workunit.client.0.smithi044.stdout:2/398: truncate d7/d8/d48/f4f 28272 0 2024-04-25T22:03:19.903 INFO:tasks.workunit.client.0.smithi044.stdout:2/399: chown d7/d16/f17 66230 1 2024-04-25T22:03:19.904 INFO:tasks.workunit.client.0.smithi044.stdout:6/491: dwrite d2/d23/d5a/d11/d3b/f32 [0,4194304] 0 2024-04-25T22:03:19.905 INFO:tasks.workunit.client.0.smithi044.stdout:2/400: creat d7/d7b/d81/d4e/d2e/f83 x:0 0 0 2024-04-25T22:03:19.905 INFO:tasks.workunit.client.0.smithi044.stdout:6/492: mkdir d2/d23/da9 0 2024-04-25T22:03:19.906 INFO:tasks.workunit.client.0.smithi044.stdout:6/493: truncate d2/d23/d5a/d11/d2a/f61 56078 0 2024-04-25T22:03:19.907 INFO:tasks.workunit.client.0.smithi044.stdout:6/494: creat d2/d23/d30/faa x:0 0 0 2024-04-25T22:03:19.908 INFO:tasks.workunit.client.0.smithi044.stdout:6/495: fsync d2/fd 0 2024-04-25T22:03:19.908 INFO:tasks.workunit.client.0.smithi044.stdout:3/432: sync 2024-04-25T22:03:19.908 INFO:tasks.workunit.client.0.smithi044.stdout:5/361: sync 2024-04-25T22:03:19.908 INFO:tasks.workunit.client.0.smithi044.stdout:7/366: sync 2024-04-25T22:03:19.908 INFO:tasks.workunit.client.0.smithi044.stdout:4/380: sync 2024-04-25T22:03:19.909 INFO:tasks.workunit.client.0.smithi044.stdout:6/496: write d2/d23/d30/fa0 [7738,6001] 0 2024-04-25T22:03:19.910 INFO:tasks.workunit.client.0.smithi044.stdout:4/381: chown dd/d35/f58 1900 1 2024-04-25T22:03:19.910 INFO:tasks.workunit.client.0.smithi044.stdout:3/433: chown d0/d1/d15/d23/c64 1358909 1 2024-04-25T22:03:19.910 INFO:tasks.workunit.client.0.smithi044.stdout:6/497: readlink d2/d23/d5a/d11/d2a/la5 0 2024-04-25T22:03:19.910 INFO:tasks.workunit.client.0.smithi044.stdout:3/434: mknod d0/d13/c88 0 2024-04-25T22:03:19.910 INFO:tasks.workunit.client.0.smithi044.stdout:5/362: rename d2/d5/f39 to d2/d5/d27/d2a/d5c/d5f/f73 0 2024-04-25T22:03:19.911 INFO:tasks.workunit.client.0.smithi044.stdout:5/363: chown d2/d5/d27/d2a/f42 360159 1 2024-04-25T22:03:19.912 INFO:tasks.workunit.client.0.smithi044.stdout:5/364: fsync d2/d5/d21/f43 0 2024-04-25T22:03:19.913 INFO:tasks.workunit.client.0.smithi044.stdout:0/387: dread d8/d20/f6a [0,4194304] 0 2024-04-25T22:03:19.913 INFO:tasks.workunit.client.0.smithi044.stdout:3/435: creat d0/d1/d15/d51/dd/f89 x:0 0 0 2024-04-25T22:03:19.914 INFO:tasks.workunit.client.0.smithi044.stdout:0/388: rmdir d8/df/d17/d45 39 2024-04-25T22:03:19.916 INFO:tasks.workunit.client.0.smithi044.stdout:9/524: dread d4/f1a [0,4194304] 0 2024-04-25T22:03:19.917 INFO:tasks.workunit.client.0.smithi044.stdout:3/436: read d0/d1/d15/d51/dd/d11/d43/d44/f6b [1330597,75358] 0 2024-04-25T22:03:19.917 INFO:tasks.workunit.client.0.smithi044.stdout:6/498: dwrite d2/d23/d5a/d11/d3b/f71 [0,4194304] 0 2024-04-25T22:03:19.917 INFO:tasks.workunit.client.0.smithi044.stdout:3/437: dread - d0/d2/f67 zero size 2024-04-25T22:03:19.918 INFO:tasks.workunit.client.0.smithi044.stdout:6/499: symlink d2/d23/d5a/d12/d27/lab 0 2024-04-25T22:03:19.919 INFO:tasks.workunit.client.0.smithi044.stdout:3/438: write d0/d1/d15/d51/dd/d28/f53 [2957133,40005] 0 2024-04-25T22:03:19.919 INFO:tasks.workunit.client.0.smithi044.stdout:4/382: write dd/d19/f1d [1605025,38793] 0 2024-04-25T22:03:19.920 INFO:tasks.workunit.client.0.smithi044.stdout:1/431: dread d3/d7/f2f [0,4194304] 0 2024-04-25T22:03:19.920 INFO:tasks.workunit.client.0.smithi044.stdout:9/525: getdents d4/d3d/d66/d93 0 2024-04-25T22:03:19.921 INFO:tasks.workunit.client.0.smithi044.stdout:2/401: fdatasync d7/d16/d2c/f6d 0 2024-04-25T22:03:19.921 INFO:tasks.workunit.client.0.smithi044.stdout:9/526: rmdir d4/d7 39 2024-04-25T22:03:19.921 INFO:tasks.workunit.client.0.smithi044.stdout:3/439: mkdir d0/d1/d15/d51/dd/d11/d8a 0 2024-04-25T22:03:19.921 INFO:tasks.workunit.client.0.smithi044.stdout:4/383: creat dd/f80 x:0 0 0 2024-04-25T22:03:19.922 INFO:tasks.workunit.client.0.smithi044.stdout:6/500: getdents d2/d23 0 2024-04-25T22:03:19.922 INFO:tasks.workunit.client.0.smithi044.stdout:1/432: link d3/d7/db/f15 d3/d7/d81/f8a 0 2024-04-25T22:03:19.923 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:19.916+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:19.923 INFO:tasks.workunit.client.0.smithi044.stdout:2/402: creat d7/d7b/d81/d57/f84 x:0 0 0 2024-04-25T22:03:19.923 INFO:tasks.workunit.client.0.smithi044.stdout:3/440: symlink d0/d13/d6c/l8b 0 2024-04-25T22:03:19.923 INFO:tasks.workunit.client.0.smithi044.stdout:1/433: fdatasync d3/d7/f69 0 2024-04-25T22:03:19.924 INFO:tasks.workunit.client.0.smithi044.stdout:9/527: write d4/d7/d79/f8e [467537,12141] 0 2024-04-25T22:03:19.924 INFO:tasks.workunit.client.0.smithi044.stdout:3/441: readlink d0/d1/d15/d51/dd/d11/d43/l50 0 2024-04-25T22:03:19.924 INFO:tasks.workunit.client.0.smithi044.stdout:8/549: dread d2a/d39/f5c [0,4194304] 0 2024-04-25T22:03:19.925 INFO:tasks.workunit.client.0.smithi044.stdout:2/403: truncate d7/d8/d1c/f67 4407361 0 2024-04-25T22:03:19.925 INFO:tasks.workunit.client.0.smithi044.stdout:4/384: rename dd/d19/d38 to dd/d19/d72/d79/d7f/d81 0 2024-04-25T22:03:19.925 INFO:tasks.workunit.client.0.smithi044.stdout:8/550: readlink d2a/d39/d42/l47 0 2024-04-25T22:03:19.925 INFO:tasks.workunit.client.0.smithi044.stdout:9/528: mknod d4/d4b/cad 0 2024-04-25T22:03:19.926 INFO:tasks.workunit.client.0.smithi044.stdout:3/442: unlink d0/d1/d15/d51/d39/f5a 0 2024-04-25T22:03:19.926 INFO:tasks.workunit.client.0.smithi044.stdout:4/385: stat dd/d19/d72/d79/d7f/d81/l45 0 2024-04-25T22:03:19.926 INFO:tasks.workunit.client.0.smithi044.stdout:8/551: mknod d2a/d39/cba 0 2024-04-25T22:03:19.927 INFO:tasks.workunit.client.0.smithi044.stdout:9/529: rename d4/l12 to d4/d37/d54/d84/lae 0 2024-04-25T22:03:19.927 INFO:tasks.workunit.client.0.smithi044.stdout:3/443: rmdir d0/d1/d15/d51/dd/d35/d36 39 2024-04-25T22:03:19.928 INFO:teuthology.orchestra.run.smithi044.stdout:moved 0 / 210 (0%) 2024-04-25T22:03:19.928 INFO:teuthology.orchestra.run.smithi044.stdout:avg 70 2024-04-25T22:03:19.928 INFO:teuthology.orchestra.run.smithi044.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-04-25T22:03:19.928 INFO:teuthology.orchestra.run.smithi044.stdout:min osd.2 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-04-25T22:03:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:max osd.1 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-04-25T22:03:19.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:03:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:oload 1000 2024-04-25T22:03:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:max_change 1 2024-04-25T22:03:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:max_change_osds 4 2024-04-25T22:03:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:average_utilization 0.0010 2024-04-25T22:03:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:overload_utilization 0.0104 2024-04-25T22:03:19.929 INFO:teuthology.orchestra.run.smithi044.stderr:no change 2024-04-25T22:03:19.930 INFO:tasks.workunit.client.0.smithi044.stdout:6/501: link d2/d23/d5a/d13/d68/f72 d2/d23/d5a/d13/d68/d8e/fac 0 2024-04-25T22:03:19.930 INFO:tasks.workunit.client.0.smithi044.stdout:9/530: mknod d4/d3d/caf 0 2024-04-25T22:03:19.930 INFO:tasks.workunit.client.0.smithi044.stdout:0/389: dread d8/d15/f30 [0,4194304] 0 2024-04-25T22:03:19.931 INFO:tasks.workunit.client.0.smithi044.stdout:6/502: dread - d2/d23/d5a/d12/d49/d7f/f97 zero size 2024-04-25T22:03:19.932 INFO:tasks.workunit.client.0.smithi044.stdout:0/390: truncate d8/d24/f3a 965126 0 2024-04-25T22:03:19.932 INFO:tasks.workunit.client.0.smithi044.stdout:9/531: creat d4/d37/d54/d84/d72/fb0 x:0 0 0 2024-04-25T22:03:19.932 INFO:tasks.workunit.client.0.smithi044.stdout:1/434: dwrite d3/d7/db/f1d [0,4194304] 0 2024-04-25T22:03:19.932 INFO:tasks.workunit.client.0.smithi044.stdout:9/532: chown d4/d3d/c78 199 1 2024-04-25T22:03:19.933 INFO:tasks.workunit.client.0.smithi044.stdout:4/386: write dd/f6f [3544667,75665] 0 2024-04-25T22:03:19.933 INFO:tasks.workunit.client.0.smithi044.stdout:8/552: dread d2a/d39/d42/d68/d6b/f4b [0,4194304] 0 2024-04-25T22:03:19.934 INFO:tasks.workunit.client.0.smithi044.stdout:9/533: unlink d4/d7/d79/l8a 0 2024-04-25T22:03:19.934 INFO:tasks.workunit.client.0.smithi044.stdout:6/503: link d2/d23/d5a/d12/d49/f89 d2/d23/d5a/d12/d49/fad 0 2024-04-25T22:03:19.935 INFO:tasks.workunit.client.0.smithi044.stdout:4/387: getdents dd/d19/d72 0 2024-04-25T22:03:19.935 INFO:tasks.workunit.client.0.smithi044.stdout:6/504: fsync d2/d23/d30/faa 0 2024-04-25T22:03:19.936 INFO:tasks.workunit.client.0.smithi044.stdout:3/444: dread d0/d1/d15/d23/f40 [0,4194304] 0 2024-04-25T22:03:19.940 INFO:tasks.workunit.client.0.smithi044.stdout:5/365: dread d2/d5/d21/d26/d2c/d37/f4d [0,4194304] 0 2024-04-25T22:03:19.941 INFO:tasks.workunit.client.0.smithi044.stdout:5/366: stat d2/d35/f4a 0 2024-04-25T22:03:19.941 INFO:tasks.workunit.client.0.smithi044.stdout:8/553: dwrite fc [0,4194304] 0 2024-04-25T22:03:19.942 INFO:tasks.workunit.client.0.smithi044.stdout:5/367: stat d2/d5b 0 2024-04-25T22:03:19.942 INFO:tasks.workunit.client.0.smithi044.stdout:4/388: dread dd/d19/f1d [0,4194304] 0 2024-04-25T22:03:19.942 INFO:tasks.workunit.client.0.smithi044.stdout:8/554: dread - d2a/d82/fa7 zero size 2024-04-25T22:03:19.943 INFO:tasks.workunit.client.0.smithi044.stdout:4/389: chown dd/d19/f3d 90477 1 2024-04-25T22:03:19.943 INFO:tasks.workunit.client.0.smithi044.stdout:7/367: sync 2024-04-25T22:03:19.944 INFO:tasks.workunit.client.0.smithi044.stdout:8/555: fdatasync d2a/f36 0 2024-04-25T22:03:19.945 INFO:tasks.workunit.client.0.smithi044.stdout:5/368: truncate d2/d5/f5e 409688 0 2024-04-25T22:03:19.945 INFO:tasks.workunit.client.0.smithi044.stdout:1/435: dwrite d3/d30/d3f/f86 [0,4194304] 0 2024-04-25T22:03:19.946 INFO:tasks.workunit.client.0.smithi044.stdout:8/556: fsync d2a/d39/d42/d68/d6b/f64 0 2024-04-25T22:03:19.948 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:19.949 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:19.949 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:03:19.949 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:03:19.949 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:19.950 INFO:tasks.workunit.client.0.smithi044.stdout:5/369: creat d2/d5/d21/d26/d2c/f74 x:0 0 0 2024-04-25T22:03:19.951 INFO:tasks.workunit.client.0.smithi044.stdout:5/370: mknod d2/d5/d21/d38/d52/c75 0 2024-04-25T22:03:19.952 INFO:tasks.workunit.client.0.smithi044.stdout:2/404: dread d7/d8/d1c/f69 [0,4194304] 0 2024-04-25T22:03:19.953 INFO:tasks.workunit.client.0.smithi044.stdout:1/436: dwrite d3/d7/d29/d43/f52 [0,4194304] 0 2024-04-25T22:03:19.954 INFO:tasks.workunit.client.0.smithi044.stdout:8/557: dwrite f22 [4194304,4194304] 0 2024-04-25T22:03:19.954 INFO:tasks.workunit.client.0.smithi044.stdout:2/405: rename d7/d8/d48/f6a to d7/d16/d2c/f85 0 2024-04-25T22:03:19.954 INFO:tasks.workunit.client.0.smithi044.stdout:1/437: creat d3/d72/f8b x:0 0 0 2024-04-25T22:03:19.955 INFO:tasks.workunit.client.0.smithi044.stdout:8/558: truncate d2a/f45 509318 0 2024-04-25T22:03:19.956 INFO:tasks.workunit.client.0.smithi044.stdout:1/438: creat d3/d72/f8c x:0 0 0 2024-04-25T22:03:19.956 INFO:tasks.workunit.client.0.smithi044.stdout:1/439: chown d3/d30/d3f/f68 240162762 1 2024-04-25T22:03:19.957 INFO:tasks.workunit.client.0.smithi044.stdout:1/440: write d3/f61 [35696,10426] 0 2024-04-25T22:03:19.959 INFO:tasks.workunit.client.0.smithi044.stdout:5/371: dwrite d2/f20 [0,4194304] 0 2024-04-25T22:03:19.959 INFO:tasks.workunit.client.0.smithi044.stdout:2/406: dread d7/d8/d1c/f69 [0,4194304] 0 2024-04-25T22:03:19.965 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-04-25T22:03:19.965 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2024-04-25T22:03:19.966 INFO:tasks.workunit.client.0.smithi044.stdout:1/441: dwrite d3/f37 [0,4194304] 0 2024-04-25T22:03:19.966 INFO:tasks.workunit.client.0.smithi044.stdout:8/559: dread d2a/d32/f34 [4194304,4194304] 0 2024-04-25T22:03:19.966 INFO:tasks.workunit.client.0.smithi044.stdout:8/560: rename d2a/d32/f3b to d2a/d32/d57/d5e/fbb 0 2024-04-25T22:03:19.967 INFO:tasks.workunit.client.0.smithi044.stdout:5/372: dwrite d2/d5/d27/f62 [4194304,4194304] 0 2024-04-25T22:03:19.967 INFO:tasks.workunit.client.0.smithi044.stdout:5/373: unlink d2/f24 0 2024-04-25T22:03:19.968 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:19.969 INFO:tasks.workunit.client.0.smithi044.stdout:5/374: creat d2/d5/d21/d26/d2c/d37/f76 x:0 0 0 2024-04-25T22:03:19.973 INFO:tasks.workunit.client.0.smithi044.stdout:8/561: dwrite d2a/d82/fa6 [0,4194304] 0 2024-04-25T22:03:19.973 INFO:tasks.workunit.client.0.smithi044.stdout:8/562: readlink d2a/l65 0 2024-04-25T22:03:19.974 INFO:tasks.workunit.client.0.smithi044.stdout:8/563: stat d2a/d39/d42/d80/l8f 0 2024-04-25T22:03:19.976 INFO:tasks.workunit.client.0.smithi044.stdout:0/391: sync 2024-04-25T22:03:19.976 INFO:tasks.workunit.client.0.smithi044.stdout:9/534: sync 2024-04-25T22:03:19.976 INFO:tasks.workunit.client.0.smithi044.stdout:6/505: sync 2024-04-25T22:03:19.976 INFO:tasks.workunit.client.0.smithi044.stdout:3/445: sync 2024-04-25T22:03:19.977 INFO:tasks.workunit.client.0.smithi044.stdout:0/392: getdents d8/d78 0 2024-04-25T22:03:19.978 INFO:tasks.workunit.client.0.smithi044.stdout:3/446: unlink d0/d1/d15/c2a 0 2024-04-25T22:03:19.979 INFO:tasks.workunit.client.0.smithi044.stdout:7/368: dwrite d1c/d22/f25 [4194304,4194304] 0 2024-04-25T22:03:19.979 INFO:tasks.workunit.client.0.smithi044.stdout:7/369: chown f9 28553 1 2024-04-25T22:03:19.980 INFO:tasks.workunit.client.0.smithi044.stdout:7/370: chown d1c 1038866 1 2024-04-25T22:03:19.981 INFO:tasks.workunit.client.0.smithi044.stdout:7/371: chown d1c/f21 3 1 2024-04-25T22:03:19.982 INFO:tasks.workunit.client.0.smithi044.stdout:0/393: getdents d8/da/d60 0 2024-04-25T22:03:19.984 INFO:tasks.workunit.client.0.smithi044.stdout:0/394: write d8/df/f40 [93362,37579] 0 2024-04-25T22:03:19.985 INFO:tasks.workunit.client.0.smithi044.stdout:6/506: dwrite d2/d23/d5a/d13/f5f [0,4194304] 0 2024-04-25T22:03:19.986 INFO:tasks.workunit.client.0.smithi044.stdout:0/395: symlink d8/d24/l7e 0 2024-04-25T22:03:19.987 INFO:tasks.workunit.client.0.smithi044.stdout:6/507: symlink d2/d23/d5a/d12/d1f/d94/lae 0 2024-04-25T22:03:19.987 INFO:tasks.workunit.client.0.smithi044.stdout:0/396: fsync d8/da/d55/f5c 0 2024-04-25T22:03:19.987 INFO:tasks.workunit.client.0.smithi044.stdout:9/535: dwrite d4/d37/d54/d84/d72/f87 [0,4194304] 0 2024-04-25T22:03:19.988 INFO:tasks.workunit.client.0.smithi044.stdout:2/407: dread f0 [0,4194304] 0 2024-04-25T22:03:19.990 INFO:tasks.workunit.client.0.smithi044.stdout:2/408: rename d7/d7b/d81/d4e/d2e to d7/d7b/d81/d4e/d86 0 2024-04-25T22:03:19.992 INFO:tasks.workunit.client.0.smithi044.stdout:2/409: link d7/d16/d2c/f3b d7/d7b/d81/d4e/f87 0 2024-04-25T22:03:19.993 INFO:tasks.workunit.client.0.smithi044.stdout:2/410: link d7/d16/c47 d7/d7b/d81/d4e/d86/c88 0 2024-04-25T22:03:19.994 INFO:tasks.workunit.client.0.smithi044.stdout:6/508: dwrite d2/fd [4194304,4194304] 0 2024-04-25T22:03:19.997 INFO:tasks.workunit.client.0.smithi044.stdout:6/509: chown d2/d23/d5a/d12/cf 7 1 2024-04-25T22:03:19.997 INFO:tasks.workunit.client.0.smithi044.stdout:6/510: mkdir d2/d23/d5a/d12/d27/daf 0 2024-04-25T22:03:19.998 INFO:tasks.workunit.client.0.smithi044.stdout:6/511: truncate d2/d23/d5a/d11/d2a/f61 415096 0 2024-04-25T22:03:20.003 INFO:tasks.workunit.client.0.smithi044.stdout:6/512: dwrite d2/d23/d5a/d11/d3b/f71 [0,4194304] 0 2024-04-25T22:03:20.004 INFO:tasks.workunit.client.0.smithi044.stdout:6/513: getdents d2 0 2024-04-25T22:03:20.006 INFO:tasks.workunit.client.0.smithi044.stdout:0/397: dread d8/da/f59 [0,4194304] 0 2024-04-25T22:03:20.007 INFO:tasks.workunit.client.0.smithi044.stdout:0/398: truncate d8/df/f40 964247 0 2024-04-25T22:03:20.007 INFO:tasks.workunit.client.0.smithi044.stdout:0/399: fdatasync d8/da/f61 0 2024-04-25T22:03:20.008 INFO:tasks.workunit.client.0.smithi044.stdout:0/400: readlink d8/d15/l35 0 2024-04-25T22:03:20.009 INFO:tasks.workunit.client.0.smithi044.stdout:6/514: dwrite d2/d23/d5a/d11/f21 [4194304,4194304] 0 2024-04-25T22:03:20.018 INFO:tasks.workunit.client.0.smithi044.stdout:4/390: dread dd/d19/f3d [4194304,4194304] 0 2024-04-25T22:03:20.020 INFO:tasks.workunit.client.0.smithi044.stdout:4/391: getdents dd/d19/d72/d79/d7f/d81 0 2024-04-25T22:03:20.020 INFO:tasks.workunit.client.0.smithi044.stdout:4/392: truncate dd/d19/f32 8841498 0 2024-04-25T22:03:20.021 INFO:tasks.workunit.client.0.smithi044.stdout:4/393: getdents dd/d35/d78 0 2024-04-25T22:03:20.021 INFO:tasks.workunit.client.0.smithi044.stdout:4/394: dread - dd/d35/f5f zero size 2024-04-25T22:03:20.022 INFO:tasks.workunit.client.0.smithi044.stdout:4/395: rmdir dd/d35 39 2024-04-25T22:03:20.022 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:20.016+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:20.026 INFO:tasks.workunit.client.0.smithi044.stdout:4/396: dwrite dd/f3b [0,4194304] 0 2024-04-25T22:03:20.027 INFO:tasks.workunit.client.0.smithi044.stdout:4/397: symlink dd/d19/l82 0 2024-04-25T22:03:20.028 INFO:tasks.workunit.client.0.smithi044.stdout:4/398: chown dd/d35/d52/d61/c75 29391917 1 2024-04-25T22:03:20.029 INFO:tasks.workunit.client.0.smithi044.stdout:4/399: chown dd/f6f 1270 1 2024-04-25T22:03:20.044 INFO:tasks.workunit.client.0.smithi044.stdout:1/442: fsync d3/d54/f65 0 2024-04-25T22:03:20.044 INFO:tasks.workunit.client.0.smithi044.stdout:9/536: truncate d4/d7/d18/d2e/f3f 2795859 0 2024-04-25T22:03:20.044 INFO:tasks.workunit.client.0.smithi044.stdout:0/401: truncate d8/df/d17/f3d 1451762 0 2024-04-25T22:03:20.044 INFO:tasks.workunit.client.0.smithi044.stdout:6/515: truncate d2/d23/d5a/d12/d49/f5b 1099997 0 2024-04-25T22:03:20.044 INFO:tasks.workunit.client.0.smithi044.stdout:1/443: rmdir d3/d30/d3f 39 2024-04-25T22:03:20.044 INFO:tasks.workunit.client.0.smithi044.stdout:6/516: mkdir d2/d23/d30/db0 0 2024-04-25T22:03:20.045 INFO:tasks.workunit.client.0.smithi044.stdout:0/402: write d8/df/d17/d45/d4f/f56 [651589,69140] 0 2024-04-25T22:03:20.045 INFO:tasks.workunit.client.0.smithi044.stdout:1/444: symlink d3/d54/d76/l8d 0 2024-04-25T22:03:20.045 INFO:tasks.workunit.client.0.smithi044.stdout:6/517: mkdir d2/d23/d5a/d12/d27/db1 0 2024-04-25T22:03:20.046 INFO:tasks.workunit.client.0.smithi044.stdout:8/564: dwrite d2a/d39/d42/f49 [0,4194304] 0 2024-04-25T22:03:20.046 INFO:tasks.workunit.client.0.smithi044.stdout:2/411: dwrite d7/d16/d2c/f3b [0,4194304] 0 2024-04-25T22:03:20.047 INFO:tasks.workunit.client.0.smithi044.stdout:1/445: rename d3/d7/d29/l4d to d3/d7/db/d42/l8e 0 2024-04-25T22:03:20.047 INFO:tasks.workunit.client.0.smithi044.stdout:1/446: readlink d3/d7/l13 0 2024-04-25T22:03:20.048 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:03:20.049 INFO:tasks.workunit.client.0.smithi044.stdout:8/565: mknod d2a/d39/d42/cbc 0 2024-04-25T22:03:20.049 INFO:tasks.workunit.client.0.smithi044.stdout:2/412: rmdir d7/d7b/d81/d4e/d86/d6b/d78/d5e 0 2024-04-25T22:03:20.050 INFO:tasks.workunit.client.0.smithi044.stdout:1/447: stat d3/d7/db/d42/l6f 0 2024-04-25T22:03:20.050 INFO:tasks.workunit.client.0.smithi044.stdout:8/566: symlink d2a/d39/d42/lbd 0 2024-04-25T22:03:20.050 INFO:tasks.workunit.client.0.smithi044.stdout:4/400: dread dd/f6f [0,4194304] 0 2024-04-25T22:03:20.052 INFO:tasks.workunit.client.0.smithi044.stdout:2/413: fsync d7/d7b/d81/d4e/f37 0 2024-04-25T22:03:20.052 INFO:tasks.workunit.client.0.smithi044.stdout:4/401: dread - dd/f6c zero size 2024-04-25T22:03:20.052 INFO:tasks.workunit.client.0.smithi044.stdout:1/448: unlink d3/d7/db/d42/f77 0 2024-04-25T22:03:20.052 INFO:tasks.workunit.client.0.smithi044.stdout:8/567: mknod d2a/d39/d5a/d92/dab/cbe 0 2024-04-25T22:03:20.052 INFO:tasks.workunit.client.0.smithi044.stdout:2/414: mknod d7/d7b/d81/d4e/d86/d6b/d78/c89 0 2024-04-25T22:03:20.054 INFO:tasks.workunit.client.0.smithi044.stdout:1/449: write d3/d7/d29/d43/d85/f84 [353369,53442] 0 2024-04-25T22:03:20.054 INFO:tasks.workunit.client.0.smithi044.stdout:8/568: mknod d2a/d32/d57/cbf 0 2024-04-25T22:03:20.054 INFO:tasks.workunit.client.0.smithi044.stdout:2/415: write d7/d16/d2c/f61 [616498,36998] 0 2024-04-25T22:03:20.055 INFO:tasks.workunit.client.0.smithi044.stdout:1/450: chown d3/f6d 165551 1 2024-04-25T22:03:20.055 INFO:tasks.workunit.client.0.smithi044.stdout:8/569: symlink d2a/d77/lc0 0 2024-04-25T22:03:20.057 INFO:tasks.workunit.client.0.smithi044.stdout:2/416: mkdir d7/d8/d5f/d70/d8a 0 2024-04-25T22:03:20.057 INFO:tasks.workunit.client.0.smithi044.stdout:0/403: dwrite f6 [0,4194304] 0 2024-04-25T22:03:20.058 INFO:tasks.workunit.client.0.smithi044.stdout:6/518: dwrite d2/d23/d5a/d12/d27/d8d/fa1 [0,4194304] 0 2024-04-25T22:03:20.060 INFO:tasks.workunit.client.0.smithi044.stdout:2/417: stat d7/d7b/d81/d4e/d86/d6b/d78/d44 0 2024-04-25T22:03:20.060 INFO:tasks.workunit.client.0.smithi044.stdout:8/570: unlink d2a/d39/d42/d68/d6b/d6e/d84/c8d 0 2024-04-25T22:03:20.061 INFO:tasks.workunit.client.0.smithi044.stdout:6/519: getdents d2/d23/d30/db0 0 2024-04-25T22:03:20.061 INFO:tasks.workunit.client.0.smithi044.stdout:8/571: chown d2a/d32/d57/la1 1991853 1 2024-04-25T22:03:20.061 INFO:tasks.workunit.client.0.smithi044.stdout:4/402: dwrite dd/f6f [0,4194304] 0 2024-04-25T22:03:20.062 INFO:tasks.workunit.client.0.smithi044.stdout:4/403: stat dd/d35/d52/d61/c6e 0 2024-04-25T22:03:20.063 INFO:tasks.workunit.client.0.smithi044.stdout:8/572: mknod d2a/d39/d42/d68/d6b/d6e/d84/cc1 0 2024-04-25T22:03:20.063 INFO:tasks.workunit.client.0.smithi044.stdout:0/404: rename d8/df/d17/f44 to d8/da/f7f 0 2024-04-25T22:03:20.063 INFO:tasks.workunit.client.0.smithi044.stdout:2/418: getdents d7/d8/d1c/d77 0 2024-04-25T22:03:20.064 INFO:tasks.workunit.client.0.smithi044.stdout:4/404: chown dd/d19/d72/d79/d7f/d81/l63 95073746 1 2024-04-25T22:03:20.064 INFO:tasks.workunit.client.0.smithi044.stdout:1/451: truncate d3/d7/f20 4012281 0 2024-04-25T22:03:20.064 INFO:tasks.workunit.client.0.smithi044.stdout:8/573: symlink d2a/d32/d57/d5e/lc2 0 2024-04-25T22:03:20.064 INFO:tasks.workunit.client.0.smithi044.stdout:0/405: creat d8/d24/f80 x:0 0 0 2024-04-25T22:03:20.065 INFO:tasks.workunit.client.0.smithi044.stdout:1/452: mkdir d3/d7/db/d8f 0 2024-04-25T22:03:20.065 INFO:tasks.workunit.client.0.smithi044.stdout:4/405: mknod dd/d19/d72/d79/d7f/c83 0 2024-04-25T22:03:20.066 INFO:tasks.workunit.client.0.smithi044.stdout:8/574: creat d2a/d39/d5a/d92/dab/fc3 x:0 0 0 2024-04-25T22:03:20.066 INFO:tasks.workunit.client.0.smithi044.stdout:0/406: chown d8/df/d17/d45/d4f/c5b 3142410 1 2024-04-25T22:03:20.066 INFO:tasks.workunit.client.0.smithi044.stdout:2/419: write d7/d16/d4b/f5d [1215041,36888] 0 2024-04-25T22:03:20.067 INFO:tasks.workunit.client.0.smithi044.stdout:1/453: dread - d3/d59/d5c/f62 zero size 2024-04-25T22:03:20.067 INFO:tasks.workunit.client.0.smithi044.stdout:0/407: fsync d8/df/d17/d45/d4f/f56 0 2024-04-25T22:03:20.068 INFO:tasks.workunit.client.0.smithi044.stdout:1/454: symlink d3/d7/l90 0 2024-04-25T22:03:20.068 INFO:tasks.workunit.client.0.smithi044.stdout:2/420: truncate d7/d16/f54 829120 0 2024-04-25T22:03:20.068 INFO:tasks.workunit.client.0.smithi044.stdout:1/455: write d3/d7/db/f1d [6627177,77596] 0 2024-04-25T22:03:20.069 INFO:tasks.workunit.client.0.smithi044.stdout:2/421: rename d7/d16/c47 to d7/d7b/c8b 0 2024-04-25T22:03:20.070 INFO:tasks.workunit.client.0.smithi044.stdout:0/408: rename d8/df/d17/d45/d4f/c5b to d8/d24/c81 0 2024-04-25T22:03:20.070 INFO:tasks.workunit.client.0.smithi044.stdout:1/456: creat d3/d7/db/d8f/f91 x:0 0 0 2024-04-25T22:03:20.071 INFO:tasks.workunit.client.0.smithi044.stdout:0/409: write d8/f3b [2511189,30090] 0 2024-04-25T22:03:20.072 INFO:tasks.workunit.client.0.smithi044.stdout:0/410: write d8/df/f40 [1779852,45414] 0 2024-04-25T22:03:20.073 INFO:tasks.workunit.client.0.smithi044.stdout:4/406: dwrite dd/d35/d52/d61/f73 [0,4194304] 0 2024-04-25T22:03:20.075 INFO:tasks.workunit.client.0.smithi044.stdout:2/422: stat d7/d7b/c8b 0 2024-04-25T22:03:20.076 INFO:tasks.workunit.client.0.smithi044.stdout:4/407: write dd/f55 [7207,79921] 0 2024-04-25T22:03:20.076 INFO:tasks.workunit.client.0.smithi044.stdout:2/423: chown d7/d16/d2c/c4a 1611529 1 2024-04-25T22:03:20.078 INFO:tasks.workunit.client.0.smithi044.stdout:8/575: dwrite d2a/d32/f3d [0,4194304] 0 2024-04-25T22:03:20.079 INFO:tasks.workunit.client.0.smithi044.stdout:4/408: creat dd/d19/d72/d79/d7f/f84 x:0 0 0 2024-04-25T22:03:20.080 INFO:tasks.workunit.client.0.smithi044.stdout:6/520: dread d2/d23/d5a/d12/d27/f31 [0,4194304] 0 2024-04-25T22:03:20.080 INFO:tasks.workunit.client.0.smithi044.stdout:0/411: dwrite d8/d24/f80 [0,4194304] 0 2024-04-25T22:03:20.081 INFO:tasks.workunit.client.0.smithi044.stdout:2/424: creat d7/d7b/d81/d4e/f8c x:0 0 0 2024-04-25T22:03:20.081 INFO:tasks.workunit.client.0.smithi044.stdout:8/576: link d2a/d39/d42/d68/d6b/f4b d2a/d39/d42/d68/fc4 0 2024-04-25T22:03:20.082 INFO:tasks.workunit.client.0.smithi044.stdout:6/521: write d2/d23/d5a/d12/f48 [4807385,61881] 0 2024-04-25T22:03:20.082 INFO:tasks.workunit.client.0.smithi044.stdout:0/412: write d8/d24/f28 [4348464,49986] 0 2024-04-25T22:03:20.085 INFO:tasks.workunit.client.0.smithi044.stdout:2/425: creat d7/d7b/d81/d4e/d86/d6b/d78/d44/f8d x:0 0 0 2024-04-25T22:03:20.086 INFO:tasks.workunit.client.0.smithi044.stdout:0/413: creat d8/d24/d7c/f82 x:0 0 0 2024-04-25T22:03:20.086 INFO:tasks.workunit.client.0.smithi044.stdout:2/426: readlink d7/d16/l3c 0 2024-04-25T22:03:20.087 INFO:tasks.workunit.client.0.smithi044.stdout:0/414: chown d8/f4d 6 1 2024-04-25T22:03:20.087 INFO:tasks.workunit.client.0.smithi044.stdout:4/409: truncate dd/d35/f4a 6175267 0 2024-04-25T22:03:20.087 INFO:tasks.workunit.client.0.smithi044.stdout:6/522: dread d2/d23/d5a/d12/d27/d8d/fa1 [0,4194304] 0 2024-04-25T22:03:20.088 INFO:tasks.workunit.client.0.smithi044.stdout:6/523: rmdir d2/d23/d30 39 2024-04-25T22:03:20.088 INFO:tasks.workunit.client.0.smithi044.stdout:4/410: fsync dd/d19/d72/d79/d7f/d81/f43 0 2024-04-25T22:03:20.088 INFO:tasks.workunit.client.0.smithi044.stdout:0/415: truncate d8/d20/f6a 1786636 0 2024-04-25T22:03:20.089 INFO:tasks.workunit.client.0.smithi044.stdout:0/416: chown d8/da/f59 7259 1 2024-04-25T22:03:20.089 INFO:tasks.workunit.client.0.smithi044.stdout:6/524: mkdir d2/d23/d5a/d13/d4b/d5e/db2 0 2024-04-25T22:03:20.090 INFO:tasks.workunit.client.0.smithi044.stdout:4/411: link dd/f69 dd/d19/d72/d79/d7f/f85 0 2024-04-25T22:03:20.091 INFO:tasks.workunit.client.0.smithi044.stdout:0/417: link d8/f9 d8/df/d17/f83 0 2024-04-25T22:03:20.091 INFO:tasks.workunit.client.0.smithi044.stdout:4/412: mknod dd/d35/d52/c86 0 2024-04-25T22:03:20.091 INFO:tasks.workunit.client.0.smithi044.stdout:6/525: symlink d2/d23/d5a/d13/d68/d7b/lb3 0 2024-04-25T22:03:20.092 INFO:tasks.workunit.client.0.smithi044.stdout:0/418: creat d8/d15/d51/f84 x:0 0 0 2024-04-25T22:03:20.092 INFO:tasks.workunit.client.0.smithi044.stdout:4/413: fdatasync dd/f6c 0 2024-04-25T22:03:20.092 INFO:tasks.workunit.client.0.smithi044.stdout:2/427: dread d7/d16/d4b/f72 [4194304,4194304] 0 2024-04-25T22:03:20.092 INFO:tasks.workunit.client.0.smithi044.stdout:4/414: chown dd/d35/c51 6 1 2024-04-25T22:03:20.093 INFO:tasks.workunit.client.0.smithi044.stdout:4/415: fsync dd/f46 0 2024-04-25T22:03:20.094 INFO:tasks.workunit.client.0.smithi044.stdout:4/416: chown dd/f55 1815 1 2024-04-25T22:03:20.095 INFO:tasks.workunit.client.0.smithi044.stdout:4/417: link dd/f80 dd/d35/d52/d61/f87 0 2024-04-25T22:03:20.095 INFO:tasks.workunit.client.0.smithi044.stdout:4/418: fdatasync dd/d35/f58 0 2024-04-25T22:03:20.096 INFO:tasks.workunit.client.0.smithi044.stdout:4/419: mkdir dd/d19/d72/d88 0 2024-04-25T22:03:20.098 INFO:tasks.workunit.client.0.smithi044.stdout:8/577: dread d2a/d52/f72 [0,4194304] 0 2024-04-25T22:03:20.099 INFO:tasks.workunit.client.0.smithi044.stdout:6/526: write d2/d23/d5a/d13/d68/d8e/fac [2911816,102206] 0 2024-04-25T22:03:20.099 INFO:tasks.workunit.client.0.smithi044.stdout:4/420: link dd/d19/d72/d79/d7f/d81/f43 dd/f89 0 2024-04-25T22:03:20.100 INFO:tasks.workunit.client.0.smithi044.stdout:2/428: dwrite d7/d7b/d81/d4e/d86/f34 [0,4194304] 0 2024-04-25T22:03:20.100 INFO:tasks.workunit.client.0.smithi044.stdout:8/578: creat d2a/d32/d3e/fc5 x:0 0 0 2024-04-25T22:03:20.100 INFO:tasks.workunit.client.0.smithi044.stdout:0/419: dread d8/d20/f6a [0,4194304] 0 2024-04-25T22:03:20.101 INFO:tasks.workunit.client.0.smithi044.stdout:0/420: rmdir d8 39 2024-04-25T22:03:20.101 INFO:tasks.workunit.client.0.smithi044.stdout:8/579: write d2a/d32/f53 [962422,5917] 0 2024-04-25T22:03:20.102 INFO:tasks.workunit.client.0.smithi044.stdout:6/527: rmdir d2/d23/d5a/d13/d4b/d5e/db2 0 2024-04-25T22:03:20.102 INFO:tasks.workunit.client.0.smithi044.stdout:8/580: creat d2a/d39/d5a/d66/fc6 x:0 0 0 2024-04-25T22:03:20.103 INFO:tasks.workunit.client.0.smithi044.stdout:6/528: fdatasync d2/d23/d5a/f1b 0 2024-04-25T22:03:20.104 INFO:tasks.workunit.client.0.smithi044.stdout:8/581: unlink d2a/d39/d42/d80/l8f 0 2024-04-25T22:03:20.106 INFO:tasks.workunit.client.0.smithi044.stdout:4/421: write dd/d35/f4a [3838204,97274] 0 2024-04-25T22:03:20.107 INFO:tasks.workunit.client.0.smithi044.stdout:6/529: truncate d2/d23/d5a/d13/f36 4854246 0 2024-04-25T22:03:20.108 INFO:tasks.workunit.client.0.smithi044.stdout:4/422: rmdir dd/d35/d78 0 2024-04-25T22:03:20.109 INFO:tasks.workunit.client.0.smithi044.stdout:6/530: creat d2/d23/d5a/d13/d4b/fb4 x:0 0 0 2024-04-25T22:03:20.110 INFO:tasks.workunit.client.0.smithi044.stdout:2/429: dwrite d7/d16/d2c/f3b [4194304,4194304] 0 2024-04-25T22:03:20.111 INFO:tasks.workunit.client.0.smithi044.stdout:0/421: dwrite d8/d15/f39 [0,4194304] 0 2024-04-25T22:03:20.111 INFO:tasks.workunit.client.0.smithi044.stdout:2/430: write d7/d16/d2c/f61 [65125,94655] 0 2024-04-25T22:03:20.112 INFO:tasks.workunit.client.0.smithi044.stdout:0/422: chown d8/df/d17/l75 30258 1 2024-04-25T22:03:20.113 INFO:tasks.workunit.client.0.smithi044.stdout:0/423: symlink d8/l85 0 2024-04-25T22:03:20.113 INFO:tasks.workunit.client.0.smithi044.stdout:8/582: write f1f [1242061,119297] 0 2024-04-25T22:03:20.113 INFO:tasks.workunit.client.0.smithi044.stdout:8/583: stat d2a/d39/f51 0 2024-04-25T22:03:20.114 INFO:tasks.workunit.client.0.smithi044.stdout:0/424: mkdir d8/da/d60/d86 0 2024-04-25T22:03:20.114 INFO:tasks.workunit.client.0.smithi044.stdout:8/584: read - d2a/d39/d42/d80/f9a zero size 2024-04-25T22:03:20.120 INFO:tasks.workunit.client.0.smithi044.stdout:2/431: truncate f0 1078391 0 2024-04-25T22:03:20.121 INFO:tasks.workunit.client.0.smithi044.stdout:2/432: write d7/d8/d1c/f67 [4643005,126597] 0 2024-04-25T22:03:20.122 INFO:tasks.workunit.client.0.smithi044.stdout:8/585: dwrite d2a/d32/f34 [0,4194304] 0 2024-04-25T22:03:20.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:20.121+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:20.123 INFO:tasks.workunit.client.0.smithi044.stdout:8/586: write d2a/d77/f87 [692282,108909] 0 2024-04-25T22:03:20.126 INFO:tasks.workunit.client.0.smithi044.stdout:2/433: dread d7/d7b/d81/d4e/f36 [0,4194304] 0 2024-04-25T22:03:20.126 INFO:tasks.workunit.client.0.smithi044.stdout:8/587: rename d2a/d77/fae to d2a/d32/d57/d5e/fc7 0 2024-04-25T22:03:20.126 INFO:tasks.workunit.client.0.smithi044.stdout:2/434: write d7/f3f [193269,44058] 0 2024-04-25T22:03:20.127 INFO:tasks.workunit.client.0.smithi044.stdout:8/588: mknod d2a/d39/d5a/d66/cc8 0 2024-04-25T22:03:20.138 INFO:tasks.workunit.client.0.smithi044.stdout:8/589: write d2a/f45 [637888,108831] 0 2024-04-25T22:03:20.139 INFO:tasks.workunit.client.0.smithi044.stdout:8/590: chown d2a/l59 3689 1 2024-04-25T22:03:20.142 INFO:tasks.workunit.client.0.smithi044.stdout:8/591: dread - d2a/fac zero size 2024-04-25T22:03:20.143 INFO:tasks.workunit.client.0.smithi044.stdout:6/531: dread d2/d23/d5a/d13/d4b/f67 [0,4194304] 0 2024-04-25T22:03:20.143 INFO:tasks.workunit.client.0.smithi044.stdout:2/435: dwrite f0 [0,4194304] 0 2024-04-25T22:03:20.143 INFO:tasks.workunit.client.0.smithi044.stdout:8/592: chown d2a/d32/lb5 92 1 2024-04-25T22:03:20.145 INFO:tasks.workunit.client.0.smithi044.stdout:6/532: rmdir d2/d23/d5a/d13/d4b 39 2024-04-25T22:03:20.145 INFO:tasks.workunit.client.0.smithi044.stdout:2/436: symlink d7/d7b/d81/d4e/d86/d6b/l8e 0 2024-04-25T22:03:20.145 INFO:tasks.workunit.client.0.smithi044.stdout:8/593: mknod d2a/d39/d5a/d8e/cc9 0 2024-04-25T22:03:20.146 INFO:tasks.workunit.client.0.smithi044.stdout:2/437: creat d7/d7b/d81/d4e/d86/f8f x:0 0 0 2024-04-25T22:03:20.147 INFO:tasks.workunit.client.0.smithi044.stdout:8/594: link f1f d2a/d39/fca 0 2024-04-25T22:03:20.147 INFO:tasks.workunit.client.0.smithi044.stdout:4/423: dread dd/d19/f6d [0,4194304] 0 2024-04-25T22:03:20.149 INFO:tasks.workunit.client.0.smithi044.stdout:6/533: mkdir d2/d23/d5a/d13/d4b/d5e/db5 0 2024-04-25T22:03:20.149 INFO:tasks.workunit.client.0.smithi044.stdout:8/595: creat d2a/d32/d57/fcb x:0 0 0 2024-04-25T22:03:20.150 INFO:tasks.workunit.client.0.smithi044.stdout:4/424: rename dd/d35/d52/f7b to dd/f8a 0 2024-04-25T22:03:20.153 INFO:tasks.workunit.client.0.smithi044.stdout:2/438: dwrite d7/f15 [4194304,4194304] 0 2024-04-25T22:03:20.153 INFO:tasks.workunit.client.0.smithi044.stdout:8/596: dread fd [0,4194304] 0 2024-04-25T22:03:20.155 INFO:tasks.workunit.client.0.smithi044.stdout:2/439: creat d7/d16/d2c/d50/f90 x:0 0 0 2024-04-25T22:03:20.155 INFO:tasks.workunit.client.0.smithi044.stdout:6/534: dread d2/d23/d5a/d13/d68/f50 [0,4194304] 0 2024-04-25T22:03:20.156 INFO:tasks.workunit.client.0.smithi044.stdout:2/440: chown d7/d7b/d81/l51 65190864 1 2024-04-25T22:03:20.156 INFO:tasks.workunit.client.0.smithi044.stdout:6/535: symlink d2/d23/d5a/d13/d4b/d5e/d9c/lb6 0 2024-04-25T22:03:20.156 INFO:tasks.workunit.client.0.smithi044.stdout:6/536: chown d2 13089346 1 2024-04-25T22:03:20.157 INFO:tasks.workunit.client.0.smithi044.stdout:2/441: unlink d7/d7b/d81/d4e/f36 0 2024-04-25T22:03:20.158 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:20.158 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:03:20.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:03:20.158 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:20.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.158 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T22:03:20.158 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:20.158 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.171051672000001, 2024-04-25T22:03:20.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.180276931, 2024-04-25T22:03:20.158 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4 2024-04-25T22:03:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983834+0000", 2024-04-25T22:03:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2900000000000001e-06 2024-04-25T22:03:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991787+0000", 2024-04-25T22:03:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079521690000000003 2024-04-25T22:03:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991826+0000", 2024-04-25T22:03:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9258999999999998e-05 2024-04-25T22:03:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991845+0000", 2024-04-25T22:03:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9360000000000001e-05 2024-04-25T22:03:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992058+0000", 2024-04-25T22:03:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212559 2024-04-25T22:03:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992213+0000", 2024-04-25T22:03:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015520700000000001 2024-04-25T22:03:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992414+0000", 2024-04-25T22:03:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020049 2024-04-25T22:03:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162511+0000", 2024-04-25T22:03:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.17009782900000001 2024-04-25T22:03:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163967+0000", 2024-04-25T22:03:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001455752 2024-04-25T22:03:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164045+0000", 2024-04-25T22:03:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7415000000000003e-05 2024-04-25T22:03:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164109+0000", 2024-04-25T22:03:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4601e-05 2024-04-25T22:03:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.071593524000001, 2024-04-25T22:03:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.12612672599999999, 2024-04-25T22:03:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2024-04-25T22:03:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083293+0000", 2024-04-25T22:03:20.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6630000000000002e-06 2024-04-25T22:03:20.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086619+0000", 2024-04-25T22:03:20.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033261699999999998 2024-04-25T22:03:20.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086647+0000", 2024-04-25T22:03:20.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8085999999999998e-05 2024-04-25T22:03:20.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086665+0000", 2024-04-25T22:03:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:03:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086870+0000", 2024-04-25T22:03:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020488599999999999 2024-04-25T22:03:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087110+0000", 2024-04-25T22:03:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024093199999999999 2024-04-25T22:03:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087310+0000", 2024-04-25T22:03:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000199936 2024-04-25T22:03:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207766+0000", 2024-04-25T22:03:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.120456035 2024-04-25T22:03:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209358+0000", 2024-04-25T22:03:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015912369999999999 2024-04-25T22:03:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209390+0000", 2024-04-25T22:03:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2434999999999997e-05 2024-04-25T22:03:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209417+0000", 2024-04-25T22:03:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6936000000000001e-05 2024-04-25T22:03:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6847 4.16 4:68767fd1:::10000001f4f.00000000:head [write 0~7212] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.461412211000001, 2024-04-25T22:03:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0208302119999999, 2024-04-25T22:03:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6847 2024-04-25T22:03:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693473+0000", 2024-04-25T22:03:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.75e-06 2024-04-25T22:03:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693490+0000", 2024-04-25T22:03:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6540000000000001e-05 2024-04-25T22:03:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693509+0000", 2024-04-25T22:03:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9536999999999999e-05 2024-04-25T22:03:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693522+0000", 2024-04-25T22:03:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2099000000000001e-05 2024-04-25T22:03:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693677+0000", 2024-04-25T22:03:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015516799999999999 2024-04-25T22:03:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693705+0000", 2024-04-25T22:03:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8663e-05 2024-04-25T22:03:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705551+0000", 2024-04-25T22:03:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.011845495 2024-04-25T22:03:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705942+0000", 2024-04-25T22:03:20.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00039080099999999997 2024-04-25T22:03:20.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:20.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.706151+0000", 2024-04-25T22:03:20.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000209457 2024-04-25T22:03:20.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711141+0000", 2024-04-25T22:03:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049901240000000003 2024-04-25T22:03:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714005+0000", 2024-04-25T22:03:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028642229999999999 2024-04-25T22:03:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714180+0000", 2024-04-25T22:03:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017433699999999999 2024-04-25T22:03:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714302+0000", 2024-04-25T22:03:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122018 2024-04-25T22:03:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6960 4.16 4:6823d322:::10000001fd2.00000000:head [write 0~150] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.184408113, 2024-04-25T22:03:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.74417278899999995, 2024-04-25T22:03:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6960 2024-04-25T22:03:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970478+0000", 2024-04-25T22:03:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.939e-06 2024-04-25T22:03:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970488+0000", 2024-04-25T22:03:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9699999999999994e-06 2024-04-25T22:03:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970524+0000", 2024-04-25T22:03:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5963000000000001e-05 2024-04-25T22:03:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970537+0000", 2024-04-25T22:03:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.31e-05 2024-04-25T22:03:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970701+0000", 2024-04-25T22:03:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164177 2024-04-25T22:03:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970718+0000", 2024-04-25T22:03:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7323e-05 2024-04-25T22:03:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707632+0000", 2024-04-25T22:03:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.73691394300000002 2024-04-25T22:03:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707924+0000", 2024-04-25T22:03:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029223299999999998 2024-04-25T22:03:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.708389+0000", 2024-04-25T22:03:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046429300000000001 2024-04-25T22:03:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029039830000000002 2024-04-25T22:03:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714409+0000", 2024-04-25T22:03:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031159260000000002 2024-04-25T22:03:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714538+0000", 2024-04-25T22:03:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012952100000000001 2024-04-25T22:03:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714649+0000", 2024-04-25T22:03:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110418 2024-04-25T22:03:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7039 4.16 4:6919637e:::10000002032.00000000:head [write 0~2968] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.998361608, 2024-04-25T22:03:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.56024932199999999, 2024-04-25T22:03:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7039 2024-04-25T22:03:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:20.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156523+0000", 2024-04-25T22:03:20.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2130000000000001e-06 2024-04-25T22:03:20.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156530+0000", 2024-04-25T22:03:20.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9090000000000003e-06 2024-04-25T22:03:20.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156544+0000", 2024-04-25T22:03:20.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3271999999999999e-05 2024-04-25T22:03:20.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156551+0000", 2024-04-25T22:03:20.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4970000000000004e-06 2024-04-25T22:03:20.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156639+0000", 2024-04-25T22:03:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7638000000000004e-05 2024-04-25T22:03:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156649+0000", 2024-04-25T22:03:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0536e-05 2024-04-25T22:03:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709515+0000", 2024-04-25T22:03:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.55286568999999997 2024-04-25T22:03:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709836+0000", 2024-04-25T22:03:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032078899999999998 2024-04-25T22:03:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.710271+0000", 2024-04-25T22:03:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043530000000000001 2024-04-25T22:03:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716576+0000", 2024-04-25T22:03:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063045050000000002 2024-04-25T22:03:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716605+0000", 2024-04-25T22:03:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8949e-05 2024-04-25T22:03:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716706+0000", 2024-04-25T22:03:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101765 2024-04-25T22:03:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716772+0000", 2024-04-25T22:03:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5259000000000007e-05 2024-04-25T22:03:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7065 4.16 4:697a9f10:::10000002050.00000000:head [write 0~16297] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.940745659999999, 2024-04-25T22:03:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.50307290800000004, 2024-04-25T22:03:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7065 2024-04-25T22:03:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214139+0000", 2024-04-25T22:03:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.186e-06 2024-04-25T22:03:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214170+0000", 2024-04-25T22:03:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0419000000000001e-05 2024-04-25T22:03:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214186+0000", 2024-04-25T22:03:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6526000000000001e-05 2024-04-25T22:03:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214194+0000", 2024-04-25T22:03:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6769999999999995e-06 2024-04-25T22:03:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214380+0000", 2024-04-25T22:03:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018580699999999999 2024-04-25T22:03:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214399+0000", 2024-04-25T22:03:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9446e-05 2024-04-25T22:03:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711402+0000", 2024-04-25T22:03:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.497002901 2024-04-25T22:03:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711822+0000", 2024-04-25T22:03:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00041989399999999997 2024-04-25T22:03:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.712017+0000", 2024-04-25T22:03:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019540700000000001 2024-04-25T22:03:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716792+0000", 2024-04-25T22:03:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047748210000000003 2024-04-25T22:03:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716937+0000", 2024-04-25T22:03:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014479099999999999 2024-04-25T22:03:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717081+0000", 2024-04-25T22:03:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014412100000000001 2024-04-25T22:03:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717211+0000", 2024-04-25T22:03:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012991200000000001 2024-04-25T22:03:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7089 4.16 4:6868fcac:::1000000206b.00000000:head [write 0~5386] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.881191665999999, 2024-04-25T22:03:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44658810700000001, 2024-04-25T22:03:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7089 2024-04-25T22:03:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273695+0000", 2024-04-25T22:03:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.463e-06 2024-04-25T22:03:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273712+0000", 2024-04-25T22:03:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7842999999999998e-05 2024-04-25T22:03:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273742+0000", 2024-04-25T22:03:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9039000000000001e-05 2024-04-25T22:03:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273756+0000", 2024-04-25T22:03:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4406999999999999e-05 2024-04-25T22:03:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273943+0000", 2024-04-25T22:03:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018708 2024-04-25T22:03:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273961+0000", 2024-04-25T22:03:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7977000000000001e-05 2024-04-25T22:03:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714748+0000", 2024-04-25T22:03:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.440786605 2024-04-25T22:03:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715013+0000", 2024-04-25T22:03:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026558300000000001 2024-04-25T22:03:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715309+0000", 2024-04-25T22:03:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000295715 2024-04-25T22:03:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.719035+0000", 2024-04-25T22:03:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037256310000000001 2024-04-25T22:03:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720142+0000", 2024-04-25T22:03:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001107053 2024-04-25T22:03:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720221+0000", 2024-04-25T22:03:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9832000000000004e-05 2024-04-25T22:03:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720280+0000", 2024-04-25T22:03:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8879000000000003e-05 2024-04-25T22:03:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7090 4.16 4:69dc3034:::1000000206c.00000000:head [write 0~957] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.878567336, 2024-04-25T22:03:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44572077100000002, 2024-04-25T22:03:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7090 2024-04-25T22:03:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276319+0000", 2024-04-25T22:03:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3429999999999998e-06 2024-04-25T22:03:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276330+0000", 2024-04-25T22:03:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1567e-05 2024-04-25T22:03:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276362+0000", 2024-04-25T22:03:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1863000000000003e-05 2024-04-25T22:03:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276377+0000", 2024-04-25T22:03:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5102999999999999e-05 2024-04-25T22:03:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276564+0000", 2024-04-25T22:03:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018629700000000001 2024-04-25T22:03:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276583+0000", 2024-04-25T22:03:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9743000000000001e-05 2024-04-25T22:03:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717354+0000", 2024-04-25T22:03:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44077094900000002 2024-04-25T22:03:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717723+0000", 2024-04-25T22:03:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036839099999999998 2024-04-25T22:03:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.718097+0000", 2024-04-25T22:03:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037392099999999999 2024-04-25T22:03:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720305+0000", 2024-04-25T22:03:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022084439999999999 2024-04-25T22:03:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721866+0000", 2024-04-25T22:03:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015610260000000001 2024-04-25T22:03:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721944+0000", 2024-04-25T22:03:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7961999999999997e-05 2024-04-25T22:03:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.722037+0000", 2024-04-25T22:03:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3162e-05 2024-04-25T22:03:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:264 3.1d 3:bf8dcf43:::200.00000008:head [write 3731277~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682521+0000", 2024-04-25T22:03:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.472363149, 2024-04-25T22:03:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.09716756, 2024-04-25T22:03:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682521+0000", 2024-04-25T22:03:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682521+0000", 2024-04-25T22:03:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682522+0000", 2024-04-25T22:03:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.074e-06 2024-04-25T22:03:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682529+0000", 2024-04-25T22:03:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7630000000000003e-06 2024-04-25T22:03:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682573+0000", 2024-04-25T22:03:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4499000000000002e-05 2024-04-25T22:03:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682592+0000", 2024-04-25T22:03:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9323000000000001e-05 2024-04-25T22:03:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.773315+0000", 2024-04-25T22:03:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.090722811 2024-04-25T22:03:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.773542+0000", 2024-04-25T22:03:20.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00022711899999999999 2024-04-25T22:03:20.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:20.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.773723+0000", 2024-04-25T22:03:20.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000180321 2024-04-25T22:03:20.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779406+0000", 2024-04-25T22:03:20.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005683474 2024-04-25T22:03:20.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779531+0000", 2024-04-25T22:03:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000125208 2024-04-25T22:03:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779622+0000", 2024-04-25T22:03:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0643000000000006e-05 2024-04-25T22:03:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779688+0000", 2024-04-25T22:03:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6324999999999999e-05 2024-04-25T22:03:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:265 3.1d 3:bf8dcf43:::200.00000008:head [write 3732680~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682617+0000", 2024-04-25T22:03:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.472267077, 2024-04-25T22:03:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.097415482999999997, 2024-04-25T22:03:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682617+0000", 2024-04-25T22:03:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682617+0000", 2024-04-25T22:03:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682618+0000", 2024-04-25T22:03:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:03:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682625+0000", 2024-04-25T22:03:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4059999999999999e-06 2024-04-25T22:03:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682643+0000", 2024-04-25T22:03:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7476e-05 2024-04-25T22:03:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682656+0000", 2024-04-25T22:03:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.311e-05 2024-04-25T22:03:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.774784+0000", 2024-04-25T22:03:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.092128053000000001 2024-04-25T22:03:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.774912+0000", 2024-04-25T22:03:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012798099999999999 2024-04-25T22:03:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.775095+0000", 2024-04-25T22:03:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000182607 2024-04-25T22:03:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779418+0000", 2024-04-25T22:03:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043234390000000001 2024-04-25T22:03:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779841+0000", 2024-04-25T22:03:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042321999999999998 2024-04-25T22:03:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779937+0000", 2024-04-25T22:03:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5402000000000006e-05 2024-04-25T22:03:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.780032+0000", 2024-04-25T22:03:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5564999999999997e-05 2024-04-25T22:03:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:266 3.1d 3:bf8dcf43:::200.00000008:head [write 3734079~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682671+0000", 2024-04-25T22:03:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.472212433999999, 2024-04-25T22:03:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.100589284, 2024-04-25T22:03:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682671+0000", 2024-04-25T22:03:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682671+0000", 2024-04-25T22:03:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682672+0000", 2024-04-25T22:03:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:03:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682687+0000", 2024-04-25T22:03:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.418e-05 2024-04-25T22:03:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682704+0000", 2024-04-25T22:03:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7139e-05 2024-04-25T22:03:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682719+0000", 2024-04-25T22:03:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4776999999999999e-05 2024-04-25T22:03:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.776110+0000", 2024-04-25T22:03:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093391199999999994 2024-04-25T22:03:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.776237+0000", 2024-04-25T22:03:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012748800000000001 2024-04-25T22:03:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.776502+0000", 2024-04-25T22:03:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026474300000000001 2024-04-25T22:03:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.780083+0000", 2024-04-25T22:03:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035809190000000001 2024-04-25T22:03:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.783012+0000", 2024-04-25T22:03:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029288790000000001 2024-04-25T22:03:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.783173+0000", 2024-04-25T22:03:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016134799999999999 2024-04-25T22:03:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.783261+0000", 2024-04-25T22:03:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7558000000000004e-05 2024-04-25T22:03:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:10642 4.35 4:ae7b229b:::100000030a9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.493805+0000", 2024-04-25T22:03:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 6.6610791589999998, 2024-04-25T22:03:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13451306399999999, 2024-04-25T22:03:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.224 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.224 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:20.224 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:20.224 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:20.224 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10642 2024-04-25T22:03:20.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.224 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.493805+0000", 2024-04-25T22:03:20.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.493805+0000", 2024-04-25T22:03:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.493807+0000", 2024-04-25T22:03:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2129999999999998e-06 2024-04-25T22:03:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502392+0000", 2024-04-25T22:03:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085850079999999999 2024-04-25T22:03:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502428+0000", 2024-04-25T22:03:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5952999999999999e-05 2024-04-25T22:03:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502447+0000", 2024-04-25T22:03:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9565999999999999e-05 2024-04-25T22:03:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502595+0000", 2024-04-25T22:03:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014737499999999999 2024-04-25T22:03:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502851+0000", 2024-04-25T22:03:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025651299999999999 2024-04-25T22:03:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.503238+0000", 2024-04-25T22:03:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038642800000000002 2024-04-25T22:03:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.627850+0000", 2024-04-25T22:03:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.12461184 2024-04-25T22:03:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628046+0000", 2024-04-25T22:03:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019659500000000001 2024-04-25T22:03:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628184+0000", 2024-04-25T22:03:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000137532 2024-04-25T22:03:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628318+0000", 2024-04-25T22:03:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000134041 2024-04-25T22:03:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:10647 4.35 4:ae7b229b:::100000030a9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 6.625522642, 2024-04-25T22:03:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14506126, 2024-04-25T22:03:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10647 2024-04-25T22:03:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529364+0000", 2024-04-25T22:03:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.286e-06 2024-04-25T22:03:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538917+0000", 2024-04-25T22:03:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0095530010000000002 2024-04-25T22:03:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538955+0000", 2024-04-25T22:03:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:03:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538977+0000", 2024-04-25T22:03:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.105e-05 2024-04-25T22:03:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568092+0000", 2024-04-25T22:03:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029115604999999999 2024-04-25T22:03:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568243+0000", 2024-04-25T22:03:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000151044 2024-04-25T22:03:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568498+0000", 2024-04-25T22:03:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025517399999999999 2024-04-25T22:03:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628005+0000", 2024-04-25T22:03:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059506991000000002 2024-04-25T22:03:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674273+0000", 2024-04-25T22:03:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.046267233999999997 2024-04-25T22:03:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674357+0000", 2024-04-25T22:03:20.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4745000000000003e-05 2024-04-25T22:03:20.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674422+0000", 2024-04-25T22:03:20.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5160999999999995e-05 2024-04-25T22:03:20.234 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.234 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.234 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.234 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:10651 4.b e64/16 4:d2207142:::100000030bf.00000000:head v 64'182, mlcod=64'180)", 2024-04-25T22:03:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.604132+0000", 2024-04-25T22:03:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 6.5507523079999999, 2024-04-25T22:03:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.105085936, 2024-04-25T22:03:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.604132+0000", 2024-04-25T22:03:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.604132+0000", 2024-04-25T22:03:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.604133+0000", 2024-04-25T22:03:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:03:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.608939+0000", 2024-04-25T22:03:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004806009 2024-04-25T22:03:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.608965+0000", 2024-04-25T22:03:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.639e-05 2024-04-25T22:03:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.608978+0000", 2024-04-25T22:03:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2666999999999999e-05 2024-04-25T22:03:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.609113+0000", 2024-04-25T22:03:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000135575 2024-04-25T22:03:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.609198+0000", 2024-04-25T22:03:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4899000000000001e-05 2024-04-25T22:03:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.709157+0000", 2024-04-25T22:03:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.099958796000000003 2024-04-25T22:03:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.709217+0000", 2024-04-25T22:03:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0553000000000001e-05 2024-04-25T22:03:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:11395 4.35 4:addad63f:::100000030d7.00000000:head [write 0~4194304 [3@3390803]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:18.494568+0000", 2024-04-25T22:03:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.660315617, 2024-04-25T22:03:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.112104131, 2024-04-25T22:03:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 11395 2024-04-25T22:03:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.494568+0000", 2024-04-25T22:03:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.494568+0000", 2024-04-25T22:03:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.494569+0000", 2024-04-25T22:03:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9299999999999998e-07 2024-04-25T22:03:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.501621+0000", 2024-04-25T22:03:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070524979999999999 2024-04-25T22:03:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.501635+0000", 2024-04-25T22:03:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3244999999999999e-05 2024-04-25T22:03:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.501642+0000", 2024-04-25T22:03:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4769999999999997e-06 2024-04-25T22:03:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.544365+0000", 2024-04-25T22:03:20.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.042722549999999998 2024-04-25T22:03:20.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.544447+0000", 2024-04-25T22:03:20.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1924999999999999e-05 2024-04-25T22:03:20.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:20.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.544573+0000", 2024-04-25T22:03:20.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012622999999999999 2024-04-25T22:03:20.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.596552+0000", 2024-04-25T22:03:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.051979663000000002 2024-04-25T22:03:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.606595+0000", 2024-04-25T22:03:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010042979 2024-04-25T22:03:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.606636+0000", 2024-04-25T22:03:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0244999999999998e-05 2024-04-25T22:03:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.606672+0000", 2024-04-25T22:03:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6726e-05 2024-04-25T22:03:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:11818 4.27 4:e48405d9:::1000000312b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:19.135317+0000", 2024-04-25T22:03:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.019566677, 2024-04-25T22:03:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.124009722, 2024-04-25T22:03:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 11818 2024-04-25T22:03:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.135317+0000", 2024-04-25T22:03:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.135317+0000", 2024-04-25T22:03:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.135319+0000", 2024-04-25T22:03:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0540000000000002e-06 2024-04-25T22:03:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.143448+0000", 2024-04-25T22:03:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081289229999999997 2024-04-25T22:03:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.143483+0000", 2024-04-25T22:03:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5321999999999998e-05 2024-04-25T22:03:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.143505+0000", 2024-04-25T22:03:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.122e-05 2024-04-25T22:03:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.143665+0000", 2024-04-25T22:03:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016055900000000001 2024-04-25T22:03:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.143820+0000", 2024-04-25T22:03:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015480499999999999 2024-04-25T22:03:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.144036+0000", 2024-04-25T22:03:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000215625 2024-04-25T22:03:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.229745+0000", 2024-04-25T22:03:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085709236999999994 2024-04-25T22:03:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.259221+0000", 2024-04-25T22:03:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029475883000000001 2024-04-25T22:03:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.259278+0000", 2024-04-25T22:03:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7181e-05 2024-04-25T22:03:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.259327+0000", 2024-04-25T22:03:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8912999999999997e-05 2024-04-25T22:03:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:11836 4.27 4:e75b72a1:::100000032e8.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:19.160506+0000", 2024-04-25T22:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.994377913, 2024-04-25T22:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.12944214600000001, 2024-04-25T22:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 11836 2024-04-25T22:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.160506+0000", 2024-04-25T22:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.160506+0000", 2024-04-25T22:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.160513+0000", 2024-04-25T22:03:20.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0339999999999999e-06 2024-04-25T22:03:20.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.172666+0000", 2024-04-25T22:03:20.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012152718 2024-04-25T22:03:20.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.172698+0000", 2024-04-25T22:03:20.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2673999999999999e-05 2024-04-25T22:03:20.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.172736+0000", 2024-04-25T22:03:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7595999999999997e-05 2024-04-25T22:03:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.202923+0000", 2024-04-25T22:03:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.030187338000000001 2024-04-25T22:03:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.203072+0000", 2024-04-25T22:03:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014835599999999999 2024-04-25T22:03:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.203178+0000", 2024-04-25T22:03:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106766 2024-04-25T22:03:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.289757+0000", 2024-04-25T22:03:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.08657898 2024-04-25T22:03:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.289838+0000", 2024-04-25T22:03:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0272999999999995e-05 2024-04-25T22:03:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.289898+0000", 2024-04-25T22:03:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9846999999999998e-05 2024-04-25T22:03:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.289948+0000", 2024-04-25T22:03:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0563999999999999e-05 2024-04-25T22:03:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:11850 4.31 4:8dfc94b7:::10000003310.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:19.182142+0000", 2024-04-25T22:03:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.97274160799999998, 2024-04-25T22:03:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.12624586199999999, 2024-04-25T22:03:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 11850 2024-04-25T22:03:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.182142+0000", 2024-04-25T22:03:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.182142+0000", 2024-04-25T22:03:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.182143+0000", 2024-04-25T22:03:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5999999999999991e-07 2024-04-25T22:03:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.190463+0000", 2024-04-25T22:03:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083195100000000004 2024-04-25T22:03:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.190484+0000", 2024-04-25T22:03:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0917e-05 2024-04-25T22:03:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.190496+0000", 2024-04-25T22:03:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2465e-05 2024-04-25T22:03:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.213820+0000", 2024-04-25T22:03:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023324139000000001 2024-04-25T22:03:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.213959+0000", 2024-04-25T22:03:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013907399999999999 2024-04-25T22:03:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.214147+0000", 2024-04-25T22:03:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000188042 2024-04-25T22:03:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.266388+0000", 2024-04-25T22:03:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.052240871000000001 2024-04-25T22:03:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.308301+0000", 2024-04-25T22:03:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.041912405 2024-04-25T22:03:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.308347+0000", 2024-04-25T22:03:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.596e-05 2024-04-25T22:03:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.308388+0000", 2024-04-25T22:03:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1519e-05 2024-04-25T22:03:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:11869 4.27 4:e7fc5ee9:::10000003269.00000001:head [write 4063232~131072] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:19.218068+0000", 2024-04-25T22:03:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.93681543, 2024-04-25T22:03:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.113649111, 2024-04-25T22:03:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 11869 2024-04-25T22:03:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.218068+0000", 2024-04-25T22:03:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.218068+0000", 2024-04-25T22:03:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.218070+0000", 2024-04-25T22:03:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.703e-06 2024-04-25T22:03:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.218980+0000", 2024-04-25T22:03:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090953699999999998 2024-04-25T22:03:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.218991+0000", 2024-04-25T22:03:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1171e-05 2024-04-25T22:03:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.218999+0000", 2024-04-25T22:03:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6459999999999999e-06 2024-04-25T22:03:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.259386+0000", 2024-04-25T22:03:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.040386857999999998 2024-04-25T22:03:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.259469+0000", 2024-04-25T22:03:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2416000000000005e-05 2024-04-25T22:03:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.259646+0000", 2024-04-25T22:03:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017753699999999999 2024-04-25T22:03:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.301627+0000", 2024-04-25T22:03:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.041980664000000001 2024-04-25T22:03:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.331625+0000", 2024-04-25T22:03:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029998057000000002 2024-04-25T22:03:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.331677+0000", 2024-04-25T22:03:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1857999999999997e-05 2024-04-25T22:03:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.331718+0000", 2024-04-25T22:03:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0664000000000002e-05 2024-04-25T22:03:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:11875 4.27 4:e5179c63:::10000003176.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:19.225320+0000", 2024-04-25T22:03:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.92956358100000003, 2024-04-25T22:03:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.106595471, 2024-04-25T22:03:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 11875 2024-04-25T22:03:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.225320+0000", 2024-04-25T22:03:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.225320+0000", 2024-04-25T22:03:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.225321+0000", 2024-04-25T22:03:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:03:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.232320+0000", 2024-04-25T22:03:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069987859999999999 2024-04-25T22:03:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.232334+0000", 2024-04-25T22:03:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4572e-05 2024-04-25T22:03:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.232343+0000", 2024-04-25T22:03:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9469999999999992e-06 2024-04-25T22:03:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.261115+0000", 2024-04-25T22:03:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028771577 2024-04-25T22:03:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.261301+0000", 2024-04-25T22:03:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018575199999999999 2024-04-25T22:03:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.261469+0000", 2024-04-25T22:03:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016775000000000001 2024-04-25T22:03:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.301704+0000", 2024-04-25T22:03:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.040235899999999998 2024-04-25T22:03:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.331813+0000", 2024-04-25T22:03:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.030108627999999998 2024-04-25T22:03:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.331874+0000", 2024-04-25T22:03:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0989000000000002e-05 2024-04-25T22:03:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.331916+0000", 2024-04-25T22:03:20.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1696999999999997e-05 2024-04-25T22:03:20.275 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.275 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.275 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.275 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:20.275 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:20.275 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:20.277 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:20.282 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:20.268+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:20.283 INFO:tasks.workunit.client.0.smithi044.stdout:6/537: write d2/d23/d30/faa [537072,99274] 0 2024-04-25T22:03:20.283 INFO:tasks.workunit.client.0.smithi044.stdout:2/442: write d7/d8/d48/f63 [883068,43922] 0 2024-04-25T22:03:20.283 INFO:tasks.workunit.client.0.smithi044.stdout:6/538: write d2/d23/d5a/d12/d27/d8d/fa1 [3417040,109080] 0 2024-04-25T22:03:20.284 INFO:tasks.workunit.client.0.smithi044.stdout:8/597: dwrite d2a/d39/d42/d68/d6b/d6e/d84/f96 [0,4194304] 0 2024-04-25T22:03:20.284 INFO:tasks.workunit.client.0.smithi044.stdout:6/539: rename d2/d23/d5a/d12/d49/f5b to d2/d23/d5a/d12/d1f/d94/fb7 0 2024-04-25T22:03:20.284 INFO:tasks.workunit.client.0.smithi044.stdout:2/443: dwrite d7/d7b/d81/d4e/d86/d6b/d78/f5a [4194304,4194304] 0 2024-04-25T22:03:20.284 INFO:tasks.workunit.client.0.smithi044.stdout:2/444: fdatasync d7/d16/d4b/f72 0 2024-04-25T22:03:20.284 INFO:tasks.workunit.client.0.smithi044.stdout:2/445: write d7/d16/d4b/f82 [687443,2375] 0 2024-04-25T22:03:20.284 INFO:tasks.workunit.client.0.smithi044.stdout:2/446: mknod d7/d7b/d81/d4e/c91 0 2024-04-25T22:03:20.284 INFO:tasks.workunit.client.0.smithi044.stdout:8/598: dwrite d2a/d39/f97 [0,4194304] 0 2024-04-25T22:03:20.284 INFO:tasks.workunit.client.0.smithi044.stdout:8/599: truncate d2a/d52/f72 1800051 0 2024-04-25T22:03:20.284 INFO:tasks.workunit.client.0.smithi044.stdout:2/447: read d7/f32 [1859235,57515] 0 2024-04-25T22:03:20.284 INFO:tasks.workunit.client.0.smithi044.stdout:7/372: sync 2024-04-25T22:03:20.284 INFO:tasks.workunit.client.0.smithi044.stdout:3/447: sync 2024-04-25T22:03:20.284 INFO:tasks.workunit.client.0.smithi044.stdout:5/375: sync 2024-04-25T22:03:20.284 INFO:tasks.workunit.client.0.smithi044.stdout:3/448: chown d0/d1/d79 0 1 2024-04-25T22:03:20.284 INFO:tasks.workunit.client.0.smithi044.stdout:3/449: stat d0/d13/d1c/c25 0 2024-04-25T22:03:20.284 INFO:tasks.workunit.client.0.smithi044.stdout:5/376: creat d2/d5/d27/d2a/d3a/f77 x:0 0 0 2024-04-25T22:03:20.285 INFO:tasks.workunit.client.0.smithi044.stdout:7/373: truncate d1c/d22/d28/d30/d32/d33/f65 4305041 0 2024-04-25T22:03:20.285 INFO:tasks.workunit.client.0.smithi044.stdout:7/374: write d1c/d22/d28/d4e/f61 [960383,28711] 0 2024-04-25T22:03:20.285 INFO:tasks.workunit.client.0.smithi044.stdout:8/600: dwrite f27 [0,4194304] 0 2024-04-25T22:03:20.285 INFO:tasks.workunit.client.0.smithi044.stdout:7/375: dread - d1c/f38 zero size 2024-04-25T22:03:20.285 INFO:tasks.workunit.client.0.smithi044.stdout:7/376: creat d1c/d22/d28/d4e/f73 x:0 0 0 2024-04-25T22:03:20.285 INFO:tasks.workunit.client.0.smithi044.stdout:7/377: link d1c/c27 d1c/d22/d28/d30/c74 0 2024-04-25T22:03:20.285 INFO:tasks.workunit.client.0.smithi044.stdout:5/377: truncate d2/d5/d27/f36 3295474 0 2024-04-25T22:03:20.285 INFO:tasks.workunit.client.0.smithi044.stdout:5/378: fdatasync d2/d5/f9 0 2024-04-25T22:03:20.285 INFO:tasks.workunit.client.0.smithi044.stdout:5/379: creat d2/d5/d21/d26/d2c/f78 x:0 0 0 2024-04-25T22:03:20.285 INFO:tasks.workunit.client.0.smithi044.stdout:5/380: getdents d2/d5/d27/d2a/d48 0 2024-04-25T22:03:20.285 INFO:tasks.workunit.client.0.smithi044.stdout:5/381: getdents d2/d5/d21/d26 0 2024-04-25T22:03:20.285 INFO:tasks.workunit.client.0.smithi044.stdout:5/382: creat d2/f79 x:0 0 0 2024-04-25T22:03:20.285 INFO:tasks.workunit.client.0.smithi044.stdout:5/383: dread - d2/f79 zero size 2024-04-25T22:03:20.285 INFO:tasks.workunit.client.0.smithi044.stdout:5/384: read - d2/d5/d6a/f6e zero size 2024-04-25T22:03:20.285 INFO:tasks.workunit.client.0.smithi044.stdout:5/385: fsync d2/d35/f3f 0 2024-04-25T22:03:20.286 INFO:tasks.workunit.client.0.smithi044.stdout:5/386: dwrite d2/d5/d27/d2a/d5c/d5f/f73 [0,4194304] 0 2024-04-25T22:03:20.286 INFO:tasks.workunit.client.0.smithi044.stdout:5/387: symlink d2/d5/d21/d38/d52/l7a 0 2024-04-25T22:03:20.286 INFO:tasks.workunit.client.0.smithi044.stdout:5/388: dread d2/f20 [0,4194304] 0 2024-04-25T22:03:20.286 INFO:tasks.workunit.client.0.smithi044.stdout:5/389: chown d2/c28 96135733 1 2024-04-25T22:03:20.286 INFO:tasks.workunit.client.0.smithi044.stdout:5/390: link d2/d5/d27/c4e d2/d35/c7b 0 2024-04-25T22:03:20.286 INFO:tasks.workunit.client.0.smithi044.stdout:5/391: getdents d2/d5/d6a 0 2024-04-25T22:03:20.286 INFO:tasks.workunit.client.0.smithi044.stdout:5/392: mkdir d2/d5/d21/d38/d7c 0 2024-04-25T22:03:20.286 INFO:tasks.workunit.client.0.smithi044.stdout:5/393: unlink d2/d5/d27/c2e 0 2024-04-25T22:03:20.286 INFO:tasks.workunit.client.0.smithi044.stdout:2/448: dread d7/d7b/d81/d4e/f39 [0,4194304] 0 2024-04-25T22:03:20.286 INFO:tasks.workunit.client.0.smithi044.stdout:5/394: read d2/d5/d27/d2a/f42 [568280,129883] 0 2024-04-25T22:03:20.286 INFO:tasks.workunit.client.0.smithi044.stdout:2/449: creat d7/d8/d5f/d70/d8a/f92 x:0 0 0 2024-04-25T22:03:20.286 INFO:tasks.workunit.client.0.smithi044.stdout:5/395: dread - d2/d5/d21/d26/f57 zero size 2024-04-25T22:03:20.286 INFO:tasks.workunit.client.0.smithi044.stdout:2/450: symlink d7/d16/d2c/d50/l93 0 2024-04-25T22:03:20.286 INFO:tasks.workunit.client.0.smithi044.stdout:5/396: dwrite d2/f4 [4194304,4194304] 0 2024-04-25T22:03:20.286 INFO:tasks.workunit.client.0.smithi044.stdout:2/451: dread d7/d16/d4b/f82 [0,4194304] 0 2024-04-25T22:03:20.287 INFO:tasks.workunit.client.0.smithi044.stdout:2/452: write d7/d8/d5f/f76 [756931,112890] 0 2024-04-25T22:03:20.287 INFO:tasks.workunit.client.0.smithi044.stdout:5/397: dwrite d2/d5/d21/d26/f57 [0,4194304] 0 2024-04-25T22:03:20.287 INFO:tasks.workunit.client.0.smithi044.stdout:5/398: creat d2/d5/f7d x:0 0 0 2024-04-25T22:03:20.287 INFO:tasks.workunit.client.0.smithi044.stdout:5/399: dwrite d2/d5/d21/d26/d2c/d37/f4d [0,4194304] 0 2024-04-25T22:03:20.287 INFO:tasks.workunit.client.0.smithi044.stdout:5/400: symlink d2/d5/d21/d38/d52/d56/l7e 0 2024-04-25T22:03:20.287 INFO:tasks.workunit.client.0.smithi044.stdout:5/401: write d2/d5/f16 [530754,27398] 0 2024-04-25T22:03:20.287 INFO:tasks.workunit.client.0.smithi044.stdout:5/402: mknod d2/d5/d21/d26/d2c/c7f 0 2024-04-25T22:03:20.287 INFO:tasks.workunit.client.0.smithi044.stdout:5/403: mknod d2/d5/d21/d38/d7c/c80 0 2024-04-25T22:03:20.287 INFO:tasks.workunit.client.0.smithi044.stdout:5/404: creat d2/d5/d27/f81 x:0 0 0 2024-04-25T22:03:20.287 INFO:tasks.workunit.client.0.smithi044.stdout:5/405: write d2/d5/f7d [908777,16596] 0 2024-04-25T22:03:20.287 INFO:tasks.workunit.client.0.smithi044.stdout:5/406: getdents d2/d5/d21/d26/d2c/d37 0 2024-04-25T22:03:20.287 INFO:tasks.workunit.client.0.smithi044.stdout:5/407: rename d2/f79 to d2/d5/d21/d26/f82 0 2024-04-25T22:03:20.287 INFO:tasks.workunit.client.0.smithi044.stdout:5/408: truncate d2/d35/f45 166723 0 2024-04-25T22:03:20.287 INFO:tasks.workunit.client.0.smithi044.stdout:5/409: stat d2/d5/d27/f81 0 2024-04-25T22:03:20.287 INFO:tasks.workunit.client.0.smithi044.stdout:5/410: creat d2/d5/d27/d2a/d5c/f83 x:0 0 0 2024-04-25T22:03:20.288 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:20.288 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:20.292 INFO:tasks.workunit.client.0.smithi044.stdout:5/411: mkdir d2/d5/d21/d26/d84 0 2024-04-25T22:03:20.292 INFO:tasks.workunit.client.0.smithi044.stdout:5/412: getdents d2/d5/d21/d26/d2c/d37 0 2024-04-25T22:03:20.292 INFO:tasks.workunit.client.0.smithi044.stdout:5/413: symlink d2/d35/l85 0 2024-04-25T22:03:20.292 INFO:tasks.workunit.client.0.smithi044.stdout:5/414: chown d2/d35/f4a 225097 1 2024-04-25T22:03:20.292 INFO:tasks.workunit.client.0.smithi044.stdout:5/415: read d2/d35/f3f [3497781,27536] 0 2024-04-25T22:03:20.293 INFO:tasks.workunit.client.0.smithi044.stdout:2/453: dread d7/d16/d4b/f72 [0,4194304] 0 2024-04-25T22:03:20.293 INFO:tasks.workunit.client.0.smithi044.stdout:2/454: creat d7/d8/d1c/f94 x:0 0 0 2024-04-25T22:03:20.293 INFO:tasks.workunit.client.0.smithi044.stdout:5/416: truncate d2/f19 105119 0 2024-04-25T22:03:20.293 INFO:tasks.workunit.client.0.smithi044.stdout:2/455: creat d7/d7b/d81/f95 x:0 0 0 2024-04-25T22:03:20.293 INFO:tasks.workunit.client.0.smithi044.stdout:2/456: read d7/d8/d1c/f69 [3500601,53441] 0 2024-04-25T22:03:20.293 INFO:tasks.workunit.client.0.smithi044.stdout:5/417: getdents d2/d5/d27/d2a/d3a 0 2024-04-25T22:03:20.293 INFO:tasks.workunit.client.0.smithi044.stdout:2/457: mknod d7/d8/d1c/d77/c96 0 2024-04-25T22:03:20.293 INFO:tasks.workunit.client.0.smithi044.stdout:5/418: dread - d2/d5/d27/f81 zero size 2024-04-25T22:03:20.293 INFO:tasks.workunit.client.0.smithi044.stdout:2/458: chown d7/d16/d2c 6288 1 2024-04-25T22:03:20.293 INFO:tasks.workunit.client.0.smithi044.stdout:5/419: creat d2/d35/f86 x:0 0 0 2024-04-25T22:03:20.293 INFO:tasks.workunit.client.0.smithi044.stdout:9/537: sync 2024-04-25T22:03:20.293 INFO:tasks.workunit.client.0.smithi044.stdout:9/538: stat d4/d7/d18/d2e/f4c 0 2024-04-25T22:03:20.293 INFO:tasks.workunit.client.0.smithi044.stdout:9/539: symlink d4/d37/d54/d84/lb1 0 2024-04-25T22:03:20.293 INFO:tasks.workunit.client.0.smithi044.stdout:5/420: link d2/d5/d27/f36 d2/d5/d21/d26/d2c/f87 0 2024-04-25T22:03:20.293 INFO:tasks.workunit.client.0.smithi044.stdout:9/540: creat d4/d4b/d86/fb2 x:0 0 0 2024-04-25T22:03:20.294 INFO:tasks.workunit.client.0.smithi044.stdout:9/541: symlink d4/d3d/d58/lb3 0 2024-04-25T22:03:20.294 INFO:tasks.workunit.client.0.smithi044.stdout:9/542: truncate d4/d37/f7b 71872 0 2024-04-25T22:03:20.294 INFO:tasks.workunit.client.0.smithi044.stdout:9/543: symlink d4/d7/d18/d2d/d70/lb4 0 2024-04-25T22:03:20.294 INFO:tasks.workunit.client.0.smithi044.stdout:2/459: dwrite f0 [0,4194304] 0 2024-04-25T22:03:20.294 INFO:tasks.workunit.client.0.smithi044.stdout:2/460: stat d7 0 2024-04-25T22:03:20.294 INFO:tasks.workunit.client.0.smithi044.stdout:9/544: write d4/d7/d18/d2e/f5d [300204,66291] 0 2024-04-25T22:03:20.294 INFO:tasks.workunit.client.0.smithi044.stdout:9/545: mkdir d4/d7/d18/d2e/db5 0 2024-04-25T22:03:20.294 INFO:tasks.workunit.client.0.smithi044.stdout:2/461: mknod d7/d16/d4b/c97 0 2024-04-25T22:03:20.294 INFO:tasks.workunit.client.0.smithi044.stdout:9/546: symlink d4/d4b/d86/lb6 0 2024-04-25T22:03:20.294 INFO:tasks.workunit.client.0.smithi044.stdout:5/421: dwrite d2/d5/d27/f51 [0,4194304] 0 2024-04-25T22:03:20.294 INFO:tasks.workunit.client.0.smithi044.stdout:5/422: creat d2/d5/f88 x:0 0 0 2024-04-25T22:03:20.294 INFO:tasks.workunit.client.0.smithi044.stdout:5/423: chown d2/d5/f88 18808 1 2024-04-25T22:03:20.294 INFO:tasks.workunit.client.0.smithi044.stdout:2/462: truncate d7/d7b/d81/d4e/d86/d6b/d78/d44/f8d 973684 0 2024-04-25T22:03:20.294 INFO:tasks.workunit.client.0.smithi044.stdout:5/424: write d2/d5/d27/d2a/d5c/f83 [642410,76969] 0 2024-04-25T22:03:20.295 INFO:tasks.workunit.client.0.smithi044.stdout:2/463: symlink d7/d7b/l98 0 2024-04-25T22:03:20.295 INFO:tasks.workunit.client.0.smithi044.stdout:2/464: truncate d7/d7b/d81/d4e/f24 143289 0 2024-04-25T22:03:20.295 INFO:tasks.workunit.client.0.smithi044.stdout:2/465: dread - d7/d7b/d81/d4e/d86/f8f zero size 2024-04-25T22:03:20.295 INFO:tasks.workunit.client.0.smithi044.stdout:2/466: mknod d7/d7b/d81/d4e/c99 0 2024-04-25T22:03:20.295 INFO:tasks.workunit.client.0.smithi044.stdout:9/547: dwrite d4/d37/f45 [0,4194304] 0 2024-04-25T22:03:20.295 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:20.295 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:20.298 INFO:tasks.workunit.client.0.smithi044.stdout:5/425: fdatasync d2/d5/d21/d26/d2c/d37/f4d 0 2024-04-25T22:03:20.298 INFO:tasks.workunit.client.0.smithi044.stdout:9/548: dwrite d4/d7/f8 [4194304,4194304] 0 2024-04-25T22:03:20.298 INFO:tasks.workunit.client.0.smithi044.stdout:5/426: write d2/d5/d21/d26/d2c/f74 [490717,4709] 0 2024-04-25T22:03:20.298 INFO:tasks.workunit.client.0.smithi044.stdout:9/549: fsync d4/d37/d54/d84/d72/f87 0 2024-04-25T22:03:20.299 INFO:tasks.workunit.client.0.smithi044.stdout:9/550: creat d4/d7/fb7 x:0 0 0 2024-04-25T22:03:20.299 INFO:tasks.workunit.client.0.smithi044.stdout:5/427: truncate d2/d35/f3f 1577760 0 2024-04-25T22:03:20.299 INFO:tasks.workunit.client.0.smithi044.stdout:5/428: symlink d2/d5/d27/d2a/d48/l89 0 2024-04-25T22:03:20.299 INFO:tasks.workunit.client.0.smithi044.stdout:5/429: rename d2/d5/d27/f51 to d2/d5/d21/d26/d2c/d37/f8a 0 2024-04-25T22:03:20.299 INFO:tasks.workunit.client.0.smithi044.stdout:5/430: symlink d2/l8b 0 2024-04-25T22:03:20.299 INFO:tasks.workunit.client.0.smithi044.stdout:5/431: mknod d2/d5/d21/d26/d84/c8c 0 2024-04-25T22:03:20.299 INFO:tasks.workunit.client.0.smithi044.stdout:5/432: symlink d2/d5/d21/d6b/l8d 0 2024-04-25T22:03:20.299 INFO:tasks.workunit.client.0.smithi044.stdout:2/467: truncate d7/d16/f17 604227 0 2024-04-25T22:03:20.299 INFO:tasks.workunit.client.0.smithi044.stdout:5/433: dwrite d2/d5/d27/f81 [0,4194304] 0 2024-04-25T22:03:20.299 INFO:tasks.workunit.client.0.smithi044.stdout:2/468: write d7/d8/d48/f4f [614136,64380] 0 2024-04-25T22:03:20.299 INFO:tasks.workunit.client.0.smithi044.stdout:5/434: mkdir d2/d5b/d8e 0 2024-04-25T22:03:20.299 INFO:tasks.workunit.client.0.smithi044.stdout:9/551: truncate d4/d7/d18/d3a/f5f 1293300 0 2024-04-25T22:03:20.299 INFO:tasks.workunit.client.0.smithi044.stdout:9/552: creat d4/d7/d18/d2e/d73/fb8 x:0 0 0 2024-04-25T22:03:20.299 INFO:tasks.workunit.client.0.smithi044.stdout:2/469: dwrite d7/d8/d1c/f94 [0,4194304] 0 2024-04-25T22:03:20.299 INFO:tasks.workunit.client.0.smithi044.stdout:9/553: rename d4/d3d/d88 to d4/d3d/d66/db9 0 2024-04-25T22:03:20.300 INFO:tasks.workunit.client.0.smithi044.stdout:5/435: dwrite d2/d5/d21/d26/d2c/f74 [0,4194304] 0 2024-04-25T22:03:20.300 INFO:tasks.workunit.client.0.smithi044.stdout:2/470: creat d7/d8/f9a x:0 0 0 2024-04-25T22:03:20.300 INFO:tasks.workunit.client.0.smithi044.stdout:9/554: symlink d4/d7/d18/d2e/db5/lba 0 2024-04-25T22:03:20.300 INFO:tasks.workunit.client.0.smithi044.stdout:5/436: mknod d2/d5b/c8f 0 2024-04-25T22:03:20.300 INFO:tasks.workunit.client.0.smithi044.stdout:9/555: chown d4/d4b/faa 6606230 1 2024-04-25T22:03:20.300 INFO:tasks.workunit.client.0.smithi044.stdout:2/471: write d7/f32 [1886278,121367] 0 2024-04-25T22:03:20.300 INFO:tasks.workunit.client.0.smithi044.stdout:2/472: stat d7/d16/d4b 0 2024-04-25T22:03:20.300 INFO:tasks.workunit.client.0.smithi044.stdout:9/556: symlink d4/d4b/dac/lbb 0 2024-04-25T22:03:20.301 INFO:tasks.workunit.client.0.smithi044.stdout:9/557: dread d4/d7/f8 [4194304,4194304] 0 2024-04-25T22:03:20.301 INFO:tasks.workunit.client.0.smithi044.stdout:5/437: dwrite d2/d5/d27/d2a/f30 [0,4194304] 0 2024-04-25T22:03:20.302 INFO:tasks.workunit.client.0.smithi044.stdout:9/558: chown d4/d3d/d66/c89 29487 1 2024-04-25T22:03:20.303 INFO:tasks.workunit.client.0.smithi044.stdout:2/473: dwrite d7/d8/d5f/f76 [0,4194304] 0 2024-04-25T22:03:20.303 INFO:tasks.workunit.client.0.smithi044.stdout:9/559: mkdir d4/d37/d54/d84/d72/d97/dbc 0 2024-04-25T22:03:20.304 INFO:tasks.workunit.client.0.smithi044.stdout:2/474: fsync d7/d7b/d81/d4e/d86/f83 0 2024-04-25T22:03:20.307 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:20.307 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:20.309 INFO:tasks.workunit.client.0.smithi044.stdout:5/438: dwrite d2/d5/d21/f61 [0,4194304] 0 2024-04-25T22:03:20.312 INFO:tasks.workunit.client.0.smithi044.stdout:9/560: dwrite d4/d7/d18/d3a/d8b/f90 [0,4194304] 0 2024-04-25T22:03:20.312 INFO:tasks.workunit.client.0.smithi044.stdout:5/439: getdents d2/d5/d21/d38/d7c 0 2024-04-25T22:03:20.313 INFO:tasks.workunit.client.0.smithi044.stdout:9/561: creat d4/d7/d18/d2e/d94/fbd x:0 0 0 2024-04-25T22:03:20.314 INFO:tasks.workunit.client.0.smithi044.stdout:9/562: mkdir d4/d3d/d66/db9/dbe 0 2024-04-25T22:03:20.314 INFO:tasks.workunit.client.0.smithi044.stdout:9/563: chown d4/d7/d18/d2d/f38 1 1 2024-04-25T22:03:20.315 INFO:tasks.workunit.client.0.smithi044.stdout:9/564: chown d4/d7/d79/f8e 0 1 2024-04-25T22:03:20.316 INFO:tasks.workunit.client.0.smithi044.stdout:9/565: dread - d4/d37/d54/d84/d72/f95 zero size 2024-04-25T22:03:20.317 INFO:tasks.workunit.client.0.smithi044.stdout:9/566: fsync d4/d7/d18/d2e/f34 0 2024-04-25T22:03:20.319 INFO:tasks.workunit.client.0.smithi044.stdout:5/440: dwrite d2/d5/d21/f2d [0,4194304] 0 2024-04-25T22:03:20.319 INFO:tasks.workunit.client.0.smithi044.stdout:9/567: mknod d4/d7/d18/d3a/d8b/cbf 0 2024-04-25T22:03:20.320 INFO:tasks.workunit.client.0.smithi044.stdout:5/441: creat d2/d5/d21/f90 x:0 0 0 2024-04-25T22:03:20.320 INFO:tasks.workunit.client.0.smithi044.stdout:9/568: creat d4/d7/d79/fc0 x:0 0 0 2024-04-25T22:03:20.321 INFO:tasks.workunit.client.0.smithi044.stdout:5/442: truncate d2/d5/d27/d2a/d5c/d5f/f63 559225 0 2024-04-25T22:03:20.323 INFO:tasks.workunit.client.0.smithi044.stdout:9/569: read d4/d7/d18/d3a/f6c [44639,89931] 0 2024-04-25T22:03:20.324 INFO:tasks.workunit.client.0.smithi044.stdout:9/570: readlink d4/d7/l14 0 2024-04-25T22:03:20.324 INFO:tasks.workunit.client.0.smithi044.stdout:9/571: creat d4/d4b/dac/fc1 x:0 0 0 2024-04-25T22:03:20.325 INFO:tasks.workunit.client.0.smithi044.stdout:5/443: dread d2/d5/d21/d26/d2c/d37/f8a [0,4194304] 0 2024-04-25T22:03:20.326 INFO:tasks.workunit.client.0.smithi044.stdout:9/572: getdents d4/d7 0 2024-04-25T22:03:20.326 INFO:tasks.workunit.client.0.smithi044.stdout:5/444: getdents d2/d5/d21/d26 0 2024-04-25T22:03:20.326 INFO:tasks.workunit.client.0.smithi044.stdout:9/573: mknod d4/d7/d18/d2d/d70/cc2 0 2024-04-25T22:03:20.327 INFO:tasks.workunit.client.0.smithi044.stdout:5/445: rename d2/d5/d27/d2a/d48/l6d to d2/d5/d21/d38/l91 0 2024-04-25T22:03:20.328 INFO:tasks.workunit.client.0.smithi044.stdout:5/446: mkdir d2/d5/d6a/d92 0 2024-04-25T22:03:20.328 INFO:tasks.workunit.client.0.smithi044.stdout:9/574: getdents d4/d4b/d86 0 2024-04-25T22:03:20.333 INFO:tasks.workunit.client.0.smithi044.stdout:5/447: dread d2/d5/d27/d2a/d5c/f83 [0,4194304] 0 2024-04-25T22:03:20.338 INFO:tasks.workunit.client.0.smithi044.stdout:5/448: dwrite d2/d5/f2f [4194304,4194304] 0 2024-04-25T22:03:20.338 INFO:tasks.workunit.client.0.smithi044.stdout:5/449: fdatasync d2/d5/d6a/f6e 0 2024-04-25T22:03:20.339 INFO:tasks.workunit.client.0.smithi044.stdout:5/450: mknod d2/d35/c93 0 2024-04-25T22:03:20.340 INFO:tasks.workunit.client.0.smithi044.stdout:5/451: rename d2/d35/f4a to d2/d5/d21/f94 0 2024-04-25T22:03:20.343 INFO:tasks.workunit.client.0.smithi044.stdout:3/450: sync 2024-04-25T22:03:20.343 INFO:tasks.workunit.client.0.smithi044.stdout:7/378: sync 2024-04-25T22:03:20.343 INFO:tasks.workunit.client.0.smithi044.stdout:4/425: sync 2024-04-25T22:03:20.343 INFO:tasks.workunit.client.0.smithi044.stdout:8/601: sync 2024-04-25T22:03:20.343 INFO:tasks.workunit.client.0.smithi044.stdout:1/457: sync 2024-04-25T22:03:20.343 INFO:tasks.workunit.client.0.smithi044.stdout:6/540: sync 2024-04-25T22:03:20.343 INFO:tasks.workunit.client.0.smithi044.stdout:0/425: sync 2024-04-25T22:03:20.344 INFO:tasks.workunit.client.0.smithi044.stdout:0/426: chown d8/da/d55 22 1 2024-04-25T22:03:20.344 INFO:tasks.workunit.client.0.smithi044.stdout:3/451: dread - d0/d1/f7e zero size 2024-04-25T22:03:20.344 INFO:tasks.workunit.client.0.smithi044.stdout:7/379: write d1c/d22/d4a/f62 [862011,104670] 0 2024-04-25T22:03:20.344 INFO:tasks.workunit.client.0.smithi044.stdout:6/541: mknod d2/d23/d5a/d11/d2a/cb8 0 2024-04-25T22:03:20.344 INFO:tasks.workunit.client.0.smithi044.stdout:4/426: fsync dd/d19/f32 0 2024-04-25T22:03:20.345 INFO:tasks.workunit.client.0.smithi044.stdout:0/427: write d8/da/f7a [747815,120383] 0 2024-04-25T22:03:20.345 INFO:tasks.workunit.client.0.smithi044.stdout:3/452: creat d0/d70/f8c x:0 0 0 2024-04-25T22:03:20.345 INFO:tasks.workunit.client.0.smithi044.stdout:4/427: mknod dd/c8b 0 2024-04-25T22:03:20.346 INFO:tasks.workunit.client.0.smithi044.stdout:8/602: rename d2a/d39/d42/d68/d6b/d6e/d84/c9c to d2a/d39/d5a/ccc 0 2024-04-25T22:03:20.346 INFO:tasks.workunit.client.0.smithi044.stdout:0/428: truncate d8/da/d55/f77 349678 0 2024-04-25T22:03:20.346 INFO:tasks.workunit.client.0.smithi044.stdout:3/453: write d0/d1/d15/d51/dd/d11/f69 [558931,10764] 0 2024-04-25T22:03:20.347 INFO:tasks.workunit.client.0.smithi044.stdout:4/428: truncate dd/d35/d52/f6a 585261 0 2024-04-25T22:03:20.347 INFO:tasks.workunit.client.0.smithi044.stdout:0/429: chown d8/da/d55/f77 2 1 2024-04-25T22:03:20.348 INFO:tasks.workunit.client.0.smithi044.stdout:8/603: link d2a/c85 d2a/d39/d5a/d92/ccd 0 2024-04-25T22:03:20.348 INFO:tasks.workunit.client.0.smithi044.stdout:1/458: dread d3/d53/f78 [0,4194304] 0 2024-04-25T22:03:20.349 INFO:tasks.workunit.client.0.smithi044.stdout:3/454: mkdir d0/d1/d15/d51/d39/d8d 0 2024-04-25T22:03:20.349 INFO:tasks.workunit.client.0.smithi044.stdout:0/430: write d8/d20/f7d [416708,107396] 0 2024-04-25T22:03:20.349 INFO:tasks.workunit.client.0.smithi044.stdout:2/475: fsync d7/d16/f54 0 2024-04-25T22:03:20.350 INFO:tasks.workunit.client.0.smithi044.stdout:4/429: creat dd/d19/f8c x:0 0 0 2024-04-25T22:03:20.350 INFO:tasks.workunit.client.0.smithi044.stdout:1/459: write d3/d59/d5c/f74 [1001777,108423] 0 2024-04-25T22:03:20.351 INFO:tasks.workunit.client.0.smithi044.stdout:8/604: mkdir d2a/d32/d57/d5e/dce 0 2024-04-25T22:03:20.351 INFO:tasks.workunit.client.0.smithi044.stdout:5/452: chown d2/d5/d21/d38/l91 1153 1 2024-04-25T22:03:20.351 INFO:tasks.workunit.client.0.smithi044.stdout:3/455: getdents d0/d70/d7c 0 2024-04-25T22:03:20.351 INFO:tasks.workunit.client.0.smithi044.stdout:0/431: mkdir d8/df/d17/d87 0 2024-04-25T22:03:20.352 INFO:tasks.workunit.client.0.smithi044.stdout:1/460: write d3/f37 [2716486,84814] 0 2024-04-25T22:03:20.352 INFO:tasks.workunit.client.0.smithi044.stdout:4/430: creat dd/d19/d72/f8d x:0 0 0 2024-04-25T22:03:20.352 INFO:tasks.workunit.client.0.smithi044.stdout:8/605: chown d2a/d82/fa6 59078180 1 2024-04-25T22:03:20.353 INFO:tasks.workunit.client.0.smithi044.stdout:5/453: readlink d2/d5/d21/d38/l91 0 2024-04-25T22:03:20.353 INFO:tasks.workunit.client.0.smithi044.stdout:0/432: mkdir d8/df/d88 0 2024-04-25T22:03:20.353 INFO:tasks.workunit.client.0.smithi044.stdout:4/431: fdatasync dd/f89 0 2024-04-25T22:03:20.354 INFO:tasks.workunit.client.0.smithi044.stdout:1/461: fdatasync d3/d7/f20 0 2024-04-25T22:03:20.354 INFO:tasks.workunit.client.0.smithi044.stdout:6/542: dwrite d2/d23/d5a/d12/d49/f5d [0,4194304] 0 2024-04-25T22:03:20.355 INFO:tasks.workunit.client.0.smithi044.stdout:4/432: write dd/f8a [1876478,112487] 0 2024-04-25T22:03:20.356 INFO:tasks.workunit.client.0.smithi044.stdout:5/454: write d2/d5/d21/d26/d2c/d37/f76 [646360,121974] 0 2024-04-25T22:03:20.356 INFO:tasks.workunit.client.0.smithi044.stdout:3/456: rename d0/d1/d15/df/d5d/d71 to d0/d1/d15/d51/d8e 0 2024-04-25T22:03:20.356 INFO:tasks.workunit.client.0.smithi044.stdout:1/462: creat d3/d54/f92 x:0 0 0 2024-04-25T22:03:20.357 INFO:tasks.workunit.client.0.smithi044.stdout:4/433: stat dd/l3f 0 2024-04-25T22:03:20.357 INFO:tasks.workunit.client.0.smithi044.stdout:8/606: getdents d2a/d32/d57 0 2024-04-25T22:03:20.358 INFO:tasks.workunit.client.0.smithi044.stdout:5/455: mkdir d2/d5/d21/d95 0 2024-04-25T22:03:20.358 INFO:tasks.workunit.client.0.smithi044.stdout:4/434: rmdir dd/d35/d52/d61/d76 39 2024-04-25T22:03:20.358 INFO:tasks.workunit.client.0.smithi044.stdout:8/607: rename f6 to d2a/d77/fcf 0 2024-04-25T22:03:20.360 INFO:tasks.workunit.client.0.smithi044.stdout:3/457: unlink d0/d1/d15/d51/dd/d35/f7b 0 2024-04-25T22:03:20.360 INFO:tasks.workunit.client.0.smithi044.stdout:4/435: chown dd/d19/c20 25422705 1 2024-04-25T22:03:20.360 INFO:tasks.workunit.client.0.smithi044.stdout:1/463: chown d3/d30/d3f/l7a 927301 1 2024-04-25T22:03:20.360 INFO:tasks.workunit.client.0.smithi044.stdout:8/608: write d2a/d39/f55 [723736,7568] 0 2024-04-25T22:03:20.361 INFO:tasks.workunit.client.0.smithi044.stdout:9/575: dread d4/d7/d18/d2e/d73/f7c [0,4194304] 0 2024-04-25T22:03:20.362 INFO:tasks.workunit.client.0.smithi044.stdout:1/464: fdatasync d3/d7/f57 0 2024-04-25T22:03:20.362 INFO:tasks.workunit.client.0.smithi044.stdout:8/609: mkdir d2a/d32/d3e/dd0 0 2024-04-25T22:03:20.363 INFO:tasks.workunit.client.0.smithi044.stdout:0/433: dread d8/df/d17/f3d [0,4194304] 0 2024-04-25T22:03:20.363 INFO:tasks.workunit.client.0.smithi044.stdout:4/436: creat dd/d35/d52/d61/f8e x:0 0 0 2024-04-25T22:03:20.364 INFO:tasks.workunit.client.0.smithi044.stdout:1/465: creat d3/d59/f93 x:0 0 0 2024-04-25T22:03:20.364 INFO:tasks.workunit.client.0.smithi044.stdout:2/476: truncate d7/d16/f17 1404725 0 2024-04-25T22:03:20.364 INFO:tasks.workunit.client.0.smithi044.stdout:9/576: mknod d4/d3d/d66/db9/cc3 0 2024-04-25T22:03:20.364 INFO:tasks.workunit.client.0.smithi044.stdout:5/456: getdents d2/d5/d21/d38/d52 0 2024-04-25T22:03:20.365 INFO:tasks.workunit.client.0.smithi044.stdout:1/466: symlink d3/d54/d76/l94 0 2024-04-25T22:03:20.366 INFO:tasks.workunit.client.0.smithi044.stdout:9/577: rmdir d4/d7/d79 39 2024-04-25T22:03:20.366 INFO:tasks.workunit.client.0.smithi044.stdout:1/467: chown d3/d7/d81 3 1 2024-04-25T22:03:20.366 INFO:tasks.workunit.client.0.smithi044.stdout:6/543: dwrite d2/d23/d5a/d13/d68/d8e/fa6 [0,4194304] 0 2024-04-25T22:03:20.366 INFO:tasks.workunit.client.0.smithi044.stdout:1/468: readlink d3/d7/l13 0 2024-04-25T22:03:20.367 INFO:tasks.workunit.client.0.smithi044.stdout:6/544: write d2/d23/d5a/d11/d3b/f71 [251554,75996] 0 2024-04-25T22:03:20.369 INFO:tasks.workunit.client.0.smithi044.stdout:9/578: creat d4/d3d/d66/db9/dbe/fc4 x:0 0 0 2024-04-25T22:03:20.370 INFO:tasks.workunit.client.0.smithi044.stdout:1/469: creat d3/d7/d29/d43/d85/f95 x:0 0 0 2024-04-25T22:03:20.370 INFO:tasks.workunit.client.0.smithi044.stdout:8/610: dread d2a/f2e [0,4194304] 0 2024-04-25T22:03:20.370 INFO:tasks.workunit.client.0.smithi044.stdout:5/457: getdents d2/d5/d6a 0 2024-04-25T22:03:20.370 INFO:tasks.workunit.client.0.smithi044.stdout:2/477: dread d7/d8/d1c/f69 [0,4194304] 0 2024-04-25T22:03:20.371 INFO:tasks.workunit.client.0.smithi044.stdout:6/545: unlink d2/d23/d5a/d11/d2a/c99 0 2024-04-25T22:03:20.371 INFO:tasks.workunit.client.0.smithi044.stdout:9/579: mknod d4/d4b/dac/cc5 0 2024-04-25T22:03:20.371 INFO:tasks.workunit.client.0.smithi044.stdout:7/380: dread fa [0,4194304] 0 2024-04-25T22:03:20.373 INFO:tasks.workunit.client.0.smithi044.stdout:7/381: chown f15 55 1 2024-04-25T22:03:20.373 INFO:tasks.workunit.client.0.smithi044.stdout:2/478: symlink d7/d7b/d81/d57/l9b 0 2024-04-25T22:03:20.373 INFO:tasks.workunit.client.0.smithi044.stdout:1/470: creat d3/d54/d76/f96 x:0 0 0 2024-04-25T22:03:20.373 INFO:tasks.workunit.client.0.smithi044.stdout:5/458: symlink d2/d5/d21/d38/d52/d56/l96 0 2024-04-25T22:03:20.374 INFO:tasks.workunit.client.0.smithi044.stdout:8/611: mknod d2a/d39/d42/d68/d6b/d7b/cd1 0 2024-04-25T22:03:20.374 INFO:tasks.workunit.client.0.smithi044.stdout:6/546: creat d2/d23/d5a/d12/d27/d8d/fb9 x:0 0 0 2024-04-25T22:03:20.374 INFO:tasks.workunit.client.0.smithi044.stdout:0/434: dwrite d8/d24/f80 [4194304,4194304] 0 2024-04-25T22:03:20.374 INFO:tasks.workunit.client.0.smithi044.stdout:6/547: chown d2/d23/da9 10022858 1 2024-04-25T22:03:20.375 INFO:tasks.workunit.client.0.smithi044.stdout:9/580: getdents d4/d4b 0 2024-04-25T22:03:20.375 INFO:tasks.workunit.client.0.smithi044.stdout:0/435: rmdir d8/d20 39 2024-04-25T22:03:20.377 INFO:tasks.workunit.client.0.smithi044.stdout:9/581: rename d4/d7/c55 to d4/d37/cc6 0 2024-04-25T22:03:20.377 INFO:tasks.workunit.client.0.smithi044.stdout:0/436: symlink d8/da/l89 0 2024-04-25T22:03:20.377 INFO:tasks.workunit.client.0.smithi044.stdout:1/471: rename d3/d7/db/d42 to d3/d7/db/d5d/d7f/d97 0 2024-04-25T22:03:20.378 INFO:tasks.workunit.client.0.smithi044.stdout:0/437: chown d8/df/l72 315946343 1 2024-04-25T22:03:20.378 INFO:tasks.workunit.client.0.smithi044.stdout:6/548: rename d2/d23/d5a/d12/d49/c83 to d2/d23/d30/cba 0 2024-04-25T22:03:20.378 INFO:tasks.workunit.client.0.smithi044.stdout:2/479: dread d7/d8/d5f/f76 [0,4194304] 0 2024-04-25T22:03:20.379 INFO:tasks.workunit.client.0.smithi044.stdout:6/549: dread - d2/d23/d5a/d12/d1f/f87 zero size 2024-04-25T22:03:20.379 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:20.372+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:20.379 INFO:tasks.workunit.client.0.smithi044.stdout:0/438: creat d8/d15/d51/f8a x:0 0 0 2024-04-25T22:03:20.380 INFO:tasks.workunit.client.0.smithi044.stdout:0/439: mkdir d8/d15/d51/d8b 0 2024-04-25T22:03:20.381 INFO:tasks.workunit.client.0.smithi044.stdout:0/440: fsync d8/da/f59 0 2024-04-25T22:03:20.381 INFO:tasks.workunit.client.0.smithi044.stdout:0/441: stat d8/da/l89 0 2024-04-25T22:03:20.382 INFO:tasks.workunit.client.0.smithi044.stdout:0/442: rmdir d8/d15/d51/d65 0 2024-04-25T22:03:20.385 INFO:tasks.workunit.client.0.smithi044.stdout:2/480: dwrite d7/d8/d5f/d70/d8a/f92 [0,4194304] 0 2024-04-25T22:03:20.386 INFO:tasks.workunit.client.0.smithi044.stdout:2/481: stat d7/d7b/d81/l51 0 2024-04-25T22:03:20.386 INFO:tasks.workunit.client.0.smithi044.stdout:8/612: truncate d2a/d39/f55 1490136 0 2024-04-25T22:03:20.388 INFO:tasks.workunit.client.0.smithi044.stdout:9/582: dread d4/d7/d18/d3a/f46 [0,4194304] 0 2024-04-25T22:03:20.390 INFO:tasks.workunit.client.0.smithi044.stdout:0/443: write d8/f9 [104959,21748] 0 2024-04-25T22:03:20.390 INFO:tasks.workunit.client.0.smithi044.stdout:3/458: read d0/d1/d15/f86 [1085582,32063] 0 2024-04-25T22:03:20.391 INFO:tasks.workunit.client.0.smithi044.stdout:9/583: write d4/d7/d18/d2e/d73/f7c [559407,64520] 0 2024-04-25T22:03:20.392 INFO:tasks.workunit.client.0.smithi044.stdout:9/584: dread - d4/d37/d54/d84/d72/f95 zero size 2024-04-25T22:03:20.393 INFO:tasks.workunit.client.0.smithi044.stdout:4/437: dread dd/ff [0,4194304] 0 2024-04-25T22:03:20.394 INFO:tasks.workunit.client.0.smithi044.stdout:2/482: dwrite d7/d16/d2c/f85 [0,4194304] 0 2024-04-25T22:03:20.395 INFO:tasks.workunit.client.0.smithi044.stdout:2/483: dread - d7/d8/f62 zero size 2024-04-25T22:03:20.397 INFO:tasks.workunit.client.0.smithi044.stdout:2/484: rmdir d7/d8/d1c/d77 39 2024-04-25T22:03:20.398 INFO:tasks.workunit.client.0.smithi044.stdout:2/485: symlink d7/d8/d5f/l9c 0 2024-04-25T22:03:20.399 INFO:tasks.workunit.client.0.smithi044.stdout:3/459: dwrite d0/d13/f37 [0,4194304] 0 2024-04-25T22:03:20.399 INFO:tasks.workunit.client.0.smithi044.stdout:9/585: dread d4/d7/d18/d3a/d8b/f90 [0,4194304] 0 2024-04-25T22:03:20.400 INFO:tasks.workunit.client.0.smithi044.stdout:2/486: write d7/d7b/d81/d4e/d86/d6b/d78/f5a [7067650,86807] 0 2024-04-25T22:03:20.400 INFO:tasks.workunit.client.0.smithi044.stdout:9/586: fdatasync d4/d37/d54/d84/d64/f82 0 2024-04-25T22:03:20.401 INFO:tasks.workunit.client.0.smithi044.stdout:9/587: mknod d4/d3d/cc7 0 2024-04-25T22:03:20.401 INFO:tasks.workunit.client.0.smithi044.stdout:2/487: mknod d7/d7b/d81/d57/c9d 0 2024-04-25T22:03:20.403 INFO:tasks.workunit.client.0.smithi044.stdout:2/488: write d7/d7b/d81/d4e/d86/d6b/d78/f5a [7566234,73735] 0 2024-04-25T22:03:20.408 INFO:tasks.workunit.client.0.smithi044.stdout:1/472: dread d3/d7/d81/f8a [0,4194304] 0 2024-04-25T22:03:20.410 INFO:tasks.workunit.client.0.smithi044.stdout:2/489: dwrite d7/d7b/d81/d4e/d86/f34 [4194304,4194304] 0 2024-04-25T22:03:20.410 INFO:tasks.workunit.client.0.smithi044.stdout:1/473: truncate d3/d7/db/d8f/f91 901319 0 2024-04-25T22:03:20.410 INFO:tasks.workunit.client.0.smithi044.stdout:9/588: dwrite d4/d37/d54/d84/d64/f96 [0,4194304] 0 2024-04-25T22:03:20.410 INFO:tasks.workunit.client.0.smithi044.stdout:1/474: chown d3/d7/db/d8f/f91 55905 1 2024-04-25T22:03:20.411 INFO:tasks.workunit.client.0.smithi044.stdout:2/490: mknod d7/d8/d5f/d70/d8a/c9e 0 2024-04-25T22:03:20.411 INFO:tasks.workunit.client.0.smithi044.stdout:9/589: creat d4/fc8 x:0 0 0 2024-04-25T22:03:20.412 INFO:tasks.workunit.client.0.smithi044.stdout:2/491: creat d7/d16/d2c/d75/f9f x:0 0 0 2024-04-25T22:03:20.412 INFO:tasks.workunit.client.0.smithi044.stdout:4/438: dread dd/d19/f1d [0,4194304] 0 2024-04-25T22:03:20.413 INFO:tasks.workunit.client.0.smithi044.stdout:1/475: link d3/d7/d29/d43/d85/c66 d3/d7/d29/d43/c98 0 2024-04-25T22:03:20.413 INFO:tasks.workunit.client.0.smithi044.stdout:2/492: readlink d7/d7b/d81/d57/l7c 0 2024-04-25T22:03:20.413 INFO:tasks.workunit.client.0.smithi044.stdout:4/439: chown dd/d19/l22 3 1 2024-04-25T22:03:20.414 INFO:tasks.workunit.client.0.smithi044.stdout:2/493: read d7/d8/f3e [1882256,93001] 0 2024-04-25T22:03:20.414 INFO:tasks.workunit.client.0.smithi044.stdout:4/440: creat dd/d19/d72/d88/f8f x:0 0 0 2024-04-25T22:03:20.415 INFO:tasks.workunit.client.0.smithi044.stdout:1/476: rename d3/d53 to d3/d7/db/d5d/d7f/d97/d99 0 2024-04-25T22:03:20.416 INFO:tasks.workunit.client.0.smithi044.stdout:4/441: write dd/d35/f5f [410542,105087] 0 2024-04-25T22:03:20.416 INFO:tasks.workunit.client.0.smithi044.stdout:1/477: creat d3/d7/db/f9a x:0 0 0 2024-04-25T22:03:20.417 INFO:tasks.workunit.client.0.smithi044.stdout:2/494: link d7/d7b/d81/d4e/c99 d7/d16/ca0 0 2024-04-25T22:03:20.418 INFO:teuthology.orchestra.run.smithi044.stdout:moved 0 / 210 (0%) 2024-04-25T22:03:20.418 INFO:teuthology.orchestra.run.smithi044.stdout:avg 70 2024-04-25T22:03:20.418 INFO:teuthology.orchestra.run.smithi044.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-04-25T22:03:20.418 INFO:teuthology.orchestra.run.smithi044.stdout:min osd.2 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-04-25T22:03:20.418 INFO:teuthology.orchestra.run.smithi044.stdout:max osd.1 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-04-25T22:03:20.418 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:03:20.418 INFO:teuthology.orchestra.run.smithi044.stdout:oload 1000 2024-04-25T22:03:20.418 INFO:teuthology.orchestra.run.smithi044.stdout:max_change 0.05 2024-04-25T22:03:20.418 INFO:teuthology.orchestra.run.smithi044.stdout:max_change_osds 4 2024-04-25T22:03:20.418 INFO:teuthology.orchestra.run.smithi044.stdout:average_utilization 0.0010 2024-04-25T22:03:20.418 INFO:teuthology.orchestra.run.smithi044.stdout:overload_utilization 0.0104 2024-04-25T22:03:20.419 INFO:teuthology.orchestra.run.smithi044.stderr:no change 2024-04-25T22:03:20.419 INFO:tasks.workunit.client.0.smithi044.stdout:9/590: dread d4/d37/d54/d84/d64/f96 [0,4194304] 0 2024-04-25T22:03:20.419 INFO:tasks.workunit.client.0.smithi044.stdout:2/495: creat d7/d8/d48/fa1 x:0 0 0 2024-04-25T22:03:20.422 INFO:tasks.workunit.client.0.smithi044.stdout:2/496: rename d7/d7b/d81/d4e/f37 to d7/d7b/d81/d4e/d86/d6b/fa2 0 2024-04-25T22:03:20.423 INFO:tasks.workunit.client.0.smithi044.stdout:4/442: dwrite dd/d35/d52/f6a [0,4194304] 0 2024-04-25T22:03:20.425 INFO:tasks.workunit.client.0.smithi044.stdout:6/550: dread d2/d23/d5a/d12/d49/fad [0,4194304] 0 2024-04-25T22:03:20.426 INFO:tasks.workunit.client.0.smithi044.stdout:6/551: stat d2/d23/d5a/d11/f39 0 2024-04-25T22:03:20.427 INFO:tasks.workunit.client.0.smithi044.stdout:6/552: chown d2/f3a 416777 1 2024-04-25T22:03:20.428 INFO:tasks.workunit.client.0.smithi044.stdout:9/591: dwrite d4/d7/d18/d3a/d8b/f90 [0,4194304] 0 2024-04-25T22:03:20.430 INFO:tasks.workunit.client.0.smithi044.stdout:6/553: creat d2/d23/d5a/d13/d4b/d5e/d9c/fbb x:0 0 0 2024-04-25T22:03:20.432 INFO:tasks.workunit.client.0.smithi044.stdout:4/443: dwrite dd/d35/f5f [0,4194304] 0 2024-04-25T22:03:20.433 INFO:tasks.workunit.client.0.smithi044.stdout:1/478: dwrite d3/f49 [0,4194304] 0 2024-04-25T22:03:20.433 INFO:tasks.workunit.client.0.smithi044.stdout:2/497: dread d7/d16/d2c/f61 [0,4194304] 0 2024-04-25T22:03:20.434 INFO:tasks.workunit.client.0.smithi044.stdout:9/592: rename d4/d3d/da5/la8 to d4/lc9 0 2024-04-25T22:03:20.435 INFO:tasks.workunit.client.0.smithi044.stdout:4/444: creat dd/d35/d52/f90 x:0 0 0 2024-04-25T22:03:20.436 INFO:tasks.workunit.client.0.smithi044.stdout:1/479: creat d3/d72/f9b x:0 0 0 2024-04-25T22:03:20.436 INFO:tasks.workunit.client.0.smithi044.stdout:9/593: write d4/f57 [2558251,116638] 0 2024-04-25T22:03:20.437 INFO:tasks.workunit.client.0.smithi044.stdout:4/445: dread - dd/f89 zero size 2024-04-25T22:03:20.437 INFO:tasks.workunit.client.0.smithi044.stdout:0/444: dread f3 [0,4194304] 0 2024-04-25T22:03:20.438 INFO:tasks.workunit.client.0.smithi044.stdout:9/594: mkdir d4/d7/d18/d3a/dca 0 2024-04-25T22:03:20.438 INFO:tasks.workunit.client.0.smithi044.stdout:1/480: fsync d3/d7/f2a 0 2024-04-25T22:03:20.439 INFO:tasks.workunit.client.0.smithi044.stdout:6/554: truncate d2/d23/d30/f3e 385994 0 2024-04-25T22:03:20.439 INFO:tasks.workunit.client.0.smithi044.stdout:0/445: write d8/df/d17/d45/f50 [4403358,62209] 0 2024-04-25T22:03:20.439 INFO:tasks.workunit.client.0.smithi044.stdout:1/481: fsync d3/d7/d29/d43/d85/f95 0 2024-04-25T22:03:20.440 INFO:tasks.workunit.client.0.smithi044.stdout:2/498: dread f0 [0,4194304] 0 2024-04-25T22:03:20.441 INFO:tasks.workunit.client.0.smithi044.stdout:4/446: mkdir dd/d19/d91 0 2024-04-25T22:03:20.441 INFO:tasks.workunit.client.0.smithi044.stdout:9/595: rename d4/d37/f7b to d4/d7/d18/d2d/d70/fcb 0 2024-04-25T22:03:20.441 INFO:tasks.workunit.client.0.smithi044.stdout:0/446: mknod d8/da/c8c 0 2024-04-25T22:03:20.441 INFO:tasks.workunit.client.0.smithi044.stdout:2/499: write d7/d16/d2c/d75/f9f [659677,28875] 0 2024-04-25T22:03:20.442 INFO:tasks.workunit.client.0.smithi044.stdout:5/459: dread d2/d5/d21/d38/f53 [0,4194304] 0 2024-04-25T22:03:20.443 INFO:tasks.workunit.client.0.smithi044.stdout:0/447: write d8/df/d17/d45/d4f/f56 [537735,64858] 0 2024-04-25T22:03:20.443 INFO:tasks.workunit.client.0.smithi044.stdout:1/482: chown d3/d7/db/l63 43852630 1 2024-04-25T22:03:20.443 INFO:tasks.workunit.client.0.smithi044.stdout:9/596: link d4/d7/d18/d2e/d94/fbd d4/d3d/fcc 0 2024-04-25T22:03:20.443 INFO:tasks.workunit.client.0.smithi044.stdout:2/500: mknod d7/d5b/ca3 0 2024-04-25T22:03:20.444 INFO:tasks.workunit.client.0.smithi044.stdout:0/448: creat d8/da/d55/f8d x:0 0 0 2024-04-25T22:03:20.444 INFO:tasks.workunit.client.0.smithi044.stdout:1/483: write d3/f49 [1947579,100892] 0 2024-04-25T22:03:20.445 INFO:tasks.workunit.client.0.smithi044.stdout:2/501: unlink d7/d16/l3c 0 2024-04-25T22:03:20.445 INFO:tasks.workunit.client.0.smithi044.stdout:5/460: creat d2/d5/d21/d26/d2c/f97 x:0 0 0 2024-04-25T22:03:20.445 INFO:tasks.workunit.client.0.smithi044.stdout:9/597: creat d4/d4b/d86/fcd x:0 0 0 2024-04-25T22:03:20.446 INFO:tasks.workunit.client.0.smithi044.stdout:0/449: write d8/da/d60/f73 [665096,10380] 0 2024-04-25T22:03:20.452 INFO:tasks.workunit.client.0.smithi044.stdout:5/461: mknod d2/d5/d27/d2a/d3a/c98 0 2024-04-25T22:03:20.452 INFO:tasks.workunit.client.0.smithi044.stdout:9/598: mkdir d4/d3d/d66/db9/dbe/dce 0 2024-04-25T22:03:20.452 INFO:tasks.workunit.client.0.smithi044.stdout:2/502: fdatasync d7/d7b/d81/d4e/f8c 0 2024-04-25T22:03:20.452 INFO:tasks.workunit.client.0.smithi044.stdout:6/555: dwrite d2/d23/d5a/d12/f48 [0,4194304] 0 2024-04-25T22:03:20.452 INFO:tasks.workunit.client.0.smithi044.stdout:5/462: symlink d2/d5b/l99 0 2024-04-25T22:03:20.452 INFO:tasks.workunit.client.0.smithi044.stdout:2/503: creat d7/d8/d5f/fa4 x:0 0 0 2024-04-25T22:03:20.452 INFO:tasks.workunit.client.0.smithi044.stdout:9/599: dread - d4/d7/d18/d2e/d73/fb8 zero size 2024-04-25T22:03:20.452 INFO:tasks.workunit.client.0.smithi044.stdout:0/450: read f6 [172474,73597] 0 2024-04-25T22:03:20.452 INFO:tasks.workunit.client.0.smithi044.stdout:6/556: unlink d2/d23/d5a/d13/d4b/d5e/d9c/fbb 0 2024-04-25T22:03:20.452 INFO:tasks.workunit.client.0.smithi044.stdout:9/600: chown d4/fc8 65 1 2024-04-25T22:03:20.453 INFO:tasks.workunit.client.0.smithi044.stdout:5/463: write d2/d5/d27/d2a/d3a/f77 [831041,95151] 0 2024-04-25T22:03:20.453 INFO:tasks.workunit.client.0.smithi044.stdout:5/464: rename d2/d5/d21/d26/l46 to d2/d5/d21/l9a 0 2024-04-25T22:03:20.453 INFO:tasks.workunit.client.0.smithi044.stdout:0/451: truncate d8/df/d17/d45/f63 798289 0 2024-04-25T22:03:20.453 INFO:tasks.workunit.client.0.smithi044.stdout:6/557: creat d2/d23/d5a/d12/d27/daf/fbc x:0 0 0 2024-04-25T22:03:20.454 INFO:tasks.workunit.client.0.smithi044.stdout:5/465: chown d2/d5/d27 28194 1 2024-04-25T22:03:20.454 INFO:tasks.workunit.client.0.smithi044.stdout:1/484: dread d3/d7/db/f46 [0,4194304] 0 2024-04-25T22:03:20.454 INFO:tasks.workunit.client.0.smithi044.stdout:2/504: creat d7/d7b/d81/d4e/d86/fa5 x:0 0 0 2024-04-25T22:03:20.454 INFO:tasks.workunit.client.0.smithi044.stdout:6/558: symlink d2/d23/d5a/d12/d1f/d94/lbd 0 2024-04-25T22:03:20.455 INFO:tasks.workunit.client.0.smithi044.stdout:1/485: fdatasync d3/d30/d3f/f86 0 2024-04-25T22:03:20.455 INFO:tasks.workunit.client.0.smithi044.stdout:2/505: stat d7/d7b/d81/d57 0 2024-04-25T22:03:20.455 INFO:tasks.workunit.client.0.smithi044.stdout:5/466: mkdir d2/d5/d21/d6b/d9b 0 2024-04-25T22:03:20.455 INFO:tasks.workunit.client.0.smithi044.stdout:6/559: write d2/d23/d5a/d11/f39 [68426,13554] 0 2024-04-25T22:03:20.455 INFO:tasks.workunit.client.0.smithi044.stdout:1/486: creat d3/d30/d3f/f9c x:0 0 0 2024-04-25T22:03:20.455 INFO:tasks.workunit.client.0.smithi044.stdout:3/460: dread d0/d13/d1c/f2b [0,4194304] 0 2024-04-25T22:03:20.455 INFO:tasks.workunit.client.0.smithi044.stdout:2/506: creat d7/d8/d1c/d77/fa6 x:0 0 0 2024-04-25T22:03:20.456 INFO:tasks.workunit.client.0.smithi044.stdout:6/560: fdatasync d2/d23/d30/f53 0 2024-04-25T22:03:20.456 INFO:tasks.workunit.client.0.smithi044.stdout:1/487: write d3/d59/d5c/f74 [1667,124671] 0 2024-04-25T22:03:20.456 INFO:tasks.workunit.client.0.smithi044.stdout:3/461: chown d0/d1/d15/d51/dd/f61 14 1 2024-04-25T22:03:20.456 INFO:tasks.workunit.client.0.smithi044.stdout:2/507: creat d7/d16/d2c/fa7 x:0 0 0 2024-04-25T22:03:20.456 INFO:tasks.workunit.client.0.smithi044.stdout:0/452: read d8/d15/f1f [930816,57534] 0 2024-04-25T22:03:20.457 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-04-25T22:03:20.457 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2024-04-25T22:03:20.458 INFO:tasks.workunit.client.0.smithi044.stdout:6/561: rename d2/d23/d30/f69 to d2/d23/d5a/d12/d49/fbe 0 2024-04-25T22:03:20.458 INFO:tasks.workunit.client.0.smithi044.stdout:3/462: creat d0/d1/d15/d51/d39/f8f x:0 0 0 2024-04-25T22:03:20.458 INFO:tasks.workunit.client.0.smithi044.stdout:0/453: mkdir d8/df/d17/d45/d4f/d8e 0 2024-04-25T22:03:20.458 INFO:tasks.workunit.client.0.smithi044.stdout:6/562: getdents d2 0 2024-04-25T22:03:20.459 INFO:tasks.workunit.client.0.smithi044.stdout:0/454: chown d8/df/d17/l34 29119755 1 2024-04-25T22:03:20.459 INFO:tasks.workunit.client.0.smithi044.stdout:3/463: creat d0/d1/d15/d51/d8e/d74/f90 x:0 0 0 2024-04-25T22:03:20.460 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:20.460 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:20.460 INFO:tasks.workunit.client.0.smithi044.stdout:0/455: write d8/d24/d7c/f82 [476905,52121] 0 2024-04-25T22:03:20.461 INFO:tasks.workunit.client.0.smithi044.stdout:0/456: truncate d8/d20/f6a 2529806 0 2024-04-25T22:03:20.461 INFO:tasks.workunit.client.0.smithi044.stdout:0/457: symlink d8/d15/d51/l8f 0 2024-04-25T22:03:20.462 INFO:tasks.workunit.client.0.smithi044.stdout:2/508: dwrite d7/d8/d5f/d70/d8a/f92 [0,4194304] 0 2024-04-25T22:03:20.463 INFO:tasks.workunit.client.0.smithi044.stdout:0/458: mkdir d8/d15/d51/d8b/d90 0 2024-04-25T22:03:20.464 INFO:tasks.workunit.client.0.smithi044.stdout:9/601: truncate d4/d7/d18/d2d/d70/fcb 40283 0 2024-04-25T22:03:20.465 INFO:tasks.workunit.client.0.smithi044.stdout:6/563: dwrite d2/d23/d5a/d11/d2a/f61 [0,4194304] 0 2024-04-25T22:03:20.467 INFO:tasks.workunit.client.0.smithi044.stdout:5/467: truncate d2/d5/f2f 4054918 0 2024-04-25T22:03:20.469 INFO:tasks.workunit.client.0.smithi044.stdout:3/464: write d0/f5c [4353126,106221] 0 2024-04-25T22:03:20.471 INFO:tasks.workunit.client.0.smithi044.stdout:6/564: rename d2/d23/d5a/d12/d49/d7f to d2/d23/d5a/d11/d2a/dbf 0 2024-04-25T22:03:20.471 INFO:tasks.workunit.client.0.smithi044.stdout:9/602: link d4/d4b/l91 d4/d3d/d66/db9/lcf 0 2024-04-25T22:03:20.471 INFO:tasks.workunit.client.0.smithi044.stdout:5/468: link d2/d5/d27/d2a/d5c/d5f/f73 d2/d5/d6a/f9c 0 2024-04-25T22:03:20.471 INFO:tasks.workunit.client.0.smithi044.stdout:9/603: stat d4/d4b/ca7 0 2024-04-25T22:03:20.471 INFO:tasks.workunit.client.0.smithi044.stdout:3/465: mkdir d0/d1/d15/d51/d39/d8d/d91 0 2024-04-25T22:03:20.472 INFO:tasks.workunit.client.0.smithi044.stdout:5/469: chown d2/d5/f1f 7216 1 2024-04-25T22:03:20.472 INFO:tasks.workunit.client.0.smithi044.stdout:9/604: symlink d4/d3d/da5/ld0 0 2024-04-25T22:03:20.472 INFO:tasks.workunit.client.0.smithi044.stdout:3/466: readlink d0/d1/d15/d51/l19 0 2024-04-25T22:03:20.472 INFO:tasks.workunit.client.0.smithi044.stdout:0/459: dwrite d8/f4d [0,4194304] 0 2024-04-25T22:03:20.473 INFO:tasks.workunit.client.0.smithi044.stdout:6/565: getdents d2/d23/d5a/d13/d68 0 2024-04-25T22:03:20.473 INFO:tasks.workunit.client.0.smithi044.stdout:5/470: creat d2/f9d x:0 0 0 2024-04-25T22:03:20.473 INFO:tasks.workunit.client.0.smithi044.stdout:0/460: creat d8/d15/d51/f91 x:0 0 0 2024-04-25T22:03:20.474 INFO:tasks.workunit.client.0.smithi044.stdout:6/566: creat d2/d23/d5a/d12/d70/fc0 x:0 0 0 2024-04-25T22:03:20.474 INFO:tasks.workunit.client.0.smithi044.stdout:3/467: rename d0/d1/d15/d51/d8e/d74/l7a to d0/d1/d15/d23/d60/l92 0 2024-04-25T22:03:20.474 INFO:tasks.workunit.client.0.smithi044.stdout:0/461: write d8/da/d55/f77 [417322,72208] 0 2024-04-25T22:03:20.474 INFO:tasks.workunit.client.0.smithi044.stdout:5/471: getdents d2/d5/d21/d95 0 2024-04-25T22:03:20.475 INFO:tasks.workunit.client.0.smithi044.stdout:3/468: mkdir d0/d13/d1c/d93 0 2024-04-25T22:03:20.475 INFO:tasks.workunit.client.0.smithi044.stdout:6/567: write d2/d23/d5a/d12/f19 [1610563,93764] 0 2024-04-25T22:03:20.475 INFO:tasks.workunit.client.0.smithi044.stdout:0/462: mknod d8/d24/d7c/c92 0 2024-04-25T22:03:20.476 INFO:tasks.workunit.client.0.smithi044.stdout:3/469: truncate d0/f82 397326 0 2024-04-25T22:03:20.477 INFO:tasks.workunit.client.0.smithi044.stdout:6/568: unlink d2/d23/d5a/d12/d27/c42 0 2024-04-25T22:03:20.478 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:20.472+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:20.478 INFO:tasks.workunit.client.0.smithi044.stdout:3/470: write d0/d1/d15/d51/d39/f8f [617315,29196] 0 2024-04-25T22:03:20.479 INFO:tasks.workunit.client.0.smithi044.stdout:6/569: write d2/d23/d5a/d12/d27/d8d/fa1 [4758947,96296] 0 2024-04-25T22:03:20.479 INFO:tasks.workunit.client.0.smithi044.stdout:3/471: mknod d0/d1/d15/d51/dd/d28/c94 0 2024-04-25T22:03:20.479 INFO:tasks.workunit.client.0.smithi044.stdout:9/605: dwrite d4/d7/d18/d3a/f46 [0,4194304] 0 2024-04-25T22:03:20.481 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:20.482 INFO:tasks.workunit.client.0.smithi044.stdout:5/472: dread d2/d5/d21/d26/d2c/f74 [0,4194304] 0 2024-04-25T22:03:20.482 INFO:tasks.workunit.client.0.smithi044.stdout:9/606: dread - d4/d3d/d66/db9/dbe/fc4 zero size 2024-04-25T22:03:20.483 INFO:tasks.workunit.client.0.smithi044.stdout:5/473: mkdir d2/d5/d6a/d92/d9e 0 2024-04-25T22:03:20.483 INFO:tasks.workunit.client.0.smithi044.stdout:6/570: creat d2/d23/d5a/d12/fc1 x:0 0 0 2024-04-25T22:03:20.485 INFO:tasks.workunit.client.0.smithi044.stdout:6/571: rename d2/d23/d5a/d12/d27/db1 to d2/d23/d5a/d13/d4b/dc2 0 2024-04-25T22:03:20.486 INFO:tasks.workunit.client.0.smithi044.stdout:3/472: dwrite d0/d1/d34/f58 [4194304,4194304] 0 2024-04-25T22:03:20.487 INFO:tasks.workunit.client.0.smithi044.stdout:3/473: chown d0/d1/l6a 48 1 2024-04-25T22:03:20.488 INFO:tasks.workunit.client.0.smithi044.stdout:3/474: getdents d0/d1/d15/d51/dd/d11/d8a 0 2024-04-25T22:03:20.489 INFO:tasks.workunit.client.0.smithi044.stdout:6/572: truncate d2/d23/d5a/d12/d1f/f20 2815028 0 2024-04-25T22:03:20.489 INFO:tasks.workunit.client.0.smithi044.stdout:3/475: chown d0/d1/d15/d51/d39/l66 27674 1 2024-04-25T22:03:20.490 INFO:tasks.workunit.client.0.smithi044.stdout:3/476: rmdir d0/d1/d15/d51/dd/d11/d43 39 2024-04-25T22:03:20.491 INFO:tasks.workunit.client.0.smithi044.stdout:3/477: mkdir d0/d1/d34/d95 0 2024-04-25T22:03:20.495 INFO:tasks.workunit.client.0.smithi044.stdout:6/573: dwrite d2/d23/d5a/d11/d3b/f71 [0,4194304] 0 2024-04-25T22:03:20.497 INFO:tasks.workunit.client.0.smithi044.stdout:3/478: dread d0/d1/d15/d51/dd/d11/f69 [0,4194304] 0 2024-04-25T22:03:20.497 INFO:tasks.workunit.client.0.smithi044.stdout:3/479: dread - d0/d70/f8c zero size 2024-04-25T22:03:20.499 INFO:tasks.workunit.client.0.smithi044.stdout:3/480: mknod d0/d1/d15/d51/dd/d11/d43/c96 0 2024-04-25T22:03:20.500 INFO:tasks.workunit.client.0.smithi044.stdout:3/481: symlink d0/d1/d15/d51/dd/d11/d8a/l97 0 2024-04-25T22:03:20.501 INFO:tasks.workunit.client.0.smithi044.stdout:3/482: creat d0/d2/f98 x:0 0 0 2024-04-25T22:03:20.501 INFO:tasks.workunit.client.0.smithi044.stdout:3/483: unlink d0/d70/f8c 0 2024-04-25T22:03:20.502 INFO:tasks.workunit.client.0.smithi044.stdout:3/484: chown d0/d1/d15/d51/l19 12411 1 2024-04-25T22:03:20.502 INFO:tasks.workunit.client.0.smithi044.stdout:3/485: dread - d0/d2/f67 zero size 2024-04-25T22:03:20.503 INFO:tasks.workunit.client.0.smithi044.stdout:3/486: rmdir d0/d70 39 2024-04-25T22:03:20.504 INFO:tasks.workunit.client.0.smithi044.stdout:3/487: symlink d0/d1/d34/l99 0 2024-04-25T22:03:20.504 INFO:tasks.workunit.client.0.smithi044.stdout:3/488: creat d0/d1/d15/d23/d60/f9a x:0 0 0 2024-04-25T22:03:20.505 INFO:tasks.workunit.client.0.smithi044.stdout:3/489: stat d0/d1/d15/d51/dd/d28/f5e 0 2024-04-25T22:03:20.510 INFO:tasks.workunit.client.0.smithi044.stdout:6/574: dread d2/d23/d30/f3e [0,4194304] 0 2024-04-25T22:03:20.510 INFO:tasks.workunit.client.0.smithi044.stdout:5/474: dwrite d2/d5/f1f [0,4194304] 0 2024-04-25T22:03:20.512 INFO:tasks.workunit.client.0.smithi044.stdout:4/447: dread dd/d19/d72/d79/d7f/d81/f5c [0,4194304] 0 2024-04-25T22:03:20.512 INFO:tasks.workunit.client.0.smithi044.stdout:3/490: dwrite d0/d2/f67 [0,4194304] 0 2024-04-25T22:03:20.513 INFO:tasks.workunit.client.0.smithi044.stdout:4/448: read dd/ff [2122185,94632] 0 2024-04-25T22:03:20.520 INFO:tasks.workunit.client.0.smithi044.stdout:9/607: dread d4/f7f [0,4194304] 0 2024-04-25T22:03:20.521 INFO:tasks.workunit.client.0.smithi044.stdout:6/575: dwrite d2/d23/d5a/d11/d2a/dbf/f97 [0,4194304] 0 2024-04-25T22:03:20.521 INFO:tasks.workunit.client.0.smithi044.stdout:5/475: truncate d2/d5/d21/f61 3240932 0 2024-04-25T22:03:20.522 INFO:tasks.workunit.client.0.smithi044.stdout:6/576: rename d2/d23 to d2/d23/d5a/d13/d68/dc3 22 2024-04-25T22:03:20.522 INFO:tasks.workunit.client.0.smithi044.stdout:5/476: chown d2/d5/d27/d2a/d5c/f67 7 1 2024-04-25T22:03:20.523 INFO:tasks.workunit.client.0.smithi044.stdout:9/608: link d4/d7/f8 d4/d3d/fd1 0 2024-04-25T22:03:20.524 INFO:tasks.workunit.client.0.smithi044.stdout:3/491: dwrite d0/d1/d15/d51/dd/f89 [0,4194304] 0 2024-04-25T22:03:20.524 INFO:tasks.workunit.client.0.smithi044.stdout:5/477: rename d2/d5 to d2/d5/d27/d2a/d5c/d5f/d9f 22 2024-04-25T22:03:20.524 INFO:tasks.workunit.client.0.smithi044.stdout:6/577: chown d2/d23/d5a/d12/d1f/d94/l9a 61416 1 2024-04-25T22:03:20.524 INFO:tasks.workunit.client.0.smithi044.stdout:3/492: unlink d0/d1/d15/f86 0 2024-04-25T22:03:20.524 INFO:tasks.workunit.client.0.smithi044.stdout:6/578: creat d2/d23/d30/fc4 x:0 0 0 2024-04-25T22:03:20.525 INFO:tasks.workunit.client.0.smithi044.stdout:9/609: mkdir d4/d3d/d58/dd2 0 2024-04-25T22:03:20.525 INFO:tasks.workunit.client.0.smithi044.stdout:5/478: rename d2/d5/d21/d38/d52/d56/l7e to d2/d5/d27/d2a/d3a/la0 0 2024-04-25T22:03:20.525 INFO:tasks.workunit.client.0.smithi044.stdout:3/493: creat d0/d1/d15/d23/d60/f9b x:0 0 0 2024-04-25T22:03:20.526 INFO:tasks.workunit.client.0.smithi044.stdout:9/610: mkdir d4/d7/d18/d3a/dca/dd3 0 2024-04-25T22:03:20.526 INFO:tasks.workunit.client.0.smithi044.stdout:5/479: read - d2/d5/d21/d38/d52/f6c zero size 2024-04-25T22:03:20.527 INFO:tasks.workunit.client.0.smithi044.stdout:3/494: creat d0/d1/d34/d95/f9c x:0 0 0 2024-04-25T22:03:20.527 INFO:tasks.workunit.client.0.smithi044.stdout:6/579: rename d2/d23/d5a/d11/d3b/f58 to d2/d23/d5a/d13/d4b/d5e/db5/fc5 0 2024-04-25T22:03:20.527 INFO:tasks.workunit.client.0.smithi044.stdout:5/480: symlink d2/d5/d27/d2a/la1 0 2024-04-25T22:03:20.527 INFO:tasks.workunit.client.0.smithi044.stdout:3/495: readlink d0/d1/d15/df/l3b 0 2024-04-25T22:03:20.528 INFO:tasks.workunit.client.0.smithi044.stdout:6/580: mkdir d2/d23/d5a/d11/d3b/dc6 0 2024-04-25T22:03:20.528 INFO:tasks.workunit.client.0.smithi044.stdout:5/481: rename d2/d5/d21/c4b to d2/d35/ca2 0 2024-04-25T22:03:20.529 INFO:tasks.workunit.client.0.smithi044.stdout:3/496: getdents d0/d1/d15/d51/d39 0 2024-04-25T22:03:20.529 INFO:tasks.workunit.client.0.smithi044.stdout:6/581: mknod d2/d23/d5a/d13/d4b/da7/cc7 0 2024-04-25T22:03:20.529 INFO:tasks.workunit.client.0.smithi044.stdout:5/482: chown d2/d5/d21/d38/d52/c75 28355 1 2024-04-25T22:03:20.530 INFO:tasks.workunit.client.0.smithi044.stdout:6/582: read d2/d23/d5a/d12/d49/f89 [1219291,29751] 0 2024-04-25T22:03:20.530 INFO:tasks.workunit.client.0.smithi044.stdout:3/497: rmdir d0/d1/d15/d51/dd/d11/d42 39 2024-04-25T22:03:20.530 INFO:tasks.workunit.client.0.smithi044.stdout:5/483: getdents d2/d5/d27/d2a/d70 0 2024-04-25T22:03:20.531 INFO:tasks.workunit.client.0.smithi044.stdout:3/498: chown d0/d1/d15/d51/dd/d28/f3f 76458512 1 2024-04-25T22:03:20.531 INFO:tasks.workunit.client.0.smithi044.stdout:0/463: dread d8/da/d55/f6d [0,4194304] 0 2024-04-25T22:03:20.531 INFO:tasks.workunit.client.0.smithi044.stdout:5/484: chown d2/d5/d6a 1293744 1 2024-04-25T22:03:20.532 INFO:tasks.workunit.client.0.smithi044.stdout:6/583: mkdir d2/d23/d5a/d12/d1f/d94/dc8 0 2024-04-25T22:03:20.532 INFO:tasks.workunit.client.0.smithi044.stdout:0/464: fdatasync f6 0 2024-04-25T22:03:20.532 INFO:tasks.workunit.client.0.smithi044.stdout:0/465: stat d8/f3b 0 2024-04-25T22:03:20.533 INFO:tasks.workunit.client.0.smithi044.stdout:3/499: creat d0/d1/d79/f9d x:0 0 0 2024-04-25T22:03:20.533 INFO:tasks.workunit.client.0.smithi044.stdout:5/485: rmdir d2/d5/d21/d26/d84 39 2024-04-25T22:03:20.533 INFO:tasks.workunit.client.0.smithi044.stdout:6/584: mknod d2/d23/d5a/d13/d4b/da7/cc9 0 2024-04-25T22:03:20.534 INFO:tasks.workunit.client.0.smithi044.stdout:3/500: rmdir d0/d1/d15/d51/dd/d35 39 2024-04-25T22:03:20.534 INFO:tasks.workunit.client.0.smithi044.stdout:7/382: sync 2024-04-25T22:03:20.535 INFO:tasks.workunit.client.0.smithi044.stdout:0/466: truncate d8/df/d17/f76 457529 0 2024-04-25T22:03:20.535 INFO:tasks.workunit.client.0.smithi044.stdout:5/486: rename d2/d5/d6a/f9c to d2/d5/d21/d26/fa3 0 2024-04-25T22:03:20.536 INFO:tasks.workunit.client.0.smithi044.stdout:0/467: mkdir d8/df/d93 0 2024-04-25T22:03:20.537 INFO:tasks.workunit.client.0.smithi044.stdout:5/487: read - d2/d5/d21/d38/d52/f6c zero size 2024-04-25T22:03:20.537 INFO:tasks.workunit.client.0.smithi044.stdout:9/611: dwrite d4/d7/d18/d2e/f3f [0,4194304] 0 2024-04-25T22:03:20.537 INFO:tasks.workunit.client.0.smithi044.stdout:5/488: read d2/d5/f1f [801514,12405] 0 2024-04-25T22:03:20.540 INFO:tasks.workunit.client.0.smithi044.stdout:9/612: chown d4/d37/d54/d84/d64/f82 1 1 2024-04-25T22:03:20.540 INFO:tasks.workunit.client.0.smithi044.stdout:5/489: fdatasync d2/d5/d21/d38/d52/f6c 0 2024-04-25T22:03:20.540 INFO:tasks.workunit.client.0.smithi044.stdout:0/468: mknod d8/d15/d51/d8b/d90/c94 0 2024-04-25T22:03:20.540 INFO:tasks.workunit.client.0.smithi044.stdout:6/585: dread d2/d23/d5a/d13/d68/d8e/fac [0,4194304] 0 2024-04-25T22:03:20.543 INFO:tasks.workunit.client.0.smithi044.stdout:0/469: getdents d8/df/d17/d87 0 2024-04-25T22:03:20.544 INFO:tasks.workunit.client.0.smithi044.stdout:6/586: symlink d2/d23/d5a/d11/lca 0 2024-04-25T22:03:20.546 INFO:tasks.workunit.client.0.smithi044.stdout:5/490: dread d2/d5/d21/f43 [0,4194304] 0 2024-04-25T22:03:20.546 INFO:tasks.workunit.client.0.smithi044.stdout:7/383: dwrite d1c/d22/d4a/f4f [0,4194304] 0 2024-04-25T22:03:20.547 INFO:tasks.workunit.client.0.smithi044.stdout:6/587: chown d2/d23/d5a/d13/d68/d8e/fa6 50664 1 2024-04-25T22:03:20.548 INFO:tasks.workunit.client.0.smithi044.stdout:3/501: dwrite d0/d1/d15/d51/d8e/d74/f90 [0,4194304] 0 2024-04-25T22:03:20.548 INFO:tasks.workunit.client.0.smithi044.stdout:5/491: creat d2/d5/d6a/fa4 x:0 0 0 2024-04-25T22:03:20.549 INFO:tasks.workunit.client.0.smithi044.stdout:3/502: unlink d0/d1/d34/l99 0 2024-04-25T22:03:20.549 INFO:tasks.workunit.client.0.smithi044.stdout:0/470: rename d8/d15 to d8/df/d17/d45/d95 0 2024-04-25T22:03:20.550 INFO:tasks.workunit.client.0.smithi044.stdout:5/492: chown d2/d5/d27/d2a/d3a/c98 172 1 2024-04-25T22:03:20.551 INFO:tasks.workunit.client.0.smithi044.stdout:9/613: dwrite d4/d7/d18/d2e/f3f [0,4194304] 0 2024-04-25T22:03:20.551 INFO:tasks.workunit.client.0.smithi044.stdout:3/503: mknod d0/d2/c9e 0 2024-04-25T22:03:20.551 INFO:tasks.workunit.client.0.smithi044.stdout:0/471: stat d8/df/d17/d45/d95/d51/d8b/d90 0 2024-04-25T22:03:20.552 INFO:tasks.workunit.client.0.smithi044.stdout:6/588: rename d2/d23/d5a/d13/d4b to d2/d23/d5a/d12/d27/daf/dcb 0 2024-04-25T22:03:20.552 INFO:tasks.workunit.client.0.smithi044.stdout:0/472: readlink d8/df/l2d 0 2024-04-25T22:03:20.553 INFO:tasks.workunit.client.0.smithi044.stdout:6/589: chown d2/d23/d5a/d12/d1f/l8a 235 1 2024-04-25T22:03:20.553 INFO:tasks.workunit.client.0.smithi044.stdout:9/614: mkdir d4/d7/d18/d3a/dca/dd3/dd4 0 2024-04-25T22:03:20.554 INFO:tasks.workunit.client.0.smithi044.stdout:3/504: write d0/d1/d15/d51/dd/d28/f3e [1258832,95425] 0 2024-04-25T22:03:20.555 INFO:tasks.workunit.client.0.smithi044.stdout:3/505: unlink d0/d1/d15/d51/dd/f89 0 2024-04-25T22:03:20.555 INFO:tasks.workunit.client.0.smithi044.stdout:4/449: dread dd/d19/d72/d79/d7f/d81/f64 [0,4194304] 0 2024-04-25T22:03:20.556 INFO:tasks.workunit.client.0.smithi044.stdout:4/450: fsync dd/d19/f49 0 2024-04-25T22:03:20.557 INFO:tasks.workunit.client.0.smithi044.stdout:9/615: link d4/d7/d18/d2e/d73/f7c d4/fd5 0 2024-04-25T22:03:20.557 INFO:tasks.workunit.client.0.smithi044.stdout:6/590: stat d2/d23/d5a/d12/d27/lab 0 2024-04-25T22:03:20.557 INFO:tasks.workunit.client.0.smithi044.stdout:3/506: read - d0/d1/d15/d23/d60/f9a zero size 2024-04-25T22:03:20.558 INFO:tasks.workunit.client.0.smithi044.stdout:3/507: read d0/d2/f67 [1409893,29040] 0 2024-04-25T22:03:20.558 INFO:tasks.workunit.client.0.smithi044.stdout:5/493: dwrite d2/f3c [0,4194304] 0 2024-04-25T22:03:20.558 INFO:tasks.workunit.client.0.smithi044.stdout:9/616: rename d4/d4b/cad to d4/d7/d18/d3a/cd6 0 2024-04-25T22:03:20.558 INFO:tasks.workunit.client.0.smithi044.stdout:6/591: truncate d2/d23/d30/f3e 358890 0 2024-04-25T22:03:20.559 INFO:tasks.workunit.client.0.smithi044.stdout:3/508: read d0/d1/d15/d51/dd/d11/f69 [180827,119301] 0 2024-04-25T22:03:20.559 INFO:tasks.workunit.client.0.smithi044.stdout:5/494: read - d2/d5/d21/d26/d2c/d37/f58 zero size 2024-04-25T22:03:20.560 INFO:tasks.workunit.client.0.smithi044.stdout:3/509: truncate d0/d1/d15/d81/f87 82631 0 2024-04-25T22:03:20.560 INFO:tasks.workunit.client.0.smithi044.stdout:6/592: creat d2/d23/d5a/d12/d27/daf/dcb/d5e/d9c/fcc x:0 0 0 2024-04-25T22:03:20.567 INFO:tasks.workunit.client.0.smithi044.stdout:5/495: dwrite d2/d5/d21/d38/f53 [4194304,4194304] 0 2024-04-25T22:03:20.567 INFO:tasks.workunit.client.0.smithi044.stdout:6/593: read d2/d23/d6a/f84 [83577,90909] 0 2024-04-25T22:03:20.567 INFO:tasks.workunit.client.0.smithi044.stdout:3/510: dwrite d0/d1/d34/f58 [0,4194304] 0 2024-04-25T22:03:20.568 INFO:tasks.workunit.client.0.smithi044.stdout:5/496: symlink d2/d5/d27/d2a/d5c/la5 0 2024-04-25T22:03:20.568 INFO:tasks.workunit.client.0.smithi044.stdout:5/497: stat d2/d5/d21/d26/d2c/f4c 0 2024-04-25T22:03:20.569 INFO:tasks.workunit.client.0.smithi044.stdout:5/498: chown d2/d5/d27/d2a/d5c/la5 1875 1 2024-04-25T22:03:20.570 INFO:tasks.workunit.client.0.smithi044.stdout:5/499: rmdir d2/d5/d21/d26/d2c/d37 39 2024-04-25T22:03:20.571 INFO:tasks.workunit.client.0.smithi044.stdout:5/500: getdents d2/d5 0 2024-04-25T22:03:20.572 INFO:tasks.workunit.client.0.smithi044.stdout:5/501: truncate d2/d5/d6a/f6e 798319 0 2024-04-25T22:03:20.573 INFO:tasks.workunit.client.0.smithi044.stdout:5/502: fsync d2/d35/f45 0 2024-04-25T22:03:20.573 INFO:tasks.workunit.client.0.smithi044.stdout:5/503: unlink d2/l8b 0 2024-04-25T22:03:20.574 INFO:tasks.workunit.client.0.smithi044.stdout:5/504: creat d2/d5/d27/d2a/d3a/fa6 x:0 0 0 2024-04-25T22:03:20.578 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:20.572+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:20.590 INFO:tasks.workunit.client.0.smithi044.stdout:6/594: dread d2/d23/d5a/d12/f19 [0,4194304] 0 2024-04-25T22:03:20.592 INFO:tasks.workunit.client.0.smithi044.stdout:0/473: dread d8/df/d17/f33 [0,4194304] 0 2024-04-25T22:03:20.593 INFO:tasks.workunit.client.0.smithi044.stdout:8/613: sync 2024-04-25T22:03:20.594 INFO:tasks.workunit.client.0.smithi044.stdout:8/614: mkdir d2a/d82/db6/dd2 0 2024-04-25T22:03:20.594 INFO:tasks.workunit.client.0.smithi044.stdout:8/615: write fa [1889176,64426] 0 2024-04-25T22:03:20.595 INFO:tasks.workunit.client.0.smithi044.stdout:8/616: truncate d2a/d32/d3e/f75 1390020 0 2024-04-25T22:03:20.596 INFO:tasks.workunit.client.0.smithi044.stdout:8/617: creat d2a/d39/d42/d68/d6b/d6e/fd3 x:0 0 0 2024-04-25T22:03:20.597 INFO:tasks.workunit.client.0.smithi044.stdout:8/618: creat d2a/d39/d42/d68/d6b/d6e/d84/fd4 x:0 0 0 2024-04-25T22:03:20.598 INFO:tasks.workunit.client.0.smithi044.stdout:8/619: chown d2a/d39/d42/d68/d6b/d6e/fd3 218 1 2024-04-25T22:03:20.598 INFO:tasks.workunit.client.0.smithi044.stdout:8/620: unlink d2a/d32/d57/fcb 0 2024-04-25T22:03:20.599 INFO:tasks.workunit.client.0.smithi044.stdout:8/621: chown f27 697 1 2024-04-25T22:03:20.599 INFO:tasks.workunit.client.0.smithi044.stdout:8/622: readlink d2a/l59 0 2024-04-25T22:03:20.599 INFO:tasks.workunit.client.0.smithi044.stdout:8/623: chown d2a/f2e 28035 1 2024-04-25T22:03:20.599 INFO:tasks.workunit.client.0.smithi044.stdout:8/624: unlink f0 0 2024-04-25T22:03:20.600 INFO:tasks.workunit.client.0.smithi044.stdout:8/625: mknod d2a/d32/d3e/dd0/cd5 0 2024-04-25T22:03:20.603 INFO:tasks.workunit.client.0.smithi044.stdout:8/626: write f25 [1008477,107768] 0 2024-04-25T22:03:20.604 INFO:tasks.workunit.client.0.smithi044.stdout:4/451: dread dd/f6f [0,4194304] 0 2024-04-25T22:03:20.604 INFO:tasks.workunit.client.0.smithi044.stdout:8/627: read - d2a/d39/d42/d68/d6b/f7c zero size 2024-04-25T22:03:20.604 INFO:tasks.workunit.client.0.smithi044.stdout:4/452: truncate dd/d35/f5e 508362 0 2024-04-25T22:03:20.605 INFO:tasks.workunit.client.0.smithi044.stdout:8/628: fdatasync d2a/d32/f34 0 2024-04-25T22:03:20.605 INFO:tasks.workunit.client.0.smithi044.stdout:4/453: creat dd/d35/f92 x:0 0 0 2024-04-25T22:03:20.605 INFO:tasks.workunit.client.0.smithi044.stdout:8/629: write d2a/d32/d57/d5e/f8a [365997,53005] 0 2024-04-25T22:03:20.609 INFO:tasks.workunit.client.0.smithi044.stdout:4/454: truncate dd/d35/d52/d61/f73 211061 0 2024-04-25T22:03:20.609 INFO:tasks.workunit.client.0.smithi044.stdout:8/630: truncate d2a/d52/f72 136249 0 2024-04-25T22:03:20.622 INFO:tasks.workunit.client.0.smithi044.stdout:6/595: dread d2/d23/d5a/f62 [0,4194304] 0 2024-04-25T22:03:20.623 INFO:tasks.workunit.client.0.smithi044.stdout:6/596: creat d2/d23/d6a/fcd x:0 0 0 2024-04-25T22:03:20.624 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:20.624 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:20.624 INFO:tasks.workunit.client.0.smithi044.stdout:6/597: truncate d2/d23/d5a/d12/d1f/fa4 914855 0 2024-04-25T22:03:20.626 INFO:tasks.workunit.client.0.smithi044.stdout:0/474: dread d8/df/d17/f83 [0,4194304] 0 2024-04-25T22:03:20.627 INFO:tasks.workunit.client.0.smithi044.stdout:0/475: mkdir d8/df/d17/d45/d96 0 2024-04-25T22:03:20.627 INFO:tasks.workunit.client.0.smithi044.stdout:0/476: fsync f3 0 2024-04-25T22:03:20.629 INFO:tasks.workunit.client.0.smithi044.stdout:0/477: creat d8/df/d17/d45/d95/d51/d8b/f97 x:0 0 0 2024-04-25T22:03:20.631 INFO:tasks.workunit.client.0.smithi044.stdout:6/598: dwrite d2/d23/d5a/d13/d68/f79 [8388608,4194304] 0 2024-04-25T22:03:20.635 INFO:tasks.workunit.client.0.smithi044.stdout:0/478: truncate d8/d24/f80 8281092 0 2024-04-25T22:03:20.637 INFO:tasks.workunit.client.0.smithi044.stdout:6/599: dwrite d2/d23/d5a/d13/d68/d8e/fa6 [0,4194304] 0 2024-04-25T22:03:20.637 INFO:tasks.workunit.client.0.smithi044.stdout:0/479: write d8/df/d17/d45/d95/d51/f91 [526943,21949] 0 2024-04-25T22:03:20.639 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:20.639 INFO:tasks.workunit.client.0.smithi044.stdout:0/480: symlink d8/df/d17/d87/l98 0 2024-04-25T22:03:20.640 INFO:tasks.workunit.client.0.smithi044.stdout:0/481: creat d8/d24/f99 x:0 0 0 2024-04-25T22:03:20.643 INFO:tasks.workunit.client.0.smithi044.stdout:8/631: dread f27 [0,4194304] 0 2024-04-25T22:03:20.644 INFO:tasks.workunit.client.0.smithi044.stdout:8/632: getdents d2a/d77 0 2024-04-25T22:03:20.645 INFO:tasks.workunit.client.0.smithi044.stdout:5/505: dread d2/f4 [4194304,4194304] 0 2024-04-25T22:03:20.647 INFO:tasks.workunit.client.0.smithi044.stdout:5/506: getdents d2/d5/d21 0 2024-04-25T22:03:20.649 INFO:tasks.workunit.client.0.smithi044.stdout:0/482: dread d8/da/d55/f5c [0,4194304] 0 2024-04-25T22:03:20.650 INFO:tasks.workunit.client.0.smithi044.stdout:0/483: chown d8/df/d17/d87 22056 1 2024-04-25T22:03:20.650 INFO:tasks.workunit.client.0.smithi044.stdout:0/484: chown f6 136 1 2024-04-25T22:03:20.654 INFO:tasks.workunit.client.0.smithi044.stdout:8/633: dread d2a/f31 [0,4194304] 0 2024-04-25T22:03:20.654 INFO:tasks.workunit.client.0.smithi044.stdout:0/485: write d8/df/d17/f33 [4961737,11273] 0 2024-04-25T22:03:20.654 INFO:tasks.workunit.client.0.smithi044.stdout:0/486: mknod d8/df/d17/d45/d4f/c9a 0 2024-04-25T22:03:20.654 INFO:tasks.workunit.client.0.smithi044.stdout:5/507: dwrite d2/d5/d27/d2a/d5c/f83 [0,4194304] 0 2024-04-25T22:03:20.654 INFO:tasks.workunit.client.0.smithi044.stdout:8/634: truncate d2a/d32/d57/d5e/f94 641547 0 2024-04-25T22:03:20.654 INFO:tasks.workunit.client.0.smithi044.stdout:0/487: fdatasync f1 0 2024-04-25T22:03:20.655 INFO:tasks.workunit.client.0.smithi044.stdout:5/508: mkdir d2/d5/d27/d2a/da7 0 2024-04-25T22:03:20.655 INFO:tasks.workunit.client.0.smithi044.stdout:8/635: dread d2a/f31 [0,4194304] 0 2024-04-25T22:03:20.655 INFO:tasks.workunit.client.0.smithi044.stdout:5/509: mkdir d2/d5b/da8 0 2024-04-25T22:03:20.656 INFO:tasks.workunit.client.0.smithi044.stdout:8/636: mkdir d2a/d52/dd6 0 2024-04-25T22:03:20.656 INFO:tasks.workunit.client.0.smithi044.stdout:5/510: truncate d2/d5/d21/f90 535625 0 2024-04-25T22:03:20.657 INFO:tasks.workunit.client.0.smithi044.stdout:8/637: symlink d2a/d39/d42/d68/d6b/d7b/ld7 0 2024-04-25T22:03:20.657 INFO:tasks.workunit.client.0.smithi044.stdout:5/511: mknod d2/ca9 0 2024-04-25T22:03:20.657 INFO:tasks.workunit.client.0.smithi044.stdout:8/638: chown d2a/f4e 25 1 2024-04-25T22:03:20.658 INFO:tasks.workunit.client.0.smithi044.stdout:8/639: mkdir d2a/d77/dd8 0 2024-04-25T22:03:20.658 INFO:tasks.workunit.client.0.smithi044.stdout:8/640: stat d2a/d39/d5a/d66/c73 0 2024-04-25T22:03:20.659 INFO:tasks.workunit.client.0.smithi044.stdout:5/512: getdents d2/d5/d27/d2a/d5c/d5f 0 2024-04-25T22:03:20.659 INFO:tasks.workunit.client.0.smithi044.stdout:8/641: write d2a/d77/f87 [966066,26404] 0 2024-04-25T22:03:20.659 INFO:tasks.workunit.client.0.smithi044.stdout:8/642: stat d2a/d39/d5a/d8e 0 2024-04-25T22:03:20.660 INFO:tasks.workunit.client.0.smithi044.stdout:5/513: link d2/d5/d27/f62 d2/d5/faa 0 2024-04-25T22:03:20.660 INFO:tasks.workunit.client.0.smithi044.stdout:8/643: creat d2a/d39/d42/d68/fd9 x:0 0 0 2024-04-25T22:03:20.663 INFO:tasks.workunit.client.0.smithi044.stdout:8/644: dread d2a/d32/d57/d5e/f94 [0,4194304] 0 2024-04-25T22:03:20.663 INFO:tasks.workunit.client.0.smithi044.stdout:0/488: dread d8/df/f40 [0,4194304] 0 2024-04-25T22:03:20.664 INFO:tasks.workunit.client.0.smithi044.stdout:8/645: stat d2a/d39/d42/d68/d6b/d7b 0 2024-04-25T22:03:20.664 INFO:tasks.workunit.client.0.smithi044.stdout:8/646: dread - d2a/fac zero size 2024-04-25T22:03:20.665 INFO:tasks.workunit.client.0.smithi044.stdout:8/647: creat d2a/d39/fda x:0 0 0 2024-04-25T22:03:20.666 INFO:tasks.workunit.client.0.smithi044.stdout:6/600: dread d2/d23/d5a/f1b [0,4194304] 0 2024-04-25T22:03:20.666 INFO:tasks.workunit.client.0.smithi044.stdout:5/514: dwrite d2/d5/d27/f81 [0,4194304] 0 2024-04-25T22:03:20.671 INFO:tasks.workunit.client.0.smithi044.stdout:0/489: dwrite d8/df/d17/d45/f50 [0,4194304] 0 2024-04-25T22:03:20.672 INFO:tasks.workunit.client.0.smithi044.stdout:0/490: dread - d8/d20/f6c zero size 2024-04-25T22:03:20.674 INFO:tasks.workunit.client.0.smithi044.stdout:8/648: dwrite d2a/d32/d57/d5e/f8a [0,4194304] 0 2024-04-25T22:03:20.675 INFO:tasks.workunit.client.0.smithi044.stdout:6/601: dwrite d2/d23/d5a/d11/f21 [4194304,4194304] 0 2024-04-25T22:03:20.676 INFO:tasks.workunit.client.0.smithi044.stdout:8/649: stat d2a/d39/d42/d68/f91 0 2024-04-25T22:03:20.677 INFO:tasks.workunit.client.0.smithi044.stdout:5/515: dwrite d2/d5/f88 [0,4194304] 0 2024-04-25T22:03:20.677 INFO:tasks.workunit.client.0.smithi044.stdout:8/650: write fa [1271081,8170] 0 2024-04-25T22:03:20.678 INFO:tasks.workunit.client.0.smithi044.stdout:6/602: write d2/d23/d30/f53 [2401282,107915] 0 2024-04-25T22:03:20.678 INFO:tasks.workunit.client.0.smithi044.stdout:8/651: dread - d2a/d32/d57/d5e/fb4 zero size 2024-04-25T22:03:20.678 INFO:tasks.workunit.client.0.smithi044.stdout:5/516: write d2/d5/d21/d38/f60 [4136814,75285] 0 2024-04-25T22:03:20.679 INFO:tasks.workunit.client.0.smithi044.stdout:8/652: write fd [4094999,113657] 0 2024-04-25T22:03:20.679 INFO:tasks.workunit.client.0.smithi044.stdout:8/653: symlink d2a/d32/d3e/ldb 0 2024-04-25T22:03:20.679 INFO:tasks.workunit.client.0.smithi044.stdout:5/517: mknod d2/d5/d21/d26/d84/cab 0 2024-04-25T22:03:20.680 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:20.672+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:20.680 INFO:tasks.workunit.client.0.smithi044.stdout:5/518: write d2/d5/d21/f49 [2088348,20595] 0 2024-04-25T22:03:20.681 INFO:tasks.workunit.client.0.smithi044.stdout:5/519: truncate d2/f3c 4527750 0 2024-04-25T22:03:20.681 INFO:tasks.workunit.client.0.smithi044.stdout:8/654: dread d2a/d32/d3e/f75 [0,4194304] 0 2024-04-25T22:03:20.682 INFO:tasks.workunit.client.0.smithi044.stdout:5/520: dread d2/d5/d21/f43 [0,4194304] 0 2024-04-25T22:03:20.682 INFO:tasks.workunit.client.0.smithi044.stdout:8/655: mkdir d2a/d32/d3e/dd0/ddc 0 2024-04-25T22:03:20.683 INFO:tasks.workunit.client.0.smithi044.stdout:8/656: truncate d2a/f4e 1387694 0 2024-04-25T22:03:20.683 INFO:tasks.workunit.client.0.smithi044.stdout:6/603: read d2/d23/d5a/d13/f5f [947855,97524] 0 2024-04-25T22:03:20.683 INFO:tasks.workunit.client.0.smithi044.stdout:8/657: symlink d2a/d52/dd6/ldd 0 2024-04-25T22:03:20.685 INFO:tasks.workunit.client.0.smithi044.stdout:6/604: unlink d2/d23/d5a/d12/d27/daf/dcb/d5e/d9c/ca2 0 2024-04-25T22:03:20.686 INFO:tasks.workunit.client.0.smithi044.stdout:6/605: chown d2/d23/d6a/d63 2039699634 1 2024-04-25T22:03:20.687 INFO:tasks.workunit.client.0.smithi044.stdout:6/606: fdatasync d2/d23/d5a/d12/d27/daf/dcb/d5e/d9c/fcc 0 2024-04-25T22:03:20.688 INFO:tasks.workunit.client.0.smithi044.stdout:5/521: dwrite d2/d5/d21/f90 [0,4194304] 0 2024-04-25T22:03:20.688 INFO:tasks.workunit.client.0.smithi044.stdout:6/607: fsync d2/d23/d5a/d11/d3b/f24 0 2024-04-25T22:03:20.690 INFO:tasks.workunit.client.0.smithi044.stdout:6/608: mkdir d2/d23/d5a/d12/dce 0 2024-04-25T22:03:20.690 INFO:tasks.workunit.client.0.smithi044.stdout:5/522: getdents d2/d5/d27/d2a 0 2024-04-25T22:03:20.690 INFO:tasks.workunit.client.0.smithi044.stdout:6/609: dread - d2/d23/d30/fc4 zero size 2024-04-25T22:03:20.690 INFO:tasks.workunit.client.0.smithi044.stdout:6/610: chown d2/d23/d30 5 1 2024-04-25T22:03:20.691 INFO:tasks.workunit.client.0.smithi044.stdout:5/523: creat d2/d5/d21/d38/d52/d56/fac x:0 0 0 2024-04-25T22:03:20.699 INFO:tasks.workunit.client.0.smithi044.stdout:5/524: dread d2/d5/d6a/f6e [0,4194304] 0 2024-04-25T22:03:20.699 INFO:tasks.workunit.client.0.smithi044.stdout:5/525: chown d2/d5/f2f 3774 1 2024-04-25T22:03:20.700 INFO:tasks.workunit.client.0.smithi044.stdout:5/526: getdents d2/d5/d27/d2a/d70 0 2024-04-25T22:03:20.703 INFO:tasks.workunit.client.0.smithi044.stdout:8/658: dread d2a/d32/d3e/f7a [0,4194304] 0 2024-04-25T22:03:20.703 INFO:tasks.workunit.client.0.smithi044.stdout:8/659: stat d2a/d52/cb8 0 2024-04-25T22:03:20.704 INFO:tasks.workunit.client.0.smithi044.stdout:8/660: creat d2a/d32/d57/d5e/fde x:0 0 0 2024-04-25T22:03:20.705 INFO:tasks.workunit.client.0.smithi044.stdout:8/661: symlink d2a/d39/d42/d68/ldf 0 2024-04-25T22:03:20.706 INFO:tasks.workunit.client.0.smithi044.stdout:8/662: truncate d2a/d39/f55 500222 0 2024-04-25T22:03:20.714 INFO:tasks.workunit.client.0.smithi044.stdout:6/611: dread d2/d23/d5a/d11/f16 [0,4194304] 0 2024-04-25T22:03:20.715 INFO:tasks.workunit.client.0.smithi044.stdout:6/612: unlink d2/d23/d5a/d12/d27/daf/dcb/d5e/c6c 0 2024-04-25T22:03:20.716 INFO:tasks.workunit.client.0.smithi044.stdout:6/613: symlink d2/d23/d5a/d11/d2a/lcf 0 2024-04-25T22:03:20.717 INFO:tasks.workunit.client.0.smithi044.stdout:6/614: unlink d2/d23/d5a/d12/d49/f89 0 2024-04-25T22:03:20.718 INFO:tasks.workunit.client.0.smithi044.stdout:6/615: unlink d2/d23/d5a/d12/d27/daf/dcb/c64 0 2024-04-25T22:03:20.719 INFO:tasks.workunit.client.0.smithi044.stdout:6/616: rename d2/d23/d5a/d12/d70/la3 to d2/d23/d5a/d12/d27/daf/dcb/ld0 0 2024-04-25T22:03:20.719 INFO:tasks.workunit.client.0.smithi044.stdout:6/617: chown d2/d23/d5a/d12/d27 1493633 1 2024-04-25T22:03:20.720 INFO:tasks.workunit.client.0.smithi044.stdout:6/618: creat d2/d23/d6a/fd1 x:0 0 0 2024-04-25T22:03:20.721 INFO:tasks.workunit.client.0.smithi044.stdout:6/619: symlink d2/d23/d30/ld2 0 2024-04-25T22:03:20.727 INFO:tasks.workunit.client.0.smithi044.stdout:6/620: fdatasync d2/d23/d5a/d13/d68/f79 0 2024-04-25T22:03:20.728 INFO:tasks.workunit.client.0.smithi044.stdout:6/621: creat d2/d23/d5a/d13/d68/fd3 x:0 0 0 2024-04-25T22:03:20.731 INFO:tasks.workunit.client.0.smithi044.stdout:6/622: dread d2/d23/d5a/f62 [0,4194304] 0 2024-04-25T22:03:20.733 INFO:tasks.workunit.client.0.smithi044.stdout:6/623: creat d2/d23/d5a/d12/d27/daf/dcb/d5e/d9c/fd4 x:0 0 0 2024-04-25T22:03:20.735 INFO:tasks.workunit.client.0.smithi044.stdout:8/663: dwrite f23 [0,4194304] 0 2024-04-25T22:03:20.738 INFO:tasks.workunit.client.0.smithi044.stdout:6/624: mkdir d2/d23/d5a/d12/d27/daf/dcb/d5e/db5/dd5 0 2024-04-25T22:03:20.742 INFO:tasks.workunit.client.0.smithi044.stdout:6/625: creat d2/d23/d5a/d12/d49/fd6 x:0 0 0 2024-04-25T22:03:20.742 INFO:tasks.workunit.client.0.smithi044.stdout:8/664: dwrite d2a/d32/f48 [0,4194304] 0 2024-04-25T22:03:20.742 INFO:tasks.workunit.client.0.smithi044.stdout:8/665: write f17 [1447226,59468] 0 2024-04-25T22:03:20.743 INFO:tasks.workunit.client.0.smithi044.stdout:6/626: mkdir d2/d23/d5a/d13/d68/d7b/dd7 0 2024-04-25T22:03:20.748 INFO:tasks.workunit.client.0.smithi044.stdout:8/666: dwrite d2a/d32/d57/d5e/f8a [0,4194304] 0 2024-04-25T22:03:20.749 INFO:tasks.workunit.client.0.smithi044.stdout:8/667: getdents d2a/d77/dd8 0 2024-04-25T22:03:20.752 INFO:tasks.workunit.client.0.smithi044.stdout:8/668: creat d2a/d32/fe0 x:0 0 0 2024-04-25T22:03:20.758 INFO:tasks.workunit.client.0.smithi044.stdout:8/669: dwrite d2a/d32/d57/d5e/fde [0,4194304] 0 2024-04-25T22:03:20.759 INFO:tasks.workunit.client.0.smithi044.stdout:8/670: rmdir d2a/d39/d42/d68/d6b/d7b 39 2024-04-25T22:03:20.759 INFO:tasks.workunit.client.0.smithi044.stdout:8/671: fsync d2a/d39/d42/f49 0 2024-04-25T22:03:20.761 INFO:tasks.workunit.client.0.smithi044.stdout:8/672: chown f2 950748521 1 2024-04-25T22:03:20.771 INFO:tasks.workunit.client.0.smithi044.stdout:6/627: dread d2/fd [0,4194304] 0 2024-04-25T22:03:20.772 INFO:tasks.workunit.client.0.smithi044.stdout:6/628: rmdir d2/d23/d5a/d12/d27/daf/dcb/d5e/db5/dd5 0 2024-04-25T22:03:20.778 INFO:tasks.workunit.client.0.smithi044.stdout:6/629: dwrite d2/d23/d5a/d12/d27/f31 [0,4194304] 0 2024-04-25T22:03:20.780 INFO:tasks.workunit.client.0.smithi044.stdout:6/630: symlink d2/d23/d5a/d13/d68/d7b/dd7/ld8 0 2024-04-25T22:03:20.780 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:20.772+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:20.780 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:20.780 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:20.785 INFO:tasks.workunit.client.0.smithi044.stdout:8/673: dread f2 [0,4194304] 0 2024-04-25T22:03:20.785 INFO:tasks.workunit.client.0.smithi044.stdout:8/674: stat f25 0 2024-04-25T22:03:20.788 INFO:tasks.workunit.client.0.smithi044.stdout:6/631: dread d2/d23/d5a/d11/d3b/f7e [0,4194304] 0 2024-04-25T22:03:20.789 INFO:tasks.workunit.client.0.smithi044.stdout:6/632: mkdir d2/d23/d6a/d63/dd9 0 2024-04-25T22:03:20.789 INFO:tasks.workunit.client.0.smithi044.stdout:8/675: write d2a/d32/f5d [3144025,112758] 0 2024-04-25T22:03:20.790 INFO:tasks.workunit.client.0.smithi044.stdout:6/633: rmdir d2/d23/d5a/d11/d2a/dbf 39 2024-04-25T22:03:20.790 INFO:tasks.workunit.client.0.smithi044.stdout:6/634: stat d2/d23/d30/fc4 0 2024-04-25T22:03:20.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:20.796 INFO:tasks.workunit.client.0.smithi044.stdout:6/635: dwrite d2/d23/d5a/d12/d27/daf/fbc [0,4194304] 0 2024-04-25T22:03:20.796 INFO:tasks.workunit.client.0.smithi044.stdout:8/676: dwrite d2a/d39/d42/d68/d6b/d6e/d84/fd4 [0,4194304] 0 2024-04-25T22:03:20.797 INFO:tasks.workunit.client.0.smithi044.stdout:8/677: rename d2a/d82/fa7 to d2a/d77/fe1 0 2024-04-25T22:03:20.798 INFO:tasks.workunit.client.0.smithi044.stdout:8/678: fsync d2a/d32/d57/d5e/f94 0 2024-04-25T22:03:20.800 INFO:tasks.workunit.client.0.smithi044.stdout:8/679: write f2 [2670235,114554] 0 2024-04-25T22:03:20.800 INFO:tasks.workunit.client.0.smithi044.stdout:8/680: write d2a/f36 [4074126,28242] 0 2024-04-25T22:03:20.801 INFO:tasks.workunit.client.0.smithi044.stdout:6/636: dread d2/d23/d5a/d13/d68/f72 [0,4194304] 0 2024-04-25T22:03:20.801 INFO:tasks.workunit.client.0.smithi044.stdout:8/681: stat d2a/d39/d42/lbd 0 2024-04-25T22:03:20.802 INFO:tasks.workunit.client.0.smithi044.stdout:6/637: fsync d2/d23/d5a/d11/d3b/f71 0 2024-04-25T22:03:20.802 INFO:tasks.workunit.client.0.smithi044.stdout:8/682: creat d2a/d52/fe2 x:0 0 0 2024-04-25T22:03:20.802 INFO:tasks.workunit.client.0.smithi044.stdout:8/683: mknod d2a/d32/ce3 0 2024-04-25T22:03:20.803 INFO:tasks.workunit.client.0.smithi044.stdout:8/684: symlink d2a/d39/d5a/d92/le4 0 2024-04-25T22:03:20.804 INFO:tasks.workunit.client.0.smithi044.stdout:8/685: truncate d2a/d39/d42/d68/f91 980267 0 2024-04-25T22:03:20.805 INFO:tasks.workunit.client.0.smithi044.stdout:8/686: write d2a/d32/d57/d5e/fbb [2683026,16823] 0 2024-04-25T22:03:20.805 INFO:tasks.workunit.client.0.smithi044.stdout:6/638: dread d2/d23/d5a/d11/f16 [4194304,4194304] 0 2024-04-25T22:03:20.806 INFO:tasks.workunit.client.0.smithi044.stdout:8/687: mkdir d2a/d52/dd6/de5 0 2024-04-25T22:03:20.806 INFO:tasks.workunit.client.0.smithi044.stdout:8/688: rename d2a/d52/cb7 to d2a/d32/ce6 0 2024-04-25T22:03:20.811 INFO:tasks.workunit.client.0.smithi044.stdout:6/639: dwrite d2/d23/d6a/f96 [4194304,4194304] 0 2024-04-25T22:03:20.812 INFO:tasks.workunit.client.0.smithi044.stdout:6/640: symlink d2/d23/d5a/d12/d27/daf/dcb/d5e/d9c/lda 0 2024-04-25T22:03:20.817 INFO:tasks.workunit.client.0.smithi044.stdout:6/641: dread d2/d23/d5a/d13/d68/f50 [0,4194304] 0 2024-04-25T22:03:20.817 INFO:tasks.workunit.client.0.smithi044.stdout:6/642: write d2/f75 [452614,69262] 0 2024-04-25T22:03:20.819 INFO:tasks.workunit.client.0.smithi044.stdout:8/689: dread d2a/f2e [0,4194304] 0 2024-04-25T22:03:20.820 INFO:tasks.workunit.client.0.smithi044.stdout:8/690: rename d2a/d39/lb9 to d2a/d82/le7 0 2024-04-25T22:03:20.822 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:03:20.822 INFO:tasks.workunit.client.0.smithi044.stdout:6/643: dread d2/d23/d5a/f1b [0,4194304] 0 2024-04-25T22:03:20.823 INFO:tasks.workunit.client.0.smithi044.stdout:6/644: chown d2/d23/d5a/d11/d2a/dbf/c9d 12 1 2024-04-25T22:03:20.824 INFO:tasks.workunit.client.0.smithi044.stdout:6/645: rmdir d2/d23/d5a/d12 39 2024-04-25T22:03:20.825 INFO:tasks.workunit.client.0.smithi044.stdout:6/646: unlink d2/d23/d6a/fd1 0 2024-04-25T22:03:20.826 INFO:tasks.workunit.client.0.smithi044.stdout:8/691: dwrite d2a/d52/fe2 [0,4194304] 0 2024-04-25T22:03:20.826 INFO:tasks.workunit.client.0.smithi044.stdout:6/647: fdatasync d2/d23/d5a/d12/d27/daf/dcb/f8c 0 2024-04-25T22:03:20.828 INFO:tasks.workunit.client.0.smithi044.stdout:8/692: mknod d2a/d39/d5a/d8e/ce8 0 2024-04-25T22:03:20.828 INFO:tasks.workunit.client.0.smithi044.stdout:6/648: creat d2/d23/d5a/d11/d2a/dbf/fdb x:0 0 0 2024-04-25T22:03:20.829 INFO:tasks.workunit.client.0.smithi044.stdout:8/693: dread - d2a/d39/d42/f78 zero size 2024-04-25T22:03:20.829 INFO:tasks.workunit.client.0.smithi044.stdout:6/649: write d2/d23/d5a/d11/f21 [38992,37329] 0 2024-04-25T22:03:20.830 INFO:tasks.workunit.client.0.smithi044.stdout:8/694: symlink d2a/d82/db6/dd2/le9 0 2024-04-25T22:03:20.830 INFO:tasks.workunit.client.0.smithi044.stdout:6/650: chown d2/d23/d5a/d12/d27/daf/dcb/d5e 0 1 2024-04-25T22:03:20.831 INFO:tasks.workunit.client.0.smithi044.stdout:8/695: stat c18 0 2024-04-25T22:03:20.831 INFO:tasks.workunit.client.0.smithi044.stdout:6/651: creat d2/d23/d5a/d12/d1f/d94/fdc x:0 0 0 2024-04-25T22:03:20.832 INFO:tasks.workunit.client.0.smithi044.stdout:8/696: symlink d2a/d39/d42/d80/lea 0 2024-04-25T22:03:20.832 INFO:tasks.workunit.client.0.smithi044.stdout:8/697: stat d2a/d39/d42/d68/d6b 0 2024-04-25T22:03:20.833 INFO:tasks.workunit.client.0.smithi044.stdout:8/698: dread - d2a/d39/d5a/d92/dab/fc3 zero size 2024-04-25T22:03:20.835 INFO:tasks.workunit.client.0.smithi044.stdout:8/699: getdents d2a/d39/d42/d68/d6b 0 2024-04-25T22:03:20.837 INFO:tasks.workunit.client.0.smithi044.stdout:6/652: dwrite d2/d23/d5a/d11/f39 [0,4194304] 0 2024-04-25T22:03:20.839 INFO:tasks.workunit.client.0.smithi044.stdout:6/653: creat d2/d23/fdd x:0 0 0 2024-04-25T22:03:20.840 INFO:tasks.workunit.client.0.smithi044.stdout:6/654: truncate d2/d23/d30/f53 5005272 0 2024-04-25T22:03:20.842 INFO:tasks.workunit.client.0.smithi044.stdout:8/700: dwrite d2a/d32/f61 [0,4194304] 0 2024-04-25T22:03:20.845 INFO:tasks.workunit.client.0.smithi044.stdout:2/509: sync 2024-04-25T22:03:20.845 INFO:tasks.workunit.client.0.smithi044.stdout:7/384: sync 2024-04-25T22:03:20.845 INFO:tasks.workunit.client.0.smithi044.stdout:3/511: sync 2024-04-25T22:03:20.845 INFO:tasks.workunit.client.0.smithi044.stdout:1/488: sync 2024-04-25T22:03:20.845 INFO:tasks.workunit.client.0.smithi044.stdout:9/617: sync 2024-04-25T22:03:20.845 INFO:tasks.workunit.client.0.smithi044.stdout:4/455: sync 2024-04-25T22:03:20.846 INFO:tasks.workunit.client.0.smithi044.stdout:8/701: getdents d2a/d52 0 2024-04-25T22:03:20.846 INFO:tasks.workunit.client.0.smithi044.stdout:3/512: write d0/d1/f7e [1559,9670] 0 2024-04-25T22:03:20.847 INFO:tasks.workunit.client.0.smithi044.stdout:1/489: symlink d3/d7/db/d8f/l9d 0 2024-04-25T22:03:20.847 INFO:tasks.workunit.client.0.smithi044.stdout:2/510: rename d7/c1f to d7/d7b/d81/d4e/d86/d6b/ca8 0 2024-04-25T22:03:20.848 INFO:tasks.workunit.client.0.smithi044.stdout:3/513: chown d0/d1/d15/d51/d8e/d74/f90 13 1 2024-04-25T22:03:20.848 INFO:tasks.workunit.client.0.smithi044.stdout:9/618: creat d4/d3d/d58/dd2/fd7 x:0 0 0 2024-04-25T22:03:20.849 INFO:tasks.workunit.client.0.smithi044.stdout:9/619: mkdir d4/d3d/da5/dd8 0 2024-04-25T22:03:20.849 INFO:tasks.workunit.client.0.smithi044.stdout:3/514: symlink d0/d1/d15/df/d5d/l9f 0 2024-04-25T22:03:20.853 INFO:tasks.workunit.client.0.smithi044.stdout:8/702: dwrite d2a/d52/fb3 [0,4194304] 0 2024-04-25T22:03:20.855 INFO:teuthology.orchestra.run.smithi044.stdout:moved 0 / 210 (0%) 2024-04-25T22:03:20.855 INFO:teuthology.orchestra.run.smithi044.stdout:avg 70 2024-04-25T22:03:20.855 INFO:teuthology.orchestra.run.smithi044.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-04-25T22:03:20.855 INFO:teuthology.orchestra.run.smithi044.stdout:min osd.2 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-04-25T22:03:20.855 INFO:teuthology.orchestra.run.smithi044.stdout:max osd.1 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-04-25T22:03:20.855 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:03:20.855 INFO:teuthology.orchestra.run.smithi044.stdout:oload 1000 2024-04-25T22:03:20.855 INFO:teuthology.orchestra.run.smithi044.stdout:max_change 0.05 2024-04-25T22:03:20.855 INFO:teuthology.orchestra.run.smithi044.stdout:max_change_osds 4 2024-04-25T22:03:20.855 INFO:teuthology.orchestra.run.smithi044.stdout:average_utilization 0.0010 2024-04-25T22:03:20.855 INFO:teuthology.orchestra.run.smithi044.stdout:overload_utilization 0.0104 2024-04-25T22:03:20.856 INFO:teuthology.orchestra.run.smithi044.stderr:no change 2024-04-25T22:03:20.856 INFO:tasks.workunit.client.0.smithi044.stdout:2/511: dwrite d7/d8/d48/fa1 [0,4194304] 0 2024-04-25T22:03:20.856 INFO:tasks.workunit.client.0.smithi044.stdout:8/703: chown d2a/d32/d3e/f44 91 1 2024-04-25T22:03:20.859 INFO:tasks.workunit.client.0.smithi044.stdout:8/704: fdatasync d2a/d32/d3e/f54 0 2024-04-25T22:03:20.859 INFO:tasks.workunit.client.0.smithi044.stdout:9/620: dwrite d4/d7/f63 [0,4194304] 0 2024-04-25T22:03:20.862 INFO:tasks.workunit.client.0.smithi044.stdout:3/515: dwrite d0/d1/d15/d51/dd/d28/f3e [0,4194304] 0 2024-04-25T22:03:20.863 INFO:tasks.workunit.client.0.smithi044.stdout:4/456: dwrite dd/f89 [0,4194304] 0 2024-04-25T22:03:20.864 INFO:tasks.workunit.client.0.smithi044.stdout:8/705: creat d2a/d39/d42/d80/feb x:0 0 0 2024-04-25T22:03:20.868 INFO:tasks.workunit.client.0.smithi044.stdout:9/621: dwrite d4/f57 [0,4194304] 0 2024-04-25T22:03:20.870 INFO:tasks.workunit.client.0.smithi044.stdout:9/622: unlink d4/f8c 0 2024-04-25T22:03:20.871 INFO:tasks.workunit.client.0.smithi044.stdout:9/623: creat d4/d37/fd9 x:0 0 0 2024-04-25T22:03:20.873 INFO:tasks.workunit.client.0.smithi044.stdout:3/516: dwrite d0/d13/d1c/f2b [0,4194304] 0 2024-04-25T22:03:20.878 INFO:tasks.workunit.client.0.smithi044.stdout:4/457: dwrite dd/f11 [0,4194304] 0 2024-04-25T22:03:20.879 INFO:tasks.workunit.client.0.smithi044.stdout:4/458: creat dd/d19/d72/f93 x:0 0 0 2024-04-25T22:03:20.880 INFO:tasks.workunit.client.0.smithi044.stdout:3/517: dread d0/d2/f67 [0,4194304] 0 2024-04-25T22:03:20.880 INFO:tasks.workunit.client.0.smithi044.stdout:4/459: read dd/d19/d72/d79/d7f/d81/f64 [1674071,104027] 0 2024-04-25T22:03:20.881 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:20.876+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:20.882 INFO:tasks.workunit.client.0.smithi044.stdout:4/460: getdents dd/d35 0 2024-04-25T22:03:20.882 INFO:tasks.workunit.client.0.smithi044.stdout:3/518: link d0/d1/d34/d48/f5f d0/d1/d79/fa0 0 2024-04-25T22:03:20.883 INFO:tasks.workunit.client.0.smithi044.stdout:9/624: dwrite d4/d7/f8 [0,4194304] 0 2024-04-25T22:03:20.884 INFO:tasks.workunit.client.0.smithi044.stdout:9/625: creat d4/d7/d18/d2e/db5/fda x:0 0 0 2024-04-25T22:03:20.884 INFO:tasks.workunit.client.0.smithi044.stdout:4/461: rename dd/d19/d72/d88/f8f to dd/d19/d72/d79/f94 0 2024-04-25T22:03:20.885 INFO:tasks.workunit.client.0.smithi044.stdout:9/626: read d4/d7/d18/d3a/f6c [88890,20670] 0 2024-04-25T22:03:20.885 INFO:tasks.workunit.client.0.smithi044.stdout:4/462: fdatasync dd/d19/d72/f93 0 2024-04-25T22:03:20.886 INFO:tasks.workunit.client.0.smithi044.stdout:4/463: write dd/d19/f1d [1591021,46252] 0 2024-04-25T22:03:20.887 INFO:tasks.workunit.client.0.smithi044.stdout:4/464: creat dd/d19/d91/f95 x:0 0 0 2024-04-25T22:03:20.890 INFO:tasks.workunit.client.0.smithi044.stdout:9/627: dread d4/d7/d18/d3a/f6c [0,4194304] 0 2024-04-25T22:03:20.891 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-04-25T22:03:20.891 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2024-04-25T22:03:20.892 INFO:tasks.workunit.client.0.smithi044.stdout:9/628: write d4/d7/d18/d2e/f5d [1825296,107678] 0 2024-04-25T22:03:20.892 INFO:tasks.workunit.client.0.smithi044.stdout:3/519: truncate d0/d2/f67 533546 0 2024-04-25T22:03:20.895 INFO:tasks.workunit.client.0.smithi044.stdout:3/520: mknod d0/d70/d7c/ca1 0 2024-04-25T22:03:20.895 INFO:tasks.workunit.client.0.smithi044.stdout:4/465: dwrite dd/d19/f32 [4194304,4194304] 0 2024-04-25T22:03:20.895 INFO:tasks.workunit.client.0.smithi044.stdout:9/629: getdents d4/d37/d54/d84 0 2024-04-25T22:03:20.895 INFO:tasks.workunit.client.0.smithi044.stdout:3/521: mknod d0/d70/d7c/ca2 0 2024-04-25T22:03:20.895 INFO:tasks.workunit.client.0.smithi044.stdout:4/466: symlink dd/d35/d52/d61/d76/l96 0 2024-04-25T22:03:20.896 INFO:tasks.workunit.client.0.smithi044.stdout:9/630: write d4/d37/d54/d84/d64/f82 [382968,21737] 0 2024-04-25T22:03:20.896 INFO:tasks.workunit.client.0.smithi044.stdout:3/522: rmdir d0/d70/d78 0 2024-04-25T22:03:20.897 INFO:tasks.workunit.client.0.smithi044.stdout:3/523: truncate d0/d1/d15/d51/dd/f4e 1807910 0 2024-04-25T22:03:20.897 INFO:tasks.workunit.client.0.smithi044.stdout:9/631: mkdir d4/d37/d54/d84/ddb 0 2024-04-25T22:03:20.898 INFO:tasks.workunit.client.0.smithi044.stdout:3/524: rmdir d0/d1/d34/d95 39 2024-04-25T22:03:20.898 INFO:tasks.workunit.client.0.smithi044.stdout:9/632: mkdir d4/d7/d79/ddc 0 2024-04-25T22:03:20.899 INFO:tasks.workunit.client.0.smithi044.stdout:9/633: mkdir d4/d3d/d66/ddd 0 2024-04-25T22:03:20.899 INFO:tasks.workunit.client.0.smithi044.stdout:3/525: creat d0/d2/fa3 x:0 0 0 2024-04-25T22:03:20.901 INFO:tasks.workunit.client.0.smithi044.stdout:9/634: truncate d4/d37/d54/d84/d72/f87 2205082 0 2024-04-25T22:03:20.902 INFO:tasks.workunit.client.0.smithi044.stdout:3/526: link d0/d1/d15/d51/dd/d28/l63 d0/d1/d15/d51/dd/d28/la4 0 2024-04-25T22:03:20.902 INFO:tasks.workunit.client.0.smithi044.stdout:4/467: dwrite dd/f4b [4194304,4194304] 0 2024-04-25T22:03:20.903 INFO:tasks.workunit.client.0.smithi044.stdout:3/527: rename d0/d1/d15/df/l77 to d0/d1/d15/d51/dd/d11/d43/d44/la5 0 2024-04-25T22:03:20.904 INFO:tasks.workunit.client.0.smithi044.stdout:3/528: rename d0/d1/d15/d51/d39 to d0/d13/d1c/d93/da6 0 2024-04-25T22:03:20.906 INFO:tasks.workunit.client.0.smithi044.stdout:3/529: rmdir d0/d1/d15/d51/dd/d11/d42/d76 0 2024-04-25T22:03:20.907 INFO:tasks.workunit.client.0.smithi044.stdout:3/530: getdents d0/d1/d15/d23/d60 0 2024-04-25T22:03:20.912 INFO:tasks.workunit.client.0.smithi044.stdout:8/706: dread d2a/d32/d57/d5e/fb0 [0,4194304] 0 2024-04-25T22:03:20.912 INFO:tasks.workunit.client.0.smithi044.stdout:8/707: mkdir d2a/d82/dec 0 2024-04-25T22:03:20.914 INFO:tasks.workunit.client.0.smithi044.stdout:3/531: dwrite d0/d1/d15/d51/dd/d11/d42/f4d [0,4194304] 0 2024-04-25T22:03:20.914 INFO:tasks.workunit.client.0.smithi044.stdout:8/708: dread d2a/f31 [0,4194304] 0 2024-04-25T22:03:20.915 INFO:tasks.workunit.client.0.smithi044.stdout:8/709: truncate f17 4271723 0 2024-04-25T22:03:20.915 INFO:tasks.workunit.client.0.smithi044.stdout:8/710: chown d2a/f4e 65217264 1 2024-04-25T22:03:20.916 INFO:tasks.workunit.client.0.smithi044.stdout:8/711: chown d2a/d39/d5a/c71 27340208 1 2024-04-25T22:03:20.917 INFO:tasks.workunit.client.0.smithi044.stdout:8/712: rename f27 to d2a/d32/d3e/fed 0 2024-04-25T22:03:20.918 INFO:tasks.workunit.client.0.smithi044.stdout:8/713: symlink d2a/d77/dd8/lee 0 2024-04-25T22:03:20.918 INFO:tasks.workunit.client.0.smithi044.stdout:8/714: symlink d2a/d32/lef 0 2024-04-25T22:03:20.923 INFO:tasks.workunit.client.0.smithi044.stdout:8/715: dread d2a/d32/f35 [0,4194304] 0 2024-04-25T22:03:20.924 INFO:tasks.workunit.client.0.smithi044.stdout:4/468: read dd/f4b [2936491,73959] 0 2024-04-25T22:03:20.925 INFO:tasks.workunit.client.0.smithi044.stdout:8/716: truncate d2a/d39/d42/d68/d6b/d7b/fa9 531632 0 2024-04-25T22:03:20.925 INFO:tasks.workunit.client.0.smithi044.stdout:4/469: creat dd/d19/d72/d79/d7f/f97 x:0 0 0 2024-04-25T22:03:20.926 INFO:tasks.workunit.client.0.smithi044.stdout:8/717: link f24 d2a/d82/dec/ff0 0 2024-04-25T22:03:20.926 INFO:tasks.workunit.client.0.smithi044.stdout:4/470: rename dd/d35/l44 to dd/d19/d72/l98 0 2024-04-25T22:03:20.926 INFO:tasks.workunit.client.0.smithi044.stdout:4/471: rmdir dd/d35/d52 39 2024-04-25T22:03:20.927 INFO:tasks.workunit.client.0.smithi044.stdout:8/718: rename d2a/d39/fca to d2a/d82/db6/ff1 0 2024-04-25T22:03:20.927 INFO:tasks.workunit.client.0.smithi044.stdout:4/472: rmdir dd/d19/d72/d79 39 2024-04-25T22:03:20.928 INFO:tasks.workunit.client.0.smithi044.stdout:8/719: stat d2a/d32/d57/d5e/c6f 0 2024-04-25T22:03:20.928 INFO:tasks.workunit.client.0.smithi044.stdout:4/473: creat dd/d35/d52/f99 x:0 0 0 2024-04-25T22:03:20.928 INFO:tasks.workunit.client.0.smithi044.stdout:8/720: dread - d2a/d39/d42/d68/fd9 zero size 2024-04-25T22:03:20.929 INFO:tasks.workunit.client.0.smithi044.stdout:8/721: creat d2a/ff2 x:0 0 0 2024-04-25T22:03:20.929 INFO:tasks.workunit.client.0.smithi044.stdout:4/474: write dd/d35/d52/f90 [658506,11088] 0 2024-04-25T22:03:20.929 INFO:tasks.workunit.client.0.smithi044.stdout:8/722: write f17 [4257042,51892] 0 2024-04-25T22:03:20.933 INFO:tasks.workunit.client.0.smithi044.stdout:8/723: dread d2a/d32/f48 [0,4194304] 0 2024-04-25T22:03:20.934 INFO:tasks.workunit.client.0.smithi044.stdout:8/724: chown d2a/d39/d5a/d8e 360 1 2024-04-25T22:03:20.934 INFO:tasks.workunit.client.0.smithi044.stdout:8/725: chown d2a/d39/d5a/d66/c73 425129 1 2024-04-25T22:03:20.936 INFO:tasks.workunit.client.0.smithi044.stdout:8/726: rename d2a/d39/d5a/d8e/cc9 to d2a/d32/d57/cf3 0 2024-04-25T22:03:20.936 INFO:tasks.workunit.client.0.smithi044.stdout:9/635: dread d4/d3d/f68 [0,4194304] 0 2024-04-25T22:03:20.936 INFO:tasks.workunit.client.0.smithi044.stdout:8/727: mknod d2a/d77/dd8/cf4 0 2024-04-25T22:03:20.937 INFO:tasks.workunit.client.0.smithi044.stdout:9/636: write d4/d7/d18/d3a/f46 [2621737,120482] 0 2024-04-25T22:03:20.937 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:20.937 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:20.938 INFO:tasks.workunit.client.0.smithi044.stdout:9/637: readlink d4/d7/l9 0 2024-04-25T22:03:20.938 INFO:tasks.workunit.client.0.smithi044.stdout:8/728: write d2a/d39/d42/d68/f91 [415891,127101] 0 2024-04-25T22:03:20.939 INFO:tasks.workunit.client.0.smithi044.stdout:9/638: read d4/d7/d18/d2e/d73/f7c [3246559,11691] 0 2024-04-25T22:03:20.939 INFO:tasks.workunit.client.0.smithi044.stdout:8/729: truncate d2a/d32/d3e/f7a 1772546 0 2024-04-25T22:03:20.940 INFO:tasks.workunit.client.0.smithi044.stdout:3/532: getdents d0/d1/d15/d51 0 2024-04-25T22:03:20.940 INFO:tasks.workunit.client.0.smithi044.stdout:8/730: write f17 [3156415,52787] 0 2024-04-25T22:03:20.941 INFO:tasks.workunit.client.0.smithi044.stdout:3/533: rmdir d0/d2 39 2024-04-25T22:03:20.942 INFO:tasks.workunit.client.0.smithi044.stdout:8/731: creat d2a/d39/d5a/d8e/ff5 x:0 0 0 2024-04-25T22:03:20.942 INFO:tasks.workunit.client.0.smithi044.stdout:3/534: stat d0/d1/d15/d81/f87 0 2024-04-25T22:03:20.944 INFO:tasks.workunit.client.0.smithi044.stdout:3/535: mknod d0/d1/d15/d51/ca7 0 2024-04-25T22:03:20.944 INFO:tasks.workunit.client.0.smithi044.stdout:8/732: creat d2a/d32/d57/d5e/ff6 x:0 0 0 2024-04-25T22:03:20.945 INFO:tasks.workunit.client.0.smithi044.stdout:4/475: dwrite dd/d35/d52/f60 [4194304,4194304] 0 2024-04-25T22:03:20.945 INFO:tasks.workunit.client.0.smithi044.stdout:3/536: link d0/d13/c57 d0/d1/d15/d51/d8e/d74/ca8 0 2024-04-25T22:03:20.947 INFO:tasks.workunit.client.0.smithi044.stdout:4/476: symlink dd/d19/d72/d88/l9a 0 2024-04-25T22:03:20.948 INFO:tasks.workunit.client.0.smithi044.stdout:4/477: write dd/d19/f3d [4673296,48663] 0 2024-04-25T22:03:20.950 INFO:tasks.workunit.client.0.smithi044.stdout:8/733: truncate d2a/d32/d3e/fed 120856 0 2024-04-25T22:03:20.951 INFO:tasks.workunit.client.0.smithi044.stdout:4/478: truncate dd/d19/d72/d79/d7f/d81/f77 1713424 0 2024-04-25T22:03:20.951 INFO:tasks.workunit.client.0.smithi044.stdout:8/734: creat d2a/d52/ff7 x:0 0 0 2024-04-25T22:03:20.952 INFO:tasks.workunit.client.0.smithi044.stdout:4/479: mknod dd/d19/c9b 0 2024-04-25T22:03:20.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:20.955 INFO:tasks.workunit.client.0.smithi044.stdout:8/735: link d2a/d82/db6/ff1 d2a/d39/d42/d68/d6b/d6e/d84/ff8 0 2024-04-25T22:03:20.955 INFO:tasks.workunit.client.0.smithi044.stdout:4/480: getdents dd/d19/d72 0 2024-04-25T22:03:20.955 INFO:tasks.workunit.client.0.smithi044.stdout:4/481: chown c9 0 1 2024-04-25T22:03:20.955 INFO:tasks.workunit.client.0.smithi044.stdout:3/537: dwrite d0/f38 [4194304,4194304] 0 2024-04-25T22:03:20.958 INFO:tasks.workunit.client.0.smithi044.stdout:4/482: mkdir dd/d19/d72/d79/d9c 0 2024-04-25T22:03:20.959 INFO:tasks.workunit.client.0.smithi044.stdout:3/538: rmdir d0/d2/d85 0 2024-04-25T22:03:20.959 INFO:tasks.workunit.client.0.smithi044.stdout:4/483: mkdir dd/d19/d72/d9d 0 2024-04-25T22:03:20.959 INFO:tasks.workunit.client.0.smithi044.stdout:5/527: sync 2024-04-25T22:03:20.959 INFO:tasks.workunit.client.0.smithi044.stdout:0/491: sync 2024-04-25T22:03:20.960 INFO:tasks.workunit.client.0.smithi044.stdout:5/528: stat d2/d5/d6a/d92/d9e 0 2024-04-25T22:03:20.960 INFO:tasks.workunit.client.0.smithi044.stdout:4/484: write fa [3136159,118894] 0 2024-04-25T22:03:20.960 INFO:tasks.workunit.client.0.smithi044.stdout:0/492: write d8/f2b [1342128,90492] 0 2024-04-25T22:03:20.961 INFO:tasks.workunit.client.0.smithi044.stdout:0/493: chown d8/c21 17444 1 2024-04-25T22:03:20.961 INFO:tasks.workunit.client.0.smithi044.stdout:5/529: mkdir d2/dad 0 2024-04-25T22:03:20.961 INFO:tasks.workunit.client.0.smithi044.stdout:8/736: dwrite d2a/d39/f97 [0,4194304] 0 2024-04-25T22:03:20.963 INFO:tasks.workunit.client.0.smithi044.stdout:5/530: read - d2/d5/d27/d2a/d48/f5a zero size 2024-04-25T22:03:20.963 INFO:tasks.workunit.client.0.smithi044.stdout:0/494: link d8/df/d17/d45/d95/f39 d8/df/d88/f9b 0 2024-04-25T22:03:20.964 INFO:tasks.workunit.client.0.smithi044.stdout:4/485: write dd/d19/f27 [2477519,71624] 0 2024-04-25T22:03:20.965 INFO:tasks.workunit.client.0.smithi044.stdout:0/495: write d8/df/d17/d45/f63 [1267629,43409] 0 2024-04-25T22:03:20.965 INFO:tasks.workunit.client.0.smithi044.stdout:9/639: dread d4/d7/d18/d3a/f46 [0,4194304] 0 2024-04-25T22:03:20.966 INFO:tasks.workunit.client.0.smithi044.stdout:4/486: creat dd/d35/d52/f9e x:0 0 0 2024-04-25T22:03:20.967 INFO:tasks.workunit.client.0.smithi044.stdout:4/487: mknod dd/d35/c9f 0 2024-04-25T22:03:20.967 INFO:tasks.workunit.client.0.smithi044.stdout:3/539: dwrite d0/d1/d79/f9d [0,4194304] 0 2024-04-25T22:03:20.968 INFO:tasks.workunit.client.0.smithi044.stdout:9/640: link d4/d7/d18/d2e/f5d d4/d7/d18/d3a/d8b/fde 0 2024-04-25T22:03:20.969 INFO:tasks.workunit.client.0.smithi044.stdout:3/540: mkdir d0/d70/d7c/da9 0 2024-04-25T22:03:20.969 INFO:tasks.workunit.client.0.smithi044.stdout:8/737: dread d2a/d32/f9b [0,4194304] 0 2024-04-25T22:03:20.969 INFO:tasks.workunit.client.0.smithi044.stdout:3/541: chown d0/d13/f7f 11855 1 2024-04-25T22:03:20.971 INFO:tasks.workunit.client.0.smithi044.stdout:4/488: mkdir dd/d19/d72/da0 0 2024-04-25T22:03:20.972 INFO:tasks.workunit.client.0.smithi044.stdout:3/542: creat d0/d1/faa x:0 0 0 2024-04-25T22:03:20.972 INFO:tasks.workunit.client.0.smithi044.stdout:9/641: rmdir d4/d37/d54/d84/d72/d97/dbc 0 2024-04-25T22:03:20.972 INFO:tasks.workunit.client.0.smithi044.stdout:8/738: getdents d2a/d32/d3e/dd0 0 2024-04-25T22:03:20.973 INFO:tasks.workunit.client.0.smithi044.stdout:9/642: chown d4/d7/d18/d2e 1 1 2024-04-25T22:03:20.973 INFO:tasks.workunit.client.0.smithi044.stdout:4/489: creat dd/d19/d72/d88/fa1 x:0 0 0 2024-04-25T22:03:20.973 INFO:tasks.workunit.client.0.smithi044.stdout:3/543: readlink d0/d1/d15/d51/dd/d35/l3d 0 2024-04-25T22:03:20.974 INFO:tasks.workunit.client.0.smithi044.stdout:9/643: readlink d4/d37/l67 0 2024-04-25T22:03:20.974 INFO:tasks.workunit.client.0.smithi044.stdout:0/496: dwrite d8/df/d17/d45/d95/d51/f84 [0,4194304] 0 2024-04-25T22:03:20.976 INFO:tasks.workunit.client.0.smithi044.stdout:9/644: write d4/d7/f8 [2918098,53100] 0 2024-04-25T22:03:20.976 INFO:tasks.workunit.client.0.smithi044.stdout:0/497: write f0 [2573972,127465] 0 2024-04-25T22:03:20.976 INFO:tasks.workunit.client.0.smithi044.stdout:3/544: mkdir d0/d1/d15/d51/dd/d35/dab 0 2024-04-25T22:03:20.976 INFO:tasks.workunit.client.0.smithi044.stdout:9/645: readlink d4/d7/l98 0 2024-04-25T22:03:20.977 INFO:tasks.workunit.client.0.smithi044.stdout:3/545: read d0/d1/d15/d51/dd/d28/f3f [801669,55994] 0 2024-04-25T22:03:20.978 INFO:tasks.workunit.client.0.smithi044.stdout:0/498: truncate d8/df/d17/d45/d4f/f56 1309421 0 2024-04-25T22:03:20.981 INFO:tasks.workunit.client.0.smithi044.stdout:0/499: mkdir d8/df/d17/d45/d95/d9c 0 2024-04-25T22:03:20.981 INFO:tasks.workunit.client.0.smithi044.stdout:8/739: dwrite d2a/d39/d42/d68/d6b/f4b [0,4194304] 0 2024-04-25T22:03:20.983 INFO:tasks.workunit.client.0.smithi044.stdout:8/740: mkdir d2a/d77/df9 0 2024-04-25T22:03:20.984 INFO:tasks.workunit.client.0.smithi044.stdout:4/490: dwrite dd/d35/d52/d61/f8e [0,4194304] 0 2024-04-25T22:03:20.986 INFO:tasks.workunit.client.0.smithi044.stdout:9/646: dwrite d4/d7/fa9 [0,4194304] 0 2024-04-25T22:03:20.986 INFO:tasks.workunit.client.0.smithi044.stdout:8/741: truncate d2a/d39/d5a/d92/dab/fa2 1536063 0 2024-04-25T22:03:20.987 INFO:tasks.workunit.client.0.smithi044.stdout:3/546: dwrite d0/d1/d15/d51/dd/d28/f3f [0,4194304] 0 2024-04-25T22:03:20.987 INFO:tasks.workunit.client.0.smithi044.stdout:4/491: creat dd/d19/d72/da0/fa2 x:0 0 0 2024-04-25T22:03:20.988 INFO:tasks.workunit.client.0.smithi044.stdout:9/647: symlink d4/d3d/d66/ldf 0 2024-04-25T22:03:20.988 INFO:tasks.workunit.client.0.smithi044.stdout:8/742: symlink d2a/d39/d5a/d92/dab/lfa 0 2024-04-25T22:03:20.990 INFO:tasks.workunit.client.0.smithi044.stdout:8/743: rename d2a/d39/d42/f49 to d2a/ffb 0 2024-04-25T22:03:20.990 INFO:tasks.workunit.client.0.smithi044.stdout:9/648: write d4/d4b/d86/f99 [692996,78428] 0 2024-04-25T22:03:20.991 INFO:tasks.workunit.client.0.smithi044.stdout:9/649: write d4/d7/d18/d2e/f3f [645353,33248] 0 2024-04-25T22:03:20.991 INFO:tasks.workunit.client.0.smithi044.stdout:8/744: write d2a/d32/d3e/f6a [584635,93971] 0 2024-04-25T22:03:20.995 INFO:tasks.workunit.client.0.smithi044.stdout:4/492: dwrite dd/d19/d72/d79/d7f/f84 [0,4194304] 0 2024-04-25T22:03:20.998 INFO:tasks.workunit.client.0.smithi044.stdout:8/745: link d2a/d39/d5a/d66/cc8 d2a/d77/df9/cfc 0 2024-04-25T22:03:20.998 INFO:tasks.workunit.client.0.smithi044.stdout:8/746: chown d2a/d39/d5a/d92 2804518 1 2024-04-25T22:03:21.000 INFO:tasks.workunit.client.0.smithi044.stdout:9/650: dwrite d4/d7/d18/d2e/f3f [0,4194304] 0 2024-04-25T22:03:21.002 INFO:tasks.workunit.client.0.smithi044.stdout:8/747: mkdir d2a/d77/dfd 0 2024-04-25T22:03:21.003 INFO:tasks.workunit.client.0.smithi044.stdout:4/493: dwrite dd/d19/f32 [4194304,4194304] 0 2024-04-25T22:03:21.004 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:21.000+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:21.007 INFO:tasks.workunit.client.0.smithi044.stdout:4/494: rename dd/d35/d52/d61/c74 to dd/d19/d91/ca3 0 2024-04-25T22:03:21.007 INFO:tasks.workunit.client.0.smithi044.stdout:4/495: truncate dd/f80 663346 0 2024-04-25T22:03:21.013 INFO:tasks.workunit.client.0.smithi044.stdout:4/496: dread dd/f41 [0,4194304] 0 2024-04-25T22:03:21.014 INFO:tasks.workunit.client.0.smithi044.stdout:4/497: symlink dd/d19/d72/d79/d7f/d81/la4 0 2024-04-25T22:03:21.015 INFO:tasks.workunit.client.0.smithi044.stdout:5/531: dread d2/d5/d21/d26/d2c/d37/f76 [0,4194304] 0 2024-04-25T22:03:21.016 INFO:tasks.workunit.client.0.smithi044.stdout:5/532: unlink d2/d5/d21/d38/d52/f6c 0 2024-04-25T22:03:21.016 INFO:tasks.workunit.client.0.smithi044.stdout:5/533: chown d2/d5/d27/d2a/c6f 1005833329 1 2024-04-25T22:03:21.017 INFO:tasks.workunit.client.0.smithi044.stdout:5/534: write d2/d5/f18 [3625486,62987] 0 2024-04-25T22:03:21.018 INFO:tasks.workunit.client.0.smithi044.stdout:5/535: unlink d2/d5/d27/f81 0 2024-04-25T22:03:21.019 INFO:tasks.workunit.client.0.smithi044.stdout:5/536: unlink d2/d5/d21/f61 0 2024-04-25T22:03:21.020 INFO:tasks.workunit.client.0.smithi044.stdout:5/537: unlink d2/d5/d27/d2a/f30 0 2024-04-25T22:03:21.027 INFO:tasks.workunit.client.0.smithi044.stdout:3/547: dread d0/f38 [0,4194304] 0 2024-04-25T22:03:21.028 INFO:tasks.workunit.client.0.smithi044.stdout:3/548: rename d0/d1/d79/fa0 to d0/d1/d15/d51/fac 0 2024-04-25T22:03:21.030 INFO:tasks.workunit.client.0.smithi044.stdout:3/549: dread d0/d1/f7e [0,4194304] 0 2024-04-25T22:03:21.036 INFO:tasks.workunit.client.0.smithi044.stdout:3/550: dwrite d0/d1/d15/d51/dd/d11/d43/d44/f6b [0,4194304] 0 2024-04-25T22:03:21.038 INFO:tasks.workunit.client.0.smithi044.stdout:3/551: mkdir d0/d13/d1c/d93/dad 0 2024-04-25T22:03:21.039 INFO:tasks.workunit.client.0.smithi044.stdout:3/552: write d0/d1/d15/d51/dd/d11/f69 [719608,80176] 0 2024-04-25T22:03:21.040 INFO:tasks.workunit.client.0.smithi044.stdout:3/553: creat d0/d70/fae x:0 0 0 2024-04-25T22:03:21.041 INFO:tasks.workunit.client.0.smithi044.stdout:3/554: chown d0/d2/f98 141369637 1 2024-04-25T22:03:21.041 INFO:tasks.workunit.client.0.smithi044.stdout:3/555: chown d0/d13/d1c/c6d 16217 1 2024-04-25T22:03:21.042 INFO:tasks.workunit.client.0.smithi044.stdout:3/556: rmdir d0/d1/d15 39 2024-04-25T22:03:21.042 INFO:tasks.workunit.client.0.smithi044.stdout:3/557: read d0/f38 [911446,100534] 0 2024-04-25T22:03:21.043 INFO:tasks.workunit.client.0.smithi044.stdout:3/558: stat d0/d13/d1c/c25 0 2024-04-25T22:03:21.044 INFO:tasks.workunit.client.0.smithi044.stdout:3/559: mknod d0/d13/d6c/caf 0 2024-04-25T22:03:21.044 INFO:tasks.workunit.client.0.smithi044.stdout:3/560: chown d0/d1/d15/d23/d60 107 1 2024-04-25T22:03:21.045 INFO:tasks.workunit.client.0.smithi044.stdout:3/561: chown d0/d13/d1c/f2b 50 1 2024-04-25T22:03:21.046 INFO:tasks.workunit.client.0.smithi044.stdout:3/562: readlink d0/d1/d15/d51/dd/d28/la4 0 2024-04-25T22:03:21.047 INFO:tasks.workunit.client.0.smithi044.stdout:3/563: write d0/d1/d15/d51/dd/d35/d36/f45 [4553539,81752] 0 2024-04-25T22:03:21.048 INFO:tasks.workunit.client.0.smithi044.stdout:3/564: mknod d0/d1/d15/cb0 0 2024-04-25T22:03:21.049 INFO:tasks.workunit.client.0.smithi044.stdout:4/498: fsync dd/d19/f32 0 2024-04-25T22:03:21.049 INFO:tasks.workunit.client.0.smithi044.stdout:3/565: mkdir d0/d1/d15/d51/dd/d35/dab/db1 0 2024-04-25T22:03:21.050 INFO:tasks.workunit.client.0.smithi044.stdout:3/566: read d0/f82 [256389,92789] 0 2024-04-25T22:03:21.050 INFO:tasks.workunit.client.0.smithi044.stdout:4/499: read dd/d35/d52/d61/f87 [63816,122515] 0 2024-04-25T22:03:21.052 INFO:tasks.workunit.client.0.smithi044.stdout:4/500: rename dd/d19/d72/d79/f94 to dd/d19/d72/d79/d9c/fa5 0 2024-04-25T22:03:21.055 INFO:tasks.workunit.client.0.smithi044.stdout:5/538: dread d2/d5/d21/d38/f53 [4194304,4194304] 0 2024-04-25T22:03:21.055 INFO:tasks.workunit.client.0.smithi044.stdout:4/501: truncate dd/f6f 665079 0 2024-04-25T22:03:21.057 INFO:tasks.workunit.client.0.smithi044.stdout:5/539: chown d2/d5/d21/f43 184 1 2024-04-25T22:03:21.058 INFO:tasks.workunit.client.0.smithi044.stdout:3/567: dwrite d0/f31 [0,4194304] 0 2024-04-25T22:03:21.058 INFO:tasks.workunit.client.0.smithi044.stdout:5/540: unlink d2/d35/c50 0 2024-04-25T22:03:21.062 INFO:tasks.workunit.client.0.smithi044.stdout:3/568: mknod d0/d13/d1c/d93/dad/cb2 0 2024-04-25T22:03:21.062 INFO:tasks.workunit.client.0.smithi044.stdout:3/569: write d0/d1/d79/f83 [912993,87897] 0 2024-04-25T22:03:21.062 INFO:tasks.workunit.client.0.smithi044.stdout:3/570: write d0/d1/d15/d51/dd/f61 [3296580,36342] 0 2024-04-25T22:03:21.069 INFO:tasks.workunit.client.0.smithi044.stdout:3/571: truncate d0/d1/d15/d51/dd/d28/f3e 505897 0 2024-04-25T22:03:21.073 INFO:tasks.workunit.client.0.smithi044.stdout:3/572: truncate d0/d1/d34/f58 508893 0 2024-04-25T22:03:21.074 INFO:tasks.workunit.client.0.smithi044.stdout:3/573: getdents d0/d70 0 2024-04-25T22:03:21.075 INFO:tasks.workunit.client.0.smithi044.stdout:3/574: write d0/d1/d15/d51/dd/d35/f52 [1848885,124108] 0 2024-04-25T22:03:21.075 INFO:tasks.workunit.client.0.smithi044.stdout:3/575: creat d0/d13/d6c/fb3 x:0 0 0 2024-04-25T22:03:21.081 INFO:tasks.workunit.client.0.smithi044.stdout:3/576: dwrite d0/d1/d15/d81/f87 [0,4194304] 0 2024-04-25T22:03:21.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:21.077+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:21.082 INFO:tasks.workunit.client.0.smithi044.stdout:3/577: unlink d0/d1/d34/d95/f9c 0 2024-04-25T22:03:21.083 INFO:tasks.workunit.client.0.smithi044.stdout:3/578: write d0/d1/d15/d23/f40 [1454977,31185] 0 2024-04-25T22:03:21.084 INFO:tasks.workunit.client.0.smithi044.stdout:3/579: write d0/d1/d15/d23/d60/f9a [969895,87721] 0 2024-04-25T22:03:21.085 INFO:tasks.workunit.client.0.smithi044.stdout:3/580: fdatasync d0/d1/fe 0 2024-04-25T22:03:21.088 INFO:tasks.workunit.client.0.smithi044.stdout:5/541: dread d2/d5/f2f [0,4194304] 0 2024-04-25T22:03:21.089 INFO:tasks.workunit.client.0.smithi044.stdout:5/542: write d2/d5/d21/f94 [123803,95680] 0 2024-04-25T22:03:21.099 INFO:tasks.workunit.client.0.smithi044.stdout:6/655: sync 2024-04-25T22:03:21.100 INFO:tasks.workunit.client.0.smithi044.stdout:6/656: readlink d2/d23/d5a/d12/d27/daf/dcb/d5e/l85 0 2024-04-25T22:03:21.101 INFO:tasks.workunit.client.0.smithi044.stdout:6/657: creat d2/d23/d5a/d12/d27/daf/dcb/d5e/fde x:0 0 0 2024-04-25T22:03:21.102 INFO:tasks.workunit.client.0.smithi044.stdout:6/658: creat d2/d23/d5a/d12/fdf x:0 0 0 2024-04-25T22:03:21.103 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:21.103 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:21.103 INFO:tasks.workunit.client.0.smithi044.stdout:6/659: stat d2/d23/d5a/d13 0 2024-04-25T22:03:21.103 INFO:tasks.workunit.client.0.smithi044.stdout:6/660: chown d2/d23/d5a/d11/f39 565456 1 2024-04-25T22:03:21.104 INFO:tasks.workunit.client.0.smithi044.stdout:6/661: write d2/d23/d5a/d12/d27/daf/fbc [3850790,88029] 0 2024-04-25T22:03:21.104 INFO:tasks.workunit.client.0.smithi044.stdout:6/662: symlink d2/d23/le0 0 2024-04-25T22:03:21.106 INFO:tasks.workunit.client.0.smithi044.stdout:6/663: symlink d2/d23/d5a/d12/d1f/d94/dc8/le1 0 2024-04-25T22:03:21.108 INFO:tasks.workunit.client.0.smithi044.stdout:3/581: dread d0/d13/f37 [0,4194304] 0 2024-04-25T22:03:21.109 INFO:tasks.workunit.client.0.smithi044.stdout:3/582: truncate d0/d1/d15/d51/dd/d28/f53 4710047 0 2024-04-25T22:03:21.110 INFO:tasks.workunit.client.0.smithi044.stdout:6/664: read d2/d23/d5a/d12/f46 [148530,78971] 0 2024-04-25T22:03:21.115 INFO:tasks.workunit.client.0.smithi044.stdout:3/583: truncate d0/f38 2591066 0 2024-04-25T22:03:21.116 INFO:tasks.workunit.client.0.smithi044.stdout:3/584: truncate d0/d1/faa 1021068 0 2024-04-25T22:03:21.116 INFO:tasks.workunit.client.0.smithi044.stdout:6/665: dwrite d2/d23/d5a/d13/d68/d8e/fa6 [0,4194304] 0 2024-04-25T22:03:21.117 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:21.118 INFO:tasks.workunit.client.0.smithi044.stdout:3/585: dread - d0/d1/d15/d51/dd/d28/f5e zero size 2024-04-25T22:03:21.119 INFO:tasks.workunit.client.0.smithi044.stdout:3/586: creat d0/d1/d15/df/d5d/fb4 x:0 0 0 2024-04-25T22:03:21.119 INFO:tasks.workunit.client.0.smithi044.stdout:6/666: creat d2/d23/d5a/d12/d27/daf/dcb/d5e/fe2 x:0 0 0 2024-04-25T22:03:21.120 INFO:tasks.workunit.client.0.smithi044.stdout:5/543: dread d2/f3c [0,4194304] 0 2024-04-25T22:03:21.121 INFO:tasks.workunit.client.0.smithi044.stdout:5/544: chown d2/d5/d21/f90 3617 1 2024-04-25T22:03:21.123 INFO:tasks.workunit.client.0.smithi044.stdout:6/667: read d2/d23/d5a/d12/f7a [3035553,71178] 0 2024-04-25T22:03:21.124 INFO:tasks.workunit.client.0.smithi044.stdout:6/668: chown d2/d23/d5a/d12/d27/daf/fbc 23902 1 2024-04-25T22:03:21.126 INFO:tasks.workunit.client.0.smithi044.stdout:3/587: dwrite d0/d1/d15/d51/dd/f4e [0,4194304] 0 2024-04-25T22:03:21.126 INFO:tasks.workunit.client.0.smithi044.stdout:6/669: getdents d2/d23/d5a/d12/d1f/d94 0 2024-04-25T22:03:21.129 INFO:tasks.workunit.client.0.smithi044.stdout:6/670: link d2/d23/d5a/d12/fc1 d2/d23/d5a/d13/d68/d7b/fe3 0 2024-04-25T22:03:21.129 INFO:tasks.workunit.client.0.smithi044.stdout:5/545: dwrite d2/d5/d21/d26/d2c/d37/f8a [0,4194304] 0 2024-04-25T22:03:21.133 INFO:tasks.workunit.client.0.smithi044.stdout:5/546: getdents d2/d5/d21/d38/d52 0 2024-04-25T22:03:21.134 INFO:tasks.workunit.client.0.smithi044.stdout:3/588: dwrite d0/d1/d15/d51/dd/d28/f5e [0,4194304] 0 2024-04-25T22:03:21.135 INFO:tasks.workunit.client.0.smithi044.stdout:6/671: dwrite d2/d23/d5a/d12/fdf [0,4194304] 0 2024-04-25T22:03:21.137 INFO:tasks.workunit.client.0.smithi044.stdout:6/672: creat d2/d23/d5a/d12/d27/daf/dcb/dc2/fe4 x:0 0 0 2024-04-25T22:03:21.138 INFO:tasks.workunit.client.0.smithi044.stdout:3/589: read d0/d1/d15/d51/dd/d28/f3e [53586,82962] 0 2024-04-25T22:03:21.138 INFO:tasks.workunit.client.0.smithi044.stdout:6/673: dread - d2/d23/d5a/d12/d49/fd6 zero size 2024-04-25T22:03:21.138 INFO:tasks.workunit.client.0.smithi044.stdout:3/590: symlink d0/d1/d15/d51/dd/d35/lb5 0 2024-04-25T22:03:21.139 INFO:tasks.workunit.client.0.smithi044.stdout:6/674: symlink d2/d23/d6a/le5 0 2024-04-25T22:03:21.139 INFO:tasks.workunit.client.0.smithi044.stdout:3/591: fdatasync d0/d1/d15/d51/dd/d11/f69 0 2024-04-25T22:03:21.141 INFO:tasks.workunit.client.0.smithi044.stdout:6/675: rename d2/d23/d6a/f84 to d2/d23/d5a/d12/d27/daf/dcb/dc2/fe6 0 2024-04-25T22:03:21.144 INFO:tasks.workunit.client.0.smithi044.stdout:6/676: link d2/d23/d5a/d12/fc1 d2/d23/d5a/d12/d49/fe7 0 2024-04-25T22:03:21.146 INFO:tasks.workunit.client.0.smithi044.stdout:6/677: mkdir d2/d23/d5a/d12/d1f/d94/de8 0 2024-04-25T22:03:21.147 INFO:tasks.workunit.client.0.smithi044.stdout:3/592: dwrite d0/d1/d15/d51/dd/d35/f52 [0,4194304] 0 2024-04-25T22:03:21.148 INFO:tasks.workunit.client.0.smithi044.stdout:6/678: link d2/d23/d5a/d12/d27/f2d d2/d23/d6a/fe9 0 2024-04-25T22:03:21.148 INFO:tasks.workunit.client.0.smithi044.stdout:3/593: write d0/d1/d15/d23/f40 [1520664,23833] 0 2024-04-25T22:03:21.150 INFO:tasks.workunit.client.0.smithi044.stdout:3/594: truncate d0/d1/d15/d51/dd/d28/f5e 4359733 0 2024-04-25T22:03:21.150 INFO:tasks.workunit.client.0.smithi044.stdout:6/679: rename d2/d23/d5a/d11/d2a/dbf/fdb to d2/d23/d5a/d12/d27/fea 0 2024-04-25T22:03:21.153 INFO:tasks.workunit.client.0.smithi044.stdout:9/651: sync 2024-04-25T22:03:21.153 INFO:tasks.workunit.client.0.smithi044.stdout:2/512: sync 2024-04-25T22:03:21.154 INFO:tasks.workunit.client.0.smithi044.stdout:7/385: sync 2024-04-25T22:03:21.154 INFO:tasks.workunit.client.0.smithi044.stdout:1/490: sync 2024-04-25T22:03:21.154 INFO:tasks.workunit.client.0.smithi044.stdout:0/500: sync 2024-04-25T22:03:21.154 INFO:tasks.workunit.client.0.smithi044.stdout:9/652: chown f3 336262739 1 2024-04-25T22:03:21.154 INFO:tasks.workunit.client.0.smithi044.stdout:2/513: readlink d7/d8/d1c/l65 0 2024-04-25T22:03:21.154 INFO:tasks.workunit.client.0.smithi044.stdout:0/501: dread - d8/df/d17/d45/d95/d51/f79 zero size 2024-04-25T22:03:21.155 INFO:tasks.workunit.client.0.smithi044.stdout:1/491: write d3/d7/f23 [2065879,123735] 0 2024-04-25T22:03:21.155 INFO:tasks.workunit.client.0.smithi044.stdout:9/653: mknod d4/d7/d18/d9f/ce0 0 2024-04-25T22:03:21.155 INFO:tasks.workunit.client.0.smithi044.stdout:7/386: truncate d1c/d22/d28/d30/d32/f42 4712470 0 2024-04-25T22:03:21.157 INFO:tasks.workunit.client.0.smithi044.stdout:2/514: rename d7/d7b/d81/d4e/d86/fa5 to d7/d8/d1c/d77/fa9 0 2024-04-25T22:03:21.157 INFO:tasks.workunit.client.0.smithi044.stdout:1/492: fdatasync d3/d7/db/d5d/d7f/d97/f64 0 2024-04-25T22:03:21.158 INFO:tasks.workunit.client.0.smithi044.stdout:1/493: readlink d3/d7/d29/l88 0 2024-04-25T22:03:21.159 INFO:tasks.workunit.client.0.smithi044.stdout:1/494: unlink d3/d7/db/d5d/d7f/d97/f64 0 2024-04-25T22:03:21.161 INFO:tasks.workunit.client.0.smithi044.stdout:9/654: dwrite d4/d4b/dac/fc1 [0,4194304] 0 2024-04-25T22:03:21.176 INFO:tasks.workunit.client.0.smithi044.stdout:9/655: dwrite d4/d7/d18/d2e/d73/f7c [0,4194304] 0 2024-04-25T22:03:21.176 INFO:tasks.workunit.client.0.smithi044.stdout:9/656: unlink d4/d7/d18/d3a/f46 0 2024-04-25T22:03:21.176 INFO:tasks.workunit.client.0.smithi044.stdout:9/657: chown d4/d37/d54/d84/d72/d97 2 1 2024-04-25T22:03:21.182 INFO:tasks.workunit.client.0.smithi044.stdout:5/547: dread d2/d5/d27/f62 [4194304,4194304] 0 2024-04-25T22:03:21.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:21.177+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:21.183 INFO:tasks.workunit.client.0.smithi044.stdout:5/548: chown d2/c28 63 1 2024-04-25T22:03:21.183 INFO:tasks.workunit.client.0.smithi044.stdout:5/549: readlink d2/d5b/l99 0 2024-04-25T22:03:21.184 INFO:tasks.workunit.client.0.smithi044.stdout:0/502: dread d8/df/d17/d45/f50 [0,4194304] 0 2024-04-25T22:03:21.185 INFO:tasks.workunit.client.0.smithi044.stdout:5/550: creat d2/fae x:0 0 0 2024-04-25T22:03:21.186 INFO:tasks.workunit.client.0.smithi044.stdout:9/658: dwrite d4/d7/d18/d2d/d70/fcb [0,4194304] 0 2024-04-25T22:03:21.186 INFO:tasks.workunit.client.0.smithi044.stdout:0/503: rename d8/df/d17/d45/d95/d51/f91 to d8/f9d 0 2024-04-25T22:03:21.187 INFO:tasks.workunit.client.0.smithi044.stdout:5/551: link d2/d5/d21/d26/d2c/d37/f4d d2/d5/d21/d38/d7c/faf 0 2024-04-25T22:03:21.188 INFO:tasks.workunit.client.0.smithi044.stdout:0/504: symlink d8/da/d55/l9e 0 2024-04-25T22:03:21.188 INFO:tasks.workunit.client.0.smithi044.stdout:9/659: rename d4/d37 to d4/d7/d79/ddc/de1 0 2024-04-25T22:03:21.189 INFO:tasks.workunit.client.0.smithi044.stdout:0/505: creat d8/f9f x:0 0 0 2024-04-25T22:03:21.190 INFO:tasks.workunit.client.0.smithi044.stdout:9/660: rename d4/d7/d79/ddc/de1/f74 to d4/d7/d18/d3a/dca/fe2 0 2024-04-25T22:03:21.190 INFO:tasks.workunit.client.0.smithi044.stdout:0/506: rmdir d8/df/d17/d45/d96 0 2024-04-25T22:03:21.191 INFO:tasks.workunit.client.0.smithi044.stdout:9/661: creat d4/d7/d18/d2e/d94/fe3 x:0 0 0 2024-04-25T22:03:21.193 INFO:tasks.workunit.client.0.smithi044.stdout:9/662: link d4/d7/d18/f5a d4/d7/d18/d3a/dca/dd3/dd4/fe4 0 2024-04-25T22:03:21.193 INFO:tasks.workunit.client.0.smithi044.stdout:1/495: dread d3/f26 [0,4194304] 0 2024-04-25T22:03:21.194 INFO:tasks.workunit.client.0.smithi044.stdout:1/496: chown d3/d59/d5c/f62 7982 1 2024-04-25T22:03:21.195 INFO:tasks.workunit.client.0.smithi044.stdout:1/497: fsync d3/d7/f40 0 2024-04-25T22:03:21.196 INFO:tasks.workunit.client.0.smithi044.stdout:1/498: creat d3/d7/d29/d43/d85/f9e x:0 0 0 2024-04-25T22:03:21.196 INFO:tasks.workunit.client.0.smithi044.stdout:0/507: dwrite d8/f9 [4194304,4194304] 0 2024-04-25T22:03:21.197 INFO:tasks.workunit.client.0.smithi044.stdout:1/499: write d3/d7/f57 [622565,98805] 0 2024-04-25T22:03:21.198 INFO:tasks.workunit.client.0.smithi044.stdout:0/508: rename d8/df/d17/l75 to d8/df/d17/d45/la0 0 2024-04-25T22:03:21.199 INFO:tasks.workunit.client.0.smithi044.stdout:5/552: read d2/d5/d21/d26/d2c/f87 [104269,42977] 0 2024-04-25T22:03:21.200 INFO:tasks.workunit.client.0.smithi044.stdout:9/663: getdents d4 0 2024-04-25T22:03:21.200 INFO:tasks.workunit.client.0.smithi044.stdout:0/509: creat d8/df/d17/d87/fa1 x:0 0 0 2024-04-25T22:03:21.201 INFO:tasks.workunit.client.0.smithi044.stdout:5/553: mkdir d2/d5/d6a/db0 0 2024-04-25T22:03:21.201 INFO:tasks.workunit.client.0.smithi044.stdout:2/515: dread d7/f31 [0,4194304] 0 2024-04-25T22:03:21.202 INFO:tasks.workunit.client.0.smithi044.stdout:9/664: unlink d4/d3d/d66/c89 0 2024-04-25T22:03:21.204 INFO:tasks.workunit.client.0.smithi044.stdout:9/665: creat d4/d7/d18/d2e/d73/fe5 x:0 0 0 2024-04-25T22:03:21.204 INFO:tasks.workunit.client.0.smithi044.stdout:5/554: link d2/d5/d27/d2a/d5c/d5f/f73 d2/d5/d27/d2a/d3a/fb1 0 2024-04-25T22:03:21.205 INFO:tasks.workunit.client.0.smithi044.stdout:9/666: fdatasync d4/d7/f4d 0 2024-04-25T22:03:21.205 INFO:tasks.workunit.client.0.smithi044.stdout:1/500: dwrite d3/d7/db/f56 [0,4194304] 0 2024-04-25T22:03:21.206 INFO:tasks.workunit.client.0.smithi044.stdout:0/510: write d8/d20/f31 [961248,83875] 0 2024-04-25T22:03:21.207 INFO:tasks.workunit.client.0.smithi044.stdout:5/555: dread d2/d5/d21/d26/d2c/d37/f76 [0,4194304] 0 2024-04-25T22:03:21.208 INFO:tasks.workunit.client.0.smithi044.stdout:0/511: rename d8/da/d60/f73 to d8/df/d17/d45/d95/d51/fa2 0 2024-04-25T22:03:21.210 INFO:tasks.workunit.client.0.smithi044.stdout:6/680: sync 2024-04-25T22:03:21.210 INFO:tasks.workunit.client.0.smithi044.stdout:4/502: sync 2024-04-25T22:03:21.211 INFO:tasks.workunit.client.0.smithi044.stdout:3/595: sync 2024-04-25T22:03:21.211 INFO:tasks.workunit.client.0.smithi044.stdout:8/748: sync 2024-04-25T22:03:21.211 INFO:tasks.workunit.client.0.smithi044.stdout:7/387: sync 2024-04-25T22:03:21.211 INFO:tasks.workunit.client.0.smithi044.stdout:2/516: dwrite d7/d7b/d81/d4e/d86/d6b/d78/d44/f71 [0,4194304] 0 2024-04-25T22:03:21.211 INFO:tasks.workunit.client.0.smithi044.stdout:0/512: read d8/d20/f5a [2375394,110578] 0 2024-04-25T22:03:21.213 INFO:tasks.workunit.client.0.smithi044.stdout:4/503: write dd/d35/f58 [108234,20820] 0 2024-04-25T22:03:21.213 INFO:tasks.workunit.client.0.smithi044.stdout:0/513: readlink d8/da/l89 0 2024-04-25T22:03:21.214 INFO:tasks.workunit.client.0.smithi044.stdout:4/504: stat dd/d19/l33 0 2024-04-25T22:03:21.216 INFO:tasks.workunit.client.0.smithi044.stdout:0/514: dread - d8/df/d17/d45/d95/d51/f8a zero size 2024-04-25T22:03:21.216 INFO:tasks.workunit.client.0.smithi044.stdout:2/517: symlink d7/d16/d4b/laa 0 2024-04-25T22:03:21.216 INFO:tasks.workunit.client.0.smithi044.stdout:5/556: read d2/d5/d21/d26/d2c/f74 [3576977,79187] 0 2024-04-25T22:03:21.217 INFO:tasks.workunit.client.0.smithi044.stdout:8/749: rename d2a/d32/d57/c6c to d2a/d39/d42/d80/cfe 0 2024-04-25T22:03:21.217 INFO:tasks.workunit.client.0.smithi044.stdout:4/505: symlink dd/d19/d72/d79/d9c/la6 0 2024-04-25T22:03:21.217 INFO:tasks.workunit.client.0.smithi044.stdout:1/501: dwrite d3/d7/f8 [4194304,4194304] 0 2024-04-25T22:03:21.219 INFO:tasks.workunit.client.0.smithi044.stdout:9/667: truncate d4/d7/d18/d3a/d8b/f90 1737381 0 2024-04-25T22:03:21.219 INFO:tasks.workunit.client.0.smithi044.stdout:0/515: unlink d8/d20/l58 0 2024-04-25T22:03:21.220 INFO:tasks.workunit.client.0.smithi044.stdout:4/506: write dd/d19/f6d [2325675,24342] 0 2024-04-25T22:03:21.220 INFO:tasks.workunit.client.0.smithi044.stdout:2/518: write d7/d7b/d81/d4e/d86/d6b/d78/f5a [4557506,41382] 0 2024-04-25T22:03:21.220 INFO:tasks.workunit.client.0.smithi044.stdout:5/557: creat d2/d5/d27/d2a/fb2 x:0 0 0 2024-04-25T22:03:21.220 INFO:tasks.workunit.client.0.smithi044.stdout:8/750: write d2a/d32/d3e/f6a [1591415,21500] 0 2024-04-25T22:03:21.221 INFO:tasks.workunit.client.0.smithi044.stdout:9/668: creat d4/d3d/d66/d93/fe6 x:0 0 0 2024-04-25T22:03:21.222 INFO:tasks.workunit.client.0.smithi044.stdout:3/596: dread d0/f31 [0,4194304] 0 2024-04-25T22:03:21.223 INFO:tasks.workunit.client.0.smithi044.stdout:9/669: read d4/d7/f63 [432130,33143] 0 2024-04-25T22:03:21.223 INFO:tasks.workunit.client.0.smithi044.stdout:4/507: creat dd/d19/d72/d88/fa7 x:0 0 0 2024-04-25T22:03:21.223 INFO:tasks.workunit.client.0.smithi044.stdout:0/516: rename d8/d24/d7c/c92 to d8/da/d55/ca3 0 2024-04-25T22:03:21.223 INFO:tasks.workunit.client.0.smithi044.stdout:3/597: chown d0/f31 8 1 2024-04-25T22:03:21.223 INFO:tasks.workunit.client.0.smithi044.stdout:2/519: symlink d7/d7b/d81/d4e/d86/d6b/d78/lab 0 2024-04-25T22:03:21.225 INFO:tasks.workunit.client.0.smithi044.stdout:7/388: dwrite d1c/d22/d28/f3d [0,4194304] 0 2024-04-25T22:03:21.227 INFO:tasks.workunit.client.0.smithi044.stdout:8/751: write d2a/d32/d57/d5e/fb0 [2129152,15637] 0 2024-04-25T22:03:21.227 INFO:tasks.workunit.client.0.smithi044.stdout:9/670: readlink d4/d7/d79/ddc/de1/d54/d84/lb1 0 2024-04-25T22:03:21.227 INFO:tasks.workunit.client.0.smithi044.stdout:0/517: chown d8/df/d17/d87 20 1 2024-04-25T22:03:21.227 INFO:tasks.workunit.client.0.smithi044.stdout:4/508: truncate dd/d19/d72/d88/fa1 822461 0 2024-04-25T22:03:21.228 INFO:tasks.workunit.client.0.smithi044.stdout:2/520: chown d7/d7b/d81/d4e/d86/d6b 56 1 2024-04-25T22:03:21.228 INFO:tasks.workunit.client.0.smithi044.stdout:8/752: symlink d2a/d39/d42/d68/d6b/d6e/d84/lff 0 2024-04-25T22:03:21.228 INFO:tasks.workunit.client.0.smithi044.stdout:9/671: creat d4/d7/d18/d3a/dca/fe7 x:0 0 0 2024-04-25T22:03:21.228 INFO:tasks.workunit.client.0.smithi044.stdout:2/521: fsync d7/f3f 0 2024-04-25T22:03:21.229 INFO:tasks.workunit.client.0.smithi044.stdout:7/389: getdents d1c/d22/d28/d30/d32 0 2024-04-25T22:03:21.229 INFO:tasks.workunit.client.0.smithi044.stdout:4/509: link dd/d35/f37 dd/d19/fa8 0 2024-04-25T22:03:21.230 INFO:tasks.workunit.client.0.smithi044.stdout:8/753: creat d2a/d39/d5a/f100 x:0 0 0 2024-04-25T22:03:21.230 INFO:tasks.workunit.client.0.smithi044.stdout:1/502: dread d3/d7/db/d5d/d7f/d97/d99/f78 [0,4194304] 0 2024-04-25T22:03:21.230 INFO:tasks.workunit.client.0.smithi044.stdout:4/510: mkdir dd/d35/d52/da9 0 2024-04-25T22:03:21.231 INFO:tasks.workunit.client.0.smithi044.stdout:1/503: stat d3/f49 0 2024-04-25T22:03:21.231 INFO:tasks.workunit.client.0.smithi044.stdout:9/672: symlink d4/d7/d18/le8 0 2024-04-25T22:03:21.231 INFO:tasks.workunit.client.0.smithi044.stdout:2/522: link d7/l64 d7/d16/d4b/lac 0 2024-04-25T22:03:21.232 INFO:tasks.workunit.client.0.smithi044.stdout:8/754: truncate d2a/d39/d42/f88 1205017 0 2024-04-25T22:03:21.232 INFO:tasks.workunit.client.0.smithi044.stdout:5/558: dwrite d2/d5/f9 [0,4194304] 0 2024-04-25T22:03:21.233 INFO:tasks.workunit.client.0.smithi044.stdout:8/755: chown d2a/d32/lb5 3672 1 2024-04-25T22:03:21.233 INFO:tasks.workunit.client.0.smithi044.stdout:7/390: dread d1c/d22/f49 [0,4194304] 0 2024-04-25T22:03:21.233 INFO:tasks.workunit.client.0.smithi044.stdout:8/756: chown d2a/d32/d3e/dd0/cd5 62 1 2024-04-25T22:03:21.234 INFO:tasks.workunit.client.0.smithi044.stdout:9/673: write d4/d7/d18/d2e/d94/fe3 [514119,67044] 0 2024-04-25T22:03:21.234 INFO:tasks.workunit.client.0.smithi044.stdout:1/504: chown d3/d7/db/d5d/d7f/d97/l6f 82 1 2024-04-25T22:03:21.234 INFO:tasks.workunit.client.0.smithi044.stdout:8/757: chown d2a/f62 1 1 2024-04-25T22:03:21.235 INFO:tasks.workunit.client.0.smithi044.stdout:8/758: fsync d2a/ff2 0 2024-04-25T22:03:21.236 INFO:tasks.workunit.client.0.smithi044.stdout:9/674: chown d4/d3d/d66/d93/la6 0 1 2024-04-25T22:03:21.236 INFO:tasks.workunit.client.0.smithi044.stdout:7/391: creat d1c/d22/f75 x:0 0 0 2024-04-25T22:03:21.236 INFO:tasks.workunit.client.0.smithi044.stdout:5/559: mknod d2/d35/cb3 0 2024-04-25T22:03:21.236 INFO:tasks.workunit.client.0.smithi044.stdout:2/523: write f0 [1627919,22931] 0 2024-04-25T22:03:21.236 INFO:tasks.workunit.client.0.smithi044.stdout:8/759: rmdir d2a/d39/d5a/d8e 39 2024-04-25T22:03:21.236 INFO:tasks.workunit.client.0.smithi044.stdout:4/511: getdents dd/d35/d52/d61 0 2024-04-25T22:03:21.237 INFO:tasks.workunit.client.0.smithi044.stdout:1/505: link d3/d7/d29/d43/d85/f84 d3/d54/d76/f9f 0 2024-04-25T22:03:21.237 INFO:tasks.workunit.client.0.smithi044.stdout:5/560: creat d2/d5/d21/d26/d2c/d37/fb4 x:0 0 0 2024-04-25T22:03:21.238 INFO:tasks.workunit.client.0.smithi044.stdout:7/392: creat d1c/d22/d28/d30/d32/d5d/f76 x:0 0 0 2024-04-25T22:03:21.238 INFO:tasks.workunit.client.0.smithi044.stdout:2/524: stat d7/d7b/d81/d4e/d86/f8f 0 2024-04-25T22:03:21.238 INFO:tasks.workunit.client.0.smithi044.stdout:9/675: truncate d4/d4b/d86/fcd 668684 0 2024-04-25T22:03:21.239 INFO:tasks.workunit.client.0.smithi044.stdout:1/506: mknod d3/d72/ca0 0 2024-04-25T22:03:21.239 INFO:tasks.workunit.client.0.smithi044.stdout:8/760: unlink d2a/d32/d3e/dd0/cd5 0 2024-04-25T22:03:21.239 INFO:tasks.workunit.client.0.smithi044.stdout:5/561: mkdir d2/d5/d27/d2a/db5 0 2024-04-25T22:03:21.239 INFO:tasks.workunit.client.0.smithi044.stdout:1/507: unlink d3/f49 0 2024-04-25T22:03:21.239 INFO:tasks.workunit.client.0.smithi044.stdout:2/525: unlink d7/d7b/d81/d4e/d86/f34 0 2024-04-25T22:03:21.239 INFO:tasks.workunit.client.0.smithi044.stdout:4/512: creat dd/d19/d72/d88/faa x:0 0 0 2024-04-25T22:03:21.240 INFO:tasks.workunit.client.0.smithi044.stdout:1/508: readlink d3/d7/d29/l32 0 2024-04-25T22:03:21.240 INFO:tasks.workunit.client.0.smithi044.stdout:9/676: chown d4/d7/d18/d2e/d94/fbd 46 1 2024-04-25T22:03:21.240 INFO:tasks.workunit.client.0.smithi044.stdout:2/526: unlink d7/l64 0 2024-04-25T22:03:21.241 INFO:tasks.workunit.client.0.smithi044.stdout:5/562: creat d2/dad/fb6 x:0 0 0 2024-04-25T22:03:21.241 INFO:tasks.workunit.client.0.smithi044.stdout:9/677: readlink d4/d7/l1e 0 2024-04-25T22:03:21.241 INFO:tasks.workunit.client.0.smithi044.stdout:7/393: mknod d1c/d22/d28/d30/d32/d33/d59/c77 0 2024-04-25T22:03:21.241 INFO:tasks.workunit.client.0.smithi044.stdout:1/509: creat d3/d7/d29/d43/fa1 x:0 0 0 2024-04-25T22:03:21.241 INFO:tasks.workunit.client.0.smithi044.stdout:8/761: link d2a/d32/d57/l74 d2a/d77/l101 0 2024-04-25T22:03:21.242 INFO:tasks.workunit.client.0.smithi044.stdout:4/513: write dd/d19/d72/d79/d7f/d81/f43 [3044938,107010] 0 2024-04-25T22:03:21.244 INFO:tasks.workunit.client.0.smithi044.stdout:6/681: sync 2024-04-25T22:03:21.244 INFO:tasks.workunit.client.0.smithi044.stdout:4/514: getdents dd/d19/d72/da0 0 2024-04-25T22:03:21.244 INFO:tasks.workunit.client.0.smithi044.stdout:2/527: sync 2024-04-25T22:03:21.244 INFO:tasks.workunit.client.0.smithi044.stdout:8/762: read d2a/d52/f72 [126802,90408] 0 2024-04-25T22:03:21.246 INFO:tasks.workunit.client.0.smithi044.stdout:8/763: symlink d2a/d32/d57/l102 0 2024-04-25T22:03:21.247 INFO:tasks.workunit.client.0.smithi044.stdout:8/764: creat d2a/d52/f103 x:0 0 0 2024-04-25T22:03:21.248 INFO:tasks.workunit.client.0.smithi044.stdout:7/394: dwrite f15 [0,4194304] 0 2024-04-25T22:03:21.248 INFO:tasks.workunit.client.0.smithi044.stdout:9/678: dread d4/d7/d18/d3a/dca/fe2 [0,4194304] 0 2024-04-25T22:03:21.249 INFO:tasks.workunit.client.0.smithi044.stdout:9/679: dread - d4/d7/d18/d2e/d73/fe5 zero size 2024-04-25T22:03:21.249 INFO:tasks.workunit.client.0.smithi044.stdout:7/395: creat d1c/d22/d4a/f78 x:0 0 0 2024-04-25T22:03:21.250 INFO:tasks.workunit.client.0.smithi044.stdout:9/680: read - d4/d7/d18/d2e/db5/fda zero size 2024-04-25T22:03:21.251 INFO:tasks.workunit.client.0.smithi044.stdout:7/396: dread d1c/d22/f49 [0,4194304] 0 2024-04-25T22:03:21.251 INFO:tasks.workunit.client.0.smithi044.stdout:9/681: stat d4/d7/d18/d2e/d73 0 2024-04-25T22:03:21.252 INFO:tasks.workunit.client.0.smithi044.stdout:7/397: truncate d1c/d22/d4a/f78 975176 0 2024-04-25T22:03:21.252 INFO:tasks.workunit.client.0.smithi044.stdout:9/682: write d4/d7/d18/d2e/f3f [2093200,106089] 0 2024-04-25T22:03:21.253 INFO:tasks.workunit.client.0.smithi044.stdout:6/682: dwrite d2/d23/d5a/d12/d1f/fa4 [0,4194304] 0 2024-04-25T22:03:21.253 INFO:tasks.workunit.client.0.smithi044.stdout:7/398: write d1c/d22/d28/f41 [706379,43501] 0 2024-04-25T22:03:21.256 INFO:tasks.workunit.client.0.smithi044.stdout:4/515: truncate dd/d35/f5f 4086412 0 2024-04-25T22:03:21.257 INFO:tasks.workunit.client.0.smithi044.stdout:7/399: link d1c/d22/d4a/f72 d1c/f79 0 2024-04-25T22:03:21.257 INFO:tasks.workunit.client.0.smithi044.stdout:6/683: symlink d2/d23/d5a/d11/leb 0 2024-04-25T22:03:21.258 INFO:tasks.workunit.client.0.smithi044.stdout:4/516: mknod dd/d19/d72/d88/cab 0 2024-04-25T22:03:21.258 INFO:tasks.workunit.client.0.smithi044.stdout:5/563: dwrite d2/d5/d21/d26/fa3 [0,4194304] 0 2024-04-25T22:03:21.258 INFO:tasks.workunit.client.0.smithi044.stdout:1/510: dwrite d3/d30/d3f/f68 [0,4194304] 0 2024-04-25T22:03:21.259 INFO:tasks.workunit.client.0.smithi044.stdout:7/400: mknod d1c/d22/d28/d66/c7a 0 2024-04-25T22:03:21.259 INFO:tasks.workunit.client.0.smithi044.stdout:6/684: symlink d2/d23/d5a/d12/d27/d8d/lec 0 2024-04-25T22:03:21.259 INFO:tasks.workunit.client.0.smithi044.stdout:7/401: stat d1c/d22/d4a/l4d 0 2024-04-25T22:03:21.260 INFO:tasks.workunit.client.0.smithi044.stdout:6/685: chown d2/d23/d5a/d11 81911321 1 2024-04-25T22:03:21.260 INFO:tasks.workunit.client.0.smithi044.stdout:5/564: truncate d2/d5/d27/d2a/fb2 332567 0 2024-04-25T22:03:21.260 INFO:tasks.workunit.client.0.smithi044.stdout:0/518: sync 2024-04-25T22:03:21.260 INFO:tasks.workunit.client.0.smithi044.stdout:3/598: sync 2024-04-25T22:03:21.261 INFO:tasks.workunit.client.0.smithi044.stdout:2/528: sync 2024-04-25T22:03:21.261 INFO:tasks.workunit.client.0.smithi044.stdout:8/765: sync 2024-04-25T22:03:21.261 INFO:tasks.workunit.client.0.smithi044.stdout:4/517: sync 2024-04-25T22:03:21.261 INFO:tasks.workunit.client.0.smithi044.stdout:5/565: chown d2/d5/d6a/db0 899752979 1 2024-04-25T22:03:21.261 INFO:tasks.workunit.client.0.smithi044.stdout:8/766: stat d2a/d32/d3e/f54 0 2024-04-25T22:03:21.261 INFO:tasks.workunit.client.0.smithi044.stdout:0/519: mkdir d8/da/da4 0 2024-04-25T22:03:21.262 INFO:tasks.workunit.client.0.smithi044.stdout:4/518: stat dd/d35/d52/f5b 0 2024-04-25T22:03:21.266 INFO:tasks.workunit.client.0.smithi044.stdout:0/520: dread - d8/da/d55/f8d zero size 2024-04-25T22:03:21.267 INFO:tasks.workunit.client.0.smithi044.stdout:8/767: rename d2a/d39/f51 to d2a/d39/f104 0 2024-04-25T22:03:21.267 INFO:tasks.workunit.client.0.smithi044.stdout:2/529: mkdir d7/d7b/d81/d4e/d86/d6b/d78/d44/dad 0 2024-04-25T22:03:21.268 INFO:tasks.workunit.client.0.smithi044.stdout:3/599: write d0/d1/d15/df/d5d/fb4 [68056,100632] 0 2024-04-25T22:03:21.268 INFO:tasks.workunit.client.0.smithi044.stdout:9/683: truncate d4/d7/d79/ddc/de1/d54/d84/d72/f95 1036365 0 2024-04-25T22:03:21.268 INFO:tasks.workunit.client.0.smithi044.stdout:4/519: rmdir dd/d19/d72/d79/d9c 39 2024-04-25T22:03:21.268 INFO:tasks.workunit.client.0.smithi044.stdout:5/566: rename d2/d35/c7b to d2/d5/d27/d2a/d5c/d5f/cb7 0 2024-04-25T22:03:21.269 INFO:tasks.workunit.client.0.smithi044.stdout:2/530: mkdir d7/d7b/d81/d4e/d86/d6b/d78/dae 0 2024-04-25T22:03:21.270 INFO:tasks.workunit.client.0.smithi044.stdout:3/600: mknod d0/d2/cb6 0 2024-04-25T22:03:21.270 INFO:tasks.workunit.client.0.smithi044.stdout:4/520: mknod dd/d19/d72/d88/cac 0 2024-04-25T22:03:21.270 INFO:tasks.workunit.client.0.smithi044.stdout:5/567: truncate d2/d5/d27/d2a/d48/f5a 216225 0 2024-04-25T22:03:21.270 INFO:tasks.workunit.client.0.smithi044.stdout:7/402: dwrite d1c/d22/d28/d57/f60 [0,4194304] 0 2024-04-25T22:03:21.270 INFO:tasks.workunit.client.0.smithi044.stdout:0/521: creat d8/df/fa5 x:0 0 0 2024-04-25T22:03:21.270 INFO:tasks.workunit.client.0.smithi044.stdout:7/403: fdatasync d1c/d22/f5c 0 2024-04-25T22:03:21.272 INFO:tasks.workunit.client.0.smithi044.stdout:0/522: rmdir d8/df/d88 39 2024-04-25T22:03:21.272 INFO:tasks.workunit.client.0.smithi044.stdout:3/601: mknod d0/d1/d34/d95/cb7 0 2024-04-25T22:03:21.272 INFO:tasks.workunit.client.0.smithi044.stdout:9/684: dwrite d4/d7/fa9 [0,4194304] 0 2024-04-25T22:03:21.274 INFO:tasks.workunit.client.0.smithi044.stdout:5/568: link d2/d5/d27/d2a/d48/l54 d2/d5/d6a/d92/d9e/lb8 0 2024-04-25T22:03:21.275 INFO:tasks.workunit.client.0.smithi044.stdout:6/686: truncate d2/d23/d5a/d11/d3b/f7e 383514 0 2024-04-25T22:03:21.275 INFO:tasks.workunit.client.0.smithi044.stdout:5/569: chown d2/d5/d27/d2a/c3b 0 1 2024-04-25T22:03:21.276 INFO:tasks.workunit.client.0.smithi044.stdout:3/602: creat d0/d1/d15/d51/d8e/d74/fb8 x:0 0 0 2024-04-25T22:03:21.278 INFO:tasks.workunit.client.0.smithi044.stdout:0/523: rename d8/df/d17/f76 to d8/d78/fa6 0 2024-04-25T22:03:21.278 INFO:tasks.workunit.client.0.smithi044.stdout:6/687: mkdir d2/d23/d5a/d12/d27/daf/dcb/ded 0 2024-04-25T22:03:21.280 INFO:tasks.workunit.client.0.smithi044.stdout:9/685: dread d4/d3d/f68 [0,4194304] 0 2024-04-25T22:03:21.281 INFO:tasks.workunit.client.0.smithi044.stdout:0/524: dread - d8/da/d55/f62 zero size 2024-04-25T22:03:21.281 INFO:tasks.workunit.client.0.smithi044.stdout:4/521: dwrite dd/d19/d91/f95 [0,4194304] 0 2024-04-25T22:03:21.281 INFO:tasks.workunit.client.0.smithi044.stdout:2/531: dread d7/d16/d4b/f5d [0,4194304] 0 2024-04-25T22:03:21.282 INFO:tasks.workunit.client.0.smithi044.stdout:9/686: chown d4/d4b/dac 257001189 1 2024-04-25T22:03:21.282 INFO:tasks.workunit.client.0.smithi044.stdout:8/768: dread d2a/f4e [0,4194304] 0 2024-04-25T22:03:21.284 INFO:tasks.workunit.client.0.smithi044.stdout:7/404: dwrite d1c/f79 [0,4194304] 0 2024-04-25T22:03:21.284 INFO:tasks.workunit.client.0.smithi044.stdout:4/522: creat dd/d35/d52/d61/fad x:0 0 0 2024-04-25T22:03:21.287 INFO:tasks.workunit.client.0.smithi044.stdout:0/525: unlink d8/da/d55/l67 0 2024-04-25T22:03:21.288 INFO:tasks.workunit.client.0.smithi044.stdout:9/687: chown d4/d3d/d66/db9/dbe/fc4 20991 1 2024-04-25T22:03:21.288 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:21.280+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:21.290 INFO:tasks.workunit.client.0.smithi044.stdout:7/405: rmdir d1c/d22/d28/d4e/d6a 39 2024-04-25T22:03:21.291 INFO:tasks.workunit.client.0.smithi044.stdout:3/603: dwrite d0/d1/d15/d51/dd/d11/f69 [0,4194304] 0 2024-04-25T22:03:21.291 INFO:tasks.workunit.client.0.smithi044.stdout:4/523: fsync dd/d35/d52/d61/f8e 0 2024-04-25T22:03:21.292 INFO:tasks.workunit.client.0.smithi044.stdout:7/406: write d1c/d22/d4a/f64 [434371,77104] 0 2024-04-25T22:03:21.292 INFO:tasks.workunit.client.0.smithi044.stdout:9/688: symlink d4/d7/d18/d2d/le9 0 2024-04-25T22:03:21.293 INFO:tasks.workunit.client.0.smithi044.stdout:0/526: link d8/d24/f99 d8/df/d93/fa7 0 2024-04-25T22:03:21.294 INFO:tasks.workunit.client.0.smithi044.stdout:8/769: getdents d2a/d32/d3e/dd0 0 2024-04-25T22:03:21.294 INFO:tasks.workunit.client.0.smithi044.stdout:4/524: chown dd/d19/d91/ca3 1730 1 2024-04-25T22:03:21.294 INFO:tasks.workunit.client.0.smithi044.stdout:6/688: dwrite d2/d23/d5a/d12/d27/daf/dcb/d5e/d9c/fcc [0,4194304] 0 2024-04-25T22:03:21.295 INFO:tasks.workunit.client.0.smithi044.stdout:8/770: rmdir d2a/d39/d5a/d92 39 2024-04-25T22:03:21.295 INFO:tasks.workunit.client.0.smithi044.stdout:6/689: write d2/f75 [165054,55876] 0 2024-04-25T22:03:21.295 INFO:tasks.workunit.client.0.smithi044.stdout:3/604: link d0/d13/d1c/d93/dad/cb2 d0/d1/d15/cb9 0 2024-04-25T22:03:21.297 INFO:tasks.workunit.client.0.smithi044.stdout:9/689: write d4/d7/f4d [171925,57310] 0 2024-04-25T22:03:21.297 INFO:tasks.workunit.client.0.smithi044.stdout:4/525: dread - dd/f69 zero size 2024-04-25T22:03:21.298 INFO:tasks.workunit.client.0.smithi044.stdout:4/526: chown dd/d19/d72 8093 1 2024-04-25T22:03:21.298 INFO:tasks.workunit.client.0.smithi044.stdout:6/690: getdents d2/d23/d5a/d13/d68/d8e 0 2024-04-25T22:03:21.299 INFO:tasks.workunit.client.0.smithi044.stdout:4/527: rmdir dd/d19/d72/d79 39 2024-04-25T22:03:21.299 INFO:tasks.workunit.client.0.smithi044.stdout:6/691: readlink d2/d23/d5a/d13/d68/d7b/lb3 0 2024-04-25T22:03:21.299 INFO:tasks.workunit.client.0.smithi044.stdout:9/690: write d4/d7/d79/ddc/de1/d54/d84/d72/d97/f9d [6351989,7947] 0 2024-04-25T22:03:21.300 INFO:tasks.workunit.client.0.smithi044.stdout:3/605: dread d0/f38 [0,4194304] 0 2024-04-25T22:03:21.300 INFO:tasks.workunit.client.0.smithi044.stdout:6/692: truncate d2/d23/fdd 670751 0 2024-04-25T22:03:21.301 INFO:tasks.workunit.client.0.smithi044.stdout:6/693: unlink d2/d23/d5a/d13/f3d 0 2024-04-25T22:03:21.301 INFO:tasks.workunit.client.0.smithi044.stdout:9/691: rename d4/d7/d18/d3a/c60 to d4/d3d/da5/cea 0 2024-04-25T22:03:21.302 INFO:tasks.workunit.client.0.smithi044.stdout:7/407: dwrite d1c/d22/d28/d30/d32/d5d/f76 [0,4194304] 0 2024-04-25T22:03:21.302 INFO:tasks.workunit.client.0.smithi044.stdout:2/532: write d7/d7b/d81/d4e/d86/d6b/d78/f56 [56317,130476] 0 2024-04-25T22:03:21.305 INFO:tasks.workunit.client.0.smithi044.stdout:2/533: dread - d7/d7b/d81/d4e/d86/f83 zero size 2024-04-25T22:03:21.306 INFO:tasks.workunit.client.0.smithi044.stdout:7/408: rename d1c/d22/d28/d30/d32/d33 to d1c/d22/d28/d4e/d7b 0 2024-04-25T22:03:21.307 INFO:tasks.workunit.client.0.smithi044.stdout:2/534: write d7/d7b/d81/f79 [1374830,110124] 0 2024-04-25T22:03:21.308 INFO:tasks.workunit.client.0.smithi044.stdout:2/535: symlink d7/d8/d48/laf 0 2024-04-25T22:03:21.308 INFO:tasks.workunit.client.0.smithi044.stdout:4/528: dwrite dd/d19/d72/d88/fa1 [0,4194304] 0 2024-04-25T22:03:21.309 INFO:tasks.workunit.client.0.smithi044.stdout:2/536: mknod d7/d7b/d81/d4e/d86/d6b/d78/d44/cb0 0 2024-04-25T22:03:21.310 INFO:tasks.workunit.client.0.smithi044.stdout:2/537: fdatasync d7/d7b/d81/d4e/f39 0 2024-04-25T22:03:21.311 INFO:tasks.workunit.client.0.smithi044.stdout:2/538: creat d7/d7b/d81/d4e/d86/d6b/fb1 x:0 0 0 2024-04-25T22:03:21.315 INFO:tasks.workunit.client.0.smithi044.stdout:1/511: fdatasync d3/d30/d3f/f68 0 2024-04-25T22:03:21.316 INFO:tasks.workunit.client.0.smithi044.stdout:5/570: dread d2/d5/d21/d38/f60 [4194304,4194304] 0 2024-04-25T22:03:21.317 INFO:tasks.workunit.client.0.smithi044.stdout:5/571: write d2/f20 [3232056,80286] 0 2024-04-25T22:03:21.318 INFO:tasks.workunit.client.0.smithi044.stdout:0/527: getdents d8/df/d93 0 2024-04-25T22:03:21.319 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:21.319 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:21.319 INFO:tasks.workunit.client.0.smithi044.stdout:0/528: mknod d8/df/d17/ca8 0 2024-04-25T22:03:21.322 INFO:tasks.workunit.client.0.smithi044.stdout:0/529: mknod d8/df/d17/d45/d95/ca9 0 2024-04-25T22:03:21.323 INFO:tasks.workunit.client.0.smithi044.stdout:0/530: dread - d8/d24/f99 zero size 2024-04-25T22:03:21.324 INFO:tasks.workunit.client.0.smithi044.stdout:6/694: dwrite d2/d23/d5a/d12/d1f/f20 [0,4194304] 0 2024-04-25T22:03:21.324 INFO:tasks.workunit.client.0.smithi044.stdout:1/512: dwrite d3/d7/db/f46 [0,4194304] 0 2024-04-25T22:03:21.325 INFO:tasks.workunit.client.0.smithi044.stdout:0/531: write d8/da/d55/f5c [1104217,90191] 0 2024-04-25T22:03:21.325 INFO:tasks.workunit.client.0.smithi044.stdout:1/513: unlink d3/d30/d3f/l6b 0 2024-04-25T22:03:21.326 INFO:tasks.workunit.client.0.smithi044.stdout:5/572: dwrite d2/d5/f88 [0,4194304] 0 2024-04-25T22:03:21.326 INFO:tasks.workunit.client.0.smithi044.stdout:6/695: mknod d2/d23/d5a/d12/d27/daf/dcb/ded/cee 0 2024-04-25T22:03:21.326 INFO:tasks.workunit.client.0.smithi044.stdout:0/532: rmdir d8/df/d17/d45/d95/d51/d8b/d90 39 2024-04-25T22:03:21.327 INFO:tasks.workunit.client.0.smithi044.stdout:1/514: mkdir d3/d54/da2 0 2024-04-25T22:03:21.327 INFO:tasks.workunit.client.0.smithi044.stdout:0/533: rmdir d8/da/d60 39 2024-04-25T22:03:21.327 INFO:tasks.workunit.client.0.smithi044.stdout:3/606: sync 2024-04-25T22:03:21.327 INFO:tasks.workunit.client.0.smithi044.stdout:6/696: symlink d2/d23/d5a/d11/d3b/lef 0 2024-04-25T22:03:21.330 INFO:tasks.workunit.client.0.smithi044.stdout:5/573: creat d2/d5/d27/d2a/d48/fb9 x:0 0 0 2024-04-25T22:03:21.330 INFO:tasks.workunit.client.0.smithi044.stdout:3/607: rmdir d0/d1/d15/d51/dd/d11 39 2024-04-25T22:03:21.333 INFO:tasks.workunit.client.0.smithi044.stdout:6/697: creat d2/d23/d5a/d12/d1f/d94/dc8/ff0 x:0 0 0 2024-04-25T22:03:21.333 INFO:tasks.workunit.client.0.smithi044.stdout:3/608: creat d0/d1/d15/d51/dd/d28/fba x:0 0 0 2024-04-25T22:03:21.333 INFO:tasks.workunit.client.0.smithi044.stdout:5/574: dread d2/d5/d27/d2a/d5c/d5f/f63 [0,4194304] 0 2024-04-25T22:03:21.335 INFO:tasks.workunit.client.0.smithi044.stdout:6/698: unlink d2/d23/d5a/d13/d68/f50 0 2024-04-25T22:03:21.336 INFO:tasks.workunit.client.0.smithi044.stdout:1/515: dwrite d3/d7/f8 [0,4194304] 0 2024-04-25T22:03:21.336 INFO:tasks.workunit.client.0.smithi044.stdout:5/575: dread d2/d5/d21/d26/d2c/d37/f76 [0,4194304] 0 2024-04-25T22:03:21.337 INFO:tasks.workunit.client.0.smithi044.stdout:3/609: truncate d0/d1/d15/d51/dd/d11/d42/f4d 4331665 0 2024-04-25T22:03:21.337 INFO:tasks.workunit.client.0.smithi044.stdout:6/699: symlink d2/d23/d5a/d12/d1f/d94/dc8/lf1 0 2024-04-25T22:03:21.338 INFO:tasks.workunit.client.0.smithi044.stdout:6/700: dread - d2/d23/d5a/d12/d1f/f87 zero size 2024-04-25T22:03:21.338 INFO:tasks.workunit.client.0.smithi044.stdout:0/534: dread d8/df/d17/d45/d95/d51/f71 [0,4194304] 0 2024-04-25T22:03:21.340 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:21.343 INFO:tasks.workunit.client.0.smithi044.stdout:3/610: dread d0/d1/d15/d51/dd/d11/d43/d44/f6b [0,4194304] 0 2024-04-25T22:03:21.344 INFO:tasks.workunit.client.0.smithi044.stdout:5/576: dwrite d2/d5/d21/f94 [0,4194304] 0 2024-04-25T22:03:21.345 INFO:tasks.workunit.client.0.smithi044.stdout:3/611: mknod d0/d13/d1c/d93/cbb 0 2024-04-25T22:03:21.346 INFO:tasks.workunit.client.0.smithi044.stdout:6/701: truncate d2/d23/d6a/f96 1898063 0 2024-04-25T22:03:21.346 INFO:tasks.workunit.client.0.smithi044.stdout:3/612: truncate d0/d70/f84 444360 0 2024-04-25T22:03:21.346 INFO:tasks.workunit.client.0.smithi044.stdout:5/577: write d2/d5/d6a/f6e [337567,51132] 0 2024-04-25T22:03:21.348 INFO:tasks.workunit.client.0.smithi044.stdout:6/702: fsync d2/d23/d5a/d11/d3b/f7e 0 2024-04-25T22:03:21.349 INFO:tasks.workunit.client.0.smithi044.stdout:3/613: symlink d0/d1/d15/d51/dd/d11/lbc 0 2024-04-25T22:03:21.349 INFO:tasks.workunit.client.0.smithi044.stdout:5/578: link d2/f4 d2/d5/d21/d38/d7c/fba 0 2024-04-25T22:03:21.350 INFO:tasks.workunit.client.0.smithi044.stdout:7/409: dread d1c/d22/d28/d30/f46 [0,4194304] 0 2024-04-25T22:03:21.350 INFO:tasks.workunit.client.0.smithi044.stdout:6/703: rename d2/d23/d5a/d12/d1f/d94/de8 to d2/d23/d5a/d13/d68/d7b/df2 0 2024-04-25T22:03:21.350 INFO:tasks.workunit.client.0.smithi044.stdout:7/410: fsync d1c/d22/f34 0 2024-04-25T22:03:21.350 INFO:tasks.workunit.client.0.smithi044.stdout:3/614: getdents d0/d1/d15/d51/dd/d35/d36 0 2024-04-25T22:03:21.351 INFO:teuthology.orchestra.run.smithi044.stdout:moved 0 / 210 (0%) 2024-04-25T22:03:21.351 INFO:teuthology.orchestra.run.smithi044.stdout:avg 70 2024-04-25T22:03:21.351 INFO:teuthology.orchestra.run.smithi044.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-04-25T22:03:21.351 INFO:teuthology.orchestra.run.smithi044.stdout:min osd.2 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-04-25T22:03:21.351 INFO:teuthology.orchestra.run.smithi044.stdout:max osd.1 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-04-25T22:03:21.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:03:21.351 INFO:teuthology.orchestra.run.smithi044.stdout:oload 110 2024-04-25T22:03:21.351 INFO:teuthology.orchestra.run.smithi044.stdout:max_change 1 2024-04-25T22:03:21.351 INFO:teuthology.orchestra.run.smithi044.stdout:max_change_osds 4 2024-04-25T22:03:21.351 INFO:teuthology.orchestra.run.smithi044.stdout:average_utilization 0.0010 2024-04-25T22:03:21.351 INFO:teuthology.orchestra.run.smithi044.stdout:overload_utilization 0.0011 2024-04-25T22:03:21.352 INFO:teuthology.orchestra.run.smithi044.stderr:no change 2024-04-25T22:03:21.352 INFO:tasks.workunit.client.0.smithi044.stdout:6/704: write d2/d23/d5a/d12/d70/fc0 [364271,47704] 0 2024-04-25T22:03:21.352 INFO:tasks.workunit.client.0.smithi044.stdout:7/411: fsync d1c/d22/d28/d30/d32/f39 0 2024-04-25T22:03:21.353 INFO:tasks.workunit.client.0.smithi044.stdout:7/412: write f12 [3858430,105083] 0 2024-04-25T22:03:21.353 INFO:tasks.workunit.client.0.smithi044.stdout:4/529: dread dd/f48 [0,4194304] 0 2024-04-25T22:03:21.354 INFO:tasks.workunit.client.0.smithi044.stdout:6/705: link d2/d23/d5a/d13/d68/d8e/fa6 d2/d23/d5a/d12/d27/daf/ff3 0 2024-04-25T22:03:21.355 INFO:tasks.workunit.client.0.smithi044.stdout:4/530: stat dd/l15 0 2024-04-25T22:03:21.355 INFO:tasks.workunit.client.0.smithi044.stdout:7/413: write d1c/d22/d28/d30/f46 [5385290,56842] 0 2024-04-25T22:03:21.356 INFO:tasks.workunit.client.0.smithi044.stdout:4/531: chown dd/f46 218 1 2024-04-25T22:03:21.357 INFO:tasks.workunit.client.0.smithi044.stdout:7/414: fsync d1c/d22/d4a/f62 0 2024-04-25T22:03:21.358 INFO:tasks.workunit.client.0.smithi044.stdout:4/532: stat dd/d35/d52 0 2024-04-25T22:03:21.358 INFO:tasks.workunit.client.0.smithi044.stdout:2/539: dread d7/d7b/d81/d4e/f87 [4194304,4194304] 0 2024-04-25T22:03:21.358 INFO:tasks.workunit.client.0.smithi044.stdout:6/706: chown d2/d23/d5a/d12/d27/daf/dcb/f67 585316 1 2024-04-25T22:03:21.359 INFO:tasks.workunit.client.0.smithi044.stdout:2/540: chown d7/d7b/d81/d4e/d86/d6b/l8e 48918 1 2024-04-25T22:03:21.359 INFO:tasks.workunit.client.0.smithi044.stdout:3/615: dwrite d0/d2/fa3 [0,4194304] 0 2024-04-25T22:03:21.360 INFO:tasks.workunit.client.0.smithi044.stdout:4/533: write dd/d19/d72/d79/d7f/d81/f64 [768948,76729] 0 2024-04-25T22:03:21.360 INFO:tasks.workunit.client.0.smithi044.stdout:6/707: chown d2/d23/d5a/d11/d3b/lef 12589 1 2024-04-25T22:03:21.361 INFO:tasks.workunit.client.0.smithi044.stdout:2/541: rmdir d7/d16/d2c/d75 39 2024-04-25T22:03:21.362 INFO:tasks.workunit.client.0.smithi044.stdout:4/534: creat dd/d35/d52/d61/d76/fae x:0 0 0 2024-04-25T22:03:21.364 INFO:tasks.workunit.client.0.smithi044.stdout:2/542: mkdir d7/d8/d48/db2 0 2024-04-25T22:03:21.364 INFO:tasks.workunit.client.0.smithi044.stdout:3/616: rename d0/d1/d15/d51/dd/d11/d43/c96 to d0/cbd 0 2024-04-25T22:03:21.364 INFO:tasks.workunit.client.0.smithi044.stdout:5/579: sync 2024-04-25T22:03:21.365 INFO:tasks.workunit.client.0.smithi044.stdout:1/516: dread d3/d59/d5c/f74 [0,4194304] 0 2024-04-25T22:03:21.365 INFO:tasks.workunit.client.0.smithi044.stdout:4/535: getdents dd/d35/d52/da9 0 2024-04-25T22:03:21.366 INFO:tasks.workunit.client.0.smithi044.stdout:2/543: write d7/d8/f62 [505207,15315] 0 2024-04-25T22:03:21.367 INFO:tasks.workunit.client.0.smithi044.stdout:9/692: dread d4/f7f [0,4194304] 0 2024-04-25T22:03:21.367 INFO:tasks.workunit.client.0.smithi044.stdout:7/415: dwrite d1c/d22/f6b [0,4194304] 0 2024-04-25T22:03:21.367 INFO:tasks.workunit.client.0.smithi044.stdout:1/517: mknod d3/d72/ca3 0 2024-04-25T22:03:21.367 INFO:tasks.workunit.client.0.smithi044.stdout:5/580: rename d2/d5/d6a/d92 to d2/d5/d21/d26/d2c/d37/dbb 0 2024-04-25T22:03:21.368 INFO:tasks.workunit.client.0.smithi044.stdout:4/536: mkdir dd/d19/daf 0 2024-04-25T22:03:21.368 INFO:tasks.workunit.client.0.smithi044.stdout:3/617: link d0/d1/d15/l2d d0/d1/d15/d51/dd/d28/lbe 0 2024-04-25T22:03:21.369 INFO:tasks.workunit.client.0.smithi044.stdout:5/581: dread - d2/d5/d21/d26/d2c/f97 zero size 2024-04-25T22:03:21.369 INFO:tasks.workunit.client.0.smithi044.stdout:2/544: write d7/d7b/d81/d4e/d86/d6b/fa2 [3889304,67427] 0 2024-04-25T22:03:21.369 INFO:tasks.workunit.client.0.smithi044.stdout:9/693: mknod d4/d7/d18/d3a/dca/dd3/dd4/ceb 0 2024-04-25T22:03:21.369 INFO:tasks.workunit.client.0.smithi044.stdout:3/618: chown d0/d1/d79 797 1 2024-04-25T22:03:21.369 INFO:tasks.workunit.client.0.smithi044.stdout:4/537: rmdir dd/d19/d72/d88 39 2024-04-25T22:03:21.370 INFO:tasks.workunit.client.0.smithi044.stdout:7/416: write d1c/d22/d28/d30/d32/f39 [278592,121819] 0 2024-04-25T22:03:21.370 INFO:tasks.workunit.client.0.smithi044.stdout:5/582: fsync d2/d5/d21/d38/f60 0 2024-04-25T22:03:21.371 INFO:tasks.workunit.client.0.smithi044.stdout:9/694: fsync d4/d7/d18/d2e/d73/f7c 0 2024-04-25T22:03:21.371 INFO:tasks.workunit.client.0.smithi044.stdout:7/417: mkdir d1c/d22/d28/d57/d7c 0 2024-04-25T22:03:21.371 INFO:tasks.workunit.client.0.smithi044.stdout:2/545: creat d7/d16/d2c/d75/fb3 x:0 0 0 2024-04-25T22:03:21.372 INFO:tasks.workunit.client.0.smithi044.stdout:3/619: creat d0/d70/d7c/da9/fbf x:0 0 0 2024-04-25T22:03:21.372 INFO:tasks.workunit.client.0.smithi044.stdout:6/708: dread d2/d23/d6a/f96 [0,4194304] 0 2024-04-25T22:03:21.372 INFO:tasks.workunit.client.0.smithi044.stdout:9/695: creat d4/d3d/da5/dd8/fec x:0 0 0 2024-04-25T22:03:21.373 INFO:tasks.workunit.client.0.smithi044.stdout:4/538: link dd/d19/d72/f7d dd/d35/d52/fb0 0 2024-04-25T22:03:21.373 INFO:tasks.workunit.client.0.smithi044.stdout:2/546: write d7/d7b/d81/d4e/d86/f8f [698140,115580] 0 2024-04-25T22:03:21.373 INFO:tasks.workunit.client.0.smithi044.stdout:7/418: stat d1c/d22/d28/d30/d32/f43 0 2024-04-25T22:03:21.374 INFO:tasks.workunit.client.0.smithi044.stdout:2/547: symlink d7/d16/d2c/d75/lb4 0 2024-04-25T22:03:21.375 INFO:tasks.workunit.client.0.smithi044.stdout:7/419: unlink d1c/d22/d28/d4e/d7b/f2d 0 2024-04-25T22:03:21.376 INFO:tasks.workunit.client.0.smithi044.stdout:2/548: mknod d7/d8/d5f/d70/cb5 0 2024-04-25T22:03:21.376 INFO:tasks.workunit.client.0.smithi044.stdout:1/518: dread d3/f6d [0,4194304] 0 2024-04-25T22:03:21.377 INFO:tasks.workunit.client.0.smithi044.stdout:6/709: link d2/d23/d5a/d12/d27/daf/dcb/dc2/fe4 d2/d23/d5a/d12/d27/daf/dcb/d5e/db5/ff4 0 2024-04-25T22:03:21.377 INFO:tasks.workunit.client.0.smithi044.stdout:2/549: readlink d7/d16/l7f 0 2024-04-25T22:03:21.378 INFO:tasks.workunit.client.0.smithi044.stdout:7/420: rmdir d1c/d22/d28/d57 39 2024-04-25T22:03:21.380 INFO:tasks.workunit.client.0.smithi044.stdout:5/583: dwrite d2/d5/d21/f94 [0,4194304] 0 2024-04-25T22:03:21.380 INFO:tasks.workunit.client.0.smithi044.stdout:1/519: creat d3/d7/db/d5d/d7f/fa4 x:0 0 0 2024-04-25T22:03:21.380 INFO:tasks.workunit.client.0.smithi044.stdout:2/550: creat d7/d8/d5f/d70/fb6 x:0 0 0 2024-04-25T22:03:21.380 INFO:tasks.workunit.client.0.smithi044.stdout:5/584: readlink d2/d5/d21/l9a 0 2024-04-25T22:03:21.380 INFO:tasks.workunit.client.0.smithi044.stdout:1/520: chown d3/d4b/l75 3954877 1 2024-04-25T22:03:21.380 INFO:tasks.workunit.client.0.smithi044.stdout:2/551: readlink d7/d16/d2c/d75/lb4 0 2024-04-25T22:03:21.383 INFO:tasks.workunit.client.0.smithi044.stdout:5/585: getdents d2/d5/d21/d38 0 2024-04-25T22:03:21.383 INFO:tasks.workunit.client.0.smithi044.stdout:5/586: chown d2/ca9 923 1 2024-04-25T22:03:21.384 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:21.376+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:21.384 INFO:tasks.workunit.client.0.smithi044.stdout:5/587: write d2/d5/d21/d26/d2c/f34 [1445398,122507] 0 2024-04-25T22:03:21.385 INFO:tasks.workunit.client.0.smithi044.stdout:5/588: rmdir d2/d5/d21/d26/d84 39 2024-04-25T22:03:21.387 INFO:tasks.workunit.client.0.smithi044.stdout:5/589: dread d2/d5/d21/d26/d2c/d37/f76 [0,4194304] 0 2024-04-25T22:03:21.388 INFO:tasks.workunit.client.0.smithi044.stdout:8/771: dread d2a/f36 [4194304,4194304] 0 2024-04-25T22:03:21.389 INFO:tasks.workunit.client.0.smithi044.stdout:5/590: creat d2/d5/d27/d2a/da7/fbc x:0 0 0 2024-04-25T22:03:21.389 INFO:tasks.workunit.client.0.smithi044.stdout:8/772: readlink d2a/d39/d42/lbd 0 2024-04-25T22:03:21.390 INFO:tasks.workunit.client.0.smithi044.stdout:2/552: dwrite d7/d16/f17 [0,4194304] 0 2024-04-25T22:03:21.390 INFO:tasks.workunit.client.0.smithi044.stdout:8/773: fsync f1f 0 2024-04-25T22:03:21.391 INFO:tasks.workunit.client.0.smithi044.stdout:5/591: dread d2/d5/f5e [0,4194304] 0 2024-04-25T22:03:21.391 INFO:tasks.workunit.client.0.smithi044.stdout:8/774: mkdir d2a/d32/d105 0 2024-04-25T22:03:21.393 INFO:tasks.workunit.client.0.smithi044.stdout:8/775: read f23 [2581007,125520] 0 2024-04-25T22:03:21.394 INFO:tasks.workunit.client.0.smithi044.stdout:8/776: rmdir d2a/d39/d42/d68/d6b/d6e 39 2024-04-25T22:03:21.396 INFO:tasks.workunit.client.0.smithi044.stdout:2/553: dwrite d7/d8/d1c/f33 [0,4194304] 0 2024-04-25T22:03:21.396 INFO:tasks.workunit.client.0.smithi044.stdout:8/777: dread d2a/d32/d3e/f54 [0,4194304] 0 2024-04-25T22:03:21.400 INFO:tasks.workunit.client.0.smithi044.stdout:3/620: dread d0/d1/d15/d51/dd/d11/d42/f4d [0,4194304] 0 2024-04-25T22:03:21.401 INFO:tasks.workunit.client.0.smithi044.stdout:3/621: stat d0/d1/d15 0 2024-04-25T22:03:21.402 INFO:tasks.workunit.client.0.smithi044.stdout:9/696: sync 2024-04-25T22:03:21.403 INFO:tasks.workunit.client.0.smithi044.stdout:6/710: sync 2024-04-25T22:03:21.404 INFO:tasks.workunit.client.0.smithi044.stdout:4/539: dread dd/d19/d72/d79/d7f/f84 [0,4194304] 0 2024-04-25T22:03:21.404 INFO:tasks.workunit.client.0.smithi044.stdout:8/778: dwrite d2a/fac [0,4194304] 0 2024-04-25T22:03:21.404 INFO:tasks.workunit.client.0.smithi044.stdout:3/622: mkdir d0/d70/d7c/da9/dc0 0 2024-04-25T22:03:21.405 INFO:tasks.workunit.client.0.smithi044.stdout:8/779: fdatasync d2a/d32/f33 0 2024-04-25T22:03:21.405 INFO:tasks.workunit.client.0.smithi044.stdout:6/711: creat d2/d23/d5a/d13/ff5 x:0 0 0 2024-04-25T22:03:21.405 INFO:tasks.workunit.client.0.smithi044.stdout:2/554: dwrite d7/d16/d4b/f5d [0,4194304] 0 2024-04-25T22:03:21.406 INFO:tasks.workunit.client.0.smithi044.stdout:3/623: creat d0/d13/d1c/fc1 x:0 0 0 2024-04-25T22:03:21.406 INFO:tasks.workunit.client.0.smithi044.stdout:9/697: write d4/d3d/d58/dd2/fd7 [184441,24766] 0 2024-04-25T22:03:21.406 INFO:tasks.workunit.client.0.smithi044.stdout:2/555: stat d7/d8/d1c/f33 0 2024-04-25T22:03:21.406 INFO:tasks.workunit.client.0.smithi044.stdout:8/780: mkdir d2a/d32/d3e/dd0/d106 0 2024-04-25T22:03:21.407 INFO:tasks.workunit.client.0.smithi044.stdout:6/712: fsync d2/d23/d5a/d13/d68/d8e/fa6 0 2024-04-25T22:03:21.407 INFO:tasks.workunit.client.0.smithi044.stdout:4/540: truncate dd/d19/d72/d79/d7f/f85 902122 0 2024-04-25T22:03:21.408 INFO:tasks.workunit.client.0.smithi044.stdout:8/781: mkdir d2a/d32/d3e/dd0/d107 0 2024-04-25T22:03:21.409 INFO:tasks.workunit.client.0.smithi044.stdout:3/624: getdents d0/d1/d15/d23 0 2024-04-25T22:03:21.409 INFO:tasks.workunit.client.0.smithi044.stdout:8/782: creat d2a/d82/f108 x:0 0 0 2024-04-25T22:03:21.409 INFO:tasks.workunit.client.0.smithi044.stdout:9/698: link d4/d7/d18/d2e/c49 d4/d3d/d66/db9/dbe/dce/ced 0 2024-04-25T22:03:21.409 INFO:tasks.workunit.client.0.smithi044.stdout:6/713: stat d2/d23/d5a/d13/c1a 0 2024-04-25T22:03:21.409 INFO:tasks.workunit.client.0.smithi044.stdout:8/783: unlink fc 0 2024-04-25T22:03:21.410 INFO:tasks.workunit.client.0.smithi044.stdout:7/421: dread d1c/f2f [0,4194304] 0 2024-04-25T22:03:21.411 INFO:tasks.workunit.client.0.smithi044.stdout:6/714: mkdir d2/d23/d5a/d12/d27/daf/dcb/dc2/df6 0 2024-04-25T22:03:21.412 INFO:tasks.workunit.client.0.smithi044.stdout:7/422: creat d1c/d22/d28/d30/f7d x:0 0 0 2024-04-25T22:03:21.414 INFO:tasks.workunit.client.0.smithi044.stdout:2/556: dwrite d7/f3f [0,4194304] 0 2024-04-25T22:03:21.414 INFO:tasks.workunit.client.0.smithi044.stdout:7/423: chown d1c/d22/d28/c2e 1 1 2024-04-25T22:03:21.417 INFO:tasks.workunit.client.0.smithi044.stdout:4/541: truncate dd/f48 160740 0 2024-04-25T22:03:21.418 INFO:tasks.workunit.client.0.smithi044.stdout:3/625: dwrite d0/d13/d1c/fc1 [0,4194304] 0 2024-04-25T22:03:21.418 INFO:tasks.workunit.client.0.smithi044.stdout:0/535: dread d8/f3b [0,4194304] 0 2024-04-25T22:03:21.420 INFO:tasks.workunit.client.0.smithi044.stdout:3/626: creat d0/d13/d6c/fc2 x:0 0 0 2024-04-25T22:03:21.420 INFO:tasks.workunit.client.0.smithi044.stdout:4/542: read dd/d35/d52/f5b [48687,116203] 0 2024-04-25T22:03:21.421 INFO:tasks.workunit.client.0.smithi044.stdout:9/699: dwrite d4/d7/d79/ddc/de1/d54/d84/d64/f9e [0,4194304] 0 2024-04-25T22:03:21.421 INFO:tasks.workunit.client.0.smithi044.stdout:0/536: mkdir d8/da/d60/daa 0 2024-04-25T22:03:21.421 INFO:tasks.workunit.client.0.smithi044.stdout:6/715: dread d2/d23/d5a/d12/d27/daf/dcb/f67 [0,4194304] 0 2024-04-25T22:03:21.423 INFO:tasks.workunit.client.0.smithi044.stdout:1/521: dread d3/d7/f2f [0,4194304] 0 2024-04-25T22:03:21.423 INFO:tasks.workunit.client.0.smithi044.stdout:0/537: mknod d8/df/d17/cab 0 2024-04-25T22:03:21.423 INFO:tasks.workunit.client.0.smithi044.stdout:9/700: unlink d4/d7/d79/ddc/de1/d54/c6f 0 2024-04-25T22:03:21.424 INFO:tasks.workunit.client.0.smithi044.stdout:4/543: creat dd/d35/d52/d61/d76/fb1 x:0 0 0 2024-04-25T22:03:21.424 INFO:tasks.workunit.client.0.smithi044.stdout:3/627: rename d0/d1/d15/d51/dd/d28/l63 to d0/d70/d7c/lc3 0 2024-04-25T22:03:21.425 INFO:tasks.workunit.client.0.smithi044.stdout:6/716: creat d2/d23/d5a/d11/d3b/dc6/ff7 x:0 0 0 2024-04-25T22:03:21.425 INFO:tasks.workunit.client.0.smithi044.stdout:7/424: dwrite d1c/f47 [0,4194304] 0 2024-04-25T22:03:21.425 INFO:tasks.workunit.client.0.smithi044.stdout:2/557: truncate d7/d8/d48/f4f 191218 0 2024-04-25T22:03:21.427 INFO:tasks.workunit.client.0.smithi044.stdout:4/544: write dd/d19/d72/d88/faa [608754,81175] 0 2024-04-25T22:03:21.427 INFO:tasks.workunit.client.0.smithi044.stdout:0/538: chown d8/df/d17/d45/d4f/c52 1 1 2024-04-25T22:03:21.427 INFO:tasks.workunit.client.0.smithi044.stdout:7/425: fdatasync d1c/d22/d4a/f4f 0 2024-04-25T22:03:21.427 INFO:tasks.workunit.client.0.smithi044.stdout:3/628: rename d0/d1/d15/cb9 to d0/d1/d15/d81/cc4 0 2024-04-25T22:03:21.428 INFO:tasks.workunit.client.0.smithi044.stdout:6/717: creat d2/d23/d5a/ff8 x:0 0 0 2024-04-25T22:03:21.428 INFO:tasks.workunit.client.0.smithi044.stdout:0/539: chown d8/df/d17/d45/d95/d9c 116681379 1 2024-04-25T22:03:21.428 INFO:tasks.workunit.client.0.smithi044.stdout:2/558: symlink d7/d8/d48/db2/lb7 0 2024-04-25T22:03:21.428 INFO:tasks.workunit.client.0.smithi044.stdout:4/545: symlink dd/d35/d52/d61/lb2 0 2024-04-25T22:03:21.428 INFO:tasks.workunit.client.0.smithi044.stdout:7/426: creat d1c/d22/d28/d30/d32/d5d/f7e x:0 0 0 2024-04-25T22:03:21.429 INFO:tasks.workunit.client.0.smithi044.stdout:2/559: fdatasync d7/d7b/d81/d4e/f8c 0 2024-04-25T22:03:21.430 INFO:tasks.workunit.client.0.smithi044.stdout:0/540: unlink d8/d24/f48 0 2024-04-25T22:03:21.430 INFO:tasks.workunit.client.0.smithi044.stdout:3/629: symlink d0/d1/d15/d51/dd/d35/dab/lc5 0 2024-04-25T22:03:21.431 INFO:tasks.workunit.client.0.smithi044.stdout:0/541: unlink d8/d24/d7c/f82 0 2024-04-25T22:03:21.431 INFO:tasks.workunit.client.0.smithi044.stdout:6/718: truncate d2/d23/d6a/fe9 4866431 0 2024-04-25T22:03:21.432 INFO:tasks.workunit.client.0.smithi044.stdout:7/427: rename d1c/d22/d4a/l56 to d1c/d22/d28/d30/l7f 0 2024-04-25T22:03:21.432 INFO:tasks.workunit.client.0.smithi044.stdout:9/701: dwrite d4/f57 [0,4194304] 0 2024-04-25T22:03:21.432 INFO:tasks.workunit.client.0.smithi044.stdout:6/719: truncate d2/f75 655889 0 2024-04-25T22:03:21.432 INFO:tasks.workunit.client.0.smithi044.stdout:2/560: write d7/d7b/d81/d4e/d86/d6b/d78/f56 [736653,58570] 0 2024-04-25T22:03:21.433 INFO:tasks.workunit.client.0.smithi044.stdout:0/542: read d8/df/f40 [1561563,61818] 0 2024-04-25T22:03:21.433 INFO:tasks.workunit.client.0.smithi044.stdout:6/720: write d2/d23/d5a/ff8 [159708,30323] 0 2024-04-25T22:03:21.433 INFO:tasks.workunit.client.0.smithi044.stdout:7/428: unlink d1c/d22/d28/d4e/f5f 0 2024-04-25T22:03:21.434 INFO:tasks.workunit.client.0.smithi044.stdout:0/543: dread - d8/df/d17/d87/fa1 zero size 2024-04-25T22:03:21.434 INFO:tasks.workunit.client.0.smithi044.stdout:2/561: creat d7/d7b/d81/d4e/d86/d6b/d78/dae/fb8 x:0 0 0 2024-04-25T22:03:21.435 INFO:tasks.workunit.client.0.smithi044.stdout:6/721: creat d2/d23/d5a/d12/d27/ff9 x:0 0 0 2024-04-25T22:03:21.435 INFO:tasks.workunit.client.0.smithi044.stdout:9/702: read d4/d3d/fd1 [535561,14340] 0 2024-04-25T22:03:21.435 INFO:tasks.workunit.client.0.smithi044.stdout:7/429: symlink d1c/d22/d28/d57/l80 0 2024-04-25T22:03:21.435 INFO:tasks.workunit.client.0.smithi044.stdout:0/544: creat d8/fac x:0 0 0 2024-04-25T22:03:21.435 INFO:tasks.workunit.client.0.smithi044.stdout:2/562: dread - d7/d7b/d81/d4e/d86/f83 zero size 2024-04-25T22:03:21.436 INFO:tasks.workunit.client.0.smithi044.stdout:0/545: chown d8/df/d17/d87 5 1 2024-04-25T22:03:21.436 INFO:tasks.workunit.client.0.smithi044.stdout:7/430: unlink d1c/d22/d28/d4e/d7b/f65 0 2024-04-25T22:03:21.436 INFO:tasks.workunit.client.0.smithi044.stdout:2/563: chown d7/d7b/d81/d57/l9b 1157365165 1 2024-04-25T22:03:21.437 INFO:tasks.workunit.client.0.smithi044.stdout:0/546: mkdir d8/df/d17/d45/dad 0 2024-04-25T22:03:21.438 INFO:tasks.workunit.client.0.smithi044.stdout:9/703: rename d4/d7/d79/ddc/de1/d54/d84/c80 to d4/d3d/d58/cee 0 2024-04-25T22:03:21.438 INFO:tasks.workunit.client.0.smithi044.stdout:2/564: symlink d7/d8/d1c/d77/lb9 0 2024-04-25T22:03:21.438 INFO:tasks.workunit.client.0.smithi044.stdout:9/704: symlink d4/d7/d18/d3a/dca/lef 0 2024-04-25T22:03:21.439 INFO:tasks.workunit.client.0.smithi044.stdout:0/547: truncate d8/df/d17/d45/d95/d51/f79 262901 0 2024-04-25T22:03:21.439 INFO:tasks.workunit.client.0.smithi044.stdout:0/548: write f1 [1077884,11517] 0 2024-04-25T22:03:21.440 INFO:tasks.workunit.client.0.smithi044.stdout:9/705: getdents d4/d7/d18/d2d 0 2024-04-25T22:03:21.440 INFO:tasks.workunit.client.0.smithi044.stdout:0/549: symlink d8/d24/lae 0 2024-04-25T22:03:21.440 INFO:tasks.workunit.client.0.smithi044.stdout:9/706: readlink d4/d7/d18/l28 0 2024-04-25T22:03:21.442 INFO:tasks.workunit.client.0.smithi044.stdout:9/707: getdents d4/d3d/d66/d93 0 2024-04-25T22:03:21.442 INFO:tasks.workunit.client.0.smithi044.stdout:7/431: dwrite d1c/d22/d28/d30/d32/f39 [0,4194304] 0 2024-04-25T22:03:21.445 INFO:tasks.workunit.client.0.smithi044.stdout:4/546: write dd/f80 [1197112,130016] 0 2024-04-25T22:03:21.446 INFO:tasks.workunit.client.0.smithi044.stdout:9/708: rename d4/d7/d18/d2d/f38 to d4/d7/d79/ddc/de1/d54/d84/d72/ff0 0 2024-04-25T22:03:21.447 INFO:tasks.workunit.client.0.smithi044.stdout:9/709: symlink d4/d7/d18/d2d/lf1 0 2024-04-25T22:03:21.448 INFO:tasks.workunit.client.0.smithi044.stdout:3/630: truncate d0/d1/d15/d23/f40 4123346 0 2024-04-25T22:03:21.449 INFO:tasks.workunit.client.0.smithi044.stdout:6/722: write d2/d23/d5a/d12/d49/fe7 [48848,83431] 0 2024-04-25T22:03:21.449 INFO:tasks.workunit.client.0.smithi044.stdout:0/550: dwrite d8/df/d17/d45/f50 [4194304,4194304] 0 2024-04-25T22:03:21.449 INFO:tasks.workunit.client.0.smithi044.stdout:7/432: dwrite d1c/f47 [0,4194304] 0 2024-04-25T22:03:21.450 INFO:tasks.workunit.client.0.smithi044.stdout:0/551: write d8/da/f61 [501369,105122] 0 2024-04-25T22:03:21.451 INFO:tasks.workunit.client.0.smithi044.stdout:7/433: creat d1c/d22/d4a/f81 x:0 0 0 2024-04-25T22:03:21.451 INFO:tasks.workunit.client.0.smithi044.stdout:9/710: link d4/d7/d79/ddc/de1/d54/d84/d72/f95 d4/d7/d79/ddc/ff2 0 2024-04-25T22:03:21.451 INFO:tasks.workunit.client.0.smithi044.stdout:6/723: truncate d2/d23/d5a/d11/f21 1540677 0 2024-04-25T22:03:21.452 INFO:tasks.workunit.client.0.smithi044.stdout:7/434: chown d1c/l26 58493349 1 2024-04-25T22:03:21.452 INFO:tasks.workunit.client.0.smithi044.stdout:0/552: chown d8/df/d17/d45/d95/f42 34 1 2024-04-25T22:03:21.452 INFO:tasks.workunit.client.0.smithi044.stdout:0/553: write f0 [1518418,76239] 0 2024-04-25T22:03:21.453 INFO:tasks.workunit.client.0.smithi044.stdout:7/435: truncate d1c/d22/f75 679687 0 2024-04-25T22:03:21.453 INFO:tasks.workunit.client.0.smithi044.stdout:9/711: mkdir d4/d7/d79/ddc/de1/d54/d84/d72/d97/df3 0 2024-04-25T22:03:21.453 INFO:tasks.workunit.client.0.smithi044.stdout:0/554: symlink d8/df/d17/d45/laf 0 2024-04-25T22:03:21.453 INFO:tasks.workunit.client.0.smithi044.stdout:6/724: rename d2/d23/d5a/d13/d68/d7b to d2/d23/d5a/d12/d1f/d94/dc8/dfa 0 2024-04-25T22:03:21.455 INFO:tasks.workunit.client.0.smithi044.stdout:0/555: mkdir d8/df/d17/d45/d95/d51/d8b/db0 0 2024-04-25T22:03:21.455 INFO:tasks.workunit.client.0.smithi044.stdout:6/725: symlink d2/d23/d5a/d12/dce/lfb 0 2024-04-25T22:03:21.456 INFO:tasks.workunit.client.0.smithi044.stdout:2/565: getdents d7/d8/d1c/d77 0 2024-04-25T22:03:21.456 INFO:tasks.workunit.client.0.smithi044.stdout:6/726: symlink d2/d23/d5a/d12/d27/daf/lfc 0 2024-04-25T22:03:21.457 INFO:tasks.workunit.client.0.smithi044.stdout:6/727: stat d2/d23/da9 0 2024-04-25T22:03:21.457 INFO:tasks.workunit.client.0.smithi044.stdout:2/566: rename d7/d16/d2c/c4d to d7/d7b/cba 0 2024-04-25T22:03:21.458 INFO:tasks.workunit.client.0.smithi044.stdout:9/712: dread d4/d7/d18/d2e/d73/f7c [0,4194304] 0 2024-04-25T22:03:21.458 INFO:tasks.workunit.client.0.smithi044.stdout:6/728: rmdir d2/d23/d5a/d12/d70 39 2024-04-25T22:03:21.458 INFO:tasks.workunit.client.0.smithi044.stdout:9/713: rmdir d4/d7/d18/d2d/d70 39 2024-04-25T22:03:21.458 INFO:tasks.workunit.client.0.smithi044.stdout:6/729: chown d2/d23/fdd 2925100 1 2024-04-25T22:03:21.459 INFO:tasks.workunit.client.0.smithi044.stdout:9/714: fsync d4/d7/fb7 0 2024-04-25T22:03:21.459 INFO:tasks.workunit.client.0.smithi044.stdout:6/730: stat d2/d23/d5a/d12/d27/daf/dcb/dc2 0 2024-04-25T22:03:21.459 INFO:tasks.workunit.client.0.smithi044.stdout:9/715: stat d4/d7/d18/d3a/f5f 0 2024-04-25T22:03:21.461 INFO:tasks.workunit.client.0.smithi044.stdout:9/716: mknod d4/d7/d18/d3a/dca/dd3/cf4 0 2024-04-25T22:03:21.461 INFO:tasks.workunit.client.0.smithi044.stdout:0/556: read d8/df/d17/f33 [4955301,128205] 0 2024-04-25T22:03:21.461 INFO:tasks.workunit.client.0.smithi044.stdout:6/731: link d2/d23/d5a/d12/d27/daf/dcb/d5e/fe2 d2/d23/d5a/d12/d49/ffd 0 2024-04-25T22:03:21.463 INFO:tasks.workunit.client.0.smithi044.stdout:0/557: getdents d8/df/d17/d45/d95/d51 0 2024-04-25T22:03:21.468 INFO:tasks.workunit.client.0.smithi044.stdout:6/732: dwrite d2/d23/d5a/d11/d2a/f61 [0,4194304] 0 2024-04-25T22:03:21.468 INFO:tasks.workunit.client.0.smithi044.stdout:6/733: stat d2/d23/d5a/l14 0 2024-04-25T22:03:21.468 INFO:tasks.workunit.client.0.smithi044.stdout:5/592: dread d2/d5/f2f [0,4194304] 0 2024-04-25T22:03:21.469 INFO:tasks.workunit.client.0.smithi044.stdout:5/593: stat d2/d5/d21/d38/d52/d56/l96 0 2024-04-25T22:03:21.469 INFO:tasks.workunit.client.0.smithi044.stdout:6/734: stat d2/d23/d5a/d11/f21 0 2024-04-25T22:03:21.470 INFO:tasks.workunit.client.0.smithi044.stdout:6/735: readlink d2/d23/d5a/d13/d68/l65 0 2024-04-25T22:03:21.470 INFO:tasks.workunit.client.0.smithi044.stdout:5/594: rmdir d2/d5/d6a/db0 0 2024-04-25T22:03:21.471 INFO:tasks.workunit.client.0.smithi044.stdout:5/595: creat d2/d5/d21/fbd x:0 0 0 2024-04-25T22:03:21.471 INFO:tasks.workunit.client.0.smithi044.stdout:6/736: readlink d2/d23/d5a/d12/l8b 0 2024-04-25T22:03:21.473 INFO:tasks.workunit.client.0.smithi044.stdout:9/717: dread d4/d7/d18/f4f [0,4194304] 0 2024-04-25T22:03:21.473 INFO:tasks.workunit.client.0.smithi044.stdout:9/718: stat d4/d7/l98 0 2024-04-25T22:03:21.473 INFO:tasks.workunit.client.0.smithi044.stdout:5/596: dread d2/d35/f45 [0,4194304] 0 2024-04-25T22:03:21.474 INFO:tasks.workunit.client.0.smithi044.stdout:6/737: rename d2/d23/d5a/d12/d27/daf/dcb/f67 to d2/d23/d5a/d12/d1f/d94/dc8/dfa/dd7/ffe 0 2024-04-25T22:03:21.474 INFO:tasks.workunit.client.0.smithi044.stdout:9/719: read d4/d7/d18/d2e/d73/f7c [378764,127419] 0 2024-04-25T22:03:21.474 INFO:tasks.workunit.client.0.smithi044.stdout:5/597: dread - d2/d5/d27/d2a/d5c/f67 zero size 2024-04-25T22:03:21.475 INFO:tasks.workunit.client.0.smithi044.stdout:6/738: chown d2/d23/d5a/d13/d68/f79 547 1 2024-04-25T22:03:21.475 INFO:tasks.workunit.client.0.smithi044.stdout:5/598: getdents d2/d5b/d8e 0 2024-04-25T22:03:21.476 INFO:tasks.workunit.client.0.smithi044.stdout:6/739: creat d2/d23/d6a/d63/fff x:0 0 0 2024-04-25T22:03:21.476 INFO:tasks.workunit.client.0.smithi044.stdout:5/599: creat d2/d5/d21/d38/d52/fbe x:0 0 0 2024-04-25T22:03:21.477 INFO:tasks.workunit.client.0.smithi044.stdout:5/600: symlink d2/d5/d27/d2a/db5/lbf 0 2024-04-25T22:03:21.477 INFO:tasks.workunit.client.0.smithi044.stdout:6/740: write d2/d23/d5a/f62 [1852894,70215] 0 2024-04-25T22:03:21.479 INFO:tasks.workunit.client.0.smithi044.stdout:9/720: read d4/d7/d18/d3a/d8b/fde [2798773,35247] 0 2024-04-25T22:03:21.480 INFO:tasks.workunit.client.0.smithi044.stdout:9/721: rmdir d4/d3d/d58/dd2 39 2024-04-25T22:03:21.481 INFO:tasks.workunit.client.0.smithi044.stdout:1/522: dread d3/d7/d29/f35 [0,4194304] 0 2024-04-25T22:03:21.481 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:21.481 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:21.482 INFO:tasks.workunit.client.0.smithi044.stdout:4/547: dread dd/f4b [4194304,4194304] 0 2024-04-25T22:03:21.482 INFO:tasks.workunit.client.0.smithi044.stdout:2/567: unlink d7/d7b/cba 0 2024-04-25T22:03:21.482 INFO:tasks.workunit.client.0.smithi044.stdout:1/523: creat d3/d7/db/d8f/fa5 x:0 0 0 2024-04-25T22:03:21.483 INFO:tasks.workunit.client.0.smithi044.stdout:1/524: write d3/d7/db/d8f/f91 [1313460,71283] 0 2024-04-25T22:03:21.484 INFO:tasks.workunit.client.0.smithi044.stdout:4/548: read dd/f17 [3801853,25675] 0 2024-04-25T22:03:21.484 INFO:tasks.workunit.client.0.smithi044.stdout:1/525: chown d3/d30/d3f/f9c 88 1 2024-04-25T22:03:21.485 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:21.480+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:21.485 INFO:tasks.workunit.client.0.smithi044.stdout:1/526: rmdir d3/d72 39 2024-04-25T22:03:21.486 INFO:tasks.workunit.client.0.smithi044.stdout:4/549: creat dd/d35/d52/da9/fb3 x:0 0 0 2024-04-25T22:03:21.486 INFO:tasks.workunit.client.0.smithi044.stdout:1/527: unlink d3/l22 0 2024-04-25T22:03:21.487 INFO:tasks.workunit.client.0.smithi044.stdout:5/601: dwrite d2/d5/d27/d2a/d5c/f83 [0,4194304] 0 2024-04-25T22:03:21.487 INFO:tasks.workunit.client.0.smithi044.stdout:2/568: dread d7/d16/d2c/f6d [0,4194304] 0 2024-04-25T22:03:21.488 INFO:tasks.workunit.client.0.smithi044.stdout:5/602: fdatasync d2/d5/d27/d2a/d5c/f67 0 2024-04-25T22:03:21.488 INFO:tasks.workunit.client.0.smithi044.stdout:9/722: dwrite d4/d7/d18/d2e/f3f [0,4194304] 0 2024-04-25T22:03:21.488 INFO:tasks.workunit.client.0.smithi044.stdout:1/528: symlink d3/d7/db/d5d/d7f/la6 0 2024-04-25T22:03:21.488 INFO:tasks.workunit.client.0.smithi044.stdout:9/723: fsync d4/d4b/dac/fc1 0 2024-04-25T22:03:21.489 INFO:tasks.workunit.client.0.smithi044.stdout:1/529: chown d3/d30/d3f/c44 5736 1 2024-04-25T22:03:21.491 INFO:tasks.workunit.client.0.smithi044.stdout:9/724: readlink d4/d3d/da5/ld0 0 2024-04-25T22:03:21.493 INFO:tasks.workunit.client.0.smithi044.stdout:9/725: truncate d4/f40 100628 0 2024-04-25T22:03:21.494 INFO:tasks.workunit.client.0.smithi044.stdout:6/741: link d2/d23/d5a/d12/d1f/d94/dc8/dfa/dd7/ffe d2/f100 0 2024-04-25T22:03:21.495 INFO:tasks.workunit.client.0.smithi044.stdout:5/603: write d2/f4 [4860123,4638] 0 2024-04-25T22:03:21.496 INFO:tasks.workunit.client.0.smithi044.stdout:6/742: mkdir d2/d23/d5a/d12/d1f/d94/dc8/dfa/df2/d101 0 2024-04-25T22:03:21.496 INFO:tasks.workunit.client.0.smithi044.stdout:9/726: truncate d4/d3d/d58/dd2/fd7 809370 0 2024-04-25T22:03:21.497 INFO:tasks.workunit.client.0.smithi044.stdout:5/604: creat d2/d5/d27/d2a/d5c/fc0 x:0 0 0 2024-04-25T22:03:21.497 INFO:tasks.workunit.client.0.smithi044.stdout:9/727: fsync d4/d3d/d66/d93/fe6 0 2024-04-25T22:03:21.498 INFO:tasks.workunit.client.0.smithi044.stdout:4/550: dread dd/d35/d52/f5b [0,4194304] 0 2024-04-25T22:03:21.499 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:21.500 INFO:tasks.workunit.client.0.smithi044.stdout:9/728: fdatasync d4/d4b/dac/fc1 0 2024-04-25T22:03:21.500 INFO:tasks.workunit.client.0.smithi044.stdout:6/743: truncate d2/d23/d5a/d11/d2a/dbf/f97 5232072 0 2024-04-25T22:03:21.500 INFO:tasks.workunit.client.0.smithi044.stdout:1/530: dwrite d3/d7/d81/f8a [0,4194304] 0 2024-04-25T22:03:21.500 INFO:tasks.workunit.client.0.smithi044.stdout:4/551: mknod dd/d19/daf/cb4 0 2024-04-25T22:03:21.500 INFO:tasks.workunit.client.0.smithi044.stdout:9/729: chown d4/d7/l1e 13930 1 2024-04-25T22:03:21.500 INFO:tasks.workunit.client.0.smithi044.stdout:9/730: chown d4/d7/d18/l28 66515 1 2024-04-25T22:03:21.501 INFO:tasks.workunit.client.0.smithi044.stdout:4/552: symlink dd/lb5 0 2024-04-25T22:03:21.501 INFO:tasks.workunit.client.0.smithi044.stdout:6/744: truncate d2/d23/d5a/d12/d49/fe7 1108681 0 2024-04-25T22:03:21.501 INFO:tasks.workunit.client.0.smithi044.stdout:9/731: dread - d4/d3d/fcc zero size 2024-04-25T22:03:21.501 INFO:tasks.workunit.client.0.smithi044.stdout:4/553: mkdir dd/d19/d72/db6 0 2024-04-25T22:03:21.502 INFO:tasks.workunit.client.0.smithi044.stdout:1/531: getdents d3/d7/db/d5d/d7f/d97 0 2024-04-25T22:03:21.503 INFO:tasks.workunit.client.0.smithi044.stdout:6/745: rmdir d2/d23/d5a/d12/d27/daf 39 2024-04-25T22:03:21.504 INFO:tasks.workunit.client.0.smithi044.stdout:9/732: truncate d4/d7/d18/d2e/f34 5232189 0 2024-04-25T22:03:21.505 INFO:tasks.workunit.client.0.smithi044.stdout:4/554: creat dd/d19/d72/d79/fb7 x:0 0 0 2024-04-25T22:03:21.505 INFO:tasks.workunit.client.0.smithi044.stdout:1/532: fdatasync d3/d7/d29/d43/fa1 0 2024-04-25T22:03:21.507 INFO:tasks.workunit.client.0.smithi044.stdout:6/746: symlink d2/d23/d5a/d12/d27/daf/dcb/dc2/l102 0 2024-04-25T22:03:21.507 INFO:tasks.workunit.client.0.smithi044.stdout:4/555: truncate dd/f6c 34375 0 2024-04-25T22:03:21.507 INFO:tasks.workunit.client.0.smithi044.stdout:5/605: dwrite d2/d5/d21/d26/d2c/d37/fb4 [0,4194304] 0 2024-04-25T22:03:21.507 INFO:tasks.workunit.client.0.smithi044.stdout:8/784: dread d2a/d32/f3d [0,4194304] 0 2024-04-25T22:03:21.508 INFO:tasks.workunit.client.0.smithi044.stdout:6/747: readlink d2/d23/d5a/d13/d68/l65 0 2024-04-25T22:03:21.508 INFO:tasks.workunit.client.0.smithi044.stdout:9/733: rename d4/d7/d18/d3a/dca to d4/d3d/d66/db9/dbe/df5 0 2024-04-25T22:03:21.508 INFO:tasks.workunit.client.0.smithi044.stdout:8/785: unlink f8 0 2024-04-25T22:03:21.508 INFO:tasks.workunit.client.0.smithi044.stdout:6/748: readlink d2/d23/d5a/l7c 0 2024-04-25T22:03:21.509 INFO:tasks.workunit.client.0.smithi044.stdout:5/606: chown d2/d5/d27/d2a/c6f 1 1 2024-04-25T22:03:21.509 INFO:tasks.workunit.client.0.smithi044.stdout:8/786: rmdir d2a/d39/d42/d80 39 2024-04-25T22:03:21.509 INFO:tasks.workunit.client.0.smithi044.stdout:5/607: chown d2/d5/f9 5842610 1 2024-04-25T22:03:21.510 INFO:tasks.workunit.client.0.smithi044.stdout:6/749: getdents d2/d23/d5a/d11/d3b/dc6 0 2024-04-25T22:03:21.513 INFO:tasks.workunit.client.0.smithi044.stdout:6/750: truncate d2/d23/d5a/d12/d27/daf/dcb/dc2/fe6 825711 0 2024-04-25T22:03:21.515 INFO:tasks.workunit.client.0.smithi044.stdout:6/751: unlink d2/d23/d5a/d12/d27/daf/ff3 0 2024-04-25T22:03:21.516 INFO:tasks.workunit.client.0.smithi044.stdout:9/734: dwrite d4/d3d/d58/dd2/fd7 [0,4194304] 0 2024-04-25T22:03:21.517 INFO:tasks.workunit.client.0.smithi044.stdout:6/752: fsync d2/d23/d5a/d12/f46 0 2024-04-25T22:03:21.517 INFO:tasks.workunit.client.0.smithi044.stdout:8/787: dwrite d2a/d39/d42/d68/d6b/f56 [0,4194304] 0 2024-04-25T22:03:21.518 INFO:tasks.workunit.client.0.smithi044.stdout:9/735: truncate d4/d7/d79/fc0 789087 0 2024-04-25T22:03:21.519 INFO:tasks.workunit.client.0.smithi044.stdout:6/753: mknod d2/d23/d5a/d12/d1f/d94/dc8/dfa/c103 0 2024-04-25T22:03:21.519 INFO:tasks.workunit.client.0.smithi044.stdout:8/788: symlink d2a/d39/d5a/d8e/l109 0 2024-04-25T22:03:21.520 INFO:tasks.workunit.client.0.smithi044.stdout:9/736: mknod d4/d3d/d58/dd2/cf6 0 2024-04-25T22:03:21.521 INFO:tasks.workunit.client.0.smithi044.stdout:6/754: mknod d2/d23/d5a/d12/d1f/c104 0 2024-04-25T22:03:21.522 INFO:tasks.workunit.client.0.smithi044.stdout:6/755: write d2/d23/d5a/d12/d27/daf/dcb/d5e/db5/fc5 [307458,27084] 0 2024-04-25T22:03:21.523 INFO:tasks.workunit.client.0.smithi044.stdout:6/756: rmdir d2/d23/d5a/d11/d3b 39 2024-04-25T22:03:21.524 INFO:tasks.workunit.client.0.smithi044.stdout:6/757: fsync d2/d23/d5a/d13/d68/d8e/fac 0 2024-04-25T22:03:21.526 INFO:tasks.workunit.client.0.smithi044.stdout:2/569: dread d7/d16/d2c/f3b [0,4194304] 0 2024-04-25T22:03:21.526 INFO:tasks.workunit.client.0.smithi044.stdout:2/570: symlink d7/d8/d1c/d77/lbb 0 2024-04-25T22:03:21.527 INFO:tasks.workunit.client.0.smithi044.stdout:3/631: sync 2024-04-25T22:03:21.527 INFO:tasks.workunit.client.0.smithi044.stdout:0/558: sync 2024-04-25T22:03:21.528 INFO:tasks.workunit.client.0.smithi044.stdout:2/571: read f0 [1698120,19004] 0 2024-04-25T22:03:21.529 INFO:tasks.workunit.client.0.smithi044.stdout:2/572: stat d7/d16/d4b/f72 0 2024-04-25T22:03:21.530 INFO:tasks.workunit.client.0.smithi044.stdout:3/632: rename d0/d1/d15/d51/dd/d11/d43 to d0/d1/d15/d51/dd/d35/dc6 0 2024-04-25T22:03:21.531 INFO:tasks.workunit.client.0.smithi044.stdout:2/573: symlink d7/d7b/d81/d4e/d86/d6b/lbc 0 2024-04-25T22:03:21.531 INFO:tasks.workunit.client.0.smithi044.stdout:6/758: dread d2/d23/d30/f3e [0,4194304] 0 2024-04-25T22:03:21.531 INFO:tasks.workunit.client.0.smithi044.stdout:2/574: write d7/d8/d1c/f67 [8131873,47591] 0 2024-04-25T22:03:21.532 INFO:tasks.workunit.client.0.smithi044.stdout:6/759: getdents d2/d23/d5a/d12/d27/daf/dcb/d5e/d92 0 2024-04-25T22:03:21.533 INFO:tasks.workunit.client.0.smithi044.stdout:8/789: dread d2a/d39/f104 [0,4194304] 0 2024-04-25T22:03:21.534 INFO:tasks.workunit.client.0.smithi044.stdout:8/790: mknod d2a/d82/db6/c10a 0 2024-04-25T22:03:21.534 INFO:tasks.workunit.client.0.smithi044.stdout:7/436: dread f12 [0,4194304] 0 2024-04-25T22:03:21.537 INFO:tasks.workunit.client.0.smithi044.stdout:1/533: dread d3/d7/d29/d43/f52 [0,4194304] 0 2024-04-25T22:03:21.539 INFO:tasks.workunit.client.0.smithi044.stdout:2/575: dwrite d7/d7b/d81/f79 [0,4194304] 0 2024-04-25T22:03:21.540 INFO:tasks.workunit.client.0.smithi044.stdout:1/534: rename d3/d4b/c67 to d3/d54/d76/ca7 0 2024-04-25T22:03:21.540 INFO:tasks.workunit.client.0.smithi044.stdout:2/576: symlink d7/d7b/d81/d4e/lbd 0 2024-04-25T22:03:21.541 INFO:tasks.workunit.client.0.smithi044.stdout:2/577: rmdir d7/d16/d2c/d50 39 2024-04-25T22:03:21.541 INFO:tasks.workunit.client.0.smithi044.stdout:5/608: dread d2/d5/d21/d38/d7c/faf [0,4194304] 0 2024-04-25T22:03:21.542 INFO:tasks.workunit.client.0.smithi044.stdout:1/535: rename d3/l6e to d3/d7/d29/d43/la8 0 2024-04-25T22:03:21.542 INFO:tasks.workunit.client.0.smithi044.stdout:5/609: stat d2/d5/d21/d38/f53 0 2024-04-25T22:03:21.542 INFO:tasks.workunit.client.0.smithi044.stdout:0/559: truncate d8/da/d55/f6d 1355124 0 2024-04-25T22:03:21.543 INFO:tasks.workunit.client.0.smithi044.stdout:7/437: truncate d1c/d22/d28/f3d 3478818 0 2024-04-25T22:03:21.543 INFO:tasks.workunit.client.0.smithi044.stdout:0/560: mknod d8/d24/cb1 0 2024-04-25T22:03:21.544 INFO:tasks.workunit.client.0.smithi044.stdout:5/610: readlink d2/d5/d27/d2a/d5c/d5f/l71 0 2024-04-25T22:03:21.544 INFO:tasks.workunit.client.0.smithi044.stdout:7/438: mknod d1c/d22/d28/d57/d7c/c82 0 2024-04-25T22:03:21.545 INFO:tasks.workunit.client.0.smithi044.stdout:7/439: write d1c/f3a [246611,99021] 0 2024-04-25T22:03:21.545 INFO:tasks.workunit.client.0.smithi044.stdout:5/611: mkdir d2/dc1 0 2024-04-25T22:03:21.546 INFO:tasks.workunit.client.0.smithi044.stdout:7/440: stat d1c/f47 0 2024-04-25T22:03:21.546 INFO:tasks.workunit.client.0.smithi044.stdout:5/612: readlink d2/d35/l85 0 2024-04-25T22:03:21.546 INFO:tasks.workunit.client.0.smithi044.stdout:9/737: dread d4/d7/d18/d3a/d8b/f90 [0,4194304] 0 2024-04-25T22:03:21.547 INFO:tasks.workunit.client.0.smithi044.stdout:4/556: dread fa [0,4194304] 0 2024-04-25T22:03:21.547 INFO:tasks.workunit.client.0.smithi044.stdout:7/441: rmdir d1c/d22/d28/d66 39 2024-04-25T22:03:21.547 INFO:tasks.workunit.client.0.smithi044.stdout:5/613: mknod d2/d5/d21/cc2 0 2024-04-25T22:03:21.548 INFO:tasks.workunit.client.0.smithi044.stdout:9/738: write d4/d3d/fd1 [8136604,97865] 0 2024-04-25T22:03:21.548 INFO:tasks.workunit.client.0.smithi044.stdout:7/442: mkdir d1c/d22/d28/d30/d32/d5d/d83 0 2024-04-25T22:03:21.548 INFO:tasks.workunit.client.0.smithi044.stdout:5/614: dread - d2/d5/d27/d2a/d3a/fa6 zero size 2024-04-25T22:03:21.548 INFO:tasks.workunit.client.0.smithi044.stdout:4/557: creat dd/d19/d72/db6/fb8 x:0 0 0 2024-04-25T22:03:21.550 INFO:tasks.workunit.client.0.smithi044.stdout:7/443: creat d1c/d22/d28/d30/f84 x:0 0 0 2024-04-25T22:03:21.550 INFO:tasks.workunit.client.0.smithi044.stdout:9/739: getdents d4/d3d/d66/ddd 0 2024-04-25T22:03:21.550 INFO:tasks.workunit.client.0.smithi044.stdout:1/536: dwrite d3/d7/f20 [0,4194304] 0 2024-04-25T22:03:21.551 INFO:tasks.workunit.client.0.smithi044.stdout:0/561: dread d8/df/f40 [0,4194304] 0 2024-04-25T22:03:21.552 INFO:tasks.workunit.client.0.smithi044.stdout:7/444: unlink d1c/d22/d28/d30/c74 0 2024-04-25T22:03:21.553 INFO:tasks.workunit.client.0.smithi044.stdout:7/445: truncate d1c/d22/f49 1199385 0 2024-04-25T22:03:21.554 INFO:tasks.workunit.client.0.smithi044.stdout:5/615: dread d2/d5/f88 [0,4194304] 0 2024-04-25T22:03:21.555 INFO:tasks.workunit.client.0.smithi044.stdout:5/616: chown d2/ca 250145 1 2024-04-25T22:03:21.555 INFO:tasks.workunit.client.0.smithi044.stdout:1/537: mknod d3/d7/d83/ca9 0 2024-04-25T22:03:21.556 INFO:tasks.workunit.client.0.smithi044.stdout:7/446: creat d1c/d22/d28/d4e/d7b/f85 x:0 0 0 2024-04-25T22:03:21.556 INFO:tasks.workunit.client.0.smithi044.stdout:0/562: rename d8/df/d17/d45/d4f to d8/db2 0 2024-04-25T22:03:21.556 INFO:tasks.workunit.client.0.smithi044.stdout:4/558: dwrite dd/d19/d72/da0/fa2 [0,4194304] 0 2024-04-25T22:03:21.557 INFO:tasks.workunit.client.0.smithi044.stdout:0/563: mknod d8/cb3 0 2024-04-25T22:03:21.557 INFO:tasks.workunit.client.0.smithi044.stdout:7/447: mkdir d1c/d22/d28/d66/d86 0 2024-04-25T22:03:21.558 INFO:tasks.workunit.client.0.smithi044.stdout:4/559: creat dd/d19/d91/fb9 x:0 0 0 2024-04-25T22:03:21.558 INFO:tasks.workunit.client.0.smithi044.stdout:5/617: link d2/d35/ca2 d2/d5/d27/d2a/d70/cc3 0 2024-04-25T22:03:21.558 INFO:tasks.workunit.client.0.smithi044.stdout:7/448: rmdir d1c/d22/d28 39 2024-04-25T22:03:21.560 INFO:tasks.workunit.client.0.smithi044.stdout:4/560: symlink dd/d19/d91/lba 0 2024-04-25T22:03:21.561 INFO:tasks.workunit.client.0.smithi044.stdout:8/791: sync 2024-04-25T22:03:21.561 INFO:tasks.workunit.client.0.smithi044.stdout:1/538: sync 2024-04-25T22:03:21.561 INFO:tasks.workunit.client.0.smithi044.stdout:2/578: sync 2024-04-25T22:03:21.561 INFO:tasks.workunit.client.0.smithi044.stdout:1/539: sync 2024-04-25T22:03:21.562 INFO:tasks.workunit.client.0.smithi044.stdout:8/792: chown f24 480316 1 2024-04-25T22:03:21.562 INFO:tasks.workunit.client.0.smithi044.stdout:4/561: chown dd/d35/d52/d61/d76/fb1 1784855323 1 2024-04-25T22:03:21.563 INFO:tasks.workunit.client.0.smithi044.stdout:1/540: unlink d3/d72/ca0 0 2024-04-25T22:03:21.563 INFO:tasks.workunit.client.0.smithi044.stdout:2/579: chown d7/d7b/d81/d4e/d86/f2f 371929437 1 2024-04-25T22:03:21.564 INFO:tasks.workunit.client.0.smithi044.stdout:6/760: dread d2/d23/d5a/d12/d1f/fa4 [0,4194304] 0 2024-04-25T22:03:21.564 INFO:tasks.workunit.client.0.smithi044.stdout:1/541: rmdir d3 39 2024-04-25T22:03:21.566 INFO:tasks.workunit.client.0.smithi044.stdout:8/793: write d2a/d39/d42/d68/d6b/d6e/d84/f96 [2943906,75859] 0 2024-04-25T22:03:21.567 INFO:tasks.workunit.client.0.smithi044.stdout:6/761: chown d2/d23/d6a/fe9 1165 1 2024-04-25T22:03:21.567 INFO:tasks.workunit.client.0.smithi044.stdout:5/618: dwrite d2/d5/f9 [0,4194304] 0 2024-04-25T22:03:21.569 INFO:tasks.workunit.client.0.smithi044.stdout:2/580: unlink d7/d16/d4b/lac 0 2024-04-25T22:03:21.569 INFO:tasks.workunit.client.0.smithi044.stdout:7/449: dwrite d1c/d22/d28/d57/f60 [0,4194304] 0 2024-04-25T22:03:21.569 INFO:tasks.workunit.client.0.smithi044.stdout:6/762: mkdir d2/d105 0 2024-04-25T22:03:21.569 INFO:tasks.workunit.client.0.smithi044.stdout:7/450: readlink d1c/l26 0 2024-04-25T22:03:21.569 INFO:tasks.workunit.client.0.smithi044.stdout:3/633: dread d0/f31 [0,4194304] 0 2024-04-25T22:03:21.571 INFO:tasks.workunit.client.0.smithi044.stdout:5/619: symlink d2/d5/d21/lc4 0 2024-04-25T22:03:21.571 INFO:tasks.workunit.client.0.smithi044.stdout:6/763: chown d2/d23/d5a/d11/f21 14654 1 2024-04-25T22:03:21.572 INFO:tasks.workunit.client.0.smithi044.stdout:3/634: mkdir d0/d1/d34/d48/dc7 0 2024-04-25T22:03:21.572 INFO:tasks.workunit.client.0.smithi044.stdout:7/451: creat d1c/d22/d28/d30/d32/d5d/f87 x:0 0 0 2024-04-25T22:03:21.573 INFO:tasks.workunit.client.0.smithi044.stdout:5/620: write d2/d5/f16 [3636949,122452] 0 2024-04-25T22:03:21.574 INFO:tasks.workunit.client.0.smithi044.stdout:1/542: dread d3/d7/f57 [0,4194304] 0 2024-04-25T22:03:21.575 INFO:tasks.workunit.client.0.smithi044.stdout:8/794: read d2a/d32/f35 [764566,111497] 0 2024-04-25T22:03:21.576 INFO:tasks.workunit.client.0.smithi044.stdout:2/581: truncate d7/d16/d2c/f3b 2008841 0 2024-04-25T22:03:21.576 INFO:tasks.workunit.client.0.smithi044.stdout:4/562: dwrite dd/d19/d72/d79/d7f/d81/f77 [0,4194304] 0 2024-04-25T22:03:21.576 INFO:tasks.workunit.client.0.smithi044.stdout:5/621: mkdir d2/d5/d21/d38/dc5 0 2024-04-25T22:03:21.576 INFO:tasks.workunit.client.0.smithi044.stdout:8/795: stat d2a/d52/dd6 0 2024-04-25T22:03:21.577 INFO:tasks.workunit.client.0.smithi044.stdout:3/635: truncate d0/d1/d15/d23/f40 3316498 0 2024-04-25T22:03:21.578 INFO:tasks.workunit.client.0.smithi044.stdout:8/796: read - d2a/d39/d42/d68/fd9 zero size 2024-04-25T22:03:21.579 INFO:tasks.workunit.client.0.smithi044.stdout:1/543: link d3/d7/f8 d3/d7/db/d5d/d7f/faa 0 2024-04-25T22:03:21.581 INFO:tasks.workunit.client.0.smithi044.stdout:4/563: getdents dd/d19/d72/d79/d7f 0 2024-04-25T22:03:21.582 INFO:tasks.workunit.client.0.smithi044.stdout:6/764: dwrite d2/d23/d5a/d11/d3b/f71 [0,4194304] 0 2024-04-25T22:03:21.583 INFO:tasks.workunit.client.0.smithi044.stdout:8/797: truncate d2a/d32/d3e/f44 693392 0 2024-04-25T22:03:21.583 INFO:tasks.workunit.client.0.smithi044.stdout:7/452: dwrite d1c/d22/d28/d4e/d7b/f85 [0,4194304] 0 2024-04-25T22:03:21.585 INFO:tasks.workunit.client.0.smithi044.stdout:4/564: chown dd/d35/d52/c7a 2468 1 2024-04-25T22:03:21.585 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:21.580+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:21.586 INFO:tasks.workunit.client.0.smithi044.stdout:1/544: link d3/d59/d5c/f62 d3/d7/d83/fab 0 2024-04-25T22:03:21.586 INFO:tasks.workunit.client.0.smithi044.stdout:6/765: chown d2/d23/d5a/d12/dce/lfb 14 1 2024-04-25T22:03:21.587 INFO:tasks.workunit.client.0.smithi044.stdout:4/565: creat dd/d19/d72/fbb x:0 0 0 2024-04-25T22:03:21.587 INFO:tasks.workunit.client.0.smithi044.stdout:2/582: dwrite d7/d8/f62 [0,4194304] 0 2024-04-25T22:03:21.588 INFO:tasks.workunit.client.0.smithi044.stdout:5/622: dwrite d2/d5/d21/d26/d2c/d37/f58 [0,4194304] 0 2024-04-25T22:03:21.588 INFO:tasks.workunit.client.0.smithi044.stdout:7/453: write d1c/f50 [245519,25974] 0 2024-04-25T22:03:21.588 INFO:tasks.workunit.client.0.smithi044.stdout:9/740: dread d4/d7/d18/f5a [0,4194304] 0 2024-04-25T22:03:21.588 INFO:tasks.workunit.client.0.smithi044.stdout:6/766: chown d2/d23/d5a/ff8 5231459 1 2024-04-25T22:03:21.591 INFO:tasks.workunit.client.0.smithi044.stdout:9/741: mkdir d4/d3d/d58/dd2/df7 0 2024-04-25T22:03:21.592 INFO:tasks.workunit.client.0.smithi044.stdout:5/623: getdents d2/d5b/d8e 0 2024-04-25T22:03:21.592 INFO:tasks.workunit.client.0.smithi044.stdout:4/566: symlink dd/lbc 0 2024-04-25T22:03:21.595 INFO:tasks.workunit.client.0.smithi044.stdout:4/567: readlink dd/d35/l4d 0 2024-04-25T22:03:21.595 INFO:tasks.workunit.client.0.smithi044.stdout:0/564: dread d8/d20/f31 [0,4194304] 0 2024-04-25T22:03:21.595 INFO:tasks.workunit.client.0.smithi044.stdout:9/742: unlink d4/d3d/d66/db9/lcf 0 2024-04-25T22:03:21.595 INFO:tasks.workunit.client.0.smithi044.stdout:1/545: link d3/d7/d81/c87 d3/d7/db/d5d/d7f/cac 0 2024-04-25T22:03:21.596 INFO:tasks.workunit.client.0.smithi044.stdout:2/583: fsync d7/d7b/d81/d4e/d86/d6b/d78/f56 0 2024-04-25T22:03:21.596 INFO:tasks.workunit.client.0.smithi044.stdout:4/568: fdatasync dd/f69 0 2024-04-25T22:03:21.597 INFO:tasks.workunit.client.0.smithi044.stdout:9/743: fsync d4/d7/d18/d2e/d73/f7c 0 2024-04-25T22:03:21.597 INFO:tasks.workunit.client.0.smithi044.stdout:4/569: mknod dd/cbd 0 2024-04-25T22:03:21.598 INFO:tasks.workunit.client.0.smithi044.stdout:8/798: dwrite d2a/d39/d42/d68/d6b/d6e/fd3 [0,4194304] 0 2024-04-25T22:03:21.599 INFO:tasks.workunit.client.0.smithi044.stdout:7/454: dwrite d1c/d22/d28/d4e/f73 [0,4194304] 0 2024-04-25T22:03:21.599 INFO:tasks.workunit.client.0.smithi044.stdout:2/584: rename d7/d7b/d81/f79 to d7/d8/d5f/fbe 0 2024-04-25T22:03:21.599 INFO:tasks.workunit.client.0.smithi044.stdout:1/546: truncate d3/d7/db/d8f/fa5 352227 0 2024-04-25T22:03:21.599 INFO:tasks.workunit.client.0.smithi044.stdout:4/570: stat dd/d35/d52/f5b 0 2024-04-25T22:03:21.599 INFO:tasks.workunit.client.0.smithi044.stdout:0/565: write d8/df/d17/d45/d95/d51/d8b/f97 [130944,53028] 0 2024-04-25T22:03:21.601 INFO:tasks.workunit.client.0.smithi044.stdout:8/799: chown d2a/d52/fb3 14035 1 2024-04-25T22:03:21.601 INFO:tasks.workunit.client.0.smithi044.stdout:7/455: rmdir d1c/d22/d28/d4e/d6a 39 2024-04-25T22:03:21.601 INFO:tasks.workunit.client.0.smithi044.stdout:9/744: fsync d4/d3d/d66/db9/dbe/df5/fe2 0 2024-04-25T22:03:21.602 INFO:tasks.workunit.client.0.smithi044.stdout:9/745: symlink d4/d7/d18/d3a/lf8 0 2024-04-25T22:03:21.603 INFO:tasks.workunit.client.0.smithi044.stdout:0/566: link d8/d20/c5f d8/db2/d8e/cb4 0 2024-04-25T22:03:21.603 INFO:tasks.workunit.client.0.smithi044.stdout:7/456: write d1c/d22/d28/d30/d32/d5d/f7e [375972,6737] 0 2024-04-25T22:03:21.604 INFO:tasks.workunit.client.0.smithi044.stdout:2/585: rename d7/d16/d2c/d50/l93 to d7/d7b/d81/d4e/d86/d6b/d78/d44/dad/lbf 0 2024-04-25T22:03:21.604 INFO:tasks.workunit.client.0.smithi044.stdout:5/624: dwrite d2/d5/f17 [0,4194304] 0 2024-04-25T22:03:21.605 INFO:tasks.workunit.client.0.smithi044.stdout:0/567: write d8/df/d17/d45/d95/f1f [872807,93843] 0 2024-04-25T22:03:21.606 INFO:tasks.workunit.client.0.smithi044.stdout:7/457: getdents d1c/d22/d28/d57/d7c 0 2024-04-25T22:03:21.606 INFO:tasks.workunit.client.0.smithi044.stdout:9/746: link d4/l77 d4/d7/d79/ddc/lf9 0 2024-04-25T22:03:21.608 INFO:tasks.workunit.client.0.smithi044.stdout:7/458: mkdir d1c/d88 0 2024-04-25T22:03:21.608 INFO:tasks.workunit.client.0.smithi044.stdout:0/568: mknod d8/da/d60/d86/cb5 0 2024-04-25T22:03:21.608 INFO:tasks.workunit.client.0.smithi044.stdout:1/547: dwrite d3/d72/f9b [0,4194304] 0 2024-04-25T22:03:21.608 INFO:tasks.workunit.client.0.smithi044.stdout:9/747: rmdir d4/d3d/d66/db9/dbe/dce 39 2024-04-25T22:03:21.610 INFO:tasks.workunit.client.0.smithi044.stdout:3/636: write d0/d1/d34/d48/f5f [967093,84499] 0 2024-04-25T22:03:21.610 INFO:tasks.workunit.client.0.smithi044.stdout:7/459: symlink d1c/d22/d28/d4e/l89 0 2024-04-25T22:03:21.610 INFO:tasks.workunit.client.0.smithi044.stdout:6/767: sync 2024-04-25T22:03:21.611 INFO:tasks.workunit.client.0.smithi044.stdout:8/800: dwrite d2a/d39/d42/d68/d6b/d6e/fb2 [0,4194304] 0 2024-04-25T22:03:21.612 INFO:tasks.workunit.client.0.smithi044.stdout:7/460: truncate d1c/f45 1409944 0 2024-04-25T22:03:21.612 INFO:tasks.workunit.client.0.smithi044.stdout:3/637: creat d0/d1/d15/df/d5d/fc8 x:0 0 0 2024-04-25T22:03:21.612 INFO:tasks.workunit.client.0.smithi044.stdout:1/548: link d3/d7/d29/d43/d85/f9e d3/d7/db/d5d/d7f/d97/d99/fad 0 2024-04-25T22:03:21.613 INFO:tasks.workunit.client.0.smithi044.stdout:7/461: rmdir d1c/d22 39 2024-04-25T22:03:21.613 INFO:tasks.workunit.client.0.smithi044.stdout:8/801: getdents d2a/d52/dd6 0 2024-04-25T22:03:21.613 INFO:tasks.workunit.client.0.smithi044.stdout:1/549: write d3/d59/d5c/f74 [322289,16640] 0 2024-04-25T22:03:21.614 INFO:tasks.workunit.client.0.smithi044.stdout:7/462: write d1c/d22/d28/d30/f36 [961235,89842] 0 2024-04-25T22:03:21.620 INFO:tasks.workunit.client.0.smithi044.stdout:2/586: truncate d7/d16/d2c/f6d 3909313 0 2024-04-25T22:03:21.620 INFO:tasks.workunit.client.0.smithi044.stdout:7/463: getdents d1c/d22/d28/d4e 0 2024-04-25T22:03:21.620 INFO:tasks.workunit.client.0.smithi044.stdout:3/638: write d0/f38 [2475938,45545] 0 2024-04-25T22:03:21.621 INFO:tasks.workunit.client.0.smithi044.stdout:2/587: symlink d7/lc0 0 2024-04-25T22:03:21.622 INFO:tasks.workunit.client.0.smithi044.stdout:8/802: dread d2a/f45 [0,4194304] 0 2024-04-25T22:03:21.622 INFO:tasks.workunit.client.0.smithi044.stdout:7/464: rename d1c/f21 to d1c/d22/d28/d30/d32/f8a 0 2024-04-25T22:03:21.623 INFO:tasks.workunit.client.0.smithi044.stdout:8/803: fdatasync d2a/d52/fb3 0 2024-04-25T22:03:21.624 INFO:tasks.workunit.client.0.smithi044.stdout:3/639: rename d0/d13/f7f to d0/d70/d7c/da9/fc9 0 2024-04-25T22:03:21.624 INFO:tasks.workunit.client.0.smithi044.stdout:6/768: dwrite d2/d23/d5a/d12/d49/ffd [0,4194304] 0 2024-04-25T22:03:21.624 INFO:tasks.workunit.client.0.smithi044.stdout:8/804: creat d2a/d32/d3e/dd0/ddc/f10b x:0 0 0 2024-04-25T22:03:21.626 INFO:tasks.workunit.client.0.smithi044.stdout:8/805: write d2a/d39/d5a/d8e/ff5 [265489,73852] 0 2024-04-25T22:03:21.626 INFO:tasks.workunit.client.0.smithi044.stdout:8/806: write d2a/d32/d57/d5e/fb4 [303973,84963] 0 2024-04-25T22:03:21.632 INFO:tasks.workunit.client.0.smithi044.stdout:6/769: dwrite d2/d23/d5a/d12/d27/daf/dcb/d5e/d9c/fcc [4194304,4194304] 0 2024-04-25T22:03:21.633 INFO:tasks.workunit.client.0.smithi044.stdout:8/807: dwrite f17 [0,4194304] 0 2024-04-25T22:03:21.633 INFO:tasks.workunit.client.0.smithi044.stdout:5/625: dread d2/d5/d21/f2d [0,4194304] 0 2024-04-25T22:03:21.634 INFO:tasks.workunit.client.0.smithi044.stdout:8/808: readlink d2a/d39/d42/d68/d6b/d6e/d84/lff 0 2024-04-25T22:03:21.634 INFO:tasks.workunit.client.0.smithi044.stdout:5/626: dread - d2/d5/d21/d26/d2c/f97 zero size 2024-04-25T22:03:21.635 INFO:tasks.workunit.client.0.smithi044.stdout:6/770: getdents d2/d23/d5a/d11/d2a 0 2024-04-25T22:03:21.635 INFO:tasks.workunit.client.0.smithi044.stdout:5/627: chown d2/d5/d27/d2a/d70 991540 1 2024-04-25T22:03:21.635 INFO:tasks.workunit.client.0.smithi044.stdout:8/809: symlink d2a/d82/db6/dd2/l10c 0 2024-04-25T22:03:21.635 INFO:tasks.workunit.client.0.smithi044.stdout:6/771: fdatasync d2/d23/d6a/fe9 0 2024-04-25T22:03:21.635 INFO:tasks.workunit.client.0.smithi044.stdout:5/628: write d2/d5/d6a/f6e [1610496,124373] 0 2024-04-25T22:03:21.636 INFO:tasks.workunit.client.0.smithi044.stdout:6/772: dread - d2/d23/d5a/d12/d27/ff9 zero size 2024-04-25T22:03:21.636 INFO:tasks.workunit.client.0.smithi044.stdout:8/810: write d2a/d39/d42/d68/d6b/f4b [3533953,72672] 0 2024-04-25T22:03:21.637 INFO:tasks.workunit.client.0.smithi044.stdout:6/773: creat d2/d23/da9/f106 x:0 0 0 2024-04-25T22:03:21.637 INFO:tasks.workunit.client.0.smithi044.stdout:8/811: creat d2a/d32/d3e/dd0/d107/f10d x:0 0 0 2024-04-25T22:03:21.638 INFO:tasks.workunit.client.0.smithi044.stdout:8/812: creat d2a/d82/f10e x:0 0 0 2024-04-25T22:03:21.638 INFO:tasks.workunit.client.0.smithi044.stdout:6/774: stat d2/d23/d5a/d12/d27/daf/dcb/d5e/db5/ff4 0 2024-04-25T22:03:21.639 INFO:tasks.workunit.client.0.smithi044.stdout:8/813: creat d2a/d39/d5a/d92/dab/f10f x:0 0 0 2024-04-25T22:03:21.640 INFO:tasks.workunit.client.0.smithi044.stdout:8/814: fsync d2a/f31 0 2024-04-25T22:03:21.640 INFO:tasks.workunit.client.0.smithi044.stdout:6/775: symlink d2/d23/d5a/d12/d27/daf/dcb/dc2/df6/l107 0 2024-04-25T22:03:21.641 INFO:tasks.workunit.client.0.smithi044.stdout:6/776: rmdir d2/d23/d5a/d12 39 2024-04-25T22:03:21.641 INFO:tasks.workunit.client.0.smithi044.stdout:5/629: dwrite d2/d5/f9 [0,4194304] 0 2024-04-25T22:03:21.642 INFO:tasks.workunit.client.0.smithi044.stdout:6/777: stat d2/d23/d5a/d13/ff5 0 2024-04-25T22:03:21.648 INFO:tasks.workunit.client.0.smithi044.stdout:5/630: dwrite d2/d5/d21/d26/d2c/d37/fb4 [4194304,4194304] 0 2024-04-25T22:03:21.649 INFO:tasks.workunit.client.0.smithi044.stdout:5/631: creat d2/d5/d21/d26/d2c/d37/fc6 x:0 0 0 2024-04-25T22:03:21.649 INFO:tasks.workunit.client.0.smithi044.stdout:5/632: chown d2/d5/d27/d2a 106172377 1 2024-04-25T22:03:21.649 INFO:tasks.workunit.client.0.smithi044.stdout:5/633: write d2/d5/d27/d2a/d3a/fa6 [196489,66884] 0 2024-04-25T22:03:21.650 INFO:tasks.workunit.client.0.smithi044.stdout:5/634: write d2/d5/d21/d26/d2c/d37/fc6 [259810,44497] 0 2024-04-25T22:03:21.651 INFO:tasks.workunit.client.0.smithi044.stdout:5/635: getdents d2/dad 0 2024-04-25T22:03:21.654 INFO:tasks.workunit.client.0.smithi044.stdout:7/465: truncate d1c/d22/f75 260317 0 2024-04-25T22:03:21.655 INFO:tasks.workunit.client.0.smithi044.stdout:6/778: dread d2/f75 [0,4194304] 0 2024-04-25T22:03:21.655 INFO:tasks.workunit.client.0.smithi044.stdout:7/466: write d1c/d22/d28/f58 [920695,15668] 0 2024-04-25T22:03:21.656 INFO:tasks.workunit.client.0.smithi044.stdout:7/467: rename d1c/f45 to d1c/d22/d28/d57/f8b 0 2024-04-25T22:03:21.656 INFO:tasks.workunit.client.0.smithi044.stdout:6/779: mknod d2/d23/d5a/d12/d27/daf/dcb/d5e/db5/c108 0 2024-04-25T22:03:21.656 INFO:tasks.workunit.client.0.smithi044.stdout:3/640: dread d0/d1/d15/d23/d60/f9a [0,4194304] 0 2024-04-25T22:03:21.657 INFO:tasks.workunit.client.0.smithi044.stdout:7/468: creat d1c/d22/d28/d4e/d6a/f8c x:0 0 0 2024-04-25T22:03:21.657 INFO:tasks.workunit.client.0.smithi044.stdout:6/780: stat d2/d23/d5a/d12/d27/daf/dcb/fb4 0 2024-04-25T22:03:21.657 INFO:tasks.workunit.client.0.smithi044.stdout:7/469: symlink d1c/d22/d28/l8d 0 2024-04-25T22:03:21.661 INFO:tasks.workunit.client.0.smithi044.stdout:0/569: sync 2024-04-25T22:03:21.662 INFO:tasks.workunit.client.0.smithi044.stdout:9/748: sync 2024-04-25T22:03:21.662 INFO:tasks.workunit.client.0.smithi044.stdout:8/815: truncate d2a/d32/f3d 3896656 0 2024-04-25T22:03:21.663 INFO:tasks.workunit.client.0.smithi044.stdout:9/749: write d4/d3d/d66/db9/dbe/df5/fe7 [127252,32539] 0 2024-04-25T22:03:21.663 INFO:tasks.workunit.client.0.smithi044.stdout:8/816: creat d2a/d39/d5a/d92/dab/f110 x:0 0 0 2024-04-25T22:03:21.663 INFO:tasks.workunit.client.0.smithi044.stdout:9/750: creat d4/d7/d18/d2e/d94/ffa x:0 0 0 2024-04-25T22:03:21.664 INFO:tasks.workunit.client.0.smithi044.stdout:8/817: truncate d2a/d39/d5a/d92/dab/f10f 905292 0 2024-04-25T22:03:21.664 INFO:tasks.workunit.client.0.smithi044.stdout:9/751: readlink d4/d7/d79/ddc/de1/l5b 0 2024-04-25T22:03:21.664 INFO:tasks.workunit.client.0.smithi044.stdout:9/752: chown d4/d3d/d58 65093 1 2024-04-25T22:03:21.665 INFO:tasks.workunit.client.0.smithi044.stdout:9/753: rmdir d4/d3d/da5/dd8 39 2024-04-25T22:03:21.665 INFO:tasks.workunit.client.0.smithi044.stdout:6/781: truncate d2/d23/d30/f53 1044292 0 2024-04-25T22:03:21.666 INFO:tasks.workunit.client.0.smithi044.stdout:0/570: dread d8/d78/fa6 [0,4194304] 0 2024-04-25T22:03:21.666 INFO:tasks.workunit.client.0.smithi044.stdout:9/754: symlink d4/d3d/da5/dd8/lfb 0 2024-04-25T22:03:21.666 INFO:tasks.workunit.client.0.smithi044.stdout:0/571: write d8/f9f [430853,25239] 0 2024-04-25T22:03:21.667 INFO:tasks.workunit.client.0.smithi044.stdout:0/572: chown d8/d20/f31 1714 1 2024-04-25T22:03:21.667 INFO:tasks.workunit.client.0.smithi044.stdout:2/588: truncate d7/d8/d1c/f33 770237 0 2024-04-25T22:03:21.669 INFO:tasks.workunit.client.0.smithi044.stdout:9/755: rename d4/d7/d18/d2e/db5/fda to d4/d3d/d66/db9/dbe/ffc 0 2024-04-25T22:03:21.669 INFO:tasks.workunit.client.0.smithi044.stdout:0/573: unlink d8/df/d17/d45/d95/c3c 0 2024-04-25T22:03:21.669 INFO:tasks.workunit.client.0.smithi044.stdout:6/782: write d2/d23/f28 [2367493,62851] 0 2024-04-25T22:03:21.670 INFO:tasks.workunit.client.0.smithi044.stdout:8/818: dwrite d2a/d39/d5a/f100 [0,4194304] 0 2024-04-25T22:03:21.670 INFO:tasks.workunit.client.0.smithi044.stdout:9/756: creat d4/d3d/d66/db9/dbe/dce/ffd x:0 0 0 2024-04-25T22:03:21.670 INFO:tasks.workunit.client.0.smithi044.stdout:6/783: creat d2/d23/d5a/d13/f109 x:0 0 0 2024-04-25T22:03:21.671 INFO:tasks.workunit.client.0.smithi044.stdout:8/819: symlink d2a/d77/df9/l111 0 2024-04-25T22:03:21.671 INFO:tasks.workunit.client.0.smithi044.stdout:9/757: creat d4/d7/d18/d3a/ffe x:0 0 0 2024-04-25T22:03:21.672 INFO:tasks.workunit.client.0.smithi044.stdout:6/784: dread - d2/d23/d5a/d12/d27/daf/dcb/d5e/fde zero size 2024-04-25T22:03:21.672 INFO:tasks.workunit.client.0.smithi044.stdout:2/589: dread d7/d16/d2c/f6d [0,4194304] 0 2024-04-25T22:03:21.673 INFO:tasks.workunit.client.0.smithi044.stdout:2/590: fdatasync d7/d7b/d81/d4e/d86/f8f 0 2024-04-25T22:03:21.674 INFO:tasks.workunit.client.0.smithi044.stdout:2/591: fsync d7/d8/d48/fa1 0 2024-04-25T22:03:21.674 INFO:tasks.workunit.client.0.smithi044.stdout:8/820: fsync d2a/d32/d57/d5e/fc7 0 2024-04-25T22:03:21.674 INFO:tasks.workunit.client.0.smithi044.stdout:9/758: stat d4/d7/d79/ddc/de1/d54/d84/d72/f87 0 2024-04-25T22:03:21.674 INFO:tasks.workunit.client.0.smithi044.stdout:6/785: read d2/d23/d5a/d12/f7a [2912738,96763] 0 2024-04-25T22:03:21.677 INFO:tasks.workunit.client.0.smithi044.stdout:8/821: stat d2a/d39/d42/d68/d6b/c89 0 2024-04-25T22:03:21.677 INFO:tasks.workunit.client.0.smithi044.stdout:9/759: chown d4/d7/d79/ddc/de1/l5b 2461284 1 2024-04-25T22:03:21.677 INFO:tasks.workunit.client.0.smithi044.stdout:6/786: mkdir d2/d23/d5a/d11/d3b/dc6/d10a 0 2024-04-25T22:03:21.679 INFO:tasks.workunit.client.0.smithi044.stdout:8/822: unlink d2a/d82/fa6 0 2024-04-25T22:03:21.679 INFO:tasks.workunit.client.0.smithi044.stdout:8/823: chown d2a/d39/f55 2420467 1 2024-04-25T22:03:21.679 INFO:tasks.workunit.client.0.smithi044.stdout:6/787: creat d2/d23/d5a/d12/d27/daf/dcb/d5e/db5/f10b x:0 0 0 2024-04-25T22:03:21.679 INFO:tasks.workunit.client.0.smithi044.stdout:8/824: mknod d2a/d32/d57/c112 0 2024-04-25T22:03:21.679 INFO:tasks.workunit.client.0.smithi044.stdout:6/788: chown d2/d23/d5a/d11/d2a/cb8 911 1 2024-04-25T22:03:21.679 INFO:tasks.workunit.client.0.smithi044.stdout:6/789: fsync d2/d23/d5a/d13/f109 0 2024-04-25T22:03:21.679 INFO:tasks.workunit.client.0.smithi044.stdout:8/825: truncate d2a/d32/d57/f98 114676 0 2024-04-25T22:03:21.679 INFO:tasks.workunit.client.0.smithi044.stdout:8/826: mknod d2a/d32/d3e/dd0/ddc/c113 0 2024-04-25T22:03:21.679 INFO:tasks.workunit.client.0.smithi044.stdout:6/790: truncate d2/d23/d5a/d13/ff5 292384 0 2024-04-25T22:03:21.680 INFO:tasks.workunit.client.0.smithi044.stdout:8/827: write d2a/d39/d42/d68/d6b/d6e/d84/fd4 [321426,99211] 0 2024-04-25T22:03:21.680 INFO:tasks.workunit.client.0.smithi044.stdout:6/791: creat d2/d23/d5a/d11/f10c x:0 0 0 2024-04-25T22:03:21.680 INFO:tasks.workunit.client.0.smithi044.stdout:8/828: stat d2a/d39/d42/d80/f9a 0 2024-04-25T22:03:21.680 INFO:tasks.workunit.client.0.smithi044.stdout:6/792: readlink d2/d23/d5a/d12/d27/daf/dcb/d5e/l85 0 2024-04-25T22:03:21.680 INFO:tasks.workunit.client.0.smithi044.stdout:8/829: chown d2a/d32/f41 40179947 1 2024-04-25T22:03:21.681 INFO:tasks.workunit.client.0.smithi044.stdout:8/830: unlink c1d 0 2024-04-25T22:03:21.681 INFO:tasks.workunit.client.0.smithi044.stdout:6/793: chown d2/d23/d5a/d12/d1f/d94/dc8/lf1 8374 1 2024-04-25T22:03:21.682 INFO:tasks.workunit.client.0.smithi044.stdout:4/571: dread dd/d35/d52/d61/f73 [0,4194304] 0 2024-04-25T22:03:21.684 INFO:tasks.workunit.client.0.smithi044.stdout:4/572: rename dd/d19/c7e to dd/d19/d72/d79/d9c/cbe 0 2024-04-25T22:03:21.684 INFO:tasks.workunit.client.0.smithi044.stdout:9/760: dread d4/d7/d18/d3a/f6c [0,4194304] 0 2024-04-25T22:03:21.685 INFO:tasks.workunit.client.0.smithi044.stdout:6/794: dread d2/d23/d30/f47 [0,4194304] 0 2024-04-25T22:03:21.685 INFO:tasks.workunit.client.0.smithi044.stdout:9/761: fdatasync f3 0 2024-04-25T22:03:21.686 INFO:tasks.workunit.client.0.smithi044.stdout:4/573: dread dd/d19/f2b [0,4194304] 0 2024-04-25T22:03:21.686 INFO:tasks.workunit.client.0.smithi044.stdout:9/762: dread - d4/d3d/d66/db9/dbe/fc4 zero size 2024-04-25T22:03:21.686 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:21.684+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:21.687 INFO:tasks.workunit.client.0.smithi044.stdout:6/795: truncate d2/d23/d5a/d13/f109 479908 0 2024-04-25T22:03:21.687 INFO:tasks.workunit.client.0.smithi044.stdout:4/574: mknod dd/d35/d52/d61/d76/cbf 0 2024-04-25T22:03:21.687 INFO:tasks.workunit.client.0.smithi044.stdout:6/796: unlink d2/d23/d5a/d12/d27/daf/dcb/d5e/l9f 0 2024-04-25T22:03:21.688 INFO:tasks.workunit.client.0.smithi044.stdout:4/575: dread dd/f2a [0,4194304] 0 2024-04-25T22:03:21.689 INFO:tasks.workunit.client.0.smithi044.stdout:4/576: getdents dd/d19/d72/d9d 0 2024-04-25T22:03:21.689 INFO:tasks.workunit.client.0.smithi044.stdout:4/577: readlink dd/d35/d52/d61/lb2 0 2024-04-25T22:03:21.691 INFO:tasks.workunit.client.0.smithi044.stdout:4/578: truncate dd/d35/d52/d61/f73 1133132 0 2024-04-25T22:03:21.695 INFO:tasks.workunit.client.0.smithi044.stdout:0/574: dread d8/da/f7f [0,4194304] 0 2024-04-25T22:03:21.695 INFO:tasks.workunit.client.0.smithi044.stdout:0/575: mkdir d8/df/d88/db6 0 2024-04-25T22:03:21.696 INFO:tasks.workunit.client.0.smithi044.stdout:0/576: chown d8/df/d17/f3d 79132 1 2024-04-25T22:03:21.697 INFO:tasks.workunit.client.0.smithi044.stdout:0/577: truncate d8/da/d55/f77 570595 0 2024-04-25T22:03:21.697 INFO:tasks.workunit.client.0.smithi044.stdout:0/578: rename d8/df/d17/cab to d8/df/d88/cb7 0 2024-04-25T22:03:21.698 INFO:tasks.workunit.client.0.smithi044.stdout:0/579: unlink d8/df/d17/d45/d95/f39 0 2024-04-25T22:03:21.701 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:21.701 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:21.702 INFO:tasks.workunit.client.0.smithi044.stdout:8/831: write d2a/d82/dec/ff0 [814647,18314] 0 2024-04-25T22:03:21.703 INFO:tasks.workunit.client.0.smithi044.stdout:8/832: truncate d2a/fac 4817274 0 2024-04-25T22:03:21.703 INFO:tasks.workunit.client.0.smithi044.stdout:8/833: truncate d2a/d52/f103 907371 0 2024-04-25T22:03:21.704 INFO:tasks.workunit.client.0.smithi044.stdout:8/834: stat d2a/d32/c4c 0 2024-04-25T22:03:21.704 INFO:tasks.workunit.client.0.smithi044.stdout:0/580: dwrite d8/df/f54 [0,4194304] 0 2024-04-25T22:03:21.705 INFO:tasks.workunit.client.0.smithi044.stdout:8/835: write f2 [5459802,106415] 0 2024-04-25T22:03:21.705 INFO:tasks.workunit.client.0.smithi044.stdout:0/581: rename d8/da/da4 to d8/d78/db8 0 2024-04-25T22:03:21.706 INFO:tasks.workunit.client.0.smithi044.stdout:8/836: write d2a/d39/d5a/d92/dab/f10f [105690,50532] 0 2024-04-25T22:03:21.707 INFO:tasks.workunit.client.0.smithi044.stdout:0/582: rename d8/d24 to d8/df/d17/db9 0 2024-04-25T22:03:21.707 INFO:tasks.workunit.client.0.smithi044.stdout:8/837: unlink d2a/d82/db6/c10a 0 2024-04-25T22:03:21.708 INFO:tasks.workunit.client.0.smithi044.stdout:8/838: read - d2a/d52/ff7 zero size 2024-04-25T22:03:21.709 INFO:tasks.workunit.client.0.smithi044.stdout:9/763: dread d4/d7/f39 [0,4194304] 0 2024-04-25T22:03:21.711 INFO:tasks.workunit.client.0.smithi044.stdout:7/470: sync 2024-04-25T22:03:21.711 INFO:tasks.workunit.client.0.smithi044.stdout:3/641: sync 2024-04-25T22:03:21.711 INFO:tasks.workunit.client.0.smithi044.stdout:5/636: sync 2024-04-25T22:03:21.711 INFO:tasks.workunit.client.0.smithi044.stdout:1/550: sync 2024-04-25T22:03:21.711 INFO:tasks.workunit.client.0.smithi044.stdout:0/583: write d8/df/d17/db9/f99 [504682,123294] 0 2024-04-25T22:03:21.711 INFO:tasks.workunit.client.0.smithi044.stdout:2/592: sync 2024-04-25T22:03:21.712 INFO:tasks.workunit.client.0.smithi044.stdout:5/637: unlink d2/dad/fb6 0 2024-04-25T22:03:21.712 INFO:tasks.workunit.client.0.smithi044.stdout:6/797: dread d2/d23/d5a/d11/f60 [0,4194304] 0 2024-04-25T22:03:21.712 INFO:tasks.workunit.client.0.smithi044.stdout:9/764: truncate d4/d7/d18/d3a/d8b/f90 1992875 0 2024-04-25T22:03:21.712 INFO:tasks.workunit.client.0.smithi044.stdout:0/584: symlink d8/da/d55/lba 0 2024-04-25T22:03:21.713 INFO:tasks.workunit.client.0.smithi044.stdout:1/551: rename d3/c25 to d3/cae 0 2024-04-25T22:03:21.713 INFO:tasks.workunit.client.0.smithi044.stdout:9/765: dread - d4/fc8 zero size 2024-04-25T22:03:21.713 INFO:tasks.workunit.client.0.smithi044.stdout:6/798: read d2/d23/d5a/d11/f60 [3991966,111177] 0 2024-04-25T22:03:21.713 INFO:tasks.workunit.client.0.smithi044.stdout:0/585: creat d8/db2/fbb x:0 0 0 2024-04-25T22:03:21.714 INFO:tasks.workunit.client.0.smithi044.stdout:3/642: chown d0/d1/d15/df/l3b 351 1 2024-04-25T22:03:21.715 INFO:tasks.workunit.client.0.smithi044.stdout:2/593: read d7/f31 [3707321,39812] 0 2024-04-25T22:03:21.715 INFO:tasks.workunit.client.0.smithi044.stdout:0/586: symlink d8/df/d93/lbc 0 2024-04-25T22:03:21.716 INFO:tasks.workunit.client.0.smithi044.stdout:9/766: getdents d4/d3d/d58/dd2/df7 0 2024-04-25T22:03:21.717 INFO:tasks.workunit.client.0.smithi044.stdout:1/552: truncate d3/d30/d3f/f86 1280318 0 2024-04-25T22:03:21.717 INFO:tasks.workunit.client.0.smithi044.stdout:8/839: dwrite d2a/d32/d57/d5e/fbb [0,4194304] 0 2024-04-25T22:03:21.717 INFO:tasks.workunit.client.0.smithi044.stdout:4/579: dread dd/d19/f3d [0,4194304] 0 2024-04-25T22:03:21.717 INFO:tasks.workunit.client.0.smithi044.stdout:6/799: symlink d2/d23/d5a/d12/d27/daf/dcb/d5e/l10d 0 2024-04-25T22:03:21.718 INFO:tasks.workunit.client.0.smithi044.stdout:9/767: dread - d4/d7/d18/d3a/ffe zero size 2024-04-25T22:03:21.718 INFO:tasks.workunit.client.0.smithi044.stdout:3/643: creat d0/d1/d15/d51/d8e/d74/fca x:0 0 0 2024-04-25T22:03:21.718 INFO:tasks.workunit.client.0.smithi044.stdout:8/840: readlink d2a/d32/d57/la1 0 2024-04-25T22:03:21.718 INFO:tasks.workunit.client.0.smithi044.stdout:1/553: fsync d3/d7/db/d5d/d7f/fa4 0 2024-04-25T22:03:21.719 INFO:tasks.workunit.client.0.smithi044.stdout:4/580: creat dd/d19/d72/db6/fc0 x:0 0 0 2024-04-25T22:03:21.720 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:21.721 INFO:tasks.workunit.client.0.smithi044.stdout:9/768: rmdir d4/d7/d79/ddc/de1/d54/d84/d64 39 2024-04-25T22:03:21.721 INFO:tasks.workunit.client.0.smithi044.stdout:5/638: dwrite d2/f4 [4194304,4194304] 0 2024-04-25T22:03:21.721 INFO:tasks.workunit.client.0.smithi044.stdout:2/594: truncate d7/d7b/d81/d4e/d86/d6b/d78/dae/fb8 110210 0 2024-04-25T22:03:21.721 INFO:tasks.workunit.client.0.smithi044.stdout:9/769: stat d4/d3d/d58/dd2/cf6 0 2024-04-25T22:03:21.722 INFO:tasks.workunit.client.0.smithi044.stdout:9/770: dread - d4/d7/d18/d2e/d73/fb8 zero size 2024-04-25T22:03:21.725 INFO:tasks.workunit.client.0.smithi044.stdout:6/800: mknod d2/d23/d5a/d12/d27/daf/dcb/dc2/df6/c10e 0 2024-04-25T22:03:21.725 INFO:tasks.workunit.client.0.smithi044.stdout:5/639: fsync d2/d5/d27/f62 0 2024-04-25T22:03:21.725 INFO:tasks.workunit.client.0.smithi044.stdout:9/771: unlink d4/d7/d18/l28 0 2024-04-25T22:03:21.726 INFO:tasks.workunit.client.0.smithi044.stdout:0/587: dwrite d8/df/d17/d45/d95/d51/f84 [0,4194304] 0 2024-04-25T22:03:21.729 INFO:tasks.workunit.client.0.smithi044.stdout:1/554: link d3/d30/d3f/f68 d3/d7/db/d5d/d7f/faf 0 2024-04-25T22:03:21.730 INFO:tasks.workunit.client.0.smithi044.stdout:0/588: mkdir d8/df/d17/d45/d95/d9c/dbd 0 2024-04-25T22:03:21.730 INFO:tasks.workunit.client.0.smithi044.stdout:7/471: truncate d1c/d22/d28/d4e/f73 3157290 0 2024-04-25T22:03:21.730 INFO:tasks.workunit.client.0.smithi044.stdout:9/772: rename d4/fd5 to d4/d3d/d58/dd2/df7/fff 0 2024-04-25T22:03:21.731 INFO:tasks.workunit.client.0.smithi044.stdout:6/801: truncate d2/d23/d5a/d13/d68/f72 4105013 0 2024-04-25T22:03:21.731 INFO:tasks.workunit.client.0.smithi044.stdout:5/640: creat d2/d5/d21/d6b/fc7 x:0 0 0 2024-04-25T22:03:21.731 INFO:tasks.workunit.client.0.smithi044.stdout:1/555: chown d3/d4b 353 1 2024-04-25T22:03:21.731 INFO:tasks.workunit.client.0.smithi044.stdout:5/641: mkdir d2/d5/d21/d38/dc8 0 2024-04-25T22:03:21.732 INFO:tasks.workunit.client.0.smithi044.stdout:0/589: mkdir d8/da/d60/daa/dbe 0 2024-04-25T22:03:21.732 INFO:tasks.workunit.client.0.smithi044.stdout:1/556: chown d3/d7/l38 1372706 1 2024-04-25T22:03:21.733 INFO:tasks.workunit.client.0.smithi044.stdout:6/802: link d2/d23/d5a/d11/f16 d2/d23/d5a/d12/dce/f10f 0 2024-04-25T22:03:21.733 INFO:tasks.workunit.client.0.smithi044.stdout:5/642: mknod d2/cc9 0 2024-04-25T22:03:21.734 INFO:tasks.workunit.client.0.smithi044.stdout:0/590: creat d8/fbf x:0 0 0 2024-04-25T22:03:21.735 INFO:tasks.workunit.client.0.smithi044.stdout:0/591: creat d8/d20/fc0 x:0 0 0 2024-04-25T22:03:21.735 INFO:tasks.workunit.client.0.smithi044.stdout:5/643: truncate d2/d5/d21/d26/d2c/f87 35484 0 2024-04-25T22:03:21.736 INFO:tasks.workunit.client.0.smithi044.stdout:7/472: dread d1c/d22/d28/d4e/d7b/f85 [0,4194304] 0 2024-04-25T22:03:21.736 INFO:tasks.workunit.client.0.smithi044.stdout:5/644: readlink d2/d5/lc 0 2024-04-25T22:03:21.736 INFO:tasks.workunit.client.0.smithi044.stdout:0/592: symlink d8/df/d88/lc1 0 2024-04-25T22:03:21.737 INFO:tasks.workunit.client.0.smithi044.stdout:7/473: chown d1c/d22/d28/d57/f8b 93036 1 2024-04-25T22:03:21.737 INFO:tasks.workunit.client.0.smithi044.stdout:5/645: creat d2/d5/d21/d38/d7c/fca x:0 0 0 2024-04-25T22:03:21.739 INFO:tasks.workunit.client.0.smithi044.stdout:0/593: mkdir d8/df/d17/d45/d95/d51/dc2 0 2024-04-25T22:03:21.741 INFO:tasks.workunit.client.0.smithi044.stdout:9/773: dread - d4/d3d/f9c zero size 2024-04-25T22:03:21.741 INFO:tasks.workunit.client.0.smithi044.stdout:5/646: mkdir d2/d5/d27/d2a/da7/dcb 0 2024-04-25T22:03:21.741 INFO:tasks.workunit.client.0.smithi044.stdout:1/557: dwrite d3/d7/f23 [4194304,4194304] 0 2024-04-25T22:03:21.743 INFO:tasks.workunit.client.0.smithi044.stdout:7/474: truncate d1c/d22/d28/d30/d32/f55 834976 0 2024-04-25T22:03:21.744 INFO:tasks.workunit.client.0.smithi044.stdout:5/647: getdents d2/dc1 0 2024-04-25T22:03:21.744 INFO:tasks.workunit.client.0.smithi044.stdout:3/644: dwrite d0/d1/d15/d23/f40 [0,4194304] 0 2024-04-25T22:03:21.745 INFO:tasks.workunit.client.0.smithi044.stdout:7/475: rmdir d1c/d22/d28/d4e/d7b 39 2024-04-25T22:03:21.745 INFO:tasks.workunit.client.0.smithi044.stdout:8/841: dread d2a/d32/d57/d5e/fb0 [0,4194304] 0 2024-04-25T22:03:21.745 INFO:tasks.workunit.client.0.smithi044.stdout:1/558: write d3/d7/f69 [1784502,85317] 0 2024-04-25T22:03:21.746 INFO:tasks.workunit.client.0.smithi044.stdout:3/645: mkdir d0/d2/dcb 0 2024-04-25T22:03:21.747 INFO:tasks.workunit.client.0.smithi044.stdout:1/559: mkdir d3/d7/db/d5d/db0 0 2024-04-25T22:03:21.747 INFO:tasks.workunit.client.0.smithi044.stdout:9/774: creat d4/d7/d79/ddc/de1/d54/d84/d72/f100 x:0 0 0 2024-04-25T22:03:21.747 INFO:tasks.workunit.client.0.smithi044.stdout:7/476: mknod d1c/d22/d28/d4e/d6a/c8e 0 2024-04-25T22:03:21.747 INFO:tasks.workunit.client.0.smithi044.stdout:4/581: dwrite dd/d19/d72/d79/d7f/f85 [0,4194304] 0 2024-04-25T22:03:21.748 INFO:tasks.workunit.client.0.smithi044.stdout:8/842: getdents d2a/d39/d5a/d92/dab 0 2024-04-25T22:03:21.748 INFO:tasks.workunit.client.0.smithi044.stdout:0/594: truncate d8/f9 17719 0 2024-04-25T22:03:21.749 INFO:tasks.workunit.client.0.smithi044.stdout:7/477: fdatasync d1c/d22/d28/d30/d32/f39 0 2024-04-25T22:03:21.749 INFO:tasks.workunit.client.0.smithi044.stdout:9/775: write d4/d3d/d66/db9/dbe/fc4 [320509,62064] 0 2024-04-25T22:03:21.749 INFO:tasks.workunit.client.0.smithi044.stdout:3/646: getdents d0/d13/d1c/d93/da6/d8d/d91 0 2024-04-25T22:03:21.751 INFO:tasks.workunit.client.0.smithi044.stdout:9/776: creat d4/d3d/d66/d93/f101 x:0 0 0 2024-04-25T22:03:21.752 INFO:tasks.workunit.client.0.smithi044.stdout:3/647: getdents d0/d13/d1c/d93 0 2024-04-25T22:03:21.753 INFO:tasks.workunit.client.0.smithi044.stdout:3/648: chown d0/d1/d34/d48/dc7 0 1 2024-04-25T22:03:21.754 INFO:tasks.workunit.client.0.smithi044.stdout:9/777: fsync d4/d7/d79/ddc/de1/d54/d84/d72/ff0 0 2024-04-25T22:03:21.756 INFO:tasks.workunit.client.0.smithi044.stdout:4/582: dwrite dd/f4b [4194304,4194304] 0 2024-04-25T22:03:21.757 INFO:tasks.workunit.client.0.smithi044.stdout:2/595: dread d7/d7b/d81/d4e/d86/d6b/fa2 [0,4194304] 0 2024-04-25T22:03:21.757 INFO:tasks.workunit.client.0.smithi044.stdout:4/583: creat dd/d35/d52/d61/d76/fc1 x:0 0 0 2024-04-25T22:03:21.758 INFO:tasks.workunit.client.0.smithi044.stdout:4/584: write dd/d35/d52/f90 [1083713,123328] 0 2024-04-25T22:03:21.759 INFO:tasks.workunit.client.0.smithi044.stdout:7/478: read d1c/d22/d4a/f78 [854831,48601] 0 2024-04-25T22:03:21.759 INFO:tasks.workunit.client.0.smithi044.stdout:7/479: mkdir d1c/d88/d8f 0 2024-04-25T22:03:21.759 INFO:tasks.workunit.client.0.smithi044.stdout:4/585: dread - dd/d35/d52/d61/d76/fae zero size 2024-04-25T22:03:21.760 INFO:tasks.workunit.client.0.smithi044.stdout:4/586: chown dd/d19/l82 3774342 1 2024-04-25T22:03:21.761 INFO:tasks.workunit.client.0.smithi044.stdout:7/480: write d1c/d22/d28/d30/d32/f8a [366696,44953] 0 2024-04-25T22:03:21.762 INFO:tasks.workunit.client.0.smithi044.stdout:9/778: dwrite d4/d7/d18/d2e/d94/ffa [0,4194304] 0 2024-04-25T22:03:21.762 INFO:tasks.workunit.client.0.smithi044.stdout:7/481: write d1c/f50 [367148,130877] 0 2024-04-25T22:03:21.762 INFO:tasks.workunit.client.0.smithi044.stdout:7/482: fdatasync d1c/d22/d28/f58 0 2024-04-25T22:03:21.763 INFO:tasks.workunit.client.0.smithi044.stdout:7/483: creat d1c/d22/d28/d4e/d6a/f90 x:0 0 0 2024-04-25T22:03:21.764 INFO:tasks.workunit.client.0.smithi044.stdout:9/779: truncate d4/d7/d79/ddc/de1/d54/d84/d72/d97/f9d 8978241 0 2024-04-25T22:03:21.765 INFO:tasks.workunit.client.0.smithi044.stdout:6/803: dread d2/fd [0,4194304] 0 2024-04-25T22:03:21.765 INFO:tasks.workunit.client.0.smithi044.stdout:9/780: mkdir d4/d7/d79/ddc/de1/d54/d102 0 2024-04-25T22:03:21.765 INFO:tasks.workunit.client.0.smithi044.stdout:7/484: rename d1c/f2b to d1c/d22/d28/d4e/d7b/d59/f91 0 2024-04-25T22:03:21.767 INFO:tasks.workunit.client.0.smithi044.stdout:6/804: link d2/d23/d5a/d13/d68/l65 d2/d23/d6a/d63/l110 0 2024-04-25T22:03:21.767 INFO:tasks.workunit.client.0.smithi044.stdout:9/781: link d4/d3d/d58/l61 d4/d7/d79/ddc/de1/d54/d84/d72/d97/df3/l103 0 2024-04-25T22:03:21.767 INFO:tasks.workunit.client.0.smithi044.stdout:6/805: fdatasync d2/d23/d5a/d12/d27/ff9 0 2024-04-25T22:03:21.768 INFO:tasks.workunit.client.0.smithi044.stdout:9/782: readlink d4/d3d/da5/dd8/lfb 0 2024-04-25T22:03:21.768 INFO:tasks.workunit.client.0.smithi044.stdout:7/485: link d1c/d22/d28/d4e/c68 d1c/d22/d28/d66/c92 0 2024-04-25T22:03:21.768 INFO:tasks.workunit.client.0.smithi044.stdout:7/486: chown d1c/d22/d4a/f64 983404 1 2024-04-25T22:03:21.769 INFO:tasks.workunit.client.0.smithi044.stdout:9/783: mknod d4/d3d/da5/c104 0 2024-04-25T22:03:21.769 INFO:tasks.workunit.client.0.smithi044.stdout:7/487: truncate d1c/d22/f23 600589 0 2024-04-25T22:03:21.770 INFO:tasks.workunit.client.0.smithi044.stdout:9/784: symlink d4/d7/d79/ddc/de1/d54/d84/d64/l105 0 2024-04-25T22:03:21.770 INFO:tasks.workunit.client.0.smithi044.stdout:7/488: chown d1c/d22/d28/d30/f84 26364440 1 2024-04-25T22:03:21.771 INFO:tasks.workunit.client.0.smithi044.stdout:2/596: dread d7/d16/d4b/f82 [0,4194304] 0 2024-04-25T22:03:21.771 INFO:tasks.workunit.client.0.smithi044.stdout:9/785: write d4/f5c [1378076,91255] 0 2024-04-25T22:03:21.771 INFO:tasks.workunit.client.0.smithi044.stdout:7/489: link f0 d1c/d22/f93 0 2024-04-25T22:03:21.772 INFO:tasks.workunit.client.0.smithi044.stdout:7/490: fdatasync d1c/f47 0 2024-04-25T22:03:21.772 INFO:tasks.workunit.client.0.smithi044.stdout:7/491: readlink d1c/l26 0 2024-04-25T22:03:21.776 INFO:tasks.workunit.client.0.smithi044.stdout:2/597: dwrite d7/d8/d5f/fbe [4194304,4194304] 0 2024-04-25T22:03:21.777 INFO:tasks.workunit.client.0.smithi044.stdout:2/598: chown d7/d7b/d81/d57/l60 1317 1 2024-04-25T22:03:21.778 INFO:tasks.workunit.client.0.smithi044.stdout:5/648: sync 2024-04-25T22:03:21.778 INFO:tasks.workunit.client.0.smithi044.stdout:2/599: write d7/d8/d1c/f69 [106415,108926] 0 2024-04-25T22:03:21.780 INFO:tasks.workunit.client.0.smithi044.stdout:2/600: getdents d7/d7b/d81/d4e 0 2024-04-25T22:03:21.781 INFO:tasks.workunit.client.0.smithi044.stdout:5/649: read d2/d5/d21/d26/d2c/f74 [3404916,104676] 0 2024-04-25T22:03:21.782 INFO:tasks.workunit.client.0.smithi044.stdout:7/492: fdatasync d1c/f50 0 2024-04-25T22:03:21.782 INFO:tasks.workunit.client.0.smithi044.stdout:5/650: stat d2/d5/d27/d2a/d3a/fb1 0 2024-04-25T22:03:21.783 INFO:tasks.workunit.client.0.smithi044.stdout:5/651: fdatasync d2/d5/d21/d38/d7c/fba 0 2024-04-25T22:03:21.783 INFO:tasks.workunit.client.0.smithi044.stdout:2/601: rmdir d7/d8/d5f 39 2024-04-25T22:03:21.784 INFO:tasks.workunit.client.0.smithi044.stdout:1/560: dread d3/d7/db/f1d [0,4194304] 0 2024-04-25T22:03:21.784 INFO:tasks.workunit.client.0.smithi044.stdout:4/587: write dd/d35/d52/fb0 [311170,70061] 0 2024-04-25T22:03:21.785 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-25T22:03:21.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:21.781+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:21.787 INFO:tasks.workunit.client.0.smithi044.stdout:1/561: chown d3/d7/l3a 271229887 1 2024-04-25T22:03:21.787 INFO:tasks.workunit.client.0.smithi044.stdout:5/652: truncate d2/d5/d21/d26/d2c/f97 590190 0 2024-04-25T22:03:21.787 INFO:tasks.workunit.client.0.smithi044.stdout:5/653: chown d2/d5/d21/d38/f60 3 1 2024-04-25T22:03:21.788 INFO:tasks.workunit.client.0.smithi044.stdout:1/562: creat d3/d7/d29/fb1 x:0 0 0 2024-04-25T22:03:21.790 INFO:tasks.workunit.client.0.smithi044.stdout:9/786: write d4/d7/d18/d3a/d8b/fde [1457305,115985] 0 2024-04-25T22:03:21.795 INFO:tasks.workunit.client.0.smithi044.stdout:2/602: dwrite d7/d7b/d81/d4e/d86/d6b/d78/f5a [4194304,4194304] 0 2024-04-25T22:03:21.797 INFO:tasks.workunit.client.0.smithi044.stdout:2/603: fdatasync d7/d16/f17 0 2024-04-25T22:03:21.797 INFO:tasks.workunit.client.0.smithi044.stdout:8/843: dread d2a/d39/d42/d68/fc4 [0,4194304] 0 2024-04-25T22:03:21.797 INFO:tasks.workunit.client.0.smithi044.stdout:1/563: dread d3/d59/d5c/f74 [0,4194304] 0 2024-04-25T22:03:21.797 INFO:tasks.workunit.client.0.smithi044.stdout:4/588: dwrite dd/d19/d72/f93 [0,4194304] 0 2024-04-25T22:03:21.797 INFO:tasks.workunit.client.0.smithi044.stdout:3/649: dwrite d0/d1/d34/f58 [0,4194304] 0 2024-04-25T22:03:21.798 INFO:tasks.workunit.client.0.smithi044.stdout:2/604: chown d7/d16/d2c/fa7 3020227 1 2024-04-25T22:03:21.798 INFO:tasks.workunit.client.0.smithi044.stdout:4/589: mknod dd/d19/d91/cc2 0 2024-04-25T22:03:21.799 INFO:tasks.workunit.client.0.smithi044.stdout:9/787: truncate d4/d7/d79/f8e 178799 0 2024-04-25T22:03:21.800 INFO:tasks.workunit.client.0.smithi044.stdout:9/788: creat d4/d7/d18/d2e/d73/f106 x:0 0 0 2024-04-25T22:03:21.801 INFO:tasks.workunit.client.0.smithi044.stdout:3/650: symlink d0/d1/d15/d51/dd/lcc 0 2024-04-25T22:03:21.802 INFO:tasks.workunit.client.0.smithi044.stdout:4/590: write dd/d35/f37 [1668127,53303] 0 2024-04-25T22:03:21.802 INFO:tasks.workunit.client.0.smithi044.stdout:9/789: creat d4/d4b/d86/f107 x:0 0 0 2024-04-25T22:03:21.803 INFO:tasks.workunit.client.0.smithi044.stdout:8/844: dread d2a/d39/d42/d68/f91 [0,4194304] 0 2024-04-25T22:03:21.803 INFO:tasks.workunit.client.0.smithi044.stdout:3/651: read d0/d1/d34/d48/f5f [293106,17741] 0 2024-04-25T22:03:21.805 INFO:tasks.workunit.client.0.smithi044.stdout:8/845: chown d2a/d32/d3e/dd0/d107/f10d 164844585 1 2024-04-25T22:03:21.805 INFO:tasks.workunit.client.0.smithi044.stdout:4/591: rename dd/d19/d72/d88 to dd/d19/d72/d79/d7f/dc3 0 2024-04-25T22:03:21.805 INFO:tasks.workunit.client.0.smithi044.stdout:9/790: mkdir d4/d7/d79/ddc/de1/d54/d84/d72/d108 0 2024-04-25T22:03:21.805 INFO:tasks.workunit.client.0.smithi044.stdout:1/564: dwrite d3/d7/f20 [4194304,4194304] 0 2024-04-25T22:03:21.807 INFO:tasks.workunit.client.0.smithi044.stdout:1/565: dread d3/d59/d5c/f74 [0,4194304] 0 2024-04-25T22:03:21.809 INFO:tasks.workunit.client.0.smithi044.stdout:3/652: creat d0/d1/fcd x:0 0 0 2024-04-25T22:03:21.809 INFO:tasks.workunit.client.0.smithi044.stdout:4/592: rename dd to dd/d35/d52/d61/dc4 22 2024-04-25T22:03:21.809 INFO:tasks.workunit.client.0.smithi044.stdout:9/791: unlink d4/d7/d79/ddc/de1/fd9 0 2024-04-25T22:03:21.810 INFO:tasks.workunit.client.0.smithi044.stdout:4/593: creat dd/d35/d52/da9/fc5 x:0 0 0 2024-04-25T22:03:21.811 INFO:tasks.workunit.client.0.smithi044.stdout:3/653: symlink d0/d1/d15/d51/dd/d35/lce 0 2024-04-25T22:03:21.812 INFO:tasks.workunit.client.0.smithi044.stdout:3/654: mknod d0/d1/d34/d95/ccf 0 2024-04-25T22:03:21.812 INFO:tasks.workunit.client.0.smithi044.stdout:3/655: readlink d0/l26 0 2024-04-25T22:03:21.814 INFO:tasks.workunit.client.0.smithi044.stdout:3/656: stat d0/d1/d15/d51/dd/d11/d42/c59 0 2024-04-25T22:03:21.815 INFO:tasks.workunit.client.0.smithi044.stdout:3/657: creat d0/d1/d15/d51/dd/d11/fd0 x:0 0 0 2024-04-25T22:03:21.816 INFO:tasks.workunit.client.0.smithi044.stdout:3/658: creat d0/d13/d1c/d93/da6/fd1 x:0 0 0 2024-04-25T22:03:21.817 INFO:tasks.workunit.client.0.smithi044.stdout:4/594: dwrite dd/d35/d52/f60 [0,4194304] 0 2024-04-25T22:03:21.818 INFO:tasks.workunit.client.0.smithi044.stdout:6/806: dread d2/d23/d5a/d12/d27/daf/dcb/f54 [0,4194304] 0 2024-04-25T22:03:21.818 INFO:tasks.workunit.client.0.smithi044.stdout:3/659: truncate d0/d1/d15/d51/dd/d11/fd0 130558 0 2024-04-25T22:03:21.819 INFO:tasks.workunit.client.0.smithi044.stdout:4/595: rename dd/d19/d91/lba to dd/d19/d72/d79/d7f/dc3/lc6 0 2024-04-25T22:03:21.819 INFO:tasks.workunit.client.0.smithi044.stdout:3/660: mkdir d0/d1/d15/d81/dd2 0 2024-04-25T22:03:21.820 INFO:tasks.workunit.client.0.smithi044.stdout:3/661: fsync d0/d1/d15/d51/d8e/d74/f90 0 2024-04-25T22:03:21.821 INFO:tasks.workunit.client.0.smithi044.stdout:3/662: symlink d0/d13/d6c/ld3 0 2024-04-25T22:03:21.825 INFO:tasks.workunit.client.0.smithi044.stdout:8/846: dread d2a/f2f [0,4194304] 0 2024-04-25T22:03:21.827 INFO:tasks.workunit.client.0.smithi044.stdout:8/847: dread d2a/d32/d3e/fed [0,4194304] 0 2024-04-25T22:03:21.829 INFO:tasks.workunit.client.0.smithi044.stdout:8/848: symlink d2a/d39/d42/d68/d6b/d7b/l114 0 2024-04-25T22:03:21.829 INFO:tasks.workunit.client.0.smithi044.stdout:8/849: mknod d2a/d39/d5a/d8e/c115 0 2024-04-25T22:03:21.830 INFO:tasks.workunit.client.0.smithi044.stdout:8/850: mkdir d2a/d32/d3e/dd0/d116 0 2024-04-25T22:03:21.831 INFO:tasks.workunit.client.0.smithi044.stdout:3/663: dwrite d0/f82 [0,4194304] 0 2024-04-25T22:03:21.836 INFO:tasks.workunit.client.0.smithi044.stdout:5/654: dread d2/d5/d27/f62 [4194304,4194304] 0 2024-04-25T22:03:21.837 INFO:tasks.workunit.client.0.smithi044.stdout:5/655: mknod d2/d5/d27/d2a/d48/ccc 0 2024-04-25T22:03:21.838 INFO:tasks.workunit.client.0.smithi044.stdout:3/664: truncate d0/d13/d1c/d93/da6/f8f 475373 0 2024-04-25T22:03:21.838 INFO:tasks.workunit.client.0.smithi044.stdout:8/851: getdents d2a/d32/d3e/dd0 0 2024-04-25T22:03:21.838 INFO:tasks.workunit.client.0.smithi044.stdout:8/852: chown d2a/f45 8105716 1 2024-04-25T22:03:21.838 INFO:tasks.workunit.client.0.smithi044.stdout:5/656: chown d2/d5/d21/d26/d2c/f87 93938 1 2024-04-25T22:03:21.838 INFO:tasks.workunit.client.0.smithi044.stdout:3/665: chown d0/d1/d15/d51/dd/d35 17 1 2024-04-25T22:03:21.839 INFO:tasks.workunit.client.0.smithi044.stdout:5/657: mknod d2/d5/d21/d38/d52/ccd 0 2024-04-25T22:03:21.839 INFO:tasks.workunit.client.0.smithi044.stdout:3/666: creat d0/d13/d1c/d93/fd4 x:0 0 0 2024-04-25T22:03:21.840 INFO:tasks.workunit.client.0.smithi044.stdout:5/658: symlink d2/d5/d27/d2a/db5/lce 0 2024-04-25T22:03:21.840 INFO:tasks.workunit.client.0.smithi044.stdout:3/667: link d0/d70/d7c/da9/fc9 d0/d13/d1c/fd5 0 2024-04-25T22:03:21.840 INFO:tasks.workunit.client.0.smithi044.stdout:5/659: write d2/d5/d21/d38/d7c/fca [195428,66809] 0 2024-04-25T22:03:21.841 INFO:tasks.workunit.client.0.smithi044.stdout:3/668: readlink d0/d1/d15/d51/dd/d35/dc6/l50 0 2024-04-25T22:03:21.841 INFO:tasks.workunit.client.0.smithi044.stdout:3/669: chown d0/d1/fe 48 1 2024-04-25T22:03:21.841 INFO:tasks.workunit.client.0.smithi044.stdout:5/660: rename d2/d5/d21/d38/d52/c75 to d2/d5/d21/ccf 0 2024-04-25T22:03:21.842 INFO:tasks.workunit.client.0.smithi044.stdout:5/661: dread - d2/d5/d27/d2a/d48/fb9 zero size 2024-04-25T22:03:21.843 INFO:tasks.workunit.client.0.smithi044.stdout:5/662: chown d2/d5/d21/d26/d2c/d37 3792 1 2024-04-25T22:03:21.843 INFO:tasks.workunit.client.0.smithi044.stdout:5/663: mkdir d2/d5b/d8e/dd0 0 2024-04-25T22:03:21.845 INFO:tasks.workunit.client.0.smithi044.stdout:5/664: truncate d2/d5/d27/d2a/d5c/f83 4686850 0 2024-04-25T22:03:21.845 INFO:tasks.workunit.client.0.smithi044.stdout:5/665: symlink d2/d5/d21/d6b/ld1 0 2024-04-25T22:03:21.846 INFO:tasks.workunit.client.0.smithi044.stdout:5/666: mknod d2/d5/d21/d6b/d9b/cd2 0 2024-04-25T22:03:21.847 INFO:tasks.workunit.client.0.smithi044.stdout:5/667: readlink d2/d5/d27/d2a/d5c/la5 0 2024-04-25T22:03:21.847 INFO:tasks.workunit.client.0.smithi044.stdout:4/596: dread dd/d19/d72/d79/d7f/d81/f43 [0,4194304] 0 2024-04-25T22:03:21.847 INFO:tasks.workunit.client.0.smithi044.stdout:5/668: symlink d2/d5/d27/d2a/d48/ld3 0 2024-04-25T22:03:21.853 INFO:tasks.workunit.client.0.smithi044.stdout:5/669: write d2/f19 [117835,93573] 0 2024-04-25T22:03:21.856 INFO:tasks.workunit.client.0.smithi044.stdout:4/597: dwrite dd/d35/f5f [4194304,4194304] 0 2024-04-25T22:03:21.856 INFO:tasks.workunit.client.0.smithi044.stdout:0/595: sync 2024-04-25T22:03:21.857 INFO:tasks.workunit.client.0.smithi044.stdout:0/596: stat d8/d20/f6a 0 2024-04-25T22:03:21.857 INFO:tasks.workunit.client.0.smithi044.stdout:4/598: creat dd/d35/d52/fc7 x:0 0 0 2024-04-25T22:03:21.858 INFO:tasks.workunit.client.0.smithi044.stdout:0/597: creat d8/db2/d8e/fc3 x:0 0 0 2024-04-25T22:03:21.859 INFO:tasks.workunit.client.0.smithi044.stdout:5/670: write d2/d5/f5e [797694,85575] 0 2024-04-25T22:03:21.860 INFO:tasks.workunit.client.0.smithi044.stdout:4/599: truncate dd/d19/f2b 32186 0 2024-04-25T22:03:21.860 INFO:tasks.workunit.client.0.smithi044.stdout:5/671: mkdir d2/d5/d21/d38/d52/dd4 0 2024-04-25T22:03:21.861 INFO:tasks.workunit.client.0.smithi044.stdout:5/672: stat d2/d5/d27/d2a/d5c/d5f/c69 0 2024-04-25T22:03:21.862 INFO:tasks.workunit.client.0.smithi044.stdout:4/600: getdents dd/d19/d72/d79/d7f 0 2024-04-25T22:03:21.862 INFO:tasks.workunit.client.0.smithi044.stdout:4/601: readlink l2 0 2024-04-25T22:03:21.863 INFO:tasks.workunit.client.0.smithi044.stdout:5/673: rename d2/d5/d21/d26/d84 to d2/d5/d27/dd5 0 2024-04-25T22:03:21.864 INFO:tasks.workunit.client.0.smithi044.stdout:3/670: dread d0/d1/d15/d51/dd/d28/f53 [0,4194304] 0 2024-04-25T22:03:21.865 INFO:tasks.workunit.client.0.smithi044.stdout:4/602: link dd/d35/f92 dd/d19/d72/d79/d9c/fc8 0 2024-04-25T22:03:21.865 INFO:tasks.workunit.client.0.smithi044.stdout:0/598: dwrite d8/da/d55/f62 [0,4194304] 0 2024-04-25T22:03:21.865 INFO:tasks.workunit.client.0.smithi044.stdout:3/671: symlink d0/d2/dcb/ld6 0 2024-04-25T22:03:21.865 INFO:tasks.workunit.client.0.smithi044.stdout:4/603: truncate dd/d19/d72/f7d 1182891 0 2024-04-25T22:03:21.866 INFO:tasks.workunit.client.0.smithi044.stdout:3/672: mkdir d0/d13/d1c/d93/da6/dd7 0 2024-04-25T22:03:21.867 INFO:tasks.workunit.client.0.smithi044.stdout:4/604: creat dd/d19/fc9 x:0 0 0 2024-04-25T22:03:21.867 INFO:tasks.workunit.client.0.smithi044.stdout:0/599: rename d8/da/d55/ca3 to d8/df/d88/db6/cc4 0 2024-04-25T22:03:21.867 INFO:tasks.workunit.client.0.smithi044.stdout:4/605: write dd/d19/f8c [499697,62752] 0 2024-04-25T22:03:21.869 INFO:tasks.workunit.client.0.smithi044.stdout:4/606: truncate dd/d19/f1d 4355650 0 2024-04-25T22:03:21.872 INFO:tasks.workunit.client.0.smithi044.stdout:3/673: dwrite d0/d1/d15/d51/d8e/d74/f90 [4194304,4194304] 0 2024-04-25T22:03:21.873 INFO:tasks.workunit.client.0.smithi044.stdout:3/674: creat d0/d1/d15/d51/dd/d28/fd8 x:0 0 0 2024-04-25T22:03:21.874 INFO:tasks.workunit.client.0.smithi044.stdout:3/675: readlink d0/d1/d15/d51/dd/d35/dc6/d44/l4b 0 2024-04-25T22:03:21.878 INFO:tasks.workunit.client.0.smithi044.stdout:3/676: read d0/d1/fe [3551294,30902] 0 2024-04-25T22:03:21.882 INFO:tasks.workunit.client.0.smithi044.stdout:3/677: mkdir d0/d1/d34/d95/dd9 0 2024-04-25T22:03:21.882 INFO:tasks.workunit.client.0.smithi044.stdout:3/678: dread - d0/d2/f98 zero size 2024-04-25T22:03:21.882 INFO:tasks.workunit.client.0.smithi044.stdout:3/679: getdents d0/d1/d15/df 0 2024-04-25T22:03:21.882 INFO:tasks.workunit.client.0.smithi044.stdout:3/680: creat d0/d1/d15/d51/dd/d35/fda x:0 0 0 2024-04-25T22:03:21.882 INFO:tasks.workunit.client.0.smithi044.stdout:3/681: creat d0/d13/d1c/d93/fdb x:0 0 0 2024-04-25T22:03:21.884 INFO:tasks.workunit.client.0.smithi044.stdout:5/674: dread d2/d5/d21/f94 [0,4194304] 0 2024-04-25T22:03:21.884 INFO:tasks.workunit.client.0.smithi044.stdout:3/682: dread d0/f82 [0,4194304] 0 2024-04-25T22:03:21.886 INFO:tasks.workunit.client.0.smithi044.stdout:3/683: link d0/d13/d1c/d93/fd4 d0/d1/d15/d81/fdc 0 2024-04-25T22:03:21.887 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:21.880+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:21.891 INFO:tasks.workunit.client.0.smithi044.stdout:5/675: dwrite d2/d5/d21/d26/d2c/d37/fc6 [0,4194304] 0 2024-04-25T22:03:21.891 INFO:tasks.workunit.client.0.smithi044.stdout:5/676: chown d2/d35/ca2 14995563 1 2024-04-25T22:03:21.892 INFO:tasks.workunit.client.0.smithi044.stdout:3/684: dread d0/f38 [0,4194304] 0 2024-04-25T22:03:21.892 INFO:tasks.workunit.client.0.smithi044.stdout:5/677: mknod d2/d5/d21/d26/d2c/cd6 0 2024-04-25T22:03:21.894 INFO:tasks.workunit.client.0.smithi044.stdout:3/685: fsync d0/d1/d15/d51/dd/d28/f53 0 2024-04-25T22:03:21.894 INFO:tasks.workunit.client.0.smithi044.stdout:5/678: fdatasync d2/d5/d21/d38/f53 0 2024-04-25T22:03:21.894 INFO:tasks.workunit.client.0.smithi044.stdout:5/679: mknod d2/d5/d21/d38/d52/d56/cd7 0 2024-04-25T22:03:21.896 INFO:tasks.workunit.client.0.smithi044.stdout:5/680: creat d2/d5/d27/d2a/d70/fd8 x:0 0 0 2024-04-25T22:03:21.896 INFO:tasks.workunit.client.0.smithi044.stdout:5/681: rename d2/d5/f1f to d2/d5/d21/d6b/d9b/fd9 0 2024-04-25T22:03:21.899 INFO:tasks.workunit.client.0.smithi044.stdout:4/607: read dd/d19/f1d [3419485,130012] 0 2024-04-25T22:03:21.899 INFO:tasks.workunit.client.0.smithi044.stdout:3/686: truncate d0/d13/f37 146941 0 2024-04-25T22:03:21.900 INFO:tasks.workunit.client.0.smithi044.stdout:4/608: stat dd/f17 0 2024-04-25T22:03:21.900 INFO:tasks.workunit.client.0.smithi044.stdout:4/609: unlink dd/d19/c25 0 2024-04-25T22:03:21.900 INFO:tasks.workunit.client.0.smithi044.stdout:3/687: symlink d0/d1/d34/d95/ldd 0 2024-04-25T22:03:21.901 INFO:tasks.workunit.client.0.smithi044.stdout:4/610: fdatasync dd/d19/d72/fbb 0 2024-04-25T22:03:21.901 INFO:tasks.workunit.client.0.smithi044.stdout:3/688: dread - d0/d13/d1c/d93/da6/fd1 zero size 2024-04-25T22:03:21.902 INFO:tasks.workunit.client.0.smithi044.stdout:3/689: creat d0/fde x:0 0 0 2024-04-25T22:03:21.902 INFO:tasks.workunit.client.0.smithi044.stdout:0/600: dread d8/da/f7a [0,4194304] 0 2024-04-25T22:03:21.903 INFO:tasks.workunit.client.0.smithi044.stdout:5/682: dwrite d2/d5/d27/d2a/d70/fd8 [0,4194304] 0 2024-04-25T22:03:21.903 INFO:tasks.workunit.client.0.smithi044.stdout:3/690: rmdir d0/d13/d1c/d93/da6/d8d 39 2024-04-25T22:03:21.903 INFO:tasks.workunit.client.0.smithi044.stdout:0/601: readlink d8/df/d17/d45/d95/d51/l8f 0 2024-04-25T22:03:21.904 INFO:tasks.workunit.client.0.smithi044.stdout:5/683: mknod d2/d5/d27/d2a/d5c/cda 0 2024-04-25T22:03:21.904 INFO:tasks.workunit.client.0.smithi044.stdout:3/691: symlink d0/ldf 0 2024-04-25T22:03:21.905 INFO:tasks.workunit.client.0.smithi044.stdout:5/684: creat d2/d5/d21/fdb x:0 0 0 2024-04-25T22:03:21.906 INFO:tasks.workunit.client.0.smithi044.stdout:3/692: write d0/d1/d15/d51/dd/d35/fda [948202,112033] 0 2024-04-25T22:03:21.907 INFO:tasks.workunit.client.0.smithi044.stdout:3/693: fsync d0/d1/d15/d51/dd/d28/fd8 0 2024-04-25T22:03:21.908 INFO:tasks.workunit.client.0.smithi044.stdout:0/602: dread f0 [0,4194304] 0 2024-04-25T22:03:21.908 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:21.908 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:21.909 INFO:tasks.workunit.client.0.smithi044.stdout:4/611: dwrite dd/d19/d72/d79/fb7 [0,4194304] 0 2024-04-25T22:03:21.911 INFO:tasks.workunit.client.0.smithi044.stdout:0/603: creat d8/da/fc5 x:0 0 0 2024-04-25T22:03:21.912 INFO:tasks.workunit.client.0.smithi044.stdout:5/685: dwrite d2/d5/d27/d2a/d5c/f83 [0,4194304] 0 2024-04-25T22:03:21.913 INFO:tasks.workunit.client.0.smithi044.stdout:3/694: truncate d0/d1/d15/d81/f87 2223725 0 2024-04-25T22:03:21.915 INFO:tasks.workunit.client.0.smithi044.stdout:3/695: rmdir d0/d1/d34 39 2024-04-25T22:03:21.915 INFO:tasks.workunit.client.0.smithi044.stdout:5/686: getdents d2/d5/d27/d2a/d5c 0 2024-04-25T22:03:21.916 INFO:tasks.workunit.client.0.smithi044.stdout:0/604: dwrite d8/da/f59 [0,4194304] 0 2024-04-25T22:03:21.916 INFO:tasks.workunit.client.0.smithi044.stdout:5/687: chown d2/d5/d21/d38/d7c/faf 13 1 2024-04-25T22:03:21.916 INFO:tasks.workunit.client.0.smithi044.stdout:3/696: dread d0/d1/d15/d23/d60/f9a [0,4194304] 0 2024-04-25T22:03:21.916 INFO:tasks.workunit.client.0.smithi044.stdout:0/605: chown d8/df/d88 4 1 2024-04-25T22:03:21.916 INFO:tasks.workunit.client.0.smithi044.stdout:3/697: fsync d0/d1/d15/d23/d60/f9b 0 2024-04-25T22:03:21.917 INFO:tasks.workunit.client.0.smithi044.stdout:5/688: rename d2/d5/d27/d2a/d48/fb9 to d2/d5b/da8/fdc 0 2024-04-25T22:03:21.918 INFO:tasks.workunit.client.0.smithi044.stdout:0/606: symlink d8/df/d17/d45/dad/lc6 0 2024-04-25T22:03:21.918 INFO:tasks.workunit.client.0.smithi044.stdout:5/689: creat d2/d5/d6a/fdd x:0 0 0 2024-04-25T22:03:21.920 INFO:tasks.workunit.client.0.smithi044.stdout:0/607: creat d8/df/d17/d45/d95/fc7 x:0 0 0 2024-04-25T22:03:21.922 INFO:tasks.workunit.client.0.smithi044.stdout:5/690: rmdir d2/d5b/da8 39 2024-04-25T22:03:21.922 INFO:tasks.workunit.client.0.smithi044.stdout:0/608: symlink d8/df/d88/lc8 0 2024-04-25T22:03:21.922 INFO:tasks.workunit.client.0.smithi044.stdout:5/691: stat d2/d35/f3f 0 2024-04-25T22:03:21.922 INFO:tasks.workunit.client.0.smithi044.stdout:3/698: truncate d0/f82 3037257 0 2024-04-25T22:03:21.922 INFO:tasks.workunit.client.0.smithi044.stdout:5/692: dread - d2/d5/d21/fbd zero size 2024-04-25T22:03:21.923 INFO:tasks.workunit.client.0.smithi044.stdout:3/699: fdatasync d0/f82 0 2024-04-25T22:03:21.923 INFO:tasks.workunit.client.0.smithi044.stdout:5/693: fsync d2/d5/d27/d2a/d3a/f77 0 2024-04-25T22:03:21.923 INFO:tasks.workunit.client.0.smithi044.stdout:0/609: rename d8/d20/f31 to d8/df/d17/d45/d95/d51/d8b/d90/fc9 0 2024-04-25T22:03:21.924 INFO:tasks.workunit.client.0.smithi044.stdout:5/694: readlink d2/d5/d27/d2a/d48/l54 0 2024-04-25T22:03:21.924 INFO:tasks.workunit.client.0.smithi044.stdout:0/610: dread d8/d78/fa6 [0,4194304] 0 2024-04-25T22:03:21.925 INFO:tasks.workunit.client.0.smithi044.stdout:0/611: creat d8/fca x:0 0 0 2024-04-25T22:03:21.926 INFO:tasks.workunit.client.0.smithi044.stdout:0/612: chown d8/da/d60/daa 30 1 2024-04-25T22:03:21.926 INFO:tasks.workunit.client.0.smithi044.stdout:0/613: symlink d8/db2/d8e/lcb 0 2024-04-25T22:03:21.927 INFO:tasks.workunit.client.0.smithi044.stdout:0/614: rename d8/da/d55 to d8/df/d17/d45/d95/d9c/dcc 0 2024-04-25T22:03:21.928 INFO:tasks.workunit.client.0.smithi044.stdout:0/615: creat d8/d78/db8/fcd x:0 0 0 2024-04-25T22:03:21.930 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:21.930 INFO:tasks.workunit.client.0.smithi044.stdout:5/695: dwrite d2/d5/f16 [4194304,4194304] 0 2024-04-25T22:03:21.931 INFO:tasks.workunit.client.0.smithi044.stdout:5/696: mkdir d2/d5/d27/d2a/db5/dde 0 2024-04-25T22:03:21.931 INFO:tasks.workunit.client.0.smithi044.stdout:5/697: mkdir d2/d5/d27/d2a/d5c/d5f/ddf 0 2024-04-25T22:03:21.933 INFO:tasks.workunit.client.0.smithi044.stdout:5/698: mkdir d2/d5/d27/d2a/db5/dde/de0 0 2024-04-25T22:03:21.933 INFO:tasks.workunit.client.0.smithi044.stdout:5/699: write d2/f20 [1069045,112807] 0 2024-04-25T22:03:21.934 INFO:tasks.workunit.client.0.smithi044.stdout:0/616: dwrite d8/d78/db8/fcd [0,4194304] 0 2024-04-25T22:03:21.935 INFO:tasks.workunit.client.0.smithi044.stdout:5/700: fdatasync d2/d5/d21/d38/d52/d56/fac 0 2024-04-25T22:03:21.938 INFO:tasks.workunit.client.0.smithi044.stdout:7/493: sync 2024-04-25T22:03:21.938 INFO:tasks.workunit.client.0.smithi044.stdout:7/494: fdatasync d1c/d22/d28/d30/d32/f42 0 2024-04-25T22:03:21.938 INFO:tasks.workunit.client.0.smithi044.stdout:7/495: mknod d1c/d22/d4a/c94 0 2024-04-25T22:03:21.940 INFO:tasks.workunit.client.0.smithi044.stdout:7/496: write d1c/d22/d4a/f64 [35733,22441] 0 2024-04-25T22:03:21.940 INFO:tasks.workunit.client.0.smithi044.stdout:7/497: fdatasync d1c/d22/d28/d30/d32/f52 0 2024-04-25T22:03:21.940 INFO:tasks.workunit.client.0.smithi044.stdout:7/498: chown d1c/d22/d28/d30/d32/d5d 89 1 2024-04-25T22:03:21.940 INFO:tasks.workunit.client.0.smithi044.stdout:7/499: write d1c/d22/f25 [7862245,58606] 0 2024-04-25T22:03:21.941 INFO:tasks.workunit.client.0.smithi044.stdout:7/500: read - d1c/d22/d28/d4e/d6a/f8c zero size 2024-04-25T22:03:21.942 INFO:tasks.workunit.client.0.smithi044.stdout:0/617: truncate d8/db2/f56 1075449 0 2024-04-25T22:03:21.943 INFO:tasks.workunit.client.0.smithi044.stdout:0/618: symlink d8/df/d17/d87/lce 0 2024-04-25T22:03:21.943 INFO:tasks.workunit.client.0.smithi044.stdout:0/619: stat d8/df/l2d 0 2024-04-25T22:03:21.947 INFO:tasks.workunit.client.0.smithi044.stdout:7/501: dwrite d1c/d22/d28/d30/d32/d5d/f76 [0,4194304] 0 2024-04-25T22:03:21.947 INFO:tasks.workunit.client.0.smithi044.stdout:4/612: dread dd/f11 [0,4194304] 0 2024-04-25T22:03:21.948 INFO:tasks.workunit.client.0.smithi044.stdout:7/502: mknod d1c/d88/c95 0 2024-04-25T22:03:21.948 INFO:tasks.workunit.client.0.smithi044.stdout:5/701: truncate d2/d5/d21/d26/d2c/d37/fb4 7938768 0 2024-04-25T22:03:21.949 INFO:tasks.workunit.client.0.smithi044.stdout:7/503: write d1c/f2f [2205815,82001] 0 2024-04-25T22:03:21.949 INFO:tasks.workunit.client.0.smithi044.stdout:0/620: dwrite d8/db2/d8e/fc3 [0,4194304] 0 2024-04-25T22:03:21.950 INFO:tasks.workunit.client.0.smithi044.stdout:5/702: getdents d2/d5 0 2024-04-25T22:03:21.955 INFO:tasks.workunit.client.0.smithi044.stdout:4/613: dwrite dd/d35/d52/f6a [0,4194304] 0 2024-04-25T22:03:21.958 INFO:tasks.workunit.client.0.smithi044.stdout:7/504: dwrite d1c/d22/d28/d30/d32/f42 [0,4194304] 0 2024-04-25T22:03:21.958 INFO:tasks.workunit.client.0.smithi044.stdout:5/703: dwrite d2/d5/d27/d2a/d3a/fb1 [0,4194304] 0 2024-04-25T22:03:21.959 INFO:tasks.workunit.client.0.smithi044.stdout:0/621: dwrite d8/df/d17/d45/f50 [0,4194304] 0 2024-04-25T22:03:21.959 INFO:tasks.workunit.client.0.smithi044.stdout:7/505: readlink d1c/d22/d28/d4e/d6a/l6d 0 2024-04-25T22:03:21.961 INFO:tasks.workunit.client.0.smithi044.stdout:0/622: fsync d8/da/f7a 0 2024-04-25T22:03:21.961 INFO:tasks.workunit.client.0.smithi044.stdout:5/704: creat d2/d5/d27/d2a/db5/dde/fe1 x:0 0 0 2024-04-25T22:03:21.961 INFO:tasks.workunit.client.0.smithi044.stdout:0/623: stat d8/db2/d8e/fc3 0 2024-04-25T22:03:21.961 INFO:tasks.workunit.client.0.smithi044.stdout:5/705: chown d2/d5/d21/cc2 0 1 2024-04-25T22:03:21.962 INFO:tasks.workunit.client.0.smithi044.stdout:0/624: fdatasync d8/df/f10 0 2024-04-25T22:03:21.962 INFO:tasks.workunit.client.0.smithi044.stdout:5/706: mkdir d2/d5b/da8/de2 0 2024-04-25T22:03:21.963 INFO:tasks.workunit.client.0.smithi044.stdout:5/707: fsync d2/d5/d21/d26/f82 0 2024-04-25T22:03:21.964 INFO:tasks.workunit.client.0.smithi044.stdout:5/708: chown d2/d5/d27/d2a/d5c/d5f/f63 111986 1 2024-04-25T22:03:21.966 INFO:tasks.workunit.client.0.smithi044.stdout:5/709: write d2/d5/d21/d26/d2c/d37/f8a [3011896,92689] 0 2024-04-25T22:03:21.966 INFO:tasks.workunit.client.0.smithi044.stdout:4/614: dwrite dd/d19/d72/d79/d7f/d81/f5c [4194304,4194304] 0 2024-04-25T22:03:21.967 INFO:tasks.workunit.client.0.smithi044.stdout:5/710: creat d2/d5/d21/d38/d52/fe3 x:0 0 0 2024-04-25T22:03:21.967 INFO:tasks.workunit.client.0.smithi044.stdout:5/711: chown d2/d5/d27/d2a/d3a/fa6 26962180 1 2024-04-25T22:03:21.972 INFO:tasks.workunit.client.0.smithi044.stdout:4/615: dwrite dd/d19/d72/db6/fc0 [0,4194304] 0 2024-04-25T22:03:21.978 INFO:tasks.workunit.client.0.smithi044.stdout:5/712: truncate d2/d5/d21/f49 2632753 0 2024-04-25T22:03:21.979 INFO:tasks.workunit.client.0.smithi044.stdout:5/713: symlink d2/d5/d27/d2a/d5c/le4 0 2024-04-25T22:03:21.980 INFO:tasks.workunit.client.0.smithi044.stdout:5/714: fsync d2/d5/d21/d26/d2c/d37/f58 0 2024-04-25T22:03:21.981 INFO:tasks.workunit.client.0.smithi044.stdout:4/616: dread dd/d19/f6d [4194304,4194304] 0 2024-04-25T22:03:21.981 INFO:tasks.workunit.client.0.smithi044.stdout:5/715: creat d2/d5/d21/d6b/fe5 x:0 0 0 2024-04-25T22:03:21.981 INFO:tasks.workunit.client.0.smithi044.stdout:4/617: rename dd/d19/d72 to dd/d35/d52/da9/dca 0 2024-04-25T22:03:21.982 INFO:tasks.workunit.client.0.smithi044.stdout:4/618: chown dd/d35/d52/f90 422484 1 2024-04-25T22:03:21.983 INFO:tasks.workunit.client.0.smithi044.stdout:4/619: truncate dd/d35/d52/d61/f73 1456013 0 2024-04-25T22:03:21.986 INFO:tasks.workunit.client.0.smithi044.stdout:5/716: dwrite d2/d5/d21/f2d [4194304,4194304] 0 2024-04-25T22:03:21.987 INFO:tasks.workunit.client.0.smithi044.stdout:5/717: fdatasync d2/d5/d27/d2a/f42 0 2024-04-25T22:03:21.988 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:21.984+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:21.989 INFO:tasks.workunit.client.0.smithi044.stdout:5/718: getdents d2/d5/d21/d38/d52/dd4 0 2024-04-25T22:03:21.989 INFO:tasks.workunit.client.0.smithi044.stdout:4/620: dwrite fa [0,4194304] 0 2024-04-25T22:03:21.990 INFO:tasks.workunit.client.0.smithi044.stdout:4/621: chown dd/f80 4766 1 2024-04-25T22:03:21.990 INFO:tasks.workunit.client.0.smithi044.stdout:5/719: write d2/d5/d21/d26/d2c/d37/f58 [517308,92296] 0 2024-04-25T22:03:21.990 INFO:tasks.workunit.client.0.smithi044.stdout:4/622: creat dd/d35/d52/fcb x:0 0 0 2024-04-25T22:03:21.991 INFO:tasks.workunit.client.0.smithi044.stdout:4/623: chown dd/d19/f6d 1085 1 2024-04-25T22:03:21.992 INFO:tasks.workunit.client.0.smithi044.stdout:4/624: write dd/d35/d52/fb0 [728515,20882] 0 2024-04-25T22:03:21.992 INFO:tasks.workunit.client.0.smithi044.stdout:4/625: chown dd/d35/d52/f90 10222 1 2024-04-25T22:03:21.992 INFO:tasks.workunit.client.0.smithi044.stdout:5/720: rmdir d2/d5/d21/d38/dc5 0 2024-04-25T22:03:21.993 INFO:tasks.workunit.client.0.smithi044.stdout:5/721: creat d2/d5/d21/d38/dc8/fe6 x:0 0 0 2024-04-25T22:03:21.994 INFO:tasks.workunit.client.0.smithi044.stdout:4/626: truncate dd/d35/d52/da9/dca/f8d 963151 0 2024-04-25T22:03:21.994 INFO:tasks.workunit.client.0.smithi044.stdout:4/627: unlink dd/d19/fa8 0 2024-04-25T22:03:21.994 INFO:tasks.workunit.client.0.smithi044.stdout:5/722: symlink d2/d5b/d8e/dd0/le7 0 2024-04-25T22:03:21.995 INFO:tasks.workunit.client.0.smithi044.stdout:5/723: chown d2/d5/d27/d2a/c6f 171280891 1 2024-04-25T22:03:21.995 INFO:tasks.workunit.client.0.smithi044.stdout:5/724: chown d2/f19 5081614 1 2024-04-25T22:03:21.995 INFO:tasks.workunit.client.0.smithi044.stdout:9/792: sync 2024-04-25T22:03:21.995 INFO:tasks.workunit.client.0.smithi044.stdout:6/807: sync 2024-04-25T22:03:21.996 INFO:tasks.workunit.client.0.smithi044.stdout:2/605: sync 2024-04-25T22:03:21.996 INFO:tasks.workunit.client.0.smithi044.stdout:3/700: sync 2024-04-25T22:03:21.996 INFO:tasks.workunit.client.0.smithi044.stdout:1/566: sync 2024-04-25T22:03:21.996 INFO:tasks.workunit.client.0.smithi044.stdout:8/853: sync 2024-04-25T22:03:21.996 INFO:tasks.workunit.client.0.smithi044.stdout:0/625: sync 2024-04-25T22:03:21.996 INFO:tasks.workunit.client.0.smithi044.stdout:3/701: chown d0/d70/d7c/da9/dc0 22792793 1 2024-04-25T22:03:21.997 INFO:tasks.workunit.client.0.smithi044.stdout:1/567: mknod d3/d7/db/d5d/cb2 0 2024-04-25T22:03:21.997 INFO:tasks.workunit.client.0.smithi044.stdout:5/725: write d2/d5/d27/d2a/f42 [386279,119291] 0 2024-04-25T22:03:21.997 INFO:tasks.workunit.client.0.smithi044.stdout:9/793: mknod d4/d7/d18/d3a/c109 0 2024-04-25T22:03:21.998 INFO:tasks.workunit.client.0.smithi044.stdout:8/854: creat d2a/d32/d3e/dd0/d116/f117 x:0 0 0 2024-04-25T22:03:21.998 INFO:tasks.workunit.client.0.smithi044.stdout:0/626: creat d8/da/fcf x:0 0 0 2024-04-25T22:03:21.998 INFO:tasks.workunit.client.0.smithi044.stdout:6/808: creat d2/d23/d5a/d12/d1f/d94/dc8/dfa/f111 x:0 0 0 2024-04-25T22:03:21.999 INFO:tasks.workunit.client.0.smithi044.stdout:5/726: mknod d2/d5/d27/d2a/db5/dde/ce8 0 2024-04-25T22:03:21.999 INFO:tasks.workunit.client.0.smithi044.stdout:3/702: truncate d0/d13/d1c/d93/fd4 930309 0 2024-04-25T22:03:21.999 INFO:tasks.workunit.client.0.smithi044.stdout:9/794: write d4/f1a [1276399,56039] 0 2024-04-25T22:03:22.000 INFO:tasks.workunit.client.0.smithi044.stdout:0/627: symlink d8/df/d17/d45/d95/d51/ld0 0 2024-04-25T22:03:22.000 INFO:tasks.workunit.client.0.smithi044.stdout:6/809: unlink d2/d23/d5a/d11/c9e 0 2024-04-25T22:03:22.000 INFO:tasks.workunit.client.0.smithi044.stdout:8/855: getdents d2a/d39 0 2024-04-25T22:03:22.001 INFO:tasks.workunit.client.0.smithi044.stdout:5/727: chown d2/d5/d21/lc4 43340 1 2024-04-25T22:03:22.001 INFO:tasks.workunit.client.0.smithi044.stdout:9/795: chown d4/l77 322647 1 2024-04-25T22:03:22.001 INFO:tasks.workunit.client.0.smithi044.stdout:0/628: readlink d8/df/d17/d45/d95/d51/ld0 0 2024-04-25T22:03:22.002 INFO:tasks.workunit.client.0.smithi044.stdout:3/703: dread d0/d70/f84 [0,4194304] 0 2024-04-25T22:03:22.002 INFO:tasks.workunit.client.0.smithi044.stdout:6/810: mknod d2/d23/d5a/d12/d27/d8d/c112 0 2024-04-25T22:03:22.002 INFO:tasks.workunit.client.0.smithi044.stdout:9/796: readlink d4/d7/d18/la2 0 2024-04-25T22:03:22.002 INFO:tasks.workunit.client.0.smithi044.stdout:4/628: dwrite dd/d35/d52/f9e [0,4194304] 0 2024-04-25T22:03:22.004 INFO:tasks.workunit.client.0.smithi044.stdout:8/856: symlink d2a/d39/d42/d68/d6b/d6e/d84/l118 0 2024-04-25T22:03:22.005 INFO:tasks.workunit.client.0.smithi044.stdout:9/797: stat d4/d3d/caf 0 2024-04-25T22:03:22.005 INFO:tasks.workunit.client.0.smithi044.stdout:6/811: read d2/d23/d5a/d11/f39 [2653658,1299] 0 2024-04-25T22:03:22.005 INFO:tasks.workunit.client.0.smithi044.stdout:9/798: stat d4/d7/d79/ddc/de1/l6b 0 2024-04-25T22:03:22.005 INFO:tasks.workunit.client.0.smithi044.stdout:4/629: symlink dd/d35/d52/lcc 0 2024-04-25T22:03:22.005 INFO:tasks.workunit.client.0.smithi044.stdout:5/728: read d2/d5/f5e [43558,69708] 0 2024-04-25T22:03:22.005 INFO:tasks.workunit.client.0.smithi044.stdout:8/857: write d2a/d39/d5a/d92/dab/f110 [345319,50133] 0 2024-04-25T22:03:22.005 INFO:tasks.workunit.client.0.smithi044.stdout:0/629: rename d8/f4d to d8/da/d60/daa/dbe/fd1 0 2024-04-25T22:03:22.007 INFO:tasks.workunit.client.0.smithi044.stdout:0/630: symlink d8/d78/db8/ld2 0 2024-04-25T22:03:22.007 INFO:tasks.workunit.client.0.smithi044.stdout:9/799: write d4/d7/d18/d2d/f62 [8038361,103695] 0 2024-04-25T22:03:22.008 INFO:tasks.workunit.client.0.smithi044.stdout:8/858: dread d2a/d32/d3e/f44 [0,4194304] 0 2024-04-25T22:03:22.008 INFO:tasks.workunit.client.0.smithi044.stdout:9/800: chown d4/c2a 688828593 1 2024-04-25T22:03:22.009 INFO:tasks.workunit.client.0.smithi044.stdout:6/812: dread d2/d23/d5a/d11/d2a/dbf/f97 [4194304,4194304] 0 2024-04-25T22:03:22.009 INFO:tasks.workunit.client.0.smithi044.stdout:0/631: creat d8/da/d60/daa/dbe/fd3 x:0 0 0 2024-04-25T22:03:22.009 INFO:tasks.workunit.client.0.smithi044.stdout:3/704: dwrite d0/f31 [0,4194304] 0 2024-04-25T22:03:22.009 INFO:tasks.workunit.client.0.smithi044.stdout:0/632: readlink d8/da/lb 0 2024-04-25T22:03:22.010 INFO:tasks.workunit.client.0.smithi044.stdout:8/859: mkdir d2a/d32/d57/d119 0 2024-04-25T22:03:22.011 INFO:tasks.workunit.client.0.smithi044.stdout:9/801: mkdir d4/d3d/d66/db9/dbe/df5/d10a 0 2024-04-25T22:03:22.011 INFO:tasks.workunit.client.0.smithi044.stdout:6/813: creat d2/d23/d5a/d11/d3b/dc6/d10a/f113 x:0 0 0 2024-04-25T22:03:22.013 INFO:tasks.workunit.client.0.smithi044.stdout:8/860: mknod d2a/d39/d5a/d92/dab/c11a 0 2024-04-25T22:03:22.013 INFO:tasks.workunit.client.0.smithi044.stdout:3/705: link d0/d13/d1c/fd5 d0/d1/d15/d51/fe0 0 2024-04-25T22:03:22.014 INFO:tasks.workunit.client.0.smithi044.stdout:5/729: dwrite d2/d5/d21/f2d [4194304,4194304] 0 2024-04-25T22:03:22.016 INFO:tasks.workunit.client.0.smithi044.stdout:3/706: read d0/d1/d15/d51/dd/d28/f3e [35330,36417] 0 2024-04-25T22:03:22.016 INFO:tasks.workunit.client.0.smithi044.stdout:0/633: link d8/df/d17/d45/d95/d9c/dcc/f5c d8/df/d88/db6/fd4 0 2024-04-25T22:03:22.016 INFO:tasks.workunit.client.0.smithi044.stdout:3/707: mknod d0/d70/ce1 0 2024-04-25T22:03:22.017 INFO:tasks.workunit.client.0.smithi044.stdout:5/730: getdents d2/d5 0 2024-04-25T22:03:22.018 INFO:tasks.workunit.client.0.smithi044.stdout:9/802: getdents d4/d3d/d66/db9/dbe 0 2024-04-25T22:03:22.020 INFO:tasks.workunit.client.0.smithi044.stdout:5/731: rename d2/d5/f88 to d2/d5/d21/d38/d52/d56/fe9 0 2024-04-25T22:03:22.021 INFO:tasks.workunit.client.0.smithi044.stdout:8/861: dwrite d2a/d32/f35 [0,4194304] 0 2024-04-25T22:03:22.023 INFO:tasks.workunit.client.0.smithi044.stdout:0/634: dwrite d8/df/d17/d45/d95/d9c/dcc/f8d [0,4194304] 0 2024-04-25T22:03:22.023 INFO:tasks.workunit.client.0.smithi044.stdout:8/862: mkdir d2a/d32/d57/d119/d11b 0 2024-04-25T22:03:22.026 INFO:tasks.workunit.client.0.smithi044.stdout:0/635: rename d8/f3b to d8/df/d17/d45/d95/d9c/dbd/fd5 0 2024-04-25T22:03:22.027 INFO:tasks.workunit.client.0.smithi044.stdout:1/568: write d3/d30/d3f/f68 [3201026,18735] 0 2024-04-25T22:03:22.027 INFO:tasks.workunit.client.0.smithi044.stdout:2/606: write d7/d16/d2c/f3b [25994,73713] 0 2024-04-25T22:03:22.027 INFO:tasks.workunit.client.0.smithi044.stdout:8/863: link d2a/d39/d42/d80/feb d2a/d39/d42/d80/f11c 0 2024-04-25T22:03:22.030 INFO:tasks.workunit.client.0.smithi044.stdout:8/864: mknod d2a/d32/d57/d5e/dce/c11d 0 2024-04-25T22:03:22.030 INFO:tasks.workunit.client.0.smithi044.stdout:1/569: rename d3/d72/f9b to d3/d7/db/d5d/d7f/fb3 0 2024-04-25T22:03:22.030 INFO:tasks.workunit.client.0.smithi044.stdout:2/607: dread - d7/d7b/d81/d4e/d86/d6b/fb1 zero size 2024-04-25T22:03:22.031 INFO:tasks.workunit.client.0.smithi044.stdout:1/570: mkdir d3/d4b/db4 0 2024-04-25T22:03:22.031 INFO:tasks.workunit.client.0.smithi044.stdout:2/608: mkdir d7/d16/d4b/dc1 0 2024-04-25T22:03:22.031 INFO:tasks.workunit.client.0.smithi044.stdout:8/865: link d2a/d39/d42/d68/d6b/d7b/f8b d2a/d39/d42/d68/f11e 0 2024-04-25T22:03:22.032 INFO:tasks.workunit.client.0.smithi044.stdout:1/571: creat d3/d7/db/fb5 x:0 0 0 2024-04-25T22:03:22.032 INFO:tasks.workunit.client.0.smithi044.stdout:2/609: unlink d7/c1e 0 2024-04-25T22:03:22.032 INFO:tasks.workunit.client.0.smithi044.stdout:0/636: dread d8/d78/db8/fcd [0,4194304] 0 2024-04-25T22:03:22.032 INFO:tasks.workunit.client.0.smithi044.stdout:4/630: truncate dd/f8a 1006474 0 2024-04-25T22:03:22.032 INFO:tasks.workunit.client.0.smithi044.stdout:1/572: dread - d3/d7/db/fb5 zero size 2024-04-25T22:03:22.033 INFO:tasks.workunit.client.0.smithi044.stdout:4/631: fdatasync dd/d35/f47 0 2024-04-25T22:03:22.033 INFO:tasks.workunit.client.0.smithi044.stdout:3/708: truncate d0/d1/d34/f58 1088329 0 2024-04-25T22:03:22.034 INFO:tasks.workunit.client.0.smithi044.stdout:1/573: mkdir d3/d4b/db6 0 2024-04-25T22:03:22.034 INFO:tasks.workunit.client.0.smithi044.stdout:0/637: write d8/d20/fc0 [749075,36725] 0 2024-04-25T22:03:22.034 INFO:tasks.workunit.client.0.smithi044.stdout:9/803: truncate d4/d7/d79/ddc/de1/f45 1486516 0 2024-04-25T22:03:22.034 INFO:tasks.workunit.client.0.smithi044.stdout:2/610: dread - d7/d8/d5f/fa4 zero size 2024-04-25T22:03:22.035 INFO:tasks.workunit.client.0.smithi044.stdout:4/632: fsync dd/d35/d52/d61/d76/fae 0 2024-04-25T22:03:22.035 INFO:tasks.workunit.client.0.smithi044.stdout:3/709: rename d0/l24 to d0/d70/le2 0 2024-04-25T22:03:22.036 INFO:tasks.workunit.client.0.smithi044.stdout:1/574: rmdir d3/d54/da2 0 2024-04-25T22:03:22.037 INFO:tasks.workunit.client.0.smithi044.stdout:0/638: write d8/df/d17/d45/d95/d9c/dcc/f8d [4326601,92931] 0 2024-04-25T22:03:22.038 INFO:tasks.workunit.client.0.smithi044.stdout:2/611: symlink d7/d7b/d81/d4e/d86/lc2 0 2024-04-25T22:03:22.038 INFO:tasks.workunit.client.0.smithi044.stdout:4/633: write dd/d35/f47 [5877304,42886] 0 2024-04-25T22:03:22.038 INFO:tasks.workunit.client.0.smithi044.stdout:1/575: read d3/d7/db/f1d [3272116,22831] 0 2024-04-25T22:03:22.039 INFO:tasks.workunit.client.0.smithi044.stdout:6/814: dwrite d2/f100 [0,4194304] 0 2024-04-25T22:03:22.039 INFO:tasks.workunit.client.0.smithi044.stdout:1/576: write d3/d7/d29/fb1 [603124,92151] 0 2024-04-25T22:03:22.039 INFO:tasks.workunit.client.0.smithi044.stdout:0/639: creat d8/df/d17/d45/d95/d51/d8b/db0/fd6 x:0 0 0 2024-04-25T22:03:22.040 INFO:tasks.workunit.client.0.smithi044.stdout:1/577: chown d3/d7/f57 10409557 1 2024-04-25T22:03:22.043 INFO:tasks.workunit.client.0.smithi044.stdout:8/866: truncate d2a/d39/d42/d68/d6b/f56 1911550 0 2024-04-25T22:03:22.043 INFO:tasks.workunit.client.0.smithi044.stdout:8/867: mkdir d2a/d39/d11f 0 2024-04-25T22:03:22.047 INFO:tasks.workunit.client.0.smithi044.stdout:7/506: dread d1c/d22/f25 [0,4194304] 0 2024-04-25T22:03:22.048 INFO:tasks.workunit.client.0.smithi044.stdout:7/507: symlink d1c/d88/d8f/l96 0 2024-04-25T22:03:22.049 INFO:tasks.workunit.client.0.smithi044.stdout:4/634: dwrite dd/d19/f2b [0,4194304] 0 2024-04-25T22:03:22.056 INFO:tasks.workunit.client.0.smithi044.stdout:6/815: dread d2/d23/d5a/d12/d1f/fa4 [0,4194304] 0 2024-04-25T22:03:22.057 INFO:tasks.workunit.client.0.smithi044.stdout:7/508: dwrite d1c/d22/f25 [8388608,4194304] 0 2024-04-25T22:03:22.057 INFO:tasks.workunit.client.0.smithi044.stdout:5/732: dread d2/d5/f9 [0,4194304] 0 2024-04-25T22:03:22.057 INFO:tasks.workunit.client.0.smithi044.stdout:6/816: chown d2/d23/d5a/d13/d68/l59 327 1 2024-04-25T22:03:22.058 INFO:tasks.workunit.client.0.smithi044.stdout:0/640: truncate f0 3540368 0 2024-04-25T22:03:22.058 INFO:tasks.workunit.client.0.smithi044.stdout:7/509: mkdir d1c/d22/d28/d30/d32/d97 0 2024-04-25T22:03:22.059 INFO:tasks.workunit.client.0.smithi044.stdout:7/510: readlink d1c/d22/d28/l6c 0 2024-04-25T22:03:22.061 INFO:tasks.workunit.client.0.smithi044.stdout:5/733: unlink d2/d5/d21/d26/d2c/f74 0 2024-04-25T22:03:22.061 INFO:tasks.workunit.client.0.smithi044.stdout:6/817: creat d2/d23/d5a/d12/d27/daf/dcb/d5e/d92/f114 x:0 0 0 2024-04-25T22:03:22.062 INFO:tasks.workunit.client.0.smithi044.stdout:5/734: write d2/d5/f16 [3389039,121994] 0 2024-04-25T22:03:22.064 INFO:tasks.workunit.client.0.smithi044.stdout:5/735: mknod d2/dc1/cea 0 2024-04-25T22:03:22.064 INFO:tasks.workunit.client.0.smithi044.stdout:4/635: chown dd/f8a 0 1 2024-04-25T22:03:22.066 INFO:tasks.workunit.client.0.smithi044.stdout:0/641: dwrite d8/df/d17/d45/d95/d51/d8b/f97 [0,4194304] 0 2024-04-25T22:03:22.069 INFO:tasks.workunit.client.0.smithi044.stdout:0/642: mknod d8/df/d17/d45/cd7 0 2024-04-25T22:03:22.070 INFO:tasks.workunit.client.0.smithi044.stdout:6/818: dwrite d2/d23/d5a/d12/f46 [0,4194304] 0 2024-04-25T22:03:22.071 INFO:tasks.workunit.client.0.smithi044.stdout:2/612: dread d7/d8/d1c/f67 [0,4194304] 0 2024-04-25T22:03:22.071 INFO:tasks.workunit.client.0.smithi044.stdout:0/643: truncate d8/da/f7a 1172975 0 2024-04-25T22:03:22.071 INFO:tasks.workunit.client.0.smithi044.stdout:5/736: truncate d2/d5/d21/d26/d2c/d37/fb4 4758073 0 2024-04-25T22:03:22.071 INFO:tasks.workunit.client.0.smithi044.stdout:7/511: dwrite f12 [0,4194304] 0 2024-04-25T22:03:22.071 INFO:tasks.workunit.client.0.smithi044.stdout:2/613: readlink d7/l29 0 2024-04-25T22:03:22.071 INFO:tasks.workunit.client.0.smithi044.stdout:6/819: write d2/d23/d5a/d12/d49/ffd [4207727,16446] 0 2024-04-25T22:03:22.072 INFO:tasks.workunit.client.0.smithi044.stdout:0/644: mkdir d8/df/d17/db9/dd8 0 2024-04-25T22:03:22.073 INFO:tasks.workunit.client.0.smithi044.stdout:7/512: symlink d1c/d22/d28/d4e/l98 0 2024-04-25T22:03:22.073 INFO:tasks.workunit.client.0.smithi044.stdout:6/820: mkdir d2/d23/d5a/d11/d2a/dbf/d115 0 2024-04-25T22:03:22.074 INFO:tasks.workunit.client.0.smithi044.stdout:0/645: mkdir d8/da/d60/d86/dd9 0 2024-04-25T22:03:22.074 INFO:tasks.workunit.client.0.smithi044.stdout:0/646: chown d8/d78/db8 1604 1 2024-04-25T22:03:22.075 INFO:tasks.workunit.client.0.smithi044.stdout:2/614: link d7/d7b/d81/d4e/d86/d6b/c73 d7/d16/d2c/d75/cc3 0 2024-04-25T22:03:22.075 INFO:tasks.workunit.client.0.smithi044.stdout:6/821: write d2/d23/d5a/d11/d2a/f80 [846120,110382] 0 2024-04-25T22:03:22.076 INFO:tasks.workunit.client.0.smithi044.stdout:0/647: chown d8/df/d17/d45/dad/lc6 13322 1 2024-04-25T22:03:22.077 INFO:tasks.workunit.client.0.smithi044.stdout:6/822: mkdir d2/d105/d116 0 2024-04-25T22:03:22.080 INFO:tasks.workunit.client.0.smithi044.stdout:6/823: stat d2/d23/d6a/d63 0 2024-04-25T22:03:22.080 INFO:tasks.workunit.client.0.smithi044.stdout:2/615: symlink d7/d5b/lc4 0 2024-04-25T22:03:22.080 INFO:tasks.workunit.client.0.smithi044.stdout:0/648: write d8/d20/f7d [908505,77256] 0 2024-04-25T22:03:22.080 INFO:tasks.workunit.client.0.smithi044.stdout:5/737: dwrite d2/d5/d6a/fa4 [0,4194304] 0 2024-04-25T22:03:22.080 INFO:tasks.workunit.client.0.smithi044.stdout:0/649: write d8/f9f [743493,113087] 0 2024-04-25T22:03:22.081 INFO:tasks.workunit.client.0.smithi044.stdout:6/824: symlink d2/d23/d5a/d12/d1f/d94/dc8/dfa/l117 0 2024-04-25T22:03:22.081 INFO:tasks.workunit.client.0.smithi044.stdout:9/804: dread d4/d3d/d58/dd2/df7/fff [0,4194304] 0 2024-04-25T22:03:22.081 INFO:tasks.workunit.client.0.smithi044.stdout:8/868: dread f22 [0,4194304] 0 2024-04-25T22:03:22.081 INFO:tasks.workunit.client.0.smithi044.stdout:5/738: write d2/d5/d27/d2a/d3a/fa6 [380670,59060] 0 2024-04-25T22:03:22.081 INFO:tasks.workunit.client.0.smithi044.stdout:0/650: rmdir d8/df/d17/d45/dad 39 2024-04-25T22:03:22.081 INFO:tasks.workunit.client.0.smithi044.stdout:8/869: mkdir d2a/d77/d120 0 2024-04-25T22:03:22.082 INFO:tasks.workunit.client.0.smithi044.stdout:9/805: write d4/d3d/d66/db9/dbe/df5/fe7 [1065624,32043] 0 2024-04-25T22:03:22.082 INFO:tasks.workunit.client.0.smithi044.stdout:6/825: mknod d2/d23/d5a/d12/d27/daf/dcb/d5e/db5/c118 0 2024-04-25T22:03:22.086 INFO:tasks.workunit.client.0.smithi044.stdout:5/739: write d2/d5/d27/d2a/d3a/fb1 [4042132,102809] 0 2024-04-25T22:03:22.087 INFO:tasks.workunit.client.0.smithi044.stdout:6/826: chown d2/d105/d116 69 1 2024-04-25T22:03:22.087 INFO:tasks.workunit.client.0.smithi044.stdout:8/870: rename d2a/d32/d57/d5e to d2a/d39/d42/d80/d121 0 2024-04-25T22:03:22.087 INFO:tasks.workunit.client.0.smithi044.stdout:0/651: write d8/df/d17/d45/d95/d9c/dbd/fd5 [4887361,40899] 0 2024-04-25T22:03:22.087 INFO:tasks.workunit.client.0.smithi044.stdout:7/513: dread d1c/d22/f75 [0,4194304] 0 2024-04-25T22:03:22.087 INFO:tasks.workunit.client.0.smithi044.stdout:0/652: mknod d8/db2/cda 0 2024-04-25T22:03:22.087 INFO:tasks.workunit.client.0.smithi044.stdout:3/710: dread d0/d1/d15/d51/dd/d35/dc6/d44/f6b [0,4194304] 0 2024-04-25T22:03:22.087 INFO:tasks.workunit.client.0.smithi044.stdout:8/871: write d2a/d39/d42/d68/fd9 [933212,73146] 0 2024-04-25T22:03:22.087 INFO:tasks.workunit.client.0.smithi044.stdout:9/806: mkdir d4/d7/d79/ddc/de1/d54/d84/d72/d97/df3/d10b 0 2024-04-25T22:03:22.087 INFO:tasks.workunit.client.0.smithi044.stdout:6/827: creat d2/d23/d5a/d12/d27/daf/dcb/d5e/db5/f119 x:0 0 0 2024-04-25T22:03:22.087 INFO:tasks.workunit.client.0.smithi044.stdout:3/711: rmdir d0/d1/d15/d51/dd/d11 39 2024-04-25T22:03:22.088 INFO:tasks.workunit.client.0.smithi044.stdout:5/740: link d2/d5/d21/d6b/d9b/cd2 d2/d5/d27/d2a/d3a/ceb 0 2024-04-25T22:03:22.088 INFO:tasks.workunit.client.0.smithi044.stdout:7/514: getdents d1c/d22/d28/d57/d7c 0 2024-04-25T22:03:22.088 INFO:tasks.workunit.client.0.smithi044.stdout:8/872: getdents d2a/d82/dec 0 2024-04-25T22:03:22.089 INFO:tasks.workunit.client.0.smithi044.stdout:9/807: unlink d4/d3d/d66/db9/dbe/df5/dd3/cf4 0 2024-04-25T22:03:22.089 INFO:tasks.workunit.client.0.smithi044.stdout:1/578: sync 2024-04-25T22:03:22.089 INFO:tasks.workunit.client.0.smithi044.stdout:3/712: mknod d0/d1/d34/d48/ce3 0 2024-04-25T22:03:22.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:22.085+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:22.090 INFO:tasks.workunit.client.0.smithi044.stdout:1/579: rmdir d3/d54 39 2024-04-25T22:03:22.090 INFO:tasks.workunit.client.0.smithi044.stdout:2/616: read d7/d8/d5f/d70/d8a/f92 [552688,14769] 0 2024-04-25T22:03:22.090 INFO:tasks.workunit.client.0.smithi044.stdout:9/808: creat d4/d3d/d66/db9/dbe/df5/dd3/dd4/f10c x:0 0 0 2024-04-25T22:03:22.090 INFO:tasks.workunit.client.0.smithi044.stdout:3/713: rename d0/d2/dcb to d0/d1/d15/d51/d8e/d74/de4 0 2024-04-25T22:03:22.091 INFO:tasks.workunit.client.0.smithi044.stdout:7/515: link d1c/d22/d28/d4e/d7b/c31 d1c/d22/d28/d66/d6e/c99 0 2024-04-25T22:03:22.091 INFO:tasks.workunit.client.0.smithi044.stdout:1/580: write d3/d7/db/f1d [7335954,115451] 0 2024-04-25T22:03:22.091 INFO:tasks.workunit.client.0.smithi044.stdout:0/653: getdents d8/df/d17/d45/dad 0 2024-04-25T22:03:22.091 INFO:tasks.workunit.client.0.smithi044.stdout:2/617: symlink d7/d7b/d81/d4e/d86/lc5 0 2024-04-25T22:03:22.091 INFO:tasks.workunit.client.0.smithi044.stdout:4/636: dread dd/d35/d52/da9/dca/d79/d7f/dc3/faa [0,4194304] 0 2024-04-25T22:03:22.091 INFO:tasks.workunit.client.0.smithi044.stdout:3/714: unlink d0/d13/d1c/c4c 0 2024-04-25T22:03:22.094 INFO:tasks.workunit.client.0.smithi044.stdout:1/581: symlink d3/d30/d3f/lb7 0 2024-04-25T22:03:22.094 INFO:tasks.workunit.client.0.smithi044.stdout:4/637: mknod dd/d35/d52/da9/dca/d79/d9c/ccd 0 2024-04-25T22:03:22.094 INFO:tasks.workunit.client.0.smithi044.stdout:0/654: truncate d8/da/f61 1270222 0 2024-04-25T22:03:22.094 INFO:tasks.workunit.client.0.smithi044.stdout:2/618: write d7/d8/d1c/f94 [1730209,98443] 0 2024-04-25T22:03:22.095 INFO:tasks.workunit.client.0.smithi044.stdout:7/516: read d1c/d22/d4a/f4f [3255141,73330] 0 2024-04-25T22:03:22.095 INFO:tasks.workunit.client.0.smithi044.stdout:9/809: truncate d4/d3d/d66/db9/dbe/ffc 493095 0 2024-04-25T22:03:22.096 INFO:tasks.workunit.client.0.smithi044.stdout:1/582: creat d3/d59/d5c/fb8 x:0 0 0 2024-04-25T22:03:22.096 INFO:tasks.workunit.client.0.smithi044.stdout:2/619: chown d7/d16/d2c/f3b 30365 1 2024-04-25T22:03:22.097 INFO:tasks.workunit.client.0.smithi044.stdout:3/715: creat d0/d13/d1c/d93/da6/d8d/d91/fe5 x:0 0 0 2024-04-25T22:03:22.097 INFO:tasks.workunit.client.0.smithi044.stdout:7/517: read - d1c/d22/d28/d30/d32/d5d/f87 zero size 2024-04-25T22:03:22.097 INFO:tasks.workunit.client.0.smithi044.stdout:0/655: mknod d8/df/d17/d45/d95/d9c/dcc/cdb 0 2024-04-25T22:03:22.098 INFO:tasks.workunit.client.0.smithi044.stdout:5/741: dwrite d2/d5/d21/d26/fa3 [0,4194304] 0 2024-04-25T22:03:22.098 INFO:tasks.workunit.client.0.smithi044.stdout:9/810: write d4/d3d/d58/dd2/df7/fff [4815567,63897] 0 2024-04-25T22:03:22.098 INFO:tasks.workunit.client.0.smithi044.stdout:1/583: chown d3/d54/d76/f96 3797 1 2024-04-25T22:03:22.098 INFO:tasks.workunit.client.0.smithi044.stdout:2/620: symlink d7/d16/d2c/lc6 0 2024-04-25T22:03:22.099 INFO:tasks.workunit.client.0.smithi044.stdout:0/656: rmdir d8/df/d17/d45/d95/d9c 39 2024-04-25T22:03:22.099 INFO:tasks.workunit.client.0.smithi044.stdout:6/828: dwrite d2/d23/d5a/d11/f16 [0,4194304] 0 2024-04-25T22:03:22.100 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:22.100 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:22.100 INFO:tasks.workunit.client.0.smithi044.stdout:3/716: symlink d0/d1/d15/d81/dd2/le6 0 2024-04-25T22:03:22.100 INFO:tasks.workunit.client.0.smithi044.stdout:9/811: dread - d4/d4b/d86/fb2 zero size 2024-04-25T22:03:22.100 INFO:tasks.workunit.client.0.smithi044.stdout:7/518: rename f12 to d1c/d22/d28/d30/d32/f9a 0 2024-04-25T22:03:22.101 INFO:tasks.workunit.client.0.smithi044.stdout:1/584: chown d3/d7/db/d5d/d7f/cac 7 1 2024-04-25T22:03:22.101 INFO:tasks.workunit.client.0.smithi044.stdout:6/829: chown d2/d23/d5a/d12/d27/d8d/c112 2 1 2024-04-25T22:03:22.101 INFO:tasks.workunit.client.0.smithi044.stdout:2/621: write d7/d8/d5f/d70/d8a/f92 [1848154,110177] 0 2024-04-25T22:03:22.103 INFO:tasks.workunit.client.0.smithi044.stdout:6/830: read - d2/d23/d5a/d12/d27/daf/dcb/d5e/db5/f10b zero size 2024-04-25T22:03:22.105 INFO:tasks.workunit.client.0.smithi044.stdout:5/742: mkdir d2/d5/d27/d2a/d5c/dec 0 2024-04-25T22:03:22.105 INFO:tasks.workunit.client.0.smithi044.stdout:0/657: truncate d8/df/d17/d45/d95/d9c/dcc/f77 1161168 0 2024-04-25T22:03:22.105 INFO:tasks.workunit.client.0.smithi044.stdout:2/622: stat d7/d8/d1c/f94 0 2024-04-25T22:03:22.105 INFO:tasks.workunit.client.0.smithi044.stdout:7/519: getdents d1c/d22/d28/d66/d86 0 2024-04-25T22:03:22.106 INFO:tasks.workunit.client.0.smithi044.stdout:5/743: fsync d2/d5/d21/d38/d7c/fba 0 2024-04-25T22:03:22.106 INFO:tasks.workunit.client.0.smithi044.stdout:2/623: read - d7/d16/d2c/fa7 zero size 2024-04-25T22:03:22.108 INFO:tasks.workunit.client.0.smithi044.stdout:0/658: getdents d8 0 2024-04-25T22:03:22.108 INFO:tasks.workunit.client.0.smithi044.stdout:4/638: dwrite dd/d35/d52/d61/f73 [0,4194304] 0 2024-04-25T22:03:22.109 INFO:tasks.workunit.client.0.smithi044.stdout:2/624: unlink d7/d5b/ca3 0 2024-04-25T22:03:22.109 INFO:tasks.workunit.client.0.smithi044.stdout:5/744: fsync d2/d5/d27/d2a/d3a/f77 0 2024-04-25T22:03:22.110 INFO:tasks.workunit.client.0.smithi044.stdout:1/585: dwrite d3/d7/d29/fb1 [0,4194304] 0 2024-04-25T22:03:22.112 INFO:tasks.workunit.client.0.smithi044.stdout:4/639: dread dd/d35/f5e [0,4194304] 0 2024-04-25T22:03:22.113 INFO:tasks.workunit.client.0.smithi044.stdout:7/520: truncate d1c/d22/d28/d30/d32/f52 3031209 0 2024-04-25T22:03:22.113 INFO:tasks.workunit.client.0.smithi044.stdout:1/586: rename d3/d7/db/d5d/d7f/faf to d3/d4b/fb9 0 2024-04-25T22:03:22.113 INFO:tasks.workunit.client.0.smithi044.stdout:6/831: dwrite d2/d23/d5a/d12/d49/fd6 [0,4194304] 0 2024-04-25T22:03:22.113 INFO:tasks.workunit.client.0.smithi044.stdout:0/659: link d8/df/d17/d45/l47 d8/df/d93/ldc 0 2024-04-25T22:03:22.115 INFO:tasks.workunit.client.0.smithi044.stdout:5/745: getdents d2/d5/d21/d6b 0 2024-04-25T22:03:22.115 INFO:tasks.workunit.client.0.smithi044.stdout:6/832: symlink d2/d23/d6a/d63/l11a 0 2024-04-25T22:03:22.115 INFO:tasks.workunit.client.0.smithi044.stdout:4/640: symlink dd/d35/d52/d61/lce 0 2024-04-25T22:03:22.115 INFO:tasks.workunit.client.0.smithi044.stdout:1/587: creat d3/d4b/db6/fba x:0 0 0 2024-04-25T22:03:22.117 INFO:tasks.workunit.client.0.smithi044.stdout:5/746: creat d2/d5/d27/d2a/d3a/fed x:0 0 0 2024-04-25T22:03:22.117 INFO:tasks.workunit.client.0.smithi044.stdout:6/833: creat d2/d23/d5a/d11/d3b/dc6/d10a/f11b x:0 0 0 2024-04-25T22:03:22.118 INFO:tasks.workunit.client.0.smithi044.stdout:5/747: write d2/d5/d21/d26/d2c/d37/f58 [1018959,5417] 0 2024-04-25T22:03:22.119 INFO:tasks.workunit.client.0.smithi044.stdout:6/834: mknod d2/d23/d5a/d11/c11c 0 2024-04-25T22:03:22.120 INFO:tasks.workunit.client.0.smithi044.stdout:6/835: read - d2/d23/d5a/d11/f10c zero size 2024-04-25T22:03:22.120 INFO:tasks.workunit.client.0.smithi044.stdout:7/521: dwrite d1c/d22/d4a/f62 [0,4194304] 0 2024-04-25T22:03:22.121 INFO:tasks.workunit.client.0.smithi044.stdout:6/836: dread - d2/d23/d6a/d63/fff zero size 2024-04-25T22:03:22.122 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:22.123 INFO:tasks.workunit.client.0.smithi044.stdout:8/873: sync 2024-04-25T22:03:22.123 INFO:tasks.workunit.client.0.smithi044.stdout:9/812: sync 2024-04-25T22:03:22.123 INFO:tasks.workunit.client.0.smithi044.stdout:0/660: sync 2024-04-25T22:03:22.123 INFO:tasks.workunit.client.0.smithi044.stdout:2/625: sync 2024-04-25T22:03:22.123 INFO:tasks.workunit.client.0.smithi044.stdout:4/641: dwrite dd/d35/d52/d61/f73 [0,4194304] 0 2024-04-25T22:03:22.123 INFO:tasks.workunit.client.0.smithi044.stdout:6/837: fdatasync d2/d23/d5a/d12/d27/daf/dcb/f8c 0 2024-04-25T22:03:22.123 INFO:tasks.workunit.client.0.smithi044.stdout:1/588: dwrite d3/f4a [0,4194304] 0 2024-04-25T22:03:22.124 INFO:tasks.workunit.client.0.smithi044.stdout:4/642: fdatasync dd/f55 0 2024-04-25T22:03:22.124 INFO:tasks.workunit.client.0.smithi044.stdout:7/522: link c8 d1c/d22/d28/d4e/c9b 0 2024-04-25T22:03:22.125 INFO:tasks.workunit.client.0.smithi044.stdout:1/589: stat d3/d7/db/d5d/d7f/fa4 0 2024-04-25T22:03:22.125 INFO:tasks.workunit.client.0.smithi044.stdout:0/661: stat d8/df/d17/d45/d95/d51/d8b/f97 0 2024-04-25T22:03:22.126 INFO:tasks.workunit.client.0.smithi044.stdout:4/643: chown dd/d35/d52/f9e 42 1 2024-04-25T22:03:22.126 INFO:tasks.workunit.client.0.smithi044.stdout:7/523: fdatasync d1c/d22/d28/d30/f7d 0 2024-04-25T22:03:22.126 INFO:tasks.workunit.client.0.smithi044.stdout:9/813: fdatasync d4/d7/d79/ddc/de1/d54/d84/d64/f9e 0 2024-04-25T22:03:22.128 INFO:tasks.workunit.client.0.smithi044.stdout:6/838: unlink d2/d23/d5a/d12/d27/daf/dcb/d5e/db5/c118 0 2024-04-25T22:03:22.131 INFO:tasks.workunit.client.0.smithi044.stdout:2/626: rename d7/d16/ca0 to d7/d16/d4b/cc7 0 2024-04-25T22:03:22.131 INFO:tasks.workunit.client.0.smithi044.stdout:6/839: link d2/d23/d5a/d12/d27/daf/dcb/dc2/df6/c10e d2/d23/d5a/d12/d1f/d94/dc8/dfa/df2/c11d 0 2024-04-25T22:03:22.132 INFO:tasks.workunit.client.0.smithi044.stdout:2/627: fsync d7/d7b/d81/d4e/d86/d6b/fb1 0 2024-04-25T22:03:22.132 INFO:tasks.workunit.client.0.smithi044.stdout:6/840: chown d2/d23/d5a/d11/d3b/c35 142 1 2024-04-25T22:03:22.132 INFO:tasks.workunit.client.0.smithi044.stdout:8/874: dread d2a/d39/d42/d80/d121/fc7 [0,4194304] 0 2024-04-25T22:03:22.133 INFO:tasks.workunit.client.0.smithi044.stdout:2/628: unlink d7/d8/d1c/f94 0 2024-04-25T22:03:22.134 INFO:tasks.workunit.client.0.smithi044.stdout:8/875: truncate d2a/d39/d42/f78 765481 0 2024-04-25T22:03:22.134 INFO:tasks.workunit.client.0.smithi044.stdout:6/841: write d2/d23/d5a/d12/d70/fc0 [1424424,49656] 0 2024-04-25T22:03:22.134 INFO:tasks.workunit.client.0.smithi044.stdout:2/629: write d7/d7b/d81/d4e/f87 [2247135,869] 0 2024-04-25T22:03:22.135 INFO:tasks.workunit.client.0.smithi044.stdout:6/842: stat d2/d23/d5a/c18 0 2024-04-25T22:03:22.135 INFO:tasks.workunit.client.0.smithi044.stdout:8/876: creat d2a/d82/db6/dd2/f122 x:0 0 0 2024-04-25T22:03:22.135 INFO:tasks.workunit.client.0.smithi044.stdout:6/843: mknod d2/d23/d30/db0/c11e 0 2024-04-25T22:03:22.136 INFO:tasks.workunit.client.0.smithi044.stdout:8/877: write d2a/f4e [122312,8566] 0 2024-04-25T22:03:22.136 INFO:tasks.workunit.client.0.smithi044.stdout:2/630: rename d7/d16/d4b/c52 to d7/d8/d1c/cc8 0 2024-04-25T22:03:22.136 INFO:tasks.workunit.client.0.smithi044.stdout:6/844: write d2/d23/f28 [1277794,92947] 0 2024-04-25T22:03:22.137 INFO:tasks.workunit.client.0.smithi044.stdout:8/878: creat d2a/d39/d5a/d66/f123 x:0 0 0 2024-04-25T22:03:22.137 INFO:tasks.workunit.client.0.smithi044.stdout:2/631: creat d7/d16/d4b/fc9 x:0 0 0 2024-04-25T22:03:22.139 INFO:tasks.workunit.client.0.smithi044.stdout:8/879: creat d2a/d39/d42/f124 x:0 0 0 2024-04-25T22:03:22.139 INFO:tasks.workunit.client.0.smithi044.stdout:6/845: write d2/d23/d5a/d12/d27/daf/dcb/d5e/d9c/fd4 [666682,117611] 0 2024-04-25T22:03:22.139 INFO:tasks.workunit.client.0.smithi044.stdout:2/632: write d7/d7b/d81/d4e/f59 [688288,125354] 0 2024-04-25T22:03:22.139 INFO:tasks.workunit.client.0.smithi044.stdout:8/880: fdatasync d2a/d82/f10e 0 2024-04-25T22:03:22.140 INFO:tasks.workunit.client.0.smithi044.stdout:2/633: creat d7/d8/fca x:0 0 0 2024-04-25T22:03:22.140 INFO:tasks.workunit.client.0.smithi044.stdout:8/881: rmdir d2a/d52 39 2024-04-25T22:03:22.141 INFO:tasks.workunit.client.0.smithi044.stdout:2/634: creat d7/fcb x:0 0 0 2024-04-25T22:03:22.142 INFO:tasks.workunit.client.0.smithi044.stdout:8/882: write d2a/d39/f3a [4771891,886] 0 2024-04-25T22:03:22.142 INFO:tasks.workunit.client.0.smithi044.stdout:8/883: sync 2024-04-25T22:03:22.143 INFO:tasks.workunit.client.0.smithi044.stdout:2/635: read - d7/d7b/d81/d57/f84 zero size 2024-04-25T22:03:22.143 INFO:tasks.workunit.client.0.smithi044.stdout:9/814: write d4/d7/d79/ddc/de1/d54/d84/d72/f87 [2659669,60328] 0 2024-04-25T22:03:22.143 INFO:tasks.workunit.client.0.smithi044.stdout:2/636: sync 2024-04-25T22:03:22.144 INFO:tasks.workunit.client.0.smithi044.stdout:3/717: dread d0/d1/d15/d51/dd/d11/f69 [0,4194304] 0 2024-04-25T22:03:22.144 INFO:tasks.workunit.client.0.smithi044.stdout:8/884: write d2a/d39/d5a/d92/dab/fa2 [1563598,88810] 0 2024-04-25T22:03:22.145 INFO:tasks.workunit.client.0.smithi044.stdout:9/815: symlink d4/d3d/d66/db9/dbe/df5/dd3/l10d 0 2024-04-25T22:03:22.145 INFO:tasks.workunit.client.0.smithi044.stdout:5/748: dread d2/d5/d21/d38/f53 [4194304,4194304] 0 2024-04-25T22:03:22.146 INFO:tasks.workunit.client.0.smithi044.stdout:2/637: creat d7/d8/d1c/fcc x:0 0 0 2024-04-25T22:03:22.146 INFO:tasks.workunit.client.0.smithi044.stdout:8/885: dread - d2a/d77/fe1 zero size 2024-04-25T22:03:22.146 INFO:tasks.workunit.client.0.smithi044.stdout:9/816: creat d4/d7/d79/f10e x:0 0 0 2024-04-25T22:03:22.147 INFO:tasks.workunit.client.0.smithi044.stdout:5/749: fdatasync d2/d5/d21/d26/d2c/d37/f58 0 2024-04-25T22:03:22.148 INFO:tasks.workunit.client.0.smithi044.stdout:2/638: symlink d7/d7b/d81/d4e/d86/lcd 0 2024-04-25T22:03:22.148 INFO:tasks.workunit.client.0.smithi044.stdout:7/524: dwrite d1c/d22/f93 [0,4194304] 0 2024-04-25T22:03:22.148 INFO:tasks.workunit.client.0.smithi044.stdout:6/846: dread d2/d23/d30/f53 [0,4194304] 0 2024-04-25T22:03:22.149 INFO:tasks.workunit.client.0.smithi044.stdout:9/817: truncate d4/d4b/dac/fc1 3367050 0 2024-04-25T22:03:22.150 INFO:tasks.workunit.client.0.smithi044.stdout:8/886: getdents d2a/d82/db6 0 2024-04-25T22:03:22.150 INFO:tasks.workunit.client.0.smithi044.stdout:5/750: creat d2/d5/d27/d2a/db5/dde/fee x:0 0 0 2024-04-25T22:03:22.150 INFO:tasks.workunit.client.0.smithi044.stdout:2/639: write d7/d16/d4b/fc9 [59582,27079] 0 2024-04-25T22:03:22.150 INFO:tasks.workunit.client.0.smithi044.stdout:6/847: mknod d2/d23/d6a/d63/c11f 0 2024-04-25T22:03:22.150 INFO:tasks.workunit.client.0.smithi044.stdout:8/887: fdatasync d2a/d32/f5d 0 2024-04-25T22:03:22.151 INFO:tasks.workunit.client.0.smithi044.stdout:6/848: unlink d2/d23/da9/f106 0 2024-04-25T22:03:22.151 INFO:tasks.workunit.client.0.smithi044.stdout:2/640: write d7/d16/f17 [2084039,128258] 0 2024-04-25T22:03:22.152 INFO:tasks.workunit.client.0.smithi044.stdout:6/849: read - d2/d23/d5a/d11/f88 zero size 2024-04-25T22:03:22.152 INFO:tasks.workunit.client.0.smithi044.stdout:6/850: dread - d2/d23/d6a/fcd zero size 2024-04-25T22:03:22.154 INFO:tasks.workunit.client.0.smithi044.stdout:6/851: creat d2/d23/d6a/d63/f120 x:0 0 0 2024-04-25T22:03:22.155 INFO:tasks.workunit.client.0.smithi044.stdout:8/888: creat d2a/d32/d57/d119/f125 x:0 0 0 2024-04-25T22:03:22.156 INFO:tasks.workunit.client.0.smithi044.stdout:2/641: dread d7/d7b/d81/d4e/d86/d6b/d78/d44/f8d [0,4194304] 0 2024-04-25T22:03:22.156 INFO:tasks.workunit.client.0.smithi044.stdout:6/852: mkdir d2/d23/d5a/d13/d121 0 2024-04-25T22:03:22.158 INFO:tasks.workunit.client.0.smithi044.stdout:0/662: dread d8/df/d17/d45/d95/d51/f84 [0,4194304] 0 2024-04-25T22:03:22.159 INFO:tasks.workunit.client.0.smithi044.stdout:7/525: dwrite d1c/d22/d28/d30/f84 [0,4194304] 0 2024-04-25T22:03:22.160 INFO:tasks.workunit.client.0.smithi044.stdout:6/853: fdatasync d2/d23/d5a/d11/d3b/dc6/ff7 0 2024-04-25T22:03:22.160 INFO:tasks.workunit.client.0.smithi044.stdout:2/642: unlink d7/d7b/d81/d4e/d86/d6b/d78/dae/fb8 0 2024-04-25T22:03:22.160 INFO:tasks.workunit.client.0.smithi044.stdout:9/818: dwrite d4/d3d/d66/db9/dbe/ffc [0,4194304] 0 2024-04-25T22:03:22.160 INFO:tasks.workunit.client.0.smithi044.stdout:0/663: fdatasync d8/df/d17/d45/d95/d51/f71 0 2024-04-25T22:03:22.161 INFO:tasks.workunit.client.0.smithi044.stdout:9/819: mknod d4/c10f 0 2024-04-25T22:03:22.161 INFO:tasks.workunit.client.0.smithi044.stdout:6/854: write d2/d23/d5a/d11/d2a/f3c [1751024,5499] 0 2024-04-25T22:03:22.162 INFO:tasks.workunit.client.0.smithi044.stdout:2/643: getdents d7/d7b/d81/d4e 0 2024-04-25T22:03:22.162 INFO:tasks.workunit.client.0.smithi044.stdout:7/526: write fa [984582,40320] 0 2024-04-25T22:03:22.163 INFO:tasks.workunit.client.0.smithi044.stdout:0/664: truncate d8/d20/f6a 3327298 0 2024-04-25T22:03:22.164 INFO:tasks.workunit.client.0.smithi044.stdout:9/820: creat d4/d3d/d66/db9/dbe/df5/dd3/f110 x:0 0 0 2024-04-25T22:03:22.164 INFO:tasks.workunit.client.0.smithi044.stdout:4/644: dread dd/d35/d52/da9/dca/d79/d7f/d81/f5c [0,4194304] 0 2024-04-25T22:03:22.164 INFO:tasks.workunit.client.0.smithi044.stdout:7/527: mkdir d1c/d88/d8f/d9c 0 2024-04-25T22:03:22.164 INFO:tasks.workunit.client.0.smithi044.stdout:6/855: rename d2/d23/d5a/d12/dce/lfb to d2/d23/d5a/d12/d49/l122 0 2024-04-25T22:03:22.165 INFO:tasks.workunit.client.0.smithi044.stdout:0/665: unlink d8/df/d17/d45/d95/d9c/dcc/f62 0 2024-04-25T22:03:22.166 INFO:tasks.workunit.client.0.smithi044.stdout:6/856: rename d2/d23/d6a to d2/d23/d5a/d12/d1f/d94/dc8/dfa/df2/d123 0 2024-04-25T22:03:22.167 INFO:tasks.workunit.client.0.smithi044.stdout:6/857: unlink d2/d23/d5a/c15 0 2024-04-25T22:03:22.169 INFO:tasks.workunit.client.0.smithi044.stdout:6/858: fdatasync d2/d23/d5a/d12/d1f/d94/dc8/dfa/df2/d123/fe9 0 2024-04-25T22:03:22.170 INFO:tasks.workunit.client.0.smithi044.stdout:6/859: unlink d2/d23/d5a/d11/d3b/c6b 0 2024-04-25T22:03:22.171 INFO:tasks.workunit.client.0.smithi044.stdout:9/821: dwrite d4/d3d/d66/db9/dbe/df5/dd3/dd4/f10c [0,4194304] 0 2024-04-25T22:03:22.173 INFO:tasks.workunit.client.0.smithi044.stdout:0/666: dwrite d8/fca [0,4194304] 0 2024-04-25T22:03:22.173 INFO:tasks.workunit.client.0.smithi044.stdout:1/590: dread d3/d7/f20 [4194304,4194304] 0 2024-04-25T22:03:22.174 INFO:tasks.workunit.client.0.smithi044.stdout:1/591: mkdir d3/d30/dbb 0 2024-04-25T22:03:22.175 INFO:tasks.workunit.client.0.smithi044.stdout:1/592: unlink d3/d30/d3f/f5a 0 2024-04-25T22:03:22.176 INFO:tasks.workunit.client.0.smithi044.stdout:7/528: read d1c/d22/d28/d4e/f61 [289944,104274] 0 2024-04-25T22:03:22.177 INFO:tasks.workunit.client.0.smithi044.stdout:1/593: getdents d3/d7/db 0 2024-04-25T22:03:22.178 INFO:tasks.workunit.client.0.smithi044.stdout:1/594: chown d3/d7/db/d5d/cb2 21241 1 2024-04-25T22:03:22.179 INFO:tasks.workunit.client.0.smithi044.stdout:3/718: dread d0/d1/d15/d51/dd/d28/f53 [0,4194304] 0 2024-04-25T22:03:22.179 INFO:tasks.workunit.client.0.smithi044.stdout:9/822: write d4/d7/d18/d3a/d8b/f90 [2275220,92128] 0 2024-04-25T22:03:22.180 INFO:tasks.workunit.client.0.smithi044.stdout:1/595: creat d3/d7/fbc x:0 0 0 2024-04-25T22:03:22.180 INFO:tasks.workunit.client.0.smithi044.stdout:9/823: write d4/d3d/f68 [2311564,47563] 0 2024-04-25T22:03:22.180 INFO:tasks.workunit.client.0.smithi044.stdout:3/719: mknod d0/d1/d15/d51/dd/d11/d8a/ce7 0 2024-04-25T22:03:22.181 INFO:tasks.workunit.client.0.smithi044.stdout:1/596: creat d3/d7/d83/fbd x:0 0 0 2024-04-25T22:03:22.181 INFO:tasks.workunit.client.0.smithi044.stdout:9/824: mkdir d4/d7/d18/d9f/d111 0 2024-04-25T22:03:22.181 INFO:tasks.workunit.client.0.smithi044.stdout:1/597: dread - d3/d59/d5c/f62 zero size 2024-04-25T22:03:22.182 INFO:tasks.workunit.client.0.smithi044.stdout:3/720: creat d0/d1/d15/d51/dd/d11/d42/fe8 x:0 0 0 2024-04-25T22:03:22.182 INFO:tasks.workunit.client.0.smithi044.stdout:9/825: mkdir d4/d7/d79/d112 0 2024-04-25T22:03:22.183 INFO:tasks.workunit.client.0.smithi044.stdout:1/598: readlink d3/d7/l18 0 2024-04-25T22:03:22.183 INFO:tasks.workunit.client.0.smithi044.stdout:3/721: creat d0/d1/d15/d51/fe9 x:0 0 0 2024-04-25T22:03:22.183 INFO:tasks.workunit.client.0.smithi044.stdout:3/722: rmdir d0/d1 39 2024-04-25T22:03:22.184 INFO:tasks.workunit.client.0.smithi044.stdout:1/599: chown d3/d7/db/d5d/d7f/d97/l8e 0 1 2024-04-25T22:03:22.184 INFO:tasks.workunit.client.0.smithi044.stdout:9/826: mkdir d4/d7/d79/ddc/de1/d54/d84/d72/d113 0 2024-04-25T22:03:22.185 INFO:tasks.workunit.client.0.smithi044.stdout:1/600: rename d3/d7/d81/c87 to d3/d7/db/d5d/db0/cbe 0 2024-04-25T22:03:22.185 INFO:tasks.workunit.client.0.smithi044.stdout:9/827: link d4/d3d/d66/db9/dbe/df5/fe7 d4/d7/d79/ddc/de1/f114 0 2024-04-25T22:03:22.187 INFO:tasks.workunit.client.0.smithi044.stdout:7/529: truncate d1c/d22/d28/d57/f60 2733843 0 2024-04-25T22:03:22.188 INFO:tasks.workunit.client.0.smithi044.stdout:9/828: link d4/f57 d4/d7/d79/ddc/de1/d54/d84/d72/d97/df3/f115 0 2024-04-25T22:03:22.189 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:22.188+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:22.189 INFO:tasks.workunit.client.0.smithi044.stdout:9/829: symlink d4/l116 0 2024-04-25T22:03:22.190 INFO:tasks.workunit.client.0.smithi044.stdout:3/723: dwrite d0/d1/d15/df/d5d/fc8 [0,4194304] 0 2024-04-25T22:03:22.191 INFO:tasks.workunit.client.0.smithi044.stdout:3/724: dread - d0/d1/d15/d51/d8e/d74/fca zero size 2024-04-25T22:03:22.191 INFO:tasks.workunit.client.0.smithi044.stdout:9/830: creat d4/d7/d79/ddc/de1/d54/d84/d72/f117 x:0 0 0 2024-04-25T22:03:22.192 INFO:tasks.workunit.client.0.smithi044.stdout:9/831: dread - d4/d7/fb7 zero size 2024-04-25T22:03:22.192 INFO:tasks.workunit.client.0.smithi044.stdout:2/644: dread d7/f32 [0,4194304] 0 2024-04-25T22:03:22.193 INFO:tasks.workunit.client.0.smithi044.stdout:3/725: link d0/d1/d15/c1d d0/d1/d79/cea 0 2024-04-25T22:03:22.193 INFO:tasks.workunit.client.0.smithi044.stdout:9/832: symlink d4/d3d/d66/db9/dbe/df5/dd3/l118 0 2024-04-25T22:03:22.196 INFO:tasks.workunit.client.0.smithi044.stdout:9/833: write d4/d7/d18/d2e/f34 [5842234,60493] 0 2024-04-25T22:03:22.196 INFO:tasks.workunit.client.0.smithi044.stdout:1/601: truncate d3/d7/f20 6634032 0 2024-04-25T22:03:22.197 INFO:tasks.workunit.client.0.smithi044.stdout:8/889: dread f23 [0,4194304] 0 2024-04-25T22:03:22.198 INFO:tasks.workunit.client.0.smithi044.stdout:2/645: truncate d7/d7b/d81/d4e/d86/d6b/d78/d44/f8d 256331 0 2024-04-25T22:03:22.198 INFO:tasks.workunit.client.0.smithi044.stdout:9/834: creat d4/d7/d79/ddc/de1/f119 x:0 0 0 2024-04-25T22:03:22.198 INFO:tasks.workunit.client.0.smithi044.stdout:1/602: mkdir d3/d30/dbf 0 2024-04-25T22:03:22.199 INFO:tasks.workunit.client.0.smithi044.stdout:8/890: truncate d2a/d77/fe1 95422 0 2024-04-25T22:03:22.199 INFO:tasks.workunit.client.0.smithi044.stdout:1/603: chown d3/d72 3790273 1 2024-04-25T22:03:22.199 INFO:tasks.workunit.client.0.smithi044.stdout:0/667: dread d8/df/d17/db9/f99 [0,4194304] 0 2024-04-25T22:03:22.199 INFO:tasks.workunit.client.0.smithi044.stdout:9/835: creat d4/d7/d18/d3a/f11a x:0 0 0 2024-04-25T22:03:22.199 INFO:tasks.workunit.client.0.smithi044.stdout:3/726: dread d0/d13/f37 [0,4194304] 0 2024-04-25T22:03:22.200 INFO:tasks.workunit.client.0.smithi044.stdout:0/668: chown d8/df/d17/d45 68114 1 2024-04-25T22:03:22.200 INFO:tasks.workunit.client.0.smithi044.stdout:7/530: dread d1c/f3a [0,4194304] 0 2024-04-25T22:03:22.200 INFO:tasks.workunit.client.0.smithi044.stdout:8/891: mkdir d2a/d32/d57/d119/d126 0 2024-04-25T22:03:22.200 INFO:tasks.workunit.client.0.smithi044.stdout:7/531: fdatasync d1c/d22/f93 0 2024-04-25T22:03:22.201 INFO:tasks.workunit.client.0.smithi044.stdout:0/669: creat d8/da/d60/daa/dbe/fdd x:0 0 0 2024-04-25T22:03:22.201 INFO:tasks.workunit.client.0.smithi044.stdout:8/892: rmdir d2a/d32/d3e/dd0/d107 39 2024-04-25T22:03:22.201 INFO:tasks.workunit.client.0.smithi044.stdout:9/836: rename d4/d3d/d58/c69 to d4/d3d/d58/c11b 0 2024-04-25T22:03:22.201 INFO:tasks.workunit.client.0.smithi044.stdout:1/604: link d3/f4a d3/d7/fc0 0 2024-04-25T22:03:22.202 INFO:tasks.workunit.client.0.smithi044.stdout:7/532: creat d1c/d22/d28/d66/d6e/f9d x:0 0 0 2024-04-25T22:03:22.202 INFO:tasks.workunit.client.0.smithi044.stdout:9/837: symlink d4/d3d/d58/dd2/l11c 0 2024-04-25T22:03:22.203 INFO:tasks.workunit.client.0.smithi044.stdout:0/670: rename d8/db2/c52 to d8/df/d17/db9/dd8/cde 0 2024-04-25T22:03:22.203 INFO:tasks.workunit.client.0.smithi044.stdout:7/533: write d1c/d22/d28/d30/f7d [100925,117494] 0 2024-04-25T22:03:22.204 INFO:tasks.workunit.client.0.smithi044.stdout:9/838: write d4/d7/fb7 [395442,107778] 0 2024-04-25T22:03:22.204 INFO:tasks.workunit.client.0.smithi044.stdout:7/534: rmdir d1c/d22/d28/d66 39 2024-04-25T22:03:22.205 INFO:tasks.workunit.client.0.smithi044.stdout:8/893: write d2a/d77/fe1 [935006,124187] 0 2024-04-25T22:03:22.207 INFO:tasks.workunit.client.0.smithi044.stdout:7/535: mkdir d1c/d22/d28/d4e/d6a/d9e 0 2024-04-25T22:03:22.207 INFO:tasks.workunit.client.0.smithi044.stdout:9/839: write d4/f7f [2485553,67231] 0 2024-04-25T22:03:22.208 INFO:tasks.workunit.client.0.smithi044.stdout:2/646: dwrite d7/d7b/d81/d4e/d86/d6b/fa2 [0,4194304] 0 2024-04-25T22:03:22.208 INFO:tasks.workunit.client.0.smithi044.stdout:8/894: unlink d2a/d39/d42/d68/d6b/d6e/d84/f96 0 2024-04-25T22:03:22.210 INFO:tasks.workunit.client.0.smithi044.stdout:8/895: fsync d2a/d39/f104 0 2024-04-25T22:03:22.211 INFO:tasks.workunit.client.0.smithi044.stdout:6/860: dread d2/d23/d5a/d12/d27/daf/dcb/f54 [0,4194304] 0 2024-04-25T22:03:22.211 INFO:tasks.workunit.client.0.smithi044.stdout:1/605: dwrite d3/d7/f40 [4194304,4194304] 0 2024-04-25T22:03:22.211 INFO:tasks.workunit.client.0.smithi044.stdout:9/840: truncate d4/d7/d18/d2e/f34 6944617 0 2024-04-25T22:03:22.212 INFO:tasks.workunit.client.0.smithi044.stdout:1/606: dread - d3/d7/d83/fab zero size 2024-04-25T22:03:22.213 INFO:tasks.workunit.client.0.smithi044.stdout:8/896: creat d2a/d39/d42/d68/d6b/d6e/d84/f127 x:0 0 0 2024-04-25T22:03:22.213 INFO:tasks.workunit.client.0.smithi044.stdout:9/841: write d4/d7/fa9 [4181949,91573] 0 2024-04-25T22:03:22.213 INFO:tasks.workunit.client.0.smithi044.stdout:6/861: mkdir d2/d23/d5a/d13/d121/d124 0 2024-04-25T22:03:22.214 INFO:tasks.workunit.client.0.smithi044.stdout:0/671: dwrite d8/df/d17/d45/d95/d51/fa2 [0,4194304] 0 2024-04-25T22:03:22.214 INFO:tasks.workunit.client.0.smithi044.stdout:1/607: mknod d3/d54/cc1 0 2024-04-25T22:03:22.214 INFO:tasks.workunit.client.0.smithi044.stdout:8/897: mkdir d2a/d32/d57/d119/d128 0 2024-04-25T22:03:22.215 INFO:tasks.workunit.client.0.smithi044.stdout:6/862: mknod d2/d23/c125 0 2024-04-25T22:03:22.215 INFO:tasks.workunit.client.0.smithi044.stdout:3/727: read d0/d2/fa3 [2992415,49919] 0 2024-04-25T22:03:22.215 INFO:tasks.workunit.client.0.smithi044.stdout:0/672: creat d8/da/d60/d86/fdf x:0 0 0 2024-04-25T22:03:22.215 INFO:tasks.workunit.client.0.smithi044.stdout:1/608: rmdir d3/d4b/db4 0 2024-04-25T22:03:22.216 INFO:tasks.workunit.client.0.smithi044.stdout:9/842: rename d4/d7/d79/ddc/de1/d54/d84/c6a to d4/d3d/d66/db9/dbe/c11d 0 2024-04-25T22:03:22.217 INFO:tasks.workunit.client.0.smithi044.stdout:1/609: chown d3/d7/db/d8f/l9d 23 1 2024-04-25T22:03:22.217 INFO:tasks.workunit.client.0.smithi044.stdout:4/645: dread dd/d19/d91/f95 [0,4194304] 0 2024-04-25T22:03:22.217 INFO:tasks.workunit.client.0.smithi044.stdout:3/728: write d0/d1/d15/d51/dd/d11/fd0 [180829,62868] 0 2024-04-25T22:03:22.218 INFO:tasks.workunit.client.0.smithi044.stdout:0/673: rename d8/df/d17/db9/f80 to d8/d78/db8/fe0 0 2024-04-25T22:03:22.218 INFO:tasks.workunit.client.0.smithi044.stdout:9/843: creat d4/d7/d18/d3a/f11e x:0 0 0 2024-04-25T22:03:22.218 INFO:tasks.workunit.client.0.smithi044.stdout:8/898: truncate d2a/d39/f104 1906904 0 2024-04-25T22:03:22.219 INFO:tasks.workunit.client.0.smithi044.stdout:1/610: chown d3/d7/db/d5d/d7f/d97/d99/f78 7 1 2024-04-25T22:03:22.219 INFO:tasks.workunit.client.0.smithi044.stdout:4/646: creat dd/d35/d52/d61/fcf x:0 0 0 2024-04-25T22:03:22.219 INFO:tasks.workunit.client.0.smithi044.stdout:0/674: mknod d8/df/d17/db9/d7c/ce1 0 2024-04-25T22:03:22.220 INFO:tasks.workunit.client.0.smithi044.stdout:4/647: stat dd/l31 0 2024-04-25T22:03:22.220 INFO:tasks.workunit.client.0.smithi044.stdout:1/611: mkdir d3/d7/db/d5d/d7f/dc2 0 2024-04-25T22:03:22.220 INFO:tasks.workunit.client.0.smithi044.stdout:3/729: truncate d0/d1/d15/d51/dd/d11/fd0 470426 0 2024-04-25T22:03:22.220 INFO:tasks.workunit.client.0.smithi044.stdout:8/899: chown d2a/d39/d42/d68/d6b/d6e/fa5 1303 1 2024-04-25T22:03:22.221 INFO:tasks.workunit.client.0.smithi044.stdout:8/900: unlink d2a/f31 0 2024-04-25T22:03:22.221 INFO:tasks.workunit.client.0.smithi044.stdout:1/612: fdatasync d3/d7/db/d5d/d7f/d97/d99/fad 0 2024-04-25T22:03:22.221 INFO:tasks.workunit.client.0.smithi044.stdout:4/648: link dd/f46 dd/d19/fd0 0 2024-04-25T22:03:22.221 INFO:tasks.workunit.client.0.smithi044.stdout:3/730: creat d0/d70/d7c/da9/dc0/feb x:0 0 0 2024-04-25T22:03:22.222 INFO:tasks.workunit.client.0.smithi044.stdout:0/675: symlink d8/df/d17/d45/le2 0 2024-04-25T22:03:22.222 INFO:tasks.workunit.client.0.smithi044.stdout:4/649: write dd/ff [410575,99715] 0 2024-04-25T22:03:22.222 INFO:tasks.workunit.client.0.smithi044.stdout:3/731: creat d0/d1/d15/d51/fec x:0 0 0 2024-04-25T22:03:22.223 INFO:tasks.workunit.client.0.smithi044.stdout:0/676: mkdir d8/df/d88/db6/de3 0 2024-04-25T22:03:22.224 INFO:tasks.workunit.client.0.smithi044.stdout:4/650: mkdir dd/d35/d52/da9/dca/d79/d7f/dd1 0 2024-04-25T22:03:22.224 INFO:tasks.workunit.client.0.smithi044.stdout:0/677: chown d8/f9 2020 1 2024-04-25T22:03:22.224 INFO:tasks.workunit.client.0.smithi044.stdout:3/732: fsync d0/d13/d1c/d93/da6/f8f 0 2024-04-25T22:03:22.225 INFO:tasks.workunit.client.0.smithi044.stdout:5/751: dread d2/d5/d21/d26/d2c/d37/f4d [0,4194304] 0 2024-04-25T22:03:22.225 INFO:tasks.workunit.client.0.smithi044.stdout:4/651: write dd/d35/f4a [4265063,126124] 0 2024-04-25T22:03:22.227 INFO:tasks.workunit.client.0.smithi044.stdout:4/652: mknod dd/d35/d52/da9/dca/d79/d9c/cd2 0 2024-04-25T22:03:22.227 INFO:tasks.workunit.client.0.smithi044.stdout:5/752: truncate d2/d5/d21/d38/d52/fbe 1024033 0 2024-04-25T22:03:22.228 INFO:tasks.workunit.client.0.smithi044.stdout:1/613: dwrite d3/f37 [0,4194304] 0 2024-04-25T22:03:22.228 INFO:tasks.workunit.client.0.smithi044.stdout:5/753: dread - d2/d5/d27/d2a/d5c/f67 zero size 2024-04-25T22:03:22.233 INFO:tasks.workunit.client.0.smithi044.stdout:5/754: truncate d2/d5/d27/d2a/d48/f5a 1222525 0 2024-04-25T22:03:22.233 INFO:tasks.workunit.client.0.smithi044.stdout:8/901: read d2a/d32/f9b [538,130114] 0 2024-04-25T22:03:22.234 INFO:tasks.workunit.client.0.smithi044.stdout:3/733: dwrite d0/d13/d1c/d93/da6/f8f [0,4194304] 0 2024-04-25T22:03:22.235 INFO:tasks.workunit.client.0.smithi044.stdout:5/755: dread d2/d5/d27/d2a/d5c/d5f/f63 [0,4194304] 0 2024-04-25T22:03:22.235 INFO:tasks.workunit.client.0.smithi044.stdout:8/902: rename d2a/d39/d42/d68/d6b/d6e to d2a/d39/d42/d129 0 2024-04-25T22:03:22.236 INFO:tasks.workunit.client.0.smithi044.stdout:3/734: truncate d0/d1/f7e 437636 0 2024-04-25T22:03:22.236 INFO:tasks.workunit.client.0.smithi044.stdout:8/903: read f23 [1967860,10244] 0 2024-04-25T22:03:22.236 INFO:tasks.workunit.client.0.smithi044.stdout:5/756: mkdir d2/d5/d27/d2a/db5/def 0 2024-04-25T22:03:22.238 INFO:tasks.workunit.client.0.smithi044.stdout:3/735: unlink d0/d1/d15/l2d 0 2024-04-25T22:03:22.238 INFO:tasks.workunit.client.0.smithi044.stdout:8/904: symlink d2a/l12a 0 2024-04-25T22:03:22.238 INFO:tasks.workunit.client.0.smithi044.stdout:3/736: unlink d0/d13/d1c/d93/cbb 0 2024-04-25T22:03:22.240 INFO:tasks.workunit.client.0.smithi044.stdout:8/905: rename d2a/d39/d42/d129/d84/ff8 to d2a/d39/d42/d68/f12b 0 2024-04-25T22:03:22.242 INFO:tasks.workunit.client.0.smithi044.stdout:9/844: dread d4/d3d/d58/dd2/df7/fff [4194304,4194304] 0 2024-04-25T22:03:22.242 INFO:tasks.workunit.client.0.smithi044.stdout:5/757: dwrite d2/f3c [0,4194304] 0 2024-04-25T22:03:22.245 INFO:tasks.workunit.client.0.smithi044.stdout:5/758: rename d2/d5/f17 to d2/d5/d27/d2a/db5/dde/de0/ff0 0 2024-04-25T22:03:22.245 INFO:tasks.workunit.client.0.smithi044.stdout:5/759: dread - d2/d5/d27/d2a/da7/fbc zero size 2024-04-25T22:03:22.246 INFO:tasks.workunit.client.0.smithi044.stdout:5/760: link d2/d5/d27/d2a/la1 d2/d5/lf1 0 2024-04-25T22:03:22.247 INFO:tasks.workunit.client.0.smithi044.stdout:5/761: mkdir d2/dad/df2 0 2024-04-25T22:03:22.248 INFO:tasks.workunit.client.0.smithi044.stdout:7/536: dread d1c/d22/d28/d30/f36 [0,4194304] 0 2024-04-25T22:03:22.248 INFO:tasks.workunit.client.0.smithi044.stdout:3/737: truncate d0/d1/d79/f9d 2039048 0 2024-04-25T22:03:22.248 INFO:tasks.workunit.client.0.smithi044.stdout:5/762: chown d2/d5/d21/d26/d2c/c7f 11 1 2024-04-25T22:03:22.249 INFO:tasks.workunit.client.0.smithi044.stdout:1/614: dread d3/d59/d5c/f74 [0,4194304] 0 2024-04-25T22:03:22.249 INFO:tasks.workunit.client.0.smithi044.stdout:5/763: mkdir d2/d5/d6a/df3 0 2024-04-25T22:03:22.249 INFO:tasks.workunit.client.0.smithi044.stdout:7/537: chown d1c/d22/d28/d57/f5a 420506522 1 2024-04-25T22:03:22.250 INFO:tasks.workunit.client.0.smithi044.stdout:1/615: mkdir d3/d30/d3f/dc3 0 2024-04-25T22:03:22.251 INFO:tasks.workunit.client.0.smithi044.stdout:5/764: chown d2/d5/d27/d2a/d3a/fb1 105924 1 2024-04-25T22:03:22.251 INFO:tasks.workunit.client.0.smithi044.stdout:6/863: dread d2/f3a [0,4194304] 0 2024-04-25T22:03:22.251 INFO:tasks.workunit.client.0.smithi044.stdout:6/864: chown d2/d23/d5a 61 1 2024-04-25T22:03:22.252 INFO:tasks.workunit.client.0.smithi044.stdout:5/765: creat d2/d5/ff4 x:0 0 0 2024-04-25T22:03:22.252 INFO:tasks.workunit.client.0.smithi044.stdout:7/538: getdents d1c/d22/d28/d66/d86 0 2024-04-25T22:03:22.252 INFO:tasks.workunit.client.0.smithi044.stdout:1/616: rmdir d3/d30/dbf 0 2024-04-25T22:03:22.253 INFO:tasks.workunit.client.0.smithi044.stdout:1/617: mknod d3/d59/cc4 0 2024-04-25T22:03:22.255 INFO:tasks.workunit.client.0.smithi044.stdout:1/618: stat d3/d7/db/d5d/d7f/d97/l6f 0 2024-04-25T22:03:22.256 INFO:tasks.workunit.client.0.smithi044.stdout:7/539: link cc d1c/d22/c9f 0 2024-04-25T22:03:22.256 INFO:tasks.workunit.client.0.smithi044.stdout:2/647: dread d7/d8/d5f/fbe [4194304,4194304] 0 2024-04-25T22:03:22.256 INFO:tasks.workunit.client.0.smithi044.stdout:5/766: getdents d2/d5/d21/d26/d2c/d37/dbb/d9e 0 2024-04-25T22:03:22.256 INFO:tasks.workunit.client.0.smithi044.stdout:0/678: dread d8/df/d17/d45/f50 [4194304,4194304] 0 2024-04-25T22:03:22.258 INFO:tasks.workunit.client.0.smithi044.stdout:7/540: write d1c/d22/d28/d30/d32/f8a [513013,29177] 0 2024-04-25T22:03:22.258 INFO:tasks.workunit.client.0.smithi044.stdout:2/648: chown d7/d8/d48/db2/lb7 76650 1 2024-04-25T22:03:22.258 INFO:tasks.workunit.client.0.smithi044.stdout:3/738: dwrite d0/d1/d15/d51/dd/d11/d42/fe8 [0,4194304] 0 2024-04-25T22:03:22.259 INFO:tasks.workunit.client.0.smithi044.stdout:6/865: dread d2/f75 [0,4194304] 0 2024-04-25T22:03:22.260 INFO:tasks.workunit.client.0.smithi044.stdout:2/649: mkdir d7/d8/d1c/d77/dce 0 2024-04-25T22:03:22.260 INFO:tasks.workunit.client.0.smithi044.stdout:4/653: dread dd/d35/d52/da9/dca/f93 [0,4194304] 0 2024-04-25T22:03:22.261 INFO:tasks.workunit.client.0.smithi044.stdout:7/541: write d1c/d22/d28/d66/d6e/f9d [835794,129255] 0 2024-04-25T22:03:22.262 INFO:tasks.workunit.client.0.smithi044.stdout:2/650: creat d7/d7b/d81/d57/fcf x:0 0 0 2024-04-25T22:03:22.263 INFO:tasks.workunit.client.0.smithi044.stdout:8/906: dread d2a/d39/d42/d68/d6b/f56 [0,4194304] 0 2024-04-25T22:03:22.263 INFO:tasks.workunit.client.0.smithi044.stdout:6/866: chown d2/d23/d5a/d11/d2a/dbf/f97 7 1 2024-04-25T22:03:22.264 INFO:tasks.workunit.client.0.smithi044.stdout:0/679: rename d8/d20/f6a to d8/df/d17/d45/d95/fe4 0 2024-04-25T22:03:22.265 INFO:tasks.workunit.client.0.smithi044.stdout:2/651: stat d7/d7b/d81/d4e/d86/d6b/d78/dae 0 2024-04-25T22:03:22.266 INFO:tasks.workunit.client.0.smithi044.stdout:4/654: link dd/d35/d52/d61/f66 dd/d19/d91/fd3 0 2024-04-25T22:03:22.266 INFO:tasks.workunit.client.0.smithi044.stdout:0/680: write d8/da/f59 [3938142,4996] 0 2024-04-25T22:03:22.268 INFO:tasks.workunit.client.0.smithi044.stdout:7/542: rename d1c/d22/d28/d4e/d7b/f85 to d1c/d22/d28/d4e/d7b/fa0 0 2024-04-25T22:03:22.270 INFO:tasks.workunit.client.0.smithi044.stdout:3/739: dwrite d0/f5c [0,4194304] 0 2024-04-25T22:03:22.270 INFO:tasks.workunit.client.0.smithi044.stdout:5/767: dwrite d2/d5/d27/d2a/d5c/f83 [4194304,4194304] 0 2024-04-25T22:03:22.271 INFO:tasks.workunit.client.0.smithi044.stdout:2/652: creat d7/d16/d2c/fd0 x:0 0 0 2024-04-25T22:03:22.271 INFO:tasks.workunit.client.0.smithi044.stdout:0/681: chown d8/df/d17/f33 6083 1 2024-04-25T22:03:22.271 INFO:tasks.workunit.client.0.smithi044.stdout:1/619: dwrite d3/d30/d3f/f80 [0,4194304] 0 2024-04-25T22:03:22.273 INFO:tasks.workunit.client.0.smithi044.stdout:5/768: chown d2/d5/d27/d2a/db5/lce 3571 1 2024-04-25T22:03:22.273 INFO:tasks.workunit.client.0.smithi044.stdout:4/655: creat dd/d35/d52/da9/dca/d79/d7f/dd1/fd4 x:0 0 0 2024-04-25T22:03:22.275 INFO:tasks.workunit.client.0.smithi044.stdout:8/907: dwrite d2a/d32/f48 [0,4194304] 0 2024-04-25T22:03:22.275 INFO:tasks.workunit.client.0.smithi044.stdout:6/867: dwrite d2/d23/d5a/ff8 [0,4194304] 0 2024-04-25T22:03:22.275 INFO:tasks.workunit.client.0.smithi044.stdout:1/620: fsync d3/d54/d76/f9f 0 2024-04-25T22:03:22.276 INFO:tasks.workunit.client.0.smithi044.stdout:5/769: fdatasync d2/d5/d27/d2a/d5c/f67 0 2024-04-25T22:03:22.276 INFO:tasks.workunit.client.0.smithi044.stdout:0/682: write d8/d78/db8/fcd [1782636,70081] 0 2024-04-25T22:03:22.277 INFO:tasks.workunit.client.0.smithi044.stdout:4/656: write dd/d35/d52/da9/dca/d79/fb7 [1965574,109997] 0 2024-04-25T22:03:22.279 INFO:tasks.workunit.client.0.smithi044.stdout:3/740: getdents d0/d1/d15/d81/dd2 0 2024-04-25T22:03:22.279 INFO:tasks.workunit.client.0.smithi044.stdout:2/653: creat d7/d5b/fd1 x:0 0 0 2024-04-25T22:03:22.279 INFO:tasks.workunit.client.0.smithi044.stdout:0/683: creat d8/db2/fe5 x:0 0 0 2024-04-25T22:03:22.279 INFO:tasks.workunit.client.0.smithi044.stdout:6/868: mknod d2/d23/d5a/d12/d27/daf/dcb/d5e/d92/c126 0 2024-04-25T22:03:22.279 INFO:tasks.workunit.client.0.smithi044.stdout:9/845: dread d4/d7/d18/d2e/f3f [0,4194304] 0 2024-04-25T22:03:22.280 INFO:tasks.workunit.client.0.smithi044.stdout:9/846: chown d4/d7/d18/la2 1 1 2024-04-25T22:03:22.280 INFO:tasks.workunit.client.0.smithi044.stdout:6/869: write d2/d23/d5a/d12/d49/fd6 [354407,63108] 0 2024-04-25T22:03:22.282 INFO:tasks.workunit.client.0.smithi044.stdout:4/657: creat dd/d35/fd5 x:0 0 0 2024-04-25T22:03:22.282 INFO:tasks.workunit.client.0.smithi044.stdout:7/543: dwrite d1c/d22/d28/d30/d32/d5d/f87 [0,4194304] 0 2024-04-25T22:03:22.283 INFO:tasks.workunit.client.0.smithi044.stdout:2/654: getdents d7/d16/d2c/d75 0 2024-04-25T22:03:22.283 INFO:tasks.workunit.client.0.smithi044.stdout:6/870: chown d2/d23/f28 20114 1 2024-04-25T22:03:22.284 INFO:tasks.workunit.client.0.smithi044.stdout:0/684: link d8/df/d17/db9/f3a d8/df/d17/d45/d95/d51/d8b/d90/fe6 0 2024-04-25T22:03:22.284 INFO:tasks.workunit.client.0.smithi044.stdout:3/741: chown d0/d1/d15/d51/dd/d28/lbe 110 1 2024-04-25T22:03:22.285 INFO:tasks.workunit.client.0.smithi044.stdout:7/544: mkdir d1c/d22/d28/d4e/da1 0 2024-04-25T22:03:22.285 INFO:tasks.workunit.client.0.smithi044.stdout:4/658: rename dd/d19/c9b to dd/d19/cd6 0 2024-04-25T22:03:22.286 INFO:tasks.workunit.client.0.smithi044.stdout:3/742: getdents d0/d13 0 2024-04-25T22:03:22.286 INFO:tasks.workunit.client.0.smithi044.stdout:8/908: dwrite d2a/d39/d42/d80/d121/fb4 [0,4194304] 0 2024-04-25T22:03:22.287 INFO:tasks.workunit.client.0.smithi044.stdout:6/871: rename d2/d23/d5a/d12/d49/c6e to d2/d23/d5a/d11/d3b/dc6/d10a/c127 0 2024-04-25T22:03:22.288 INFO:tasks.workunit.client.0.smithi044.stdout:4/659: rename dd/d35/f58 to dd/d35/d52/da9/dca/d79/d7f/dd1/fd7 0 2024-04-25T22:03:22.288 INFO:tasks.workunit.client.0.smithi044.stdout:8/909: write d2a/d39/d42/d68/d6b/d7b/f95 [758939,69298] 0 2024-04-25T22:03:22.288 INFO:tasks.workunit.client.0.smithi044.stdout:1/621: write d3/d7/db/d5d/d7f/d97/d99/fad [21243,48944] 0 2024-04-25T22:03:22.289 INFO:tasks.workunit.client.0.smithi044.stdout:9/847: truncate d4/d7/f8 7984782 0 2024-04-25T22:03:22.289 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:22.284+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:22.290 INFO:tasks.workunit.client.0.smithi044.stdout:8/910: write d2a/d77/fe1 [1188900,68040] 0 2024-04-25T22:03:22.290 INFO:tasks.workunit.client.0.smithi044.stdout:3/743: chown d0/d13/d1c/d93/da6/fd1 8230 1 2024-04-25T22:03:22.290 INFO:tasks.workunit.client.0.smithi044.stdout:8/911: write d2a/d39/d5a/d66/fc6 [869655,86899] 0 2024-04-25T22:03:22.294 INFO:tasks.workunit.client.0.smithi044.stdout:9/848: stat d4/f32 0 2024-04-25T22:03:22.294 INFO:tasks.workunit.client.0.smithi044.stdout:9/849: chown d4/d7/d18/d2e/c92 461339 1 2024-04-25T22:03:22.294 INFO:tasks.workunit.client.0.smithi044.stdout:3/744: mknod d0/d13/d1c/d93/da6/dd7/ced 0 2024-04-25T22:03:22.294 INFO:tasks.workunit.client.0.smithi044.stdout:4/660: getdents dd/d19/d91 0 2024-04-25T22:03:22.295 INFO:tasks.workunit.client.0.smithi044.stdout:1/622: link d3/d7/f3d d3/d7/d83/fc5 0 2024-04-25T22:03:22.295 INFO:tasks.workunit.client.0.smithi044.stdout:6/872: dwrite d2/d23/d5a/d12/f7a [0,4194304] 0 2024-04-25T22:03:22.297 INFO:tasks.workunit.client.0.smithi044.stdout:1/623: write d3/d7/d29/d43/d85/f9e [52998,30187] 0 2024-04-25T22:03:22.298 INFO:tasks.workunit.client.0.smithi044.stdout:8/912: dwrite d2a/d39/d42/d68/d6b/d7b/fa9 [0,4194304] 0 2024-04-25T22:03:22.302 INFO:tasks.workunit.client.0.smithi044.stdout:5/770: dread d2/f19 [0,4194304] 0 2024-04-25T22:03:22.303 INFO:tasks.workunit.client.0.smithi044.stdout:5/771: write d2/d5/d21/f90 [636489,52878] 0 2024-04-25T22:03:22.304 INFO:tasks.workunit.client.0.smithi044.stdout:7/545: sync 2024-04-25T22:03:22.304 INFO:tasks.workunit.client.0.smithi044.stdout:1/624: sync 2024-04-25T22:03:22.305 INFO:tasks.workunit.client.0.smithi044.stdout:5/772: creat d2/d5/d21/d26/d2c/ff5 x:0 0 0 2024-04-25T22:03:22.305 INFO:tasks.workunit.client.0.smithi044.stdout:1/625: read d3/d7/d29/fb1 [3830720,81580] 0 2024-04-25T22:03:22.305 INFO:tasks.workunit.client.0.smithi044.stdout:1/626: creat d3/fc6 x:0 0 0 2024-04-25T22:03:22.306 INFO:tasks.workunit.client.0.smithi044.stdout:5/773: write d2/d5/d21/d38/d52/d56/fac [972094,72852] 0 2024-04-25T22:03:22.306 INFO:tasks.workunit.client.0.smithi044.stdout:1/627: dread - d3/d7/db/d5d/d7f/fa4 zero size 2024-04-25T22:03:22.306 INFO:tasks.workunit.client.0.smithi044.stdout:5/774: fdatasync d2/d5/d21/fdb 0 2024-04-25T22:03:22.307 INFO:tasks.workunit.client.0.smithi044.stdout:3/745: dread d0/d1/d79/f83 [0,4194304] 0 2024-04-25T22:03:22.308 INFO:tasks.workunit.client.0.smithi044.stdout:3/746: symlink d0/d13/d1c/d93/lee 0 2024-04-25T22:03:22.308 INFO:tasks.workunit.client.0.smithi044.stdout:7/546: dread d1c/d22/d28/d30/d32/d5d/f7e [0,4194304] 0 2024-04-25T22:03:22.309 INFO:tasks.workunit.client.0.smithi044.stdout:3/747: mkdir d0/d13/d1c/d93/def 0 2024-04-25T22:03:22.309 INFO:tasks.workunit.client.0.smithi044.stdout:6/873: read d2/d23/d5a/d11/d2a/f61 [682316,100627] 0 2024-04-25T22:03:22.310 INFO:tasks.workunit.client.0.smithi044.stdout:6/874: chown d2/d23/f28 0 1 2024-04-25T22:03:22.310 INFO:tasks.workunit.client.0.smithi044.stdout:3/748: creat d0/d1/d15/d51/dd/d11/d8a/ff0 x:0 0 0 2024-04-25T22:03:22.310 INFO:tasks.workunit.client.0.smithi044.stdout:7/547: truncate d1c/d22/d28/d4e/d6a/f90 536487 0 2024-04-25T22:03:22.311 INFO:tasks.workunit.client.0.smithi044.stdout:6/875: write d2/d23/d5a/d12/d27/daf/dcb/d5e/fde [230542,9419] 0 2024-04-25T22:03:22.312 INFO:tasks.workunit.client.0.smithi044.stdout:5/775: dread d2/d5/f7d [0,4194304] 0 2024-04-25T22:03:22.312 INFO:tasks.workunit.client.0.smithi044.stdout:3/749: rename d0/d1/d34/d95/ccf to d0/d1/d15/d81/cf1 0 2024-04-25T22:03:22.313 INFO:tasks.workunit.client.0.smithi044.stdout:7/548: creat d1c/d22/d28/d30/d32/d5d/d83/fa2 x:0 0 0 2024-04-25T22:03:22.313 INFO:tasks.workunit.client.0.smithi044.stdout:6/876: mknod d2/d23/d5a/d11/d3b/c128 0 2024-04-25T22:03:22.314 INFO:tasks.workunit.client.0.smithi044.stdout:6/877: unlink d2/d23/f28 0 2024-04-25T22:03:22.314 INFO:tasks.workunit.client.0.smithi044.stdout:5/776: rename d2/d5/d21/d26/fa3 to d2/d5/d21/d95/ff6 0 2024-04-25T22:03:22.314 INFO:tasks.workunit.client.0.smithi044.stdout:3/750: symlink d0/d1/d15/d51/dd/d28/lf2 0 2024-04-25T22:03:22.314 INFO:tasks.workunit.client.0.smithi044.stdout:7/549: fdatasync d1c/d22/d28/d30/d32/f42 0 2024-04-25T22:03:22.314 INFO:tasks.workunit.client.0.smithi044.stdout:2/655: dread f0 [0,4194304] 0 2024-04-25T22:03:22.315 INFO:tasks.workunit.client.0.smithi044.stdout:3/751: write d0/d1/f7e [274039,5353] 0 2024-04-25T22:03:22.315 INFO:tasks.workunit.client.0.smithi044.stdout:5/777: creat d2/d5/d27/d2a/d5c/dec/ff7 x:0 0 0 2024-04-25T22:03:22.315 INFO:tasks.workunit.client.0.smithi044.stdout:7/550: fsync d1c/d22/d28/d4e/d7b/d59/f91 0 2024-04-25T22:03:22.316 INFO:tasks.workunit.client.0.smithi044.stdout:6/878: rename d2/d23/d5a/d12/d1f/d94/dc8/dfa/df2/d101 to d2/d23/d5a/d11/d3b/dc6/d129 0 2024-04-25T22:03:22.316 INFO:tasks.workunit.client.0.smithi044.stdout:7/551: chown d1c/d22/d28/d30/d32/f42 598 1 2024-04-25T22:03:22.317 INFO:tasks.workunit.client.0.smithi044.stdout:6/879: dread - d2/d23/d5a/d12/d27/ff9 zero size 2024-04-25T22:03:22.317 INFO:tasks.workunit.client.0.smithi044.stdout:5/778: getdents d2/d5/d21/d38/d52/d56 0 2024-04-25T22:03:22.317 INFO:tasks.workunit.client.0.smithi044.stdout:7/552: stat d1c/d22/d28/d30/d32/d5d/f76 0 2024-04-25T22:03:22.317 INFO:tasks.workunit.client.0.smithi044.stdout:3/752: getdents d0/d1/d15/d51/dd/d35/dab 0 2024-04-25T22:03:22.318 INFO:tasks.workunit.client.0.smithi044.stdout:7/553: chown d1c/d88/d8f/l96 1436 1 2024-04-25T22:03:22.318 INFO:tasks.workunit.client.0.smithi044.stdout:5/779: unlink d2/d5/d27/d2a/d5c/la5 0 2024-04-25T22:03:22.319 INFO:tasks.workunit.client.0.smithi044.stdout:3/753: truncate d0/d1/d15/d51/fe9 453486 0 2024-04-25T22:03:22.319 INFO:tasks.workunit.client.0.smithi044.stdout:3/754: stat d0/d13 0 2024-04-25T22:03:22.319 INFO:tasks.workunit.client.0.smithi044.stdout:5/780: creat d2/d5/d27/d2a/d48/ff8 x:0 0 0 2024-04-25T22:03:22.320 INFO:tasks.workunit.client.0.smithi044.stdout:5/781: truncate d2/d5/d21/d26/d2c/f78 541366 0 2024-04-25T22:03:22.321 INFO:tasks.workunit.client.0.smithi044.stdout:9/850: dread d4/d7/f4d [0,4194304] 0 2024-04-25T22:03:22.322 INFO:tasks.workunit.client.0.smithi044.stdout:5/782: getdents d2/d5/d21/d38/dc8 0 2024-04-25T22:03:22.323 INFO:tasks.workunit.client.0.smithi044.stdout:9/851: creat d4/d7/d79/ddc/de1/f11f x:0 0 0 2024-04-25T22:03:22.323 INFO:tasks.workunit.client.0.smithi044.stdout:8/913: dread d2a/d39/d42/d80/d121/f94 [0,4194304] 0 2024-04-25T22:03:22.323 INFO:tasks.workunit.client.0.smithi044.stdout:6/880: dwrite d2/d23/d5a/d13/ff5 [0,4194304] 0 2024-04-25T22:03:22.324 INFO:tasks.workunit.client.0.smithi044.stdout:9/852: rmdir d4/d7/d18/d9f 39 2024-04-25T22:03:22.325 INFO:tasks.workunit.client.0.smithi044.stdout:7/554: dwrite d1c/d22/f71 [0,4194304] 0 2024-04-25T22:03:22.325 INFO:tasks.workunit.client.0.smithi044.stdout:6/881: chown d2/d23/d5a/d12/d1f/d94/dc8/dfa/l117 53258 1 2024-04-25T22:03:22.326 INFO:tasks.workunit.client.0.smithi044.stdout:7/555: write d1c/d22/f49 [43964,38850] 0 2024-04-25T22:03:22.327 INFO:tasks.workunit.client.0.smithi044.stdout:8/914: link d2a/d39/d5a/d66/c73 d2a/d39/d5a/d8e/c12c 0 2024-04-25T22:03:22.329 INFO:tasks.workunit.client.0.smithi044.stdout:6/882: creat d2/d23/d5a/d11/d3b/dc6/d10a/f12a x:0 0 0 2024-04-25T22:03:22.331 INFO:tasks.workunit.client.0.smithi044.stdout:7/556: creat d1c/d22/d28/d4e/d7b/fa3 x:0 0 0 2024-04-25T22:03:22.331 INFO:tasks.workunit.client.0.smithi044.stdout:4/661: write dd/d35/d52/da9/dca/d79/d9c/fc8 [381337,57615] 0 2024-04-25T22:03:22.332 INFO:tasks.workunit.client.0.smithi044.stdout:4/662: symlink dd/d35/d52/ld8 0 2024-04-25T22:03:22.332 INFO:tasks.workunit.client.0.smithi044.stdout:5/783: dwrite d2/d5/d27/d2a/d3a/f55 [0,4194304] 0 2024-04-25T22:03:22.334 INFO:tasks.workunit.client.0.smithi044.stdout:5/784: symlink d2/d5/lf9 0 2024-04-25T22:03:22.334 INFO:tasks.workunit.client.0.smithi044.stdout:4/663: chown dd/d35/d52/da9/dca/f8d 1339406 1 2024-04-25T22:03:22.334 INFO:tasks.workunit.client.0.smithi044.stdout:9/853: dwrite d4/d3d/d66/d93/f101 [0,4194304] 0 2024-04-25T22:03:22.335 INFO:tasks.workunit.client.0.smithi044.stdout:0/685: dread d8/d20/f5a [0,4194304] 0 2024-04-25T22:03:22.335 INFO:tasks.workunit.client.0.smithi044.stdout:9/854: sync 2024-04-25T22:03:22.335 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:03:22.336 INFO:tasks.workunit.client.0.smithi044.stdout:4/664: write dd/d35/d52/fc7 [511880,11069] 0 2024-04-25T22:03:22.336 INFO:tasks.workunit.client.0.smithi044.stdout:2/656: truncate d7/d16/d2c/f85 1052155 0 2024-04-25T22:03:22.338 INFO:tasks.workunit.client.0.smithi044.stdout:6/883: rename d2/d23/d5a/d12/d1f/d94/dc8/dfa/df2/d123/d63/dd9 to d2/d23/d5a/d12/d27/daf/dcb/d5e/d92/d12b 0 2024-04-25T22:03:22.338 INFO:tasks.workunit.client.0.smithi044.stdout:3/755: write d0/d2/f67 [1562341,50942] 0 2024-04-25T22:03:22.338 INFO:tasks.workunit.client.0.smithi044.stdout:8/915: dwrite d2a/d39/d42/d68/fa3 [0,4194304] 0 2024-04-25T22:03:22.338 INFO:tasks.workunit.client.0.smithi044.stdout:5/785: creat d2/d5/d6a/df3/ffa x:0 0 0 2024-04-25T22:03:22.338 INFO:tasks.workunit.client.0.smithi044.stdout:4/665: mkdir dd/d19/d91/dd9 0 2024-04-25T22:03:22.340 INFO:tasks.workunit.client.0.smithi044.stdout:8/916: write d2a/d32/f41 [5600573,95894] 0 2024-04-25T22:03:22.340 INFO:tasks.workunit.client.0.smithi044.stdout:3/756: symlink d0/d13/lf3 0 2024-04-25T22:03:22.340 INFO:tasks.workunit.client.0.smithi044.stdout:0/686: mkdir d8/df/d17/d45/d95/de7 0 2024-04-25T22:03:22.341 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:22.341 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:22.341 INFO:tasks.workunit.client.0.smithi044.stdout:6/884: symlink d2/d23/d5a/d12/d1f/d94/l12c 0 2024-04-25T22:03:22.341 INFO:tasks.workunit.client.0.smithi044.stdout:9/855: getdents d4/d3d/da5 0 2024-04-25T22:03:22.342 INFO:tasks.workunit.client.0.smithi044.stdout:1/628: dwrite d3/d7/f8 [4194304,4194304] 0 2024-04-25T22:03:22.342 INFO:tasks.workunit.client.0.smithi044.stdout:5/786: creat d2/dad/df2/ffb x:0 0 0 2024-04-25T22:03:22.342 INFO:tasks.workunit.client.0.smithi044.stdout:7/557: truncate d1c/d22/d4a/f64 174746 0 2024-04-25T22:03:22.342 INFO:tasks.workunit.client.0.smithi044.stdout:0/687: dread - d8/da/d60/daa/dbe/fdd zero size 2024-04-25T22:03:22.342 INFO:tasks.workunit.client.0.smithi044.stdout:8/917: write d2a/d39/d5a/d92/dab/fa2 [1445403,25089] 0 2024-04-25T22:03:22.343 INFO:tasks.workunit.client.0.smithi044.stdout:1/629: read d3/d7/db/d5d/d7f/d97/d99/fad [55813,94023] 0 2024-04-25T22:03:22.344 INFO:tasks.workunit.client.0.smithi044.stdout:7/558: rmdir d1c/d22/d28/d30/d32/d5d 39 2024-04-25T22:03:22.345 INFO:tasks.workunit.client.0.smithi044.stdout:9/856: mkdir d4/d7/d79/ddc/de1/d54/d84/d72/d113/d120 0 2024-04-25T22:03:22.346 INFO:tasks.workunit.client.0.smithi044.stdout:8/918: mkdir d2a/d32/d105/d12d 0 2024-04-25T22:03:22.346 INFO:tasks.workunit.client.0.smithi044.stdout:5/787: truncate d2/d5/d6a/df3/ffa 114609 0 2024-04-25T22:03:22.346 INFO:tasks.workunit.client.0.smithi044.stdout:0/688: chown d8/df/d17/d45/d95/d9c/dcc/f5c 26877 1 2024-04-25T22:03:22.346 INFO:tasks.workunit.client.0.smithi044.stdout:6/885: link d2/d23/d5a/d12/d1f/d94/dc8/dfa/df2/d123/fcd d2/d23/d5a/d12/d1f/d94/dc8/dfa/dd7/f12d 0 2024-04-25T22:03:22.347 INFO:tasks.workunit.client.0.smithi044.stdout:3/757: write d0/d70/d7c/da9/dc0/feb [1023596,27439] 0 2024-04-25T22:03:22.347 INFO:tasks.workunit.client.0.smithi044.stdout:7/559: mknod d1c/d22/d28/d66/d86/ca4 0 2024-04-25T22:03:22.347 INFO:tasks.workunit.client.0.smithi044.stdout:9/857: getdents d4/d7/d79/ddc 0 2024-04-25T22:03:22.348 INFO:tasks.workunit.client.0.smithi044.stdout:7/560: write d1c/d22/d28/d30/f84 [3400643,106561] 0 2024-04-25T22:03:22.348 INFO:tasks.workunit.client.0.smithi044.stdout:0/689: stat d8/df/d88/f9b 0 2024-04-25T22:03:22.348 INFO:tasks.workunit.client.0.smithi044.stdout:5/788: creat d2/d5/d27/d2a/db5/ffc x:0 0 0 2024-04-25T22:03:22.348 INFO:tasks.workunit.client.0.smithi044.stdout:3/758: mkdir d0/d1/d15/d51/d8e/df4 0 2024-04-25T22:03:22.349 INFO:tasks.workunit.client.0.smithi044.stdout:6/886: symlink d2/d23/d5a/d12/d49/l12e 0 2024-04-25T22:03:22.349 INFO:tasks.workunit.client.0.smithi044.stdout:9/858: mknod d4/d3d/d58/dd2/df7/c121 0 2024-04-25T22:03:22.349 INFO:tasks.workunit.client.0.smithi044.stdout:7/561: write d1c/d22/d28/d30/f7d [753050,127686] 0 2024-04-25T22:03:22.350 INFO:tasks.workunit.client.0.smithi044.stdout:5/789: symlink d2/d5/d21/d38/d52/dd4/lfd 0 2024-04-25T22:03:22.351 INFO:tasks.workunit.client.0.smithi044.stdout:0/690: creat d8/df/d17/d45/d95/d9c/fe8 x:0 0 0 2024-04-25T22:03:22.351 INFO:tasks.workunit.client.0.smithi044.stdout:3/759: write d0/d1/d15/d51/dd/d11/fd0 [142561,85411] 0 2024-04-25T22:03:22.352 INFO:tasks.workunit.client.0.smithi044.stdout:7/562: creat d1c/d22/d28/d4e/d7b/d59/fa5 x:0 0 0 2024-04-25T22:03:22.352 INFO:tasks.workunit.client.0.smithi044.stdout:9/859: symlink d4/d7/d79/ddc/de1/d54/d84/l122 0 2024-04-25T22:03:22.354 INFO:tasks.workunit.client.0.smithi044.stdout:0/691: rename d8/df/d17/db9/c81 to d8/d20/ce9 0 2024-04-25T22:03:22.354 INFO:tasks.workunit.client.0.smithi044.stdout:7/563: read d1c/d22/d28/d30/f84 [3426775,78487] 0 2024-04-25T22:03:22.354 INFO:tasks.workunit.client.0.smithi044.stdout:8/919: dread d2a/d32/d3e/f75 [0,4194304] 0 2024-04-25T22:03:22.354 INFO:tasks.workunit.client.0.smithi044.stdout:3/760: rename d0/d13/c57 to d0/d2/cf5 0 2024-04-25T22:03:22.354 INFO:tasks.workunit.client.0.smithi044.stdout:9/860: truncate d4/d7/d18/d2e/d73/fb8 521948 0 2024-04-25T22:03:22.355 INFO:tasks.workunit.client.0.smithi044.stdout:7/564: mknod d1c/d22/d28/d66/d6e/ca6 0 2024-04-25T22:03:22.355 INFO:tasks.workunit.client.0.smithi044.stdout:0/692: mkdir d8/df/d17/d45/d95/d51/d8b/db0/dea 0 2024-04-25T22:03:22.355 INFO:tasks.workunit.client.0.smithi044.stdout:8/920: unlink d2a/d39/d42/d68/ldf 0 2024-04-25T22:03:22.356 INFO:tasks.workunit.client.0.smithi044.stdout:3/761: creat d0/d1/d34/d95/dd9/ff6 x:0 0 0 2024-04-25T22:03:22.356 INFO:tasks.workunit.client.0.smithi044.stdout:0/693: write d8/d78/db8/fcd [4904281,114986] 0 2024-04-25T22:03:22.357 INFO:tasks.workunit.client.0.smithi044.stdout:8/921: mknod d2a/d77/dfd/c12e 0 2024-04-25T22:03:22.358 INFO:tasks.workunit.client.0.smithi044.stdout:8/922: chown d2a/d39/f3a 11040 1 2024-04-25T22:03:22.358 INFO:tasks.workunit.client.0.smithi044.stdout:0/694: creat d8/d78/db8/feb x:0 0 0 2024-04-25T22:03:22.358 INFO:tasks.workunit.client.0.smithi044.stdout:7/565: rename d1c/d22/d28/d4e/d6a/l6d to d1c/d22/d28/d4e/da1/la7 0 2024-04-25T22:03:22.359 INFO:tasks.workunit.client.0.smithi044.stdout:3/762: symlink d0/d1/d15/d51/dd/d28/lf7 0 2024-04-25T22:03:22.359 INFO:tasks.workunit.client.0.smithi044.stdout:5/790: dwrite d2/d5/d27/d2a/d5c/f83 [0,4194304] 0 2024-04-25T22:03:22.359 INFO:tasks.workunit.client.0.smithi044.stdout:7/566: readlink d1c/d22/d28/l6c 0 2024-04-25T22:03:22.360 INFO:tasks.workunit.client.0.smithi044.stdout:3/763: mkdir d0/d1/d15/df/d5d/df8 0 2024-04-25T22:03:22.360 INFO:tasks.workunit.client.0.smithi044.stdout:8/923: read - d2a/d32/d3e/dd0/ddc/f10b zero size 2024-04-25T22:03:22.360 INFO:tasks.workunit.client.0.smithi044.stdout:8/924: stat d2a/d77 0 2024-04-25T22:03:22.360 INFO:tasks.workunit.client.0.smithi044.stdout:0/695: mkdir d8/df/d17/d45/d95/d9c/dcc/dec 0 2024-04-25T22:03:22.361 INFO:tasks.workunit.client.0.smithi044.stdout:8/925: readlink d2a/d32/d57/l63 0 2024-04-25T22:03:22.363 INFO:tasks.workunit.client.0.smithi044.stdout:8/926: truncate d2a/d39/d42/d80/feb 542385 0 2024-04-25T22:03:22.364 INFO:tasks.workunit.client.0.smithi044.stdout:3/764: unlink d0/d1/d15/d51/dd/d35/d36/f45 0 2024-04-25T22:03:22.364 INFO:tasks.workunit.client.0.smithi044.stdout:8/927: mknod d2a/d32/d57/d119/c12f 0 2024-04-25T22:03:22.366 INFO:tasks.workunit.client.0.smithi044.stdout:7/567: dwrite d1c/f79 [0,4194304] 0 2024-04-25T22:03:22.367 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:22.368 INFO:tasks.workunit.client.0.smithi044.stdout:1/630: dwrite d3/f34 [0,4194304] 0 2024-04-25T22:03:22.368 INFO:tasks.workunit.client.0.smithi044.stdout:3/765: read d0/d2/f67 [1489241,73628] 0 2024-04-25T22:03:22.368 INFO:tasks.workunit.client.0.smithi044.stdout:7/568: rmdir d1c/d22/d28/d30/d32 39 2024-04-25T22:03:22.369 INFO:tasks.workunit.client.0.smithi044.stdout:8/928: getdents d2a/d39/d42/d80 0 2024-04-25T22:03:22.369 INFO:tasks.workunit.client.0.smithi044.stdout:3/766: mknod d0/d13/d1c/d93/dad/cf9 0 2024-04-25T22:03:22.369 INFO:tasks.workunit.client.0.smithi044.stdout:7/569: write d1c/f2c [178689,68656] 0 2024-04-25T22:03:22.369 INFO:tasks.workunit.client.0.smithi044.stdout:1/631: rename d3/d7/db/f56 to d3/d7/db/d5d/d7f/fc7 0 2024-04-25T22:03:22.371 INFO:tasks.workunit.client.0.smithi044.stdout:7/570: write d1c/d22/d28/d30/d32/f55 [271916,121327] 0 2024-04-25T22:03:22.371 INFO:tasks.workunit.client.0.smithi044.stdout:6/887: dwrite d2/d23/d5a/d12/d27/f2d [0,4194304] 0 2024-04-25T22:03:22.372 INFO:tasks.workunit.client.0.smithi044.stdout:1/632: mknod d3/d7/cc8 0 2024-04-25T22:03:22.373 INFO:tasks.workunit.client.0.smithi044.stdout:0/696: write f0 [3765997,27477] 0 2024-04-25T22:03:22.374 INFO:tasks.workunit.client.0.smithi044.stdout:6/888: write d2/d23/d5a/d11/f60 [3703170,70555] 0 2024-04-25T22:03:22.376 INFO:tasks.workunit.client.0.smithi044.stdout:7/571: symlink d1c/d88/d8f/la8 0 2024-04-25T22:03:22.376 INFO:tasks.workunit.client.0.smithi044.stdout:0/697: dread - d8/da/d60/daa/dbe/fd3 zero size 2024-04-25T22:03:22.376 INFO:tasks.workunit.client.0.smithi044.stdout:8/929: dwrite d2a/ff2 [0,4194304] 0 2024-04-25T22:03:22.376 INFO:tasks.workunit.client.0.smithi044.stdout:1/633: write d3/d30/d3f/f68 [1124686,58765] 0 2024-04-25T22:03:22.377 INFO:tasks.workunit.client.0.smithi044.stdout:8/930: readlink d2a/d39/d42/l47 0 2024-04-25T22:03:22.377 INFO:tasks.workunit.client.0.smithi044.stdout:0/698: write d8/d78/db8/fcd [1135824,77757] 0 2024-04-25T22:03:22.378 INFO:tasks.workunit.client.0.smithi044.stdout:3/767: dwrite d0/d1/d15/d51/d8e/d74/fb8 [0,4194304] 0 2024-04-25T22:03:22.379 INFO:tasks.workunit.client.0.smithi044.stdout:2/657: dread d7/d8/d5f/d70/d8a/f92 [0,4194304] 0 2024-04-25T22:03:22.379 INFO:tasks.workunit.client.0.smithi044.stdout:6/889: mknod d2/d23/d5a/c12f 0 2024-04-25T22:03:22.379 INFO:tasks.workunit.client.0.smithi044.stdout:0/699: write f1 [796917,44009] 0 2024-04-25T22:03:22.379 INFO:tasks.workunit.client.0.smithi044.stdout:1/634: rename d3/d59/cc4 to d3/d7/d29/d43/d85/cc9 0 2024-04-25T22:03:22.380 INFO:tasks.workunit.client.0.smithi044.stdout:0/700: read - d8/d78/db8/feb zero size 2024-04-25T22:03:22.380 INFO:tasks.workunit.client.0.smithi044.stdout:7/572: creat d1c/fa9 x:0 0 0 2024-04-25T22:03:22.381 INFO:tasks.workunit.client.0.smithi044.stdout:6/890: creat d2/d23/d30/f130 x:0 0 0 2024-04-25T22:03:22.382 INFO:tasks.workunit.client.0.smithi044.stdout:3/768: unlink d0/d1/d15/d81/cc4 0 2024-04-25T22:03:22.382 INFO:tasks.workunit.client.0.smithi044.stdout:6/891: mknod d2/d23/d5a/d13/d68/c131 0 2024-04-25T22:03:22.383 INFO:tasks.workunit.client.0.smithi044.stdout:0/701: mkdir d8/df/d17/d45/d95/de7/ded 0 2024-04-25T22:03:22.383 INFO:tasks.workunit.client.0.smithi044.stdout:1/635: rename d3/c55 to d3/d54/cca 0 2024-04-25T22:03:22.385 INFO:tasks.workunit.client.0.smithi044.stdout:3/769: unlink d0/d70/d7c/da9/dc0/feb 0 2024-04-25T22:03:22.385 INFO:tasks.workunit.client.0.smithi044.stdout:2/658: rename d7/d7b/d81/d4e/d86/d6b/d78/c89 to d7/d7b/d81/d4e/d86/d6b/d78/d44/dad/cd2 0 2024-04-25T22:03:22.386 INFO:tasks.workunit.client.0.smithi044.stdout:0/702: symlink d8/df/d17/d45/d95/d51/d8b/lee 0 2024-04-25T22:03:22.387 INFO:tasks.workunit.client.0.smithi044.stdout:1/636: rmdir d3/d7/db/d5d/d7f 39 2024-04-25T22:03:22.388 INFO:tasks.workunit.client.0.smithi044.stdout:8/931: dwrite d2a/d82/dec/ff0 [0,4194304] 0 2024-04-25T22:03:22.389 INFO:tasks.workunit.client.0.smithi044.stdout:2/659: mknod d7/d8/d1c/cd3 0 2024-04-25T22:03:22.390 INFO:tasks.workunit.client.0.smithi044.stdout:2/660: fdatasync d7/f3f 0 2024-04-25T22:03:22.390 INFO:tasks.workunit.client.0.smithi044.stdout:7/573: dwrite d1c/d22/d4a/f81 [0,4194304] 0 2024-04-25T22:03:22.390 INFO:tasks.workunit.client.0.smithi044.stdout:3/770: creat d0/d1/d15/d51/dd/d35/ffa x:0 0 0 2024-04-25T22:03:22.390 INFO:tasks.workunit.client.0.smithi044.stdout:1/637: truncate d3/d4b/db6/fba 761111 0 2024-04-25T22:03:22.391 INFO:tasks.workunit.client.0.smithi044.stdout:8/932: write d2a/d39/d42/f78 [907777,109929] 0 2024-04-25T22:03:22.392 INFO:tasks.workunit.client.0.smithi044.stdout:1/638: write d3/d72/f8b [13475,100562] 0 2024-04-25T22:03:22.392 INFO:tasks.workunit.client.0.smithi044.stdout:7/574: write d1c/d22/d4a/f4f [3232709,61902] 0 2024-04-25T22:03:22.393 INFO:tasks.workunit.client.0.smithi044.stdout:6/892: dwrite d2/d23/d5a/d12/f7a [0,4194304] 0 2024-04-25T22:03:22.393 INFO:tasks.workunit.client.0.smithi044.stdout:7/575: write d1c/d22/f5c [633754,59303] 0 2024-04-25T22:03:22.394 INFO:tasks.workunit.client.0.smithi044.stdout:6/893: fdatasync d2/d23/d5a/d13/d68/f79 0 2024-04-25T22:03:22.395 INFO:tasks.workunit.client.0.smithi044.stdout:7/576: truncate d1c/f38 472408 0 2024-04-25T22:03:22.395 INFO:tasks.workunit.client.0.smithi044.stdout:1/639: rename d3/d7/d29/d43/l6a to d3/d7/db/d5d/d7f/d97/lcb 0 2024-04-25T22:03:22.395 INFO:tasks.workunit.client.0.smithi044.stdout:7/577: readlink d1c/d22/d28/l8d 0 2024-04-25T22:03:22.396 INFO:tasks.workunit.client.0.smithi044.stdout:6/894: symlink d2/d23/d5a/d11/l132 0 2024-04-25T22:03:22.397 INFO:tasks.workunit.client.0.smithi044.stdout:7/578: write d1c/d22/d28/d57/f8b [2205206,64754] 0 2024-04-25T22:03:22.397 INFO:tasks.workunit.client.0.smithi044.stdout:6/895: creat d2/d23/d5a/d12/d27/daf/dcb/ded/f133 x:0 0 0 2024-04-25T22:03:22.398 INFO:tasks.workunit.client.0.smithi044.stdout:3/771: dread d0/d1/d15/d51/dd/d28/f53 [0,4194304] 0 2024-04-25T22:03:22.398 INFO:tasks.workunit.client.0.smithi044.stdout:6/896: stat d2/d23/d5a/f62 0 2024-04-25T22:03:22.398 INFO:tasks.workunit.client.0.smithi044.stdout:3/772: rmdir d0/d1/d15/d51/dd/d11/d8a 39 2024-04-25T22:03:22.400 INFO:tasks.workunit.client.0.smithi044.stdout:7/579: creat d1c/d22/d4a/faa x:0 0 0 2024-04-25T22:03:22.400 INFO:tasks.workunit.client.0.smithi044.stdout:6/897: write d2/d23/d5a/d12/f48 [8743601,105403] 0 2024-04-25T22:03:22.400 INFO:tasks.workunit.client.0.smithi044.stdout:6/898: chown d2/d23/d5a/d11/d3b 277854703 1 2024-04-25T22:03:22.402 INFO:tasks.workunit.client.0.smithi044.stdout:6/899: rename d2/d23/d5a/d12/d1f/d94 to d2/d23/d5a/d12/d27/d8d/d134 0 2024-04-25T22:03:22.403 INFO:tasks.workunit.client.0.smithi044.stdout:4/666: dread dd/d35/d52/d61/f8e [0,4194304] 0 2024-04-25T22:03:22.403 INFO:tasks.workunit.client.0.smithi044.stdout:6/900: creat d2/d23/d5a/d12/d49/f135 x:0 0 0 2024-04-25T22:03:22.404 INFO:tasks.workunit.client.0.smithi044.stdout:4/667: creat dd/d35/fda x:0 0 0 2024-04-25T22:03:22.405 INFO:tasks.workunit.client.0.smithi044.stdout:6/901: creat d2/d23/d5a/d12/d27/d8d/d134/dc8/dfa/df2/d123/d63/f136 x:0 0 0 2024-04-25T22:03:22.405 INFO:tasks.workunit.client.0.smithi044.stdout:0/703: write d8/df/d88/db6/fd4 [223805,84518] 0 2024-04-25T22:03:22.406 INFO:tasks.workunit.client.0.smithi044.stdout:6/902: creat d2/d23/d5a/d13/d68/f137 x:0 0 0 2024-04-25T22:03:22.410 INFO:tasks.workunit.client.0.smithi044.stdout:4/668: dread dd/d35/d52/f90 [0,4194304] 0 2024-04-25T22:03:22.411 INFO:tasks.workunit.client.0.smithi044.stdout:4/669: rmdir dd/d19 39 2024-04-25T22:03:22.415 INFO:tasks.workunit.client.0.smithi044.stdout:8/933: write d2a/d39/d42/d68/f12b [1659201,28372] 0 2024-04-25T22:03:22.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:22.413+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:22.421 INFO:tasks.workunit.client.0.smithi044.stdout:8/934: dwrite d2a/d39/d42/d68/d6b/f4b [4194304,4194304] 0 2024-04-25T22:03:22.427 INFO:tasks.workunit.client.0.smithi044.stdout:8/935: dread d2a/d77/fe1 [0,4194304] 0 2024-04-25T22:03:22.427 INFO:tasks.workunit.client.0.smithi044.stdout:8/936: read - d2a/d32/d3e/fc5 zero size 2024-04-25T22:03:22.430 INFO:tasks.workunit.client.0.smithi044.stdout:5/791: dread d2/d5/d21/d38/d52/d56/fac [0,4194304] 0 2024-04-25T22:03:22.432 INFO:tasks.workunit.client.0.smithi044.stdout:5/792: rmdir d2/d5/d27/d2a/da7/dcb 0 2024-04-25T22:03:22.433 INFO:tasks.workunit.client.0.smithi044.stdout:5/793: truncate d2/d5/d27/f36 18337 0 2024-04-25T22:03:22.433 INFO:tasks.workunit.client.0.smithi044.stdout:8/937: dwrite d2a/d39/d42/d129/d84/fd4 [0,4194304] 0 2024-04-25T22:03:22.434 INFO:tasks.workunit.client.0.smithi044.stdout:5/794: write d2/d5/d21/d26/d2c/f78 [1262267,48446] 0 2024-04-25T22:03:22.436 INFO:tasks.workunit.client.0.smithi044.stdout:2/661: read d7/d16/f17 [3121692,14045] 0 2024-04-25T22:03:22.436 INFO:tasks.workunit.client.0.smithi044.stdout:5/795: creat d2/d5/d21/d26/d2c/ffe x:0 0 0 2024-04-25T22:03:22.437 INFO:tasks.workunit.client.0.smithi044.stdout:1/640: truncate d3/d7/d29/f39 467122 0 2024-04-25T22:03:22.437 INFO:tasks.workunit.client.0.smithi044.stdout:3/773: truncate d0/f38 207564 0 2024-04-25T22:03:22.437 INFO:tasks.workunit.client.0.smithi044.stdout:9/861: sync 2024-04-25T22:03:22.437 INFO:tasks.workunit.client.0.smithi044.stdout:6/903: sync 2024-04-25T22:03:22.438 INFO:tasks.workunit.client.0.smithi044.stdout:0/704: write d8/df/d17/d45/d95/d51/d8b/d90/fe6 [133131,114295] 0 2024-04-25T22:03:22.438 INFO:tasks.workunit.client.0.smithi044.stdout:4/670: truncate dd/f89 2810463 0 2024-04-25T22:03:22.438 INFO:tasks.workunit.client.0.smithi044.stdout:5/796: write d2/d5/d21/f94 [1654810,7458] 0 2024-04-25T22:03:22.438 INFO:tasks.workunit.client.0.smithi044.stdout:2/662: mkdir d7/d8/d1c/d77/dce/dd4 0 2024-04-25T22:03:22.439 INFO:tasks.workunit.client.0.smithi044.stdout:1/641: symlink d3/d7/db/d8f/lcc 0 2024-04-25T22:03:22.439 INFO:tasks.workunit.client.0.smithi044.stdout:3/774: rmdir d0/d1/d15/d23/d60 39 2024-04-25T22:03:22.439 INFO:tasks.workunit.client.0.smithi044.stdout:2/663: dread - d7/d8/d5f/d70/fb6 zero size 2024-04-25T22:03:22.439 INFO:tasks.workunit.client.0.smithi044.stdout:0/705: mknod d8/da/d60/daa/cef 0 2024-04-25T22:03:22.440 INFO:tasks.workunit.client.0.smithi044.stdout:8/938: dread d2a/d39/d5a/d92/dab/f110 [0,4194304] 0 2024-04-25T22:03:22.440 INFO:tasks.workunit.client.0.smithi044.stdout:6/904: creat d2/d23/d5a/d12/d27/daf/dcb/d5e/d92/f138 x:0 0 0 2024-04-25T22:03:22.440 INFO:tasks.workunit.client.0.smithi044.stdout:5/797: mknod d2/d5/d21/d26/d2c/d37/dbb/d9e/cff 0 2024-04-25T22:03:22.441 INFO:tasks.workunit.client.0.smithi044.stdout:0/706: creat d8/db2/d8e/ff0 x:0 0 0 2024-04-25T22:03:22.441 INFO:tasks.workunit.client.0.smithi044.stdout:3/775: creat d0/d1/d15/d51/ffb x:0 0 0 2024-04-25T22:03:22.441 INFO:tasks.workunit.client.0.smithi044.stdout:9/862: write d4/d3d/d66/db9/dbe/df5/dd3/dd4/fe4 [1106619,123937] 0 2024-04-25T22:03:22.442 INFO:tasks.workunit.client.0.smithi044.stdout:1/642: getdents d3/d7/d29/d43/d85 0 2024-04-25T22:03:22.442 INFO:tasks.workunit.client.0.smithi044.stdout:0/707: stat d8/da/fc5 0 2024-04-25T22:03:22.442 INFO:tasks.workunit.client.0.smithi044.stdout:8/939: symlink d2a/d32/d3e/dd0/ddc/l130 0 2024-04-25T22:03:22.443 INFO:tasks.workunit.client.0.smithi044.stdout:5/798: mkdir d2/d5/d21/d26/d2c/d37/d100 0 2024-04-25T22:03:22.443 INFO:tasks.workunit.client.0.smithi044.stdout:1/643: dread - d3/d7/db/fb5 zero size 2024-04-25T22:03:22.443 INFO:tasks.workunit.client.0.smithi044.stdout:8/940: chown d2a/d77/dd8/cf4 4 1 2024-04-25T22:03:22.444 INFO:tasks.workunit.client.0.smithi044.stdout:5/799: mkdir d2/d5/d21/d38/d52/d101 0 2024-04-25T22:03:22.444 INFO:tasks.workunit.client.0.smithi044.stdout:9/863: symlink d4/d3d/d66/db9/dbe/df5/dd3/dd4/l123 0 2024-04-25T22:03:22.445 INFO:tasks.workunit.client.0.smithi044.stdout:5/800: write d2/d5/d21/d38/d52/fe3 [37604,28945] 0 2024-04-25T22:03:22.445 INFO:tasks.workunit.client.0.smithi044.stdout:0/708: rename d8/df/d17/d45/d95/d51/d8b/db0/fd6 to d8/df/d17/d45/d95/d9c/dcc/dec/ff1 0 2024-04-25T22:03:22.446 INFO:tasks.workunit.client.0.smithi044.stdout:9/864: mknod d4/d7/d79/ddc/de1/d54/d84/d72/d97/df3/d10b/c124 0 2024-04-25T22:03:22.447 INFO:tasks.workunit.client.0.smithi044.stdout:3/776: dread d0/d1/f7e [0,4194304] 0 2024-04-25T22:03:22.448 INFO:tasks.workunit.client.0.smithi044.stdout:0/709: read d8/df/d17/d45/d95/d9c/dcc/f5c [594730,40403] 0 2024-04-25T22:03:22.449 INFO:tasks.workunit.client.0.smithi044.stdout:7/580: dread d1c/d22/d28/d30/d32/f52 [0,4194304] 0 2024-04-25T22:03:22.449 INFO:tasks.workunit.client.0.smithi044.stdout:3/777: symlink d0/d1/d15/d51/d8e/d74/lfc 0 2024-04-25T22:03:22.449 INFO:tasks.workunit.client.0.smithi044.stdout:9/865: creat d4/d7/d79/ddc/de1/d54/d84/d72/d97/df3/f125 x:0 0 0 2024-04-25T22:03:22.450 INFO:tasks.workunit.client.0.smithi044.stdout:6/905: dwrite d2/d23/d5a/d12/d27/d8d/d134/dc8/ff0 [0,4194304] 0 2024-04-25T22:03:22.450 INFO:tasks.workunit.client.0.smithi044.stdout:3/778: creat d0/d13/d1c/ffd x:0 0 0 2024-04-25T22:03:22.452 INFO:tasks.workunit.client.0.smithi044.stdout:2/664: truncate f0 4174073 0 2024-04-25T22:03:22.452 INFO:tasks.workunit.client.0.smithi044.stdout:9/866: mknod d4/d7/d18/d2e/d94/c126 0 2024-04-25T22:03:22.452 INFO:tasks.workunit.client.0.smithi044.stdout:4/671: write dd/f46 [4672305,12664] 0 2024-04-25T22:03:22.452 INFO:tasks.workunit.client.0.smithi044.stdout:3/779: fsync d0/d13/d6c/fb3 0 2024-04-25T22:03:22.452 INFO:tasks.workunit.client.0.smithi044.stdout:0/710: link d8/da/d60/d86/fdf d8/d78/ff2 0 2024-04-25T22:03:22.453 INFO:tasks.workunit.client.0.smithi044.stdout:4/672: write dd/d35/d52/d61/d76/fb1 [812517,53514] 0 2024-04-25T22:03:22.453 INFO:tasks.workunit.client.0.smithi044.stdout:0/711: dread - d8/df/d17/d45/d95/fc7 zero size 2024-04-25T22:03:22.454 INFO:tasks.workunit.client.0.smithi044.stdout:3/780: creat d0/d1/d15/d81/ffe x:0 0 0 2024-04-25T22:03:22.455 INFO:tasks.workunit.client.0.smithi044.stdout:5/801: dwrite d2/d5/d21/d26/d2c/d37/f4d [0,4194304] 0 2024-04-25T22:03:22.455 INFO:tasks.workunit.client.0.smithi044.stdout:4/673: stat dd/d19/d91 0 2024-04-25T22:03:22.455 INFO:tasks.workunit.client.0.smithi044.stdout:1/644: truncate d3/d4b/fb9 3933601 0 2024-04-25T22:03:22.456 INFO:tasks.workunit.client.0.smithi044.stdout:0/712: truncate d8/d78/ff2 63559 0 2024-04-25T22:03:22.457 INFO:tasks.workunit.client.0.smithi044.stdout:3/781: rename d0/l26 to d0/d2/lff 0 2024-04-25T22:03:22.458 INFO:tasks.workunit.client.0.smithi044.stdout:1/645: getdents d3/d30/dbb 0 2024-04-25T22:03:22.458 INFO:tasks.workunit.client.0.smithi044.stdout:0/713: write d8/d20/f6c [948098,72151] 0 2024-04-25T22:03:22.458 INFO:tasks.workunit.client.0.smithi044.stdout:5/802: getdents d2/d5/d21/d38/dc8 0 2024-04-25T22:03:22.459 INFO:tasks.workunit.client.0.smithi044.stdout:6/906: link d2/d23/d5a/d12/d27/daf/dcb/dc2/fe6 d2/d23/d5a/d12/d27/daf/dcb/d5e/d9c/f139 0 2024-04-25T22:03:22.460 INFO:tasks.workunit.client.0.smithi044.stdout:0/714: chown d8/da/lb 2124 1 2024-04-25T22:03:22.460 INFO:tasks.workunit.client.0.smithi044.stdout:3/782: fsync d0/d1/d15/d51/d8e/d74/fca 0 2024-04-25T22:03:22.460 INFO:tasks.workunit.client.0.smithi044.stdout:7/581: sync 2024-04-25T22:03:22.460 INFO:tasks.workunit.client.0.smithi044.stdout:6/907: chown d2/d23/le0 136972 1 2024-04-25T22:03:22.461 INFO:tasks.workunit.client.0.smithi044.stdout:9/867: dwrite d4/d7/d79/ddc/de1/f11f [0,4194304] 0 2024-04-25T22:03:22.463 INFO:tasks.workunit.client.0.smithi044.stdout:9/868: chown d4/d7/l25 274920 1 2024-04-25T22:03:22.463 INFO:tasks.workunit.client.0.smithi044.stdout:8/941: dwrite d2a/d32/d3e/f54 [0,4194304] 0 2024-04-25T22:03:22.464 INFO:tasks.workunit.client.0.smithi044.stdout:6/908: write d2/d23/d5a/d12/d27/f2d [3928781,93366] 0 2024-04-25T22:03:22.465 INFO:tasks.workunit.client.0.smithi044.stdout:9/869: unlink d4/d7/fb7 0 2024-04-25T22:03:22.466 INFO:tasks.workunit.client.0.smithi044.stdout:3/783: link d0/d1/d15/d51/dd/d11/l32 d0/d1/d15/d51/dd/d35/dc6/l100 0 2024-04-25T22:03:22.466 INFO:tasks.workunit.client.0.smithi044.stdout:6/909: mknod d2/d23/da9/c13a 0 2024-04-25T22:03:22.469 INFO:tasks.workunit.client.0.smithi044.stdout:0/715: dwrite d8/df/d17/d87/fa1 [0,4194304] 0 2024-04-25T22:03:22.469 INFO:tasks.workunit.client.0.smithi044.stdout:7/582: getdents d1c/d22/d28/d30/d32/d5d/d83 0 2024-04-25T22:03:22.469 INFO:tasks.workunit.client.0.smithi044.stdout:8/942: mkdir d2a/d32/d3e/dd0/d116/d131 0 2024-04-25T22:03:22.469 INFO:tasks.workunit.client.0.smithi044.stdout:3/784: creat d0/d13/d6c/f101 x:0 0 0 2024-04-25T22:03:22.469 INFO:tasks.workunit.client.0.smithi044.stdout:1/646: write d3/d7/fc0 [1181708,82906] 0 2024-04-25T22:03:22.470 INFO:tasks.workunit.client.0.smithi044.stdout:7/583: chown d1c/fa9 94 1 2024-04-25T22:03:22.472 INFO:tasks.workunit.client.0.smithi044.stdout:0/716: fsync d8/d78/db8/fe0 0 2024-04-25T22:03:22.472 INFO:tasks.workunit.client.0.smithi044.stdout:2/665: dread d7/d7b/d81/d4e/d86/d6b/d78/f56 [0,4194304] 0 2024-04-25T22:03:22.473 INFO:tasks.workunit.client.0.smithi044.stdout:9/870: dwrite d4/d7/d18/d2e/d73/fe5 [0,4194304] 0 2024-04-25T22:03:22.475 INFO:tasks.workunit.client.0.smithi044.stdout:7/584: unlink d1c/d22/d28/d4e/d7b/d59/fa5 0 2024-04-25T22:03:22.475 INFO:tasks.workunit.client.0.smithi044.stdout:0/717: rename d8/db2/d8e/ff0 to d8/da/d60/daa/ff3 0 2024-04-25T22:03:22.475 INFO:tasks.workunit.client.0.smithi044.stdout:6/910: link d2/d23/d5a/d12/d49/fad d2/d23/d5a/d12/d49/f13b 0 2024-04-25T22:03:22.476 INFO:tasks.workunit.client.0.smithi044.stdout:2/666: rename d7/f31 to d7/d8/d48/db2/fd5 0 2024-04-25T22:03:22.476 INFO:tasks.workunit.client.0.smithi044.stdout:7/585: write d1c/d22/d28/d4e/d7b/fa3 [86394,28054] 0 2024-04-25T22:03:22.477 INFO:tasks.workunit.client.0.smithi044.stdout:9/871: rename d4/d7/d79/ddc/de1/d54/d84/lb1 to d4/d7/d79/l127 0 2024-04-25T22:03:22.478 INFO:tasks.workunit.client.0.smithi044.stdout:0/718: mkdir d8/df/d17/d45/d95/d51/dc2/df4 0 2024-04-25T22:03:22.478 INFO:tasks.workunit.client.0.smithi044.stdout:6/911: mkdir d2/d23/d5a/d12/d27/daf/dcb/d5e/d13c 0 2024-04-25T22:03:22.479 INFO:tasks.workunit.client.0.smithi044.stdout:8/943: dwrite d2a/d39/d42/f9f [0,4194304] 0 2024-04-25T22:03:22.479 INFO:tasks.workunit.client.0.smithi044.stdout:0/719: dread - d8/d78/db8/feb zero size 2024-04-25T22:03:22.480 INFO:tasks.workunit.client.0.smithi044.stdout:7/586: symlink d1c/lab 0 2024-04-25T22:03:22.480 INFO:tasks.workunit.client.0.smithi044.stdout:6/912: creat d2/d105/f13d x:0 0 0 2024-04-25T22:03:22.482 INFO:tasks.workunit.client.0.smithi044.stdout:9/872: write d4/d7/d79/ddc/de1/d54/d84/d72/f100 [936462,118022] 0 2024-04-25T22:03:22.483 INFO:tasks.workunit.client.0.smithi044.stdout:7/587: mkdir d1c/d22/d28/d4e/dac 0 2024-04-25T22:03:22.483 INFO:tasks.workunit.client.0.smithi044.stdout:6/913: chown d2/d23/d5a/d12/cf 157709 1 2024-04-25T22:03:22.483 INFO:tasks.workunit.client.0.smithi044.stdout:7/588: chown d1c/l69 3 1 2024-04-25T22:03:22.484 INFO:tasks.workunit.client.0.smithi044.stdout:9/873: stat d4/d7/d79/ddc/de1/l5b 0 2024-04-25T22:03:22.484 INFO:tasks.workunit.client.0.smithi044.stdout:7/589: stat cc 0 2024-04-25T22:03:22.484 INFO:tasks.workunit.client.0.smithi044.stdout:9/874: readlink d4/d7/l1e 0 2024-04-25T22:03:22.485 INFO:tasks.workunit.client.0.smithi044.stdout:6/914: mkdir d2/d23/d5a/d12/d27/daf/dcb/ded/d13e 0 2024-04-25T22:03:22.486 INFO:tasks.workunit.client.0.smithi044.stdout:7/590: write d1c/d22/f71 [2022971,36758] 0 2024-04-25T22:03:22.486 INFO:tasks.workunit.client.0.smithi044.stdout:5/803: dread d2/d5/d21/d26/d2c/f97 [0,4194304] 0 2024-04-25T22:03:22.487 INFO:tasks.workunit.client.0.smithi044.stdout:3/785: dwrite d0/d1/d15/d51/d8e/d74/f90 [0,4194304] 0 2024-04-25T22:03:22.487 INFO:tasks.workunit.client.0.smithi044.stdout:2/667: dwrite d7/d8/d48/db2/fd5 [0,4194304] 0 2024-04-25T22:03:22.488 INFO:tasks.workunit.client.0.smithi044.stdout:9/875: write d4/d7/d79/ddc/de1/d54/d84/d72/f87 [2216456,80028] 0 2024-04-25T22:03:22.488 INFO:tasks.workunit.client.0.smithi044.stdout:5/804: creat d2/d5b/d8e/f102 x:0 0 0 2024-04-25T22:03:22.488 INFO:tasks.workunit.client.0.smithi044.stdout:3/786: chown d0/d1/d15/d23/c64 36400 1 2024-04-25T22:03:22.489 INFO:tasks.workunit.client.0.smithi044.stdout:6/915: mknod d2/d23/d5a/d12/d27/daf/dcb/ded/c13f 0 2024-04-25T22:03:22.489 INFO:tasks.workunit.client.0.smithi044.stdout:9/876: rmdir d4/d7/d18/d2e/d94 39 2024-04-25T22:03:22.489 INFO:tasks.workunit.client.0.smithi044.stdout:7/591: creat d1c/d88/d8f/d9c/fad x:0 0 0 2024-04-25T22:03:22.489 INFO:tasks.workunit.client.0.smithi044.stdout:7/592: sync 2024-04-25T22:03:22.490 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:22.484+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:22.490 INFO:tasks.workunit.client.0.smithi044.stdout:6/916: unlink d2/d23/d5a/d13/ff5 0 2024-04-25T22:03:22.491 INFO:tasks.workunit.client.0.smithi044.stdout:3/787: rename d0/d13/d1c/d93/fdb to d0/d1/d15/d51/dd/d35/dc6/f102 0 2024-04-25T22:03:22.491 INFO:tasks.workunit.client.0.smithi044.stdout:9/877: chown d4/d7/d18/d3a/d8b/fde 4 1 2024-04-25T22:03:22.491 INFO:tasks.workunit.client.0.smithi044.stdout:6/917: mknod d2/d23/d5a/d12/d1f/c140 0 2024-04-25T22:03:22.493 INFO:tasks.workunit.client.0.smithi044.stdout:9/878: write d4/d3d/d58/dd2/df7/fff [204706,80158] 0 2024-04-25T22:03:22.493 INFO:tasks.workunit.client.0.smithi044.stdout:3/788: getdents d0/d1/d15/d23/d60 0 2024-04-25T22:03:22.498 INFO:tasks.workunit.client.0.smithi044.stdout:9/879: rename d4/d3d/d58 to d4/d7/d79/ddc/de1/d54/d84/d72/d113/d128 0 2024-04-25T22:03:22.498 INFO:tasks.workunit.client.0.smithi044.stdout:5/805: dwrite d2/d5/d27/d2a/da7/fbc [0,4194304] 0 2024-04-25T22:03:22.498 INFO:tasks.workunit.client.0.smithi044.stdout:6/918: dread d2/d23/d5a/d12/d27/daf/dcb/dc2/fe6 [0,4194304] 0 2024-04-25T22:03:22.498 INFO:tasks.workunit.client.0.smithi044.stdout:2/668: dwrite d7/d8/d1c/d77/fa6 [0,4194304] 0 2024-04-25T22:03:22.499 INFO:tasks.workunit.client.0.smithi044.stdout:6/919: rmdir d2/d23/da9 39 2024-04-25T22:03:22.499 INFO:tasks.workunit.client.0.smithi044.stdout:5/806: write d2/d5/d21/d26/d2c/d37/f8a [4780154,21225] 0 2024-04-25T22:03:22.501 INFO:tasks.workunit.client.0.smithi044.stdout:2/669: symlink d7/d7b/d81/d4e/d86/d6b/d78/ld6 0 2024-04-25T22:03:22.501 INFO:tasks.workunit.client.0.smithi044.stdout:5/807: unlink d2/d5/d21/d38/f53 0 2024-04-25T22:03:22.502 INFO:tasks.workunit.client.0.smithi044.stdout:6/920: write d2/d23/d5a/d12/d27/fea [451482,3499] 0 2024-04-25T22:03:22.504 INFO:tasks.workunit.client.0.smithi044.stdout:2/670: write d7/d7b/d81/d57/fcf [87207,34522] 0 2024-04-25T22:03:22.504 INFO:tasks.workunit.client.0.smithi044.stdout:5/808: mknod d2/d5/d21/d6b/d9b/c103 0 2024-04-25T22:03:22.504 INFO:tasks.workunit.client.0.smithi044.stdout:3/789: dwrite d0/d13/d6c/fc2 [0,4194304] 0 2024-04-25T22:03:22.505 INFO:tasks.workunit.client.0.smithi044.stdout:2/671: chown d7/d8/d5f/fbe 5969 1 2024-04-25T22:03:22.507 INFO:tasks.workunit.client.0.smithi044.stdout:3/790: write d0/d1/d15/d51/fec [915172,44976] 0 2024-04-25T22:03:22.507 INFO:tasks.workunit.client.0.smithi044.stdout:9/880: dwrite d4/d7/d79/ddc/de1/d54/d84/d64/f82 [0,4194304] 0 2024-04-25T22:03:22.507 INFO:tasks.workunit.client.0.smithi044.stdout:5/809: chown d2/d5/d27/d2a/d70/fd8 4761614 1 2024-04-25T22:03:22.507 INFO:tasks.workunit.client.0.smithi044.stdout:6/921: write d2/d23/d5a/d12/d27/d8d/d134/dc8/dfa/df2/d123/d63/f120 [860008,113827] 0 2024-04-25T22:03:22.507 INFO:tasks.workunit.client.0.smithi044.stdout:2/672: creat d7/d8/d5f/d70/d8a/fd7 x:0 0 0 2024-04-25T22:03:22.508 INFO:tasks.workunit.client.0.smithi044.stdout:5/810: chown d2/d5/d27/d2a/d48/ld3 9 1 2024-04-25T22:03:22.508 INFO:tasks.workunit.client.0.smithi044.stdout:9/881: mkdir d4/d3d/da5/dd8/d129 0 2024-04-25T22:03:22.508 INFO:tasks.workunit.client.0.smithi044.stdout:5/811: dread - d2/fae zero size 2024-04-25T22:03:22.508 INFO:tasks.workunit.client.0.smithi044.stdout:6/922: creat d2/d23/d5a/d13/d121/d124/f141 x:0 0 0 2024-04-25T22:03:22.508 INFO:tasks.workunit.client.0.smithi044.stdout:3/791: rename d0/d1/d15/df to d0/d1/d15/d51/d8e/d74/d103 0 2024-04-25T22:03:22.509 INFO:tasks.workunit.client.0.smithi044.stdout:5/812: readlink d2/d5/lf9 0 2024-04-25T22:03:22.509 INFO:tasks.workunit.client.0.smithi044.stdout:9/882: truncate d4/f1a 3728081 0 2024-04-25T22:03:22.510 INFO:tasks.workunit.client.0.smithi044.stdout:5/813: getdents d2/d5/d27/d2a 0 2024-04-25T22:03:22.512 INFO:tasks.workunit.client.0.smithi044.stdout:8/944: dread d2a/d52/f103 [0,4194304] 0 2024-04-25T22:03:22.512 INFO:tasks.workunit.client.0.smithi044.stdout:5/814: chown d2/f20 1966316 1 2024-04-25T22:03:22.513 INFO:tasks.workunit.client.0.smithi044.stdout:8/945: stat l29 0 2024-04-25T22:03:22.513 INFO:tasks.workunit.client.0.smithi044.stdout:8/946: chown d2a/d32/d57/d119 162362 1 2024-04-25T22:03:22.513 INFO:tasks.workunit.client.0.smithi044.stdout:5/815: stat d2/d35/f45 0 2024-04-25T22:03:22.516 INFO:tasks.workunit.client.0.smithi044.stdout:3/792: dwrite d0/d1/fcd [0,4194304] 0 2024-04-25T22:03:22.520 INFO:tasks.workunit.client.0.smithi044.stdout:3/793: link d0/d13/d1c/d93/da6/l66 d0/d13/d1c/d93/dad/l104 0 2024-04-25T22:03:22.520 INFO:tasks.workunit.client.0.smithi044.stdout:3/794: fsync d0/d13/d1c/fc1 0 2024-04-25T22:03:22.521 INFO:tasks.workunit.client.0.smithi044.stdout:3/795: mkdir d0/d1/d15/d81/dd2/d105 0 2024-04-25T22:03:22.523 INFO:tasks.workunit.client.0.smithi044.stdout:3/796: creat d0/d70/d7c/da9/dc0/f106 x:0 0 0 2024-04-25T22:03:22.523 INFO:tasks.workunit.client.0.smithi044.stdout:1/647: dwrite d3/d4b/fb9 [0,4194304] 0 2024-04-25T22:03:22.524 INFO:tasks.workunit.client.0.smithi044.stdout:1/648: rmdir d3/d7/db/d5d/d7f/d97/d99 39 2024-04-25T22:03:22.524 INFO:tasks.workunit.client.0.smithi044.stdout:0/720: dread d8/df/d17/d45/d95/d9c/dcc/f8d [4194304,4194304] 0 2024-04-25T22:03:22.525 INFO:tasks.workunit.client.0.smithi044.stdout:3/797: rename d0/d1/d15/d51/dd/d11/d8a/l97 to d0/d1/d15/d51/dd/d35/dab/l107 0 2024-04-25T22:03:22.526 INFO:tasks.workunit.client.0.smithi044.stdout:1/649: dread - d3/d7/d29/d43/fa1 zero size 2024-04-25T22:03:22.527 INFO:tasks.workunit.client.0.smithi044.stdout:1/650: stat d3/d7/db/d8f 0 2024-04-25T22:03:22.528 INFO:tasks.workunit.client.0.smithi044.stdout:1/651: mkdir d3/dcd 0 2024-04-25T22:03:22.530 INFO:tasks.workunit.client.0.smithi044.stdout:7/593: read d1c/d22/d28/d4e/d7b/fa0 [1843662,92297] 0 2024-04-25T22:03:22.530 INFO:tasks.workunit.client.0.smithi044.stdout:4/674: dread dd/f41 [0,4194304] 0 2024-04-25T22:03:22.531 INFO:tasks.workunit.client.0.smithi044.stdout:4/675: write fa [1336244,25839] 0 2024-04-25T22:03:22.531 INFO:tasks.workunit.client.0.smithi044.stdout:7/594: fdatasync d1c/d22/d28/d30/d32/f9a 0 2024-04-25T22:03:22.532 INFO:tasks.workunit.client.0.smithi044.stdout:7/595: creat d1c/d88/d8f/d9c/fae x:0 0 0 2024-04-25T22:03:22.532 INFO:tasks.workunit.client.0.smithi044.stdout:4/676: mknod dd/d19/d91/dd9/cdb 0 2024-04-25T22:03:22.533 INFO:tasks.workunit.client.0.smithi044.stdout:3/798: dwrite d0/d1/d15/d51/d8e/d74/d103/d5d/fb4 [0,4194304] 0 2024-04-25T22:03:22.533 INFO:tasks.workunit.client.0.smithi044.stdout:7/596: write d1c/f2c [590775,93003] 0 2024-04-25T22:03:22.533 INFO:tasks.workunit.client.0.smithi044.stdout:4/677: rmdir dd/d35/d52/da9 39 2024-04-25T22:03:22.535 INFO:tasks.workunit.client.0.smithi044.stdout:7/597: mknod d1c/d22/d28/d30/caf 0 2024-04-25T22:03:22.535 INFO:tasks.workunit.client.0.smithi044.stdout:8/947: dread d2a/d39/d42/d80/d121/fb0 [0,4194304] 0 2024-04-25T22:03:22.536 INFO:tasks.workunit.client.0.smithi044.stdout:8/948: write d2a/d32/f34 [5539055,86195] 0 2024-04-25T22:03:22.538 INFO:tasks.workunit.client.0.smithi044.stdout:8/949: getdents d2a/d39/d42/d68/d6b/d7b 0 2024-04-25T22:03:22.539 INFO:tasks.workunit.client.0.smithi044.stdout:4/678: dread dd/f55 [0,4194304] 0 2024-04-25T22:03:22.539 INFO:tasks.workunit.client.0.smithi044.stdout:8/950: fsync d2a/d39/d42/f124 0 2024-04-25T22:03:22.540 INFO:tasks.workunit.client.0.smithi044.stdout:4/679: symlink dd/d35/d52/ldc 0 2024-04-25T22:03:22.540 INFO:tasks.workunit.client.0.smithi044.stdout:8/951: write d2a/d39/d5a/d92/dab/f10f [710221,94049] 0 2024-04-25T22:03:22.540 INFO:tasks.workunit.client.0.smithi044.stdout:6/923: dread d2/d23/d5a/d11/d2a/dbf/f97 [0,4194304] 0 2024-04-25T22:03:22.541 INFO:tasks.workunit.client.0.smithi044.stdout:8/952: mkdir d2a/d39/d5a/d8e/d132 0 2024-04-25T22:03:22.542 INFO:tasks.workunit.client.0.smithi044.stdout:7/598: dwrite d1c/d22/f71 [0,4194304] 0 2024-04-25T22:03:22.542 INFO:tasks.workunit.client.0.smithi044.stdout:6/924: mknod d2/d23/d5a/d11/d3b/c142 0 2024-04-25T22:03:22.542 INFO:tasks.workunit.client.0.smithi044.stdout:8/953: symlink d2a/d52/l133 0 2024-04-25T22:03:22.542 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:22.543 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:22.545 INFO:tasks.workunit.client.0.smithi044.stdout:0/721: truncate d8/fca 1045958 0 2024-04-25T22:03:22.546 INFO:tasks.workunit.client.0.smithi044.stdout:1/652: truncate d3/d7/f40 8011607 0 2024-04-25T22:03:22.546 INFO:tasks.workunit.client.0.smithi044.stdout:4/680: dread dd/d19/f6d [0,4194304] 0 2024-04-25T22:03:22.547 INFO:tasks.workunit.client.0.smithi044.stdout:0/722: mknod d8/df/d93/cf5 0 2024-04-25T22:03:22.550 INFO:tasks.workunit.client.0.smithi044.stdout:7/599: dwrite d1c/f47 [4194304,4194304] 0 2024-04-25T22:03:22.552 INFO:tasks.workunit.client.0.smithi044.stdout:6/925: dwrite d2/d23/d5a/d11/f60 [0,4194304] 0 2024-04-25T22:03:22.552 INFO:tasks.workunit.client.0.smithi044.stdout:9/883: dread d4/d7/d79/ddc/de1/d54/d84/d72/d113/d128/dd2/fd7 [0,4194304] 0 2024-04-25T22:03:22.556 INFO:tasks.workunit.client.0.smithi044.stdout:8/954: truncate d2a/d39/d42/f88 402947 0 2024-04-25T22:03:22.558 INFO:tasks.workunit.client.0.smithi044.stdout:9/884: creat d4/d7/d79/ddc/de1/d54/d84/d72/d113/d128/f12a x:0 0 0 2024-04-25T22:03:22.559 INFO:tasks.workunit.client.0.smithi044.stdout:9/885: write d4/d7/d18/d3a/ffe [395840,26961] 0 2024-04-25T22:03:22.560 INFO:tasks.workunit.client.0.smithi044.stdout:0/723: dwrite d8/da/f7f [0,4194304] 0 2024-04-25T22:03:22.560 INFO:tasks.workunit.client.0.smithi044.stdout:4/681: dwrite dd/d35/d52/f5b [0,4194304] 0 2024-04-25T22:03:22.560 INFO:tasks.workunit.client.0.smithi044.stdout:6/926: dread d2/d23/d5a/d11/d2a/dbf/f97 [0,4194304] 0 2024-04-25T22:03:22.564 INFO:tasks.workunit.client.0.smithi044.stdout:7/600: read d1c/d22/d28/d66/d6e/f9d [478135,73215] 0 2024-04-25T22:03:22.565 INFO:tasks.workunit.client.0.smithi044.stdout:8/955: dread d2a/d32/d3e/f44 [0,4194304] 0 2024-04-25T22:03:22.566 INFO:tasks.workunit.client.0.smithi044.stdout:2/673: sync 2024-04-25T22:03:22.567 INFO:tasks.workunit.client.0.smithi044.stdout:7/601: link d1c/d22/d28/d66/c92 d1c/cb0 0 2024-04-25T22:03:22.567 INFO:tasks.workunit.client.0.smithi044.stdout:2/674: mkdir d7/d7b/d81/d4e/d86/d6b/dd8 0 2024-04-25T22:03:22.568 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:22.568 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:22.568 INFO:tasks.workunit.client.0.smithi044.stdout:6/927: dwrite d2/d23/d5a/d13/d68/fd3 [0,4194304] 0 2024-04-25T22:03:22.568 INFO:tasks.workunit.client.0.smithi044.stdout:2/675: rename d7/d16 to d7/d8/d48/dd9 0 2024-04-25T22:03:22.569 INFO:tasks.workunit.client.0.smithi044.stdout:7/602: rmdir d1c/d22/d28/d4e/dac 0 2024-04-25T22:03:22.570 INFO:tasks.workunit.client.0.smithi044.stdout:6/928: truncate d2/d23/d5a/d13/d68/f137 105875 0 2024-04-25T22:03:22.570 INFO:tasks.workunit.client.0.smithi044.stdout:7/603: mkdir d1c/d22/d4a/db1 0 2024-04-25T22:03:22.570 INFO:tasks.workunit.client.0.smithi044.stdout:2/676: symlink d7/d7b/d81/d4e/d86/d6b/lda 0 2024-04-25T22:03:22.570 INFO:tasks.workunit.client.0.smithi044.stdout:7/604: fdatasync d1c/f79 0 2024-04-25T22:03:22.570 INFO:tasks.workunit.client.0.smithi044.stdout:2/677: symlink d7/d8/d48/db2/ldb 0 2024-04-25T22:03:22.571 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:22.571 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:22.571 INFO:tasks.workunit.client.0.smithi044.stdout:2/678: creat d7/d7b/fdc x:0 0 0 2024-04-25T22:03:22.571 INFO:tasks.workunit.client.0.smithi044.stdout:7/605: link d1c/f2c d1c/d22/d28/d30/d32/d97/fb2 0 2024-04-25T22:03:22.572 INFO:tasks.workunit.client.0.smithi044.stdout:7/606: symlink d1c/d22/d28/lb3 0 2024-04-25T22:03:22.573 INFO:tasks.workunit.client.0.smithi044.stdout:2/679: creat d7/d7b/d81/d4e/d86/d6b/d78/d44/fdd x:0 0 0 2024-04-25T22:03:22.573 INFO:tasks.workunit.client.0.smithi044.stdout:7/607: creat d1c/d22/d28/d57/d7c/fb4 x:0 0 0 2024-04-25T22:03:22.574 INFO:tasks.workunit.client.0.smithi044.stdout:3/799: dread d0/d1/d34/f58 [0,4194304] 0 2024-04-25T22:03:22.574 INFO:tasks.workunit.client.0.smithi044.stdout:2/680: fsync d7/d8/d48/dd9/d4b/f72 0 2024-04-25T22:03:22.574 INFO:tasks.workunit.client.0.smithi044.stdout:3/800: mkdir d0/d13/d1c/d93/d108 0 2024-04-25T22:03:22.575 INFO:tasks.workunit.client.0.smithi044.stdout:3/801: unlink d0/d1/d34/d95/cb7 0 2024-04-25T22:03:22.576 INFO:tasks.workunit.client.0.smithi044.stdout:2/681: rename d7/d7b/d81/d4e/d86/lcd to d7/d8/d48/dd9/lde 0 2024-04-25T22:03:22.576 INFO:tasks.workunit.client.0.smithi044.stdout:3/802: dread - d0/d13/d6c/f101 zero size 2024-04-25T22:03:22.577 INFO:tasks.workunit.client.0.smithi044.stdout:3/803: creat d0/d13/d6c/f109 x:0 0 0 2024-04-25T22:03:22.577 INFO:tasks.workunit.client.0.smithi044.stdout:2/682: chown d7/d8/d48/dd9/d2c/d50 48515928 1 2024-04-25T22:03:22.578 INFO:tasks.workunit.client.0.smithi044.stdout:3/804: rename d0/d2/f67 to d0/d13/d1c/d93/d108/f10a 0 2024-04-25T22:03:22.579 INFO:tasks.workunit.client.0.smithi044.stdout:2/683: truncate d7/d7b/d81/d4e/d86/d6b/d78/d44/fdd 324440 0 2024-04-25T22:03:22.579 INFO:tasks.workunit.client.0.smithi044.stdout:7/608: dread d1c/d22/d28/d66/d6e/f9d [0,4194304] 0 2024-04-25T22:03:22.580 INFO:tasks.workunit.client.0.smithi044.stdout:2/684: creat d7/d8/d48/dd9/fdf x:0 0 0 2024-04-25T22:03:22.580 INFO:tasks.workunit.client.0.smithi044.stdout:7/609: link d1c/f2c d1c/d88/d8f/fb5 0 2024-04-25T22:03:22.581 INFO:tasks.workunit.client.0.smithi044.stdout:2/685: stat d7/d8/d1c/d77/dce/dd4 0 2024-04-25T22:03:22.582 INFO:tasks.workunit.client.0.smithi044.stdout:2/686: truncate d7/d7b/d81/d4e/f59 1820658 0 2024-04-25T22:03:22.582 INFO:tasks.workunit.client.0.smithi044.stdout:2/687: creat d7/d8/d48/fe0 x:0 0 0 2024-04-25T22:03:22.583 INFO:tasks.workunit.client.0.smithi044.stdout:2/688: unlink d7/d7b/d81/d4e/d86/d6b/d78/c7a 0 2024-04-25T22:03:22.584 INFO:tasks.workunit.client.0.smithi044.stdout:3/805: write d0/d70/f84 [976020,58922] 0 2024-04-25T22:03:22.588 INFO:tasks.workunit.client.0.smithi044.stdout:3/806: read d0/d1/d15/d23/f40 [3922281,129194] 0 2024-04-25T22:03:22.588 INFO:tasks.workunit.client.0.smithi044.stdout:1/653: dread d3/d7/d81/f8a [0,4194304] 0 2024-04-25T22:03:22.589 INFO:tasks.workunit.client.0.smithi044.stdout:1/654: creat d3/d4b/db6/fce x:0 0 0 2024-04-25T22:03:22.589 INFO:tasks.workunit.client.0.smithi044.stdout:3/807: creat d0/d13/d1c/d93/da6/d8d/f10b x:0 0 0 2024-04-25T22:03:22.590 INFO:tasks.workunit.client.0.smithi044.stdout:1/655: chown d3/d54/d76 317361 1 2024-04-25T22:03:22.590 INFO:tasks.workunit.client.0.smithi044.stdout:2/689: dwrite d7/d7b/d81/d4e/f24 [0,4194304] 0 2024-04-25T22:03:22.590 INFO:tasks.workunit.client.0.smithi044.stdout:1/656: read - d3/d7/d83/fbd zero size 2024-04-25T22:03:22.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:22.585+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:22.591 INFO:tasks.workunit.client.0.smithi044.stdout:3/808: creat d0/d1/d15/d51/dd/d35/d36/f10c x:0 0 0 2024-04-25T22:03:22.591 INFO:tasks.workunit.client.0.smithi044.stdout:2/690: chown d7/d8/d48/dd9/d2c/f85 2323626 1 2024-04-25T22:03:22.592 INFO:tasks.workunit.client.0.smithi044.stdout:3/809: mknod d0/d1/d15/d23/d60/c10d 0 2024-04-25T22:03:22.594 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:22.595 INFO:tasks.workunit.client.0.smithi044.stdout:2/691: mkdir d7/d8/d48/dd9/d4b/dc1/de1 0 2024-04-25T22:03:22.595 INFO:tasks.workunit.client.0.smithi044.stdout:3/810: mknod d0/d1/d34/d48/dc7/c10e 0 2024-04-25T22:03:22.595 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:22.596 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:22.596 INFO:tasks.workunit.client.0.smithi044.stdout:8/956: dread d2a/f36 [0,4194304] 0 2024-04-25T22:03:22.596 INFO:tasks.workunit.client.0.smithi044.stdout:2/692: rename d7/d5b to d7/d8/de2 0 2024-04-25T22:03:22.596 INFO:tasks.workunit.client.0.smithi044.stdout:3/811: write d0/d1/d15/d51/dd/d11/f69 [4006055,22316] 0 2024-04-25T22:03:22.597 INFO:tasks.workunit.client.0.smithi044.stdout:8/957: dread - d2a/d39/d42/d129/fa8 zero size 2024-04-25T22:03:22.597 INFO:tasks.workunit.client.0.smithi044.stdout:2/693: rmdir d7/d8/d5f/d70/d8a 39 2024-04-25T22:03:22.598 INFO:tasks.workunit.client.0.smithi044.stdout:1/657: dwrite d3/d72/f8c [0,4194304] 0 2024-04-25T22:03:22.598 INFO:tasks.workunit.client.0.smithi044.stdout:8/958: readlink d2a/d82/db6/dd2/le9 0 2024-04-25T22:03:22.599 INFO:tasks.workunit.client.0.smithi044.stdout:0/724: dread d8/df/d17/d45/d95/f30 [0,4194304] 0 2024-04-25T22:03:22.599 INFO:tasks.workunit.client.0.smithi044.stdout:1/658: write d3/d7/db/f1d [4840365,125801] 0 2024-04-25T22:03:22.600 INFO:tasks.workunit.client.0.smithi044.stdout:1/659: chown d3/d30/f31 18168562 1 2024-04-25T22:03:22.600 INFO:tasks.workunit.client.0.smithi044.stdout:2/694: creat d7/d8/fe3 x:0 0 0 2024-04-25T22:03:22.601 INFO:tasks.workunit.client.0.smithi044.stdout:8/959: rename d2a/d39/d42/l47 to d2a/d32/d3e/l134 0 2024-04-25T22:03:22.602 INFO:tasks.workunit.client.0.smithi044.stdout:1/660: mkdir d3/d7/d29/dcf 0 2024-04-25T22:03:22.602 INFO:tasks.workunit.client.0.smithi044.stdout:2/695: mkdir d7/d8/d1c/d77/dce/de4 0 2024-04-25T22:03:22.602 INFO:tasks.workunit.client.0.smithi044.stdout:8/960: rename f2 to d2a/d32/d57/d119/f135 0 2024-04-25T22:03:22.603 INFO:tasks.workunit.client.0.smithi044.stdout:1/661: fsync d3/d7/f23 0 2024-04-25T22:03:22.604 INFO:tasks.workunit.client.0.smithi044.stdout:8/961: chown d2a/d32/d57/d119/f135 522817 1 2024-04-25T22:03:22.604 INFO:tasks.workunit.client.0.smithi044.stdout:1/662: mknod d3/d59/d5c/cd0 0 2024-04-25T22:03:22.605 INFO:tasks.workunit.client.0.smithi044.stdout:2/696: truncate d7/d8/d48/dd9/f17 4680993 0 2024-04-25T22:03:22.606 INFO:tasks.workunit.client.0.smithi044.stdout:3/812: dwrite d0/d13/d6c/f101 [0,4194304] 0 2024-04-25T22:03:22.606 INFO:tasks.workunit.client.0.smithi044.stdout:8/962: creat d2a/d82/db6/f136 x:0 0 0 2024-04-25T22:03:22.608 INFO:tasks.workunit.client.0.smithi044.stdout:8/963: getdents d2a/d39/d42/d80 0 2024-04-25T22:03:22.608 INFO:tasks.workunit.client.0.smithi044.stdout:3/813: getdents d0/d1/d15/d51/dd/d35/dab/db1 0 2024-04-25T22:03:22.609 INFO:tasks.workunit.client.0.smithi044.stdout:8/964: creat d2a/d39/d5a/d92/f137 x:0 0 0 2024-04-25T22:03:22.610 INFO:tasks.workunit.client.0.smithi044.stdout:8/965: readlink d2a/d39/d42/d129/l83 0 2024-04-25T22:03:22.611 INFO:tasks.workunit.client.0.smithi044.stdout:3/814: rename d0/d1/d15/d51/dd/d35 to d0/d1/d15/d81/dd2/d10f 0 2024-04-25T22:03:22.612 INFO:tasks.workunit.client.0.smithi044.stdout:1/663: dwrite d3/d7/db/f3c [0,4194304] 0 2024-04-25T22:03:22.613 INFO:tasks.workunit.client.0.smithi044.stdout:5/816: sync 2024-04-25T22:03:22.614 INFO:tasks.workunit.client.0.smithi044.stdout:9/886: sync 2024-04-25T22:03:22.614 INFO:tasks.workunit.client.0.smithi044.stdout:6/929: sync 2024-04-25T22:03:22.614 INFO:tasks.workunit.client.0.smithi044.stdout:7/610: sync 2024-04-25T22:03:22.614 INFO:tasks.workunit.client.0.smithi044.stdout:3/815: link d0/d13/d1c/c6d d0/d1/d34/d48/c110 0 2024-04-25T22:03:22.615 INFO:tasks.workunit.client.0.smithi044.stdout:2/697: dwrite d7/d8/d1c/f33 [0,4194304] 0 2024-04-25T22:03:22.615 INFO:tasks.workunit.client.0.smithi044.stdout:6/930: symlink d2/l143 0 2024-04-25T22:03:22.615 INFO:tasks.workunit.client.0.smithi044.stdout:5/817: stat d2/d35/ca2 0 2024-04-25T22:03:22.615 INFO:tasks.workunit.client.0.smithi044.stdout:1/664: write d3/d7/f69 [5170510,115143] 0 2024-04-25T22:03:22.616 INFO:tasks.workunit.client.0.smithi044.stdout:1/665: readlink d3/d7/db/l11 0 2024-04-25T22:03:22.617 INFO:tasks.workunit.client.0.smithi044.stdout:3/816: symlink d0/d1/d15/d81/dd2/d10f/dc6/l111 0 2024-04-25T22:03:22.617 INFO:tasks.workunit.client.0.smithi044.stdout:4/682: dread dd/d35/d52/f9e [0,4194304] 0 2024-04-25T22:03:22.618 INFO:tasks.workunit.client.0.smithi044.stdout:5/818: stat d2/d5/d21/d38/dc8/fe6 0 2024-04-25T22:03:22.618 INFO:tasks.workunit.client.0.smithi044.stdout:8/966: write d2a/d39/d42/d68/f11e [713125,30657] 0 2024-04-25T22:03:22.618 INFO:tasks.workunit.client.0.smithi044.stdout:2/698: truncate d7/d7b/d81/d4e/f87 2253182 0 2024-04-25T22:03:22.619 INFO:tasks.workunit.client.0.smithi044.stdout:8/967: mkdir d2a/d39/d5a/d8e/d138 0 2024-04-25T22:03:22.619 INFO:tasks.workunit.client.0.smithi044.stdout:9/887: read d4/d3d/d66/db9/dbe/df5/fe7 [61559,18954] 0 2024-04-25T22:03:22.620 INFO:tasks.workunit.client.0.smithi044.stdout:9/888: dread - d4/d3d/fcc zero size 2024-04-25T22:03:22.622 INFO:tasks.workunit.client.0.smithi044.stdout:6/931: symlink d2/d23/d5a/d12/d27/d8d/d134/dc8/dfa/df2/d123/l144 0 2024-04-25T22:03:22.622 INFO:tasks.workunit.client.0.smithi044.stdout:3/817: rename d0/d13/d1c/d93/da6/dd7/ced to d0/d1/d15/d51/dd/d11/d8a/c112 0 2024-04-25T22:03:22.622 INFO:tasks.workunit.client.0.smithi044.stdout:8/968: mknod d2a/d32/d57/d119/d126/c139 0 2024-04-25T22:03:22.623 INFO:tasks.workunit.client.0.smithi044.stdout:2/699: creat d7/d8/d1c/d77/fe5 x:0 0 0 2024-04-25T22:03:22.623 INFO:tasks.workunit.client.0.smithi044.stdout:9/889: rmdir d4/d4b/d86 39 2024-04-25T22:03:22.623 INFO:tasks.workunit.client.0.smithi044.stdout:6/932: readlink d2/d23/d5a/d11/d2a/la5 0 2024-04-25T22:03:22.625 INFO:tasks.workunit.client.0.smithi044.stdout:9/890: write d4/d7/d18/d3a/f11e [499729,50445] 0 2024-04-25T22:03:22.625 INFO:tasks.workunit.client.0.smithi044.stdout:3/818: write d0/d1/d15/d51/d8e/d74/fb8 [2870821,56123] 0 2024-04-25T22:03:22.626 INFO:tasks.workunit.client.0.smithi044.stdout:2/700: creat d7/d8/d48/dd9/d4b/dc1/de1/fe6 x:0 0 0 2024-04-25T22:03:22.626 INFO:tasks.workunit.client.0.smithi044.stdout:5/819: dwrite d2/d5/d21/d26/d2c/f4c [0,4194304] 0 2024-04-25T22:03:22.627 INFO:tasks.workunit.client.0.smithi044.stdout:9/891: chown d4/d7/d79/ddc/de1/l67 3457118 1 2024-04-25T22:03:22.627 INFO:tasks.workunit.client.0.smithi044.stdout:3/819: symlink d0/d1/d15/d51/d8e/d74/l113 0 2024-04-25T22:03:22.627 INFO:tasks.workunit.client.0.smithi044.stdout:8/969: truncate d2a/d39/d42/d68/d6b/f64 3210920 0 2024-04-25T22:03:22.628 INFO:tasks.workunit.client.0.smithi044.stdout:9/892: fsync d4/d7/d79/fc0 0 2024-04-25T22:03:22.629 INFO:tasks.workunit.client.0.smithi044.stdout:5/820: rename d2/d35/f3f to d2/d5/d6a/f104 0 2024-04-25T22:03:22.629 INFO:tasks.workunit.client.0.smithi044.stdout:3/820: unlink d0/d70/d7c/ca2 0 2024-04-25T22:03:22.630 INFO:tasks.workunit.client.0.smithi044.stdout:5/821: mkdir d2/d5/d21/d38/d52/d56/d105 0 2024-04-25T22:03:22.631 INFO:tasks.workunit.client.0.smithi044.stdout:5/822: symlink d2/d5/d21/d38/l106 0 2024-04-25T22:03:22.632 INFO:tasks.workunit.client.0.smithi044.stdout:5/823: chown d2/f3c 990736 1 2024-04-25T22:03:22.634 INFO:tasks.workunit.client.0.smithi044.stdout:0/725: dread d8/df/d17/d45/d95/d51/d8b/f97 [0,4194304] 0 2024-04-25T22:03:22.635 INFO:tasks.workunit.client.0.smithi044.stdout:4/683: dwrite dd/d35/f37 [0,4194304] 0 2024-04-25T22:03:22.635 INFO:tasks.workunit.client.0.smithi044.stdout:1/666: truncate d3/d7/db/f1d 6750062 0 2024-04-25T22:03:22.636 INFO:tasks.workunit.client.0.smithi044.stdout:5/824: rename d2/d5/d27/dd5 to d2/d5/d21/d38/d52/d56/d105/d107 0 2024-04-25T22:03:22.636 INFO:tasks.workunit.client.0.smithi044.stdout:0/726: chown d8/df/d17/db9/l7e 29723 1 2024-04-25T22:03:22.637 INFO:tasks.workunit.client.0.smithi044.stdout:9/893: dread d4/d7/d79/ddc/de1/f114 [0,4194304] 0 2024-04-25T22:03:22.637 INFO:tasks.workunit.client.0.smithi044.stdout:3/821: dwrite d0/d1/d15/d23/d60/f9b [0,4194304] 0 2024-04-25T22:03:22.638 INFO:tasks.workunit.client.0.smithi044.stdout:5/825: write d2/d5/d21/d26/d2c/f78 [461433,104992] 0 2024-04-25T22:03:22.638 INFO:tasks.workunit.client.0.smithi044.stdout:8/970: write d2a/d32/d3e/fed [72452,75321] 0 2024-04-25T22:03:22.639 INFO:tasks.workunit.client.0.smithi044.stdout:9/894: read d4/d7/d18/d3a/ffe [250967,49942] 0 2024-04-25T22:03:22.639 INFO:tasks.workunit.client.0.smithi044.stdout:2/701: dread d7/d8/f3e [4194304,4194304] 0 2024-04-25T22:03:22.641 INFO:tasks.workunit.client.0.smithi044.stdout:3/822: symlink d0/d13/l114 0 2024-04-25T22:03:22.641 INFO:tasks.workunit.client.0.smithi044.stdout:5/826: rmdir d2/d5/d21/d6b/d9b 39 2024-04-25T22:03:22.641 INFO:tasks.workunit.client.0.smithi044.stdout:0/727: link d8/df/d17/f33 d8/df/d17/d87/ff6 0 2024-04-25T22:03:22.642 INFO:tasks.workunit.client.0.smithi044.stdout:9/895: dread - d4/d4b/d86/f107 zero size 2024-04-25T22:03:22.642 INFO:tasks.workunit.client.0.smithi044.stdout:2/702: creat d7/d7b/d81/d4e/d86/fe7 x:0 0 0 2024-04-25T22:03:22.643 INFO:tasks.workunit.client.0.smithi044.stdout:0/728: fsync d8/df/d17/d45/d95/fc7 0 2024-04-25T22:03:22.643 INFO:tasks.workunit.client.0.smithi044.stdout:5/827: stat d2/d5/d27/d2a/la1 0 2024-04-25T22:03:22.644 INFO:tasks.workunit.client.0.smithi044.stdout:9/896: fsync d4/d7/d79/ddc/de1/f119 0 2024-04-25T22:03:22.644 INFO:tasks.workunit.client.0.smithi044.stdout:3/823: creat d0/d1/d15/d51/d8e/d74/de4/f115 x:0 0 0 2024-04-25T22:03:22.644 INFO:tasks.workunit.client.0.smithi044.stdout:2/703: symlink d7/le8 0 2024-04-25T22:03:22.644 INFO:tasks.workunit.client.0.smithi044.stdout:0/729: write d8/da/f61 [1436627,42030] 0 2024-04-25T22:03:22.644 INFO:tasks.workunit.client.0.smithi044.stdout:2/704: read - d7/d7b/fdc zero size 2024-04-25T22:03:22.644 INFO:tasks.workunit.client.0.smithi044.stdout:5/828: mkdir d2/dad/df2/d108 0 2024-04-25T22:03:22.645 INFO:tasks.workunit.client.0.smithi044.stdout:3/824: rmdir d0/d13/d1c/d93 39 2024-04-25T22:03:22.646 INFO:tasks.workunit.client.0.smithi044.stdout:2/705: write d7/d8/fe3 [802874,129480] 0 2024-04-25T22:03:22.646 INFO:tasks.workunit.client.0.smithi044.stdout:4/684: dwrite dd/d19/f1d [0,4194304] 0 2024-04-25T22:03:22.647 INFO:tasks.workunit.client.0.smithi044.stdout:0/730: truncate d8/f9 466690 0 2024-04-25T22:03:22.647 INFO:tasks.workunit.client.0.smithi044.stdout:5/829: mknod d2/d5/d21/d38/dc8/c109 0 2024-04-25T22:03:22.647 INFO:tasks.workunit.client.0.smithi044.stdout:3/825: mkdir d0/d70/d7c/da9/dc0/d116 0 2024-04-25T22:03:22.647 INFO:tasks.workunit.client.0.smithi044.stdout:4/685: fdatasync dd/d19/f32 0 2024-04-25T22:03:22.647 INFO:tasks.workunit.client.0.smithi044.stdout:5/830: dread - d2/d5/d6a/fdd zero size 2024-04-25T22:03:22.648 INFO:tasks.workunit.client.0.smithi044.stdout:0/731: chown d8/df/d17/d45/d95/d9c/dcc/l9e 913 1 2024-04-25T22:03:22.648 INFO:tasks.workunit.client.0.smithi044.stdout:3/826: write d0/d1/d15/d51/dd/d11/d42/fe8 [4680796,40774] 0 2024-04-25T22:03:22.649 INFO:tasks.workunit.client.0.smithi044.stdout:2/706: rename d7/d8/d1c/d77/fe5 to d7/d8/d48/dd9/d4b/dc1/de1/fe9 0 2024-04-25T22:03:22.649 INFO:tasks.workunit.client.0.smithi044.stdout:2/707: read - d7/d8/fca zero size 2024-04-25T22:03:22.650 INFO:tasks.workunit.client.0.smithi044.stdout:0/732: dread - d8/da/d60/daa/dbe/fd3 zero size 2024-04-25T22:03:22.650 INFO:tasks.workunit.client.0.smithi044.stdout:4/686: link dd/d35/d52/d61/c75 dd/d19/daf/cdd 0 2024-04-25T22:03:22.650 INFO:tasks.workunit.client.0.smithi044.stdout:5/831: truncate d2/d5/d27/d2a/d48/ff8 576035 0 2024-04-25T22:03:22.651 INFO:tasks.workunit.client.0.smithi044.stdout:3/827: getdents d0/d1/d34/d95/dd9 0 2024-04-25T22:03:22.651 INFO:tasks.workunit.client.0.smithi044.stdout:2/708: read - d7/d8/d48/fe0 zero size 2024-04-25T22:03:22.652 INFO:tasks.workunit.client.0.smithi044.stdout:9/897: dwrite d4/d7/d79/ddc/de1/d54/d84/d64/f9e [4194304,4194304] 0 2024-04-25T22:03:22.652 INFO:tasks.workunit.client.0.smithi044.stdout:5/832: creat d2/d5/d6a/df3/f10a x:0 0 0 2024-04-25T22:03:22.652 INFO:tasks.workunit.client.0.smithi044.stdout:0/733: write d8/df/d17/d45/d95/d51/d8b/d90/fe6 [1191775,52360] 0 2024-04-25T22:03:22.653 INFO:tasks.workunit.client.0.smithi044.stdout:5/833: mkdir d2/d5b/da8/d10b 0 2024-04-25T22:03:22.654 INFO:tasks.workunit.client.0.smithi044.stdout:5/834: mknod d2/d5/d27/d2a/db5/c10c 0 2024-04-25T22:03:22.656 INFO:tasks.workunit.client.0.smithi044.stdout:6/933: dread d2/d23/d5a/d12/d27/daf/dcb/d5e/d9c/fd4 [0,4194304] 0 2024-04-25T22:03:22.660 INFO:tasks.workunit.client.0.smithi044.stdout:7/611: dread d1c/d22/d28/d4e/d7b/d59/f91 [0,4194304] 0 2024-04-25T22:03:22.660 INFO:tasks.workunit.client.0.smithi044.stdout:3/828: dwrite d0/d1/fcd [0,4194304] 0 2024-04-25T22:03:22.661 INFO:tasks.workunit.client.0.smithi044.stdout:6/934: chown d2/d23/d5a/d12/d27/d8d/d134/dc8/dfa/dd7/f12d 26830247 1 2024-04-25T22:03:22.661 INFO:tasks.workunit.client.0.smithi044.stdout:2/709: dwrite d7/d8/d48/dd9/d2c/d75/f9f [0,4194304] 0 2024-04-25T22:03:22.661 INFO:tasks.workunit.client.0.smithi044.stdout:9/898: dwrite d4/d7/d79/f10e [0,4194304] 0 2024-04-25T22:03:22.664 INFO:tasks.workunit.client.0.smithi044.stdout:1/667: truncate d3/d7/db/f1d 7264122 0 2024-04-25T22:03:22.664 INFO:tasks.workunit.client.0.smithi044.stdout:7/612: rename f15 to d1c/d22/d28/d30/d32/d5d/fb6 0 2024-04-25T22:03:22.664 INFO:tasks.workunit.client.0.smithi044.stdout:2/710: rename d7/d7b/d81/d4e/c10 to d7/d7b/d81/d4e/cea 0 2024-04-25T22:03:22.665 INFO:tasks.workunit.client.0.smithi044.stdout:6/935: unlink d2/d23/d5a/d12/d27/d8d/d134/dc8/dfa/df2/d123/d63/l11a 0 2024-04-25T22:03:22.665 INFO:tasks.workunit.client.0.smithi044.stdout:3/829: write d0/d1/d79/f83 [380103,34975] 0 2024-04-25T22:03:22.665 INFO:tasks.workunit.client.0.smithi044.stdout:7/613: unlink d1c/d22/f25 0 2024-04-25T22:03:22.667 INFO:tasks.workunit.client.0.smithi044.stdout:2/711: mkdir d7/d7b/d81/d4e/deb 0 2024-04-25T22:03:22.668 INFO:tasks.workunit.client.0.smithi044.stdout:1/668: truncate d3/d30/d3f/f86 1606364 0 2024-04-25T22:03:22.668 INFO:tasks.workunit.client.0.smithi044.stdout:7/614: creat d1c/d22/d28/d30/d32/d97/fb7 x:0 0 0 2024-04-25T22:03:22.668 INFO:tasks.workunit.client.0.smithi044.stdout:5/835: truncate d2/d5/d21/d26/d2c/d37/f4d 75487 0 2024-04-25T22:03:22.669 INFO:tasks.workunit.client.0.smithi044.stdout:2/712: dread - d7/d7b/d81/d4e/d86/fe7 zero size 2024-04-25T22:03:22.669 INFO:tasks.workunit.client.0.smithi044.stdout:3/830: symlink d0/d13/d1c/d93/da6/dd7/l117 0 2024-04-25T22:03:22.670 INFO:tasks.workunit.client.0.smithi044.stdout:5/836: chown d2/d5/d27/d2a/d3a 3 1 2024-04-25T22:03:22.670 INFO:tasks.workunit.client.0.smithi044.stdout:7/615: write d1c/d22/d28/f41 [696275,55874] 0 2024-04-25T22:03:22.670 INFO:tasks.workunit.client.0.smithi044.stdout:9/899: dwrite d4/d7/d18/d3a/f11e [0,4194304] 0 2024-04-25T22:03:22.672 INFO:tasks.workunit.client.0.smithi044.stdout:5/837: rmdir d2/d5/d21/d26/d2c/d37/dbb 39 2024-04-25T22:03:22.672 INFO:tasks.workunit.client.0.smithi044.stdout:3/831: truncate d0/d13/f37 446911 0 2024-04-25T22:03:22.672 INFO:tasks.workunit.client.0.smithi044.stdout:7/616: mknod d1c/d22/d28/d30/cb8 0 2024-04-25T22:03:22.673 INFO:tasks.workunit.client.0.smithi044.stdout:2/713: dread d7/d8/d48/dd9/f54 [0,4194304] 0 2024-04-25T22:03:22.674 INFO:tasks.workunit.client.0.smithi044.stdout:5/838: symlink d2/dad/df2/l10d 0 2024-04-25T22:03:22.674 INFO:tasks.workunit.client.0.smithi044.stdout:7/617: write fa [837407,57850] 0 2024-04-25T22:03:22.674 INFO:tasks.workunit.client.0.smithi044.stdout:6/936: dwrite d2/d23/d5a/d12/d27/daf/dcb/d5e/db5/f119 [0,4194304] 0 2024-04-25T22:03:22.674 INFO:tasks.workunit.client.0.smithi044.stdout:3/832: write d0/d1/d15/d51/d8e/d74/f90 [9030549,112506] 0 2024-04-25T22:03:22.675 INFO:tasks.workunit.client.0.smithi044.stdout:7/618: chown cc 2748567 1 2024-04-25T22:03:22.676 INFO:tasks.workunit.client.0.smithi044.stdout:2/714: mkdir d7/d8/d1c/d77/dce/dd4/dec 0 2024-04-25T22:03:22.676 INFO:tasks.workunit.client.0.smithi044.stdout:3/833: mknod d0/d13/d1c/d93/d108/c118 0 2024-04-25T22:03:22.676 INFO:tasks.workunit.client.0.smithi044.stdout:5/839: mkdir d2/d5/d21/d6b/d9b/d10e 0 2024-04-25T22:03:22.678 INFO:tasks.workunit.client.0.smithi044.stdout:5/840: truncate d2/d5/d6a/df3/f10a 994873 0 2024-04-25T22:03:22.679 INFO:tasks.workunit.client.0.smithi044.stdout:3/834: chown d0/d1/d15/d81/dd2/d10f/dc6 1 1 2024-04-25T22:03:22.680 INFO:tasks.workunit.client.0.smithi044.stdout:5/841: write d2/d5/d21/d95/ff6 [1631063,72450] 0 2024-04-25T22:03:22.681 INFO:tasks.workunit.client.0.smithi044.stdout:9/900: truncate d4/d7/d79/ddc/de1/d54/d84/d64/f82 4171879 0 2024-04-25T22:03:22.681 INFO:tasks.workunit.client.0.smithi044.stdout:3/835: rmdir d0/d13/d1c/d93/def 0 2024-04-25T22:03:22.684 INFO:tasks.workunit.client.0.smithi044.stdout:3/836: fsync d0/d70/d7c/da9/fc9 0 2024-04-25T22:03:22.685 INFO:tasks.workunit.client.0.smithi044.stdout:2/715: dwrite d7/d8/d48/dd9/d2c/d50/f90 [0,4194304] 0 2024-04-25T22:03:22.686 INFO:tasks.workunit.client.0.smithi044.stdout:7/619: dwrite d1c/d22/d28/d30/f46 [0,4194304] 0 2024-04-25T22:03:22.686 INFO:tasks.workunit.client.0.smithi044.stdout:3/837: mknod d0/d1/d15/d23/c119 0 2024-04-25T22:03:22.689 INFO:tasks.workunit.client.0.smithi044.stdout:7/620: mknod d1c/d22/d28/d4e/d7b/cb9 0 2024-04-25T22:03:22.690 INFO:tasks.workunit.client.0.smithi044.stdout:9/901: dwrite d4/f7f [0,4194304] 0 2024-04-25T22:03:22.691 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:22.688+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:22.691 INFO:tasks.workunit.client.0.smithi044.stdout:7/621: creat d1c/d22/d28/d30/fba x:0 0 0 2024-04-25T22:03:22.692 INFO:tasks.workunit.client.0.smithi044.stdout:9/902: getdents d4/d7/d79/ddc/de1/d54/d84/d72/d97/df3/d10b 0 2024-04-25T22:03:22.693 INFO:tasks.workunit.client.0.smithi044.stdout:7/622: link d1c/d22/d28/l6c d1c/d22/d28/d30/d32/lbb 0 2024-04-25T22:03:22.694 INFO:tasks.workunit.client.0.smithi044.stdout:5/842: dread d2/d5/d27/d2a/d3a/fa6 [0,4194304] 0 2024-04-25T22:03:22.694 INFO:tasks.workunit.client.0.smithi044.stdout:0/734: dread d8/df/d17/d45/d95/f42 [0,4194304] 0 2024-04-25T22:03:22.695 INFO:tasks.workunit.client.0.smithi044.stdout:9/903: creat d4/d7/d79/ddc/de1/d54/d84/d72/d113/f12b x:0 0 0 2024-04-25T22:03:22.696 INFO:tasks.workunit.client.0.smithi044.stdout:2/716: dwrite d7/d8/d1c/d77/fa6 [0,4194304] 0 2024-04-25T22:03:22.696 INFO:tasks.workunit.client.0.smithi044.stdout:0/735: write d8/df/d17/d45/d95/d51/f71 [1127056,130303] 0 2024-04-25T22:03:22.697 INFO:tasks.workunit.client.0.smithi044.stdout:9/904: write d4/d7/d79/ddc/de1/d54/d84/d72/d113/d128/dd2/df7/fff [3126146,74692] 0 2024-04-25T22:03:22.698 INFO:tasks.workunit.client.0.smithi044.stdout:0/736: creat d8/d78/db8/ff7 x:0 0 0 2024-04-25T22:03:22.698 INFO:tasks.workunit.client.0.smithi044.stdout:2/717: readlink d7/d8/d48/dd9/d4b/laa 0 2024-04-25T22:03:22.699 INFO:tasks.workunit.client.0.smithi044.stdout:9/905: mkdir d4/d3d/d66/db9/dbe/dce/d12c 0 2024-04-25T22:03:22.699 INFO:tasks.workunit.client.0.smithi044.stdout:0/737: mknod d8/da/cf8 0 2024-04-25T22:03:22.700 INFO:tasks.workunit.client.0.smithi044.stdout:0/738: write d8/fbf [510428,24840] 0 2024-04-25T22:03:22.702 INFO:tasks.workunit.client.0.smithi044.stdout:0/739: write d8/d20/f5a [4134794,51304] 0 2024-04-25T22:03:22.702 INFO:tasks.workunit.client.0.smithi044.stdout:9/906: truncate d4/d3d/d66/db9/dbe/df5/fe2 1237231 0 2024-04-25T22:03:22.702 INFO:tasks.workunit.client.0.smithi044.stdout:5/843: dwrite d2/d5/d21/d26/d2c/ff5 [0,4194304] 0 2024-04-25T22:03:22.707 INFO:tasks.workunit.client.0.smithi044.stdout:9/907: write d4/d7/d79/ddc/de1/f11f [2944720,112662] 0 2024-04-25T22:03:22.707 INFO:tasks.workunit.client.0.smithi044.stdout:1/669: dread d3/f4a [0,4194304] 0 2024-04-25T22:03:22.707 INFO:tasks.workunit.client.0.smithi044.stdout:0/740: rename d8/df/d17/d45/d95/d51/d8b/lee to d8/df/d93/lf9 0 2024-04-25T22:03:22.707 INFO:tasks.workunit.client.0.smithi044.stdout:5/844: read d2/d5/d21/d38/d52/fbe [808286,99517] 0 2024-04-25T22:03:22.707 INFO:tasks.workunit.client.0.smithi044.stdout:5/845: readlink d2/d5b/l99 0 2024-04-25T22:03:22.707 INFO:tasks.workunit.client.0.smithi044.stdout:0/741: mkdir d8/d78/db8/dfa 0 2024-04-25T22:03:22.707 INFO:tasks.workunit.client.0.smithi044.stdout:9/908: unlink d4/d7/d18/d2d/f62 0 2024-04-25T22:03:22.707 INFO:tasks.workunit.client.0.smithi044.stdout:1/670: read d3/d7/db/f3c [5978088,47977] 0 2024-04-25T22:03:22.708 INFO:tasks.workunit.client.0.smithi044.stdout:6/937: dread d2/d23/d5a/d12/d49/f13b [0,4194304] 0 2024-04-25T22:03:22.708 INFO:tasks.workunit.client.0.smithi044.stdout:1/671: fdatasync d3/d7/db/d5d/d7f/fa4 0 2024-04-25T22:03:22.708 INFO:tasks.workunit.client.0.smithi044.stdout:0/742: mknod d8/da/d60/d86/cfb 0 2024-04-25T22:03:22.708 INFO:tasks.workunit.client.0.smithi044.stdout:5/846: rename d2/d5/d27/d2a/db5 to d2/d5b/d8e/d10f 0 2024-04-25T22:03:22.709 INFO:tasks.workunit.client.0.smithi044.stdout:0/743: write d8/f2b [2363020,61201] 0 2024-04-25T22:03:22.709 INFO:tasks.workunit.client.0.smithi044.stdout:5/847: unlink d2/d5/d21/d26/d2c/ff5 0 2024-04-25T22:03:22.710 INFO:tasks.workunit.client.0.smithi044.stdout:9/909: rename d4/d4b/d86/f99 to d4/d7/d79/ddc/de1/d54/d84/d72/d113/d128/dd2/df7/f12d 0 2024-04-25T22:03:22.710 INFO:tasks.workunit.client.0.smithi044.stdout:0/744: chown d8/df/d17/d45/laf 1 1 2024-04-25T22:03:22.711 INFO:tasks.workunit.client.0.smithi044.stdout:9/910: mkdir d4/d3d/d66/db9/d12e 0 2024-04-25T22:03:22.711 INFO:tasks.workunit.client.0.smithi044.stdout:5/848: link d2/d5/d6a/f6e d2/d5/d21/d26/f110 0 2024-04-25T22:03:22.711 INFO:tasks.workunit.client.0.smithi044.stdout:9/911: write d4/d3d/f9c [1005168,97115] 0 2024-04-25T22:03:22.712 INFO:tasks.workunit.client.0.smithi044.stdout:0/745: link d8/df/d17/db9/lae d8/df/d17/d45/d95/d51/d8b/db0/lfc 0 2024-04-25T22:03:22.712 INFO:tasks.workunit.client.0.smithi044.stdout:5/849: creat d2/d5/d21/d26/d2c/f111 x:0 0 0 2024-04-25T22:03:22.712 INFO:tasks.workunit.client.0.smithi044.stdout:0/746: chown d8/fbf 1362517228 1 2024-04-25T22:03:22.714 INFO:tasks.workunit.client.0.smithi044.stdout:9/912: getdents d4/d3d/d66/d93 0 2024-04-25T22:03:22.714 INFO:tasks.workunit.client.0.smithi044.stdout:5/850: read - d2/d5/d27/d2a/d5c/dec/ff7 zero size 2024-04-25T22:03:22.714 INFO:tasks.workunit.client.0.smithi044.stdout:1/672: read d3/d7/f2f [2684486,17233] 0 2024-04-25T22:03:22.714 INFO:tasks.workunit.client.0.smithi044.stdout:1/673: stat d3/d54 0 2024-04-25T22:03:22.714 INFO:tasks.workunit.client.0.smithi044.stdout:0/747: mknod d8/df/d17/d45/d95/d51/dc2/cfd 0 2024-04-25T22:03:22.715 INFO:tasks.workunit.client.0.smithi044.stdout:9/913: stat d4/d7/d18/d2e/d73/f7c 0 2024-04-25T22:03:22.715 INFO:tasks.workunit.client.0.smithi044.stdout:2/718: dread d7/d7b/d81/d4e/f59 [0,4194304] 0 2024-04-25T22:03:22.715 INFO:tasks.workunit.client.0.smithi044.stdout:5/851: write d2/d5/d27/d2a/d48/ff8 [422008,59463] 0 2024-04-25T22:03:22.716 INFO:tasks.workunit.client.0.smithi044.stdout:6/938: dwrite d2/d23/d5a/d12/d27/daf/dcb/d5e/d9c/fd4 [0,4194304] 0 2024-04-25T22:03:22.716 INFO:tasks.workunit.client.0.smithi044.stdout:5/852: readlink d2/d35/l85 0 2024-04-25T22:03:22.718 INFO:tasks.workunit.client.0.smithi044.stdout:9/914: write d4/d7/d18/d2e/d73/fb8 [1235110,72030] 0 2024-04-25T22:03:22.718 INFO:tasks.workunit.client.0.smithi044.stdout:2/719: write d7/d7b/d81/d4e/d86/d6b/d78/f56 [984023,36347] 0 2024-04-25T22:03:22.720 INFO:tasks.workunit.client.0.smithi044.stdout:9/915: fsync d4/d3d/d66/db9/dbe/ffc 0 2024-04-25T22:03:22.721 INFO:tasks.workunit.client.0.smithi044.stdout:8/971: sync 2024-04-25T22:03:22.721 INFO:tasks.workunit.client.0.smithi044.stdout:4/687: sync 2024-04-25T22:03:22.722 INFO:tasks.workunit.client.0.smithi044.stdout:9/916: unlink d4/d3d/d66/db9/dbe/df5/dd3/dd4/fe4 0 2024-04-25T22:03:22.723 INFO:tasks.workunit.client.0.smithi044.stdout:8/972: creat d2a/d39/f13a x:0 0 0 2024-04-25T22:03:22.723 INFO:tasks.workunit.client.0.smithi044.stdout:7/623: dwrite d1c/d22/d28/f3d [0,4194304] 0 2024-04-25T22:03:22.724 INFO:tasks.workunit.client.0.smithi044.stdout:1/674: dread d3/d30/d3f/f68 [0,4194304] 0 2024-04-25T22:03:22.726 INFO:tasks.workunit.client.0.smithi044.stdout:1/675: chown d3/d7/d29/d43 3729717 1 2024-04-25T22:03:22.726 INFO:tasks.workunit.client.0.smithi044.stdout:9/917: mknod d4/d3d/d66/db9/dbe/df5/dd3/dd4/c12f 0 2024-04-25T22:03:22.727 INFO:tasks.workunit.client.0.smithi044.stdout:6/939: dwrite d2/d23/d5a/d11/d2a/f61 [4194304,4194304] 0 2024-04-25T22:03:22.728 INFO:tasks.workunit.client.0.smithi044.stdout:1/676: write d3/d72/f8b [654380,111929] 0 2024-04-25T22:03:22.729 INFO:tasks.workunit.client.0.smithi044.stdout:2/720: dwrite d7/d8/d48/dd9/d4b/dc1/de1/fe6 [0,4194304] 0 2024-04-25T22:03:22.730 INFO:tasks.workunit.client.0.smithi044.stdout:1/677: creat d3/d4b/fd1 x:0 0 0 2024-04-25T22:03:22.731 INFO:tasks.workunit.client.0.smithi044.stdout:1/678: rmdir d3/d7/db/d5d/d7f 39 2024-04-25T22:03:22.732 INFO:tasks.workunit.client.0.smithi044.stdout:7/624: dwrite d1c/d22/d28/d57/f5a [0,4194304] 0 2024-04-25T22:03:22.733 INFO:tasks.workunit.client.0.smithi044.stdout:7/625: write d1c/d22/f71 [452799,64853] 0 2024-04-25T22:03:22.734 INFO:tasks.workunit.client.0.smithi044.stdout:2/721: rename d7/d8/d1c/d77/dce to d7/d7b/d81/d4e/d86/d6b/dd8/ded 0 2024-04-25T22:03:22.735 INFO:tasks.workunit.client.0.smithi044.stdout:0/748: truncate d8/df/f54 1218234 0 2024-04-25T22:03:22.736 INFO:tasks.workunit.client.0.smithi044.stdout:0/749: dread - d8/db2/fe5 zero size 2024-04-25T22:03:22.736 INFO:tasks.workunit.client.0.smithi044.stdout:7/626: link d1c/d22/d28/d30/d32/d97/fb2 d1c/d22/d28/d30/d32/d97/fbc 0 2024-04-25T22:03:22.736 INFO:tasks.workunit.client.0.smithi044.stdout:2/722: creat d7/d8/d48/dd9/d4b/fee x:0 0 0 2024-04-25T22:03:22.737 INFO:tasks.workunit.client.0.smithi044.stdout:7/627: mknod d1c/d88/d8f/d9c/cbd 0 2024-04-25T22:03:22.737 INFO:tasks.workunit.client.0.smithi044.stdout:0/750: truncate d8/fca 1167813 0 2024-04-25T22:03:22.737 INFO:tasks.workunit.client.0.smithi044.stdout:2/723: mkdir d7/d7b/d81/d4e/d86/d6b/d78/d44/dad/def 0 2024-04-25T22:03:22.739 INFO:tasks.workunit.client.0.smithi044.stdout:1/679: dwrite d3/f4a [0,4194304] 0 2024-04-25T22:03:22.739 INFO:tasks.workunit.client.0.smithi044.stdout:2/724: symlink d7/lf0 0 2024-04-25T22:03:22.740 INFO:tasks.workunit.client.0.smithi044.stdout:2/725: creat d7/d8/d48/dd9/d2c/d50/ff1 x:0 0 0 2024-04-25T22:03:22.740 INFO:tasks.workunit.client.0.smithi044.stdout:1/680: truncate d3/d59/d5c/f62 994892 0 2024-04-25T22:03:22.740 INFO:tasks.workunit.client.0.smithi044.stdout:2/726: rmdir d7/d8/d48/dd9/d2c/d50 39 2024-04-25T22:03:22.741 INFO:tasks.workunit.client.0.smithi044.stdout:2/727: readlink d7/d8/d48/db2/lb7 0 2024-04-25T22:03:22.742 INFO:tasks.workunit.client.0.smithi044.stdout:2/728: dread - d7/d7b/d81/d4e/f8c zero size 2024-04-25T22:03:22.744 INFO:tasks.workunit.client.0.smithi044.stdout:2/729: chown d7/d7b/d81/d4e/d86/d6b/fa2 28720813 1 2024-04-25T22:03:22.744 INFO:tasks.workunit.client.0.smithi044.stdout:2/730: write d7/d8/d48/db2/fd5 [2805190,73275] 0 2024-04-25T22:03:22.745 INFO:tasks.workunit.client.0.smithi044.stdout:2/731: mkdir d7/d8/d48/dd9/d2c/df2 0 2024-04-25T22:03:22.746 INFO:tasks.workunit.client.0.smithi044.stdout:2/732: fsync d7/d8/d48/dd9/d4b/f72 0 2024-04-25T22:03:22.747 INFO:tasks.workunit.client.0.smithi044.stdout:2/733: rename d7/d8/de2/fd1 to d7/ff3 0 2024-04-25T22:03:22.748 INFO:tasks.workunit.client.0.smithi044.stdout:2/734: getdents d7/d8/d48/dd9 0 2024-04-25T22:03:22.749 INFO:tasks.workunit.client.0.smithi044.stdout:5/853: write d2/d5/d21/d26/d2c/d37/fb4 [3213354,120970] 0 2024-04-25T22:03:22.755 INFO:tasks.workunit.client.0.smithi044.stdout:5/854: dwrite d2/d5/faa [8388608,4194304] 0 2024-04-25T22:03:22.756 INFO:tasks.workunit.client.0.smithi044.stdout:5/855: mkdir d2/d5/d27/d2a/d5c/d112 0 2024-04-25T22:03:22.756 INFO:tasks.workunit.client.0.smithi044.stdout:2/735: read d7/d7b/d81/d4e/d86/d6b/d78/d44/f8d [94626,122749] 0 2024-04-25T22:03:22.758 INFO:tasks.workunit.client.0.smithi044.stdout:2/736: chown d7/d8/de2 9839874 1 2024-04-25T22:03:22.758 INFO:tasks.workunit.client.0.smithi044.stdout:5/856: getdents d2/d5/d21/d38/d52/d101 0 2024-04-25T22:03:22.758 INFO:tasks.workunit.client.0.smithi044.stdout:2/737: mkdir d7/d8/d48/df4 0 2024-04-25T22:03:22.758 INFO:tasks.workunit.client.0.smithi044.stdout:5/857: symlink d2/d5b/d8e/d10f/dde/de0/l113 0 2024-04-25T22:03:22.759 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(4.25 epoch 67/16 rep_tid 5912 entries 67'184 (0'0) error 4:a74e9ef3:::10000003554.00000000:head by mds.0.3:2454 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 67'181)", 2024-04-25T22:03:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.741999+0000", 2024-04-25T22:03:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.015227317000000001, 2024-04-25T22:03:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015268492, 2024-04-25T22:03:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.741999+0000", 2024-04-25T22:03:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.741999+0000", 2024-04-25T22:03:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.741999+0000", 2024-04-25T22:03:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.34e-07 2024-04-25T22:03:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.742007+0000", 2024-04-25T22:03:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2689999999999999e-06 2024-04-25T22:03:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.742036+0000", 2024-04-25T22:03:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8838000000000001e-05 2024-04-25T22:03:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.742059+0000", 2024-04-25T22:03:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3096999999999999e-05 2024-04-25T22:03:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.744492+0000", 2024-04-25T22:03:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002433073 2024-04-25T22:03:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:14442 4.27 e67/49 4:e5396b5c:::100000032d5.00000000:head v 67'200, mlcod=67'198)", 2024-04-25T22:03:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.745327+0000", 2024-04-25T22:03:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011898827000000001, 2024-04-25T22:03:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012000165, 2024-04-25T22:03:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.745327+0000", 2024-04-25T22:03:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.745327+0000", 2024-04-25T22:03:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.745328+0000", 2024-04-25T22:03:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0999999999999997e-07 2024-04-25T22:03:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.749522+0000", 2024-04-25T22:03:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041943919999999999 2024-04-25T22:03:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.749533+0000", 2024-04-25T22:03:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0591000000000001e-05 2024-04-25T22:03:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.749540+0000", 2024-04-25T22:03:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.25e-06 2024-04-25T22:03:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.749588+0000", 2024-04-25T22:03:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7772000000000003e-05 2024-04-25T22:03:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.749608+0000", 2024-04-25T22:03:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0355000000000001e-05 2024-04-25T22:03:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:14400 4.7 e67/16 4:e102bf81:::1000000359e.00000000:head v 67'192, mlcod=67'189)", 2024-04-25T22:03:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.724042+0000", 2024-04-25T22:03:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.033183381999999997, 2024-04-25T22:03:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.033348306000000001, 2024-04-25T22:03:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.724042+0000", 2024-04-25T22:03:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.724042+0000", 2024-04-25T22:03:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.724044+0000", 2024-04-25T22:03:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0720000000000001e-06 2024-04-25T22:03:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.728290+0000", 2024-04-25T22:03:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004246433 2024-04-25T22:03:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.728303+0000", 2024-04-25T22:03:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.293e-05 2024-04-25T22:03:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.728310+0000", 2024-04-25T22:03:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1470000000000004e-06 2024-04-25T22:03:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.731397+0000", 2024-04-25T22:03:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030872909999999998 2024-04-25T22:03:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.731420+0000", 2024-04-25T22:03:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3125999999999998e-05 2024-04-25T22:03:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(4.1c epoch 67/49 rep_tid 8086 entries 67'192 (0'0) error 4:3bf60182:::10000003409.00000000:head by mds.0.3:2445 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 67'188)", 2024-04-25T22:03:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.750976+0000", 2024-04-25T22:03:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0062496879999999998, 2024-04-25T22:03:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0064857939999999996, 2024-04-25T22:03:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.750976+0000", 2024-04-25T22:03:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.750976+0000", 2024-04-25T22:03:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.750977+0000", 2024-04-25T22:03:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5300000000000004e-07 2024-04-25T22:03:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.750983+0000", 2024-04-25T22:03:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6880000000000002e-06 2024-04-25T22:03:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.750997+0000", 2024-04-25T22:03:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4061e-05 2024-04-25T22:03:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.751011+0000", 2024-04-25T22:03:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3157e-05 2024-04-25T22:03:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:14435 4.36 e67/49 4:6c273be3:::1000000385e.00000000:head v 67'182, mlcod=67'180)", 2024-04-25T22:03:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.751395+0000", 2024-04-25T22:03:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0058305420000000002, 2024-04-25T22:03:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061170560000000001, 2024-04-25T22:03:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.751395+0000", 2024-04-25T22:03:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.751395+0000", 2024-04-25T22:03:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.751396+0000", 2024-04-25T22:03:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.54e-07 2024-04-25T22:03:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.756032+0000", 2024-04-25T22:03:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046361140000000002 2024-04-25T22:03:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.756049+0000", 2024-04-25T22:03:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7314000000000001e-05 2024-04-25T22:03:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.756063+0000", 2024-04-25T22:03:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3485999999999999e-05 2024-04-25T22:03:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.756225+0000", 2024-04-25T22:03:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000162289 2024-04-25T22:03:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.756249+0000", 2024-04-25T22:03:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3883000000000002e-05 2024-04-25T22:03:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:2460 3.8 e67/49 3:17051619:::200.0000000f:head v 67'384, mlcod=67'378)", 2024-04-25T22:03:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.756185+0000", 2024-04-25T22:03:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001040968, 2024-04-25T22:03:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001386069, 2024-04-25T22:03:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.756185+0000", 2024-04-25T22:03:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.756185+0000", 2024-04-25T22:03:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.756186+0000", 2024-04-25T22:03:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7499999999999998e-07 2024-04-25T22:03:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.756228+0000", 2024-04-25T22:03:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1734999999999999e-05 2024-04-25T22:03:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.756639+0000", 2024-04-25T22:03:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041181099999999999 2024-04-25T22:03:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.756646+0000", 2024-04-25T22:03:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9e-06 2024-04-25T22:03:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.756705+0000", 2024-04-25T22:03:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8216e-05 2024-04-25T22:03:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.756727+0000", 2024-04-25T22:03:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2107e-05 2024-04-25T22:03:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:14427 4.5 e67/16 4:a0ee6455:::1000000336f.00000000:head v 67'229, mlcod=67'227)", 2024-04-25T22:03:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.729583+0000", 2024-04-25T22:03:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.027643267999999999, 2024-04-25T22:03:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028047229999999999, 2024-04-25T22:03:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.729583+0000", 2024-04-25T22:03:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.729583+0000", 2024-04-25T22:03:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.729583+0000", 2024-04-25T22:03:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:03:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.735512+0000", 2024-04-25T22:03:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005929223 2024-04-25T22:03:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.735522+0000", 2024-04-25T22:03:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8390000000000002e-06 2024-04-25T22:03:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.735529+0000", 2024-04-25T22:03:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3010000000000003e-06 2024-04-25T22:03:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.735578+0000", 2024-04-25T22:03:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9540999999999999e-05 2024-04-25T22:03:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.735599+0000", 2024-04-25T22:03:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0689000000000001e-05 2024-04-25T22:03:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:2449 4.4 e67/16)", 2024-04-25T22:03:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.757543+0000", 2024-04-25T22:03:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9996829, 2024-04-25T22:03:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000141905, 2024-04-25T22:03:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757543+0000", 2024-04-25T22:03:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757543+0000", 2024-04-25T22:03:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757543+0000", 2024-04-25T22:03:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7199999999999999e-07 2024-04-25T22:03:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757549+0000", 2024-04-25T22:03:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9780000000000002e-06 2024-04-25T22:03:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757562+0000", 2024-04-25T22:03:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2318e-05 2024-04-25T22:03:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757568+0000", 2024-04-25T22:03:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6499999999999999e-06 2024-04-25T22:03:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(4.d epoch 67/16 rep_tid 5905 entries 67'199 (0'0) error 4:b3bd9509:::100000031dc.00000000:head by mds.0.3:2432 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 67'197)", 2024-04-25T22:03:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.736790+0000", 2024-04-25T22:03:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.020435780000000001, 2024-04-25T22:03:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.02095725, 2024-04-25T22:03:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.736790+0000", 2024-04-25T22:03:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.736790+0000", 2024-04-25T22:03:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.736791+0000", 2024-04-25T22:03:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.015e-06 2024-04-25T22:03:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.736799+0000", 2024-04-25T22:03:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3469999999999999e-06 2024-04-25T22:03:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.736816+0000", 2024-04-25T22:03:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6801999999999999e-05 2024-04-25T22:03:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.736825+0000", 2024-04-25T22:03:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0149999999999992e-06 2024-04-25T22:03:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.736908+0000", 2024-04-25T22:03:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2941000000000004e-05 2024-04-25T22:03:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(4.14 epoch 67/49 rep_tid 8091 entries 67'192 (0'0) error 4:2ad110e9:::10000003530.00000000:head by mds.0.3:2453 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 67'190)", 2024-04-25T22:03:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.757581+0000", 2024-04-25T22:03:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9996452, 2024-04-25T22:03:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022971999999999999, 2024-04-25T22:03:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757581+0000", 2024-04-25T22:03:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757581+0000", 2024-04-25T22:03:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757581+0000", 2024-04-25T22:03:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0200000000000003e-07 2024-04-25T22:03:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757588+0000", 2024-04-25T22:03:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0260000000000002e-06 2024-04-25T22:03:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757603+0000", 2024-04-25T22:03:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4701999999999999e-05 2024-04-25T22:03:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757615+0000", 2024-04-25T22:03:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2347000000000001e-05 2024-04-25T22:03:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(4.25 epoch 67/16 rep_tid 5908 entries 67'183 (0'0) error 4:a43eb3e5:::10000003206.00000000:head by mds.0.3:2433 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 67'181)", 2024-04-25T22:03:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.736844+0000", 2024-04-25T22:03:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.020381637000000001, 2024-04-25T22:03:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.021022801000000001, 2024-04-25T22:03:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.736844+0000", 2024-04-25T22:03:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.736844+0000", 2024-04-25T22:03:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.736845+0000", 2024-04-25T22:03:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7099999999999997e-07 2024-04-25T22:03:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.736850+0000", 2024-04-25T22:03:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0340000000000004e-06 2024-04-25T22:03:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.736861+0000", 2024-04-25T22:03:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1025e-05 2024-04-25T22:03:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.736871+0000", 2024-04-25T22:03:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0767999999999999e-05 2024-04-25T22:03:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737143+0000", 2024-04-25T22:03:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027117899999999997 2024-04-25T22:03:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:2461 3.8 e67/49)", 2024-04-25T22:03:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.757629+0000", 2024-04-25T22:03:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9995971, 2024-04-25T22:03:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028958199999999998, 2024-04-25T22:03:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757629+0000", 2024-04-25T22:03:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757629+0000", 2024-04-25T22:03:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757629+0000", 2024-04-25T22:03:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6399999999999998e-07 2024-04-25T22:03:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757654+0000", 2024-04-25T22:03:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4922e-05 2024-04-25T22:03:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757662+0000", 2024-04-25T22:03:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8460000000000008e-06 2024-04-25T22:03:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757677+0000", 2024-04-25T22:03:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5497000000000001e-05 2024-04-25T22:03:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:14422 4.1c e67/49 4:3a783c95:::100000035e8.00000000:head v 67'191, mlcod=67'188)", 2024-04-25T22:03:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.731126+0000", 2024-04-25T22:03:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.026099997, 2024-04-25T22:03:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026841481, 2024-04-25T22:03:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.731126+0000", 2024-04-25T22:03:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.731126+0000", 2024-04-25T22:03:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.731127+0000", 2024-04-25T22:03:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0499999999999999e-06 2024-04-25T22:03:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737088+0000", 2024-04-25T22:03:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059610970000000003 2024-04-25T22:03:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737099+0000", 2024-04-25T22:03:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-04-25T22:03:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737107+0000", 2024-04-25T22:03:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3520000000000001e-06 2024-04-25T22:03:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737169+0000", 2024-04-25T22:03:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1958999999999994e-05 2024-04-25T22:03:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737190+0000", 2024-04-25T22:03:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0777000000000001e-05 2024-04-25T22:03:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:2462 3.8 e67/49)", 2024-04-25T22:03:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.757691+0000", 2024-04-25T22:03:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9995346, 2024-04-25T22:03:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033283800000000001, 2024-04-25T22:03:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757691+0000", 2024-04-25T22:03:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757691+0000", 2024-04-25T22:03:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757691+0000", 2024-04-25T22:03:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:03:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757708+0000", 2024-04-25T22:03:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6742999999999999e-05 2024-04-25T22:03:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757715+0000", 2024-04-25T22:03:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0430000000000002e-06 2024-04-25T22:03:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757720+0000", 2024-04-25T22:03:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1279999999999999e-06 2024-04-25T22:03:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:14446 4.28 e67/49)", 2024-04-25T22:03:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.757729+0000", 2024-04-25T22:03:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9994965, 2024-04-25T22:03:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033680800000000002, 2024-04-25T22:03:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757729+0000", 2024-04-25T22:03:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757729+0000", 2024-04-25T22:03:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757730+0000", 2024-04-25T22:03:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9799999999999999e-07 2024-04-25T22:03:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757789+0000", 2024-04-25T22:03:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9469000000000003e-05 2024-04-25T22:03:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757797+0000", 2024-04-25T22:03:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8399999999999995e-06 2024-04-25T22:03:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.757803+0000", 2024-04-25T22:03:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4389999999999999e-06 2024-04-25T22:03:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:14424 4.4 e67/16 4:211dd80e:::10000003351.00000000:head v 67'226, mlcod=67'224)", 2024-04-25T22:03:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.737213+0000", 2024-04-25T22:03:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.020012793000000001, 2024-04-25T22:03:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.020909374000000001, 2024-04-25T22:03:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737213+0000", 2024-04-25T22:03:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737213+0000", 2024-04-25T22:03:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737213+0000", 2024-04-25T22:03:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3700000000000001e-07 2024-04-25T22:03:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737249+0000", 2024-04-25T22:03:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5385000000000001e-05 2024-04-25T22:03:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737256+0000", 2024-04-25T22:03:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1860000000000003e-06 2024-04-25T22:03:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737261+0000", 2024-04-25T22:03:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2059999999999998e-06 2024-04-25T22:03:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737792+0000", 2024-04-25T22:03:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00053097099999999998 2024-04-25T22:03:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737866+0000", 2024-04-25T22:03:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4258000000000006e-05 2024-04-25T22:03:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(4.15 epoch 67/49 rep_tid 8071 entries 67'174 (0'0) error 4:ab2e5dd4:::1000000321d.00000000:head by mds.0.3:2437 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 67'172)", 2024-04-25T22:03:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.737309+0000", 2024-04-25T22:03:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.019917326999999999, 2024-04-25T22:03:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.020883776999999999, 2024-04-25T22:03:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737309+0000", 2024-04-25T22:03:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737309+0000", 2024-04-25T22:03:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737309+0000", 2024-04-25T22:03:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9999999999999999e-07 2024-04-25T22:03:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737315+0000", 2024-04-25T22:03:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5370000000000003e-06 2024-04-25T22:03:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737328+0000", 2024-04-25T22:03:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2955999999999999e-05 2024-04-25T22:03:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737342+0000", 2024-04-25T22:03:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3696999999999999e-05 2024-04-25T22:03:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737617+0000", 2024-04-25T22:03:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027538299999999998 2024-04-25T22:03:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.817 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.817 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.817 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(4.4 epoch 67/16 rep_tid 8072 entries 67'227 (0'0) error 4:204019dc:::1000000320c.00000001:head by mds.0.3:2435 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 67'224)", 2024-04-25T22:03:22.817 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.737405+0000", 2024-04-25T22:03:22.817 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.019820925999999999, 2024-04-25T22:03:22.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.020854458999999999, 2024-04-25T22:03:22.817 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.817 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.817 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:22.817 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737405+0000", 2024-04-25T22:03:22.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737405+0000", 2024-04-25T22:03:22.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737405+0000", 2024-04-25T22:03:22.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4400000000000001e-07 2024-04-25T22:03:22.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737410+0000", 2024-04-25T22:03:22.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4209999999999997e-06 2024-04-25T22:03:22.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737422+0000", 2024-04-25T22:03:22.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2150999999999999e-05 2024-04-25T22:03:22.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737433+0000", 2024-04-25T22:03:22.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1313e-05 2024-04-25T22:03:22.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:22.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.738827+0000", 2024-04-25T22:03:22.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001393968 2024-04-25T22:03:22.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.820 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.820 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:14393 4.7 e67/16 4:e2edf7d3:::100000033d2.00000000:head v 67'191, mlcod=67'189)", 2024-04-25T22:03:22.820 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.700053+0000", 2024-04-25T22:03:22.820 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.057172408000000001, 2024-04-25T22:03:22.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058260056999999997, 2024-04-25T22:03:22.821 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.821 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:22.821 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.700053+0000", 2024-04-25T22:03:22.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.700053+0000", 2024-04-25T22:03:22.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.700054+0000", 2024-04-25T22:03:22.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3099999999999996e-07 2024-04-25T22:03:22.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.703921+0000", 2024-04-25T22:03:22.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038665679999999999 2024-04-25T22:03:22.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.703932+0000", 2024-04-25T22:03:22.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1603999999999999e-05 2024-04-25T22:03:22.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.703939+0000", 2024-04-25T22:03:22.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9229999999999996e-06 2024-04-25T22:03:22.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:22.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.704021+0000", 2024-04-25T22:03:22.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1810000000000004e-05 2024-04-25T22:03:22.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:22.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.704045+0000", 2024-04-25T22:03:22.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4056000000000001e-05 2024-04-25T22:03:22.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.823 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.824 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.824 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:14431 4.e e67/16 4:714997c5:::10000003299.00000001:head v 67'176, mlcod=67'174)", 2024-04-25T22:03:22.824 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:22.737909+0000", 2024-04-25T22:03:22.824 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.019316765, 2024-04-25T22:03:22.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.020464548999999999, 2024-04-25T22:03:22.824 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:22.824 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:22.824 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:22.824 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:22.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:22.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737909+0000", 2024-04-25T22:03:22.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:22.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737909+0000", 2024-04-25T22:03:22.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:22.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:22.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.737909+0000", 2024-04-25T22:03:22.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7800000000000002e-07 2024-04-25T22:03:22.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:22.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.741918+0000", 2024-04-25T22:03:22.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0040088839999999999 2024-04-25T22:03:22.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:22.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.741935+0000", 2024-04-25T22:03:22.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6765e-05 2024-04-25T22:03:22.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:22.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.741942+0000", 2024-04-25T22:03:22.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3089999999999998e-06 2024-04-25T22:03:22.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:22.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.742001+0000", 2024-04-25T22:03:22.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8919000000000003e-05 2024-04-25T22:03:22.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:22.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:22.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:22.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:22.742028+0000", 2024-04-25T22:03:22.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6291e-05 2024-04-25T22:03:22.827 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.828 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:22.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:22.828 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-25T22:03:22.828 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 20 2024-04-25T22:03:22.828 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:22.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:22.825+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:22.831 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:22.846 INFO:tasks.workunit.client.0.smithi044.stdout:9/918: write d4/d7/d79/ddc/de1/f114 [683139,29065] 0 2024-04-25T22:03:22.846 INFO:tasks.workunit.client.0.smithi044.stdout:2/738: dread d7/d8/d48/db2/fd5 [0,4194304] 0 2024-04-25T22:03:22.846 INFO:tasks.workunit.client.0.smithi044.stdout:9/919: mknod d4/d4b/dac/c130 0 2024-04-25T22:03:22.846 INFO:tasks.workunit.client.0.smithi044.stdout:2/739: write d7/d8/f62 [2290679,26587] 0 2024-04-25T22:03:22.846 INFO:tasks.workunit.client.0.smithi044.stdout:2/740: write d7/d8/d1c/f69 [1780595,128278] 0 2024-04-25T22:03:22.846 INFO:tasks.workunit.client.0.smithi044.stdout:2/741: mknod d7/d8/d48/df4/cf5 0 2024-04-25T22:03:22.847 INFO:tasks.workunit.client.0.smithi044.stdout:2/742: mknod d7/d8/d48/dd9/cf6 0 2024-04-25T22:03:22.847 INFO:tasks.workunit.client.0.smithi044.stdout:3/838: dread d0/d1/d15/d51/d8e/d74/f90 [4194304,4194304] 0 2024-04-25T22:03:22.848 INFO:tasks.workunit.client.0.smithi044.stdout:3/839: read - d0/d2/f98 zero size 2024-04-25T22:03:22.848 INFO:tasks.workunit.client.0.smithi044.stdout:3/840: rmdir d0/d1/d15/d51/dd/d28 39 2024-04-25T22:03:22.848 INFO:tasks.workunit.client.0.smithi044.stdout:5/858: dread d2/d5/d21/d26/d2c/f34 [0,4194304] 0 2024-04-25T22:03:22.848 INFO:tasks.workunit.client.0.smithi044.stdout:0/751: dwrite d8/f9 [0,4194304] 0 2024-04-25T22:03:22.848 INFO:tasks.workunit.client.0.smithi044.stdout:5/859: rmdir d2/d5/d21/d38/d7c 39 2024-04-25T22:03:22.848 INFO:tasks.workunit.client.0.smithi044.stdout:5/860: rmdir d2/d5/d27/d2a 39 2024-04-25T22:03:22.848 INFO:tasks.workunit.client.0.smithi044.stdout:5/861: dread - d2/d5/d27/d2a/d5c/fc0 zero size 2024-04-25T22:03:22.848 INFO:tasks.workunit.client.0.smithi044.stdout:4/688: dread dd/d35/f47 [0,4194304] 0 2024-04-25T22:03:22.848 INFO:tasks.workunit.client.0.smithi044.stdout:2/743: write d7/d8/d48/dd9/d4b/dc1/de1/fe9 [661574,3857] 0 2024-04-25T22:03:22.849 INFO:tasks.workunit.client.0.smithi044.stdout:7/628: dread d1c/d22/d28/d30/d32/f43 [0,4194304] 0 2024-04-25T22:03:22.849 INFO:tasks.workunit.client.0.smithi044.stdout:3/841: dwrite d0/d13/d1c/d93/fd4 [0,4194304] 0 2024-04-25T22:03:22.849 INFO:tasks.workunit.client.0.smithi044.stdout:1/681: dwrite d3/d7/d29/f6c [0,4194304] 0 2024-04-25T22:03:22.849 INFO:tasks.workunit.client.0.smithi044.stdout:5/862: creat d2/d5b/d8e/d10f/dde/f114 x:0 0 0 2024-04-25T22:03:22.849 INFO:tasks.workunit.client.0.smithi044.stdout:8/973: dread d2a/d39/d42/d80/d121/f8a [0,4194304] 0 2024-04-25T22:03:22.849 INFO:tasks.workunit.client.0.smithi044.stdout:7/629: truncate d1c/f50 1200245 0 2024-04-25T22:03:22.849 INFO:tasks.workunit.client.0.smithi044.stdout:2/744: creat d7/d7b/d81/d4e/d86/ff7 x:0 0 0 2024-04-25T22:03:22.849 INFO:tasks.workunit.client.0.smithi044.stdout:1/682: chown d3/d7/d83/ca9 97 1 2024-04-25T22:03:22.849 INFO:tasks.workunit.client.0.smithi044.stdout:3/842: fsync d0/d1/d15/d51/d8e/d74/d103/d5d/fb4 0 2024-04-25T22:03:22.849 INFO:tasks.workunit.client.0.smithi044.stdout:8/974: mkdir d2a/d39/d42/d80/d121/d13b 0 2024-04-25T22:03:22.849 INFO:tasks.workunit.client.0.smithi044.stdout:5/863: rename d2/d5/f2f to d2/d5/d21/d26/f115 0 2024-04-25T22:03:22.849 INFO:tasks.workunit.client.0.smithi044.stdout:1/683: creat d3/d30/fd2 x:0 0 0 2024-04-25T22:03:22.849 INFO:tasks.workunit.client.0.smithi044.stdout:3/843: mkdir d0/d1/d15/d51/dd/d11/d8a/d11a 0 2024-04-25T22:03:22.849 INFO:tasks.workunit.client.0.smithi044.stdout:7/630: rename d1c/d22/d28/d30/d32/d5d/f87 to d1c/d22/d4a/fbe 0 2024-04-25T22:03:22.849 INFO:tasks.workunit.client.0.smithi044.stdout:1/684: readlink d3/d54/d76/l94 0 2024-04-25T22:03:22.850 INFO:tasks.workunit.client.0.smithi044.stdout:3/844: read - d0/fde zero size 2024-04-25T22:03:22.850 INFO:tasks.workunit.client.0.smithi044.stdout:2/745: fdatasync d7/d8/d48/dd9/d4b/dc1/de1/fe9 0 2024-04-25T22:03:22.850 INFO:tasks.workunit.client.0.smithi044.stdout:8/975: mknod d2a/d82/db6/dd2/c13c 0 2024-04-25T22:03:22.850 INFO:tasks.workunit.client.0.smithi044.stdout:3/845: rmdir d0/d13 39 2024-04-25T22:03:22.850 INFO:tasks.workunit.client.0.smithi044.stdout:1/685: mknod d3/d30/cd3 0 2024-04-25T22:03:22.850 INFO:tasks.workunit.client.0.smithi044.stdout:0/752: truncate d8/df/d17/d45/d95/d51/f84 721973 0 2024-04-25T22:03:22.850 INFO:tasks.workunit.client.0.smithi044.stdout:7/631: mknod d1c/d22/d28/d30/d32/cbf 0 2024-04-25T22:03:22.850 INFO:tasks.workunit.client.0.smithi044.stdout:4/689: dwrite dd/f69 [0,4194304] 0 2024-04-25T22:03:22.850 INFO:tasks.workunit.client.0.smithi044.stdout:5/864: fdatasync d2/d5/d6a/df3/ffa 0 2024-04-25T22:03:22.850 INFO:tasks.workunit.client.0.smithi044.stdout:0/753: write d8/fbf [745633,123093] 0 2024-04-25T22:03:22.850 INFO:tasks.workunit.client.0.smithi044.stdout:0/754: readlink d8/df/l72 0 2024-04-25T22:03:22.850 INFO:tasks.workunit.client.0.smithi044.stdout:8/976: mkdir d2a/d52/d13d 0 2024-04-25T22:03:22.850 INFO:tasks.workunit.client.0.smithi044.stdout:5/865: mkdir d2/d5/d27/d2a/d5c/d112/d116 0 2024-04-25T22:03:22.850 INFO:tasks.workunit.client.0.smithi044.stdout:0/755: read d8/da/d60/d86/fdf [45341,111355] 0 2024-04-25T22:03:22.851 INFO:tasks.workunit.client.0.smithi044.stdout:1/686: mkdir d3/d7/db/d5d/d7f/d97/dd4 0 2024-04-25T22:03:22.851 INFO:tasks.workunit.client.0.smithi044.stdout:8/977: dread - d2a/d39/d5a/d92/f137 zero size 2024-04-25T22:03:22.851 INFO:tasks.workunit.client.0.smithi044.stdout:7/632: getdents d1c/d88 0 2024-04-25T22:03:22.851 INFO:tasks.workunit.client.0.smithi044.stdout:5/866: readlink d2/d5/d21/d38/d52/l7a 0 2024-04-25T22:03:22.851 INFO:tasks.workunit.client.0.smithi044.stdout:7/633: stat d1c/d22/f5c 0 2024-04-25T22:03:22.851 INFO:tasks.workunit.client.0.smithi044.stdout:0/756: rename f0 to d8/da/d60/daa/ffe 0 2024-04-25T22:03:22.851 INFO:tasks.workunit.client.0.smithi044.stdout:1/687: mknod d3/d7/db/cd5 0 2024-04-25T22:03:22.851 INFO:tasks.workunit.client.0.smithi044.stdout:5/867: mknod d2/d5/d27/d2a/d5c/c117 0 2024-04-25T22:03:22.851 INFO:tasks.workunit.client.0.smithi044.stdout:0/757: unlink d8/df/d17/db9/f99 0 2024-04-25T22:03:22.851 INFO:tasks.workunit.client.0.smithi044.stdout:3/846: dwrite d0/d2/f98 [0,4194304] 0 2024-04-25T22:03:22.851 INFO:tasks.workunit.client.0.smithi044.stdout:1/688: getdents d3/d59 0 2024-04-25T22:03:22.851 INFO:tasks.workunit.client.0.smithi044.stdout:7/634: symlink d1c/d22/d28/d4e/d6a/d9e/lc0 0 2024-04-25T22:03:22.851 INFO:tasks.workunit.client.0.smithi044.stdout:5/868: mknod d2/d5/d6a/c118 0 2024-04-25T22:03:22.851 INFO:tasks.workunit.client.0.smithi044.stdout:0/758: truncate d8/df/f5d 5031018 0 2024-04-25T22:03:22.851 INFO:tasks.workunit.client.0.smithi044.stdout:1/689: rmdir d3/d7/db/d5d/d7f 39 2024-04-25T22:03:22.852 INFO:tasks.workunit.client.0.smithi044.stdout:6/940: sync 2024-04-25T22:03:22.852 INFO:tasks.workunit.client.0.smithi044.stdout:3/847: rename d0/d13/d6c/fb3 to d0/d1/f11b 0 2024-04-25T22:03:22.852 INFO:tasks.workunit.client.0.smithi044.stdout:5/869: truncate d2/d5/d27/d2a/d3a/fed 270558 0 2024-04-25T22:03:22.852 INFO:tasks.workunit.client.0.smithi044.stdout:3/848: mkdir d0/d70/d7c/d11c 0 2024-04-25T22:03:22.852 INFO:tasks.workunit.client.0.smithi044.stdout:7/635: rename d1c/d22/d28/d30/c53 to d1c/cc1 0 2024-04-25T22:03:22.852 INFO:tasks.workunit.client.0.smithi044.stdout:5/870: chown d2/d5/d21/d38/l91 850 1 2024-04-25T22:03:22.852 INFO:tasks.workunit.client.0.smithi044.stdout:2/746: truncate d7/f32 3079920 0 2024-04-25T22:03:22.852 INFO:tasks.workunit.client.0.smithi044.stdout:1/690: unlink d3/d7/d29/d43/d85/f84 0 2024-04-25T22:03:22.852 INFO:tasks.workunit.client.0.smithi044.stdout:7/636: symlink d1c/d22/d28/d30/lc2 0 2024-04-25T22:03:22.852 INFO:tasks.workunit.client.0.smithi044.stdout:2/747: mknod d7/d8/d5f/cf8 0 2024-04-25T22:03:22.852 INFO:tasks.workunit.client.0.smithi044.stdout:3/849: symlink d0/d1/d15/d51/d8e/d74/l11d 0 2024-04-25T22:03:22.852 INFO:tasks.workunit.client.0.smithi044.stdout:1/691: mkdir d3/d7/d29/d43/dd6 0 2024-04-25T22:03:22.852 INFO:tasks.workunit.client.0.smithi044.stdout:7/637: chown d1c/d22/d28/d30/f7d 7950 1 2024-04-25T22:03:22.852 INFO:tasks.workunit.client.0.smithi044.stdout:2/748: write d7/d7b/d81/d4e/d86/d6b/d78/f5a [4977483,80572] 0 2024-04-25T22:03:22.852 INFO:tasks.workunit.client.0.smithi044.stdout:1/692: mknod d3/d7/db/d5d/d7f/cd7 0 2024-04-25T22:03:22.853 INFO:tasks.workunit.client.0.smithi044.stdout:3/850: getdents d0/d13/d6c 0 2024-04-25T22:03:22.853 INFO:tasks.workunit.client.0.smithi044.stdout:2/749: write d7/d8/d48/dd9/f17 [808248,45396] 0 2024-04-25T22:03:22.853 INFO:tasks.workunit.client.0.smithi044.stdout:1/693: readlink d3/d72/l7e 0 2024-04-25T22:03:22.853 INFO:tasks.workunit.client.0.smithi044.stdout:2/750: unlink d7/d8/d5f/fa4 0 2024-04-25T22:03:22.853 INFO:tasks.workunit.client.0.smithi044.stdout:7/638: dread d1c/d22/f5c [0,4194304] 0 2024-04-25T22:03:22.853 INFO:tasks.workunit.client.0.smithi044.stdout:3/851: truncate d0/d1/d15/d51/fe9 1053430 0 2024-04-25T22:03:22.853 INFO:tasks.workunit.client.0.smithi044.stdout:6/941: dwrite d2/d23/d5a/d12/d27/daf/dcb/ded/f133 [0,4194304] 0 2024-04-25T22:03:22.853 INFO:tasks.workunit.client.0.smithi044.stdout:2/751: symlink d7/d7b/d81/d57/lf9 0 2024-04-25T22:03:22.853 INFO:tasks.workunit.client.0.smithi044.stdout:5/871: dwrite d2/f3c [0,4194304] 0 2024-04-25T22:03:22.853 INFO:tasks.workunit.client.0.smithi044.stdout:7/639: creat d1c/d22/fc3 x:0 0 0 2024-04-25T22:03:22.853 INFO:tasks.workunit.client.0.smithi044.stdout:3/852: creat d0/d13/d1c/d93/da6/f11e x:0 0 0 2024-04-25T22:03:22.853 INFO:tasks.workunit.client.0.smithi044.stdout:6/942: dread - d2/d23/d5a/d11/d3b/dc6/d10a/f11b zero size 2024-04-25T22:03:22.853 INFO:tasks.workunit.client.0.smithi044.stdout:7/640: chown d1c/cc1 85916573 1 2024-04-25T22:03:22.853 INFO:tasks.workunit.client.0.smithi044.stdout:5/872: symlink d2/dad/df2/d108/l119 0 2024-04-25T22:03:22.853 INFO:tasks.workunit.client.0.smithi044.stdout:2/752: mkdir d7/d7b/d81/d4e/d86/d6b/dd8/ded/dd4/dfa 0 2024-04-25T22:03:22.854 INFO:tasks.workunit.client.0.smithi044.stdout:6/943: rmdir d2/d23/d5a/d13/d68/d8e 39 2024-04-25T22:03:22.854 INFO:tasks.workunit.client.0.smithi044.stdout:7/641: chown d1c/d22/d28/d30/d32/f8a 98966 1 2024-04-25T22:03:22.854 INFO:tasks.workunit.client.0.smithi044.stdout:3/853: link d0/c65 d0/d1/d34/d48/dc7/c11f 0 2024-04-25T22:03:22.854 INFO:tasks.workunit.client.0.smithi044.stdout:5/873: write d2/d5b/d8e/d10f/dde/fe1 [888341,119193] 0 2024-04-25T22:03:22.854 INFO:tasks.workunit.client.0.smithi044.stdout:7/642: creat d1c/d88/d8f/d9c/fc4 x:0 0 0 2024-04-25T22:03:22.854 INFO:tasks.workunit.client.0.smithi044.stdout:2/753: rename d7/d8/d1c/cc8 to d7/d8/cfb 0 2024-04-25T22:03:22.854 INFO:tasks.workunit.client.0.smithi044.stdout:6/944: dread - d2/d23/d5a/d12/d27/daf/dcb/d5e/db5/f10b zero size 2024-04-25T22:03:22.854 INFO:tasks.workunit.client.0.smithi044.stdout:3/854: chown d0/d1/d15/d23/d60/f9b 7458559 1 2024-04-25T22:03:22.854 INFO:tasks.workunit.client.0.smithi044.stdout:8/978: dread d2a/f62 [0,4194304] 0 2024-04-25T22:03:22.854 INFO:tasks.workunit.client.0.smithi044.stdout:7/643: write d1c/d22/d4a/f81 [1031056,36493] 0 2024-04-25T22:03:22.854 INFO:tasks.workunit.client.0.smithi044.stdout:5/874: dread d2/d5/d27/d2a/d3a/fa6 [0,4194304] 0 2024-04-25T22:03:22.854 INFO:tasks.workunit.client.0.smithi044.stdout:3/855: mknod d0/d70/d7c/da9/c120 0 2024-04-25T22:03:22.854 INFO:tasks.workunit.client.0.smithi044.stdout:8/979: mknod d2a/d32/d57/c13e 0 2024-04-25T22:03:22.854 INFO:tasks.workunit.client.0.smithi044.stdout:2/754: creat d7/d8/d5f/d70/ffc x:0 0 0 2024-04-25T22:03:22.855 INFO:tasks.workunit.client.0.smithi044.stdout:5/875: dread - d2/dad/df2/ffb zero size 2024-04-25T22:03:22.855 INFO:tasks.workunit.client.0.smithi044.stdout:6/945: mkdir d2/d23/d5a/d12/d27/daf/dcb/da7/d145 0 2024-04-25T22:03:22.855 INFO:tasks.workunit.client.0.smithi044.stdout:8/980: write d2a/ffb [5085,78890] 0 2024-04-25T22:03:22.855 INFO:tasks.workunit.client.0.smithi044.stdout:3/856: write d0/d1/d15/d51/dd/d11/f69 [1258552,127294] 0 2024-04-25T22:03:22.855 INFO:tasks.workunit.client.0.smithi044.stdout:5/876: rmdir d2/d5/d27/d2a/d5c 39 2024-04-25T22:03:22.855 INFO:tasks.workunit.client.0.smithi044.stdout:2/755: dread - d7/d7b/d81/d4e/d86/ff7 zero size 2024-04-25T22:03:22.855 INFO:tasks.workunit.client.0.smithi044.stdout:6/946: write d2/d23/d5a/d11/f39 [3888938,54940] 0 2024-04-25T22:03:22.855 INFO:tasks.workunit.client.0.smithi044.stdout:5/877: fdatasync d2/d5/d27/d2a/d5c/d5f/f73 0 2024-04-25T22:03:22.855 INFO:tasks.workunit.client.0.smithi044.stdout:4/690: dread dd/d35/d52/da9/dca/d79/d7f/d81/f64 [0,4194304] 0 2024-04-25T22:03:22.855 INFO:tasks.workunit.client.0.smithi044.stdout:4/691: write dd/d19/f3d [4258189,40906] 0 2024-04-25T22:03:22.855 INFO:tasks.workunit.client.0.smithi044.stdout:8/981: dread d2a/d52/f72 [0,4194304] 0 2024-04-25T22:03:22.855 INFO:tasks.workunit.client.0.smithi044.stdout:8/982: creat d2a/d52/dd6/f13f x:0 0 0 2024-04-25T22:03:22.855 INFO:tasks.workunit.client.0.smithi044.stdout:2/756: truncate d7/f1b 814818 0 2024-04-25T22:03:22.855 INFO:tasks.workunit.client.0.smithi044.stdout:8/983: rename d2a/d32/l58 to d2a/d32/d105/d12d/l140 0 2024-04-25T22:03:22.855 INFO:tasks.workunit.client.0.smithi044.stdout:2/757: mknod d7/d7b/d81/cfd 0 2024-04-25T22:03:22.856 INFO:tasks.workunit.client.0.smithi044.stdout:8/984: readlink d2a/d39/d42/d68/d6b/d7b/l114 0 2024-04-25T22:03:22.856 INFO:tasks.workunit.client.0.smithi044.stdout:2/758: write d7/d7b/d81/d4e/d86/d6b/fa2 [2077561,65699] 0 2024-04-25T22:03:22.856 INFO:tasks.workunit.client.0.smithi044.stdout:5/878: dwrite d2/d5/d21/d26/f110 [0,4194304] 0 2024-04-25T22:03:22.856 INFO:tasks.workunit.client.0.smithi044.stdout:5/879: symlink d2/d5b/da8/d10b/l11a 0 2024-04-25T22:03:22.856 INFO:tasks.workunit.client.0.smithi044.stdout:2/759: getdents d7/d8/d5f 0 2024-04-25T22:03:22.856 INFO:tasks.workunit.client.0.smithi044.stdout:4/692: dwrite dd/d35/d52/d61/d76/fb1 [0,4194304] 0 2024-04-25T22:03:22.856 INFO:tasks.workunit.client.0.smithi044.stdout:6/947: dread d2/d23/d5a/d12/d27/daf/dcb/dc2/fe6 [0,4194304] 0 2024-04-25T22:03:22.856 INFO:tasks.workunit.client.0.smithi044.stdout:8/985: rename d2a/d52/dd6 to d2a/d39/d141 0 2024-04-25T22:03:22.856 INFO:tasks.workunit.client.0.smithi044.stdout:6/948: chown d2/d23/d5a/d13/d68/f79 619 1 2024-04-25T22:03:22.856 INFO:tasks.workunit.client.0.smithi044.stdout:2/760: mknod d7/d7b/d81/d4e/d86/d6b/dd8/ded/dd4/cfe 0 2024-04-25T22:03:22.856 INFO:tasks.workunit.client.0.smithi044.stdout:8/986: dread - d2a/d82/f10e zero size 2024-04-25T22:03:22.856 INFO:tasks.workunit.client.0.smithi044.stdout:5/880: truncate d2/d5/d27/d2a/d5c/d5f/f63 1200914 0 2024-04-25T22:03:22.856 INFO:tasks.workunit.client.0.smithi044.stdout:8/987: dread - d2a/d82/db6/dd2/f122 zero size 2024-04-25T22:03:22.856 INFO:tasks.workunit.client.0.smithi044.stdout:9/920: sync 2024-04-25T22:03:22.856 INFO:tasks.workunit.client.0.smithi044.stdout:5/881: write d2/d5/d6a/fdd [722678,53916] 0 2024-04-25T22:03:22.857 INFO:tasks.workunit.client.0.smithi044.stdout:6/949: rename d2/d23/d5a/d12/d27/daf/dcb to d2/d23/d30/db0/d146 0 2024-04-25T22:03:22.857 INFO:tasks.workunit.client.0.smithi044.stdout:3/857: dread d0/d1/d15/d51/dd/d11/fd0 [0,4194304] 0 2024-04-25T22:03:22.857 INFO:tasks.workunit.client.0.smithi044.stdout:5/882: stat d2/d5/d6a/df3/f10a 0 2024-04-25T22:03:22.857 INFO:tasks.workunit.client.0.smithi044.stdout:6/950: chown d2/d23/d5a/d12/d27 24 1 2024-04-25T22:03:22.857 INFO:tasks.workunit.client.0.smithi044.stdout:8/988: mkdir d2a/d39/d5a/d92/d142 0 2024-04-25T22:03:22.857 INFO:tasks.workunit.client.0.smithi044.stdout:5/883: rmdir d2/d5/d27/d2a/d3a 39 2024-04-25T22:03:22.857 INFO:tasks.workunit.client.0.smithi044.stdout:6/951: symlink d2/d23/d30/db0/d146/da7/d145/l147 0 2024-04-25T22:03:22.857 INFO:tasks.workunit.client.0.smithi044.stdout:5/884: rmdir d2/dad 39 2024-04-25T22:03:22.857 INFO:tasks.workunit.client.0.smithi044.stdout:4/693: dwrite dd/d19/f32 [0,4194304] 0 2024-04-25T22:03:22.857 INFO:tasks.workunit.client.0.smithi044.stdout:6/952: mknod d2/d23/d5a/d13/d121/c148 0 2024-04-25T22:03:22.857 INFO:tasks.workunit.client.0.smithi044.stdout:5/885: creat d2/d5/d27/f11b x:0 0 0 2024-04-25T22:03:22.857 INFO:tasks.workunit.client.0.smithi044.stdout:4/694: symlink dd/d35/d52/lde 0 2024-04-25T22:03:22.857 INFO:tasks.workunit.client.0.smithi044.stdout:6/953: symlink d2/d23/d5a/d12/d27/d8d/d134/dc8/dfa/l149 0 2024-04-25T22:03:22.857 INFO:tasks.workunit.client.0.smithi044.stdout:5/886: rmdir d2/d5/d21/d26/d2c/d37/d100 0 2024-04-25T22:03:22.857 INFO:tasks.workunit.client.0.smithi044.stdout:5/887: creat d2/dc1/f11c x:0 0 0 2024-04-25T22:03:22.857 INFO:tasks.workunit.client.0.smithi044.stdout:4/695: rename dd/d35/d52/da9/dca/d79/d7f/d81/f5d to dd/d19/daf/fdf 0 2024-04-25T22:03:22.858 INFO:tasks.workunit.client.0.smithi044.stdout:5/888: dread - d2/d5/d27/d2a/d5c/f67 zero size 2024-04-25T22:03:22.858 INFO:tasks.workunit.client.0.smithi044.stdout:4/696: stat dd/l3f 0 2024-04-25T22:03:22.858 INFO:tasks.workunit.client.0.smithi044.stdout:6/954: dwrite d2/d23/d5a/d12/d27/d8d/d134/dc8/ff0 [0,4194304] 0 2024-04-25T22:03:22.858 INFO:tasks.workunit.client.0.smithi044.stdout:6/955: chown d2/d23/d30/fc4 453 1 2024-04-25T22:03:22.858 INFO:tasks.workunit.client.0.smithi044.stdout:2/761: truncate d7/d8/d1c/f67 6815817 0 2024-04-25T22:03:22.858 INFO:tasks.workunit.client.0.smithi044.stdout:3/858: truncate d0/d2/f98 3733449 0 2024-04-25T22:03:22.858 INFO:tasks.workunit.client.0.smithi044.stdout:9/921: write d4/d7/d79/ddc/de1/d54/d84/d72/d97/df3/f115 [848760,96096] 0 2024-04-25T22:03:22.858 INFO:tasks.workunit.client.0.smithi044.stdout:2/762: dread - d7/d7b/d81/d4e/f8c zero size 2024-04-25T22:03:22.858 INFO:tasks.workunit.client.0.smithi044.stdout:4/697: write dd/f6c [556402,44451] 0 2024-04-25T22:03:22.858 INFO:tasks.workunit.client.0.smithi044.stdout:3/859: creat d0/d70/d7c/d11c/f121 x:0 0 0 2024-04-25T22:03:22.858 INFO:tasks.workunit.client.0.smithi044.stdout:7/644: dread d1c/d22/d28/d30/f36 [0,4194304] 0 2024-04-25T22:03:22.858 INFO:tasks.workunit.client.0.smithi044.stdout:4/698: creat dd/d35/d52/da9/dca/d79/d7f/dd1/fe0 x:0 0 0 2024-04-25T22:03:22.861 INFO:tasks.workunit.client.0.smithi044.stdout:7/645: write f0 [943433,95923] 0 2024-04-25T22:03:22.861 INFO:tasks.workunit.client.0.smithi044.stdout:9/922: link d4/d3d/l41 d4/d4b/l131 0 2024-04-25T22:03:22.861 INFO:tasks.workunit.client.0.smithi044.stdout:4/699: creat dd/d35/d52/da9/dca/db6/fe1 x:0 0 0 2024-04-25T22:03:22.861 INFO:tasks.workunit.client.0.smithi044.stdout:6/956: dwrite d2/d23/d30/db0/d146/ded/f133 [0,4194304] 0 2024-04-25T22:03:22.861 INFO:tasks.workunit.client.0.smithi044.stdout:2/763: dread d7/d8/d48/db2/fd5 [0,4194304] 0 2024-04-25T22:03:22.862 INFO:tasks.workunit.client.0.smithi044.stdout:6/957: fsync d2/d23/d30/f47 0 2024-04-25T22:03:22.862 INFO:tasks.workunit.client.0.smithi044.stdout:4/700: rename dd/d19/l26 to dd/d35/d52/da9/dca/d79/d7f/dd1/le2 0 2024-04-25T22:03:22.862 INFO:tasks.workunit.client.0.smithi044.stdout:6/958: dread - d2/d23/d5a/d12/d1f/f87 zero size 2024-04-25T22:03:22.862 INFO:tasks.workunit.client.0.smithi044.stdout:4/701: write dd/d35/d52/da9/dca/f7d [862514,69463] 0 2024-04-25T22:03:22.862 INFO:tasks.workunit.client.0.smithi044.stdout:6/959: write d2/d23/d30/db0/d146/d5e/d92/f138 [978785,114297] 0 2024-04-25T22:03:22.862 INFO:tasks.workunit.client.0.smithi044.stdout:6/960: creat d2/d23/d5a/f14a x:0 0 0 2024-04-25T22:03:22.862 INFO:tasks.workunit.client.0.smithi044.stdout:6/961: creat d2/d105/d116/f14b x:0 0 0 2024-04-25T22:03:22.862 INFO:tasks.workunit.client.0.smithi044.stdout:9/923: truncate d4/d7/d79/ddc/de1/f11f 190109 0 2024-04-25T22:03:22.862 INFO:tasks.workunit.client.0.smithi044.stdout:9/924: symlink d4/d3d/da5/dd8/l132 0 2024-04-25T22:03:22.862 INFO:tasks.workunit.client.0.smithi044.stdout:6/962: link d2/d23/d5a/d11/l132 d2/d23/d5a/d12/d27/d8d/d134/dc8/dfa/df2/l14c 0 2024-04-25T22:03:22.862 INFO:tasks.workunit.client.0.smithi044.stdout:4/702: dwrite dd/d35/d52/da9/dca/db6/fe1 [0,4194304] 0 2024-04-25T22:03:22.862 INFO:tasks.workunit.client.0.smithi044.stdout:6/963: unlink d2/d23/d5a/d12/d27/ff9 0 2024-04-25T22:03:22.862 INFO:tasks.workunit.client.0.smithi044.stdout:9/925: truncate d4/d7/d79/ddc/ff2 637984 0 2024-04-25T22:03:22.862 INFO:tasks.workunit.client.0.smithi044.stdout:4/703: fsync dd/d35/fda 0 2024-04-25T22:03:22.862 INFO:tasks.workunit.client.0.smithi044.stdout:4/704: creat dd/d19/d91/dd9/fe3 x:0 0 0 2024-04-25T22:03:22.863 INFO:tasks.workunit.client.0.smithi044.stdout:9/926: mkdir d4/d7/d18/d2e/d94/d133 0 2024-04-25T22:03:22.863 INFO:tasks.workunit.client.0.smithi044.stdout:6/964: readlink d2/d23/d5a/d12/d27/d8d/d134/dc8/dfa/df2/l14c 0 2024-04-25T22:03:22.863 INFO:tasks.workunit.client.0.smithi044.stdout:3/860: dread d0/d70/f84 [0,4194304] 0 2024-04-25T22:03:22.863 INFO:tasks.workunit.client.0.smithi044.stdout:4/705: unlink dd/d35/d52/da9/dca/f7d 0 2024-04-25T22:03:22.863 INFO:tasks.workunit.client.0.smithi044.stdout:9/927: mknod d4/d7/d18/d2e/c134 0 2024-04-25T22:03:22.864 INFO:tasks.workunit.client.0.smithi044.stdout:0/759: sync 2024-04-25T22:03:22.864 INFO:tasks.workunit.client.0.smithi044.stdout:9/928: rmdir d4/d7/d79/ddc/de1/d54/d84/d72/d113 39 2024-04-25T22:03:22.864 INFO:tasks.workunit.client.0.smithi044.stdout:4/706: mkdir dd/d35/d52/da9/dca/d79/d7f/dd1/de4 0 2024-04-25T22:03:22.865 INFO:tasks.workunit.client.0.smithi044.stdout:3/861: mknod d0/d1/d15/d51/dd/d11/c122 0 2024-04-25T22:03:22.865 INFO:tasks.workunit.client.0.smithi044.stdout:0/760: write d8/df/d17/d45/d95/d51/f8a [305127,117867] 0 2024-04-25T22:03:22.865 INFO:tasks.workunit.client.0.smithi044.stdout:9/929: unlink d4/d3d/d66/d93/f101 0 2024-04-25T22:03:22.865 INFO:tasks.workunit.client.0.smithi044.stdout:4/707: dread - dd/f36 zero size 2024-04-25T22:03:22.865 INFO:tasks.workunit.client.0.smithi044.stdout:0/761: creat d8/da/d60/fff x:0 0 0 2024-04-25T22:03:22.865 INFO:tasks.workunit.client.0.smithi044.stdout:3/862: creat d0/d1/d15/f123 x:0 0 0 2024-04-25T22:03:22.865 INFO:tasks.workunit.client.0.smithi044.stdout:0/762: fdatasync d8/f68 0 2024-04-25T22:03:22.865 INFO:tasks.workunit.client.0.smithi044.stdout:7/646: dread d1c/d22/d28/d57/f60 [0,4194304] 0 2024-04-25T22:03:22.866 INFO:tasks.workunit.client.0.smithi044.stdout:6/965: read d2/d23/d5a/d12/f7a [2984542,111409] 0 2024-04-25T22:03:22.866 INFO:tasks.workunit.client.0.smithi044.stdout:5/889: dread d2/d5b/d8e/d10f/dde/de0/ff0 [0,4194304] 0 2024-04-25T22:03:22.866 INFO:tasks.workunit.client.0.smithi044.stdout:2/764: dread d7/d7b/d81/d4e/d86/d6b/d78/f56 [0,4194304] 0 2024-04-25T22:03:22.866 INFO:tasks.workunit.client.0.smithi044.stdout:9/930: creat d4/d7/d79/ddc/de1/d54/d84/d72/d113/d128/dd2/df7/f135 x:0 0 0 2024-04-25T22:03:22.867 INFO:tasks.workunit.client.0.smithi044.stdout:7/647: rename d1c/d22/c9f to d1c/d22/d4a/cc5 0 2024-04-25T22:03:22.869 INFO:tasks.workunit.client.0.smithi044.stdout:9/931: mknod d4/d7/d18/d2e/db5/c136 0 2024-04-25T22:03:22.869 INFO:tasks.workunit.client.0.smithi044.stdout:2/765: truncate f0 2364740 0 2024-04-25T22:03:22.869 INFO:tasks.workunit.client.0.smithi044.stdout:6/966: symlink d2/d23/d30/db0/d146/d5e/d13c/l14d 0 2024-04-25T22:03:22.869 INFO:tasks.workunit.client.0.smithi044.stdout:7/648: link d1c/d22/d4a/f78 d1c/d22/d28/d57/fc6 0 2024-04-25T22:03:22.871 INFO:tasks.workunit.client.0.smithi044.stdout:2/766: write d7/d8/d48/dd9/d2c/f61 [254206,67611] 0 2024-04-25T22:03:22.872 INFO:tasks.workunit.client.0.smithi044.stdout:2/767: creat d7/d8/d48/fff x:0 0 0 2024-04-25T22:03:22.872 INFO:tasks.workunit.client.0.smithi044.stdout:2/768: read - d7/d8/d1c/f5c zero size 2024-04-25T22:03:22.873 INFO:tasks.workunit.client.0.smithi044.stdout:5/890: dwrite d2/d5/d21/d26/d2c/d37/fb4 [0,4194304] 0 2024-04-25T22:03:22.873 INFO:tasks.workunit.client.0.smithi044.stdout:2/769: chown d7/le8 111675 1 2024-04-25T22:03:22.873 INFO:tasks.workunit.client.0.smithi044.stdout:5/891: rmdir d2 39 2024-04-25T22:03:22.874 INFO:tasks.workunit.client.0.smithi044.stdout:2/770: chown d7/d7b/d81/d4e/f8c 0 1 2024-04-25T22:03:22.875 INFO:tasks.workunit.client.0.smithi044.stdout:6/967: dread d2/d23/d30/db0/d146/d5e/d9c/fd4 [0,4194304] 0 2024-04-25T22:03:22.875 INFO:tasks.workunit.client.0.smithi044.stdout:5/892: write d2/d5/d6a/f6e [3159327,112022] 0 2024-04-25T22:03:22.875 INFO:tasks.workunit.client.0.smithi044.stdout:2/771: symlink d7/d7b/l100 0 2024-04-25T22:03:22.877 INFO:tasks.workunit.client.0.smithi044.stdout:0/763: truncate d8/d20/fc0 499213 0 2024-04-25T22:03:22.878 INFO:tasks.workunit.client.0.smithi044.stdout:9/932: write d4/d7/d79/f8e [170090,128947] 0 2024-04-25T22:03:22.878 INFO:tasks.workunit.client.0.smithi044.stdout:6/968: write d2/d23/d5a/d11/d3b/dc6/ff7 [694699,95880] 0 2024-04-25T22:03:22.878 INFO:tasks.workunit.client.0.smithi044.stdout:0/764: creat d8/da/d60/daa/f100 x:0 0 0 2024-04-25T22:03:22.879 INFO:tasks.workunit.client.0.smithi044.stdout:9/933: write d4/d7/d18/d3a/f11a [625053,74717] 0 2024-04-25T22:03:22.879 INFO:tasks.workunit.client.0.smithi044.stdout:0/765: creat d8/db2/f101 x:0 0 0 2024-04-25T22:03:22.880 INFO:tasks.workunit.client.0.smithi044.stdout:9/934: dread - d4/d4b/d86/fb2 zero size 2024-04-25T22:03:22.880 INFO:tasks.workunit.client.0.smithi044.stdout:0/766: creat d8/d78/db8/dfa/f102 x:0 0 0 2024-04-25T22:03:22.881 INFO:tasks.workunit.client.0.smithi044.stdout:3/863: dread d0/d1/d79/f9d [0,4194304] 0 2024-04-25T22:03:22.881 INFO:tasks.workunit.client.0.smithi044.stdout:6/969: fsync d2/d23/d30/db0/d146/ded/f133 0 2024-04-25T22:03:22.881 INFO:tasks.workunit.client.0.smithi044.stdout:5/893: dread d2/d5/d27/d2a/d48/f5a [0,4194304] 0 2024-04-25T22:03:22.882 INFO:tasks.workunit.client.0.smithi044.stdout:5/894: read - d2/d5/d21/d6b/fe5 zero size 2024-04-25T22:03:22.883 INFO:tasks.workunit.client.0.smithi044.stdout:3/864: chown d0/d13/d6c/f109 0 1 2024-04-25T22:03:22.883 INFO:tasks.workunit.client.0.smithi044.stdout:9/935: stat d4/d7/d79/ddc/de1/d54/d84/d72/d113/d128/c11b 0 2024-04-25T22:03:22.883 INFO:tasks.workunit.client.0.smithi044.stdout:0/767: creat d8/df/d17/d45/d95/d51/d8b/d90/f103 x:0 0 0 2024-04-25T22:03:22.884 INFO:tasks.workunit.client.0.smithi044.stdout:9/936: mknod d4/d3d/da5/dd8/c137 0 2024-04-25T22:03:22.884 INFO:tasks.workunit.client.0.smithi044.stdout:5/895: fdatasync d2/d5/d27/d2a/d3a/fed 0 2024-04-25T22:03:22.885 INFO:tasks.workunit.client.0.smithi044.stdout:2/772: dwrite d7/d8/d48/dd9/d2c/f61 [0,4194304] 0 2024-04-25T22:03:22.885 INFO:tasks.workunit.client.0.smithi044.stdout:3/865: fsync d0/d1/d15/d51/dd/d28/f3e 0 2024-04-25T22:03:22.885 INFO:tasks.workunit.client.0.smithi044.stdout:5/896: rmdir d2/d5/d21/d6b 39 2024-04-25T22:03:22.887 INFO:tasks.workunit.client.0.smithi044.stdout:2/773: link d7/d7b/d81/d4e/d86/d6b/d78/f56 d7/d8/d48/df4/f101 0 2024-04-25T22:03:22.887 INFO:tasks.workunit.client.0.smithi044.stdout:3/866: getdents d0/d1/d15/d23/d60 0 2024-04-25T22:03:22.888 INFO:tasks.workunit.client.0.smithi044.stdout:2/774: creat d7/d8/d1c/d77/f102 x:0 0 0 2024-04-25T22:03:22.888 INFO:tasks.workunit.client.0.smithi044.stdout:3/867: creat d0/d1/d15/d23/d60/f124 x:0 0 0 2024-04-25T22:03:22.888 INFO:tasks.workunit.client.0.smithi044.stdout:2/775: chown d7/le8 84 1 2024-04-25T22:03:22.889 INFO:tasks.workunit.client.0.smithi044.stdout:2/776: creat d7/d7b/d81/d4e/d86/d6b/dd8/ded/dd4/f103 x:0 0 0 2024-04-25T22:03:22.889 INFO:tasks.workunit.client.0.smithi044.stdout:6/970: write d2/d23/d5a/d12/d49/fad [1707803,53626] 0 2024-04-25T22:03:22.889 INFO:tasks.workunit.client.0.smithi044.stdout:9/937: truncate d4/d7/d18/d2e/d73/fb8 546815 0 2024-04-25T22:03:22.890 INFO:tasks.workunit.client.0.smithi044.stdout:6/971: write d2/d23/d5a/d11/d3b/f32 [4997123,46164] 0 2024-04-25T22:03:22.890 INFO:tasks.workunit.client.0.smithi044.stdout:2/777: truncate d7/d8/d1c/f67 7775820 0 2024-04-25T22:03:22.890 INFO:tasks.workunit.client.0.smithi044.stdout:9/938: unlink d4/d7/d79/ddc/de1/d54/d84/d72/d113/d128/l61 0 2024-04-25T22:03:22.891 INFO:tasks.workunit.client.0.smithi044.stdout:9/939: dread - d4/d7/d18/d2e/d73/f106 zero size 2024-04-25T22:03:22.891 INFO:tasks.workunit.client.0.smithi044.stdout:6/972: creat d2/d23/d5a/d12/d27/d8d/d134/dc8/dfa/df2/d123/d63/f14e x:0 0 0 2024-04-25T22:03:22.892 INFO:tasks.workunit.client.0.smithi044.stdout:6/973: symlink d2/d23/d30/l14f 0 2024-04-25T22:03:22.892 INFO:tasks.workunit.client.0.smithi044.stdout:9/940: creat d4/d7/d79/ddc/de1/d54/d84/d72/f138 x:0 0 0 2024-04-25T22:03:22.896 INFO:tasks.workunit.client.0.smithi044.stdout:5/897: write d2/d5/d21/d26/f115 [1221322,21803] 0 2024-04-25T22:03:22.897 INFO:tasks.workunit.client.0.smithi044.stdout:3/868: truncate d0/d1/d15/d81/dd2/d10f/f52 3303686 0 2024-04-25T22:03:22.897 INFO:tasks.workunit.client.0.smithi044.stdout:2/778: dwrite d7/d8/d48/dd9/d2c/d75/f9f [0,4194304] 0 2024-04-25T22:03:22.897 INFO:tasks.workunit.client.0.smithi044.stdout:3/869: chown d0/d1 157 1 2024-04-25T22:03:22.899 INFO:tasks.workunit.client.0.smithi044.stdout:5/898: fsync d2/d5/d21/d38/d52/d56/fe9 0 2024-04-25T22:03:22.900 INFO:tasks.workunit.client.0.smithi044.stdout:6/974: dwrite d2/d23/d5a/ff8 [0,4194304] 0 2024-04-25T22:03:22.900 INFO:tasks.workunit.client.0.smithi044.stdout:2/779: write d7/d7b/d81/d4e/d86/d6b/fb1 [991806,94991] 0 2024-04-25T22:03:22.900 INFO:tasks.workunit.client.0.smithi044.stdout:3/870: rmdir d0/d1/d15/d81/dd2/d10f/dc6/d44 39 2024-04-25T22:03:22.900 INFO:tasks.workunit.client.0.smithi044.stdout:9/941: dwrite d4/d7/d18/d2e/d94/ffa [0,4194304] 0 2024-04-25T22:03:22.901 INFO:tasks.workunit.client.0.smithi044.stdout:2/780: fsync d7/d8/d48/dd9/d4b/fee 0 2024-04-25T22:03:22.901 INFO:tasks.workunit.client.0.smithi044.stdout:3/871: chown d0/d1/d15/d51/dd/d28/fd8 89700 1 2024-04-25T22:03:22.903 INFO:tasks.workunit.client.0.smithi044.stdout:9/942: creat d4/d3d/d66/db9/d12e/f139 x:0 0 0 2024-04-25T22:03:22.904 INFO:tasks.workunit.client.0.smithi044.stdout:3/872: stat d0/d13/d1c/d93/dad/cf9 0 2024-04-25T22:03:22.904 INFO:tasks.workunit.client.0.smithi044.stdout:2/781: creat d7/d7b/d81/d4e/d86/d6b/dd8/ded/f104 x:0 0 0 2024-04-25T22:03:22.904 INFO:tasks.workunit.client.0.smithi044.stdout:9/943: write d4/d7/d18/d3a/f11a [1210409,27501] 0 2024-04-25T22:03:22.904 INFO:tasks.workunit.client.0.smithi044.stdout:9/944: readlink d4/l116 0 2024-04-25T22:03:22.904 INFO:tasks.workunit.client.0.smithi044.stdout:9/945: readlink d4/d7/l14 0 2024-04-25T22:03:22.904 INFO:tasks.workunit.client.0.smithi044.stdout:3/873: dread d0/d1/faa [0,4194304] 0 2024-04-25T22:03:22.905 INFO:tasks.workunit.client.0.smithi044.stdout:3/874: chown d0/f82 199476178 1 2024-04-25T22:03:22.905 INFO:tasks.workunit.client.0.smithi044.stdout:9/946: mknod d4/d7/d79/ddc/de1/d54/d84/d72/d108/c13a 0 2024-04-25T22:03:22.910 INFO:tasks.workunit.client.0.smithi044.stdout:9/947: rename d4/d3d/da5/c104 to d4/d7/d79/ddc/de1/d54/d84/d72/d97/c13b 0 2024-04-25T22:03:22.910 INFO:tasks.workunit.client.0.smithi044.stdout:9/948: dread d4/d7/d79/ddc/de1/f114 [0,4194304] 0 2024-04-25T22:03:22.910 INFO:tasks.workunit.client.0.smithi044.stdout:5/899: read d2/d5/d27/f62 [3351192,37809] 0 2024-04-25T22:03:22.911 INFO:tasks.workunit.client.0.smithi044.stdout:2/782: dwrite d7/d8/d48/dd9/d2c/f6d [0,4194304] 0 2024-04-25T22:03:22.911 INFO:tasks.workunit.client.0.smithi044.stdout:9/949: readlink d4/d7/d79/ddc/de1/l67 0 2024-04-25T22:03:22.912 INFO:tasks.workunit.client.0.smithi044.stdout:2/783: chown d7/d8/d48/dd9/c45 7 1 2024-04-25T22:03:22.913 INFO:tasks.workunit.client.0.smithi044.stdout:3/875: dwrite d0/d1/d15/d51/ffb [0,4194304] 0 2024-04-25T22:03:22.913 INFO:tasks.workunit.client.0.smithi044.stdout:9/950: write d4/d7/d18/d3a/f11e [1520946,8273] 0 2024-04-25T22:03:22.914 INFO:tasks.workunit.client.0.smithi044.stdout:2/784: mkdir d7/d7b/d81/d105 0 2024-04-25T22:03:22.914 INFO:tasks.workunit.client.0.smithi044.stdout:3/876: creat d0/d13/d6c/f125 x:0 0 0 2024-04-25T22:03:22.914 INFO:tasks.workunit.client.0.smithi044.stdout:1/694: sync 2024-04-25T22:03:22.914 INFO:tasks.workunit.client.0.smithi044.stdout:8/989: sync 2024-04-25T22:03:22.914 INFO:tasks.workunit.client.0.smithi044.stdout:0/768: sync 2024-04-25T22:03:22.914 INFO:tasks.workunit.client.0.smithi044.stdout:7/649: sync 2024-04-25T22:03:22.914 INFO:tasks.workunit.client.0.smithi044.stdout:4/708: sync 2024-04-25T22:03:22.916 INFO:tasks.workunit.client.0.smithi044.stdout:3/877: symlink d0/d1/d34/d48/l126 0 2024-04-25T22:03:22.917 INFO:tasks.workunit.client.0.smithi044.stdout:4/709: fdatasync dd/d35/d52/da9/dca/d79/d7f/f85 0 2024-04-25T22:03:22.918 INFO:tasks.workunit.client.0.smithi044.stdout:9/951: rename d4/l116 to d4/d7/d18/d2d/l13c 0 2024-04-25T22:03:22.918 INFO:tasks.workunit.client.0.smithi044.stdout:2/785: symlink d7/d7b/d81/d4e/d86/d6b/dd8/ded/dd4/dec/l106 0 2024-04-25T22:03:22.918 INFO:tasks.workunit.client.0.smithi044.stdout:8/990: unlink d2a/d32/d3e/l134 0 2024-04-25T22:03:22.919 INFO:tasks.workunit.client.0.smithi044.stdout:3/878: mknod d0/d1/d34/d48/c127 0 2024-04-25T22:03:22.919 INFO:tasks.workunit.client.0.smithi044.stdout:4/710: symlink dd/d35/d52/da9/dca/d79/le5 0 2024-04-25T22:03:22.920 INFO:tasks.workunit.client.0.smithi044.stdout:2/786: chown d7/d8/d48/dd9/d4b/dc1/de1/fe9 0 1 2024-04-25T22:03:22.921 INFO:tasks.workunit.client.0.smithi044.stdout:3/879: symlink d0/d13/l128 0 2024-04-25T22:03:22.922 INFO:tasks.workunit.client.0.smithi044.stdout:9/952: mkdir d4/d7/d18/d2e/d94/d13d 0 2024-04-25T22:03:22.922 INFO:tasks.workunit.client.0.smithi044.stdout:4/711: mkdir dd/d35/d52/da9/dca/d79/d7f/de6 0 2024-04-25T22:03:22.922 INFO:tasks.workunit.client.0.smithi044.stdout:1/695: rename d3/d59/d5c/f74 to d3/d30/fd8 0 2024-04-25T22:03:22.922 INFO:tasks.workunit.client.0.smithi044.stdout:8/991: symlink d2a/d39/d5a/l143 0 2024-04-25T22:03:22.923 INFO:tasks.workunit.client.0.smithi044.stdout:0/769: dwrite d8/df/f5d [0,4194304] 0 2024-04-25T22:03:22.923 INFO:tasks.workunit.client.0.smithi044.stdout:8/992: fsync d2a/d32/f5d 0 2024-04-25T22:03:22.923 INFO:tasks.workunit.client.0.smithi044.stdout:1/696: fsync d3/d7/db/f46 0 2024-04-25T22:03:22.923 INFO:tasks.workunit.client.0.smithi044.stdout:7/650: dread d1c/d22/d28/d57/fc6 [0,4194304] 0 2024-04-25T22:03:22.924 INFO:tasks.workunit.client.0.smithi044.stdout:4/712: chown dd/d35/d52/fb0 27125803 1 2024-04-25T22:03:22.924 INFO:tasks.workunit.client.0.smithi044.stdout:0/770: mknod d8/df/d17/d45/dad/c104 0 2024-04-25T22:03:22.924 INFO:tasks.workunit.client.0.smithi044.stdout:2/787: link d7/d8/d48/dd9/d4b/dc1/de1/fe9 d7/d7b/d81/d4e/d86/d6b/d78/f107 0 2024-04-25T22:03:22.925 INFO:tasks.workunit.client.0.smithi044.stdout:1/697: unlink d3/d7/db/fb5 0 2024-04-25T22:03:22.925 INFO:tasks.workunit.client.0.smithi044.stdout:7/651: chown d1c/d88/d8f/d9c/fc4 3 1 2024-04-25T22:03:22.925 INFO:tasks.workunit.client.0.smithi044.stdout:3/880: rename d0/d1/d34/d48/c127 to d0/d1/d15/d51/dd/d11/d42/c129 0 2024-04-25T22:03:22.925 INFO:tasks.workunit.client.0.smithi044.stdout:4/713: creat dd/d35/fe7 x:0 0 0 2024-04-25T22:03:22.925 INFO:tasks.workunit.client.0.smithi044.stdout:2/788: mkdir d7/d8/d1c/d77/d108 0 2024-04-25T22:03:22.925 INFO:tasks.workunit.client.0.smithi044.stdout:4/714: dread - dd/d35/fda zero size 2024-04-25T22:03:22.927 INFO:tasks.workunit.client.0.smithi044.stdout:3/881: symlink d0/d1/d15/d51/d8e/d74/d103/l12a 0 2024-04-25T22:03:22.927 INFO:tasks.workunit.client.0.smithi044.stdout:7/652: creat d1c/d22/d28/d30/d32/d5d/d83/fc7 x:0 0 0 2024-04-25T22:03:22.927 INFO:tasks.workunit.client.0.smithi044.stdout:4/715: fsync dd/d35/d52/fcb 0 2024-04-25T22:03:22.928 INFO:tasks.workunit.client.0.smithi044.stdout:7/653: stat d1c/d22/d28/d4e/d6a/d9e 0 2024-04-25T22:03:22.928 INFO:tasks.workunit.client.0.smithi044.stdout:2/789: rename d7/d7b/d81/d57/f84 to d7/d8/d48/dd9/d4b/f109 0 2024-04-25T22:03:22.929 INFO:tasks.workunit.client.0.smithi044.stdout:2/790: chown d7/lc0 346 1 2024-04-25T22:03:22.929 INFO:tasks.workunit.client.0.smithi044.stdout:4/716: creat dd/d19/fe8 x:0 0 0 2024-04-25T22:03:22.930 INFO:tasks.workunit.client.0.smithi044.stdout:9/953: rename d4/d7/d18/d2d/d70 to d4/d3d/da5/d13e 0 2024-04-25T22:03:22.930 INFO:tasks.workunit.client.0.smithi044.stdout:2/791: creat d7/d7b/f10a x:0 0 0 2024-04-25T22:03:22.930 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:22.924+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:22.931 INFO:tasks.workunit.client.0.smithi044.stdout:4/717: readlink dd/d35/d52/da9/dca/d79/d7f/d81/l63 0 2024-04-25T22:03:22.932 INFO:tasks.workunit.client.0.smithi044.stdout:4/718: unlink dd/d19/f49 0 2024-04-25T22:03:22.933 INFO:tasks.workunit.client.0.smithi044.stdout:0/771: truncate d8/df/d17/d45/d95/d9c/dbd/fd5 741479 0 2024-04-25T22:03:22.934 INFO:tasks.workunit.client.0.smithi044.stdout:7/654: write d1c/d22/f23 [1430725,18799] 0 2024-04-25T22:03:22.935 INFO:tasks.workunit.client.0.smithi044.stdout:8/993: dread d2a/f4e [0,4194304] 0 2024-04-25T22:03:22.935 INFO:tasks.workunit.client.0.smithi044.stdout:1/698: dwrite d3/d7/db/d5d/d7f/fb3 [4194304,4194304] 0 2024-04-25T22:03:22.938 INFO:tasks.workunit.client.0.smithi044.stdout:2/792: link d7/d8/d48/f4f d7/d7b/d81/d4e/d86/d6b/d78/f10b 0 2024-04-25T22:03:22.938 INFO:tasks.workunit.client.0.smithi044.stdout:7/655: chown d1c/d22/d28/c51 50 1 2024-04-25T22:03:22.938 INFO:tasks.workunit.client.0.smithi044.stdout:3/882: dwrite d0/d13/d1c/f2b [4194304,4194304] 0 2024-04-25T22:03:22.939 INFO:tasks.workunit.client.0.smithi044.stdout:8/994: write d2a/d32/d57/d119/f125 [721811,85551] 0 2024-04-25T22:03:22.939 INFO:tasks.workunit.client.0.smithi044.stdout:1/699: symlink d3/ld9 0 2024-04-25T22:03:22.940 INFO:tasks.workunit.client.0.smithi044.stdout:3/883: chown d0/d1/d15/d51/fac 2205603 1 2024-04-25T22:03:22.940 INFO:tasks.workunit.client.0.smithi044.stdout:8/995: creat d2a/d39/d5a/d8e/d132/f144 x:0 0 0 2024-04-25T22:03:22.940 INFO:tasks.workunit.client.0.smithi044.stdout:2/793: link d7/d7b/d81/d4e/c99 d7/d7b/d81/d4e/d86/d6b/dd8/ded/dd4/c10c 0 2024-04-25T22:03:22.941 INFO:tasks.workunit.client.0.smithi044.stdout:3/884: write d0/d1/d15/d51/fec [739477,17246] 0 2024-04-25T22:03:22.941 INFO:tasks.workunit.client.0.smithi044.stdout:5/900: dread d2/f4 [0,4194304] 0 2024-04-25T22:03:22.944 INFO:tasks.workunit.client.0.smithi044.stdout:8/996: write d2a/d39/d42/d129/d84/f127 [526695,119969] 0 2024-04-25T22:03:22.944 INFO:tasks.workunit.client.0.smithi044.stdout:3/885: write d0/d13/d6c/f101 [1678248,104872] 0 2024-04-25T22:03:22.946 INFO:tasks.workunit.client.0.smithi044.stdout:5/901: rename d2/d5/d21/f2d to d2/dad/f11d 0 2024-04-25T22:03:22.946 INFO:tasks.workunit.client.0.smithi044.stdout:3/886: mkdir d0/d70/d12b 0 2024-04-25T22:03:22.947 INFO:tasks.workunit.client.0.smithi044.stdout:7/656: dwrite d1c/d22/d28/d30/d32/f42 [0,4194304] 0 2024-04-25T22:03:22.948 INFO:tasks.workunit.client.0.smithi044.stdout:2/794: link d7/d8/d5f/l9c d7/d7b/d81/d4e/d86/d6b/dd8/ded/dd4/dfa/l10d 0 2024-04-25T22:03:22.949 INFO:tasks.workunit.client.0.smithi044.stdout:1/700: dwrite d3/d7/f23 [0,4194304] 0 2024-04-25T22:03:22.949 INFO:tasks.workunit.client.0.smithi044.stdout:0/772: dwrite d8/d78/fa6 [0,4194304] 0 2024-04-25T22:03:22.949 INFO:tasks.workunit.client.0.smithi044.stdout:3/887: creat d0/d13/d1c/d93/da6/d8d/f12c x:0 0 0 2024-04-25T22:03:22.949 INFO:tasks.workunit.client.0.smithi044.stdout:5/902: read d2/d5/f16 [5095,26707] 0 2024-04-25T22:03:22.950 INFO:tasks.workunit.client.0.smithi044.stdout:0/773: write d8/df/fa5 [36754,23795] 0 2024-04-25T22:03:22.950 INFO:tasks.workunit.client.0.smithi044.stdout:1/701: mkdir d3/d7/db/dda 0 2024-04-25T22:03:22.951 INFO:tasks.workunit.client.0.smithi044.stdout:1/702: chown d3/d30/d3f/f9c 47 1 2024-04-25T22:03:22.951 INFO:tasks.workunit.client.0.smithi044.stdout:3/888: mknod d0/d1/d15/d81/dd2/d10f/c12d 0 2024-04-25T22:03:22.951 INFO:tasks.workunit.client.0.smithi044.stdout:1/703: dread - d3/d59/d5c/fb8 zero size 2024-04-25T22:03:22.952 INFO:tasks.workunit.client.0.smithi044.stdout:5/903: link d2/d5/d27/d2a/d3a/c72 d2/d5b/d8e/d10f/def/c11e 0 2024-04-25T22:03:22.952 INFO:tasks.workunit.client.0.smithi044.stdout:1/704: mkdir d3/d72/ddb 0 2024-04-25T22:03:22.953 INFO:tasks.workunit.client.0.smithi044.stdout:3/889: rename d0/d1/d15/d51/dd/d28/f3e to d0/d70/f12e 0 2024-04-25T22:03:22.954 INFO:tasks.workunit.client.0.smithi044.stdout:1/705: creat d3/fdc x:0 0 0 2024-04-25T22:03:22.954 INFO:tasks.workunit.client.0.smithi044.stdout:0/774: link d8/df/d17/d45/d95/d9c/dcc/cdb d8/df/d93/c105 0 2024-04-25T22:03:22.954 INFO:tasks.workunit.client.0.smithi044.stdout:6/975: dread d2/d23/d5a/d12/f48 [4194304,4194304] 0 2024-04-25T22:03:22.954 INFO:tasks.workunit.client.0.smithi044.stdout:3/890: fsync d0/d1/d15/d51/dd/d28/f53 0 2024-04-25T22:03:22.954 INFO:tasks.workunit.client.0.smithi044.stdout:6/976: write d2/d23/fdd [51992,14334] 0 2024-04-25T22:03:22.955 INFO:tasks.workunit.client.0.smithi044.stdout:5/904: link d2/d5/d21/d38/f60 d2/d5/d21/d38/f11f 0 2024-04-25T22:03:22.955 INFO:tasks.workunit.client.0.smithi044.stdout:3/891: fdatasync d0/d13/d1c/d93/da6/d8d/f10b 0 2024-04-25T22:03:22.956 INFO:tasks.workunit.client.0.smithi044.stdout:1/706: creat d3/d7/d29/d43/dd6/fdd x:0 0 0 2024-04-25T22:03:22.957 INFO:tasks.workunit.client.0.smithi044.stdout:5/905: fdatasync d2/d5/d27/d2a/d3a/fa6 0 2024-04-25T22:03:22.957 INFO:tasks.workunit.client.0.smithi044.stdout:0/775: truncate d8/df/d17/f33 4083783 0 2024-04-25T22:03:22.957 INFO:tasks.workunit.client.0.smithi044.stdout:1/707: mknod d3/d7/db/d8f/cde 0 2024-04-25T22:03:22.957 INFO:tasks.workunit.client.0.smithi044.stdout:1/708: dread - d3/d59/f93 zero size 2024-04-25T22:03:22.958 INFO:tasks.workunit.client.0.smithi044.stdout:0/776: chown d8/df/d17/db9/cb1 905 1 2024-04-25T22:03:22.959 INFO:tasks.workunit.client.0.smithi044.stdout:1/709: fsync d3/d59/d5c/f62 0 2024-04-25T22:03:22.960 INFO:tasks.workunit.client.0.smithi044.stdout:0/777: creat d8/df/d17/db9/d7c/f106 x:0 0 0 2024-04-25T22:03:22.961 INFO:tasks.workunit.client.0.smithi044.stdout:0/778: write d8/f9f [1416344,9690] 0 2024-04-25T22:03:22.961 INFO:tasks.workunit.client.0.smithi044.stdout:3/892: dread d0/f38 [0,4194304] 0 2024-04-25T22:03:22.962 INFO:tasks.workunit.client.0.smithi044.stdout:1/710: link d3/d72/f8b d3/d7/d29/dcf/fdf 0 2024-04-25T22:03:22.963 INFO:tasks.workunit.client.0.smithi044.stdout:6/977: dwrite d2/d23/d5a/d12/d27/d8d/d134/fdc [0,4194304] 0 2024-04-25T22:03:22.965 INFO:tasks.workunit.client.0.smithi044.stdout:5/906: dwrite d2/f4 [4194304,4194304] 0 2024-04-25T22:03:22.966 INFO:tasks.workunit.client.0.smithi044.stdout:3/893: mkdir d0/d13/d1c/d93/dad/d12f 0 2024-04-25T22:03:22.967 INFO:tasks.workunit.client.0.smithi044.stdout:0/779: creat d8/df/d17/d45/d95/d51/d8b/db0/f107 x:0 0 0 2024-04-25T22:03:22.967 INFO:tasks.workunit.client.0.smithi044.stdout:5/907: write d2/dad/f11d [5188715,30367] 0 2024-04-25T22:03:22.968 INFO:tasks.workunit.client.0.smithi044.stdout:1/711: dread d3/d7/db/d5d/d7f/fb3 [4194304,4194304] 0 2024-04-25T22:03:22.969 INFO:tasks.workunit.client.0.smithi044.stdout:1/712: dread - d3/d7/db/d5d/d7f/fa4 zero size 2024-04-25T22:03:22.970 INFO:tasks.workunit.client.0.smithi044.stdout:8/997: dread d2a/d39/d5a/d92/dab/f110 [0,4194304] 0 2024-04-25T22:03:22.970 INFO:tasks.workunit.client.0.smithi044.stdout:3/894: mkdir d0/d1/d15/d81/dd2/d10f/dab/db1/d130 0 2024-04-25T22:03:22.970 INFO:tasks.workunit.client.0.smithi044.stdout:9/954: dread d4/d3d/f68 [0,4194304] 0 2024-04-25T22:03:22.970 INFO:tasks.workunit.client.0.smithi044.stdout:0/780: creat d8/df/d17/d87/f108 x:0 0 0 2024-04-25T22:03:22.971 INFO:tasks.workunit.client.0.smithi044.stdout:5/908: rmdir d2/d5/d21/d38/d7c 39 2024-04-25T22:03:22.973 INFO:tasks.workunit.client.0.smithi044.stdout:9/955: creat d4/d7/d79/f13f x:0 0 0 2024-04-25T22:03:22.973 INFO:tasks.workunit.client.0.smithi044.stdout:5/909: symlink d2/d5/d27/d2a/d70/l120 0 2024-04-25T22:03:22.973 INFO:tasks.workunit.client.0.smithi044.stdout:3/895: mknod d0/d1/d15/d51/d8e/df4/c131 0 2024-04-25T22:03:22.973 INFO:tasks.workunit.client.0.smithi044.stdout:0/781: write d8/df/d17/d45/d95/d9c/dcc/f8d [4752494,68640] 0 2024-04-25T22:03:22.974 INFO:tasks.workunit.client.0.smithi044.stdout:4/719: dread dd/f1b [0,4194304] 0 2024-04-25T22:03:22.974 INFO:tasks.workunit.client.0.smithi044.stdout:5/910: fdatasync d2/d5/d27/d2a/d3a/fa6 0 2024-04-25T22:03:22.974 INFO:tasks.workunit.client.0.smithi044.stdout:9/956: mkdir d4/d4b/dac/d140 0 2024-04-25T22:03:22.974 INFO:tasks.workunit.client.0.smithi044.stdout:3/896: symlink d0/d70/d7c/da9/dc0/l132 0 2024-04-25T22:03:22.975 INFO:tasks.workunit.client.0.smithi044.stdout:0/782: unlink d8/da/d60/daa/dbe/fdd 0 2024-04-25T22:03:22.975 INFO:tasks.workunit.client.0.smithi044.stdout:6/978: dread d2/d23/d5a/d12/d49/fe7 [0,4194304] 0 2024-04-25T22:03:22.975 INFO:tasks.workunit.client.0.smithi044.stdout:4/720: fsync dd/d35/d52/d61/d76/fb1 0 2024-04-25T22:03:22.976 INFO:tasks.workunit.client.0.smithi044.stdout:0/783: write d8/da/d60/fff [294510,125788] 0 2024-04-25T22:03:22.976 INFO:tasks.workunit.client.0.smithi044.stdout:9/957: stat d4/d7/d79/ddc/de1/d54/d84/d72/d108 0 2024-04-25T22:03:22.976 INFO:tasks.workunit.client.0.smithi044.stdout:0/784: unlink l5 0 2024-04-25T22:03:22.977 INFO:tasks.workunit.client.0.smithi044.stdout:6/979: creat d2/d23/d5a/d12/d1f/f150 x:0 0 0 2024-04-25T22:03:22.977 INFO:tasks.workunit.client.0.smithi044.stdout:4/721: write dd/d35/d52/fcb [304373,108594] 0 2024-04-25T22:03:22.977 INFO:tasks.workunit.client.0.smithi044.stdout:9/958: rmdir d4/d7/d18/d2e/d94/d13d 0 2024-04-25T22:03:22.977 INFO:tasks.workunit.client.0.smithi044.stdout:0/785: creat d8/df/d17/d45/d95/d9c/f109 x:0 0 0 2024-04-25T22:03:22.978 INFO:tasks.workunit.client.0.smithi044.stdout:6/980: getdents d2/d23/d30 0 2024-04-25T22:03:22.978 INFO:tasks.workunit.client.0.smithi044.stdout:0/786: rmdir d8/db2/d8e 39 2024-04-25T22:03:22.978 INFO:tasks.workunit.client.0.smithi044.stdout:9/959: dread - d4/d7/d18/d2e/d73/f106 zero size 2024-04-25T22:03:22.979 INFO:tasks.workunit.client.0.smithi044.stdout:6/981: dread - d2/d23/d5a/d11/d3b/dc6/d10a/f113 zero size 2024-04-25T22:03:22.979 INFO:tasks.workunit.client.0.smithi044.stdout:4/722: dread dd/f48 [0,4194304] 0 2024-04-25T22:03:22.979 INFO:tasks.workunit.client.0.smithi044.stdout:0/787: rename d8/da/d60/d86/cb5 to d8/df/d17/d45/d95/d51/dc2/c10a 0 2024-04-25T22:03:22.980 INFO:tasks.workunit.client.0.smithi044.stdout:6/982: write d2/d23/d30/f47 [1644422,90489] 0 2024-04-25T22:03:22.980 INFO:tasks.workunit.client.0.smithi044.stdout:0/788: chown f3 3355729 1 2024-04-25T22:03:22.980 INFO:tasks.workunit.client.0.smithi044.stdout:0/789: creat d8/f10b x:0 0 0 2024-04-25T22:03:22.981 INFO:tasks.workunit.client.0.smithi044.stdout:6/983: mkdir d2/d23/d5a/d12/d27/daf/d151 0 2024-04-25T22:03:22.981 INFO:tasks.workunit.client.0.smithi044.stdout:0/790: symlink d8/d78/l10c 0 2024-04-25T22:03:22.982 INFO:tasks.workunit.client.0.smithi044.stdout:1/713: write d3/d7/d29/f39 [375274,18606] 0 2024-04-25T22:03:22.982 INFO:tasks.workunit.client.0.smithi044.stdout:3/897: write d0/d1/d34/f58 [619320,71051] 0 2024-04-25T22:03:22.983 INFO:tasks.workunit.client.0.smithi044.stdout:5/911: truncate d2/d5b/d8e/d10f/dde/de0/ff0 3031103 0 2024-04-25T22:03:22.983 INFO:tasks.workunit.client.0.smithi044.stdout:1/714: symlink d3/d7/db/le0 0 2024-04-25T22:03:22.984 INFO:tasks.workunit.client.0.smithi044.stdout:3/898: chown d0/d13/d1c/d93/da6/dd7/l117 15698 1 2024-04-25T22:03:22.985 INFO:tasks.workunit.client.0.smithi044.stdout:8/998: dwrite d2a/d39/f55 [0,4194304] 0 2024-04-25T22:03:22.985 INFO:tasks.workunit.client.0.smithi044.stdout:5/912: write d2/d5/d21/d26/d2c/d37/fb4 [1839162,8338] 0 2024-04-25T22:03:22.985 INFO:tasks.workunit.client.0.smithi044.stdout:1/715: write d3/d7/db/d5d/d7f/fb3 [971531,17561] 0 2024-04-25T22:03:22.985 INFO:tasks.workunit.client.0.smithi044.stdout:8/999: symlink d2a/d32/l145 0 2024-04-25T22:03:22.986 INFO:tasks.workunit.client.0.smithi044.stdout:9/960: write d4/d7/d18/d3a/ffe [43612,60840] 0 2024-04-25T22:03:22.986 INFO:tasks.workunit.client.0.smithi044.stdout:5/913: rename d2/d5/f18 to d2/dad/df2/f121 0 2024-04-25T22:03:22.986 INFO:tasks.workunit.client.0.smithi044.stdout:3/899: mknod d0/d70/d7c/da9/dc0/d116/c133 0 2024-04-25T22:03:22.987 INFO:tasks.workunit.client.0.smithi044.stdout:5/914: chown d2/f9d 1662079475 1 2024-04-25T22:03:22.987 INFO:tasks.workunit.client.0.smithi044.stdout:9/961: symlink d4/d7/d18/d3a/l141 0 2024-04-25T22:03:22.988 INFO:tasks.workunit.client.0.smithi044.stdout:9/962: creat d4/d7/d79/ddc/de1/d54/d84/ddb/f142 x:0 0 0 2024-04-25T22:03:22.989 INFO:tasks.workunit.client.0.smithi044.stdout:3/900: creat d0/d1/d15/f134 x:0 0 0 2024-04-25T22:03:22.990 INFO:tasks.workunit.client.0.smithi044.stdout:7/657: sync 2024-04-25T22:03:22.990 INFO:tasks.workunit.client.0.smithi044.stdout:9/963: creat d4/d3d/d66/db9/dbe/f143 x:0 0 0 2024-04-25T22:03:22.990 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:22.990 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:22.991 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:03:22.991 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:03:22.991 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:22.992 INFO:tasks.workunit.client.0.smithi044.stdout:1/716: dread d3/d7/d29/d43/d85/f9e [0,4194304] 0 2024-04-25T22:03:22.992 INFO:tasks.workunit.client.0.smithi044.stdout:6/984: write d2/d23/d5a/d11/d2a/dbf/f97 [652571,69160] 0 2024-04-25T22:03:22.993 INFO:tasks.workunit.client.0.smithi044.stdout:1/717: readlink d3/d7/l28 0 2024-04-25T22:03:22.994 INFO:tasks.workunit.client.0.smithi044.stdout:4/723: dwrite dd/d19/f6d [0,4194304] 0 2024-04-25T22:03:22.995 INFO:tasks.workunit.client.0.smithi044.stdout:6/985: read d2/d23/d5a/d12/fc1 [869922,99872] 0 2024-04-25T22:03:22.996 INFO:tasks.workunit.client.0.smithi044.stdout:4/724: mkdir dd/d35/d52/de9 0 2024-04-25T22:03:22.996 INFO:tasks.workunit.client.0.smithi044.stdout:3/901: dwrite d0/d1/d15/d51/dd/d28/f53 [0,4194304] 0 2024-04-25T22:03:22.996 INFO:tasks.workunit.client.0.smithi044.stdout:1/718: read d3/f34 [1418280,3848] 0 2024-04-25T22:03:22.997 INFO:tasks.workunit.client.0.smithi044.stdout:4/725: chown dd/d35/l4d 31078 1 2024-04-25T22:03:22.998 INFO:tasks.workunit.client.0.smithi044.stdout:6/986: dread d2/d23/d5a/d13/d68/f137 [0,4194304] 0 2024-04-25T22:03:22.998 INFO:tasks.workunit.client.0.smithi044.stdout:4/726: write dd/d19/f27 [1008004,15410] 0 2024-04-25T22:03:23.000 INFO:tasks.workunit.client.0.smithi044.stdout:1/719: getdents d3/d7/d83 0 2024-04-25T22:03:23.000 INFO:tasks.workunit.client.0.smithi044.stdout:6/987: write d2/d23/d5a/d12/d1f/f150 [340387,61077] 0 2024-04-25T22:03:23.001 INFO:tasks.workunit.client.0.smithi044.stdout:6/988: fsync d2/d23/d5a/d13/f109 0 2024-04-25T22:03:23.001 INFO:tasks.workunit.client.0.smithi044.stdout:7/658: truncate d1c/d22/f71 1015336 0 2024-04-25T22:03:23.001 INFO:tasks.workunit.client.0.smithi044.stdout:7/659: readlink d1c/l1d 0 2024-04-25T22:03:23.007 INFO:tasks.workunit.client.0.smithi044.stdout:3/902: dwrite d0/d1/d15/d51/fe9 [0,4194304] 0 2024-04-25T22:03:23.007 INFO:tasks.workunit.client.0.smithi044.stdout:9/964: write d4/d7/d79/ddc/ff2 [15263,44860] 0 2024-04-25T22:03:23.009 INFO:tasks.workunit.client.0.smithi044.stdout:4/727: dwrite dd/d35/d52/da9/dca/d79/d7f/dc3/fa1 [4194304,4194304] 0 2024-04-25T22:03:23.009 INFO:tasks.workunit.client.0.smithi044.stdout:3/903: dread d0/d1/d15/d51/dd/d11/fd0 [0,4194304] 0 2024-04-25T22:03:23.010 INFO:tasks.workunit.client.0.smithi044.stdout:1/720: dwrite d3/d30/fd8 [0,4194304] 0 2024-04-25T22:03:23.010 INFO:tasks.workunit.client.0.smithi044.stdout:0/791: dread d8/df/d17/d45/d95/d51/d8b/d90/fe6 [0,4194304] 0 2024-04-25T22:03:23.011 INFO:tasks.workunit.client.0.smithi044.stdout:3/904: chown d0/d70/d7c/da9/dc0 10409 1 2024-04-25T22:03:23.013 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:23.013 INFO:tasks.workunit.client.0.smithi044.stdout:6/989: dwrite d2/d23/d30/faa [0,4194304] 0 2024-04-25T22:03:23.016 INFO:tasks.workunit.client.0.smithi044.stdout:3/905: unlink d0/d1/d15/d81/dd2/d10f/dc6/l47 0 2024-04-25T22:03:23.018 INFO:tasks.workunit.client.0.smithi044.stdout:2/795: dread d7/f3f [0,4194304] 0 2024-04-25T22:03:23.018 INFO:tasks.workunit.client.0.smithi044.stdout:0/792: rename d8/df/d17/db9/d7c/f106 to d8/df/f10d 0 2024-04-25T22:03:23.019 INFO:tasks.workunit.client.0.smithi044.stdout:4/728: dwrite dd/ff [0,4194304] 0 2024-04-25T22:03:23.021 INFO:tasks.workunit.client.0.smithi044.stdout:9/965: read d4/d7/d18/f4f [684885,94002] 0 2024-04-25T22:03:23.022 INFO:tasks.workunit.client.0.smithi044.stdout:3/906: dread d0/d13/d1c/f2b [4194304,4194304] 0 2024-04-25T22:03:23.023 INFO:tasks.workunit.client.0.smithi044.stdout:6/990: rename d2/d105/f13d to d2/d23/d30/db0/d146/da7/f152 0 2024-04-25T22:03:23.024 INFO:tasks.workunit.client.0.smithi044.stdout:4/729: creat dd/d35/d52/da9/fea x:0 0 0 2024-04-25T22:03:23.024 INFO:tasks.workunit.client.0.smithi044.stdout:9/966: unlink d4/d3d/d66/db9/dbe/df5/fe2 0 2024-04-25T22:03:23.024 INFO:tasks.workunit.client.0.smithi044.stdout:1/721: dwrite d3/d7/db/f1d [4194304,4194304] 0 2024-04-25T22:03:23.025 INFO:tasks.workunit.client.0.smithi044.stdout:2/796: creat d7/d8/d5f/d70/f10e x:0 0 0 2024-04-25T22:03:23.026 INFO:tasks.workunit.client.0.smithi044.stdout:3/907: unlink d0/d1/d15/d51/d8e/d74/d103/d5d/fc8 0 2024-04-25T22:03:23.026 INFO:tasks.workunit.client.0.smithi044.stdout:6/991: rmdir d2/d23/d5a/d11/d2a/dbf 39 2024-04-25T22:03:23.026 INFO:tasks.workunit.client.0.smithi044.stdout:1/722: readlink d3/d7/db/d5d/d7f/la6 0 2024-04-25T22:03:23.027 INFO:tasks.workunit.client.0.smithi044.stdout:2/797: fdatasync d7/d8/d48/fa1 0 2024-04-25T22:03:23.027 INFO:tasks.workunit.client.0.smithi044.stdout:1/723: stat d3/f37 0 2024-04-25T22:03:23.027 INFO:tasks.workunit.client.0.smithi044.stdout:0/793: dwrite d8/df/d17/f83 [4194304,4194304] 0 2024-04-25T22:03:23.027 INFO:tasks.workunit.client.0.smithi044.stdout:3/908: write d0/d1/fe [1606375,55338] 0 2024-04-25T22:03:23.028 INFO:tasks.workunit.client.0.smithi044.stdout:5/915: dread d2/d5/d21/d26/d2c/d37/f58 [0,4194304] 0 2024-04-25T22:03:23.028 INFO:tasks.workunit.client.0.smithi044.stdout:9/967: write d4/d7/d79/ddc/de1/d54/d84/d72/d97/df3/f115 [3710625,111667] 0 2024-04-25T22:03:23.029 INFO:tasks.workunit.client.0.smithi044.stdout:1/724: symlink d3/d7/d29/d43/d85/le1 0 2024-04-25T22:03:23.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:23.025+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:23.031 INFO:tasks.workunit.client.0.smithi044.stdout:2/798: rename d7/d7b/d81/d4e/d86/d6b/dd8/ded/dd4 to d7/d7b/d81/d4e/d86/d6b/dd8/ded/de4/d10f 0 2024-04-25T22:03:23.031 INFO:tasks.workunit.client.0.smithi044.stdout:4/730: link dd/d35/d52/d61/l68 dd/d35/d52/da9/dca/da0/leb 0 2024-04-25T22:03:23.031 INFO:tasks.workunit.client.0.smithi044.stdout:0/794: write d8/df/d93/fa7 [357996,130283] 0 2024-04-25T22:03:23.031 INFO:tasks.workunit.client.0.smithi044.stdout:1/725: write d3/d4b/fd1 [343363,53272] 0 2024-04-25T22:03:23.034 INFO:tasks.workunit.client.0.smithi044.stdout:4/731: symlink dd/d35/d52/da9/dca/da0/lec 0 2024-04-25T22:03:23.034 INFO:tasks.workunit.client.0.smithi044.stdout:2/799: mknod d7/d7b/d81/d4e/d86/d6b/d78/d44/dad/c110 0 2024-04-25T22:03:23.035 INFO:tasks.workunit.client.0.smithi044.stdout:0/795: symlink d8/df/d17/d45/d95/d9c/dcc/dec/l10e 0 2024-04-25T22:03:23.036 INFO:tasks.workunit.client.0.smithi044.stdout:6/992: dwrite d2/d23/d5a/d12/d27/f45 [4194304,4194304] 0 2024-04-25T22:03:23.036 INFO:tasks.workunit.client.0.smithi044.stdout:2/800: chown d7/d7b/d81/d105 104 1 2024-04-25T22:03:23.036 INFO:tasks.workunit.client.0.smithi044.stdout:3/909: dwrite d0/d13/d1c/fc1 [0,4194304] 0 2024-04-25T22:03:23.037 INFO:tasks.workunit.client.0.smithi044.stdout:0/796: chown d8/df/d17/d45/dad/c104 181 1 2024-04-25T22:03:23.037 INFO:tasks.workunit.client.0.smithi044.stdout:1/726: rename d3/d7/d29/l88 to d3/d30/le2 0 2024-04-25T22:03:23.039 INFO:tasks.workunit.client.0.smithi044.stdout:0/797: readlink d8/df/l2d 0 2024-04-25T22:03:23.040 INFO:tasks.workunit.client.0.smithi044.stdout:1/727: mkdir d3/d7/d83/de3 0 2024-04-25T22:03:23.041 INFO:tasks.workunit.client.0.smithi044.stdout:2/801: rmdir d7/d8/d5f/d70/d8a 39 2024-04-25T22:03:23.042 INFO:tasks.workunit.client.0.smithi044.stdout:6/993: mkdir d2/d23/d5a/d11/d2a/dbf/d153 0 2024-04-25T22:03:23.042 INFO:tasks.workunit.client.0.smithi044.stdout:3/910: write d0/d1/d15/d51/d8e/d74/fca [736448,107065] 0 2024-04-25T22:03:23.042 INFO:tasks.workunit.client.0.smithi044.stdout:5/916: dwrite d2/dad/df2/ffb [0,4194304] 0 2024-04-25T22:03:23.042 INFO:tasks.workunit.client.0.smithi044.stdout:3/911: fsync d0/d13/d1c/d93/da6/d8d/d91/fe5 0 2024-04-25T22:03:23.043 INFO:tasks.workunit.client.0.smithi044.stdout:2/802: readlink d7/d7b/l98 0 2024-04-25T22:03:23.043 INFO:tasks.workunit.client.0.smithi044.stdout:4/732: dwrite dd/f4b [4194304,4194304] 0 2024-04-25T22:03:23.043 INFO:tasks.workunit.client.0.smithi044.stdout:5/917: fsync d2/d5/ff4 0 2024-04-25T22:03:23.044 INFO:tasks.workunit.client.0.smithi044.stdout:2/803: stat d7/d8/d48/dd9/c74 0 2024-04-25T22:03:23.044 INFO:tasks.workunit.client.0.smithi044.stdout:3/912: dread - d0/d13/d1c/d93/da6/d8d/d91/fe5 zero size 2024-04-25T22:03:23.045 INFO:tasks.workunit.client.0.smithi044.stdout:7/660: dread d1c/d22/d4a/f81 [0,4194304] 0 2024-04-25T22:03:23.046 INFO:tasks.workunit.client.0.smithi044.stdout:3/913: write d0/d13/d1c/d93/da6/d8d/f12c [518089,14302] 0 2024-04-25T22:03:23.046 INFO:tasks.workunit.client.0.smithi044.stdout:1/728: rmdir d3/d7/d29/d43 39 2024-04-25T22:03:23.046 INFO:tasks.workunit.client.0.smithi044.stdout:6/994: creat d2/d23/d30/db0/d146/da7/f154 x:0 0 0 2024-04-25T22:03:23.047 INFO:tasks.workunit.client.0.smithi044.stdout:6/995: stat d2/d23/d5a/l7c 0 2024-04-25T22:03:23.048 INFO:tasks.workunit.client.0.smithi044.stdout:2/804: creat d7/d7b/f111 x:0 0 0 2024-04-25T22:03:23.048 INFO:tasks.workunit.client.0.smithi044.stdout:5/918: chown d2/d5/d21/d38/d7c/faf 1011276 1 2024-04-25T22:03:23.050 INFO:tasks.workunit.client.0.smithi044.stdout:3/914: creat d0/d13/d1c/d93/dad/d12f/f135 x:0 0 0 2024-04-25T22:03:23.051 INFO:tasks.workunit.client.0.smithi044.stdout:7/661: creat d1c/d22/d28/fc8 x:0 0 0 2024-04-25T22:03:23.051 INFO:tasks.workunit.client.0.smithi044.stdout:6/996: write d2/d23/d5a/d12/d1f/fa4 [2485283,35769] 0 2024-04-25T22:03:23.052 INFO:tasks.workunit.client.0.smithi044.stdout:7/662: write d1c/f47 [5219125,77644] 0 2024-04-25T22:03:23.052 INFO:tasks.workunit.client.0.smithi044.stdout:4/733: dwrite dd/d35/d52/da9/dca/d79/d7f/f85 [4194304,4194304] 0 2024-04-25T22:03:23.052 INFO:tasks.workunit.client.0.smithi044.stdout:1/729: rename d3/d7/db/d5d/d7f/d97/c5b to d3/d54/d76/ce4 0 2024-04-25T22:03:23.052 INFO:tasks.workunit.client.0.smithi044.stdout:2/805: getdents d7/d8/d5f/d70/d8a 0 2024-04-25T22:03:23.053 INFO:tasks.workunit.client.0.smithi044.stdout:0/798: dwrite d8/da/f7a [0,4194304] 0 2024-04-25T22:03:23.055 INFO:tasks.workunit.client.0.smithi044.stdout:4/734: truncate dd/d35/d52/da9/dca/d79/d7f/dc3/fa7 457392 0 2024-04-25T22:03:23.056 INFO:tasks.workunit.client.0.smithi044.stdout:0/799: mkdir d8/d78/db8/dfa/d10f 0 2024-04-25T22:03:23.057 INFO:tasks.workunit.client.0.smithi044.stdout:1/730: stat d3/d7/d29/d43/d85/cc9 0 2024-04-25T22:03:23.059 INFO:tasks.workunit.client.0.smithi044.stdout:1/731: symlink d3/d54/le5 0 2024-04-25T22:03:23.067 INFO:tasks.workunit.client.0.smithi044.stdout:3/915: rename d0/d13/d1c/d93 to d0/d1/d15/d23/d136 0 2024-04-25T22:03:23.067 INFO:tasks.workunit.client.0.smithi044.stdout:2/806: rename d7/d8/d48/dd9/d4b/l7e to d7/d8/d5f/d70/l112 0 2024-04-25T22:03:23.068 INFO:tasks.workunit.client.0.smithi044.stdout:3/916: mknod d0/d1/d15/d51/dd/d11/d8a/d11a/c137 0 2024-04-25T22:03:23.069 INFO:tasks.workunit.client.0.smithi044.stdout:0/800: rename d8/df/d93/lbc to d8/df/d17/d45/d95/d51/dc2/l110 0 2024-04-25T22:03:23.069 INFO:tasks.workunit.client.0.smithi044.stdout:2/807: mknod d7/d8/d48/dd9/d4b/dc1/de1/c113 0 2024-04-25T22:03:23.069 INFO:tasks.workunit.client.0.smithi044.stdout:0/801: write f6 [4110470,64870] 0 2024-04-25T22:03:23.069 INFO:tasks.workunit.client.0.smithi044.stdout:0/802: creat d8/f111 x:0 0 0 2024-04-25T22:03:23.070 INFO:tasks.workunit.client.0.smithi044.stdout:2/808: truncate d7/d8/d1c/d77/f102 657330 0 2024-04-25T22:03:23.073 INFO:tasks.workunit.client.0.smithi044.stdout:9/968: sync 2024-04-25T22:03:23.075 INFO:tasks.workunit.client.0.smithi044.stdout:9/969: symlink d4/d4b/d86/l144 0 2024-04-25T22:03:23.075 INFO:tasks.workunit.client.0.smithi044.stdout:3/917: dwrite d0/d1/d15/d23/d60/f9a [0,4194304] 0 2024-04-25T22:03:23.076 INFO:tasks.workunit.client.0.smithi044.stdout:3/918: creat d0/d70/d7c/f138 x:0 0 0 2024-04-25T22:03:23.076 INFO:tasks.workunit.client.0.smithi044.stdout:0/803: dwrite d8/db2/d8e/fc3 [4194304,4194304] 0 2024-04-25T22:03:23.076 INFO:tasks.workunit.client.0.smithi044.stdout:9/970: rmdir d4/d3d/d66/ddd 0 2024-04-25T22:03:23.078 INFO:tasks.workunit.client.0.smithi044.stdout:0/804: read d8/da/f7a [2339343,56832] 0 2024-04-25T22:03:23.078 INFO:tasks.workunit.client.0.smithi044.stdout:3/919: chown d0/d1/d15/d23/d136/da6/d8d/f10b 6 1 2024-04-25T22:03:23.079 INFO:tasks.workunit.client.0.smithi044.stdout:0/805: fdatasync d8/d78/db8/fcd 0 2024-04-25T22:03:23.079 INFO:tasks.workunit.client.0.smithi044.stdout:0/806: stat d8/f111 0 2024-04-25T22:03:23.079 INFO:tasks.workunit.client.0.smithi044.stdout:0/807: chown d8/df/d17/d87 126 1 2024-04-25T22:03:23.079 INFO:tasks.workunit.client.0.smithi044.stdout:7/663: dread d1c/d22/d28/d4e/f73 [0,4194304] 0 2024-04-25T22:03:23.081 INFO:tasks.workunit.client.0.smithi044.stdout:7/664: fsync d1c/d22/d28/d30/f84 0 2024-04-25T22:03:23.084 INFO:tasks.workunit.client.0.smithi044.stdout:7/665: rename d1c/d22/d4a/l4d to d1c/d22/d28/d57/d7c/lc9 0 2024-04-25T22:03:23.084 INFO:tasks.workunit.client.0.smithi044.stdout:3/920: dwrite d0/d1/f7e [0,4194304] 0 2024-04-25T22:03:23.084 INFO:tasks.workunit.client.0.smithi044.stdout:7/666: fsync d1c/f47 0 2024-04-25T22:03:23.085 INFO:tasks.workunit.client.0.smithi044.stdout:7/667: symlink d1c/d88/lca 0 2024-04-25T22:03:23.086 INFO:tasks.workunit.client.0.smithi044.stdout:7/668: readlink l1a 0 2024-04-25T22:03:23.086 INFO:tasks.workunit.client.0.smithi044.stdout:9/971: dwrite d4/d7/d79/ddc/de1/d54/d84/d72/f87 [0,4194304] 0 2024-04-25T22:03:23.086 INFO:tasks.workunit.client.0.smithi044.stdout:3/921: symlink d0/d1/d15/d51/dd/l139 0 2024-04-25T22:03:23.087 INFO:tasks.workunit.client.0.smithi044.stdout:7/669: write d1c/d22/d28/d30/d32/d97/fb7 [819237,102043] 0 2024-04-25T22:03:23.087 INFO:tasks.workunit.client.0.smithi044.stdout:9/972: creat d4/d7/d18/d2e/db5/f145 x:0 0 0 2024-04-25T22:03:23.087 INFO:tasks.workunit.client.0.smithi044.stdout:3/922: symlink d0/d1/d15/d51/d8e/d74/de4/l13a 0 2024-04-25T22:03:23.088 INFO:tasks.workunit.client.0.smithi044.stdout:7/670: mknod d1c/d22/d28/d4e/ccb 0 2024-04-25T22:03:23.089 INFO:tasks.workunit.client.0.smithi044.stdout:9/973: write d4/d7/d18/d3a/ffe [1235779,12346] 0 2024-04-25T22:03:23.089 INFO:tasks.workunit.client.0.smithi044.stdout:7/671: mkdir d1c/d22/d4a/dcc 0 2024-04-25T22:03:23.090 INFO:tasks.workunit.client.0.smithi044.stdout:7/672: symlink d1c/d22/d28/d66/lcd 0 2024-04-25T22:03:23.092 INFO:tasks.workunit.client.0.smithi044.stdout:7/673: mkdir d1c/d88/d8f/dce 0 2024-04-25T22:03:23.092 INFO:tasks.workunit.client.0.smithi044.stdout:7/674: chown d1c/d22/d28/d4e/d7b 603266173 1 2024-04-25T22:03:23.093 INFO:tasks.workunit.client.0.smithi044.stdout:7/675: mknod d1c/d22/d28/d4e/ccf 0 2024-04-25T22:03:23.096 INFO:tasks.workunit.client.0.smithi044.stdout:3/923: dwrite d0/d1/d15/d51/dd/d28/fba [0,4194304] 0 2024-04-25T22:03:23.096 INFO:tasks.workunit.client.0.smithi044.stdout:0/808: write d8/d20/fc0 [588571,57673] 0 2024-04-25T22:03:23.097 INFO:tasks.workunit.client.0.smithi044.stdout:7/676: link d1c/d22/d28/d30/d32/f43 d1c/d22/d28/d4e/da1/fd0 0 2024-04-25T22:03:23.099 INFO:tasks.workunit.client.0.smithi044.stdout:7/677: readlink d1c/d22/d28/d30/lc2 0 2024-04-25T22:03:23.099 INFO:tasks.workunit.client.0.smithi044.stdout:0/809: write d8/da/d60/daa/f100 [559681,4326] 0 2024-04-25T22:03:23.099 INFO:tasks.workunit.client.0.smithi044.stdout:4/735: dwrite dd/d35/d52/d61/f66 [0,4194304] 0 2024-04-25T22:03:23.099 INFO:tasks.workunit.client.0.smithi044.stdout:5/919: dread d2/d5/d6a/f104 [0,4194304] 0 2024-04-25T22:03:23.100 INFO:tasks.workunit.client.0.smithi044.stdout:1/732: dwrite d3/d7/db/d5d/d7f/d97/d99/fad [0,4194304] 0 2024-04-25T22:03:23.100 INFO:tasks.workunit.client.0.smithi044.stdout:0/810: unlink d8/f11 0 2024-04-25T22:03:23.101 INFO:tasks.workunit.client.0.smithi044.stdout:5/920: symlink d2/d5/d27/d2a/d48/l122 0 2024-04-25T22:03:23.102 INFO:tasks.workunit.client.0.smithi044.stdout:7/678: creat d1c/d22/d28/d30/fd1 x:0 0 0 2024-04-25T22:03:23.102 INFO:tasks.workunit.client.0.smithi044.stdout:5/921: fsync d2/d5/d21/d26/f110 0 2024-04-25T22:03:23.103 INFO:tasks.workunit.client.0.smithi044.stdout:3/924: rename d0/d1 to d0/d70/d7c/da9/dc0/d13b 0 2024-04-25T22:03:23.103 INFO:tasks.workunit.client.0.smithi044.stdout:9/974: write d4/d7/d18/d2e/d94/fbd [854797,98960] 0 2024-04-25T22:03:23.104 INFO:tasks.workunit.client.0.smithi044.stdout:0/811: getdents d8/df/d17/db9/dd8 0 2024-04-25T22:03:23.104 INFO:tasks.workunit.client.0.smithi044.stdout:4/736: rename dd/d35/c51 to dd/d19/daf/ced 0 2024-04-25T22:03:23.104 INFO:tasks.workunit.client.0.smithi044.stdout:5/922: creat d2/d5/d21/d26/d2c/d37/f123 x:0 0 0 2024-04-25T22:03:23.105 INFO:tasks.workunit.client.0.smithi044.stdout:1/733: rename d3/d7/d29/d43/d85/f9e to d3/d7/db/dda/fe6 0 2024-04-25T22:03:23.110 INFO:tasks.workunit.client.0.smithi044.stdout:3/925: creat d0/d70/d7c/da9/dc0/d13b/d34/d95/f13c x:0 0 0 2024-04-25T22:03:23.110 INFO:tasks.workunit.client.0.smithi044.stdout:5/923: write d2/d5/f9 [715279,60250] 0 2024-04-25T22:03:23.114 INFO:tasks.workunit.client.0.smithi044.stdout:1/734: getdents d3/d7/d29/d43/dd6 0 2024-04-25T22:03:23.114 INFO:tasks.workunit.client.0.smithi044.stdout:5/924: chown d2/l1a 12356582 1 2024-04-25T22:03:23.114 INFO:tasks.workunit.client.0.smithi044.stdout:4/737: write dd/d35/d52/f99 [786534,4044] 0 2024-04-25T22:03:23.114 INFO:tasks.workunit.client.0.smithi044.stdout:7/679: dwrite d1c/d22/f34 [0,4194304] 0 2024-04-25T22:03:23.115 INFO:tasks.workunit.client.0.smithi044.stdout:6/997: dread d2/d23/d5a/d12/d49/f5d [0,4194304] 0 2024-04-25T22:03:23.115 INFO:tasks.workunit.client.0.smithi044.stdout:5/925: write d2/d5/d21/f94 [1045666,103290] 0 2024-04-25T22:03:23.115 INFO:tasks.workunit.client.0.smithi044.stdout:2/809: dread d7/d8/d48/dd9/d4b/dc1/de1/fe6 [0,4194304] 0 2024-04-25T22:03:23.116 INFO:tasks.workunit.client.0.smithi044.stdout:9/975: dwrite d4/d7/d79/ddc/de1/d54/d84/d72/f138 [0,4194304] 0 2024-04-25T22:03:23.116 INFO:tasks.workunit.client.0.smithi044.stdout:7/680: mkdir d1c/d22/d28/d66/d6e/dd2 0 2024-04-25T22:03:23.116 INFO:tasks.workunit.client.0.smithi044.stdout:4/738: creat dd/d35/d52/da9/dca/d79/d7f/dc3/fee x:0 0 0 2024-04-25T22:03:23.116 INFO:tasks.workunit.client.0.smithi044.stdout:0/812: dwrite d8/df/d17/d87/fa1 [4194304,4194304] 0 2024-04-25T22:03:23.117 INFO:tasks.workunit.client.0.smithi044.stdout:3/926: truncate d0/d70/d7c/da9/dc0/d13b/f7e 4666864 0 2024-04-25T22:03:23.120 INFO:tasks.workunit.client.0.smithi044.stdout:4/739: write dd/d35/d52/da9/dca/d79/d7f/dc3/fa7 [204891,27616] 0 2024-04-25T22:03:23.121 INFO:tasks.workunit.client.0.smithi044.stdout:4/740: fdatasync dd/d19/f1d 0 2024-04-25T22:03:23.121 INFO:tasks.workunit.client.0.smithi044.stdout:2/810: rename d7/d7b/d81/d4e/d86/d6b/dd8/ded/de4/d10f/dec to d7/d7b/d81/d105/d114 0 2024-04-25T22:03:23.121 INFO:tasks.workunit.client.0.smithi044.stdout:0/813: creat d8/df/f112 x:0 0 0 2024-04-25T22:03:23.122 INFO:tasks.workunit.client.0.smithi044.stdout:4/741: fdatasync dd/f6c 0 2024-04-25T22:03:23.123 INFO:tasks.workunit.client.0.smithi044.stdout:3/927: rename d0/d70/d7c/da9/dc0/d13b/d15/d51/dd/d28/f5e to d0/d70/d7c/da9/dc0/d13b/d15/d51/f13d 0 2024-04-25T22:03:23.124 INFO:tasks.workunit.client.0.smithi044.stdout:5/926: dwrite d2/d5/d27/d2a/f42 [0,4194304] 0 2024-04-25T22:03:23.124 INFO:tasks.workunit.client.0.smithi044.stdout:0/814: write d8/df/f5d [5339374,116520] 0 2024-04-25T22:03:23.125 INFO:tasks.workunit.client.0.smithi044.stdout:2/811: getdents d7/d7b/d81/d4e/d86 0 2024-04-25T22:03:23.125 INFO:tasks.workunit.client.0.smithi044.stdout:3/928: unlink d0/d13/d1c/f2b 0 2024-04-25T22:03:23.126 INFO:tasks.workunit.client.0.smithi044.stdout:7/681: dread d1c/d22/d28/f58 [0,4194304] 0 2024-04-25T22:03:23.126 INFO:tasks.workunit.client.0.smithi044.stdout:6/998: dwrite d2/d23/d30/db0/d146/ded/f133 [4194304,4194304] 0 2024-04-25T22:03:23.126 INFO:tasks.workunit.client.0.smithi044.stdout:7/682: sync 2024-04-25T22:03:23.126 INFO:tasks.workunit.client.0.smithi044.stdout:4/742: creat dd/d35/fef x:0 0 0 2024-04-25T22:03:23.126 INFO:tasks.workunit.client.0.smithi044.stdout:0/815: creat d8/df/d17/d45/d95/d51/d8b/d90/f113 x:0 0 0 2024-04-25T22:03:23.127 INFO:tasks.workunit.client.0.smithi044.stdout:2/812: read - d7/d8/d48/dd9/fdf zero size 2024-04-25T22:03:23.127 INFO:tasks.workunit.client.0.smithi044.stdout:5/927: write d2/d5/d27/d2a/d3a/f77 [1699936,55275] 0 2024-04-25T22:03:23.129 INFO:tasks.workunit.client.0.smithi044.stdout:6/999: fsync d2/d23/d5a/d12/d27/d8d/d134/dc8/dfa/df2/d123/d63/f120 0 2024-04-25T22:03:23.131 INFO:tasks.workunit.client.0.smithi044.stdout:0/816: mkdir d8/df/d17/d45/d95/d9c/dcc/d114 0 2024-04-25T22:03:23.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:23.129+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:23.132 INFO:tasks.workunit.client.0.smithi044.stdout:5/928: chown d2/d5/d21/d26/d2c/d37/dbb/d9e/lb8 51471797 1 2024-04-25T22:03:23.133 INFO:tasks.workunit.client.0.smithi044.stdout:2/813: link d7/d8/d48/dd9/d2c/fd0 d7/d7b/d81/d57/f115 0 2024-04-25T22:03:23.133 INFO:tasks.workunit.client.0.smithi044.stdout:5/929: readlink d2/d5/d27/d2a/d70/l120 0 2024-04-25T22:03:23.134 INFO:tasks.workunit.client.0.smithi044.stdout:2/814: creat d7/d8/d48/f116 x:0 0 0 2024-04-25T22:03:23.134 INFO:tasks.workunit.client.0.smithi044.stdout:3/929: dwrite d0/d70/d7c/da9/dc0/d13b/d15/d23/d136/da6/d8d/d91/fe5 [0,4194304] 0 2024-04-25T22:03:23.134 INFO:tasks.workunit.client.0.smithi044.stdout:4/743: dwrite dd/ff [0,4194304] 0 2024-04-25T22:03:23.137 INFO:tasks.workunit.client.0.smithi044.stdout:3/930: mknod d0/d70/d7c/da9/dc0/d13b/d15/d51/dd/d11/d8a/c13e 0 2024-04-25T22:03:23.138 INFO:tasks.workunit.client.0.smithi044.stdout:3/931: creat d0/d70/d7c/d11c/f13f x:0 0 0 2024-04-25T22:03:23.139 INFO:tasks.workunit.client.0.smithi044.stdout:3/932: creat d0/d70/d7c/da9/dc0/f140 x:0 0 0 2024-04-25T22:03:23.140 INFO:tasks.workunit.client.0.smithi044.stdout:5/930: dwrite d2/d5/ff4 [0,4194304] 0 2024-04-25T22:03:23.141 INFO:tasks.workunit.client.0.smithi044.stdout:5/931: dread - d2/d5b/d8e/f102 zero size 2024-04-25T22:03:23.141 INFO:tasks.workunit.client.0.smithi044.stdout:3/933: creat d0/d70/d7c/da9/dc0/d13b/d15/d23/d136/da6/dd7/f141 x:0 0 0 2024-04-25T22:03:23.141 INFO:tasks.workunit.client.0.smithi044.stdout:5/932: read d2/d5/d27/d2a/d48/f5a [338915,35208] 0 2024-04-25T22:03:23.142 INFO:tasks.workunit.client.0.smithi044.stdout:3/934: write d0/d70/d7c/f138 [744905,20502] 0 2024-04-25T22:03:23.143 INFO:tasks.workunit.client.0.smithi044.stdout:5/933: rename d2/d5/d21/f94 to d2/d5/f124 0 2024-04-25T22:03:23.143 INFO:tasks.workunit.client.0.smithi044.stdout:5/934: chown d2/d5b/d8e/d10f/ffc 1783045990 1 2024-04-25T22:03:23.143 INFO:tasks.workunit.client.0.smithi044.stdout:3/935: creat d0/d70/d7c/da9/dc0/d13b/d15/d51/dd/d11/d42/f142 x:0 0 0 2024-04-25T22:03:23.144 INFO:tasks.workunit.client.0.smithi044.stdout:5/935: readlink d2/d5/d27/d2a/d48/l89 0 2024-04-25T22:03:23.144 INFO:tasks.workunit.client.0.smithi044.stdout:5/936: chown d2/d5/d27/d2a/d5c/d112 65985280 1 2024-04-25T22:03:23.146 INFO:tasks.workunit.client.0.smithi044.stdout:3/936: write d0/d70/d7c/da9/dc0/d13b/d15/d23/d136/da6/fd1 [529189,121160] 0 2024-04-25T22:03:23.149 INFO:tasks.workunit.client.0.smithi044.stdout:3/937: read d0/d70/d7c/da9/dc0/d13b/d15/d23/d136/da6/d8d/f12c [489957,120741] 0 2024-04-25T22:03:23.150 INFO:tasks.workunit.client.0.smithi044.stdout:3/938: chown d0/d13/f37 111899485 1 2024-04-25T22:03:23.152 INFO:tasks.workunit.client.0.smithi044.stdout:3/939: mknod d0/d70/d7c/da9/dc0/d13b/d15/d81/dd2/d10f/dc6/d44/c143 0 2024-04-25T22:03:23.152 INFO:tasks.workunit.client.0.smithi044.stdout:3/940: chown d0/d70/d7c/da9/dc0/d13b/d15/d51/dd/l139 95714 1 2024-04-25T22:03:23.153 INFO:tasks.workunit.client.0.smithi044.stdout:3/941: creat d0/d70/d7c/da9/dc0/d13b/d15/d51/d8e/d74/f144 x:0 0 0 2024-04-25T22:03:23.154 INFO:tasks.workunit.client.0.smithi044.stdout:3/942: creat d0/d70/d7c/da9/dc0/d13b/d15/d23/d136/da6/d8d/d91/f145 x:0 0 0 2024-04-25T22:03:23.160 INFO:tasks.workunit.client.0.smithi044.stdout:3/943: dwrite d0/d70/d7c/da9/dc0/f106 [0,4194304] 0 2024-04-25T22:03:23.161 INFO:tasks.workunit.client.0.smithi044.stdout:3/944: fdatasync d0/d70/d7c/da9/dc0/d13b/d15/d23/d136/da6/dd7/f141 0 2024-04-25T22:03:23.162 INFO:tasks.workunit.client.0.smithi044.stdout:3/945: symlink d0/d70/d7c/da9/dc0/d13b/d15/d81/dd2/d10f/dc6/d44/l146 0 2024-04-25T22:03:23.167 INFO:tasks.workunit.client.0.smithi044.stdout:0/817: dread d8/df/f10 [0,4194304] 0 2024-04-25T22:03:23.169 INFO:tasks.workunit.client.0.smithi044.stdout:0/818: read d8/df/d17/d45/d95/fe4 [2234587,82270] 0 2024-04-25T22:03:23.169 INFO:tasks.workunit.client.0.smithi044.stdout:0/819: write d8/f2b [3862803,90209] 0 2024-04-25T22:03:23.169 INFO:tasks.workunit.client.0.smithi044.stdout:4/744: read dd/d35/d52/da9/dca/d79/d7f/dc3/faa [22734,98250] 0 2024-04-25T22:03:23.171 INFO:tasks.workunit.client.0.smithi044.stdout:0/820: rename d8/db2/d8e/cb4 to d8/df/d88/db6/c115 0 2024-04-25T22:03:23.171 INFO:tasks.workunit.client.0.smithi044.stdout:0/821: getdents d8/da/d60 0 2024-04-25T22:03:23.172 INFO:tasks.workunit.client.0.smithi044.stdout:0/822: fsync d8/df/fa5 0 2024-04-25T22:03:23.172 INFO:tasks.workunit.client.0.smithi044.stdout:0/823: chown d8/df/d17/db9/cb1 1758 1 2024-04-25T22:03:23.174 INFO:tasks.workunit.client.0.smithi044.stdout:0/824: read d8/da/d60/d86/fdf [36131,57258] 0 2024-04-25T22:03:23.175 INFO:tasks.workunit.client.0.smithi044.stdout:9/976: truncate d4/d3d/f9c 16927 0 2024-04-25T22:03:23.176 INFO:tasks.workunit.client.0.smithi044.stdout:2/815: write d7/d7b/d81/d4e/f59 [337612,42011] 0 2024-04-25T22:03:23.177 INFO:tasks.workunit.client.0.smithi044.stdout:4/745: truncate dd/d35/d52/da9/dca/d79/d7f/d81/f64 2399375 0 2024-04-25T22:03:23.179 INFO:tasks.workunit.client.0.smithi044.stdout:4/746: chown dd/d19/f6d 0 1 2024-04-25T22:03:23.179 INFO:tasks.workunit.client.0.smithi044.stdout:7/683: dread d1c/d22/d28/d30/f46 [0,4194304] 0 2024-04-25T22:03:23.179 INFO:tasks.workunit.client.0.smithi044.stdout:2/816: truncate d7/d8/d48/fe0 215570 0 2024-04-25T22:03:23.179 INFO:tasks.workunit.client.0.smithi044.stdout:4/747: chown dd/d35 31379 1 2024-04-25T22:03:23.180 INFO:tasks.workunit.client.0.smithi044.stdout:0/825: dread d8/db2/d8e/fc3 [4194304,4194304] 0 2024-04-25T22:03:23.180 INFO:tasks.workunit.client.0.smithi044.stdout:2/817: fdatasync d7/d8/d48/dd9/d2c/d50/f90 0 2024-04-25T22:03:23.180 INFO:tasks.workunit.client.0.smithi044.stdout:1/735: dwrite d3/d7/d29/dcf/fdf [0,4194304] 0 2024-04-25T22:03:23.181 INFO:tasks.workunit.client.0.smithi044.stdout:4/748: mkdir dd/d35/d52/da9/dca/db6/df0 0 2024-04-25T22:03:23.181 INFO:tasks.workunit.client.0.smithi044.stdout:0/826: stat d8/d20/c5f 0 2024-04-25T22:03:23.181 INFO:tasks.workunit.client.0.smithi044.stdout:9/977: write d4/d7/f4d [2109754,71204] 0 2024-04-25T22:03:23.182 INFO:tasks.workunit.client.0.smithi044.stdout:2/818: dread - d7/d8/d5f/d70/f10e zero size 2024-04-25T22:03:23.183 INFO:tasks.workunit.client.0.smithi044.stdout:0/827: mkdir d8/df/d17/d87/d116 0 2024-04-25T22:03:23.185 INFO:tasks.workunit.client.0.smithi044.stdout:4/749: creat dd/d19/ff1 x:0 0 0 2024-04-25T22:03:23.185 INFO:tasks.workunit.client.0.smithi044.stdout:2/819: creat d7/d7b/d81/d4e/d86/d6b/f117 x:0 0 0 2024-04-25T22:03:23.186 INFO:tasks.workunit.client.0.smithi044.stdout:9/978: symlink d4/d7/d18/d2e/l146 0 2024-04-25T22:03:23.186 INFO:tasks.workunit.client.0.smithi044.stdout:5/937: dread d2/d5/f16 [4194304,4194304] 0 2024-04-25T22:03:23.188 INFO:tasks.workunit.client.0.smithi044.stdout:3/946: dread d0/d70/d7c/da9/dc0/d13b/d15/d51/dd/d28/f3f [0,4194304] 0 2024-04-25T22:03:23.188 INFO:tasks.workunit.client.0.smithi044.stdout:5/938: unlink d2/d5/f124 0 2024-04-25T22:03:23.188 INFO:tasks.workunit.client.0.smithi044.stdout:1/736: dwrite d3/d30/f31 [0,4194304] 0 2024-04-25T22:03:23.188 INFO:tasks.workunit.client.0.smithi044.stdout:0/828: rename d8/df/d17/d45/d95/d51/f84 to d8/df/f117 0 2024-04-25T22:03:23.189 INFO:tasks.workunit.client.0.smithi044.stdout:9/979: write d4/d7/d79/ddc/de1/d54/d84/d72/f95 [1365347,73821] 0 2024-04-25T22:03:23.190 INFO:tasks.workunit.client.0.smithi044.stdout:7/684: dread d1c/d22/d28/d66/d6e/f9d [0,4194304] 0 2024-04-25T22:03:23.191 INFO:tasks.workunit.client.0.smithi044.stdout:3/947: write d0/d70/d7c/da9/dc0/d13b/d15/d51/dd/d28/f3f [725675,116115] 0 2024-04-25T22:03:23.191 INFO:tasks.workunit.client.0.smithi044.stdout:9/980: creat d4/d7/d18/d2e/f147 x:0 0 0 2024-04-25T22:03:23.191 INFO:tasks.workunit.client.0.smithi044.stdout:0/829: write d8/df/d17/d45/d95/d51/d8b/d90/fc9 [2832547,88089] 0 2024-04-25T22:03:23.192 INFO:tasks.workunit.client.0.smithi044.stdout:9/981: readlink d4/d7/l98 0 2024-04-25T22:03:23.193 INFO:tasks.workunit.client.0.smithi044.stdout:4/750: dread dd/d35/d52/fb0 [0,4194304] 0 2024-04-25T22:03:23.193 INFO:tasks.workunit.client.0.smithi044.stdout:3/948: mkdir d0/d70/d7c/da9/dc0/d13b/d15/d23/d147 0 2024-04-25T22:03:23.193 INFO:tasks.workunit.client.0.smithi044.stdout:0/830: read d8/df/d88/db6/fd4 [858596,115188] 0 2024-04-25T22:03:23.194 INFO:tasks.workunit.client.0.smithi044.stdout:3/949: mkdir d0/d70/d7c/da9/dc0/d13b/d148 0 2024-04-25T22:03:23.194 INFO:tasks.workunit.client.0.smithi044.stdout:9/982: symlink d4/d7/d79/ddc/de1/d54/d84/d72/d97/df3/l148 0 2024-04-25T22:03:23.194 INFO:tasks.workunit.client.0.smithi044.stdout:0/831: creat d8/df/d17/d45/d95/d51/dc2/f118 x:0 0 0 2024-04-25T22:03:23.195 INFO:tasks.workunit.client.0.smithi044.stdout:1/737: truncate d3/d7/f23 5619499 0 2024-04-25T22:03:23.195 INFO:tasks.workunit.client.0.smithi044.stdout:5/939: write d2/d5/d27/d2a/d48/f5a [1425574,82704] 0 2024-04-25T22:03:23.195 INFO:tasks.workunit.client.0.smithi044.stdout:7/685: write d1c/d22/d28/d4e/da1/fd0 [2555690,97532] 0 2024-04-25T22:03:23.196 INFO:tasks.workunit.client.0.smithi044.stdout:3/950: symlink d0/d70/d7c/da9/dc0/d13b/d15/d51/d8e/d74/d103/l149 0 2024-04-25T22:03:23.197 INFO:tasks.workunit.client.0.smithi044.stdout:4/751: read dd/f4b [901232,75630] 0 2024-04-25T22:03:23.197 INFO:tasks.workunit.client.0.smithi044.stdout:0/832: mknod d8/df/d17/d45/d95/d51/d8b/db0/c119 0 2024-04-25T22:03:23.197 INFO:tasks.workunit.client.0.smithi044.stdout:1/738: creat d3/d7/d83/fe7 x:0 0 0 2024-04-25T22:03:23.197 INFO:tasks.workunit.client.0.smithi044.stdout:0/833: write d8/db2/f101 [872076,94976] 0 2024-04-25T22:03:23.198 INFO:tasks.workunit.client.0.smithi044.stdout:4/752: mkdir dd/d35/d52/da9/dca/d9d/df2 0 2024-04-25T22:03:23.198 INFO:tasks.workunit.client.0.smithi044.stdout:5/940: link d2/d5/d21/d38/l106 d2/d5/d21/d26/d2c/l125 0 2024-04-25T22:03:23.199 INFO:tasks.workunit.client.0.smithi044.stdout:3/951: mknod d0/d70/d7c/da9/dc0/d13b/d15/d23/c14a 0 2024-04-25T22:03:23.199 INFO:tasks.workunit.client.0.smithi044.stdout:0/834: fdatasync d8/df/d17/d45/d95/fe4 0 2024-04-25T22:03:23.199 INFO:tasks.workunit.client.0.smithi044.stdout:1/739: rename d3/d7/d29/d43/c73 to d3/d7/db/d5d/d7f/ce8 0 2024-04-25T22:03:23.200 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:23.200 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:03:23.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:03:23.200 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:23.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.200 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:4 4.32 e51/16 4:4def72d4:::10000000003.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:03:23.200 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.205397384000001, 2024-04-25T22:03:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10987878, 2024-04-25T22:03:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992461+0000", 2024-04-25T22:03:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5780000000000001e-06 2024-04-25T22:03:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997784+0000", 2024-04-25T22:03:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005323627 2024-04-25T22:03:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997815+0000", 2024-04-25T22:03:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0066999999999999e-05 2024-04-25T22:03:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997830+0000", 2024-04-25T22:03:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5290000000000001e-05 2024-04-25T22:03:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997927+0000", 2024-04-25T22:03:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7391000000000003e-05 2024-04-25T22:03:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997947+0000", 2024-04-25T22:03:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0259999999999999e-05 2024-04-25T22:03:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102225+0000", 2024-04-25T22:03:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10427777100000001 2024-04-25T22:03:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102337+0000", 2024-04-25T22:03:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000111796 2024-04-25T22:03:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:6 4.13 e51/16 4:cbe72331:::10000000003.00000002:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.110583399999999, 2024-04-25T22:03:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.11536371400000001, 2024-04-25T22:03:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087273+0000", 2024-04-25T22:03:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:03:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089358+0000", 2024-04-25T22:03:23.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0020848170000000001 2024-04-25T22:03:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089372+0000", 2024-04-25T22:03:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.452e-05 2024-04-25T22:03:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089381+0000", 2024-04-25T22:03:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5979999999999997e-06 2024-04-25T22:03:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089486+0000", 2024-04-25T22:03:23.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105573 2024-04-25T22:03:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089536+0000", 2024-04-25T22:03:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9505000000000001e-05 2024-04-25T22:03:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202556+0000", 2024-04-25T22:03:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.113020169 2024-04-25T22:03:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202636+0000", 2024-04-25T22:03:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9814000000000005e-05 2024-04-25T22:03:23.208 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:5 4.10 e51/16 4:09a4c37f:::10000000003.00000001:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.098007483, 2024-04-25T22:03:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.110104358, 2024-04-25T22:03:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099849+0000", 2024-04-25T22:03:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7000000000000003e-07 2024-04-25T22:03:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108349+0000", 2024-04-25T22:03:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085003230000000006 2024-04-25T22:03:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108391+0000", 2024-04-25T22:03:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2011999999999997e-05 2024-04-25T22:03:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108415+0000", 2024-04-25T22:03:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3702000000000001e-05 2024-04-25T22:03:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108504+0000", 2024-04-25T22:03:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8684999999999995e-05 2024-04-25T22:03:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108520+0000", 2024-04-25T22:03:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5931999999999999e-05 2024-04-25T22:03:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209918+0000", 2024-04-25T22:03:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.101398696 2024-04-25T22:03:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209952+0000", 2024-04-25T22:03:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4038000000000002e-05 2024-04-25T22:03:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11 4.28 e51/49 4:177a762d:::10000000201.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.089305556999999, 2024-04-25T22:03:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098799331000000004, 2024-04-25T22:03:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:23.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:23.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108551+0000", 2024-04-25T22:03:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0699999999999996e-07 2024-04-25T22:03:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108576+0000", 2024-04-25T22:03:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4856000000000001e-05 2024-04-25T22:03:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108593+0000", 2024-04-25T22:03:23.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7125999999999998e-05 2024-04-25T22:03:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108609+0000", 2024-04-25T22:03:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6535999999999999e-05 2024-04-25T22:03:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108713+0000", 2024-04-25T22:03:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010344999999999999 2024-04-25T22:03:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108762+0000", 2024-04-25T22:03:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8711000000000002e-05 2024-04-25T22:03:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207305+0000", 2024-04-25T22:03:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098543566999999999 2024-04-25T22:03:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207349+0000", 2024-04-25T22:03:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4178000000000003e-05 2024-04-25T22:03:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:12 4.28 e51/49 4:15246602:::10000000202.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:03:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.089224265999999, 2024-04-25T22:03:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098749009999999998, 2024-04-25T22:03:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108632+0000", 2024-04-25T22:03:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2699999999999999e-07 2024-04-25T22:03:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108647+0000", 2024-04-25T22:03:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4585e-05 2024-04-25T22:03:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108667+0000", 2024-04-25T22:03:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9887000000000001e-05 2024-04-25T22:03:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108680+0000", 2024-04-25T22:03:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3249e-05 2024-04-25T22:03:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109917+0000", 2024-04-25T22:03:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012367050000000001 2024-04-25T22:03:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109961+0000", 2024-04-25T22:03:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4029000000000001e-05 2024-04-25T22:03:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207351+0000", 2024-04-25T22:03:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.097390791000000004 2024-04-25T22:03:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207380+0000", 2024-04-25T22:03:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9037e-05 2024-04-25T22:03:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:8 4.3b e51/49 4:deccbd37:::100000001fe.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.089159362, 2024-04-25T22:03:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090839771, 2024-04-25T22:03:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108697+0000", 2024-04-25T22:03:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1399999999999997e-07 2024-04-25T22:03:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108712+0000", 2024-04-25T22:03:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4772e-05 2024-04-25T22:03:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108728+0000", 2024-04-25T22:03:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5943e-05 2024-04-25T22:03:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108740+0000", 2024-04-25T22:03:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.235e-05 2024-04-25T22:03:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108797+0000", 2024-04-25T22:03:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6879000000000002e-05 2024-04-25T22:03:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108812+0000", 2024-04-25T22:03:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5268999999999999e-05 2024-04-25T22:03:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199495+0000", 2024-04-25T22:03:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090683071000000004 2024-04-25T22:03:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199536+0000", 2024-04-25T22:03:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0873e-05 2024-04-25T22:03:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.225 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:6909 4.6 4:631b09cd:::10000001f99.00000000:head [write 0~1706] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.879622+0000", 2024-04-25T22:03:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.318233851999999, 2024-04-25T22:03:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83167118299999998, 2024-04-25T22:03:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 6909 2024-04-25T22:03:23.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879622+0000", 2024-04-25T22:03:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879622+0000", 2024-04-25T22:03:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879624+0000", 2024-04-25T22:03:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.429e-06 2024-04-25T22:03:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879639+0000", 2024-04-25T22:03:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4534e-05 2024-04-25T22:03:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879669+0000", 2024-04-25T22:03:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0349e-05 2024-04-25T22:03:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879684+0000", 2024-04-25T22:03:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:03:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879767+0000", 2024-04-25T22:03:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3410000000000003e-05 2024-04-25T22:03:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879783+0000", 2024-04-25T22:03:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5378000000000001e-05 2024-04-25T22:03:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.700268+0000", 2024-04-25T22:03:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.82048565699999998 2024-04-25T22:03:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.700627+0000", 2024-04-25T22:03:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035847800000000002 2024-04-25T22:03:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.700977+0000", 2024-04-25T22:03:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035024699999999998 2024-04-25T22:03:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.704901+0000", 2024-04-25T22:03:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039243230000000004 2024-04-25T22:03:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711150+0000", 2024-04-25T22:03:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0062490519999999997 2024-04-25T22:03:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711230+0000", 2024-04-25T22:03:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9370999999999996e-05 2024-04-25T22:03:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3221999999999999e-05 2024-04-25T22:03:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:6922 4.6 4:62b4ea5c:::10000001fab.00000000:head [write 0~7953] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.902807+0000", 2024-04-25T22:03:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.295048625, 2024-04-25T22:03:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80868129799999999, 2024-04-25T22:03:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 6922 2024-04-25T22:03:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902807+0000", 2024-04-25T22:03:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902807+0000", 2024-04-25T22:03:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902809+0000", 2024-04-25T22:03:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4099999999999998e-06 2024-04-25T22:03:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902830+0000", 2024-04-25T22:03:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0381999999999999e-05 2024-04-25T22:03:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902852+0000", 2024-04-25T22:03:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2357e-05 2024-04-25T22:03:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902864+0000", 2024-04-25T22:03:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2329e-05 2024-04-25T22:03:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902923+0000", 2024-04-25T22:03:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8485e-05 2024-04-25T22:03:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902930+0000", 2024-04-25T22:03:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4200000000000001e-06 2024-04-25T22:03:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.702506+0000", 2024-04-25T22:03:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.79957517899999997 2024-04-25T22:03:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.702674+0000", 2024-04-25T22:03:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016807200000000001 2024-04-25T22:03:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.702860+0000", 2024-04-25T22:03:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018624200000000001 2024-04-25T22:03:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706186+0000", 2024-04-25T22:03:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033265619999999999 2024-04-25T22:03:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711369+0000", 2024-04-25T22:03:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005182496 2024-04-25T22:03:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711436+0000", 2024-04-25T22:03:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7135e-05 2024-04-25T22:03:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711488+0000", 2024-04-25T22:03:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2228999999999997e-05 2024-04-25T22:03:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:6926 4.6 4:62749b46:::10000001faf.00000000:head [write 0~2676] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.908574+0000", 2024-04-25T22:03:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.289281776999999, 2024-04-25T22:03:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.803246511, 2024-04-25T22:03:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 6926 2024-04-25T22:03:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908574+0000", 2024-04-25T22:03:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908574+0000", 2024-04-25T22:03:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908576+0000", 2024-04-25T22:03:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.784e-06 2024-04-25T22:03:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908585+0000", 2024-04-25T22:03:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6420000000000002e-06 2024-04-25T22:03:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908609+0000", 2024-04-25T22:03:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3303e-05 2024-04-25T22:03:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908622+0000", 2024-04-25T22:03:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3783e-05 2024-04-25T22:03:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908730+0000", 2024-04-25T22:03:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107831 2024-04-25T22:03:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908748+0000", 2024-04-25T22:03:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7909000000000001e-05 2024-04-25T22:03:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.703586+0000", 2024-04-25T22:03:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.794838131 2024-04-25T22:03:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.703854+0000", 2024-04-25T22:03:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026782299999999999 2024-04-25T22:03:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.704060+0000", 2024-04-25T22:03:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020576200000000001 2024-04-25T22:03:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711121+0000", 2024-04-25T22:03:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070615510000000001 2024-04-25T22:03:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711705+0000", 2024-04-25T22:03:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00058315899999999998 2024-04-25T22:03:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711769+0000", 2024-04-25T22:03:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4877999999999998e-05 2024-04-25T22:03:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711820+0000", 2024-04-25T22:03:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0955000000000003e-05 2024-04-25T22:03:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7057 4.6 4:63cd8154:::10000002047.00000000:head [write 0~2047] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.194487+0000", 2024-04-25T22:03:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.003368866999999, 2024-04-25T22:03:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.51749014100000001, 2024-04-25T22:03:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7057 2024-04-25T22:03:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194487+0000", 2024-04-25T22:03:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194487+0000", 2024-04-25T22:03:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194489+0000", 2024-04-25T22:03:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-04-25T22:03:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194499+0000", 2024-04-25T22:03:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0117e-05 2024-04-25T22:03:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194522+0000", 2024-04-25T22:03:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2925000000000002e-05 2024-04-25T22:03:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194541+0000", 2024-04-25T22:03:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9137e-05 2024-04-25T22:03:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194712+0000", 2024-04-25T22:03:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000170602 2024-04-25T22:03:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194743+0000", 2024-04-25T22:03:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1479000000000001e-05 2024-04-25T22:03:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.704997+0000", 2024-04-25T22:03:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.51025366000000005 2024-04-25T22:03:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.705197+0000", 2024-04-25T22:03:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020022799999999999 2024-04-25T22:03:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.705399+0000", 2024-04-25T22:03:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020160499999999999 2024-04-25T22:03:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711586+0000", 2024-04-25T22:03:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061875350000000001 2024-04-25T22:03:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711841+0000", 2024-04-25T22:03:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025510300000000001 2024-04-25T22:03:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711906+0000", 2024-04-25T22:03:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4381999999999994e-05 2024-04-25T22:03:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711977+0000", 2024-04-25T22:03:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1295000000000001e-05 2024-04-25T22:03:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7114 4.6 4:63547153:::10000002086.00000000:head [write 0~67896] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:23.251 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.411903+0000", 2024-04-25T22:03:23.251 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.785952283, 2024-04-25T22:03:23.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.301551715, 2024-04-25T22:03:23.251 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.251 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.251 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:23.251 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:23.251 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.251 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7114 2024-04-25T22:03:23.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.251 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.411903+0000", 2024-04-25T22:03:23.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.411903+0000", 2024-04-25T22:03:23.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.411906+0000", 2024-04-25T22:03:23.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9469999999999999e-06 2024-04-25T22:03:23.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412184+0000", 2024-04-25T22:03:23.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027727600000000002 2024-04-25T22:03:23.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412215+0000", 2024-04-25T22:03:23.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1899000000000001e-05 2024-04-25T22:03:23.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412230+0000", 2024-04-25T22:03:23.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4703e-05 2024-04-25T22:03:23.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412384+0000", 2024-04-25T22:03:23.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015366300000000001 2024-04-25T22:03:23.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:23.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412405+0000", 2024-04-25T22:03:23.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0936000000000001e-05 2024-04-25T22:03:23.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706266+0000", 2024-04-25T22:03:23.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.29386084299999998 2024-04-25T22:03:23.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706440+0000", 2024-04-25T22:03:23.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174759 2024-04-25T22:03:23.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:23.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706655+0000", 2024-04-25T22:03:23.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021489100000000001 2024-04-25T22:03:23.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:23.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711675+0000", 2024-04-25T22:03:23.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050198639999999997 2024-04-25T22:03:23.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:23.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.713316+0000", 2024-04-25T22:03:23.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016410280000000001 2024-04-25T22:03:23.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.713391+0000", 2024-04-25T22:03:23.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5065e-05 2024-04-25T22:03:23.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.713455+0000", 2024-04-25T22:03:23.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3841000000000001e-05 2024-04-25T22:03:23.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.256 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.257 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7117 4.6 4:60a5b603:::10000002089.00000000:head [write 0~12740] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:23.257 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.421192+0000", 2024-04-25T22:03:23.257 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.776663885000001, 2024-04-25T22:03:23.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.29400416200000001, 2024-04-25T22:03:23.257 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.257 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.257 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:23.257 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:23.257 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.257 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7117 2024-04-25T22:03:23.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.257 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421192+0000", 2024-04-25T22:03:23.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421192+0000", 2024-04-25T22:03:23.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421194+0000", 2024-04-25T22:03:23.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3700000000000002e-06 2024-04-25T22:03:23.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421247+0000", 2024-04-25T22:03:23.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2539e-05 2024-04-25T22:03:23.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421278+0000", 2024-04-25T22:03:23.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1392e-05 2024-04-25T22:03:23.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421293+0000", 2024-04-25T22:03:23.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5133000000000001e-05 2024-04-25T22:03:23.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421487+0000", 2024-04-25T22:03:23.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019340899999999999 2024-04-25T22:03:23.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:23.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421506+0000", 2024-04-25T22:03:23.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9568999999999998e-05 2024-04-25T22:03:23.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.709232+0000", 2024-04-25T22:03:23.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.28772543699999997 2024-04-25T22:03:23.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.709416+0000", 2024-04-25T22:03:23.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000184019 2024-04-25T22:03:23.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:23.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.709668+0000", 2024-04-25T22:03:23.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025279000000000002 2024-04-25T22:03:23.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:23.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712068+0000", 2024-04-25T22:03:23.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002399558 2024-04-25T22:03:23.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:23.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.715072+0000", 2024-04-25T22:03:23.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030037800000000002 2024-04-25T22:03:23.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.715143+0000", 2024-04-25T22:03:23.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1000999999999993e-05 2024-04-25T22:03:23.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.715196+0000", 2024-04-25T22:03:23.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3164999999999997e-05 2024-04-25T22:03:23.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.263 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7136 4.6 4:60bfd03c:::100000020a0.00000000:head [write 0~1357] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:23.263 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.489503+0000", 2024-04-25T22:03:23.263 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.708353003999999, 2024-04-25T22:03:23.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.22876102600000001, 2024-04-25T22:03:23.263 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.263 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.263 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:23.263 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:23.263 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.263 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7136 2024-04-25T22:03:23.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.263 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489503+0000", 2024-04-25T22:03:23.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489503+0000", 2024-04-25T22:03:23.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489505+0000", 2024-04-25T22:03:23.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.486e-06 2024-04-25T22:03:23.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489517+0000", 2024-04-25T22:03:23.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.217e-05 2024-04-25T22:03:23.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489544+0000", 2024-04-25T22:03:23.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6852999999999999e-05 2024-04-25T22:03:23.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489559+0000", 2024-04-25T22:03:23.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:03:23.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489705+0000", 2024-04-25T22:03:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014583 2024-04-25T22:03:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489722+0000", 2024-04-25T22:03:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7376000000000001e-05 2024-04-25T22:03:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712122+0000", 2024-04-25T22:03:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.22239948300000001 2024-04-25T22:03:23.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712376+0000", 2024-04-25T22:03:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025398700000000001 2024-04-25T22:03:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712639+0000", 2024-04-25T22:03:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026326300000000002 2024-04-25T22:03:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.714861+0000", 2024-04-25T22:03:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00222236 2024-04-25T22:03:23.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.718091+0000", 2024-04-25T22:03:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032294400000000001 2024-04-25T22:03:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.718197+0000", 2024-04-25T22:03:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010655 2024-04-25T22:03:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.718264+0000", 2024-04-25T22:03:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6482000000000005e-05 2024-04-25T22:03:23.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:299 3.0 3:02ac1934:::200.00000009:head [write 0~3532922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T22:03:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:10.968409+0000", 2024-04-25T22:03:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.229446980000001, 2024-04-25T22:03:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.094675465, 2024-04-25T22:03:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.968409+0000", 2024-04-25T22:03:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.968409+0000", 2024-04-25T22:03:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.968411+0000", 2024-04-25T22:03:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.012e-06 2024-04-25T22:03:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974350+0000", 2024-04-25T22:03:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059392259999999997 2024-04-25T22:03:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974375+0000", 2024-04-25T22:03:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:03:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974386+0000", 2024-04-25T22:03:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0900000000000001e-05 2024-04-25T22:03:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974473+0000", 2024-04-25T22:03:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6942999999999997e-05 2024-04-25T22:03:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974562+0000", 2024-04-25T22:03:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8744000000000003e-05 2024-04-25T22:03:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974706+0000", 2024-04-25T22:03:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014392499999999999 2024-04-25T22:03:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.020272+0000", 2024-04-25T22:03:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.045566723000000003 2024-04-25T22:03:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.062890+0000", 2024-04-25T22:03:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042617796999999999 2024-04-25T22:03:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.063008+0000", 2024-04-25T22:03:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011757 2024-04-25T22:03:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.063084+0000", 2024-04-25T22:03:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6395000000000003e-05 2024-04-25T22:03:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:10648 4.33 e64/49 4:cc614d18:::100000030cb.00000000:head v 64'159, mlcod=64'157)", 2024-04-25T22:03:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:13.541451+0000", 2024-04-25T22:03:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6564050290000001, 2024-04-25T22:03:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.120967456, 2024-04-25T22:03:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.541451+0000", 2024-04-25T22:03:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.541451+0000", 2024-04-25T22:03:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.541453+0000", 2024-04-25T22:03:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3530000000000002e-06 2024-04-25T22:03:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.545862+0000", 2024-04-25T22:03:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004409451 2024-04-25T22:03:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.545895+0000", 2024-04-25T22:03:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2811999999999997e-05 2024-04-25T22:03:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.545918+0000", 2024-04-25T22:03:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2407000000000001e-05 2024-04-25T22:03:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.546085+0000", 2024-04-25T22:03:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000167159 2024-04-25T22:03:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.546149+0000", 2024-04-25T22:03:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4208999999999995e-05 2024-04-25T22:03:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.662281+0000", 2024-04-25T22:03:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.116132255 2024-04-25T22:03:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.662418+0000", 2024-04-25T22:03:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013681000000000001 2024-04-25T22:03:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11198 4.4 e65/16 4:22c4fea3:::10000003262.00000000:head v 65'175, mlcod=65'172)", 2024-04-25T22:03:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:18.240473+0000", 2024-04-25T22:03:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9573824689999997, 2024-04-25T22:03:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.099381791999999997, 2024-04-25T22:03:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.278 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.279 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.240473+0000", 2024-04-25T22:03:23.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.240473+0000", 2024-04-25T22:03:23.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.240474+0000", 2024-04-25T22:03:23.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1299999999999999e-07 2024-04-25T22:03:23.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.247661+0000", 2024-04-25T22:03:23.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0071873630000000004 2024-04-25T22:03:23.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.247677+0000", 2024-04-25T22:03:23.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5624000000000002e-05 2024-04-25T22:03:23.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.247687+0000", 2024-04-25T22:03:23.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9089999999999995e-06 2024-04-25T22:03:23.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.259136+0000", 2024-04-25T22:03:23.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011449002999999999 2024-04-25T22:03:23.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.259154+0000", 2024-04-25T22:03:23.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7849000000000001e-05 2024-04-25T22:03:23.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.339805+0000", 2024-04-25T22:03:23.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.080651013999999993 2024-04-25T22:03:23.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.339855+0000", 2024-04-25T22:03:23.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0317e-05 2024-04-25T22:03:23.282 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.282 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.282 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.282 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11219 4.4 e65/16 4:210cd53e:::100000031ff.00000000:head v 65'177, mlcod=65'173)", 2024-04-25T22:03:23.282 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:18.271403+0000", 2024-04-25T22:03:23.282 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.926452834, 2024-04-25T22:03:23.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.093770510000000001, 2024-04-25T22:03:23.283 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.283 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.283 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.283 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.271403+0000", 2024-04-25T22:03:23.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.271403+0000", 2024-04-25T22:03:23.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.271403+0000", 2024-04-25T22:03:23.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8999999999999998e-07 2024-04-25T22:03:23.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.275340+0000", 2024-04-25T22:03:23.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039364889999999996 2024-04-25T22:03:23.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.275354+0000", 2024-04-25T22:03:23.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4864e-05 2024-04-25T22:03:23.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.275362+0000", 2024-04-25T22:03:23.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9710000000000004e-06 2024-04-25T22:03:23.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.283340+0000", 2024-04-25T22:03:23.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0079778739999999994 2024-04-25T22:03:23.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.283361+0000", 2024-04-25T22:03:23.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1214999999999999e-05 2024-04-25T22:03:23.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.365136+0000", 2024-04-25T22:03:23.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.081774327999999993 2024-04-25T22:03:23.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.365173+0000", 2024-04-25T22:03:23.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-04-25T22:03:23.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.286 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.286 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:11419 4.6 4:6132b542:::100000032bb.00000000:head [write 0~3932160 [2@1004150]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:23.286 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:18.522062+0000", 2024-04-25T22:03:23.287 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6757939569999998, 2024-04-25T22:03:23.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.091966376000000002, 2024-04-25T22:03:23.287 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.287 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.287 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.287 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:23.287 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:23.287 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.287 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 11419 2024-04-25T22:03:23.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.287 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.522062+0000", 2024-04-25T22:03:23.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.522062+0000", 2024-04-25T22:03:23.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.522063+0000", 2024-04-25T22:03:23.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.288e-06 2024-04-25T22:03:23.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527453+0000", 2024-04-25T22:03:23.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0053895530000000001 2024-04-25T22:03:23.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527469+0000", 2024-04-25T22:03:23.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:03:23.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527477+0000", 2024-04-25T22:03:23.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2320000000000001e-06 2024-04-25T22:03:23.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527541+0000", 2024-04-25T22:03:23.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3628999999999997e-05 2024-04-25T22:03:23.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527614+0000", 2024-04-25T22:03:23.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3479000000000006e-05 2024-04-25T22:03:23.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:23.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527727+0000", 2024-04-25T22:03:23.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113094 2024-04-25T22:03:23.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:23.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.547917+0000", 2024-04-25T22:03:23.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.020189983000000002 2024-04-25T22:03:23.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:23.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.613903+0000", 2024-04-25T22:03:23.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065985492000000007 2024-04-25T22:03:23.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.613968+0000", 2024-04-25T22:03:23.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5815000000000006e-05 2024-04-25T22:03:23.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.614028+0000", 2024-04-25T22:03:23.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9667999999999999e-05 2024-04-25T22:03:23.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.292 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.292 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:11421 4.6 4:6132b542:::100000032bb.00000000:head [write 3932160~262144 [2@1004150]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:23.292 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:18.527499+0000", 2024-04-25T22:03:23.292 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6703568290000002, 2024-04-25T22:03:23.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.086691641, 2024-04-25T22:03:23.292 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.292 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.292 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.292 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:23.293 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:23.293 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.293 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 11421 2024-04-25T22:03:23.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.293 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527499+0000", 2024-04-25T22:03:23.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527499+0000", 2024-04-25T22:03:23.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527501+0000", 2024-04-25T22:03:23.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7600000000000001e-06 2024-04-25T22:03:23.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527714+0000", 2024-04-25T22:03:23.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000213919 2024-04-25T22:03:23.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527726+0000", 2024-04-25T22:03:23.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1114000000000001e-05 2024-04-25T22:03:23.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527734+0000", 2024-04-25T22:03:23.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6489999999999997e-06 2024-04-25T22:03:23.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.545454+0000", 2024-04-25T22:03:23.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017720058 2024-04-25T22:03:23.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.545551+0000", 2024-04-25T22:03:23.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6978000000000006e-05 2024-04-25T22:03:23.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:23.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.545713+0000", 2024-04-25T22:03:23.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016178199999999999 2024-04-25T22:03:23.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:23.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.551069+0000", 2024-04-25T22:03:23.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0053559519999999998 2024-04-25T22:03:23.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:23.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.614075+0000", 2024-04-25T22:03:23.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063006329999999999 2024-04-25T22:03:23.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.614148+0000", 2024-04-25T22:03:23.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2821e-05 2024-04-25T22:03:23.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.614190+0000", 2024-04-25T22:03:23.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2277999999999997e-05 2024-04-25T22:03:23.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.297 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.297 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11868 4.3f e66/49 4:ffca00d8:::1000000326a.00000001:head v 66'190, mlcod=66'188)", 2024-04-25T22:03:23.298 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:19.231425+0000", 2024-04-25T22:03:23.298 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.9664306090000001, 2024-04-25T22:03:23.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.097996501, 2024-04-25T22:03:23.298 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:23.298 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:23.298 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.298 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:23.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:23.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.231425+0000", 2024-04-25T22:03:23.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:23.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.231425+0000", 2024-04-25T22:03:23.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:23.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:23.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.231426+0000", 2024-04-25T22:03:23.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.147e-06 2024-04-25T22:03:23.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:23.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.238249+0000", 2024-04-25T22:03:23.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068231810000000002 2024-04-25T22:03:23.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:23.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.238259+0000", 2024-04-25T22:03:23.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9059999999999997e-06 2024-04-25T22:03:23.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.238270+0000", 2024-04-25T22:03:23.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.11e-05 2024-04-25T22:03:23.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:23.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.253394+0000", 2024-04-25T22:03:23.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015123559999999999 2024-04-25T22:03:23.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:23.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.253419+0000", 2024-04-25T22:03:23.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4989000000000001e-05 2024-04-25T22:03:23.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:23.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.329383+0000", 2024-04-25T22:03:23.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.075963944000000005 2024-04-25T22:03:23.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:23.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:23.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:23.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.329422+0000", 2024-04-25T22:03:23.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8674000000000003e-05 2024-04-25T22:03:23.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.301 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:23.301 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:23.302 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:23.304 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:23.296+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:23.304 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:23.319 INFO:tasks.workunit.client.0.smithi044.stdout:4/753: symlink dd/d19/d91/dd9/lf3 0 2024-04-25T22:03:23.319 INFO:tasks.workunit.client.0.smithi044.stdout:0/835: unlink d8/d20/f7d 0 2024-04-25T22:03:23.319 INFO:tasks.workunit.client.0.smithi044.stdout:4/754: readlink dd/d35/d52/lde 0 2024-04-25T22:03:23.319 INFO:tasks.workunit.client.0.smithi044.stdout:0/836: readlink d8/df/d17/d45/dad/lc6 0 2024-04-25T22:03:23.319 INFO:tasks.workunit.client.0.smithi044.stdout:1/740: creat d3/d7/db/d5d/d7f/d97/fe9 x:0 0 0 2024-04-25T22:03:23.319 INFO:tasks.workunit.client.0.smithi044.stdout:4/755: creat dd/d35/ff4 x:0 0 0 2024-04-25T22:03:23.319 INFO:tasks.workunit.client.0.smithi044.stdout:7/686: dwrite d1c/d22/d28/d30/d32/d5d/f7e [0,4194304] 0 2024-04-25T22:03:23.319 INFO:tasks.workunit.client.0.smithi044.stdout:4/756: dread - dd/d35/d52/d61/fcf zero size 2024-04-25T22:03:23.319 INFO:tasks.workunit.client.0.smithi044.stdout:0/837: getdents d8/df/d17/d45/d95/d51/d8b/d90 0 2024-04-25T22:03:23.319 INFO:tasks.workunit.client.0.smithi044.stdout:1/741: creat d3/d7/d29/d43/d85/fea x:0 0 0 2024-04-25T22:03:23.319 INFO:tasks.workunit.client.0.smithi044.stdout:0/838: write d8/db2/fe5 [552817,50138] 0 2024-04-25T22:03:23.319 INFO:tasks.workunit.client.0.smithi044.stdout:1/742: chown d3/d7/db/d5d/cb2 51 1 2024-04-25T22:03:23.319 INFO:tasks.workunit.client.0.smithi044.stdout:4/757: symlink dd/d35/d52/da9/dca/d79/lf5 0 2024-04-25T22:03:23.320 INFO:tasks.workunit.client.0.smithi044.stdout:5/941: truncate d2/dad/f11d 3658161 0 2024-04-25T22:03:23.320 INFO:tasks.workunit.client.0.smithi044.stdout:1/743: rmdir d3/d7/db/d5d/d7f/d97/dd4 0 2024-04-25T22:03:23.320 INFO:tasks.workunit.client.0.smithi044.stdout:4/758: chown dd/d35/d52/d61/f87 46 1 2024-04-25T22:03:23.320 INFO:tasks.workunit.client.0.smithi044.stdout:9/983: dread d4/f1a [0,4194304] 0 2024-04-25T22:03:23.320 INFO:tasks.workunit.client.0.smithi044.stdout:0/839: creat d8/df/d17/f11a x:0 0 0 2024-04-25T22:03:23.320 INFO:tasks.workunit.client.0.smithi044.stdout:5/942: mknod d2/d5/d21/d26/d2c/c126 0 2024-04-25T22:03:23.320 INFO:tasks.workunit.client.0.smithi044.stdout:2/820: dread d7/d7b/d81/d4e/d86/d6b/d78/f5a [0,4194304] 0 2024-04-25T22:03:23.320 INFO:tasks.workunit.client.0.smithi044.stdout:4/759: truncate dd/f48 693596 0 2024-04-25T22:03:23.320 INFO:tasks.workunit.client.0.smithi044.stdout:1/744: truncate d3/d7/db/f46 4238410 0 2024-04-25T22:03:23.320 INFO:tasks.workunit.client.0.smithi044.stdout:0/840: chown d8/df/d17/d45/d95/d51 19573449 1 2024-04-25T22:03:23.320 INFO:tasks.workunit.client.0.smithi044.stdout:4/760: fdatasync dd/ff 0 2024-04-25T22:03:23.320 INFO:tasks.workunit.client.0.smithi044.stdout:5/943: dread - d2/d5/d21/d38/dc8/fe6 zero size 2024-04-25T22:03:23.320 INFO:tasks.workunit.client.0.smithi044.stdout:3/952: dwrite d0/d70/d7c/da9/dc0/d13b/faa [0,4194304] 0 2024-04-25T22:03:23.320 INFO:tasks.workunit.client.0.smithi044.stdout:1/745: stat d3/d7/db/d8f 0 2024-04-25T22:03:23.320 INFO:tasks.workunit.client.0.smithi044.stdout:9/984: creat d4/d7/d79/ddc/de1/d54/d84/d72/d113/d120/f149 x:0 0 0 2024-04-25T22:03:23.321 INFO:tasks.workunit.client.0.smithi044.stdout:1/746: stat d3/d72/ddb 0 2024-04-25T22:03:23.321 INFO:tasks.workunit.client.0.smithi044.stdout:4/761: mknod dd/d35/d52/da9/dca/da0/cf6 0 2024-04-25T22:03:23.321 INFO:tasks.workunit.client.0.smithi044.stdout:7/687: dwrite d1c/d22/d28/d30/d32/d97/fb2 [0,4194304] 0 2024-04-25T22:03:23.321 INFO:tasks.workunit.client.0.smithi044.stdout:1/747: write d3/d7/d29/d43/fa1 [554291,110539] 0 2024-04-25T22:03:23.321 INFO:tasks.workunit.client.0.smithi044.stdout:3/953: chown d0/d70/d7c/da9/dc0/d13b/d15/d23/d136/da6/c55 496 1 2024-04-25T22:03:23.321 INFO:tasks.workunit.client.0.smithi044.stdout:7/688: truncate d1c/d22/d4a/f78 1231296 0 2024-04-25T22:03:23.321 INFO:tasks.workunit.client.0.smithi044.stdout:7/689: chown d1c/d22/d28/d4e/d6a/c8e 35146 1 2024-04-25T22:03:23.321 INFO:tasks.workunit.client.0.smithi044.stdout:4/762: rename dd/d35/d52/l6b to dd/lf7 0 2024-04-25T22:03:23.321 INFO:tasks.workunit.client.0.smithi044.stdout:3/954: truncate d0/d70/d7c/da9/dc0/d13b/d79/f83 1259367 0 2024-04-25T22:03:23.321 INFO:tasks.workunit.client.0.smithi044.stdout:5/944: truncate d2/d5/d21/d26/d2c/f4c 3790258 0 2024-04-25T22:03:23.321 INFO:tasks.workunit.client.0.smithi044.stdout:3/955: stat d0/d70/d7c/da9/dc0/d13b/d34/d48/ce3 0 2024-04-25T22:03:23.321 INFO:tasks.workunit.client.0.smithi044.stdout:5/945: chown d2/d5/d27/d2a/da7 2 1 2024-04-25T22:03:23.321 INFO:tasks.workunit.client.0.smithi044.stdout:9/985: truncate d4/d7/d79/ddc/de1/d54/d84/d72/d113/d128/f83 1282076 0 2024-04-25T22:03:23.321 INFO:tasks.workunit.client.0.smithi044.stdout:4/763: link dd/d35/d52/da9/dca/d79/d9c/cbe dd/d19/d91/cf8 0 2024-04-25T22:03:23.321 INFO:tasks.workunit.client.0.smithi044.stdout:9/986: chown d4/f57 119143 1 2024-04-25T22:03:23.322 INFO:tasks.workunit.client.0.smithi044.stdout:5/946: readlink d2/d5b/d8e/d10f/dde/de0/l113 0 2024-04-25T22:03:23.322 INFO:tasks.workunit.client.0.smithi044.stdout:7/690: sync 2024-04-25T22:03:23.322 INFO:tasks.workunit.client.0.smithi044.stdout:3/956: chown d0/d70/d7c/da9/dc0/d13b/d15/d81/f87 73600046 1 2024-04-25T22:03:23.322 INFO:tasks.workunit.client.0.smithi044.stdout:0/841: dwrite d8/df/d17/d45/d95/d9c/dbd/fd5 [0,4194304] 0 2024-04-25T22:03:23.322 INFO:tasks.workunit.client.0.smithi044.stdout:0/842: sync 2024-04-25T22:03:23.322 INFO:tasks.workunit.client.0.smithi044.stdout:4/764: mkdir dd/d35/d52/da9/dca/df9 0 2024-04-25T22:03:23.322 INFO:tasks.workunit.client.0.smithi044.stdout:7/691: unlink d1c/d22/d28/d66/c7a 0 2024-04-25T22:03:23.322 INFO:tasks.workunit.client.0.smithi044.stdout:1/748: dwrite d3/d7/f69 [0,4194304] 0 2024-04-25T22:03:23.322 INFO:tasks.workunit.client.0.smithi044.stdout:5/947: mknod d2/d5/d27/d2a/d5c/d112/c127 0 2024-04-25T22:03:23.322 INFO:tasks.workunit.client.0.smithi044.stdout:0/843: rmdir d8 39 2024-04-25T22:03:23.322 INFO:tasks.workunit.client.0.smithi044.stdout:3/957: unlink d0/d2/lff 0 2024-04-25T22:03:23.322 INFO:tasks.workunit.client.0.smithi044.stdout:7/692: fsync d1c/f2f 0 2024-04-25T22:03:23.322 INFO:tasks.workunit.client.0.smithi044.stdout:9/987: write d4/d7/d79/ddc/de1/d54/d84/d72/d97/df3/f115 [412489,24826] 0 2024-04-25T22:03:23.322 INFO:tasks.workunit.client.0.smithi044.stdout:0/844: chown d8/df/d88/db6/fd4 11476 1 2024-04-25T22:03:23.323 INFO:tasks.workunit.client.0.smithi044.stdout:9/988: symlink d4/d7/d18/d2e/db5/l14a 0 2024-04-25T22:03:23.323 INFO:tasks.workunit.client.0.smithi044.stdout:7/693: creat d1c/fd3 x:0 0 0 2024-04-25T22:03:23.323 INFO:tasks.workunit.client.0.smithi044.stdout:5/948: creat d2/d5/f128 x:0 0 0 2024-04-25T22:03:23.323 INFO:tasks.workunit.client.0.smithi044.stdout:0/845: fsync d8/df/f40 0 2024-04-25T22:03:23.323 INFO:tasks.workunit.client.0.smithi044.stdout:3/958: unlink d0/d70/d7c/da9/dc0/d13b/d15/d51/dd/d11/d42/c129 0 2024-04-25T22:03:23.323 INFO:tasks.workunit.client.0.smithi044.stdout:9/989: mknod d4/d7/d18/d2e/d94/d133/c14b 0 2024-04-25T22:03:23.323 INFO:tasks.workunit.client.0.smithi044.stdout:9/990: creat d4/d7/d18/d3a/f14c x:0 0 0 2024-04-25T22:03:23.323 INFO:tasks.workunit.client.0.smithi044.stdout:4/765: dwrite dd/f41 [0,4194304] 0 2024-04-25T22:03:23.323 INFO:tasks.workunit.client.0.smithi044.stdout:9/991: mknod d4/d3d/d66/d93/c14d 0 2024-04-25T22:03:23.323 INFO:tasks.workunit.client.0.smithi044.stdout:4/766: rmdir dd/d35/d52/da9/dca/d79/d7f/dc3 39 2024-04-25T22:03:23.323 INFO:tasks.workunit.client.0.smithi044.stdout:4/767: write dd/d35/f47 [4925320,27001] 0 2024-04-25T22:03:23.323 INFO:tasks.workunit.client.0.smithi044.stdout:0/846: dwrite d8/db2/fbb [0,4194304] 0 2024-04-25T22:03:23.323 INFO:tasks.workunit.client.0.smithi044.stdout:4/768: rename dd/d35/d52/da9/dca/d79/d7f/d81 to dd/d35/d52/dfa 0 2024-04-25T22:03:23.323 INFO:tasks.workunit.client.0.smithi044.stdout:4/769: dread - dd/d35/d52/da9/dca/db6/fb8 zero size 2024-04-25T22:03:23.323 INFO:tasks.workunit.client.0.smithi044.stdout:0/847: read d8/db2/fe5 [233490,79905] 0 2024-04-25T22:03:23.324 INFO:tasks.workunit.client.0.smithi044.stdout:4/770: dread - dd/d19/d91/dd9/fe3 zero size 2024-04-25T22:03:23.324 INFO:tasks.workunit.client.0.smithi044.stdout:2/821: dread d7/d8/d5f/f76 [0,4194304] 0 2024-04-25T22:03:23.324 INFO:tasks.workunit.client.0.smithi044.stdout:4/771: truncate dd/f36 632931 0 2024-04-25T22:03:23.324 INFO:tasks.workunit.client.0.smithi044.stdout:4/772: stat dd/d19/cd6 0 2024-04-25T22:03:23.324 INFO:tasks.workunit.client.0.smithi044.stdout:4/773: symlink dd/d35/d52/da9/dca/d79/d7f/de6/lfb 0 2024-04-25T22:03:23.324 INFO:tasks.workunit.client.0.smithi044.stdout:2/822: link d7/d8/d48/dd9/d2c/d75/cc3 d7/d7b/d81/d4e/d86/d6b/dd8/ded/de4/c118 0 2024-04-25T22:03:23.324 INFO:tasks.workunit.client.0.smithi044.stdout:0/848: dwrite d8/da/d60/fff [0,4194304] 0 2024-04-25T22:03:23.324 INFO:tasks.workunit.client.0.smithi044.stdout:2/823: symlink d7/d7b/d81/d4e/d86/d6b/d78/d44/dad/l119 0 2024-04-25T22:03:23.324 INFO:tasks.workunit.client.0.smithi044.stdout:3/959: truncate d0/d70/d7c/da9/dc0/d13b/d15/d51/dd/f61 2901788 0 2024-04-25T22:03:23.324 INFO:tasks.workunit.client.0.smithi044.stdout:0/849: mknod d8/df/d17/d45/d95/d51/d8b/db0/c11b 0 2024-04-25T22:03:23.324 INFO:tasks.workunit.client.0.smithi044.stdout:5/949: dwrite d2/d35/f45 [0,4194304] 0 2024-04-25T22:03:23.324 INFO:tasks.workunit.client.0.smithi044.stdout:3/960: write d0/d70/f84 [117891,74058] 0 2024-04-25T22:03:23.324 INFO:tasks.workunit.client.0.smithi044.stdout:3/961: stat d0/d70/d7c/da9/dc0/d13b/d15/d23/d136/da6/l6e 0 2024-04-25T22:03:23.324 INFO:tasks.workunit.client.0.smithi044.stdout:5/950: creat d2/f129 x:0 0 0 2024-04-25T22:03:23.324 INFO:tasks.workunit.client.0.smithi044.stdout:0/850: creat d8/df/d17/d45/d95/d51/dc2/df4/f11c x:0 0 0 2024-04-25T22:03:23.324 INFO:tasks.workunit.client.0.smithi044.stdout:3/962: creat d0/d70/d7c/da9/dc0/d13b/f14b x:0 0 0 2024-04-25T22:03:23.325 INFO:tasks.workunit.client.0.smithi044.stdout:0/851: write d8/db2/fbb [52851,1819] 0 2024-04-25T22:03:23.325 INFO:tasks.workunit.client.0.smithi044.stdout:0/852: mknod d8/df/d17/d87/c11d 0 2024-04-25T22:03:23.325 INFO:tasks.workunit.client.0.smithi044.stdout:3/963: mkdir d0/d70/d7c/da9/dc0/d14c 0 2024-04-25T22:03:23.325 INFO:tasks.workunit.client.0.smithi044.stdout:3/964: write d0/d13/d1c/fc1 [2545200,107966] 0 2024-04-25T22:03:23.325 INFO:tasks.workunit.client.0.smithi044.stdout:2/824: dwrite d7/d8/d5f/d70/fb6 [0,4194304] 0 2024-04-25T22:03:23.325 INFO:tasks.workunit.client.0.smithi044.stdout:0/853: getdents d8/d20 0 2024-04-25T22:03:23.325 INFO:tasks.workunit.client.0.smithi044.stdout:3/965: write d0/d70/d7c/da9/dc0/d13b/d15/d23/d60/f9b [3029184,66723] 0 2024-04-25T22:03:23.325 INFO:tasks.workunit.client.0.smithi044.stdout:2/825: creat d7/d8/d48/dd9/f11a x:0 0 0 2024-04-25T22:03:23.325 INFO:tasks.workunit.client.0.smithi044.stdout:0/854: write d8/df/d17/d45/d95/d9c/f109 [615103,12379] 0 2024-04-25T22:03:23.325 INFO:tasks.workunit.client.0.smithi044.stdout:0/855: write d8/da/fcf [445391,65028] 0 2024-04-25T22:03:23.325 INFO:tasks.workunit.client.0.smithi044.stdout:0/856: mknod d8/da/d60/c11e 0 2024-04-25T22:03:23.325 INFO:tasks.workunit.client.0.smithi044.stdout:4/774: dread dd/d35/f5e [0,4194304] 0 2024-04-25T22:03:23.325 INFO:tasks.workunit.client.0.smithi044.stdout:0/857: truncate d8/df/f54 1282544 0 2024-04-25T22:03:23.325 INFO:tasks.workunit.client.0.smithi044.stdout:4/775: symlink dd/d35/d52/lfc 0 2024-04-25T22:03:23.325 INFO:tasks.workunit.client.0.smithi044.stdout:2/826: dwrite d7/d8/d1c/f5c [0,4194304] 0 2024-04-25T22:03:23.326 INFO:tasks.workunit.client.0.smithi044.stdout:3/966: dwrite d0/d70/d7c/da9/dc0/d13b/d34/d95/f13c [0,4194304] 0 2024-04-25T22:03:23.326 INFO:tasks.workunit.client.0.smithi044.stdout:0/858: creat d8/df/d17/d45/d95/d51/d8b/d90/f11f x:0 0 0 2024-04-25T22:03:23.326 INFO:tasks.workunit.client.0.smithi044.stdout:2/827: mknod d7/d8/d5f/d70/d8a/c11b 0 2024-04-25T22:03:23.326 INFO:tasks.workunit.client.0.smithi044.stdout:0/859: creat d8/d78/db8/dfa/f120 x:0 0 0 2024-04-25T22:03:23.326 INFO:tasks.workunit.client.0.smithi044.stdout:3/967: mkdir d0/d70/d7c/da9/dc0/d13b/d34/d95/dd9/d14d 0 2024-04-25T22:03:23.326 INFO:tasks.workunit.client.0.smithi044.stdout:0/860: readlink d8/df/d17/l74 0 2024-04-25T22:03:23.326 INFO:tasks.workunit.client.0.smithi044.stdout:2/828: read - d7/d7b/d81/d4e/d86/d6b/f117 zero size 2024-04-25T22:03:23.326 INFO:tasks.workunit.client.0.smithi044.stdout:0/861: dread - d8/df/f112 zero size 2024-04-25T22:03:23.326 INFO:tasks.workunit.client.0.smithi044.stdout:3/968: chown d0/d70/d7c/da9/dc0/l132 7986765 1 2024-04-25T22:03:23.326 INFO:tasks.workunit.client.0.smithi044.stdout:0/862: chown d8/df/d17/d45/d95/d9c/dcc/dec/ff1 10840 1 2024-04-25T22:03:23.326 INFO:tasks.workunit.client.0.smithi044.stdout:3/969: mkdir d0/d13/d1c/d14e 0 2024-04-25T22:03:23.326 INFO:tasks.workunit.client.0.smithi044.stdout:0/863: mkdir d8/da/d60/d86/d121 0 2024-04-25T22:03:23.326 INFO:tasks.workunit.client.0.smithi044.stdout:7/694: dread d1c/d22/d28/d57/f5a [0,4194304] 0 2024-04-25T22:03:23.326 INFO:tasks.workunit.client.0.smithi044.stdout:3/970: creat d0/d70/d7c/da9/dc0/d13b/d15/d81/dd2/d105/f14f x:0 0 0 2024-04-25T22:03:23.327 INFO:tasks.workunit.client.0.smithi044.stdout:7/695: unlink d1c/d22/fc3 0 2024-04-25T22:03:23.327 INFO:tasks.workunit.client.0.smithi044.stdout:3/971: creat d0/d70/d7c/da9/dc0/d13b/d79/f150 x:0 0 0 2024-04-25T22:03:23.327 INFO:tasks.workunit.client.0.smithi044.stdout:1/749: dread d3/f37 [0,4194304] 0 2024-04-25T22:03:23.327 INFO:tasks.workunit.client.0.smithi044.stdout:3/972: dread - d0/d70/d7c/da9/dc0/d13b/d15/d51/d8e/d74/f144 zero size 2024-04-25T22:03:23.327 INFO:tasks.workunit.client.0.smithi044.stdout:7/696: dread d1c/d22/d4a/f81 [0,4194304] 0 2024-04-25T22:03:23.327 INFO:tasks.workunit.client.0.smithi044.stdout:3/973: creat d0/d70/d7c/da9/dc0/d13b/d15/d51/dd/d11/d8a/f151 x:0 0 0 2024-04-25T22:03:23.327 INFO:tasks.workunit.client.0.smithi044.stdout:0/864: dwrite d8/df/d17/d45/f63 [0,4194304] 0 2024-04-25T22:03:23.327 INFO:tasks.workunit.client.0.smithi044.stdout:0/865: readlink d8/df/l72 0 2024-04-25T22:03:23.327 INFO:tasks.workunit.client.0.smithi044.stdout:3/974: mknod d0/d70/d7c/da9/dc0/d13b/d15/d51/d8e/df4/c152 0 2024-04-25T22:03:23.327 INFO:tasks.workunit.client.0.smithi044.stdout:7/697: read d1c/d22/d28/d4e/da1/fd0 [795175,31292] 0 2024-04-25T22:03:23.327 INFO:tasks.workunit.client.0.smithi044.stdout:1/750: dwrite d3/f6d [0,4194304] 0 2024-04-25T22:03:23.327 INFO:tasks.workunit.client.0.smithi044.stdout:0/866: read d8/d78/db8/fcd [4578884,47319] 0 2024-04-25T22:03:23.327 INFO:tasks.workunit.client.0.smithi044.stdout:9/992: write d4/d7/d79/ddc/de1/d54/d84/d64/f82 [2431918,42489] 0 2024-04-25T22:03:23.327 INFO:tasks.workunit.client.0.smithi044.stdout:1/751: symlink d3/d30/leb 0 2024-04-25T22:03:23.327 INFO:tasks.workunit.client.0.smithi044.stdout:0/867: symlink d8/df/d17/d45/d95/d51/l122 0 2024-04-25T22:03:23.328 INFO:tasks.workunit.client.0.smithi044.stdout:9/993: creat d4/d7/d18/d2d/f14e x:0 0 0 2024-04-25T22:03:23.328 INFO:tasks.workunit.client.0.smithi044.stdout:0/868: mknod d8/d78/db8/dfa/d10f/c123 0 2024-04-25T22:03:23.328 INFO:tasks.workunit.client.0.smithi044.stdout:9/994: creat d4/d7/d79/ddc/de1/d54/d84/d72/d108/f14f x:0 0 0 2024-04-25T22:03:23.328 INFO:tasks.workunit.client.0.smithi044.stdout:1/752: dwrite d3/f26 [4194304,4194304] 0 2024-04-25T22:03:23.328 INFO:tasks.workunit.client.0.smithi044.stdout:9/995: write d4/d7/d18/d2e/d94/fe3 [139350,83605] 0 2024-04-25T22:03:23.328 INFO:tasks.workunit.client.0.smithi044.stdout:9/996: rename d4/d7/d18/d2e/f3f to d4/d3d/d66/f150 0 2024-04-25T22:03:23.328 INFO:tasks.workunit.client.0.smithi044.stdout:9/997: readlink d4/d7/d79/l127 0 2024-04-25T22:03:23.328 INFO:tasks.workunit.client.0.smithi044.stdout:0/869: dwrite d8/df/d17/d45/d95/d51/f71 [0,4194304] 0 2024-04-25T22:03:23.328 INFO:tasks.workunit.client.0.smithi044.stdout:0/870: creat d8/d20/f124 x:0 0 0 2024-04-25T22:03:23.328 INFO:tasks.workunit.client.0.smithi044.stdout:9/998: rename d4/f7f to d4/d7/d79/ddc/de1/d54/d84/d72/d113/d128/dd2/df7/f151 0 2024-04-25T22:03:23.328 INFO:tasks.workunit.client.0.smithi044.stdout:9/999: creat d4/d7/d18/d3a/d8b/f152 x:0 0 0 2024-04-25T22:03:23.328 INFO:tasks.workunit.client.0.smithi044.stdout:0/871: dread d8/df/d17/d45/d95/d9c/dbd/fd5 [0,4194304] 0 2024-04-25T22:03:23.328 INFO:tasks.workunit.client.0.smithi044.stdout:0/872: creat d8/df/d17/d45/d95/f125 x:0 0 0 2024-04-25T22:03:23.328 INFO:tasks.workunit.client.0.smithi044.stdout:0/873: mkdir d8/df/d17/d87/d126 0 2024-04-25T22:03:23.328 INFO:tasks.workunit.client.0.smithi044.stdout:0/874: symlink d8/df/d17/d45/l127 0 2024-04-25T22:03:23.329 INFO:tasks.workunit.client.0.smithi044.stdout:0/875: fdatasync d8/df/f112 0 2024-04-25T22:03:23.329 INFO:tasks.workunit.client.0.smithi044.stdout:0/876: stat d8/df/d17/d45 0 2024-04-25T22:03:23.329 INFO:tasks.workunit.client.0.smithi044.stdout:0/877: creat d8/df/d17/d87/d126/f128 x:0 0 0 2024-04-25T22:03:23.329 INFO:tasks.workunit.client.0.smithi044.stdout:0/878: sync 2024-04-25T22:03:23.329 INFO:tasks.workunit.client.0.smithi044.stdout:3/975: dread d0/d2/fa3 [0,4194304] 0 2024-04-25T22:03:23.329 INFO:tasks.workunit.client.0.smithi044.stdout:0/879: dwrite d8/db2/fe5 [0,4194304] 0 2024-04-25T22:03:23.329 INFO:tasks.workunit.client.0.smithi044.stdout:2/829: dread d7/d8/d5f/fbe [4194304,4194304] 0 2024-04-25T22:03:23.329 INFO:tasks.workunit.client.0.smithi044.stdout:0/880: mkdir d8/df/d17/d45/d95/d51/d8b/db0/dea/d129 0 2024-04-25T22:03:23.329 INFO:tasks.workunit.client.0.smithi044.stdout:0/881: getdents d8/da/d60/d86 0 2024-04-25T22:03:23.329 INFO:tasks.workunit.client.0.smithi044.stdout:1/753: read d3/d59/d5c/f62 [848369,81037] 0 2024-04-25T22:03:23.329 INFO:tasks.workunit.client.0.smithi044.stdout:7/698: truncate d1c/d22/d4a/fbe 2986857 0 2024-04-25T22:03:23.329 INFO:tasks.workunit.client.0.smithi044.stdout:4/776: dread dd/d35/f4a [0,4194304] 0 2024-04-25T22:03:23.329 INFO:tasks.workunit.client.0.smithi044.stdout:7/699: write d1c/d22/d28/d57/f5a [534317,112055] 0 2024-04-25T22:03:23.333 INFO:tasks.workunit.client.0.smithi044.stdout:7/700: sync 2024-04-25T22:03:23.333 INFO:tasks.workunit.client.0.smithi044.stdout:1/754: rename d3/dcd to d3/d7/db/d5d/db0/dec 0 2024-04-25T22:03:23.333 INFO:tasks.workunit.client.0.smithi044.stdout:7/701: chown d1c/d22/d28/d30/d32/f43 837446268 1 2024-04-25T22:03:23.333 INFO:tasks.workunit.client.0.smithi044.stdout:1/755: stat d3/d7/db/d5d/d7f/ce8 0 2024-04-25T22:03:23.333 INFO:tasks.workunit.client.0.smithi044.stdout:2/830: dwrite d7/d8/d5f/d70/fb6 [0,4194304] 0 2024-04-25T22:03:23.333 INFO:tasks.workunit.client.0.smithi044.stdout:4/777: read dd/d35/d52/dfa/f5c [103194,46672] 0 2024-04-25T22:03:23.333 INFO:tasks.workunit.client.0.smithi044.stdout:7/702: write d1c/d22/d4a/f62 [2050883,50315] 0 2024-04-25T22:03:23.333 INFO:tasks.workunit.client.0.smithi044.stdout:4/778: chown dd/f55 12189 1 2024-04-25T22:03:23.333 INFO:tasks.workunit.client.0.smithi044.stdout:1/756: write d3/d54/f92 [59881,89360] 0 2024-04-25T22:03:23.333 INFO:tasks.workunit.client.0.smithi044.stdout:4/779: sync 2024-04-25T22:03:23.333 INFO:tasks.workunit.client.0.smithi044.stdout:1/757: write d3/f6d [693283,21344] 0 2024-04-25T22:03:23.333 INFO:tasks.workunit.client.0.smithi044.stdout:2/831: creat d7/d8/d48/dd9/f11c x:0 0 0 2024-04-25T22:03:23.333 INFO:tasks.workunit.client.0.smithi044.stdout:0/882: dwrite d8/df/d17/d45/d95/d9c/dcc/f77 [0,4194304] 0 2024-04-25T22:03:23.334 INFO:tasks.workunit.client.0.smithi044.stdout:4/780: rename dd/d35/d52/d61/fad to dd/d35/d52/dfa/ffd 0 2024-04-25T22:03:23.334 INFO:tasks.workunit.client.0.smithi044.stdout:0/883: chown d8/df/d17/db9/dd8 9 1 2024-04-25T22:03:23.334 INFO:tasks.workunit.client.0.smithi044.stdout:1/758: getdents d3/d7 0 2024-04-25T22:03:23.334 INFO:tasks.workunit.client.0.smithi044.stdout:7/703: truncate d1c/d88/d8f/d9c/fad 943199 0 2024-04-25T22:03:23.334 INFO:tasks.workunit.client.0.smithi044.stdout:4/781: truncate dd/d35/d52/da9/dca/d79/d9c/fa5 769172 0 2024-04-25T22:03:23.334 INFO:tasks.workunit.client.0.smithi044.stdout:1/759: getdents d3/d7/db/d8f 0 2024-04-25T22:03:23.334 INFO:tasks.workunit.client.0.smithi044.stdout:4/782: chown dd/d35/d52/fb0 23218 1 2024-04-25T22:03:23.334 INFO:tasks.workunit.client.0.smithi044.stdout:1/760: mkdir d3/d7/db/d8f/ded 0 2024-04-25T22:03:23.334 INFO:tasks.workunit.client.0.smithi044.stdout:1/761: write d3/d7/db/f46 [1885266,66613] 0 2024-04-25T22:03:23.334 INFO:tasks.workunit.client.0.smithi044.stdout:2/832: truncate d7/d8/d5f/f76 1230949 0 2024-04-25T22:03:23.334 INFO:tasks.workunit.client.0.smithi044.stdout:4/783: unlink dd/f3b 0 2024-04-25T22:03:23.334 INFO:tasks.workunit.client.0.smithi044.stdout:1/762: fdatasync d3/d7/d83/fc5 0 2024-04-25T22:03:23.334 INFO:tasks.workunit.client.0.smithi044.stdout:4/784: fsync dd/f2a 0 2024-04-25T22:03:23.334 INFO:tasks.workunit.client.0.smithi044.stdout:2/833: unlink d7/la 0 2024-04-25T22:03:23.335 INFO:tasks.workunit.client.0.smithi044.stdout:0/884: truncate d8/da/d60/daa/ffe 2973459 0 2024-04-25T22:03:23.335 INFO:tasks.workunit.client.0.smithi044.stdout:4/785: creat dd/d19/daf/ffe x:0 0 0 2024-04-25T22:03:23.335 INFO:tasks.workunit.client.0.smithi044.stdout:1/763: rename d3/d30/le2 to d3/d30/lee 0 2024-04-25T22:03:23.335 INFO:tasks.workunit.client.0.smithi044.stdout:4/786: creat dd/fff x:0 0 0 2024-04-25T22:03:23.335 INFO:tasks.workunit.client.0.smithi044.stdout:1/764: chown d3/d30/d3f/f68 1486162 1 2024-04-25T22:03:23.336 INFO:tasks.workunit.client.0.smithi044.stdout:0/885: truncate d8/df/d17/d45/d95/d51/d8b/d90/f11f 885628 0 2024-04-25T22:03:23.336 INFO:tasks.workunit.client.0.smithi044.stdout:2/834: rename d7/d8/d48/dd9/d4b/f109 to d7/d7b/d81/d4e/d86/d6b/d78/d44/dad/def/f11d 0 2024-04-25T22:03:23.336 INFO:tasks.workunit.client.0.smithi044.stdout:4/787: mkdir dd/d35/d52/da9/d100 0 2024-04-25T22:03:23.336 INFO:tasks.workunit.client.0.smithi044.stdout:1/765: creat d3/d7/d83/de3/fef x:0 0 0 2024-04-25T22:03:23.336 INFO:tasks.workunit.client.0.smithi044.stdout:4/788: chown dd/d35/d52/da9/dca/db6/fb8 124 1 2024-04-25T22:03:23.337 INFO:tasks.workunit.client.0.smithi044.stdout:0/886: mknod d8/df/d17/d45/d95/d9c/dcc/c12a 0 2024-04-25T22:03:23.337 INFO:tasks.workunit.client.0.smithi044.stdout:2/835: creat d7/d7b/d81/d4e/deb/f11e x:0 0 0 2024-04-25T22:03:23.337 INFO:tasks.workunit.client.0.smithi044.stdout:0/887: fdatasync d8/d78/db8/dfa/f120 0 2024-04-25T22:03:23.337 INFO:tasks.workunit.client.0.smithi044.stdout:4/789: chown dd/d35/d52/f6a 4804 1 2024-04-25T22:03:23.337 INFO:tasks.workunit.client.0.smithi044.stdout:2/836: creat d7/d7b/f11f x:0 0 0 2024-04-25T22:03:23.337 INFO:tasks.workunit.client.0.smithi044.stdout:0/888: fdatasync d8/df/d93/fa7 0 2024-04-25T22:03:23.337 INFO:tasks.workunit.client.0.smithi044.stdout:2/837: dread - d7/d8/d5f/d70/f10e zero size 2024-04-25T22:03:23.337 INFO:tasks.workunit.client.0.smithi044.stdout:2/838: symlink d7/d7b/d81/d4e/deb/l120 0 2024-04-25T22:03:23.341 INFO:tasks.workunit.client.0.smithi044.stdout:3/976: dread d0/d70/d7c/da9/dc0/d13b/d15/d51/fe9 [0,4194304] 0 2024-04-25T22:03:23.341 INFO:tasks.workunit.client.0.smithi044.stdout:0/889: truncate d8/df/d17/d45/d95/d51/d8b/d90/fc9 5825 0 2024-04-25T22:03:23.342 INFO:tasks.workunit.client.0.smithi044.stdout:1/766: dwrite d3/d54/d76/f96 [0,4194304] 0 2024-04-25T22:03:23.343 INFO:tasks.workunit.client.0.smithi044.stdout:3/977: chown d0/d13/d6c/f125 41545046 1 2024-04-25T22:03:23.343 INFO:tasks.workunit.client.0.smithi044.stdout:4/790: dwrite dd/d35/d52/dfa/f5c [4194304,4194304] 0 2024-04-25T22:03:23.343 INFO:tasks.workunit.client.0.smithi044.stdout:0/890: symlink d8/df/d17/db9/dd8/l12b 0 2024-04-25T22:03:23.348 INFO:tasks.workunit.client.0.smithi044.stdout:3/978: mknod d0/d13/d1c/d14e/c153 0 2024-04-25T22:03:23.348 INFO:tasks.workunit.client.0.smithi044.stdout:2/839: dwrite d7/d7b/d81/d57/fcf [0,4194304] 0 2024-04-25T22:03:23.349 INFO:tasks.workunit.client.0.smithi044.stdout:4/791: rename l8 to dd/d35/d52/da9/dca/d79/d7f/dd1/l101 0 2024-04-25T22:03:23.349 INFO:tasks.workunit.client.0.smithi044.stdout:0/891: symlink d8/df/d88/db6/de3/l12c 0 2024-04-25T22:03:23.350 INFO:tasks.workunit.client.0.smithi044.stdout:3/979: write d0/d70/d7c/da9/dc0/d13b/d15/d51/d8e/d74/fca [1841203,6911] 0 2024-04-25T22:03:23.350 INFO:tasks.workunit.client.0.smithi044.stdout:0/892: unlink d8/df/d17/d45/le2 0 2024-04-25T22:03:23.351 INFO:tasks.workunit.client.0.smithi044.stdout:0/893: rmdir d8/d20 39 2024-04-25T22:03:23.351 INFO:tasks.workunit.client.0.smithi044.stdout:3/980: creat d0/d70/d7c/da9/dc0/d13b/d15/d51/d8e/f154 x:0 0 0 2024-04-25T22:03:23.353 INFO:tasks.workunit.client.0.smithi044.stdout:0/894: link d8/df/d17/d45/d95/d9c/dcc/l9e d8/df/d17/d45/d95/d51/d8b/db0/l12d 0 2024-04-25T22:03:23.354 INFO:tasks.workunit.client.0.smithi044.stdout:1/767: dwrite d3/d30/d3f/f68 [0,4194304] 0 2024-04-25T22:03:23.355 INFO:tasks.workunit.client.0.smithi044.stdout:1/768: stat d3/d7/db/dda 0 2024-04-25T22:03:23.358 INFO:tasks.workunit.client.0.smithi044.stdout:2/840: truncate d7/d8/d48/dd9/d2c/f6d 168988 0 2024-04-25T22:03:23.358 INFO:tasks.workunit.client.0.smithi044.stdout:3/981: dread d0/d70/d7c/da9/dc0/d13b/d15/d23/d136/da6/d8d/d91/fe5 [0,4194304] 0 2024-04-25T22:03:23.358 INFO:tasks.workunit.client.0.smithi044.stdout:2/841: chown d7/d7b/d81/d57/l9b 111834695 1 2024-04-25T22:03:23.359 INFO:tasks.workunit.client.0.smithi044.stdout:3/982: sync 2024-04-25T22:03:23.359 INFO:tasks.workunit.client.0.smithi044.stdout:2/842: dread - d7/d7b/fdc zero size 2024-04-25T22:03:23.361 INFO:tasks.workunit.client.0.smithi044.stdout:3/983: creat d0/d70/d7c/da9/dc0/d13b/d15/d23/d136/d108/f155 x:0 0 0 2024-04-25T22:03:23.361 INFO:tasks.workunit.client.0.smithi044.stdout:0/895: dwrite d8/df/d88/db6/fd4 [0,4194304] 0 2024-04-25T22:03:23.362 INFO:tasks.workunit.client.0.smithi044.stdout:3/984: getdents d0/d70/d7c/da9/dc0/d13b/d79 0 2024-04-25T22:03:23.362 INFO:tasks.workunit.client.0.smithi044.stdout:0/896: symlink d8/df/l12e 0 2024-04-25T22:03:23.362 INFO:tasks.workunit.client.0.smithi044.stdout:3/985: sync 2024-04-25T22:03:23.364 INFO:tasks.workunit.client.0.smithi044.stdout:5/951: dread d2/d5/d27/d2a/da7/fbc [0,4194304] 0 2024-04-25T22:03:23.366 INFO:tasks.workunit.client.0.smithi044.stdout:3/986: rename d0/d70/d7c/da9/dc0/d13b/d15/d23/d136/dad/cf9 to d0/d70/d7c/da9/dc0/d13b/d15/d23/d136/da6/d8d/c156 0 2024-04-25T22:03:23.366 INFO:tasks.workunit.client.0.smithi044.stdout:5/952: mkdir d2/d5/d27/d2a/d5c/d112/d116/d12a 0 2024-04-25T22:03:23.366 INFO:tasks.workunit.client.0.smithi044.stdout:3/987: write d0/d70/d7c/da9/dc0/d13b/d15/d51/fe9 [4157887,12791] 0 2024-04-25T22:03:23.367 INFO:tasks.workunit.client.0.smithi044.stdout:1/769: write d3/d54/d76/f9f [1289029,68601] 0 2024-04-25T22:03:23.367 INFO:tasks.workunit.client.0.smithi044.stdout:5/953: rename d2/d5/d21/d38/d52/fbe to d2/d5/d21/d6b/f12b 0 2024-04-25T22:03:23.368 INFO:tasks.workunit.client.0.smithi044.stdout:1/770: fsync d3/d7/db/d5d/d7f/d97/d99/f78 0 2024-04-25T22:03:23.368 INFO:tasks.workunit.client.0.smithi044.stdout:3/988: write d0/d70/d7c/da9/dc0/d13b/d34/d48/f5f [1741168,44477] 0 2024-04-25T22:03:23.368 INFO:tasks.workunit.client.0.smithi044.stdout:1/771: readlink d3/d7/db/l4f 0 2024-04-25T22:03:23.369 INFO:tasks.workunit.client.0.smithi044.stdout:1/772: rmdir d3/d7/db/d5d/d7f/d97 39 2024-04-25T22:03:23.369 INFO:tasks.workunit.client.0.smithi044.stdout:1/773: dread - d3/fc6 zero size 2024-04-25T22:03:23.374 INFO:tasks.workunit.client.0.smithi044.stdout:7/704: dread d1c/d22/d28/d30/d32/f9a [0,4194304] 0 2024-04-25T22:03:23.374 INFO:tasks.workunit.client.0.smithi044.stdout:3/989: dwrite d0/d70/d7c/da9/dc0/d13b/d15/d51/dd/f4e [0,4194304] 0 2024-04-25T22:03:23.376 INFO:tasks.workunit.client.0.smithi044.stdout:1/774: dwrite d3/d30/d3f/f9c [0,4194304] 0 2024-04-25T22:03:23.377 INFO:tasks.workunit.client.0.smithi044.stdout:1/775: fdatasync d3/d7/d29/fb1 0 2024-04-25T22:03:23.378 INFO:tasks.workunit.client.0.smithi044.stdout:7/705: dread d1c/d22/d28/d30/d32/d5d/f7e [0,4194304] 0 2024-04-25T22:03:23.378 INFO:tasks.workunit.client.0.smithi044.stdout:7/706: readlink d1c/lab 0 2024-04-25T22:03:23.381 INFO:tasks.workunit.client.0.smithi044.stdout:7/707: rmdir d1c/d22/d28/d4e/da1 39 2024-04-25T22:03:23.381 INFO:tasks.workunit.client.0.smithi044.stdout:3/990: dread d0/d70/d7c/da9/dc0/d13b/d34/d95/f13c [0,4194304] 0 2024-04-25T22:03:23.381 INFO:tasks.workunit.client.0.smithi044.stdout:1/776: creat d3/d7/db/d5d/d7f/d97/d99/ff0 x:0 0 0 2024-04-25T22:03:23.381 INFO:tasks.workunit.client.0.smithi044.stdout:4/792: dread dd/f89 [0,4194304] 0 2024-04-25T22:03:23.384 INFO:tasks.workunit.client.0.smithi044.stdout:0/897: dwrite d8/db2/f56 [0,4194304] 0 2024-04-25T22:03:23.385 INFO:tasks.workunit.client.0.smithi044.stdout:3/991: rename d0/d70/d7c/da9/fc9 to d0/d70/d12b/f157 0 2024-04-25T22:03:23.385 INFO:tasks.workunit.client.0.smithi044.stdout:4/793: creat dd/d35/d52/da9/dca/d79/d7f/dd1/f102 x:0 0 0 2024-04-25T22:03:23.385 INFO:tasks.workunit.client.0.smithi044.stdout:4/794: sync 2024-04-25T22:03:23.385 INFO:tasks.workunit.client.0.smithi044.stdout:0/898: creat d8/df/d17/d45/d95/d9c/dcc/f12f x:0 0 0 2024-04-25T22:03:23.385 INFO:tasks.workunit.client.0.smithi044.stdout:4/795: sync 2024-04-25T22:03:23.386 INFO:tasks.workunit.client.0.smithi044.stdout:4/796: creat dd/d35/d52/da9/dca/db6/f103 x:0 0 0 2024-04-25T22:03:23.386 INFO:tasks.workunit.client.0.smithi044.stdout:0/899: symlink d8/df/d17/d45/d95/d51/dc2/df4/l130 0 2024-04-25T22:03:23.386 INFO:tasks.workunit.client.0.smithi044.stdout:1/777: dread d3/d7/db/d5d/d7f/d97/d99/f78 [0,4194304] 0 2024-04-25T22:03:23.387 INFO:tasks.workunit.client.0.smithi044.stdout:3/992: rename d0/d70/d7c/da9/dc0/d13b/d15/d23/f40 to d0/d70/d7c/da9/dc0/d13b/d15/d51/d8e/d74/d103/d5d/f158 0 2024-04-25T22:03:23.387 INFO:tasks.workunit.client.0.smithi044.stdout:1/778: creat d3/d7/db/d5d/d7f/dc2/ff1 x:0 0 0 2024-04-25T22:03:23.388 INFO:tasks.workunit.client.0.smithi044.stdout:5/954: dread d2/d5/f7d [0,4194304] 0 2024-04-25T22:03:23.389 INFO:tasks.workunit.client.0.smithi044.stdout:1/779: creat d3/d59/d5c/ff2 x:0 0 0 2024-04-25T22:03:23.390 INFO:tasks.workunit.client.0.smithi044.stdout:5/955: write d2/d5/d21/d26/f57 [4953377,37259] 0 2024-04-25T22:03:23.390 INFO:tasks.workunit.client.0.smithi044.stdout:7/708: dwrite d1c/d22/d28/d30/d32/d5d/f76 [0,4194304] 0 2024-04-25T22:03:23.393 INFO:tasks.workunit.client.0.smithi044.stdout:0/900: dread d8/df/f10 [0,4194304] 0 2024-04-25T22:03:23.393 INFO:tasks.workunit.client.0.smithi044.stdout:5/956: fsync d2/d5/d21/f43 0 2024-04-25T22:03:23.394 INFO:tasks.workunit.client.0.smithi044.stdout:1/780: link d3/c19 d3/d7/db/d5d/cf3 0 2024-04-25T22:03:23.394 INFO:tasks.workunit.client.0.smithi044.stdout:7/709: write d1c/d22/d28/f41 [313541,16583] 0 2024-04-25T22:03:23.394 INFO:tasks.workunit.client.0.smithi044.stdout:5/957: symlink d2/d5/d27/d2a/d70/l12c 0 2024-04-25T22:03:23.394 INFO:tasks.workunit.client.0.smithi044.stdout:1/781: creat d3/d7/d29/d43/dd6/ff4 x:0 0 0 2024-04-25T22:03:23.395 INFO:tasks.workunit.client.0.smithi044.stdout:5/958: mkdir d2/d5/d21/d26/d2c/d37/dbb/d9e/d12d 0 2024-04-25T22:03:23.396 INFO:tasks.workunit.client.0.smithi044.stdout:7/710: link d1c/d22/d28/f58 d1c/d88/fd4 0 2024-04-25T22:03:23.396 INFO:tasks.workunit.client.0.smithi044.stdout:4/797: dwrite dd/d19/daf/ffe [0,4194304] 0 2024-04-25T22:03:23.398 INFO:tasks.workunit.client.0.smithi044.stdout:0/901: rename d8/df/d17/d45/d95/d9c/dbd to d8/df/d17/d45/d95/d51/d8b/d90/d131 0 2024-04-25T22:03:23.401 INFO:tasks.workunit.client.0.smithi044.stdout:1/782: dwrite d3/d4b/db6/fba [0,4194304] 0 2024-04-25T22:03:23.402 INFO:tasks.workunit.client.0.smithi044.stdout:1/783: sync 2024-04-25T22:03:23.404 INFO:tasks.workunit.client.0.smithi044.stdout:5/959: dwrite d2/d5/faa [8388608,4194304] 0 2024-04-25T22:03:23.405 INFO:tasks.workunit.client.0.smithi044.stdout:5/960: mkdir d2/d5b/da8/d12e 0 2024-04-25T22:03:23.405 INFO:tasks.workunit.client.0.smithi044.stdout:2/843: dread d7/d8/d48/dd9/d2c/f61 [0,4194304] 0 2024-04-25T22:03:23.406 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:23.404+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:23.407 INFO:tasks.workunit.client.0.smithi044.stdout:0/902: dwrite d8/db2/f56 [0,4194304] 0 2024-04-25T22:03:23.407 INFO:tasks.workunit.client.0.smithi044.stdout:5/961: rmdir d2/d5/d27/d2a/da7 39 2024-04-25T22:03:23.407 INFO:tasks.workunit.client.0.smithi044.stdout:7/711: dwrite d1c/d22/f6b [0,4194304] 0 2024-04-25T22:03:23.407 INFO:tasks.workunit.client.0.smithi044.stdout:2/844: creat d7/d8/d1c/d77/f121 x:0 0 0 2024-04-25T22:03:23.408 INFO:tasks.workunit.client.0.smithi044.stdout:0/903: mkdir d8/db2/d132 0 2024-04-25T22:03:23.408 INFO:tasks.workunit.client.0.smithi044.stdout:7/712: rmdir d1c/d22/d28/d4e 39 2024-04-25T22:03:23.408 INFO:tasks.workunit.client.0.smithi044.stdout:7/713: sync 2024-04-25T22:03:23.409 INFO:tasks.workunit.client.0.smithi044.stdout:7/714: creat d1c/d22/d4a/fd5 x:0 0 0 2024-04-25T22:03:23.409 INFO:tasks.workunit.client.0.smithi044.stdout:2/845: mknod d7/d8/d48/dd9/d2c/df2/c122 0 2024-04-25T22:03:23.409 INFO:tasks.workunit.client.0.smithi044.stdout:0/904: mkdir d8/df/d17/d45/d95/d133 0 2024-04-25T22:03:23.410 INFO:tasks.workunit.client.0.smithi044.stdout:7/715: rmdir d1c/d22/d28/d4e/d6a/d9e 39 2024-04-25T22:03:23.410 INFO:tasks.workunit.client.0.smithi044.stdout:0/905: fsync d8/df/d17/d45/f50 0 2024-04-25T22:03:23.411 INFO:tasks.workunit.client.0.smithi044.stdout:0/906: readlink d8/d78/l10c 0 2024-04-25T22:03:23.413 INFO:tasks.workunit.client.0.smithi044.stdout:7/716: creat d1c/d22/d28/d4e/da1/fd6 x:0 0 0 2024-04-25T22:03:23.413 INFO:tasks.workunit.client.0.smithi044.stdout:5/962: dwrite d2/d5/f5e [0,4194304] 0 2024-04-25T22:03:23.413 INFO:tasks.workunit.client.0.smithi044.stdout:7/717: fsync d1c/d22/d28/f3d 0 2024-04-25T22:03:23.414 INFO:tasks.workunit.client.0.smithi044.stdout:5/963: unlink d2/d5b/d8e/d10f/c10c 0 2024-04-25T22:03:23.415 INFO:tasks.workunit.client.0.smithi044.stdout:7/718: link d1c/cc1 d1c/d88/d8f/cd7 0 2024-04-25T22:03:23.416 INFO:tasks.workunit.client.0.smithi044.stdout:5/964: mkdir d2/d5/d21/d38/d52/d56/d105/d12f 0 2024-04-25T22:03:23.416 INFO:tasks.workunit.client.0.smithi044.stdout:7/719: rmdir d1c/d22/d28/d4e/d7b/d59 39 2024-04-25T22:03:23.416 INFO:tasks.workunit.client.0.smithi044.stdout:5/965: dread - d2/d5/d21/d6b/fe5 zero size 2024-04-25T22:03:23.417 INFO:tasks.workunit.client.0.smithi044.stdout:2/846: write d7/d8/d48/dd9/d4b/dc1/de1/fe9 [1073415,11162] 0 2024-04-25T22:03:23.418 INFO:tasks.workunit.client.0.smithi044.stdout:7/720: creat d1c/d22/d28/fd8 x:0 0 0 2024-04-25T22:03:23.418 INFO:tasks.workunit.client.0.smithi044.stdout:5/966: mkdir d2/d5b/d8e/d10f/d130 0 2024-04-25T22:03:23.418 INFO:tasks.workunit.client.0.smithi044.stdout:5/967: mkdir d2/dc1/d131 0 2024-04-25T22:03:23.421 INFO:tasks.workunit.client.0.smithi044.stdout:7/721: creat d1c/d22/d4a/dcc/fd9 x:0 0 0 2024-04-25T22:03:23.423 INFO:tasks.workunit.client.0.smithi044.stdout:5/968: dread d2/d5/ff4 [0,4194304] 0 2024-04-25T22:03:23.423 INFO:tasks.workunit.client.0.smithi044.stdout:7/722: creat d1c/d22/d28/d30/fda x:0 0 0 2024-04-25T22:03:23.428 INFO:tasks.workunit.client.0.smithi044.stdout:5/969: mkdir d2/d5/d27/d132 0 2024-04-25T22:03:23.428 INFO:tasks.workunit.client.0.smithi044.stdout:2/847: dwrite d7/d7b/f111 [0,4194304] 0 2024-04-25T22:03:23.428 INFO:tasks.workunit.client.0.smithi044.stdout:0/907: dwrite d8/df/f54 [0,4194304] 0 2024-04-25T22:03:23.429 INFO:tasks.workunit.client.0.smithi044.stdout:7/723: fsync d1c/d22/d28/d30/d32/d5d/f7e 0 2024-04-25T22:03:23.429 INFO:tasks.workunit.client.0.smithi044.stdout:0/908: stat d8/df/f117 0 2024-04-25T22:03:23.429 INFO:tasks.workunit.client.0.smithi044.stdout:2/848: write d7/d8/d48/dd9/f17 [3771800,129968] 0 2024-04-25T22:03:23.429 INFO:tasks.workunit.client.0.smithi044.stdout:7/724: write d1c/d22/d4a/f62 [706033,31342] 0 2024-04-25T22:03:23.429 INFO:tasks.workunit.client.0.smithi044.stdout:2/849: stat d7/d8/d5f/d70 0 2024-04-25T22:03:23.429 INFO:tasks.workunit.client.0.smithi044.stdout:7/725: rmdir d1c/d22/d4a/dcc 39 2024-04-25T22:03:23.429 INFO:tasks.workunit.client.0.smithi044.stdout:7/726: truncate d1c/d22/d28/d4e/d7b/fa3 1090658 0 2024-04-25T22:03:23.430 INFO:tasks.workunit.client.0.smithi044.stdout:2/850: rename d7/d8/d1c/fcc to d7/d8/d48/df4/f123 0 2024-04-25T22:03:23.433 INFO:tasks.workunit.client.0.smithi044.stdout:4/798: dread dd/f55 [0,4194304] 0 2024-04-25T22:03:23.433 INFO:tasks.workunit.client.0.smithi044.stdout:3/993: dread d0/d70/d7c/da9/dc0/d13b/d15/d51/fac [0,4194304] 0 2024-04-25T22:03:23.433 INFO:tasks.workunit.client.0.smithi044.stdout:0/909: link d8/df/d88/db6/cc4 d8/df/d93/c134 0 2024-04-25T22:03:23.434 INFO:tasks.workunit.client.0.smithi044.stdout:4/799: write dd/d35/d52/f99 [656751,63796] 0 2024-04-25T22:03:23.434 INFO:tasks.workunit.client.0.smithi044.stdout:0/910: stat d8/da/d60/daa/dbe/fd3 0 2024-04-25T22:03:23.434 INFO:tasks.workunit.client.0.smithi044.stdout:0/911: creat d8/db2/f135 x:0 0 0 2024-04-25T22:03:23.434 INFO:tasks.workunit.client.0.smithi044.stdout:7/727: link d1c/l1d d1c/d22/d28/d4e/ldb 0 2024-04-25T22:03:23.434 INFO:tasks.workunit.client.0.smithi044.stdout:0/912: dread - d8/da/d60/daa/ff3 zero size 2024-04-25T22:03:23.434 INFO:tasks.workunit.client.0.smithi044.stdout:7/728: mknod d1c/d88/d8f/dce/cdc 0 2024-04-25T22:03:23.434 INFO:tasks.workunit.client.0.smithi044.stdout:2/851: truncate d7/d8/d1c/f67 8143329 0 2024-04-25T22:03:23.435 INFO:tasks.workunit.client.0.smithi044.stdout:0/913: creat d8/df/d17/d87/d126/f136 x:0 0 0 2024-04-25T22:03:23.436 INFO:tasks.workunit.client.0.smithi044.stdout:2/852: dread - d7/d8/d5f/d70/f10e zero size 2024-04-25T22:03:23.436 INFO:tasks.workunit.client.0.smithi044.stdout:7/729: creat d1c/d22/d28/d4e/d6a/d9e/fdd x:0 0 0 2024-04-25T22:03:23.436 INFO:tasks.workunit.client.0.smithi044.stdout:2/853: creat d7/d7b/d81/d4e/f124 x:0 0 0 2024-04-25T22:03:23.438 INFO:tasks.workunit.client.0.smithi044.stdout:5/970: dwrite d2/d5/d21/f49 [0,4194304] 0 2024-04-25T22:03:23.440 INFO:tasks.workunit.client.0.smithi044.stdout:5/971: chown d2/d5/d21/d38/d52/d56/fe9 4229677 1 2024-04-25T22:03:23.442 INFO:tasks.workunit.client.0.smithi044.stdout:5/972: link d2/d5/d21/d26/d2c/d37/fb4 d2/dad/df2/d108/f133 0 2024-04-25T22:03:23.445 INFO:tasks.workunit.client.0.smithi044.stdout:4/800: dread dd/d35/d52/da9/dca/d79/d7f/f84 [0,4194304] 0 2024-04-25T22:03:23.445 INFO:tasks.workunit.client.0.smithi044.stdout:3/994: dread d0/d70/d7c/da9/dc0/d13b/d79/f83 [0,4194304] 0 2024-04-25T22:03:23.447 INFO:tasks.workunit.client.0.smithi044.stdout:3/995: creat d0/d70/d7c/da9/dc0/d13b/d15/d51/dd/d11/d8a/f159 x:0 0 0 2024-04-25T22:03:23.447 INFO:tasks.workunit.client.0.smithi044.stdout:0/914: truncate d8/db2/fbb 116571 0 2024-04-25T22:03:23.448 INFO:tasks.workunit.client.0.smithi044.stdout:3/996: fsync d0/d70/d7c/da9/dc0/d13b/d15/d23/d60/f124 0 2024-04-25T22:03:23.449 INFO:tasks.workunit.client.0.smithi044.stdout:3/997: chown d0/d70/d7c/da9/dc0/f140 46668 1 2024-04-25T22:03:23.449 INFO:tasks.workunit.client.0.smithi044.stdout:0/915: truncate d8/fca 1062561 0 2024-04-25T22:03:23.450 INFO:tasks.workunit.client.0.smithi044.stdout:0/916: write d8/d78/fa6 [4320873,73271] 0 2024-04-25T22:03:23.451 INFO:tasks.workunit.client.0.smithi044.stdout:0/917: chown d8/df/d17/d45/cd7 338286 1 2024-04-25T22:03:23.451 INFO:tasks.workunit.client.0.smithi044.stdout:4/801: dwrite dd/d35/d52/f5b [0,4194304] 0 2024-04-25T22:03:23.453 INFO:tasks.workunit.client.0.smithi044.stdout:0/918: chown d8/d78/db8/ld2 1006 1 2024-04-25T22:03:23.453 INFO:tasks.workunit.client.0.smithi044.stdout:3/998: link d0/d70/d7c/da9/dc0/d13b/d15/d51/d8e/d74/de4/f115 d0/d70/d7c/da9/dc0/d13b/d15/d23/d60/f15a 0 2024-04-25T22:03:23.454 INFO:tasks.workunit.client.0.smithi044.stdout:4/802: truncate dd/d35/d52/dfa/ffd 763497 0 2024-04-25T22:03:23.454 INFO:tasks.workunit.client.0.smithi044.stdout:0/919: mkdir d8/df/d17/d87/d137 0 2024-04-25T22:03:23.454 INFO:tasks.workunit.client.0.smithi044.stdout:3/999: unlink d0/d70/d7c/da9/dc0/d13b/d15/d51/dd/d28/la4 0 2024-04-25T22:03:23.454 INFO:tasks.workunit.client.0.smithi044.stdout:4/803: read - dd/d35/d52/da9/dca/d79/d7f/dd1/f102 zero size 2024-04-25T22:03:23.455 INFO:tasks.workunit.client.0.smithi044.stdout:4/804: sync 2024-04-25T22:03:23.456 INFO:tasks.workunit.client.0.smithi044.stdout:4/805: mkdir dd/d19/d104 0 2024-04-25T22:03:23.456 INFO:tasks.workunit.client.0.smithi044.stdout:1/784: dread d3/d7/db/d5d/d7f/faa [0,4194304] 0 2024-04-25T22:03:23.456 INFO:tasks.workunit.client.0.smithi044.stdout:1/785: creat d3/d59/ff5 x:0 0 0 2024-04-25T22:03:23.456 INFO:tasks.workunit.client.0.smithi044.stdout:4/806: dread - dd/d35/d52/da9/dca/d79/d7f/f97 zero size 2024-04-25T22:03:23.459 INFO:tasks.workunit.client.0.smithi044.stdout:7/730: dread d1c/d22/d4a/f72 [0,4194304] 0 2024-04-25T22:03:23.462 INFO:tasks.workunit.client.0.smithi044.stdout:1/786: dwrite d3/d4b/db6/fba [0,4194304] 0 2024-04-25T22:03:23.462 INFO:tasks.workunit.client.0.smithi044.stdout:4/807: dread dd/d35/d52/da9/dca/d79/d7f/dd1/fd7 [0,4194304] 0 2024-04-25T22:03:23.463 INFO:tasks.workunit.client.0.smithi044.stdout:1/787: mknod d3/d59/d5c/cf6 0 2024-04-25T22:03:23.463 INFO:tasks.workunit.client.0.smithi044.stdout:4/808: write dd/f36 [464608,19048] 0 2024-04-25T22:03:23.464 INFO:tasks.workunit.client.0.smithi044.stdout:4/809: mkdir dd/d35/d52/de9/d105 0 2024-04-25T22:03:23.465 INFO:tasks.workunit.client.0.smithi044.stdout:1/788: rename d3/d7/d29 to d3/d30/d3f/df7 0 2024-04-25T22:03:23.465 INFO:tasks.workunit.client.0.smithi044.stdout:1/789: sync 2024-04-25T22:03:23.466 INFO:tasks.workunit.client.0.smithi044.stdout:1/790: creat d3/d4b/ff8 x:0 0 0 2024-04-25T22:03:23.466 INFO:tasks.workunit.client.0.smithi044.stdout:7/731: dwrite d1c/d22/f49 [0,4194304] 0 2024-04-25T22:03:23.466 INFO:tasks.workunit.client.0.smithi044.stdout:2/854: write f0 [1048746,33267] 0 2024-04-25T22:03:23.467 INFO:tasks.workunit.client.0.smithi044.stdout:5/973: write d2/d5/d21/d26/d2c/d37/f4d [79535,7669] 0 2024-04-25T22:03:23.467 INFO:tasks.workunit.client.0.smithi044.stdout:0/920: write d8/df/d17/d45/d95/d51/d8b/d90/fc9 [99458,7171] 0 2024-04-25T22:03:23.468 INFO:tasks.workunit.client.0.smithi044.stdout:7/732: truncate d1c/d88/d8f/d9c/fc4 517355 0 2024-04-25T22:03:23.469 INFO:tasks.workunit.client.0.smithi044.stdout:2/855: symlink d7/d7b/d81/d4e/d86/d6b/d78/d44/dad/def/l125 0 2024-04-25T22:03:23.469 INFO:tasks.workunit.client.0.smithi044.stdout:5/974: read d2/d5/d27/d2a/d3a/f77 [95423,126840] 0 2024-04-25T22:03:23.470 INFO:tasks.workunit.client.0.smithi044.stdout:7/733: write d1c/d22/d28/d4e/f61 [461587,10765] 0 2024-04-25T22:03:23.470 INFO:tasks.workunit.client.0.smithi044.stdout:2/856: creat d7/d7b/d81/d4e/f126 x:0 0 0 2024-04-25T22:03:23.471 INFO:tasks.workunit.client.0.smithi044.stdout:5/975: rename d2/d5/l33 to d2/d5b/da8/d12e/l134 0 2024-04-25T22:03:23.471 INFO:tasks.workunit.client.0.smithi044.stdout:2/857: write d7/d8/d48/dd9/f20 [1795613,87840] 0 2024-04-25T22:03:23.471 INFO:tasks.workunit.client.0.smithi044.stdout:5/976: unlink d2/d5/d21/d26/d2c/cd6 0 2024-04-25T22:03:23.472 INFO:tasks.workunit.client.0.smithi044.stdout:5/977: mkdir d2/d5/d21/d38/d52/d56/d135 0 2024-04-25T22:03:23.478 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:23.479 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:23.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.479 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:14977 4.11 e67/16 4:896d0484:::100000034b0.00000000:head v 67'237, mlcod=67'235)", 2024-04-25T22:03:23.479 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:23.425161+0000", 2024-04-25T22:03:23.479 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.048426148000000002, 2024-04-25T22:03:23.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.050077651000000001, 2024-04-25T22:03:23.480 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.480 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.480 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-25T22:03:23.480 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.425161+0000", 2024-04-25T22:03:23.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.425161+0000", 2024-04-25T22:03:23.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.425162+0000", 2024-04-25T22:03:23.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4399999999999998e-07 2024-04-25T22:03:23.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.432319+0000", 2024-04-25T22:03:23.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071577339999999998 2024-04-25T22:03:23.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.432337+0000", 2024-04-25T22:03:23.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7549000000000001e-05 2024-04-25T22:03:23.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.432348+0000", 2024-04-25T22:03:23.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0786e-05 2024-04-25T22:03:23.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.432411+0000", 2024-04-25T22:03:23.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2965000000000004e-05 2024-04-25T22:03:23.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:23.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.432433+0000", 2024-04-25T22:03:23.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2501e-05 2024-04-25T22:03:23.485 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.485 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.485 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.485 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:2717 4.3d 4:bccde13a:::100000036f4.00000000:head [trimtrunc 2@116571] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:23.485 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:23.467089+0000", 2024-04-25T22:03:23.486 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0064978550000000003, 2024-04-25T22:03:23.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0082087129999999994, 2024-04-25T22:03:23.486 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.486 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.486 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:23.486 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467089+0000", 2024-04-25T22:03:23.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467089+0000", 2024-04-25T22:03:23.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467090+0000", 2024-04-25T22:03:23.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8000000000000005e-07 2024-04-25T22:03:23.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467093+0000", 2024-04-25T22:03:23.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4790000000000001e-06 2024-04-25T22:03:23.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467102+0000", 2024-04-25T22:03:23.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9449999999999999e-06 2024-04-25T22:03:23.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467110+0000", 2024-04-25T22:03:23.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3250000000000002e-06 2024-04-25T22:03:23.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467245+0000", 2024-04-25T22:03:23.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013595600000000001 2024-04-25T22:03:23.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:23.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467290+0000", 2024-04-25T22:03:23.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4422999999999998e-05 2024-04-25T22:03:23.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:23.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467369+0000", 2024-04-25T22:03:23.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8934e-05 2024-04-25T22:03:23.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:23.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.470233+0000", 2024-04-25T22:03:23.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00286441 2024-04-25T22:03:23.494 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.494 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.494 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.494 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:2718 3.d 3:b02ffd62:::200.00000010:head [write 2095166~2488 [fadvise_dontneed] in=2488b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:23.494 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:23.467325+0000", 2024-04-25T22:03:23.494 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0062623260000000004, 2024-04-25T22:03:23.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0080173080000000008, 2024-04-25T22:03:23.495 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.495 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.495 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:23.495 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467325+0000", 2024-04-25T22:03:23.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467325+0000", 2024-04-25T22:03:23.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467325+0000", 2024-04-25T22:03:23.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7599999999999996e-07 2024-04-25T22:03:23.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467422+0000", 2024-04-25T22:03:23.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6360999999999994e-05 2024-04-25T22:03:23.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467433+0000", 2024-04-25T22:03:23.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0862999999999999e-05 2024-04-25T22:03:23.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467440+0000", 2024-04-25T22:03:23.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.537e-06 2024-04-25T22:03:23.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467536+0000", 2024-04-25T22:03:23.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6094999999999994e-05 2024-04-25T22:03:23.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:23.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467605+0000", 2024-04-25T22:03:23.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8466000000000005e-05 2024-04-25T22:03:23.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:23.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467721+0000", 2024-04-25T22:03:23.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011613299999999999 2024-04-25T22:03:23.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:23.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.469655+0000", 2024-04-25T22:03:23.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019344130000000001 2024-04-25T22:03:23.502 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.502 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.502 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.503 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:2719 4.2 4:43889afe:::10000003740.00000000:head [trimtrunc 3@1062561] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:23.503 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:23.467453+0000", 2024-04-25T22:03:23.503 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0061339799999999998, 2024-04-25T22:03:23.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079285290000000001, 2024-04-25T22:03:23.503 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.503 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.503 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:23.504 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467453+0000", 2024-04-25T22:03:23.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467453+0000", 2024-04-25T22:03:23.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467454+0000", 2024-04-25T22:03:23.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7100000000000001e-07 2024-04-25T22:03:23.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467456+0000", 2024-04-25T22:03:23.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7769999999999998e-06 2024-04-25T22:03:23.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467463+0000", 2024-04-25T22:03:23.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6460000000000004e-06 2024-04-25T22:03:23.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467469+0000", 2024-04-25T22:03:23.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8810000000000001e-06 2024-04-25T22:03:23.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467527+0000", 2024-04-25T22:03:23.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8374e-05 2024-04-25T22:03:23.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:23.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467605+0000", 2024-04-25T22:03:23.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7539000000000004e-05 2024-04-25T22:03:23.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:23.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467721+0000", 2024-04-25T22:03:23.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000116094 2024-04-25T22:03:23.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:23.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.469605+0000", 2024-04-25T22:03:23.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00188408 2024-04-25T22:03:23.509 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.509 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.509 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.510 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:2720 3.d 3:b02ffd62:::200.00000010:head [write 2097654~2487 [fadvise_dontneed] in=2487b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:23.510 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:23.467481+0000", 2024-04-25T22:03:23.510 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0061054680000000002, 2024-04-25T22:03:23.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007974063, 2024-04-25T22:03:23.510 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.510 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.510 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:23.510 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467481+0000", 2024-04-25T22:03:23.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467481+0000", 2024-04-25T22:03:23.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467482+0000", 2024-04-25T22:03:23.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.06e-07 2024-04-25T22:03:23.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467490+0000", 2024-04-25T22:03:23.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0809999999999994e-06 2024-04-25T22:03:23.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467497+0000", 2024-04-25T22:03:23.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8900000000000001e-06 2024-04-25T22:03:23.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467502+0000", 2024-04-25T22:03:23.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2610000000000001e-06 2024-04-25T22:03:23.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.468223+0000", 2024-04-25T22:03:23.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00072120400000000003 2024-04-25T22:03:23.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:23.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.468264+0000", 2024-04-25T22:03:23.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0507999999999999e-05 2024-04-25T22:03:23.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:23.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.468330+0000", 2024-04-25T22:03:23.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6236999999999996e-05 2024-04-25T22:03:23.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:23.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.469662+0000", 2024-04-25T22:03:23.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00133187 2024-04-25T22:03:23.515 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.515 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.515 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.515 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:15022 4.32 4:4c2e5ac1:::100000033ab.00000000:head [write 79535~7669 [2@75487] in=7669b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:23.515 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:23.467664+0000", 2024-04-25T22:03:23.515 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0059231029999999999, 2024-04-25T22:03:23.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0078737210000000002, 2024-04-25T22:03:23.515 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.516 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.516 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:23.516 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:23.516 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:23.516 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.516 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 15022 2024-04-25T22:03:23.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.516 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467664+0000", 2024-04-25T22:03:23.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467664+0000", 2024-04-25T22:03:23.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467665+0000", 2024-04-25T22:03:23.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4300000000000002e-07 2024-04-25T22:03:23.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467675+0000", 2024-04-25T22:03:23.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0458999999999999e-05 2024-04-25T22:03:23.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467686+0000", 2024-04-25T22:03:23.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0589e-05 2024-04-25T22:03:23.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467698+0000", 2024-04-25T22:03:23.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2051e-05 2024-04-25T22:03:23.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467771+0000", 2024-04-25T22:03:23.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3138000000000003e-05 2024-04-25T22:03:23.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:23.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467865+0000", 2024-04-25T22:03:23.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4641000000000004e-05 2024-04-25T22:03:23.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:23.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.468236+0000", 2024-04-25T22:03:23.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037058799999999998 2024-04-25T22:03:23.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:23.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.470219+0000", 2024-04-25T22:03:23.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001983397 2024-04-25T22:03:23.521 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.522 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.522 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.522 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:15023 4.22 4:4418665a:::10000003254.00000000:head [write 99458~7171 [3@5825] in=7171b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:23.522 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:23.468834+0000", 2024-04-25T22:03:23.522 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0047532770000000002, 2024-04-25T22:03:23.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068075649999999998, 2024-04-25T22:03:23.522 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.522 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.523 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:23.523 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:23.523 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:23.523 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.523 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 15023 2024-04-25T22:03:23.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.523 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.468834+0000", 2024-04-25T22:03:23.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.468834+0000", 2024-04-25T22:03:23.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.468835+0000", 2024-04-25T22:03:23.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7940000000000001e-06 2024-04-25T22:03:23.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.468871+0000", 2024-04-25T22:03:23.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5608000000000002e-05 2024-04-25T22:03:23.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.468885+0000", 2024-04-25T22:03:23.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4144999999999999e-05 2024-04-25T22:03:23.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.468893+0000", 2024-04-25T22:03:23.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6629999999999993e-06 2024-04-25T22:03:23.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.469050+0000", 2024-04-25T22:03:23.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015696500000000001 2024-04-25T22:03:23.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:23.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.469133+0000", 2024-04-25T22:03:23.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3691999999999998e-05 2024-04-25T22:03:23.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:23.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.469287+0000", 2024-04-25T22:03:23.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015348599999999999 2024-04-25T22:03:23.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:23.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.470673+0000", 2024-04-25T22:03:23.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001385687 2024-04-25T22:03:23.532 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.532 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.532 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.532 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:2721 3.d 3:b02ffd62:::200.00000010:head [write 2100141~18425 [fadvise_dontneed] in=18425b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:23.532 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:23.471310+0000", 2024-04-25T22:03:23.532 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.002277051, 2024-04-25T22:03:23.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044301649999999998, 2024-04-25T22:03:23.532 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.532 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.532 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:23.533 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.471310+0000", 2024-04-25T22:03:23.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.471310+0000", 2024-04-25T22:03:23.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.471311+0000", 2024-04-25T22:03:23.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0899999999999999e-06 2024-04-25T22:03:23.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.471329+0000", 2024-04-25T22:03:23.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7696000000000001e-05 2024-04-25T22:03:23.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.471343+0000", 2024-04-25T22:03:23.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4017e-05 2024-04-25T22:03:23.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.471351+0000", 2024-04-25T22:03:23.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8259999999999999e-06 2024-04-25T22:03:23.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.471391+0000", 2024-04-25T22:03:23.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9582999999999997e-05 2024-04-25T22:03:23.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:23.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.471438+0000", 2024-04-25T22:03:23.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7426999999999998e-05 2024-04-25T22:03:23.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:23.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.471513+0000", 2024-04-25T22:03:23.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4097000000000006e-05 2024-04-25T22:03:23.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:23.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.472980+0000", 2024-04-25T22:03:23.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001467014 2024-04-25T22:03:23.536 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.537 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.537 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.537 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:15027 4.5 4:a04eb487:::1000000319f.00000000:head [write 1795613~87840 [3@4172744] in=87840b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:23.537 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:23.471601+0000", 2024-04-25T22:03:23.537 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0019856779999999998, 2024-04-25T22:03:23.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042232320000000004, 2024-04-25T22:03:23.537 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.537 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.538 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:23.538 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:23.538 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:23.538 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.538 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 15027 2024-04-25T22:03:23.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.538 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.471601+0000", 2024-04-25T22:03:23.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.471601+0000", 2024-04-25T22:03:23.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.471602+0000", 2024-04-25T22:03:23.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3500000000000005e-07 2024-04-25T22:03:23.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.471733+0000", 2024-04-25T22:03:23.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000131066 2024-04-25T22:03:23.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.471746+0000", 2024-04-25T22:03:23.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2699e-05 2024-04-25T22:03:23.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.471751+0000", 2024-04-25T22:03:23.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6269999999999997e-06 2024-04-25T22:03:23.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.471801+0000", 2024-04-25T22:03:23.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0018000000000001e-05 2024-04-25T22:03:23.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:23.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.471860+0000", 2024-04-25T22:03:23.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8492999999999997e-05 2024-04-25T22:03:23.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:23.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.471934+0000", 2024-04-25T22:03:23.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4558e-05 2024-04-25T22:03:23.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:23.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.473632+0000", 2024-04-25T22:03:23.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016971449999999999 2024-04-25T22:03:23.543 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.543 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.543 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.543 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:15017 4.b e67/16 4:d296f566:::10000003789.00000000:head v 67'260, mlcod=67'258)", 2024-04-25T22:03:23.544 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:23.467738+0000", 2024-04-25T22:03:23.544 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.005848575, 2024-04-25T22:03:23.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081732090000000007, 2024-04-25T22:03:23.544 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.544 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.544 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-25T22:03:23.544 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467738+0000", 2024-04-25T22:03:23.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467738+0000", 2024-04-25T22:03:23.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.467739+0000", 2024-04-25T22:03:23.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.13e-07 2024-04-25T22:03:23.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.475378+0000", 2024-04-25T22:03:23.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076388269999999999 2024-04-25T22:03:23.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.475393+0000", 2024-04-25T22:03:23.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5540999999999999e-05 2024-04-25T22:03:23.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.475402+0000", 2024-04-25T22:03:23.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5250000000000005e-06 2024-04-25T22:03:23.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.475454+0000", 2024-04-25T22:03:23.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2382000000000001e-05 2024-04-25T22:03:23.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:23.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.475475+0000", 2024-04-25T22:03:23.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0786000000000001e-05 2024-04-25T22:03:23.548 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.548 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.548 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.548 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:15001 4.5 4:a3186838:::100000033a2.00000000:head [write 0~4194304 [2@2632753] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:23.548 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:23.439561+0000", 2024-04-25T22:03:23.548 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.034026067, 2024-04-25T22:03:23.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.036419792999999999, 2024-04-25T22:03:23.549 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.549 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.549 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:23.549 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:23.549 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:23.549 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.549 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 15001 2024-04-25T22:03:23.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.549 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.439561+0000", 2024-04-25T22:03:23.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.439561+0000", 2024-04-25T22:03:23.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.439562+0000", 2024-04-25T22:03:23.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.229e-06 2024-04-25T22:03:23.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.444620+0000", 2024-04-25T22:03:23.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050576270000000003 2024-04-25T22:03:23.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.444630+0000", 2024-04-25T22:03:23.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0417e-05 2024-04-25T22:03:23.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.444641+0000", 2024-04-25T22:03:23.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0932e-05 2024-04-25T22:03:23.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.444694+0000", 2024-04-25T22:03:23.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3025999999999997e-05 2024-04-25T22:03:23.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:23.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.444776+0000", 2024-04-25T22:03:23.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1538000000000004e-05 2024-04-25T22:03:23.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:23.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.444880+0000", 2024-04-25T22:03:23.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104891 2024-04-25T22:03:23.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:23.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.466834+0000", 2024-04-25T22:03:23.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021953868000000001 2024-04-25T22:03:23.554 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.554 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.554 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.554 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop_reply(client.4564.0:15001 4.5 e67/16 ondisk, result = 0)", 2024-04-25T22:03:23.554 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:23.475849+0000", 2024-04-25T22:03:23.554 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9977384, 2024-04-25T22:03:23.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00021572299999999999, 2024-04-25T22:03:23.554 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.555 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.555 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-25T22:03:23.555 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.475849+0000", 2024-04-25T22:03:23.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.475849+0000", 2024-04-25T22:03:23.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.475849+0000", 2024-04-25T22:03:23.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3099999999999998e-07 2024-04-25T22:03:23.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.475852+0000", 2024-04-25T22:03:23.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6850000000000001e-06 2024-04-25T22:03:23.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.475859+0000", 2024-04-25T22:03:23.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3690000000000001e-06 2024-04-25T22:03:23.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.475865+0000", 2024-04-25T22:03:23.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4049999999999999e-06 2024-04-25T22:03:23.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.476016+0000", 2024-04-25T22:03:23.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015098800000000001 2024-04-25T22:03:23.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:23.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.476019+0000", 2024-04-25T22:03:23.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8020000000000002e-06 2024-04-25T22:03:23.558 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.559 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.559 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.559 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop_reply(mds.0.3:2721 3.d e67/49)", 2024-04-25T22:03:23.559 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:23.475921+0000", 2024-04-25T22:03:23.559 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9976664, 2024-04-25T22:03:23.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020861499999999999, 2024-04-25T22:03:23.559 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.559 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.559 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:23.559 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.475921+0000", 2024-04-25T22:03:23.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.475921+0000", 2024-04-25T22:03:23.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.475921+0000", 2024-04-25T22:03:23.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0499999999999999e-07 2024-04-25T22:03:23.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.475924+0000", 2024-04-25T22:03:23.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6809999999999998e-06 2024-04-25T22:03:23.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.475932+0000", 2024-04-25T22:03:23.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6789999999999994e-06 2024-04-25T22:03:23.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.475938+0000", 2024-04-25T22:03:23.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0730000000000001e-06 2024-04-25T22:03:23.563 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.563 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.563 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.563 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:15011 4.31 4:8d70c9c0:::100000031fb.00000000:head [write 0~4194304 [3@32186] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:23.563 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:23.451803+0000", 2024-04-25T22:03:23.563 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.021783608999999999, 2024-04-25T22:03:23.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024393977000000001, 2024-04-25T22:03:23.564 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.564 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.564 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:23.564 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:23.564 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:23.564 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.564 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 15011 2024-04-25T22:03:23.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.564 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.451803+0000", 2024-04-25T22:03:23.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.451803+0000", 2024-04-25T22:03:23.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.451804+0000", 2024-04-25T22:03:23.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0690000000000001e-06 2024-04-25T22:03:23.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.455696+0000", 2024-04-25T22:03:23.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038920420000000001 2024-04-25T22:03:23.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.455712+0000", 2024-04-25T22:03:23.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5795e-05 2024-04-25T22:03:23.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.455720+0000", 2024-04-25T22:03:23.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3080000000000008e-06 2024-04-25T22:03:23.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.455780+0000", 2024-04-25T22:03:23.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9700000000000001e-05 2024-04-25T22:03:23.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:23.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.455877+0000", 2024-04-25T22:03:23.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6819999999999998e-05 2024-04-25T22:03:23.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:23.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.456034+0000", 2024-04-25T22:03:23.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015722199999999999 2024-04-25T22:03:23.569 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.569 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.570 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.570 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.570 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:03:23.570 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 14 2024-04-25T22:03:23.570 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:23.575 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:23.580 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:23.568+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:23.586 INFO:tasks.workunit.client.0.smithi044.stdout:7/734: write d1c/d22/d4a/f78 [2078164,75329] 0 2024-04-25T22:03:23.586 INFO:tasks.workunit.client.0.smithi044.stdout:0/921: dread d8/df/d17/d45/d95/d51/d8b/d90/f11f [0,4194304] 0 2024-04-25T22:03:23.586 INFO:tasks.workunit.client.0.smithi044.stdout:1/791: write d3/d7/f57 [1334727,17106] 0 2024-04-25T22:03:23.586 INFO:tasks.workunit.client.0.smithi044.stdout:7/735: mkdir d1c/d22/d28/d57/d7c/dde 0 2024-04-25T22:03:23.586 INFO:tasks.workunit.client.0.smithi044.stdout:2/858: dwrite d7/d7b/d81/d4e/d86/d6b/d78/f5a [0,4194304] 0 2024-04-25T22:03:23.586 INFO:tasks.workunit.client.0.smithi044.stdout:1/792: chown d3/d30/c41 6546 1 2024-04-25T22:03:23.586 INFO:tasks.workunit.client.0.smithi044.stdout:5/978: dread d2/d5/d21/d38/d7c/fca [0,4194304] 0 2024-04-25T22:03:23.586 INFO:tasks.workunit.client.0.smithi044.stdout:0/922: dwrite d8/df/f10d [0,4194304] 0 2024-04-25T22:03:23.586 INFO:tasks.workunit.client.0.smithi044.stdout:5/979: dwrite d2/d5/d21/f90 [4194304,4194304] 0 2024-04-25T22:03:23.586 INFO:tasks.workunit.client.0.smithi044.stdout:5/980: chown d2/f20 7942668 1 2024-04-25T22:03:23.587 INFO:tasks.workunit.client.0.smithi044.stdout:0/923: truncate d8/df/d17/f33 4366086 0 2024-04-25T22:03:23.587 INFO:tasks.workunit.client.0.smithi044.stdout:0/924: mknod d8/df/d17/d87/d126/c138 0 2024-04-25T22:03:23.587 INFO:tasks.workunit.client.0.smithi044.stdout:0/925: read d8/df/d17/db9/f28 [1646219,53268] 0 2024-04-25T22:03:23.587 INFO:tasks.workunit.client.0.smithi044.stdout:0/926: chown f1 30468190 1 2024-04-25T22:03:23.587 INFO:tasks.workunit.client.0.smithi044.stdout:0/927: link d8/df/d17/d45/d95/d9c/dcc/dec/l10e d8/df/d88/db6/de3/l139 0 2024-04-25T22:03:23.587 INFO:tasks.workunit.client.0.smithi044.stdout:5/981: dwrite d2/d5/ff4 [0,4194304] 0 2024-04-25T22:03:23.587 INFO:tasks.workunit.client.0.smithi044.stdout:0/928: write d8/df/d17/d45/f4a [2514299,27726] 0 2024-04-25T22:03:23.587 INFO:tasks.workunit.client.0.smithi044.stdout:5/982: rmdir d2/d5/d27/d2a/d5c/d5f 39 2024-04-25T22:03:23.587 INFO:tasks.workunit.client.0.smithi044.stdout:4/810: dread dd/d19/f32 [4194304,4194304] 0 2024-04-25T22:03:23.587 INFO:tasks.workunit.client.0.smithi044.stdout:5/983: read d2/d5/d27/d2a/d70/fd8 [2862849,66119] 0 2024-04-25T22:03:23.588 INFO:tasks.workunit.client.0.smithi044.stdout:4/811: rename fa to dd/d35/d52/de9/f106 0 2024-04-25T22:03:23.588 INFO:tasks.workunit.client.0.smithi044.stdout:7/736: dread d1c/d22/d28/d4e/d7b/fa3 [0,4194304] 0 2024-04-25T22:03:23.588 INFO:tasks.workunit.client.0.smithi044.stdout:4/812: unlink dd/d35/d52/d61/l68 0 2024-04-25T22:03:23.588 INFO:tasks.workunit.client.0.smithi044.stdout:7/737: link d1c/c29 d1c/d22/d28/d66/d6e/cdf 0 2024-04-25T22:03:23.588 INFO:tasks.workunit.client.0.smithi044.stdout:4/813: read dd/d19/f1d [2300863,3473] 0 2024-04-25T22:03:23.588 INFO:tasks.workunit.client.0.smithi044.stdout:2/859: dread d7/d8/d1c/f69 [0,4194304] 0 2024-04-25T22:03:23.588 INFO:tasks.workunit.client.0.smithi044.stdout:7/738: creat d1c/d22/d28/d66/d6e/dd2/fe0 x:0 0 0 2024-04-25T22:03:23.590 INFO:tasks.workunit.client.0.smithi044.stdout:2/860: chown d7/d8/d5f/d70/d8a/fd7 30 1 2024-04-25T22:03:23.590 INFO:tasks.workunit.client.0.smithi044.stdout:4/814: rename dd/d35/fef to dd/d35/d52/da9/dca/d79/d7f/dd1/f107 0 2024-04-25T22:03:23.590 INFO:tasks.workunit.client.0.smithi044.stdout:2/861: fdatasync d7/ff3 0 2024-04-25T22:03:23.590 INFO:tasks.workunit.client.0.smithi044.stdout:7/739: fsync d1c/d22/d28/d30/d32/d5d/fb6 0 2024-04-25T22:03:23.590 INFO:tasks.workunit.client.0.smithi044.stdout:5/984: dwrite d2/d35/f86 [0,4194304] 0 2024-04-25T22:03:23.591 INFO:tasks.workunit.client.0.smithi044.stdout:4/815: creat dd/d35/d52/da9/dca/f108 x:0 0 0 2024-04-25T22:03:23.591 INFO:tasks.workunit.client.0.smithi044.stdout:7/740: write d1c/d22/d28/d30/d32/d97/fb7 [1302945,94887] 0 2024-04-25T22:03:23.591 INFO:tasks.workunit.client.0.smithi044.stdout:2/862: truncate d7/d8/d48/dd9/d4b/fee 609500 0 2024-04-25T22:03:23.591 INFO:tasks.workunit.client.0.smithi044.stdout:5/985: creat d2/d5b/da8/d10b/f136 x:0 0 0 2024-04-25T22:03:23.591 INFO:tasks.workunit.client.0.smithi044.stdout:7/741: chown d1c/d88/d8f/d9c/fae 0 1 2024-04-25T22:03:23.591 INFO:tasks.workunit.client.0.smithi044.stdout:4/816: symlink dd/d35/d52/da9/dca/d79/d7f/dd1/l109 0 2024-04-25T22:03:23.591 INFO:tasks.workunit.client.0.smithi044.stdout:5/986: readlink d2/d5b/da8/d12e/l134 0 2024-04-25T22:03:23.591 INFO:tasks.workunit.client.0.smithi044.stdout:2/863: readlink d7/d7b/d81/d4e/d86/d6b/d78/lab 0 2024-04-25T22:03:23.591 INFO:tasks.workunit.client.0.smithi044.stdout:5/987: mkdir d2/d5/d21/d6b/d137 0 2024-04-25T22:03:23.591 INFO:tasks.workunit.client.0.smithi044.stdout:5/988: write d2/d5/d21/d38/d7c/fba [1303855,98062] 0 2024-04-25T22:03:23.591 INFO:tasks.workunit.client.0.smithi044.stdout:7/742: dwrite d1c/d22/d28/d30/d32/f9a [0,4194304] 0 2024-04-25T22:03:23.592 INFO:tasks.workunit.client.0.smithi044.stdout:2/864: dwrite d7/d7b/d81/d4e/d86/ff7 [0,4194304] 0 2024-04-25T22:03:23.592 INFO:tasks.workunit.client.0.smithi044.stdout:7/743: fsync d1c/d22/d28/d4e/d7b/fa3 0 2024-04-25T22:03:23.592 INFO:tasks.workunit.client.0.smithi044.stdout:2/865: fdatasync d7/d8/d48/f63 0 2024-04-25T22:03:23.592 INFO:tasks.workunit.client.0.smithi044.stdout:1/793: dread d3/f4a [0,4194304] 0 2024-04-25T22:03:23.592 INFO:tasks.workunit.client.0.smithi044.stdout:7/744: chown d1c/d22/d28/d30/fda 104 1 2024-04-25T22:03:23.592 INFO:tasks.workunit.client.0.smithi044.stdout:5/989: dwrite d2/d5/d21/d26/d2c/d37/f123 [0,4194304] 0 2024-04-25T22:03:23.592 INFO:tasks.workunit.client.0.smithi044.stdout:7/745: fdatasync d1c/d22/d28/d4e/da1/fd0 0 2024-04-25T22:03:23.592 INFO:tasks.workunit.client.0.smithi044.stdout:5/990: sync 2024-04-25T22:03:23.592 INFO:tasks.workunit.client.0.smithi044.stdout:1/794: rename d3/d7/db/d5d/d7f to d3/d7/d83/df9 0 2024-04-25T22:03:23.592 INFO:tasks.workunit.client.0.smithi044.stdout:7/746: dread - d1c/d22/d28/d30/d32/d5d/d83/fc7 zero size 2024-04-25T22:03:23.593 INFO:tasks.workunit.client.0.smithi044.stdout:1/795: chown d3/f61 60781762 1 2024-04-25T22:03:23.593 INFO:tasks.workunit.client.0.smithi044.stdout:5/991: truncate d2/d5b/da8/d10b/f136 113562 0 2024-04-25T22:03:23.593 INFO:tasks.workunit.client.0.smithi044.stdout:7/747: chown d1c/d22/d28/l6c 13 1 2024-04-25T22:03:23.593 INFO:tasks.workunit.client.0.smithi044.stdout:1/796: write d3/d7/d83/df9/d97/d99/ff0 [12734,72730] 0 2024-04-25T22:03:23.593 INFO:tasks.workunit.client.0.smithi044.stdout:2/866: dwrite d7/d8/d48/dd9/d2c/f3b [0,4194304] 0 2024-04-25T22:03:23.593 INFO:tasks.workunit.client.0.smithi044.stdout:1/797: sync 2024-04-25T22:03:23.593 INFO:tasks.workunit.client.0.smithi044.stdout:5/992: symlink d2/d5/d21/d6b/l138 0 2024-04-25T22:03:23.593 INFO:tasks.workunit.client.0.smithi044.stdout:5/993: truncate d2/d5/f128 277541 0 2024-04-25T22:03:23.593 INFO:tasks.workunit.client.0.smithi044.stdout:2/867: creat d7/d7b/d81/d4e/d86/d6b/dd8/ded/de4/d10f/f127 x:0 0 0 2024-04-25T22:03:23.593 INFO:tasks.workunit.client.0.smithi044.stdout:7/748: getdents d1c/d22/d28/d57/d7c 0 2024-04-25T22:03:23.594 INFO:tasks.workunit.client.0.smithi044.stdout:1/798: dread d3/d54/d76/f96 [0,4194304] 0 2024-04-25T22:03:23.594 INFO:tasks.workunit.client.0.smithi044.stdout:1/799: read - d3/d4b/ff8 zero size 2024-04-25T22:03:23.594 INFO:tasks.workunit.client.0.smithi044.stdout:1/800: mknod d3/d7/db/d5d/db0/cfa 0 2024-04-25T22:03:23.594 INFO:tasks.workunit.client.0.smithi044.stdout:0/929: dwrite d8/d78/db8/fe0 [0,4194304] 0 2024-04-25T22:03:23.594 INFO:tasks.workunit.client.0.smithi044.stdout:2/868: dwrite d7/fcb [0,4194304] 0 2024-04-25T22:03:23.594 INFO:tasks.workunit.client.0.smithi044.stdout:0/930: creat d8/df/d17/d45/d95/d9c/dcc/f13a x:0 0 0 2024-04-25T22:03:23.594 INFO:tasks.workunit.client.0.smithi044.stdout:5/994: dwrite d2/d5/d21/d26/d2c/f78 [0,4194304] 0 2024-04-25T22:03:23.595 INFO:tasks.workunit.client.0.smithi044.stdout:7/749: write d1c/d22/d28/d4e/d7b/f3e [1194833,70148] 0 2024-04-25T22:03:23.595 INFO:tasks.workunit.client.0.smithi044.stdout:7/750: chown d1c/fd3 272 1 2024-04-25T22:03:23.595 INFO:tasks.workunit.client.0.smithi044.stdout:0/931: mkdir d8/df/d17/d45/d95/d9c/dcc/dec/d13b 0 2024-04-25T22:03:23.595 INFO:tasks.workunit.client.0.smithi044.stdout:5/995: getdents d2/d5b/d8e/d10f 0 2024-04-25T22:03:23.595 INFO:tasks.workunit.client.0.smithi044.stdout:5/996: rename d2/dc1 to d2/d5b/da8/d139 0 2024-04-25T22:03:23.595 INFO:tasks.workunit.client.0.smithi044.stdout:0/932: rename d8/df/d17/d45/d95/d51/d8b/d90/f103 to d8/df/d17/d45/d95/d51/d8b/d90/f13c 0 2024-04-25T22:03:23.595 INFO:tasks.workunit.client.0.smithi044.stdout:5/997: mknod d2/d5/d21/d95/c13a 0 2024-04-25T22:03:23.595 INFO:tasks.workunit.client.0.smithi044.stdout:0/933: write d8/df/d17/d87/f108 [232115,52052] 0 2024-04-25T22:03:23.595 INFO:tasks.workunit.client.0.smithi044.stdout:5/998: fdatasync d2/d5/d21/d6b/fe5 0 2024-04-25T22:03:23.595 INFO:tasks.workunit.client.0.smithi044.stdout:1/801: dwrite d3/fc6 [0,4194304] 0 2024-04-25T22:03:23.596 INFO:tasks.workunit.client.0.smithi044.stdout:0/934: read - d8/df/d17/d45/d95/d51/d8b/d90/f13c zero size 2024-04-25T22:03:23.596 INFO:tasks.workunit.client.0.smithi044.stdout:0/935: write f6 [2170133,75694] 0 2024-04-25T22:03:23.596 INFO:tasks.workunit.client.0.smithi044.stdout:0/936: mkdir d8/da/d60/d13d 0 2024-04-25T22:03:23.596 INFO:tasks.workunit.client.0.smithi044.stdout:5/999: dwrite d2/d5/d27/d2a/d5c/d5f/f73 [0,4194304] 0 2024-04-25T22:03:23.596 INFO:tasks.workunit.client.0.smithi044.stdout:0/937: dwrite d8/da/f7a [0,4194304] 0 2024-04-25T22:03:23.596 INFO:tasks.workunit.client.0.smithi044.stdout:0/938: creat d8/da/f13e x:0 0 0 2024-04-25T22:03:23.596 INFO:tasks.workunit.client.0.smithi044.stdout:0/939: fdatasync d8/da/fcf 0 2024-04-25T22:03:23.596 INFO:tasks.workunit.client.0.smithi044.stdout:0/940: readlink d8/df/d17/d45/d95/d51/d8b/db0/lfc 0 2024-04-25T22:03:23.596 INFO:tasks.workunit.client.0.smithi044.stdout:0/941: write d8/df/d17/db9/f28 [1166733,8639] 0 2024-04-25T22:03:23.596 INFO:tasks.workunit.client.0.smithi044.stdout:0/942: mknod d8/df/d17/d87/c13f 0 2024-04-25T22:03:23.597 INFO:tasks.workunit.client.0.smithi044.stdout:0/943: sync 2024-04-25T22:03:23.597 INFO:tasks.workunit.client.0.smithi044.stdout:0/944: creat d8/df/d17/d45/d95/d51/d8b/db0/dea/d129/f140 x:0 0 0 2024-04-25T22:03:23.597 INFO:tasks.workunit.client.0.smithi044.stdout:0/945: symlink d8/df/d88/db6/l141 0 2024-04-25T22:03:23.597 INFO:tasks.workunit.client.0.smithi044.stdout:0/946: write f1 [483017,115814] 0 2024-04-25T22:03:23.597 INFO:tasks.workunit.client.0.smithi044.stdout:0/947: creat d8/df/d17/d45/d95/d9c/f142 x:0 0 0 2024-04-25T22:03:23.597 INFO:tasks.workunit.client.0.smithi044.stdout:1/802: dwrite d3/d30/d3f/df7/fb1 [0,4194304] 0 2024-04-25T22:03:23.597 INFO:tasks.workunit.client.0.smithi044.stdout:1/803: read - d3/d59/ff5 zero size 2024-04-25T22:03:23.597 INFO:tasks.workunit.client.0.smithi044.stdout:1/804: rename d3/d7/l38 to d3/d4b/lfb 0 2024-04-25T22:03:23.597 INFO:tasks.workunit.client.0.smithi044.stdout:4/817: dread dd/d35/d52/da9/dca/d79/d7f/f85 [4194304,4194304] 0 2024-04-25T22:03:23.597 INFO:tasks.workunit.client.0.smithi044.stdout:4/818: mkdir dd/d19/d91/d10a 0 2024-04-25T22:03:23.597 INFO:tasks.workunit.client.0.smithi044.stdout:2/869: dread d7/d8/d5f/d70/d8a/f92 [0,4194304] 0 2024-04-25T22:03:23.597 INFO:tasks.workunit.client.0.smithi044.stdout:4/819: mkdir dd/d35/d52/da9/dca/d79/d9c/d10b 0 2024-04-25T22:03:23.598 INFO:tasks.workunit.client.0.smithi044.stdout:2/870: chown d7/d7b/d81/d4e/d86/d6b/d78/d44/dad 5951963 1 2024-04-25T22:03:23.598 INFO:tasks.workunit.client.0.smithi044.stdout:4/820: rename dd/d35/d52/d61/f73 to dd/d35/d52/da9/dca/d79/d9c/d10b/f10c 0 2024-04-25T22:03:23.598 INFO:tasks.workunit.client.0.smithi044.stdout:2/871: getdents d7/d8/d48/dd9/d2c/df2 0 2024-04-25T22:03:23.598 INFO:tasks.workunit.client.0.smithi044.stdout:4/821: rename dd/d19/daf to dd/d35/d52/da9/dca/d9d/d10d 0 2024-04-25T22:03:23.598 INFO:tasks.workunit.client.0.smithi044.stdout:4/822: mkdir dd/d19/d91/d10e 0 2024-04-25T22:03:23.598 INFO:tasks.workunit.client.0.smithi044.stdout:2/872: rename d7/d7b/d81/d4e/f39 to d7/d7b/d81/d105/f128 0 2024-04-25T22:03:23.598 INFO:tasks.workunit.client.0.smithi044.stdout:4/823: fdatasync dd/d35/f5e 0 2024-04-25T22:03:23.599 INFO:tasks.workunit.client.0.smithi044.stdout:2/873: symlink d7/d8/d1c/d77/l129 0 2024-04-25T22:03:23.599 INFO:tasks.workunit.client.0.smithi044.stdout:4/824: write dd/f17 [4488413,91856] 0 2024-04-25T22:03:23.599 INFO:tasks.workunit.client.0.smithi044.stdout:2/874: creat d7/d7b/d81/d57/f12a x:0 0 0 2024-04-25T22:03:23.599 INFO:tasks.workunit.client.0.smithi044.stdout:2/875: chown d7/d8/d48/df4 169 1 2024-04-25T22:03:23.599 INFO:tasks.workunit.client.0.smithi044.stdout:4/825: rename dd/d35/d52/da9/dca/df9 to dd/d19/d91/d10e/d10f 0 2024-04-25T22:03:23.599 INFO:tasks.workunit.client.0.smithi044.stdout:2/876: read - d7/d8/d48/dd9/d2c/d50/ff1 zero size 2024-04-25T22:03:23.599 INFO:tasks.workunit.client.0.smithi044.stdout:2/877: read d7/d7b/d81/d4e/d86/ff7 [3242085,86057] 0 2024-04-25T22:03:23.602 INFO:tasks.workunit.client.0.smithi044.stdout:1/805: dwrite d3/d7/d83/df9/dc2/ff1 [0,4194304] 0 2024-04-25T22:03:23.602 INFO:tasks.workunit.client.0.smithi044.stdout:4/826: dwrite dd/d35/d52/da9/dca/d9d/d10d/fdf [0,4194304] 0 2024-04-25T22:03:23.603 INFO:tasks.workunit.client.0.smithi044.stdout:1/806: getdents d3 0 2024-04-25T22:03:23.603 INFO:tasks.workunit.client.0.smithi044.stdout:4/827: mkdir dd/d35/d52/da9/dca/da0/d110 0 2024-04-25T22:03:23.603 INFO:tasks.workunit.client.0.smithi044.stdout:1/807: mkdir d3/d30/d3f/df7/d43/d85/dfc 0 2024-04-25T22:03:23.603 INFO:tasks.workunit.client.0.smithi044.stdout:1/808: readlink d3/d72/l7e 0 2024-04-25T22:03:23.603 INFO:tasks.workunit.client.0.smithi044.stdout:7/751: fsync d1c/d22/d28/d30/d32/f9a 0 2024-04-25T22:03:23.603 INFO:tasks.workunit.client.0.smithi044.stdout:7/752: symlink d1c/d88/le1 0 2024-04-25T22:03:23.603 INFO:tasks.workunit.client.0.smithi044.stdout:7/753: write d1c/d22/d28/d30/f36 [4950751,39463] 0 2024-04-25T22:03:23.603 INFO:tasks.workunit.client.0.smithi044.stdout:4/828: mkdir dd/d35/d52/da9/dca/da0/d111 0 2024-04-25T22:03:23.604 INFO:tasks.workunit.client.0.smithi044.stdout:7/754: creat d1c/d22/d4a/dcc/fe2 x:0 0 0 2024-04-25T22:03:23.604 INFO:tasks.workunit.client.0.smithi044.stdout:4/829: symlink dd/d35/d52/da9/dca/d79/d7f/dd1/l112 0 2024-04-25T22:03:23.604 INFO:tasks.workunit.client.0.smithi044.stdout:1/809: dread d3/d30/d3f/df7/d43/fa1 [0,4194304] 0 2024-04-25T22:03:23.604 INFO:tasks.workunit.client.0.smithi044.stdout:4/830: creat dd/d35/d52/da9/f113 x:0 0 0 2024-04-25T22:03:23.604 INFO:tasks.workunit.client.0.smithi044.stdout:1/810: write d3/d72/f8c [3338649,22557] 0 2024-04-25T22:03:23.604 INFO:tasks.workunit.client.0.smithi044.stdout:4/831: mkdir dd/d19/d91/d10e/d114 0 2024-04-25T22:03:23.604 INFO:tasks.workunit.client.0.smithi044.stdout:1/811: creat d3/d54/d76/ffd x:0 0 0 2024-04-25T22:03:23.606 INFO:tasks.workunit.client.0.smithi044.stdout:4/832: chown dd/d35/d52/da9/dca/d79/d7f/dd1/de4 15 1 2024-04-25T22:03:23.606 INFO:tasks.workunit.client.0.smithi044.stdout:4/833: write dd/f41 [324948,126728] 0 2024-04-25T22:03:23.606 INFO:tasks.workunit.client.0.smithi044.stdout:2/878: dread f0 [0,4194304] 0 2024-04-25T22:03:23.606 INFO:tasks.workunit.client.0.smithi044.stdout:1/812: getdents d3/d59/d5c 0 2024-04-25T22:03:23.606 INFO:tasks.workunit.client.0.smithi044.stdout:4/834: symlink dd/d19/d91/l115 0 2024-04-25T22:03:23.606 INFO:tasks.workunit.client.0.smithi044.stdout:2/879: symlink d7/d8/d48/dd9/d2c/l12b 0 2024-04-25T22:03:23.607 INFO:tasks.workunit.client.0.smithi044.stdout:7/755: write d1c/d22/d4a/f64 [1157447,84596] 0 2024-04-25T22:03:23.607 INFO:tasks.workunit.client.0.smithi044.stdout:4/835: creat dd/d35/d52/da9/dca/d79/d7f/de6/f116 x:0 0 0 2024-04-25T22:03:23.607 INFO:tasks.workunit.client.0.smithi044.stdout:2/880: chown d7/d8/d48/dd9/cf6 0 1 2024-04-25T22:03:23.608 INFO:tasks.workunit.client.0.smithi044.stdout:2/881: write d7/d8/d48/dd9/f20 [185024,59009] 0 2024-04-25T22:03:23.608 INFO:tasks.workunit.client.0.smithi044.stdout:7/756: creat d1c/d22/d4a/fe3 x:0 0 0 2024-04-25T22:03:23.608 INFO:tasks.workunit.client.0.smithi044.stdout:7/757: write f0 [2960228,52370] 0 2024-04-25T22:03:23.608 INFO:tasks.workunit.client.0.smithi044.stdout:2/882: chown d7/d8/d1c/f5c 458 1 2024-04-25T22:03:23.609 INFO:tasks.workunit.client.0.smithi044.stdout:7/758: mkdir d1c/d22/d28/d4e/d6a/de4 0 2024-04-25T22:03:23.610 INFO:tasks.workunit.client.0.smithi044.stdout:2/883: truncate d7/d8/d48/dd9/d2c/d75/fb3 270569 0 2024-04-25T22:03:23.610 INFO:tasks.workunit.client.0.smithi044.stdout:7/759: rmdir d1c/d88/d8f/d9c 39 2024-04-25T22:03:23.611 INFO:tasks.workunit.client.0.smithi044.stdout:1/813: dwrite d3/d30/d3f/df7/d43/fa1 [0,4194304] 0 2024-04-25T22:03:23.612 INFO:tasks.workunit.client.0.smithi044.stdout:1/814: read - d3/d7/d83/fbd zero size 2024-04-25T22:03:23.612 INFO:tasks.workunit.client.0.smithi044.stdout:2/884: creat d7/d8/d48/dd9/d4b/f12c x:0 0 0 2024-04-25T22:03:23.613 INFO:tasks.workunit.client.0.smithi044.stdout:4/836: dwrite dd/d35/f4a [0,4194304] 0 2024-04-25T22:03:23.613 INFO:tasks.workunit.client.0.smithi044.stdout:2/885: symlink d7/d7b/d81/d4e/l12d 0 2024-04-25T22:03:23.614 INFO:tasks.workunit.client.0.smithi044.stdout:1/815: rename d3/d7/db/d5d/db0/dec to d3/d7/d81/dfe 0 2024-04-25T22:03:23.615 INFO:tasks.workunit.client.0.smithi044.stdout:1/816: dread - d3/d7/d83/df9/d97/fe9 zero size 2024-04-25T22:03:23.615 INFO:tasks.workunit.client.0.smithi044.stdout:2/886: rename d7/d7b/d81/d4e/c2a to d7/c12e 0 2024-04-25T22:03:23.615 INFO:tasks.workunit.client.0.smithi044.stdout:2/887: dread - d7/ff3 zero size 2024-04-25T22:03:23.619 INFO:tasks.workunit.client.0.smithi044.stdout:4/837: dwrite dd/f6f [0,4194304] 0 2024-04-25T22:03:23.620 INFO:tasks.workunit.client.0.smithi044.stdout:2/888: dread d7/d8/d48/f4f [0,4194304] 0 2024-04-25T22:03:23.621 INFO:tasks.workunit.client.0.smithi044.stdout:4/838: write dd/d19/f8c [681518,28784] 0 2024-04-25T22:03:23.622 INFO:tasks.workunit.client.0.smithi044.stdout:1/817: dwrite d3/d59/d5c/ff2 [0,4194304] 0 2024-04-25T22:03:23.623 INFO:tasks.workunit.client.0.smithi044.stdout:4/839: dread - dd/d19/fc9 zero size 2024-04-25T22:03:23.623 INFO:tasks.workunit.client.0.smithi044.stdout:1/818: rename d3/d59/d5c/ff2 to d3/d59/fff 0 2024-04-25T22:03:23.624 INFO:tasks.workunit.client.0.smithi044.stdout:4/840: write dd/d35/f5e [1018777,115132] 0 2024-04-25T22:03:23.625 INFO:tasks.workunit.client.0.smithi044.stdout:1/819: creat d3/d30/d3f/df7/dcf/f100 x:0 0 0 2024-04-25T22:03:23.626 INFO:tasks.workunit.client.0.smithi044.stdout:4/841: link dd/d35/l4d dd/d35/d52/da9/dca/d79/d9c/l117 0 2024-04-25T22:03:23.626 INFO:tasks.workunit.client.0.smithi044.stdout:1/820: fsync d3/d30/d3f/df7/d43/f52 0 2024-04-25T22:03:23.627 INFO:tasks.workunit.client.0.smithi044.stdout:1/821: write d3/d4b/fb9 [3542125,22815] 0 2024-04-25T22:03:23.635 INFO:tasks.workunit.client.0.smithi044.stdout:4/842: dread dd/d35/d52/da9/dca/f8d [0,4194304] 0 2024-04-25T22:03:23.635 INFO:tasks.workunit.client.0.smithi044.stdout:7/760: dread d1c/d22/d28/f58 [0,4194304] 0 2024-04-25T22:03:23.635 INFO:tasks.workunit.client.0.smithi044.stdout:4/843: chown dd/f8a 15999 1 2024-04-25T22:03:23.635 INFO:tasks.workunit.client.0.smithi044.stdout:7/761: write d1c/d22/d28/d4e/d6a/f8c [361203,56240] 0 2024-04-25T22:03:23.635 INFO:tasks.workunit.client.0.smithi044.stdout:1/822: dwrite d3/d54/d76/f9f [0,4194304] 0 2024-04-25T22:03:23.635 INFO:tasks.workunit.client.0.smithi044.stdout:0/948: dread f6 [0,4194304] 0 2024-04-25T22:03:23.635 INFO:tasks.workunit.client.0.smithi044.stdout:7/762: mknod d1c/d22/d28/d66/d6e/dd2/ce5 0 2024-04-25T22:03:23.636 INFO:tasks.workunit.client.0.smithi044.stdout:1/823: stat d3/d7/d81 0 2024-04-25T22:03:23.636 INFO:tasks.workunit.client.0.smithi044.stdout:0/949: chown d8/da/d60/d86/fdf 128683 1 2024-04-25T22:03:23.636 INFO:tasks.workunit.client.0.smithi044.stdout:2/889: dread d7/d7b/d81/d4e/d86/f8f [0,4194304] 0 2024-04-25T22:03:23.636 INFO:tasks.workunit.client.0.smithi044.stdout:1/824: write d3/d7/fbc [37867,91719] 0 2024-04-25T22:03:23.637 INFO:tasks.workunit.client.0.smithi044.stdout:0/950: readlink d8/df/d93/lf9 0 2024-04-25T22:03:23.637 INFO:tasks.workunit.client.0.smithi044.stdout:7/763: rename d1c/d88/d8f/fb5 to d1c/d22/d28/d4e/d6a/d9e/fe6 0 2024-04-25T22:03:23.637 INFO:tasks.workunit.client.0.smithi044.stdout:2/890: stat d7/d7b/d81/d57/l6c 0 2024-04-25T22:03:23.637 INFO:tasks.workunit.client.0.smithi044.stdout:1/825: symlink d3/d4b/l101 0 2024-04-25T22:03:23.637 INFO:tasks.workunit.client.0.smithi044.stdout:2/891: read - d7/d8/d48/fff zero size 2024-04-25T22:03:23.637 INFO:tasks.workunit.client.0.smithi044.stdout:2/892: dread - d7/d7b/d81/d4e/f124 zero size 2024-04-25T22:03:23.638 INFO:tasks.workunit.client.0.smithi044.stdout:1/826: link d3/d7/d83/df9/faa d3/d30/dbb/f102 0 2024-04-25T22:03:23.638 INFO:tasks.workunit.client.0.smithi044.stdout:4/844: dwrite dd/d35/d52/da9/dca/d79/d7f/dc3/fa1 [4194304,4194304] 0 2024-04-25T22:03:23.639 INFO:tasks.workunit.client.0.smithi044.stdout:4/845: chown c9 317422 1 2024-04-25T22:03:23.639 INFO:tasks.workunit.client.0.smithi044.stdout:2/893: mknod d7/d7b/d81/d4e/d86/c12f 0 2024-04-25T22:03:23.640 INFO:tasks.workunit.client.0.smithi044.stdout:2/894: creat d7/d8/d48/f130 x:0 0 0 2024-04-25T22:03:23.641 INFO:tasks.workunit.client.0.smithi044.stdout:0/951: dread d8/df/d17/d45/d95/d51/d8b/d90/fc9 [0,4194304] 0 2024-04-25T22:03:23.644 INFO:tasks.workunit.client.0.smithi044.stdout:0/952: read d8/df/d17/f83 [4583634,26594] 0 2024-04-25T22:03:23.644 INFO:tasks.workunit.client.0.smithi044.stdout:7/764: dwrite d1c/d22/d28/d30/d32/f42 [0,4194304] 0 2024-04-25T22:03:23.646 INFO:tasks.workunit.client.0.smithi044.stdout:1/827: dwrite d3/d30/d3f/f80 [0,4194304] 0 2024-04-25T22:03:23.646 INFO:tasks.workunit.client.0.smithi044.stdout:4/846: dwrite dd/f11 [0,4194304] 0 2024-04-25T22:03:23.646 INFO:tasks.workunit.client.0.smithi044.stdout:7/765: creat d1c/d22/d28/d4e/d7b/fe7 x:0 0 0 2024-04-25T22:03:23.647 INFO:tasks.workunit.client.0.smithi044.stdout:7/766: fsync d1c/f47 0 2024-04-25T22:03:23.647 INFO:tasks.workunit.client.0.smithi044.stdout:1/828: creat d3/d7/d81/dfe/f103 x:0 0 0 2024-04-25T22:03:23.648 INFO:tasks.workunit.client.0.smithi044.stdout:4/847: link dd/d19/f8c dd/d19/d104/f118 0 2024-04-25T22:03:23.650 INFO:tasks.workunit.client.0.smithi044.stdout:1/829: creat d3/d30/d3f/df7/d43/f104 x:0 0 0 2024-04-25T22:03:23.650 INFO:tasks.workunit.client.0.smithi044.stdout:4/848: rename dd/d19/d91/d10a to dd/d35/d52/da9/dca/d79/d9c/d10b/d119 0 2024-04-25T22:03:23.652 INFO:tasks.workunit.client.0.smithi044.stdout:4/849: chown dd/d35/d52/d61/f8e 41139832 1 2024-04-25T22:03:23.652 INFO:tasks.workunit.client.0.smithi044.stdout:0/953: dwrite d8/da/fcf [0,4194304] 0 2024-04-25T22:03:23.654 INFO:tasks.workunit.client.0.smithi044.stdout:0/954: symlink d8/d78/db8/dfa/l143 0 2024-04-25T22:03:23.655 INFO:tasks.workunit.client.0.smithi044.stdout:7/767: dwrite d1c/d22/d28/d4e/f61 [0,4194304] 0 2024-04-25T22:03:23.655 INFO:tasks.workunit.client.0.smithi044.stdout:4/850: link dd/d35/d52/d61/d76/fae dd/d19/d91/dd9/f11a 0 2024-04-25T22:03:23.656 INFO:tasks.workunit.client.0.smithi044.stdout:1/830: dwrite d3/f61 [0,4194304] 0 2024-04-25T22:03:23.656 INFO:tasks.workunit.client.0.smithi044.stdout:0/955: readlink d8/df/d17/d45/d95/d51/d8b/db0/l12d 0 2024-04-25T22:03:23.656 INFO:tasks.workunit.client.0.smithi044.stdout:1/831: stat d3/d4b/l75 0 2024-04-25T22:03:23.656 INFO:tasks.workunit.client.0.smithi044.stdout:7/768: write d1c/d22/d28/d30/d32/d5d/d83/fa2 [395182,99694] 0 2024-04-25T22:03:23.657 INFO:tasks.workunit.client.0.smithi044.stdout:1/832: write d3/f6d [3901460,84654] 0 2024-04-25T22:03:23.659 INFO:tasks.workunit.client.0.smithi044.stdout:1/833: stat d3/d7/db/l11 0 2024-04-25T22:03:23.659 INFO:tasks.workunit.client.0.smithi044.stdout:4/851: dread - dd/d35/d52/d61/d76/fc1 zero size 2024-04-25T22:03:23.660 INFO:tasks.workunit.client.0.smithi044.stdout:1/834: write d3/d30/d3f/df7/f39 [378286,11589] 0 2024-04-25T22:03:23.661 INFO:tasks.workunit.client.0.smithi044.stdout:0/956: creat d8/d20/f144 x:0 0 0 2024-04-25T22:03:23.662 INFO:tasks.workunit.client.0.smithi044.stdout:0/957: fdatasync d8/d78/db8/dfa/f102 0 2024-04-25T22:03:23.662 INFO:tasks.workunit.client.0.smithi044.stdout:1/835: mkdir d3/d30/dbb/d105 0 2024-04-25T22:03:23.662 INFO:tasks.workunit.client.0.smithi044.stdout:1/836: stat d3/d54/le5 0 2024-04-25T22:03:23.664 INFO:tasks.workunit.client.0.smithi044.stdout:0/958: getdents d8/db2/d8e 0 2024-04-25T22:03:23.664 INFO:tasks.workunit.client.0.smithi044.stdout:1/837: creat d3/d7/db/d5d/f106 x:0 0 0 2024-04-25T22:03:23.664 INFO:tasks.workunit.client.0.smithi044.stdout:1/838: mknod d3/d59/c107 0 2024-04-25T22:03:23.666 INFO:tasks.workunit.client.0.smithi044.stdout:0/959: truncate d8/df/d17/d45/d95/d9c/dcc/f12f 395816 0 2024-04-25T22:03:23.667 INFO:tasks.workunit.client.0.smithi044.stdout:7/769: dwrite d1c/d22/d28/d66/d6e/dd2/fe0 [0,4194304] 0 2024-04-25T22:03:23.668 INFO:tasks.workunit.client.0.smithi044.stdout:0/960: mkdir d8/df/d17/d45/d95/d51/d8b/db0/dea/d145 0 2024-04-25T22:03:23.671 INFO:tasks.workunit.client.0.smithi044.stdout:1/839: dwrite d3/d7/f2f [0,4194304] 0 2024-04-25T22:03:23.671 INFO:tasks.workunit.client.0.smithi044.stdout:1/840: readlink d3/d7/l90 0 2024-04-25T22:03:23.672 INFO:tasks.workunit.client.0.smithi044.stdout:1/841: unlink d3/d54/f92 0 2024-04-25T22:03:23.674 INFO:tasks.workunit.client.0.smithi044.stdout:1/842: fdatasync d3/d7/d83/df9/d97/d99/f78 0 2024-04-25T22:03:23.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:23.673+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:23.692 INFO:tasks.workunit.client.0.smithi044.stdout:7/770: dread d1c/d22/d28/d4e/d7b/d59/f91 [0,4194304] 0 2024-04-25T22:03:23.693 INFO:tasks.workunit.client.0.smithi044.stdout:7/771: write d1c/d22/d28/d30/fda [338921,65860] 0 2024-04-25T22:03:23.693 INFO:tasks.workunit.client.0.smithi044.stdout:7/772: chown c2 33143 1 2024-04-25T22:03:23.694 INFO:tasks.workunit.client.0.smithi044.stdout:1/843: getdents d3/d54 0 2024-04-25T22:03:23.694 INFO:tasks.workunit.client.0.smithi044.stdout:7/773: fdatasync d1c/d22/d28/d57/f8b 0 2024-04-25T22:03:23.695 INFO:tasks.workunit.client.0.smithi044.stdout:1/844: write d3/d30/d3f/df7/f35 [1207859,114964] 0 2024-04-25T22:03:23.696 INFO:tasks.workunit.client.0.smithi044.stdout:1/845: creat d3/d30/d3f/dc3/f108 x:0 0 0 2024-04-25T22:03:23.697 INFO:tasks.workunit.client.0.smithi044.stdout:0/961: dwrite d8/da/d60/d86/fdf [0,4194304] 0 2024-04-25T22:03:23.697 INFO:tasks.workunit.client.0.smithi044.stdout:1/846: creat d3/d7/d81/f109 x:0 0 0 2024-04-25T22:03:23.699 INFO:tasks.workunit.client.0.smithi044.stdout:0/962: mknod d8/d78/db8/dfa/c146 0 2024-04-25T22:03:23.699 INFO:tasks.workunit.client.0.smithi044.stdout:4/852: dread dd/f46 [4194304,4194304] 0 2024-04-25T22:03:23.700 INFO:tasks.workunit.client.0.smithi044.stdout:4/853: read - dd/d35/d52/d61/d76/fae zero size 2024-04-25T22:03:23.701 INFO:tasks.workunit.client.0.smithi044.stdout:1/847: rename d3/d7/cc8 to d3/d7/d83/df9/c10a 0 2024-04-25T22:03:23.701 INFO:tasks.workunit.client.0.smithi044.stdout:0/963: mknod d8/df/d17/d45/d95/d51/dc2/df4/c147 0 2024-04-25T22:03:23.702 INFO:tasks.workunit.client.0.smithi044.stdout:7/774: dwrite d1c/d22/d28/d30/d32/f43 [0,4194304] 0 2024-04-25T22:03:23.702 INFO:tasks.workunit.client.0.smithi044.stdout:4/854: mkdir dd/d35/d52/da9/dca/d79/d9c/d10b/d11b 0 2024-04-25T22:03:23.703 INFO:tasks.workunit.client.0.smithi044.stdout:4/855: getdents dd/d35/d52/da9/dca 0 2024-04-25T22:03:23.704 INFO:tasks.workunit.client.0.smithi044.stdout:4/856: dread - dd/d35/d52/da9/dca/db6/fb8 zero size 2024-04-25T22:03:23.705 INFO:tasks.workunit.client.0.smithi044.stdout:4/857: chown dd/d19/f6d 10099233 1 2024-04-25T22:03:23.707 INFO:tasks.workunit.client.0.smithi044.stdout:1/848: dwrite d3/d54/f65 [0,4194304] 0 2024-04-25T22:03:23.707 INFO:tasks.workunit.client.0.smithi044.stdout:0/964: dwrite f6 [0,4194304] 0 2024-04-25T22:03:23.709 INFO:tasks.workunit.client.0.smithi044.stdout:0/965: creat d8/df/d17/db9/f148 x:0 0 0 2024-04-25T22:03:23.710 INFO:tasks.workunit.client.0.smithi044.stdout:0/966: creat d8/d78/db8/f149 x:0 0 0 2024-04-25T22:03:23.711 INFO:tasks.workunit.client.0.smithi044.stdout:1/849: rename d3/d30/d3f/df7 to d3/d7/db/d8f/d10b 0 2024-04-25T22:03:23.712 INFO:tasks.workunit.client.0.smithi044.stdout:7/775: dread d1c/d22/f5c [0,4194304] 0 2024-04-25T22:03:23.712 INFO:tasks.workunit.client.0.smithi044.stdout:1/850: dread - d3/d7/d83/de3/fef zero size 2024-04-25T22:03:23.713 INFO:tasks.workunit.client.0.smithi044.stdout:7/776: chown d1c/d22/d28/d57/fc6 4075102 1 2024-04-25T22:03:23.714 INFO:tasks.workunit.client.0.smithi044.stdout:1/851: rename d3/d7/d83/df9/fa4 to d3/d7/d83/df9/dc2/f10c 0 2024-04-25T22:03:23.714 INFO:tasks.workunit.client.0.smithi044.stdout:7/777: link d1c/f79 d1c/d22/d28/d4e/d6a/d9e/fe8 0 2024-04-25T22:03:23.715 INFO:tasks.workunit.client.0.smithi044.stdout:7/778: chown d1c/d22/d28/d57/d7c/fb4 870403670 1 2024-04-25T22:03:23.715 INFO:tasks.workunit.client.0.smithi044.stdout:7/779: creat d1c/d22/d28/d57/d7c/dde/fe9 x:0 0 0 2024-04-25T22:03:23.716 INFO:tasks.workunit.client.0.smithi044.stdout:7/780: dread - d1c/d22/d28/d57/d7c/dde/fe9 zero size 2024-04-25T22:03:23.720 INFO:tasks.workunit.client.0.smithi044.stdout:2/895: dread d7/d7b/d81/d4e/f24 [0,4194304] 0 2024-04-25T22:03:23.723 INFO:tasks.workunit.client.0.smithi044.stdout:0/967: getdents d8/df/d17/d45/d95/d51/dc2/df4 0 2024-04-25T22:03:23.724 INFO:tasks.workunit.client.0.smithi044.stdout:2/896: dread d7/d8/d5f/d70/d8a/f92 [0,4194304] 0 2024-04-25T22:03:23.725 INFO:tasks.workunit.client.0.smithi044.stdout:2/897: truncate d7/d7b/d81/d4e/d86/d6b/d78/f5a 8850841 0 2024-04-25T22:03:23.726 INFO:tasks.workunit.client.0.smithi044.stdout:7/781: read d1c/d88/d8f/d9c/fad [411692,69986] 0 2024-04-25T22:03:23.727 INFO:tasks.workunit.client.0.smithi044.stdout:2/898: chown d7/d7b/d81/d4e/d86/lc2 34 1 2024-04-25T22:03:23.727 INFO:tasks.workunit.client.0.smithi044.stdout:7/782: rmdir d1c/d22/d28 39 2024-04-25T22:03:23.728 INFO:tasks.workunit.client.0.smithi044.stdout:2/899: write d7/d8/d48/dd9/d2c/f3b [757608,90692] 0 2024-04-25T22:03:23.729 INFO:tasks.workunit.client.0.smithi044.stdout:7/783: rename d1c/d22/d28/l8d to d1c/d22/d28/d4e/d6a/de4/lea 0 2024-04-25T22:03:23.729 INFO:tasks.workunit.client.0.smithi044.stdout:0/968: dwrite d8/df/f112 [0,4194304] 0 2024-04-25T22:03:23.730 INFO:tasks.workunit.client.0.smithi044.stdout:2/900: truncate d7/d7b/d81/d4e/f124 863520 0 2024-04-25T22:03:23.734 INFO:tasks.workunit.client.0.smithi044.stdout:7/784: mknod d1c/d22/d28/d30/d32/ceb 0 2024-04-25T22:03:23.734 INFO:tasks.workunit.client.0.smithi044.stdout:2/901: rename d7/d8/de2/lc4 to d7/d7b/d81/d4e/d86/d6b/d78/d44/l131 0 2024-04-25T22:03:23.734 INFO:tasks.workunit.client.0.smithi044.stdout:2/902: rename d7/d8/d48/dd9/f11a to d7/d7b/d81/d57/f132 0 2024-04-25T22:03:23.734 INFO:tasks.workunit.client.0.smithi044.stdout:2/903: write d7/d8/d5f/d70/d8a/fd7 [26112,121223] 0 2024-04-25T22:03:23.734 INFO:tasks.workunit.client.0.smithi044.stdout:4/858: fsync dd/d35/d52/da9/dca/d79/d7f/dc3/fa1 0 2024-04-25T22:03:23.735 INFO:tasks.workunit.client.0.smithi044.stdout:4/859: write dd/d35/d52/f99 [842058,50060] 0 2024-04-25T22:03:23.735 INFO:tasks.workunit.client.0.smithi044.stdout:2/904: getdents d7/d7b/d81/d4e/d86/d6b/dd8/ded 0 2024-04-25T22:03:23.736 INFO:tasks.workunit.client.0.smithi044.stdout:2/905: chown d7/d8/d1c/d77 8 1 2024-04-25T22:03:23.737 INFO:tasks.workunit.client.0.smithi044.stdout:4/860: creat dd/d35/d52/da9/dca/d79/d7f/f11c x:0 0 0 2024-04-25T22:03:23.737 INFO:tasks.workunit.client.0.smithi044.stdout:2/906: creat d7/d8/de2/f133 x:0 0 0 2024-04-25T22:03:23.739 INFO:tasks.workunit.client.0.smithi044.stdout:1/852: dread d3/d30/fd8 [0,4194304] 0 2024-04-25T22:03:23.739 INFO:tasks.workunit.client.0.smithi044.stdout:1/853: mkdir d3/d7/db/d10d 0 2024-04-25T22:03:23.740 INFO:tasks.workunit.client.0.smithi044.stdout:1/854: unlink d3/d72/f8b 0 2024-04-25T22:03:23.741 INFO:tasks.workunit.client.0.smithi044.stdout:1/855: chown d3/d7/f57 2375 1 2024-04-25T22:03:23.743 INFO:tasks.workunit.client.0.smithi044.stdout:2/907: dwrite d7/d8/d48/fff [0,4194304] 0 2024-04-25T22:03:23.744 INFO:tasks.workunit.client.0.smithi044.stdout:2/908: mknod d7/d7b/d81/d4e/d86/d6b/d78/d44/dad/c134 0 2024-04-25T22:03:23.747 INFO:tasks.workunit.client.0.smithi044.stdout:7/785: write d1c/d22/d4a/fbe [3867644,58529] 0 2024-04-25T22:03:23.748 INFO:tasks.workunit.client.0.smithi044.stdout:2/909: write d7/d8/d48/dd9/fdf [888731,52712] 0 2024-04-25T22:03:23.749 INFO:tasks.workunit.client.0.smithi044.stdout:1/856: dwrite d3/d7/db/f46 [0,4194304] 0 2024-04-25T22:03:23.750 INFO:tasks.workunit.client.0.smithi044.stdout:7/786: creat d1c/d22/fec x:0 0 0 2024-04-25T22:03:23.751 INFO:tasks.workunit.client.0.smithi044.stdout:7/787: creat d1c/d22/d28/d4e/da1/fed x:0 0 0 2024-04-25T22:03:23.751 INFO:tasks.workunit.client.0.smithi044.stdout:4/861: dwrite dd/f48 [0,4194304] 0 2024-04-25T22:03:23.752 INFO:tasks.workunit.client.0.smithi044.stdout:7/788: mkdir d1c/d22/d28/d66/d6e/dee 0 2024-04-25T22:03:23.754 INFO:tasks.workunit.client.0.smithi044.stdout:7/789: creat d1c/d88/fef x:0 0 0 2024-04-25T22:03:23.754 INFO:tasks.workunit.client.0.smithi044.stdout:4/862: unlink dd/d35/d52/da9/dca/d79/d7f/dd1/f102 0 2024-04-25T22:03:23.755 INFO:tasks.workunit.client.0.smithi044.stdout:7/790: creat d1c/d22/d28/d4e/d6a/ff0 x:0 0 0 2024-04-25T22:03:23.755 INFO:tasks.workunit.client.0.smithi044.stdout:2/910: dwrite d7/d7b/d81/d4e/d86/d6b/fa2 [0,4194304] 0 2024-04-25T22:03:23.756 INFO:tasks.workunit.client.0.smithi044.stdout:7/791: mkdir d1c/d22/d28/df1 0 2024-04-25T22:03:23.756 INFO:tasks.workunit.client.0.smithi044.stdout:7/792: symlink d1c/d22/d28/d4e/lf2 0 2024-04-25T22:03:23.758 INFO:tasks.workunit.client.0.smithi044.stdout:7/793: rmdir d1c/d22/d28/d4e/d7b 39 2024-04-25T22:03:23.759 INFO:tasks.workunit.client.0.smithi044.stdout:2/911: write d7/d7b/d81/d57/f115 [511616,24689] 0 2024-04-25T22:03:23.761 INFO:tasks.workunit.client.0.smithi044.stdout:4/863: dwrite dd/d35/d52/da9/dca/d79/d7f/f85 [0,4194304] 0 2024-04-25T22:03:23.763 INFO:tasks.workunit.client.0.smithi044.stdout:7/794: dwrite d1c/d22/d4a/f62 [0,4194304] 0 2024-04-25T22:03:23.765 INFO:tasks.workunit.client.0.smithi044.stdout:7/795: write d1c/d22/fec [432241,129608] 0 2024-04-25T22:03:23.765 INFO:tasks.workunit.client.0.smithi044.stdout:7/796: read - d1c/fd3 zero size 2024-04-25T22:03:23.766 INFO:tasks.workunit.client.0.smithi044.stdout:2/912: dwrite d7/d8/d48/db2/fd5 [0,4194304] 0 2024-04-25T22:03:23.766 INFO:tasks.workunit.client.0.smithi044.stdout:7/797: read - d1c/d22/d4a/fe3 zero size 2024-04-25T22:03:23.770 INFO:tasks.workunit.client.0.smithi044.stdout:7/798: mkdir d1c/df3 0 2024-04-25T22:03:23.770 INFO:tasks.workunit.client.0.smithi044.stdout:4/864: dwrite dd/f48 [0,4194304] 0 2024-04-25T22:03:23.771 INFO:tasks.workunit.client.0.smithi044.stdout:2/913: truncate d7/d8/d48/f63 203387 0 2024-04-25T22:03:23.771 INFO:tasks.workunit.client.0.smithi044.stdout:2/914: fsync d7/fcb 0 2024-04-25T22:03:23.771 INFO:tasks.workunit.client.0.smithi044.stdout:7/799: rename d1c/d22/d28/d4e/da1/fd0 to d1c/d22/d28/df1/ff4 0 2024-04-25T22:03:23.771 INFO:tasks.workunit.client.0.smithi044.stdout:2/915: write d7/d8/d48/dd9/d2c/d75/f9f [3121572,59703] 0 2024-04-25T22:03:23.771 INFO:tasks.workunit.client.0.smithi044.stdout:4/865: link dd/d35/d52/dfa/f64 dd/d19/d91/d10e/d114/f11d 0 2024-04-25T22:03:23.771 INFO:tasks.workunit.client.0.smithi044.stdout:7/800: write d1c/d22/d28/d4e/f61 [2423101,75358] 0 2024-04-25T22:03:23.772 INFO:tasks.workunit.client.0.smithi044.stdout:2/916: symlink d7/d8/d5f/d70/d8a/l135 0 2024-04-25T22:03:23.772 INFO:tasks.workunit.client.0.smithi044.stdout:4/866: read - dd/d35/d52/d61/d76/fc1 zero size 2024-04-25T22:03:23.772 INFO:tasks.workunit.client.0.smithi044.stdout:2/917: read - d7/ff3 zero size 2024-04-25T22:03:23.773 INFO:tasks.workunit.client.0.smithi044.stdout:4/867: mkdir dd/d35/d52/da9/dca/db6/d11e 0 2024-04-25T22:03:23.774 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:23.768+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:23.774 INFO:tasks.workunit.client.0.smithi044.stdout:4/868: mkdir dd/d35/d52/da9/dca/db6/df0/d11f 0 2024-04-25T22:03:23.775 INFO:tasks.workunit.client.0.smithi044.stdout:2/918: fdatasync d7/d8/d48/dd9/d2c/d75/fb3 0 2024-04-25T22:03:23.775 INFO:tasks.workunit.client.0.smithi044.stdout:4/869: fsync dd/d35/d52/da9/fc5 0 2024-04-25T22:03:23.776 INFO:tasks.workunit.client.0.smithi044.stdout:4/870: unlink dd/d35/d52/l57 0 2024-04-25T22:03:23.777 INFO:tasks.workunit.client.0.smithi044.stdout:4/871: chown dd/d19/f2b 1489 1 2024-04-25T22:03:23.777 INFO:tasks.workunit.client.0.smithi044.stdout:2/919: rename d7/d8/d48/dd9/d2c/l12b to d7/d7b/d81/d4e/d86/d6b/l136 0 2024-04-25T22:03:23.779 INFO:tasks.workunit.client.0.smithi044.stdout:7/801: dwrite d1c/d22/d4a/faa [0,4194304] 0 2024-04-25T22:03:23.782 INFO:tasks.workunit.client.0.smithi044.stdout:1/857: sync 2024-04-25T22:03:23.783 INFO:tasks.workunit.client.0.smithi044.stdout:1/858: mkdir d3/d7/d83/df9/d97/d10e 0 2024-04-25T22:03:23.785 INFO:tasks.workunit.client.0.smithi044.stdout:0/969: dread d8/df/d17/d87/fa1 [0,4194304] 0 2024-04-25T22:03:23.786 INFO:tasks.workunit.client.0.smithi044.stdout:0/970: symlink d8/df/d17/d45/d95/d51/dc2/l14a 0 2024-04-25T22:03:23.787 INFO:tasks.workunit.client.0.smithi044.stdout:0/971: chown d8/df/d17/d45/d95/f42 109272 1 2024-04-25T22:03:23.787 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:23.787 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:23.788 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:03:23.788 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:03:23.788 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:23.788 INFO:tasks.workunit.client.0.smithi044.stdout:0/972: chown d8/df/d17/db9/d7c/ce1 852 1 2024-04-25T22:03:23.789 INFO:tasks.workunit.client.0.smithi044.stdout:0/973: dread - d8/df/d17/d45/d95/d9c/fe8 zero size 2024-04-25T22:03:23.790 INFO:tasks.workunit.client.0.smithi044.stdout:1/859: dwrite d3/d59/f93 [0,4194304] 0 2024-04-25T22:03:23.791 INFO:tasks.workunit.client.0.smithi044.stdout:0/974: creat d8/df/d17/d45/d95/d51/dc2/f14b x:0 0 0 2024-04-25T22:03:23.793 INFO:tasks.workunit.client.0.smithi044.stdout:0/975: creat d8/da/f14c x:0 0 0 2024-04-25T22:03:23.794 INFO:tasks.workunit.client.0.smithi044.stdout:7/802: dwrite d1c/d22/d4a/f72 [0,4194304] 0 2024-04-25T22:03:23.795 INFO:tasks.workunit.client.0.smithi044.stdout:0/976: creat d8/df/d17/d45/d95/d51/d8b/f14d x:0 0 0 2024-04-25T22:03:23.795 INFO:tasks.workunit.client.0.smithi044.stdout:2/920: dwrite d7/d8/d5f/f76 [0,4194304] 0 2024-04-25T22:03:23.797 INFO:tasks.workunit.client.0.smithi044.stdout:7/803: write d1c/d22/d28/d4e/d7b/fe7 [40231,49013] 0 2024-04-25T22:03:23.797 INFO:tasks.workunit.client.0.smithi044.stdout:2/921: mkdir d7/d8/d48/d137 0 2024-04-25T22:03:23.797 INFO:tasks.workunit.client.0.smithi044.stdout:0/977: write d8/df/d17/d45/d95/d9c/dcc/f8d [2756420,28087] 0 2024-04-25T22:03:23.797 INFO:tasks.workunit.client.0.smithi044.stdout:0/978: fdatasync d8/db2/fe5 0 2024-04-25T22:03:23.798 INFO:tasks.workunit.client.0.smithi044.stdout:0/979: mkdir d8/d14e 0 2024-04-25T22:03:23.798 INFO:tasks.workunit.client.0.smithi044.stdout:7/804: link d1c/d22/d28/d57/d7c/fb4 d1c/d22/d28/d4e/d6a/d9e/ff5 0 2024-04-25T22:03:23.798 INFO:tasks.workunit.client.0.smithi044.stdout:0/980: dread - d8/f10b zero size 2024-04-25T22:03:23.799 INFO:tasks.workunit.client.0.smithi044.stdout:0/981: write d8/d78/db8/dfa/f120 [746083,119088] 0 2024-04-25T22:03:23.800 INFO:tasks.workunit.client.0.smithi044.stdout:7/805: write d1c/d22/d28/d30/d32/f55 [1553990,78372] 0 2024-04-25T22:03:23.801 INFO:tasks.workunit.client.0.smithi044.stdout:7/806: symlink d1c/d22/d28/d30/d32/d5d/lf6 0 2024-04-25T22:03:23.801 INFO:tasks.workunit.client.0.smithi044.stdout:0/982: mkdir d8/df/d17/d45/d95/de7/ded/d14f 0 2024-04-25T22:03:23.802 INFO:tasks.workunit.client.0.smithi044.stdout:7/807: stat d1c/d22/d28/d30/d32/d97/fb2 0 2024-04-25T22:03:23.803 INFO:tasks.workunit.client.0.smithi044.stdout:0/983: rename d8/d20/f144 to d8/df/d17/d87/d116/f150 0 2024-04-25T22:03:23.804 INFO:tasks.workunit.client.0.smithi044.stdout:7/808: symlink d1c/d22/d28/d30/d32/d5d/d83/lf7 0 2024-04-25T22:03:23.804 INFO:tasks.workunit.client.0.smithi044.stdout:2/922: dwrite d7/d7b/d81/d4e/f124 [0,4194304] 0 2024-04-25T22:03:23.805 INFO:tasks.workunit.client.0.smithi044.stdout:7/809: truncate d1c/f50 2235955 0 2024-04-25T22:03:23.806 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:23.811 INFO:tasks.workunit.client.0.smithi044.stdout:7/810: dwrite d1c/d22/d28/d30/f36 [4194304,4194304] 0 2024-04-25T22:03:23.811 INFO:tasks.workunit.client.0.smithi044.stdout:4/872: dread dd/d19/d104/f118 [0,4194304] 0 2024-04-25T22:03:23.813 INFO:tasks.workunit.client.0.smithi044.stdout:4/873: mkdir dd/d19/d91/d120 0 2024-04-25T22:03:23.819 INFO:tasks.workunit.client.0.smithi044.stdout:4/874: dwrite dd/d35/d52/da9/dca/d79/d7f/dc3/fa1 [4194304,4194304] 0 2024-04-25T22:03:23.823 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:03:23.823 INFO:tasks.workunit.client.0.smithi044.stdout:7/811: dread d1c/d22/f71 [0,4194304] 0 2024-04-25T22:03:23.824 INFO:tasks.workunit.client.0.smithi044.stdout:7/812: mkdir d1c/d22/d28/d30/df8 0 2024-04-25T22:03:23.825 INFO:tasks.workunit.client.0.smithi044.stdout:4/875: dwrite dd/f36 [0,4194304] 0 2024-04-25T22:03:23.827 INFO:tasks.workunit.client.0.smithi044.stdout:4/876: creat dd/d35/d52/da9/dca/db6/df0/f121 x:0 0 0 2024-04-25T22:03:23.827 INFO:tasks.workunit.client.0.smithi044.stdout:4/877: dread - dd/d35/fe7 zero size 2024-04-25T22:03:23.830 INFO:tasks.workunit.client.0.smithi044.stdout:7/813: dread d1c/d22/d28/d30/f36 [4194304,4194304] 0 2024-04-25T22:03:23.831 INFO:tasks.workunit.client.0.smithi044.stdout:7/814: rmdir d1c/d88/d8f/dce 39 2024-04-25T22:03:23.832 INFO:tasks.workunit.client.0.smithi044.stdout:0/984: dread d8/df/d17/d45/d95/d9c/dcc/f8d [4194304,4194304] 0 2024-04-25T22:03:23.832 INFO:tasks.workunit.client.0.smithi044.stdout:7/815: write d1c/d22/d28/d30/f7d [1044323,55461] 0 2024-04-25T22:03:23.832 INFO:tasks.workunit.client.0.smithi044.stdout:7/816: unlink d1c/fa9 0 2024-04-25T22:03:23.832 INFO:tasks.workunit.client.0.smithi044.stdout:7/817: stat d1c/d22/d28/d57/d7c/lc9 0 2024-04-25T22:03:23.833 INFO:tasks.workunit.client.0.smithi044.stdout:0/985: rename d8/df/d17/f11a to d8/da/d60/daa/f151 0 2024-04-25T22:03:23.833 INFO:tasks.workunit.client.0.smithi044.stdout:7/818: write d1c/d22/d28/d30/d32/d5d/f7e [4382274,56915] 0 2024-04-25T22:03:23.834 INFO:tasks.workunit.client.0.smithi044.stdout:4/878: truncate dd/d35/d52/da9/dca/f93 2926287 0 2024-04-25T22:03:23.835 INFO:tasks.workunit.client.0.smithi044.stdout:7/819: rename d1c/d22/d28/d30/d32/cbf to d1c/d22/d28/d66/cf9 0 2024-04-25T22:03:23.835 INFO:tasks.workunit.client.0.smithi044.stdout:4/879: mknod dd/d19/d91/d120/c122 0 2024-04-25T22:03:23.835 INFO:tasks.workunit.client.0.smithi044.stdout:7/820: read - d1c/fd3 zero size 2024-04-25T22:03:23.836 INFO:tasks.workunit.client.0.smithi044.stdout:4/880: rmdir dd/d35/d52/d61/d76 39 2024-04-25T22:03:23.837 INFO:tasks.workunit.client.0.smithi044.stdout:4/881: fsync dd/d35/d52/da9/dca/f108 0 2024-04-25T22:03:23.837 INFO:tasks.workunit.client.0.smithi044.stdout:7/821: rename d1c/d22/d28/d66/d6e to d1c/d22/d28/d4e/d6a/d9e/dfa 0 2024-04-25T22:03:23.837 INFO:tasks.workunit.client.0.smithi044.stdout:7/822: unlink d1c/c40 0 2024-04-25T22:03:23.838 INFO:tasks.workunit.client.0.smithi044.stdout:4/882: fsync dd/d35/d52/de9/f106 0 2024-04-25T22:03:23.838 INFO:tasks.workunit.client.0.smithi044.stdout:7/823: chown d1c/d22/d28/d66/c92 26747849 1 2024-04-25T22:03:23.839 INFO:tasks.workunit.client.0.smithi044.stdout:4/883: read dd/d35/d52/da9/dca/d79/d7f/f84 [3862536,76340] 0 2024-04-25T22:03:23.840 INFO:tasks.workunit.client.0.smithi044.stdout:7/824: creat d1c/d22/d28/d30/ffb x:0 0 0 2024-04-25T22:03:23.840 INFO:tasks.workunit.client.0.smithi044.stdout:4/884: rmdir dd/d19/d104 39 2024-04-25T22:03:23.841 INFO:tasks.workunit.client.0.smithi044.stdout:7/825: stat d1c/d22/f75 0 2024-04-25T22:03:23.841 INFO:tasks.workunit.client.0.smithi044.stdout:4/885: mknod dd/d19/d91/d10e/c123 0 2024-04-25T22:03:23.841 INFO:tasks.workunit.client.0.smithi044.stdout:7/826: dread - d1c/d22/d28/d57/d7c/dde/fe9 zero size 2024-04-25T22:03:23.842 INFO:tasks.workunit.client.0.smithi044.stdout:4/886: chown dd/d35/d52/da9/dca/d79/d7f/dc3/cab 189 1 2024-04-25T22:03:23.842 INFO:tasks.workunit.client.0.smithi044.stdout:7/827: creat d1c/d22/d28/d30/df8/ffc x:0 0 0 2024-04-25T22:03:23.844 INFO:tasks.workunit.client.0.smithi044.stdout:1/860: dread d3/d7/f3d [0,4194304] 0 2024-04-25T22:03:23.845 INFO:tasks.workunit.client.0.smithi044.stdout:1/861: creat d3/d7/db/d8f/d10b/f10f x:0 0 0 2024-04-25T22:03:23.847 INFO:tasks.workunit.client.0.smithi044.stdout:1/862: truncate d3/d7/d83/df9/d97/fe9 399320 0 2024-04-25T22:03:23.848 INFO:tasks.workunit.client.0.smithi044.stdout:4/887: dwrite dd/d35/d52/da9/dca/d79/d7f/f97 [0,4194304] 0 2024-04-25T22:03:23.849 INFO:tasks.workunit.client.0.smithi044.stdout:1/863: link d3/d7/d83/de3/fef d3/d7/db/d5d/f110 0 2024-04-25T22:03:23.850 INFO:tasks.workunit.client.0.smithi044.stdout:4/888: creat dd/d19/d91/dd9/f124 x:0 0 0 2024-04-25T22:03:23.850 INFO:tasks.workunit.client.0.smithi044.stdout:1/864: write d3/d54/f65 [3234574,40651] 0 2024-04-25T22:03:23.850 INFO:tasks.workunit.client.0.smithi044.stdout:1/865: stat d3/d7/d83/df9/dc2 0 2024-04-25T22:03:23.850 INFO:tasks.workunit.client.0.smithi044.stdout:4/889: stat dd/d35/d52/da9/dca/d79/d9c/l117 0 2024-04-25T22:03:23.851 INFO:tasks.workunit.client.0.smithi044.stdout:1/866: write d3/d30/d3f/f9c [1456451,36158] 0 2024-04-25T22:03:23.854 INFO:tasks.workunit.client.0.smithi044.stdout:7/828: getdents d1c/d22/d28/d30/df8 0 2024-04-25T22:03:23.854 INFO:tasks.workunit.client.0.smithi044.stdout:7/829: write d1c/d22/d28/f3d [2606905,15234] 0 2024-04-25T22:03:23.855 INFO:tasks.workunit.client.0.smithi044.stdout:4/890: dread dd/d35/d52/f5b [0,4194304] 0 2024-04-25T22:03:23.855 INFO:tasks.workunit.client.0.smithi044.stdout:1/867: write d3/d7/f40 [3279326,45980] 0 2024-04-25T22:03:23.856 INFO:tasks.workunit.client.0.smithi044.stdout:1/868: rmdir d3/d7/d83/df9/d97 39 2024-04-25T22:03:23.857 INFO:tasks.workunit.client.0.smithi044.stdout:7/830: truncate d1c/d22/f75 270182 0 2024-04-25T22:03:23.858 INFO:tasks.workunit.client.0.smithi044.stdout:2/923: dread d7/d7b/d81/d105/f128 [0,4194304] 0 2024-04-25T22:03:23.858 INFO:tasks.workunit.client.0.smithi044.stdout:1/869: chown d3/d7/d83/df9/d97/d99 3909 1 2024-04-25T22:03:23.859 INFO:tasks.workunit.client.0.smithi044.stdout:2/924: write d7/d7b/d81/d4e/d86/d6b/d78/f5a [2129641,86939] 0 2024-04-25T22:03:23.860 INFO:tasks.workunit.client.0.smithi044.stdout:1/870: read d3/d4b/db6/fba [322635,65603] 0 2024-04-25T22:03:23.861 INFO:tasks.workunit.client.0.smithi044.stdout:2/925: mkdir d7/d7b/d81/d138 0 2024-04-25T22:03:23.861 INFO:tasks.workunit.client.0.smithi044.stdout:7/831: dread d1c/d22/d28/d4e/d7b/fa3 [0,4194304] 0 2024-04-25T22:03:23.861 INFO:tasks.workunit.client.0.smithi044.stdout:1/871: creat d3/d7/db/d5d/db0/f111 x:0 0 0 2024-04-25T22:03:23.862 INFO:tasks.workunit.client.0.smithi044.stdout:7/832: rmdir d1c/d22/d4a/db1 0 2024-04-25T22:03:23.862 INFO:tasks.workunit.client.0.smithi044.stdout:1/872: mkdir d3/d7/db/d10d/d112 0 2024-04-25T22:03:23.863 INFO:tasks.workunit.client.0.smithi044.stdout:4/891: dwrite dd/d35/d52/fc7 [0,4194304] 0 2024-04-25T22:03:23.863 INFO:tasks.workunit.client.0.smithi044.stdout:1/873: creat d3/f113 x:0 0 0 2024-04-25T22:03:23.863 INFO:tasks.workunit.client.0.smithi044.stdout:7/833: fdatasync d1c/d22/d28/d30/f36 0 2024-04-25T22:03:23.864 INFO:tasks.workunit.client.0.smithi044.stdout:4/892: chown dd/d35/d52/da9/dca/d79/lf5 49 1 2024-04-25T22:03:23.864 INFO:tasks.workunit.client.0.smithi044.stdout:1/874: chown d3/d7/db/c27 1689362 1 2024-04-25T22:03:23.864 INFO:tasks.workunit.client.0.smithi044.stdout:7/834: fdatasync d1c/d22/d28/d57/d7c/dde/fe9 0 2024-04-25T22:03:23.865 INFO:tasks.workunit.client.0.smithi044.stdout:1/875: rename d3/d4b/db6/fba to d3/d30/dbb/d105/f114 0 2024-04-25T22:03:23.865 INFO:tasks.workunit.client.0.smithi044.stdout:4/893: mknod dd/d35/d52/da9/dca/d79/d7f/dd1/de4/c125 0 2024-04-25T22:03:23.865 INFO:tasks.workunit.client.0.smithi044.stdout:7/835: chown d1c/d22/d28/d30/d32/f55 18706573 1 2024-04-25T22:03:23.866 INFO:tasks.workunit.client.0.smithi044.stdout:1/876: unlink d3/d7/l28 0 2024-04-25T22:03:23.866 INFO:tasks.workunit.client.0.smithi044.stdout:7/836: stat d1c/d22/d28/f41 0 2024-04-25T22:03:23.868 INFO:tasks.workunit.client.0.smithi044.stdout:7/837: read - d1c/d22/d4a/dcc/fd9 zero size 2024-04-25T22:03:23.869 INFO:tasks.workunit.client.0.smithi044.stdout:2/926: dwrite d7/d7b/d81/d4e/d86/fe7 [0,4194304] 0 2024-04-25T22:03:23.869 INFO:tasks.workunit.client.0.smithi044.stdout:4/894: rename dd/d35/d52/da9/dca/d79/d7f/de6/lfb to dd/d35/d52/da9/dca/d79/d9c/l126 0 2024-04-25T22:03:23.871 INFO:tasks.workunit.client.0.smithi044.stdout:2/927: creat d7/d7b/d81/d4e/d86/d6b/dd8/ded/f139 x:0 0 0 2024-04-25T22:03:23.871 INFO:tasks.workunit.client.0.smithi044.stdout:2/928: dread - d7/d8/d48/f116 zero size 2024-04-25T22:03:23.872 INFO:tasks.workunit.client.0.smithi044.stdout:2/929: write d7/d8/de2/f133 [137541,117000] 0 2024-04-25T22:03:23.874 INFO:tasks.workunit.client.0.smithi044.stdout:7/838: dwrite d1c/fd3 [0,4194304] 0 2024-04-25T22:03:23.875 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:23.872+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:23.876 INFO:tasks.workunit.client.0.smithi044.stdout:7/839: getdents d1c/d22/d28/d30/d32/d5d/d83 0 2024-04-25T22:03:23.881 INFO:tasks.workunit.client.0.smithi044.stdout:2/930: truncate d7/d7b/d81/d4e/d86/fe7 1605276 0 2024-04-25T22:03:23.882 INFO:tasks.workunit.client.0.smithi044.stdout:2/931: creat d7/d7b/d81/d4e/deb/f13a x:0 0 0 2024-04-25T22:03:23.883 INFO:tasks.workunit.client.0.smithi044.stdout:2/932: unlink d7/d7b/d81/d4e/d86/d6b/d78/d44/f8d 0 2024-04-25T22:03:23.884 INFO:tasks.workunit.client.0.smithi044.stdout:7/840: dwrite d1c/d22/d28/d30/f7d [0,4194304] 0 2024-04-25T22:03:23.885 INFO:tasks.workunit.client.0.smithi044.stdout:2/933: rename d7/d8/d48/dd9/f17 to d7/d8/d48/f13b 0 2024-04-25T22:03:23.886 INFO:tasks.workunit.client.0.smithi044.stdout:2/934: rename d7/d8/d48/db2/ldb to d7/d8/d48/db2/l13c 0 2024-04-25T22:03:23.886 INFO:tasks.workunit.client.0.smithi044.stdout:2/935: fsync d7/d8/de2/f133 0 2024-04-25T22:03:23.888 INFO:tasks.workunit.client.0.smithi044.stdout:2/936: symlink d7/d7b/d81/d4e/d86/d6b/l13d 0 2024-04-25T22:03:23.889 INFO:tasks.workunit.client.0.smithi044.stdout:2/937: symlink d7/d8/d1c/d77/l13e 0 2024-04-25T22:03:23.890 INFO:tasks.workunit.client.0.smithi044.stdout:7/841: dwrite d1c/d22/d28/d30/d32/d5d/f7e [0,4194304] 0 2024-04-25T22:03:23.890 INFO:tasks.workunit.client.0.smithi044.stdout:2/938: truncate d7/d8/d48/df4/f123 262038 0 2024-04-25T22:03:23.892 INFO:tasks.workunit.client.0.smithi044.stdout:7/842: creat d1c/d22/d28/d30/d32/d97/ffd x:0 0 0 2024-04-25T22:03:23.894 INFO:tasks.workunit.client.0.smithi044.stdout:7/843: rmdir d1c/d22/d28/d4e/d6a 39 2024-04-25T22:03:23.895 INFO:tasks.workunit.client.0.smithi044.stdout:7/844: getdents d1c/d22/d28/d4e/d7b/d59 0 2024-04-25T22:03:23.895 INFO:tasks.workunit.client.0.smithi044.stdout:7/845: readlink d1c/d88/d8f/la8 0 2024-04-25T22:03:23.896 INFO:tasks.workunit.client.0.smithi044.stdout:7/846: creat d1c/ffe x:0 0 0 2024-04-25T22:03:23.897 INFO:tasks.workunit.client.0.smithi044.stdout:7/847: creat d1c/d88/d8f/d9c/fff x:0 0 0 2024-04-25T22:03:23.898 INFO:tasks.workunit.client.0.smithi044.stdout:2/939: read d7/d8/d48/dd9/d4b/f72 [3528576,110099] 0 2024-04-25T22:03:23.899 INFO:tasks.workunit.client.0.smithi044.stdout:7/848: rename d1c/d22/d28/d4e/d6a/d9e/dfa/f9d to d1c/d22/d28/d57/f100 0 2024-04-25T22:03:23.899 INFO:tasks.workunit.client.0.smithi044.stdout:1/877: dread d3/d7/f40 [4194304,4194304] 0 2024-04-25T22:03:23.900 INFO:tasks.workunit.client.0.smithi044.stdout:2/940: mkdir d7/d7b/d81/d4e/d86/d13f 0 2024-04-25T22:03:23.900 INFO:tasks.workunit.client.0.smithi044.stdout:4/895: dread dd/d19/d91/fd3 [0,4194304] 0 2024-04-25T22:03:23.900 INFO:tasks.workunit.client.0.smithi044.stdout:7/849: creat d1c/d22/d4a/dcc/f101 x:0 0 0 2024-04-25T22:03:23.901 INFO:tasks.workunit.client.0.smithi044.stdout:4/896: creat dd/d19/d91/d10e/f127 x:0 0 0 2024-04-25T22:03:23.901 INFO:tasks.workunit.client.0.smithi044.stdout:4/897: chown dd/d35/d52/da9/dca/db6/d11e 23108074 1 2024-04-25T22:03:23.907 INFO:tasks.workunit.client.0.smithi044.stdout:1/878: dwrite d3/d7/db/f1d [0,4194304] 0 2024-04-25T22:03:23.908 INFO:tasks.workunit.client.0.smithi044.stdout:7/850: dwrite f9 [0,4194304] 0 2024-04-25T22:03:23.909 INFO:tasks.workunit.client.0.smithi044.stdout:2/941: dwrite d7/d7b/d81/d4e/d86/d6b/d78/d44/fdd [0,4194304] 0 2024-04-25T22:03:23.909 INFO:tasks.workunit.client.0.smithi044.stdout:1/879: chown d3/d30/leb 3406 1 2024-04-25T22:03:23.911 INFO:tasks.workunit.client.0.smithi044.stdout:1/880: symlink d3/d7/db/d8f/d10b/d43/dd6/l115 0 2024-04-25T22:03:23.911 INFO:tasks.workunit.client.0.smithi044.stdout:2/942: write d7/d7b/d81/d4e/d86/d6b/d78/d44/dad/def/f11d [517730,115672] 0 2024-04-25T22:03:23.912 INFO:tasks.workunit.client.0.smithi044.stdout:1/881: stat d3/d7/d83/fbd 0 2024-04-25T22:03:23.912 INFO:tasks.workunit.client.0.smithi044.stdout:1/882: readlink d3/d72/l79 0 2024-04-25T22:03:23.914 INFO:tasks.workunit.client.0.smithi044.stdout:2/943: getdents d7/d8/d48/dd9/d2c 0 2024-04-25T22:03:23.914 INFO:tasks.workunit.client.0.smithi044.stdout:1/883: write d3/f34 [3490160,23176] 0 2024-04-25T22:03:23.924 INFO:tasks.workunit.client.0.smithi044.stdout:2/944: dread d7/d8/d1c/f33 [0,4194304] 0 2024-04-25T22:03:23.924 INFO:tasks.workunit.client.0.smithi044.stdout:1/884: dread d3/d7/fbc [0,4194304] 0 2024-04-25T22:03:23.924 INFO:tasks.workunit.client.0.smithi044.stdout:1/885: fsync d3/d30/f31 0 2024-04-25T22:03:23.930 INFO:tasks.workunit.client.0.smithi044.stdout:1/886: dwrite d3/d30/d3f/f9c [0,4194304] 0 2024-04-25T22:03:23.931 INFO:tasks.workunit.client.0.smithi044.stdout:1/887: mkdir d3/d7/db/dda/d116 0 2024-04-25T22:03:23.932 INFO:tasks.workunit.client.0.smithi044.stdout:1/888: creat d3/d54/f117 x:0 0 0 2024-04-25T22:03:23.933 INFO:tasks.workunit.client.0.smithi044.stdout:0/986: sync 2024-04-25T22:03:23.933 INFO:tasks.workunit.client.0.smithi044.stdout:7/851: sync 2024-04-25T22:03:23.934 INFO:tasks.workunit.client.0.smithi044.stdout:0/987: creat d8/df/d17/d87/d116/f152 x:0 0 0 2024-04-25T22:03:23.934 INFO:tasks.workunit.client.0.smithi044.stdout:1/889: dread d3/d59/d5c/f62 [0,4194304] 0 2024-04-25T22:03:23.934 INFO:tasks.workunit.client.0.smithi044.stdout:7/852: read d1c/d22/d28/d4e/d7b/f3e [4294,84247] 0 2024-04-25T22:03:23.935 INFO:tasks.workunit.client.0.smithi044.stdout:0/988: mkdir d8/df/d17/db9/d7c/d153 0 2024-04-25T22:03:23.938 INFO:tasks.workunit.client.0.smithi044.stdout:7/853: mkdir d1c/d22/d28/d66/d86/d102 0 2024-04-25T22:03:23.938 INFO:tasks.workunit.client.0.smithi044.stdout:0/989: unlink d8/df/d17/l74 0 2024-04-25T22:03:23.938 INFO:tasks.workunit.client.0.smithi044.stdout:0/990: mkdir d8/df/d17/d87/d154 0 2024-04-25T22:03:23.938 INFO:tasks.workunit.client.0.smithi044.stdout:0/991: chown d8/df/f54 2056087687 1 2024-04-25T22:03:23.942 INFO:tasks.workunit.client.0.smithi044.stdout:1/890: dwrite d3/d7/db/d8f/d10b/f39 [0,4194304] 0 2024-04-25T22:03:23.942 INFO:tasks.workunit.client.0.smithi044.stdout:4/898: dread dd/d35/d52/f60 [4194304,4194304] 0 2024-04-25T22:03:23.942 INFO:tasks.workunit.client.0.smithi044.stdout:7/854: dwrite d1c/d88/fef [0,4194304] 0 2024-04-25T22:03:23.943 INFO:tasks.workunit.client.0.smithi044.stdout:1/891: readlink d3/d30/l45 0 2024-04-25T22:03:23.944 INFO:tasks.workunit.client.0.smithi044.stdout:4/899: write dd/d35/d52/da9/dca/db6/df0/f121 [191543,90841] 0 2024-04-25T22:03:23.944 INFO:tasks.workunit.client.0.smithi044.stdout:0/992: dwrite d8/df/d17/d45/f4a [0,4194304] 0 2024-04-25T22:03:23.945 INFO:tasks.workunit.client.0.smithi044.stdout:1/892: mknod d3/d7/d81/c118 0 2024-04-25T22:03:23.945 INFO:tasks.workunit.client.0.smithi044.stdout:7/855: creat d1c/d22/d28/d30/f103 x:0 0 0 2024-04-25T22:03:23.946 INFO:tasks.workunit.client.0.smithi044.stdout:0/993: write d8/da/d60/daa/f151 [264126,118216] 0 2024-04-25T22:03:23.947 INFO:tasks.workunit.client.0.smithi044.stdout:1/893: creat d3/d7/db/d5d/db0/f119 x:0 0 0 2024-04-25T22:03:23.947 INFO:tasks.workunit.client.0.smithi044.stdout:4/900: write dd/d35/d52/da9/dca/d79/d9c/fa5 [1340800,28944] 0 2024-04-25T22:03:23.948 INFO:tasks.workunit.client.0.smithi044.stdout:7/856: fdatasync d1c/d22/d28/d30/d32/f55 0 2024-04-25T22:03:23.948 INFO:tasks.workunit.client.0.smithi044.stdout:0/994: creat d8/d78/db8/dfa/f155 x:0 0 0 2024-04-25T22:03:23.948 INFO:tasks.workunit.client.0.smithi044.stdout:4/901: creat dd/d19/d91/f128 x:0 0 0 2024-04-25T22:03:23.948 INFO:tasks.workunit.client.0.smithi044.stdout:7/857: creat d1c/d22/f104 x:0 0 0 2024-04-25T22:03:23.949 INFO:tasks.workunit.client.0.smithi044.stdout:4/902: mkdir dd/d35/d52/da9/d100/d129 0 2024-04-25T22:03:23.950 INFO:tasks.workunit.client.0.smithi044.stdout:4/903: read - dd/d35/d52/da9/dca/d79/d7f/dd1/fe0 zero size 2024-04-25T22:03:23.951 INFO:tasks.workunit.client.0.smithi044.stdout:4/904: mknod dd/d35/d52/d61/c12a 0 2024-04-25T22:03:23.952 INFO:tasks.workunit.client.0.smithi044.stdout:7/858: dread d1c/fd3 [0,4194304] 0 2024-04-25T22:03:23.954 INFO:tasks.workunit.client.0.smithi044.stdout:7/859: read d1c/d22/d28/d30/d32/d5d/f7e [2950995,46349] 0 2024-04-25T22:03:23.956 INFO:tasks.workunit.client.0.smithi044.stdout:7/860: rename d1c/d22/d28/d30/d32/d97/fbc to d1c/d22/d28/d66/d86/d102/f105 0 2024-04-25T22:03:23.956 INFO:tasks.workunit.client.0.smithi044.stdout:0/995: dwrite d8/df/d17/d45/d95/d51/f8a [0,4194304] 0 2024-04-25T22:03:23.957 INFO:tasks.workunit.client.0.smithi044.stdout:0/996: chown d8/df/d17/d45/d95/d133 40158 1 2024-04-25T22:03:23.957 INFO:tasks.workunit.client.0.smithi044.stdout:0/997: creat d8/d78/db8/dfa/f156 x:0 0 0 2024-04-25T22:03:23.966 INFO:tasks.workunit.client.0.smithi044.stdout:2/945: write d7/d7b/d81/d105/f128 [3677674,50548] 0 2024-04-25T22:03:23.966 INFO:tasks.workunit.client.0.smithi044.stdout:7/861: dread d1c/d22/d28/f41 [0,4194304] 0 2024-04-25T22:03:23.966 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:23.966 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:03:23.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:03:23.966 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:23.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.967 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T22:03:23.967 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:23.967 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.979842635000001, 2024-04-25T22:03:23.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.180276931, 2024-04-25T22:03:23.967 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.967 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.967 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.967 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:23.967 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:23.967 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.967 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4 2024-04-25T22:03:23.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.967 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983834+0000", 2024-04-25T22:03:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2900000000000001e-06 2024-04-25T22:03:23.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991787+0000", 2024-04-25T22:03:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079521690000000003 2024-04-25T22:03:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991826+0000", 2024-04-25T22:03:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9258999999999998e-05 2024-04-25T22:03:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991845+0000", 2024-04-25T22:03:23.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9360000000000001e-05 2024-04-25T22:03:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992058+0000", 2024-04-25T22:03:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212559 2024-04-25T22:03:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992213+0000", 2024-04-25T22:03:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015520700000000001 2024-04-25T22:03:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992414+0000", 2024-04-25T22:03:23.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020049 2024-04-25T22:03:23.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:23.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162511+0000", 2024-04-25T22:03:23.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.17009782900000001 2024-04-25T22:03:23.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:23.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163967+0000", 2024-04-25T22:03:23.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001455752 2024-04-25T22:03:23.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:23.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164045+0000", 2024-04-25T22:03:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7415000000000003e-05 2024-04-25T22:03:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164109+0000", 2024-04-25T22:03:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4601e-05 2024-04-25T22:03:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:23.972 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.880384487000001, 2024-04-25T22:03:23.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.12612672599999999, 2024-04-25T22:03:23.973 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.973 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.973 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.973 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:23.973 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:23.973 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.973 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2024-04-25T22:03:23.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.973 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:23.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083290+0000", 2024-04-25T22:03:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.083293+0000", 2024-04-25T22:03:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6630000000000002e-06 2024-04-25T22:03:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086619+0000", 2024-04-25T22:03:23.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033261699999999998 2024-04-25T22:03:23.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086647+0000", 2024-04-25T22:03:23.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8085999999999998e-05 2024-04-25T22:03:23.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086665+0000", 2024-04-25T22:03:23.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:03:23.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.086870+0000", 2024-04-25T22:03:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020488599999999999 2024-04-25T22:03:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087110+0000", 2024-04-25T22:03:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024093199999999999 2024-04-25T22:03:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.087310+0000", 2024-04-25T22:03:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000199936 2024-04-25T22:03:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.207766+0000", 2024-04-25T22:03:23.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.120456035 2024-04-25T22:03:23.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:23.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209358+0000", 2024-04-25T22:03:23.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015912369999999999 2024-04-25T22:03:23.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:23.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209390+0000", 2024-04-25T22:03:23.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2434999999999997e-05 2024-04-25T22:03:23.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:23.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.209417+0000", 2024-04-25T22:03:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6936000000000001e-05 2024-04-25T22:03:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6847 4.16 4:68767fd1:::10000001f4f.00000000:head [write 0~7212] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.270203173999999, 2024-04-25T22:03:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0208302119999999, 2024-04-25T22:03:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:23.978 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6847 2024-04-25T22:03:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693473+0000", 2024-04-25T22:03:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.75e-06 2024-04-25T22:03:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693490+0000", 2024-04-25T22:03:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6540000000000001e-05 2024-04-25T22:03:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693509+0000", 2024-04-25T22:03:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9536999999999999e-05 2024-04-25T22:03:23.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693522+0000", 2024-04-25T22:03:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2099000000000001e-05 2024-04-25T22:03:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693677+0000", 2024-04-25T22:03:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015516799999999999 2024-04-25T22:03:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693705+0000", 2024-04-25T22:03:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8663e-05 2024-04-25T22:03:23.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705551+0000", 2024-04-25T22:03:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.011845495 2024-04-25T22:03:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705942+0000", 2024-04-25T22:03:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00039080099999999997 2024-04-25T22:03:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.706151+0000", 2024-04-25T22:03:23.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000209457 2024-04-25T22:03:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711141+0000", 2024-04-25T22:03:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049901240000000003 2024-04-25T22:03:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714005+0000", 2024-04-25T22:03:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028642229999999999 2024-04-25T22:03:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714180+0000", 2024-04-25T22:03:23.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017433699999999999 2024-04-25T22:03:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714302+0000", 2024-04-25T22:03:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122018 2024-04-25T22:03:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6960 4.16 4:6823d322:::10000001fd2.00000000:head [write 0~150] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.993199076, 2024-04-25T22:03:23.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.74417278899999995, 2024-04-25T22:03:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6960 2024-04-25T22:03:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970478+0000", 2024-04-25T22:03:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.939e-06 2024-04-25T22:03:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970488+0000", 2024-04-25T22:03:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9699999999999994e-06 2024-04-25T22:03:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970524+0000", 2024-04-25T22:03:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5963000000000001e-05 2024-04-25T22:03:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970537+0000", 2024-04-25T22:03:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.31e-05 2024-04-25T22:03:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970701+0000", 2024-04-25T22:03:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164177 2024-04-25T22:03:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970718+0000", 2024-04-25T22:03:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7323e-05 2024-04-25T22:03:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707632+0000", 2024-04-25T22:03:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.73691394300000002 2024-04-25T22:03:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707924+0000", 2024-04-25T22:03:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029223299999999998 2024-04-25T22:03:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:23.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.708389+0000", 2024-04-25T22:03:23.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046429300000000001 2024-04-25T22:03:23.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:23.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:23.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029039830000000002 2024-04-25T22:03:23.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:23.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714409+0000", 2024-04-25T22:03:23.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031159260000000002 2024-04-25T22:03:23.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714538+0000", 2024-04-25T22:03:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012952100000000001 2024-04-25T22:03:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714649+0000", 2024-04-25T22:03:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110418 2024-04-25T22:03:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.990 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7039 4.16 4:6919637e:::10000002032.00000000:head [write 0~2968] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:23.991 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:23.991 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.807152571, 2024-04-25T22:03:23.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.56024932199999999, 2024-04-25T22:03:23.991 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.991 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.991 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.991 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:23.991 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:23.991 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.991 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7039 2024-04-25T22:03:23.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.991 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156523+0000", 2024-04-25T22:03:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2130000000000001e-06 2024-04-25T22:03:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156530+0000", 2024-04-25T22:03:23.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9090000000000003e-06 2024-04-25T22:03:23.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156544+0000", 2024-04-25T22:03:23.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3271999999999999e-05 2024-04-25T22:03:23.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:23.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156551+0000", 2024-04-25T22:03:23.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4970000000000004e-06 2024-04-25T22:03:23.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156639+0000", 2024-04-25T22:03:23.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7638000000000004e-05 2024-04-25T22:03:23.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:23.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156649+0000", 2024-04-25T22:03:23.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0536e-05 2024-04-25T22:03:23.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:23.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709515+0000", 2024-04-25T22:03:23.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.55286568999999997 2024-04-25T22:03:23.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709836+0000", 2024-04-25T22:03:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032078899999999998 2024-04-25T22:03:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.710271+0000", 2024-04-25T22:03:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043530000000000001 2024-04-25T22:03:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716576+0000", 2024-04-25T22:03:23.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063045050000000002 2024-04-25T22:03:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716605+0000", 2024-04-25T22:03:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8949e-05 2024-04-25T22:03:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716706+0000", 2024-04-25T22:03:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101765 2024-04-25T22:03:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716772+0000", 2024-04-25T22:03:23.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5259000000000007e-05 2024-04-25T22:03:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7065 4.16 4:697a9f10:::10000002050.00000000:head [write 0~16297] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.749536623000001, 2024-04-25T22:03:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.50307290800000004, 2024-04-25T22:03:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:23.997 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7065 2024-04-25T22:03:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:23.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214139+0000", 2024-04-25T22:03:23.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.186e-06 2024-04-25T22:03:23.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:23.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214170+0000", 2024-04-25T22:03:23.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0419000000000001e-05 2024-04-25T22:03:23.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:23.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:23.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:23.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214186+0000", 2024-04-25T22:03:23.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6526000000000001e-05 2024-04-25T22:03:23.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214194+0000", 2024-04-25T22:03:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6769999999999995e-06 2024-04-25T22:03:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214380+0000", 2024-04-25T22:03:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018580699999999999 2024-04-25T22:03:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214399+0000", 2024-04-25T22:03:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9446e-05 2024-04-25T22:03:24.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711402+0000", 2024-04-25T22:03:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.497002901 2024-04-25T22:03:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711822+0000", 2024-04-25T22:03:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00041989399999999997 2024-04-25T22:03:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.712017+0000", 2024-04-25T22:03:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019540700000000001 2024-04-25T22:03:24.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:24.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716792+0000", 2024-04-25T22:03:24.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047748210000000003 2024-04-25T22:03:24.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716937+0000", 2024-04-25T22:03:24.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014479099999999999 2024-04-25T22:03:24.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:24.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717081+0000", 2024-04-25T22:03:24.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014412100000000001 2024-04-25T22:03:24.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:24.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717211+0000", 2024-04-25T22:03:24.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012991200000000001 2024-04-25T22:03:24.003 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.003 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:24.003 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.003 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7089 4.16 4:6868fcac:::1000000206b.00000000:head [write 0~5386] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:24.003 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:24.003 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.689982628999999, 2024-04-25T22:03:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44658810700000001, 2024-04-25T22:03:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7089 2024-04-25T22:03:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:24.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:24.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:24.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:24.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273695+0000", 2024-04-25T22:03:24.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.463e-06 2024-04-25T22:03:24.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:24.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273712+0000", 2024-04-25T22:03:24.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7842999999999998e-05 2024-04-25T22:03:24.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:24.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273742+0000", 2024-04-25T22:03:24.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9039000000000001e-05 2024-04-25T22:03:24.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273756+0000", 2024-04-25T22:03:24.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4406999999999999e-05 2024-04-25T22:03:24.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273943+0000", 2024-04-25T22:03:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018708 2024-04-25T22:03:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273961+0000", 2024-04-25T22:03:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7977000000000001e-05 2024-04-25T22:03:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714748+0000", 2024-04-25T22:03:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.440786605 2024-04-25T22:03:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:24.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715013+0000", 2024-04-25T22:03:24.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026558300000000001 2024-04-25T22:03:24.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:24.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715309+0000", 2024-04-25T22:03:24.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000295715 2024-04-25T22:03:24.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.719035+0000", 2024-04-25T22:03:24.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037256310000000001 2024-04-25T22:03:24.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:24.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720142+0000", 2024-04-25T22:03:24.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001107053 2024-04-25T22:03:24.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:24.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720221+0000", 2024-04-25T22:03:24.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9832000000000004e-05 2024-04-25T22:03:24.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:24.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720280+0000", 2024-04-25T22:03:24.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8879000000000003e-05 2024-04-25T22:03:24.010 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.010 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:24.010 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.010 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7090 4.16 4:69dc3034:::1000000206c.00000000:head [write 0~957] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:24.010 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:24.010 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.687358299, 2024-04-25T22:03:24.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44572077100000002, 2024-04-25T22:03:24.010 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:24.010 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:24.010 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.010 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:24.010 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7090 2024-04-25T22:03:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276319+0000", 2024-04-25T22:03:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3429999999999998e-06 2024-04-25T22:03:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276330+0000", 2024-04-25T22:03:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1567e-05 2024-04-25T22:03:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276362+0000", 2024-04-25T22:03:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1863000000000003e-05 2024-04-25T22:03:24.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276377+0000", 2024-04-25T22:03:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5102999999999999e-05 2024-04-25T22:03:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276564+0000", 2024-04-25T22:03:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018629700000000001 2024-04-25T22:03:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276583+0000", 2024-04-25T22:03:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9743000000000001e-05 2024-04-25T22:03:24.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:24.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717354+0000", 2024-04-25T22:03:24.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44077094900000002 2024-04-25T22:03:24.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:24.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717723+0000", 2024-04-25T22:03:24.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036839099999999998 2024-04-25T22:03:24.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:24.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.718097+0000", 2024-04-25T22:03:24.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037392099999999999 2024-04-25T22:03:24.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:24.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720305+0000", 2024-04-25T22:03:24.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022084439999999999 2024-04-25T22:03:24.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721866+0000", 2024-04-25T22:03:24.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015610260000000001 2024-04-25T22:03:24.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:24.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721944+0000", 2024-04-25T22:03:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7961999999999997e-05 2024-04-25T22:03:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.722037+0000", 2024-04-25T22:03:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3162e-05 2024-04-25T22:03:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:265 3.1d 3:bf8dcf43:::200.00000008:head [write 3732680~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682617+0000", 2024-04-25T22:03:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.28105804, 2024-04-25T22:03:24.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.097415482999999997, 2024-04-25T22:03:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682617+0000", 2024-04-25T22:03:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682617+0000", 2024-04-25T22:03:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682618+0000", 2024-04-25T22:03:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:03:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682625+0000", 2024-04-25T22:03:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4059999999999999e-06 2024-04-25T22:03:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682643+0000", 2024-04-25T22:03:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7476e-05 2024-04-25T22:03:24.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682656+0000", 2024-04-25T22:03:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.311e-05 2024-04-25T22:03:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.774784+0000", 2024-04-25T22:03:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.092128053000000001 2024-04-25T22:03:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.774912+0000", 2024-04-25T22:03:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012798099999999999 2024-04-25T22:03:24.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.775095+0000", 2024-04-25T22:03:24.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000182607 2024-04-25T22:03:24.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:24.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779418+0000", 2024-04-25T22:03:24.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043234390000000001 2024-04-25T22:03:24.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779841+0000", 2024-04-25T22:03:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042321999999999998 2024-04-25T22:03:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.779937+0000", 2024-04-25T22:03:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5402000000000006e-05 2024-04-25T22:03:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.780032+0000", 2024-04-25T22:03:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5564999999999997e-05 2024-04-25T22:03:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.022 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:266 3.1d 3:bf8dcf43:::200.00000008:head [write 3734079~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:03:24.022 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:09.682671+0000", 2024-04-25T22:03:24.022 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.281003396999999, 2024-04-25T22:03:24.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.100589284, 2024-04-25T22:03:24.022 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:24.022 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:24.022 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.022 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:24.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:24.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682671+0000", 2024-04-25T22:03:24.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682671+0000", 2024-04-25T22:03:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682672+0000", 2024-04-25T22:03:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0529999999999999e-06 2024-04-25T22:03:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682687+0000", 2024-04-25T22:03:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.418e-05 2024-04-25T22:03:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682704+0000", 2024-04-25T22:03:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7139e-05 2024-04-25T22:03:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.682719+0000", 2024-04-25T22:03:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4776999999999999e-05 2024-04-25T22:03:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.776110+0000", 2024-04-25T22:03:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093391199999999994 2024-04-25T22:03:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:24.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.776237+0000", 2024-04-25T22:03:24.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012748800000000001 2024-04-25T22:03:24.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.776502+0000", 2024-04-25T22:03:24.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026474300000000001 2024-04-25T22:03:24.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:24.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.780083+0000", 2024-04-25T22:03:24.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035809190000000001 2024-04-25T22:03:24.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.783012+0000", 2024-04-25T22:03:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029288790000000001 2024-04-25T22:03:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.783173+0000", 2024-04-25T22:03:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016134799999999999 2024-04-25T22:03:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:09.783261+0000", 2024-04-25T22:03:24.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7558000000000004e-05 2024-04-25T22:03:24.027 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.027 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:24.027 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.027 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:10642 4.35 4:ae7b229b:::100000030a9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:24.027 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.493805+0000", 2024-04-25T22:03:24.027 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.469870122, 2024-04-25T22:03:24.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13451306399999999, 2024-04-25T22:03:24.027 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:24.027 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:24.027 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.027 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:24.027 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10642 2024-04-25T22:03:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.493805+0000", 2024-04-25T22:03:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.493805+0000", 2024-04-25T22:03:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:24.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.493807+0000", 2024-04-25T22:03:24.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2129999999999998e-06 2024-04-25T22:03:24.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:24.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502392+0000", 2024-04-25T22:03:24.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085850079999999999 2024-04-25T22:03:24.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:24.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502428+0000", 2024-04-25T22:03:24.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5952999999999999e-05 2024-04-25T22:03:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502447+0000", 2024-04-25T22:03:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9565999999999999e-05 2024-04-25T22:03:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502595+0000", 2024-04-25T22:03:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014737499999999999 2024-04-25T22:03:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.502851+0000", 2024-04-25T22:03:24.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025651299999999999 2024-04-25T22:03:24.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:24.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.503238+0000", 2024-04-25T22:03:24.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038642800000000002 2024-04-25T22:03:24.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.627850+0000", 2024-04-25T22:03:24.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.12461184 2024-04-25T22:03:24.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:24.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628046+0000", 2024-04-25T22:03:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019659500000000001 2024-04-25T22:03:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628184+0000", 2024-04-25T22:03:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000137532 2024-04-25T22:03:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628318+0000", 2024-04-25T22:03:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000134041 2024-04-25T22:03:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.033 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:10647 4.35 4:ae7b229b:::100000030a9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:24.033 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:24.033 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.434313605, 2024-04-25T22:03:24.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14506126, 2024-04-25T22:03:24.033 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:24.033 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:24.033 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.033 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:24.033 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:24.033 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.033 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10647 2024-04-25T22:03:24.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.033 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529364+0000", 2024-04-25T22:03:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.286e-06 2024-04-25T22:03:24.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:24.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538917+0000", 2024-04-25T22:03:24.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0095530010000000002 2024-04-25T22:03:24.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:24.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538955+0000", 2024-04-25T22:03:24.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:03:24.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538977+0000", 2024-04-25T22:03:24.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.105e-05 2024-04-25T22:03:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568092+0000", 2024-04-25T22:03:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029115604999999999 2024-04-25T22:03:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568243+0000", 2024-04-25T22:03:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000151044 2024-04-25T22:03:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568498+0000", 2024-04-25T22:03:24.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025517399999999999 2024-04-25T22:03:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628005+0000", 2024-04-25T22:03:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059506991000000002 2024-04-25T22:03:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674273+0000", 2024-04-25T22:03:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.046267233999999997 2024-04-25T22:03:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674357+0000", 2024-04-25T22:03:24.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4745000000000003e-05 2024-04-25T22:03:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674422+0000", 2024-04-25T22:03:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5160999999999995e-05 2024-04-25T22:03:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4564.0:10651 4.b e64/16 4:d2207142:::100000030bf.00000000:head v 64'182, mlcod=64'180)", 2024-04-25T22:03:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.604132+0000", 2024-04-25T22:03:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.359543271, 2024-04-25T22:03:24.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.105085936, 2024-04-25T22:03:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.604132+0000", 2024-04-25T22:03:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.604132+0000", 2024-04-25T22:03:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.604133+0000", 2024-04-25T22:03:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:03:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.608939+0000", 2024-04-25T22:03:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004806009 2024-04-25T22:03:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.608965+0000", 2024-04-25T22:03:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.639e-05 2024-04-25T22:03:24.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.608978+0000", 2024-04-25T22:03:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2666999999999999e-05 2024-04-25T22:03:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.609113+0000", 2024-04-25T22:03:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000135575 2024-04-25T22:03:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.609198+0000", 2024-04-25T22:03:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4899000000000001e-05 2024-04-25T22:03:24.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:24.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.709157+0000", 2024-04-25T22:03:24.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.099958796000000003 2024-04-25T22:03:24.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:24.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.709217+0000", 2024-04-25T22:03:24.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0553000000000001e-05 2024-04-25T22:03:24.042 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.042 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:24.042 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:11395 4.35 4:addad63f:::100000030d7.00000000:head [write 0~4194304 [3@3390803]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:18.494568+0000", 2024-04-25T22:03:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.4691065800000001, 2024-04-25T22:03:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.112104131, 2024-04-25T22:03:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 11395 2024-04-25T22:03:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:24.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:24.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.494568+0000", 2024-04-25T22:03:24.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:24.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.494568+0000", 2024-04-25T22:03:24.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:24.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.494569+0000", 2024-04-25T22:03:24.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9299999999999998e-07 2024-04-25T22:03:24.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.501621+0000", 2024-04-25T22:03:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070524979999999999 2024-04-25T22:03:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.501635+0000", 2024-04-25T22:03:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3244999999999999e-05 2024-04-25T22:03:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.501642+0000", 2024-04-25T22:03:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4769999999999997e-06 2024-04-25T22:03:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.544365+0000", 2024-04-25T22:03:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.042722549999999998 2024-04-25T22:03:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.544447+0000", 2024-04-25T22:03:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1924999999999999e-05 2024-04-25T22:03:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.544573+0000", 2024-04-25T22:03:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012622999999999999 2024-04-25T22:03:24.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.596552+0000", 2024-04-25T22:03:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.051979663000000002 2024-04-25T22:03:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.606595+0000", 2024-04-25T22:03:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010042979 2024-04-25T22:03:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.606636+0000", 2024-04-25T22:03:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0244999999999998e-05 2024-04-25T22:03:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:24.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:18.606672+0000", 2024-04-25T22:03:24.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6726e-05 2024-04-25T22:03:24.048 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.048 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:24.048 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.048 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:11818 4.27 4:e48405d9:::1000000312b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:24.048 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:19.135317+0000", 2024-04-25T22:03:24.048 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.8283576400000001, 2024-04-25T22:03:24.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.124009722, 2024-04-25T22:03:24.048 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 11818 2024-04-25T22:03:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.135317+0000", 2024-04-25T22:03:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:24.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.135317+0000", 2024-04-25T22:03:24.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:24.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.135319+0000", 2024-04-25T22:03:24.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0540000000000002e-06 2024-04-25T22:03:24.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:24.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.143448+0000", 2024-04-25T22:03:24.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081289229999999997 2024-04-25T22:03:24.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:24.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.143483+0000", 2024-04-25T22:03:24.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5321999999999998e-05 2024-04-25T22:03:24.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.143505+0000", 2024-04-25T22:03:24.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.122e-05 2024-04-25T22:03:24.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:24.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.143665+0000", 2024-04-25T22:03:24.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016055900000000001 2024-04-25T22:03:24.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:24.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.143820+0000", 2024-04-25T22:03:24.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015480499999999999 2024-04-25T22:03:24.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.144036+0000", 2024-04-25T22:03:24.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000215625 2024-04-25T22:03:24.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.229745+0000", 2024-04-25T22:03:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085709236999999994 2024-04-25T22:03:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.259221+0000", 2024-04-25T22:03:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029475883000000001 2024-04-25T22:03:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.259278+0000", 2024-04-25T22:03:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7181e-05 2024-04-25T22:03:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.259327+0000", 2024-04-25T22:03:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8912999999999997e-05 2024-04-25T22:03:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:11836 4.27 4:e75b72a1:::100000032e8.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:19.160506+0000", 2024-04-25T22:03:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.803168876, 2024-04-25T22:03:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.12944214600000001, 2024-04-25T22:03:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:24.054 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.055 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:24.055 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:24.055 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.055 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 11836 2024-04-25T22:03:24.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.055 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:24.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:24.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.160506+0000", 2024-04-25T22:03:24.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:24.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.160506+0000", 2024-04-25T22:03:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.160513+0000", 2024-04-25T22:03:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0339999999999999e-06 2024-04-25T22:03:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.172666+0000", 2024-04-25T22:03:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012152718 2024-04-25T22:03:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.172698+0000", 2024-04-25T22:03:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2673999999999999e-05 2024-04-25T22:03:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.172736+0000", 2024-04-25T22:03:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7595999999999997e-05 2024-04-25T22:03:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.202923+0000", 2024-04-25T22:03:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.030187338000000001 2024-04-25T22:03:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.203072+0000", 2024-04-25T22:03:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014835599999999999 2024-04-25T22:03:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.203178+0000", 2024-04-25T22:03:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106766 2024-04-25T22:03:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.289757+0000", 2024-04-25T22:03:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.08657898 2024-04-25T22:03:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.289838+0000", 2024-04-25T22:03:24.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0272999999999995e-05 2024-04-25T22:03:24.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:24.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.289898+0000", 2024-04-25T22:03:24.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9846999999999998e-05 2024-04-25T22:03:24.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:24.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.289948+0000", 2024-04-25T22:03:24.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0563999999999999e-05 2024-04-25T22:03:24.059 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:11850 4.31 4:8dfc94b7:::10000003310.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:19.182142+0000", 2024-04-25T22:03:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.7815325709999996, 2024-04-25T22:03:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.12624586199999999, 2024-04-25T22:03:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:24.060 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.061 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 11850 2024-04-25T22:03:24.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.061 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:24.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:24.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.182142+0000", 2024-04-25T22:03:24.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:24.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.182142+0000", 2024-04-25T22:03:24.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:24.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.182143+0000", 2024-04-25T22:03:24.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5999999999999991e-07 2024-04-25T22:03:24.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:24.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.190463+0000", 2024-04-25T22:03:24.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083195100000000004 2024-04-25T22:03:24.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:24.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.190484+0000", 2024-04-25T22:03:24.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0917e-05 2024-04-25T22:03:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.190496+0000", 2024-04-25T22:03:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2465e-05 2024-04-25T22:03:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.213820+0000", 2024-04-25T22:03:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023324139000000001 2024-04-25T22:03:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:24.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.213959+0000", 2024-04-25T22:03:24.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013907399999999999 2024-04-25T22:03:24.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.214147+0000", 2024-04-25T22:03:24.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000188042 2024-04-25T22:03:24.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.266388+0000", 2024-04-25T22:03:24.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.052240871000000001 2024-04-25T22:03:24.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.308301+0000", 2024-04-25T22:03:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.041912405 2024-04-25T22:03:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.308347+0000", 2024-04-25T22:03:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.596e-05 2024-04-25T22:03:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.308388+0000", 2024-04-25T22:03:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1519e-05 2024-04-25T22:03:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.065 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:24.066 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.066 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:11869 4.27 4:e7fc5ee9:::10000003269.00000001:head [write 4063232~131072] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:24.066 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:19.218068+0000", 2024-04-25T22:03:24.066 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.7456063930000001, 2024-04-25T22:03:24.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.113649111, 2024-04-25T22:03:24.066 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:24.066 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:24.066 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.066 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:24.066 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:24.066 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.066 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 11869 2024-04-25T22:03:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.218068+0000", 2024-04-25T22:03:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.218068+0000", 2024-04-25T22:03:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.218070+0000", 2024-04-25T22:03:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.703e-06 2024-04-25T22:03:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.218980+0000", 2024-04-25T22:03:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090953699999999998 2024-04-25T22:03:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.218991+0000", 2024-04-25T22:03:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1171e-05 2024-04-25T22:03:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.218999+0000", 2024-04-25T22:03:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6459999999999999e-06 2024-04-25T22:03:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.259386+0000", 2024-04-25T22:03:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.040386857999999998 2024-04-25T22:03:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.259469+0000", 2024-04-25T22:03:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2416000000000005e-05 2024-04-25T22:03:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.259646+0000", 2024-04-25T22:03:24.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017753699999999999 2024-04-25T22:03:24.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:24.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.301627+0000", 2024-04-25T22:03:24.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.041980664000000001 2024-04-25T22:03:24.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.331625+0000", 2024-04-25T22:03:24.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029998057000000002 2024-04-25T22:03:24.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.331677+0000", 2024-04-25T22:03:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1857999999999997e-05 2024-04-25T22:03:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.331718+0000", 2024-04-25T22:03:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0664000000000002e-05 2024-04-25T22:03:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:11875 4.27 4:e5179c63:::10000003176.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:19.225320+0000", 2024-04-25T22:03:24.071 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.7383545439999999, 2024-04-25T22:03:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.106595471, 2024-04-25T22:03:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 11875 2024-04-25T22:03:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.225320+0000", 2024-04-25T22:03:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.225320+0000", 2024-04-25T22:03:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.225321+0000", 2024-04-25T22:03:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7300000000000005e-07 2024-04-25T22:03:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.232320+0000", 2024-04-25T22:03:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069987859999999999 2024-04-25T22:03:24.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.232334+0000", 2024-04-25T22:03:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4572e-05 2024-04-25T22:03:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.232343+0000", 2024-04-25T22:03:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9469999999999992e-06 2024-04-25T22:03:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.261115+0000", 2024-04-25T22:03:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028771577 2024-04-25T22:03:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.261301+0000", 2024-04-25T22:03:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018575199999999999 2024-04-25T22:03:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.261469+0000", 2024-04-25T22:03:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016775000000000001 2024-04-25T22:03:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:24.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.301704+0000", 2024-04-25T22:03:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.040235899999999998 2024-04-25T22:03:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.331813+0000", 2024-04-25T22:03:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.030108627999999998 2024-04-25T22:03:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.331874+0000", 2024-04-25T22:03:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0989000000000002e-05 2024-04-25T22:03:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:24.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:19.331916+0000", 2024-04-25T22:03:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1696999999999997e-05 2024-04-25T22:03:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:15146 4.2b 4:d7c94c05:::100000034b5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:23.634111+0000", 2024-04-25T22:03:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.32956331300000002, 2024-04-25T22:03:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.100322048, 2024-04-25T22:03:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:24.077 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:24.078 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.078 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 15146 2024-04-25T22:03:24.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.078 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:24.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:24.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.634111+0000", 2024-04-25T22:03:24.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:24.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.634111+0000", 2024-04-25T22:03:24.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:24.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.634113+0000", 2024-04-25T22:03:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.485e-06 2024-04-25T22:03:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.639736+0000", 2024-04-25T22:03:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056234470000000002 2024-04-25T22:03:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.639750+0000", 2024-04-25T22:03:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3395e-05 2024-04-25T22:03:24.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.639756+0000", 2024-04-25T22:03:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3239999999999999e-06 2024-04-25T22:03:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.639823+0000", 2024-04-25T22:03:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7310000000000004e-05 2024-04-25T22:03:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.639894+0000", 2024-04-25T22:03:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0821999999999994e-05 2024-04-25T22:03:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.639975+0000", 2024-04-25T22:03:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1191000000000002e-05 2024-04-25T22:03:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.698673+0000", 2024-04-25T22:03:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.058697729999999997 2024-04-25T22:03:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.734325+0000", 2024-04-25T22:03:24.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.035651397000000001 2024-04-25T22:03:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.734386+0000", 2024-04-25T22:03:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1216000000000005e-05 2024-04-25T22:03:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:23.734434+0000", 2024-04-25T22:03:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7731000000000001e-05 2024-04-25T22:03:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.082 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:24.083 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:24.083 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:24.085 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:24.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:24.081+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:24.091 INFO:tasks.workunit.client.0.smithi044.stdout:2/946: creat d7/d7b/d81/d4e/d86/d6b/dd8/ded/f140 x:0 0 0 2024-04-25T22:03:24.091 INFO:tasks.workunit.client.0.smithi044.stdout:7/862: read d1c/d22/d28/d4e/d7b/fa3 [989651,58567] 0 2024-04-25T22:03:24.091 INFO:tasks.workunit.client.0.smithi044.stdout:2/947: unlink d7/l23 0 2024-04-25T22:03:24.091 INFO:tasks.workunit.client.0.smithi044.stdout:7/863: symlink d1c/d22/d28/d30/l106 0 2024-04-25T22:03:24.091 INFO:tasks.workunit.client.0.smithi044.stdout:2/948: write d7/d7b/d81/d4e/d86/d6b/dd8/ded/f104 [313943,50928] 0 2024-04-25T22:03:24.091 INFO:tasks.workunit.client.0.smithi044.stdout:2/949: creat d7/d8/d48/dd9/d2c/d50/f141 x:0 0 0 2024-04-25T22:03:24.092 INFO:tasks.workunit.client.0.smithi044.stdout:0/998: dread d8/df/d17/d45/d95/d9c/dcc/f6d [0,4194304] 0 2024-04-25T22:03:24.092 INFO:tasks.workunit.client.0.smithi044.stdout:2/950: mkdir d7/d7b/d81/d4e/d86/d6b/dd8/ded/de4/d142 0 2024-04-25T22:03:24.092 INFO:tasks.workunit.client.0.smithi044.stdout:0/999: chown f1 7753 1 2024-04-25T22:03:24.092 INFO:tasks.workunit.client.0.smithi044.stdout:2/951: write d7/d8/d48/dd9/f54 [1610004,94532] 0 2024-04-25T22:03:24.092 INFO:tasks.workunit.client.0.smithi044.stdout:2/952: read - d7/d8/d48/dd9/d4b/f12c zero size 2024-04-25T22:03:24.092 INFO:tasks.workunit.client.0.smithi044.stdout:2/953: creat d7/d7b/d81/f143 x:0 0 0 2024-04-25T22:03:24.092 INFO:tasks.workunit.client.0.smithi044.stdout:2/954: write d7/d8/d48/dd9/f11c [837446,116813] 0 2024-04-25T22:03:24.092 INFO:tasks.workunit.client.0.smithi044.stdout:2/955: rename d7/d7b/d81/d4e/deb/f11e to d7/d7b/d81/d4e/d86/d13f/f144 0 2024-04-25T22:03:24.092 INFO:tasks.workunit.client.0.smithi044.stdout:2/956: rename d7/d7b/d81/d4e/d86/d6b/d78/d44/dad/cd2 to d7/d8/d48/dd9/d4b/c145 0 2024-04-25T22:03:24.092 INFO:tasks.workunit.client.0.smithi044.stdout:2/957: dwrite d7/d8/d48/dd9/d4b/f72 [0,4194304] 0 2024-04-25T22:03:24.092 INFO:tasks.workunit.client.0.smithi044.stdout:4/905: sync 2024-04-25T22:03:24.092 INFO:tasks.workunit.client.0.smithi044.stdout:7/864: sync 2024-04-25T22:03:24.092 INFO:tasks.workunit.client.0.smithi044.stdout:7/865: write d1c/d22/f6b [4052530,4023] 0 2024-04-25T22:03:24.092 INFO:tasks.workunit.client.0.smithi044.stdout:4/906: creat dd/d35/d52/da9/dca/d79/d9c/f12b x:0 0 0 2024-04-25T22:03:24.093 INFO:tasks.workunit.client.0.smithi044.stdout:4/907: read - dd/d35/ff4 zero size 2024-04-25T22:03:24.093 INFO:tasks.workunit.client.0.smithi044.stdout:7/866: rmdir d1c/d22/d4a/dcc 39 2024-04-25T22:03:24.093 INFO:tasks.workunit.client.0.smithi044.stdout:7/867: truncate f9 5235439 0 2024-04-25T22:03:24.093 INFO:tasks.workunit.client.0.smithi044.stdout:4/908: mkdir dd/d35/d52/dfa/d12c 0 2024-04-25T22:03:24.093 INFO:tasks.workunit.client.0.smithi044.stdout:7/868: creat d1c/d22/d28/d30/d32/d97/f107 x:0 0 0 2024-04-25T22:03:24.093 INFO:tasks.workunit.client.0.smithi044.stdout:4/909: fsync dd/d35/d52/da9/dca/d79/fb7 0 2024-04-25T22:03:24.093 INFO:tasks.workunit.client.0.smithi044.stdout:4/910: creat dd/d35/d52/da9/dca/d79/d7f/dd1/f12d x:0 0 0 2024-04-25T22:03:24.093 INFO:tasks.workunit.client.0.smithi044.stdout:4/911: creat dd/d35/d52/da9/d100/d129/f12e x:0 0 0 2024-04-25T22:03:24.093 INFO:tasks.workunit.client.0.smithi044.stdout:1/894: truncate d3/d4b/fb9 55379 0 2024-04-25T22:03:24.093 INFO:tasks.workunit.client.0.smithi044.stdout:4/912: getdents dd/d19/d91 0 2024-04-25T22:03:24.093 INFO:tasks.workunit.client.0.smithi044.stdout:1/895: fdatasync d3/d30/dbb/d105/f114 0 2024-04-25T22:03:24.093 INFO:tasks.workunit.client.0.smithi044.stdout:1/896: dread - d3/d4b/db6/fce zero size 2024-04-25T22:03:24.093 INFO:tasks.workunit.client.0.smithi044.stdout:7/869: dwrite d1c/d22/d28/d57/f8b [0,4194304] 0 2024-04-25T22:03:24.093 INFO:tasks.workunit.client.0.smithi044.stdout:1/897: mkdir d3/d7/db/d5d/db0/d11a 0 2024-04-25T22:03:24.094 INFO:tasks.workunit.client.0.smithi044.stdout:1/898: dwrite d3/d30/fd2 [0,4194304] 0 2024-04-25T22:03:24.094 INFO:tasks.workunit.client.0.smithi044.stdout:1/899: dwrite d3/d7/f23 [0,4194304] 0 2024-04-25T22:03:24.094 INFO:tasks.workunit.client.0.smithi044.stdout:1/900: chown d3/d4b/fd1 20 1 2024-04-25T22:03:24.094 INFO:tasks.workunit.client.0.smithi044.stdout:1/901: creat d3/d7/db/f11b x:0 0 0 2024-04-25T22:03:24.094 INFO:tasks.workunit.client.0.smithi044.stdout:1/902: dwrite d3/fdc [0,4194304] 0 2024-04-25T22:03:24.094 INFO:tasks.workunit.client.0.smithi044.stdout:1/903: dread d3/d7/f40 [4194304,4194304] 0 2024-04-25T22:03:24.094 INFO:tasks.workunit.client.0.smithi044.stdout:1/904: fsync d3/d7/d83/fbd 0 2024-04-25T22:03:24.094 INFO:tasks.workunit.client.0.smithi044.stdout:1/905: creat d3/d54/d76/f11c x:0 0 0 2024-04-25T22:03:24.094 INFO:tasks.workunit.client.0.smithi044.stdout:1/906: write d3/d7/db/d8f/d10b/d43/dd6/ff4 [725276,50890] 0 2024-04-25T22:03:24.094 INFO:tasks.workunit.client.0.smithi044.stdout:1/907: link d3/d54/d76/ca7 d3/d72/c11d 0 2024-04-25T22:03:24.094 INFO:tasks.workunit.client.0.smithi044.stdout:1/908: dread - d3/d30/d3f/dc3/f108 zero size 2024-04-25T22:03:24.094 INFO:tasks.workunit.client.0.smithi044.stdout:1/909: write d3/d30/fd2 [2155304,2501] 0 2024-04-25T22:03:24.094 INFO:tasks.workunit.client.0.smithi044.stdout:1/910: dread d3/d7/db/f46 [0,4194304] 0 2024-04-25T22:03:24.094 INFO:tasks.workunit.client.0.smithi044.stdout:1/911: creat d3/d7/db/d8f/ded/f11e x:0 0 0 2024-04-25T22:03:24.095 INFO:tasks.workunit.client.0.smithi044.stdout:1/912: dread d3/d7/db/f3c [0,4194304] 0 2024-04-25T22:03:24.095 INFO:tasks.workunit.client.0.smithi044.stdout:1/913: dwrite d3/d7/db/d8f/d10b/d43/d85/f95 [0,4194304] 0 2024-04-25T22:03:24.095 INFO:tasks.workunit.client.0.smithi044.stdout:2/958: sync 2024-04-25T22:03:24.095 INFO:tasks.workunit.client.0.smithi044.stdout:1/914: dread d3/d7/d83/df9/d97/fe9 [0,4194304] 0 2024-04-25T22:03:24.095 INFO:tasks.workunit.client.0.smithi044.stdout:1/915: getdents d3/d30/dbb/d105 0 2024-04-25T22:03:24.095 INFO:tasks.workunit.client.0.smithi044.stdout:1/916: symlink d3/d72/l11f 0 2024-04-25T22:03:24.095 INFO:tasks.workunit.client.0.smithi044.stdout:1/917: link d3/d7/db/d8f/lcc d3/d7/db/d5d/db0/l120 0 2024-04-25T22:03:24.095 INFO:tasks.workunit.client.0.smithi044.stdout:1/918: truncate d3/d4b/fb9 788707 0 2024-04-25T22:03:24.095 INFO:tasks.workunit.client.0.smithi044.stdout:1/919: unlink d3/d7/f57 0 2024-04-25T22:03:24.095 INFO:tasks.workunit.client.0.smithi044.stdout:1/920: fsync d3/d7/f69 0 2024-04-25T22:03:24.095 INFO:tasks.workunit.client.0.smithi044.stdout:1/921: dread d3/d30/d3f/f86 [0,4194304] 0 2024-04-25T22:03:24.095 INFO:tasks.workunit.client.0.smithi044.stdout:1/922: link d3/d59/f93 d3/d7/d81/dfe/f121 0 2024-04-25T22:03:24.095 INFO:tasks.workunit.client.0.smithi044.stdout:1/923: getdents d3/d7/d81/dfe 0 2024-04-25T22:03:24.095 INFO:tasks.workunit.client.0.smithi044.stdout:1/924: creat d3/d59/f122 x:0 0 0 2024-04-25T22:03:24.095 INFO:tasks.workunit.client.0.smithi044.stdout:1/925: stat d3/d72/l7e 0 2024-04-25T22:03:24.096 INFO:tasks.workunit.client.0.smithi044.stdout:1/926: creat d3/d7/db/d8f/d10b/d43/f123 x:0 0 0 2024-04-25T22:03:24.102 INFO:tasks.workunit.client.0.smithi044.stdout:1/927: dread d3/d7/f2a [0,4194304] 0 2024-04-25T22:03:24.103 INFO:tasks.workunit.client.0.smithi044.stdout:1/928: getdents d3/d7 0 2024-04-25T22:03:24.104 INFO:tasks.workunit.client.0.smithi044.stdout:1/929: readlink d3/d7/db/d8f/d10b/l32 0 2024-04-25T22:03:24.106 INFO:tasks.workunit.client.0.smithi044.stdout:7/870: sync 2024-04-25T22:03:24.106 INFO:tasks.workunit.client.0.smithi044.stdout:4/913: sync 2024-04-25T22:03:24.106 INFO:tasks.workunit.client.0.smithi044.stdout:4/914: fdatasync dd/f36 0 2024-04-25T22:03:24.106 INFO:tasks.workunit.client.0.smithi044.stdout:4/915: readlink dd/d19/l82 0 2024-04-25T22:03:24.111 INFO:tasks.workunit.client.0.smithi044.stdout:1/930: write d3/d7/d83/df9/faa [2308015,65895] 0 2024-04-25T22:03:24.111 INFO:tasks.workunit.client.0.smithi044.stdout:4/916: write dd/d19/d91/d10e/d114/f11d [3172057,126192] 0 2024-04-25T22:03:24.112 INFO:tasks.workunit.client.0.smithi044.stdout:1/931: symlink d3/d30/d3f/l124 0 2024-04-25T22:03:24.112 INFO:tasks.workunit.client.0.smithi044.stdout:7/871: dwrite d1c/d22/d28/d30/d32/d5d/f7e [0,4194304] 0 2024-04-25T22:03:24.113 INFO:tasks.workunit.client.0.smithi044.stdout:4/917: link dd/l12 dd/d35/d52/da9/dca/d79/d9c/l12f 0 2024-04-25T22:03:24.114 INFO:tasks.workunit.client.0.smithi044.stdout:7/872: symlink d1c/d22/d28/d4e/d6a/d9e/dfa/dee/l108 0 2024-04-25T22:03:24.115 INFO:tasks.workunit.client.0.smithi044.stdout:1/932: write d3/f37 [3884123,82891] 0 2024-04-25T22:03:24.115 INFO:tasks.workunit.client.0.smithi044.stdout:7/873: stat d1c/d22/d28/d4e/d6a/d9e 0 2024-04-25T22:03:24.115 INFO:tasks.workunit.client.0.smithi044.stdout:4/918: rmdir dd/d35/d52/da9/dca/d79/d7f/dd1 39 2024-04-25T22:03:24.115 INFO:tasks.workunit.client.0.smithi044.stdout:1/933: rename d3/d7/db/l11 to d3/d54/l125 0 2024-04-25T22:03:24.115 INFO:tasks.workunit.client.0.smithi044.stdout:7/874: unlink d1c/d22/d28/d66/c92 0 2024-04-25T22:03:24.116 INFO:tasks.workunit.client.0.smithi044.stdout:4/919: write dd/d35/d52/dfa/ffd [214829,120246] 0 2024-04-25T22:03:24.117 INFO:tasks.workunit.client.0.smithi044.stdout:4/920: rmdir dd/d35/d52/da9/dca/d79/d7f 39 2024-04-25T22:03:24.119 INFO:tasks.workunit.client.0.smithi044.stdout:4/921: creat dd/d35/d52/da9/dca/d79/d7f/de6/f130 x:0 0 0 2024-04-25T22:03:24.120 INFO:tasks.workunit.client.0.smithi044.stdout:4/922: link dd/f17 dd/d35/d52/de9/f131 0 2024-04-25T22:03:24.124 INFO:tasks.workunit.client.0.smithi044.stdout:2/959: sync 2024-04-25T22:03:24.124 INFO:tasks.workunit.client.0.smithi044.stdout:1/934: sync 2024-04-25T22:03:24.125 INFO:tasks.workunit.client.0.smithi044.stdout:1/935: creat d3/d72/ddb/f126 x:0 0 0 2024-04-25T22:03:24.126 INFO:tasks.workunit.client.0.smithi044.stdout:4/923: dwrite dd/f8a [4194304,4194304] 0 2024-04-25T22:03:24.132 INFO:tasks.workunit.client.0.smithi044.stdout:4/924: write dd/f2a [880097,72146] 0 2024-04-25T22:03:24.134 INFO:tasks.workunit.client.0.smithi044.stdout:4/925: getdents dd/d35/d52/de9/d105 0 2024-04-25T22:03:24.134 INFO:tasks.workunit.client.0.smithi044.stdout:4/926: rmdir dd/d35/d52/d61 39 2024-04-25T22:03:24.135 INFO:tasks.workunit.client.0.smithi044.stdout:2/960: dwrite d7/d8/d48/df4/f101 [0,4194304] 0 2024-04-25T22:03:24.143 INFO:tasks.workunit.client.0.smithi044.stdout:2/961: dwrite d7/d8/d1c/f33 [0,4194304] 0 2024-04-25T22:03:24.144 INFO:tasks.workunit.client.0.smithi044.stdout:4/927: dread dd/d35/d52/f90 [0,4194304] 0 2024-04-25T22:03:24.145 INFO:tasks.workunit.client.0.smithi044.stdout:4/928: write dd/d19/f27 [3968968,77598] 0 2024-04-25T22:03:24.146 INFO:tasks.workunit.client.0.smithi044.stdout:4/929: read - dd/d35/d52/da9/dca/d79/d9c/f12b zero size 2024-04-25T22:03:24.148 INFO:tasks.workunit.client.0.smithi044.stdout:7/875: dread d1c/d22/d28/d30/d32/f9a [0,4194304] 0 2024-04-25T22:03:24.148 INFO:tasks.workunit.client.0.smithi044.stdout:7/876: fdatasync d1c/d22/f71 0 2024-04-25T22:03:24.149 INFO:tasks.workunit.client.0.smithi044.stdout:7/877: creat d1c/d88/f109 x:0 0 0 2024-04-25T22:03:24.149 INFO:tasks.workunit.client.0.smithi044.stdout:2/962: dwrite d7/d7b/d81/d4e/f126 [0,4194304] 0 2024-04-25T22:03:24.150 INFO:tasks.workunit.client.0.smithi044.stdout:2/963: rmdir d7/d8/de2 39 2024-04-25T22:03:24.152 INFO:tasks.workunit.client.0.smithi044.stdout:2/964: symlink d7/d7b/d81/d4e/d86/d6b/dd8/l146 0 2024-04-25T22:03:24.155 INFO:tasks.workunit.client.0.smithi044.stdout:2/965: creat d7/d8/d5f/f147 x:0 0 0 2024-04-25T22:03:24.156 INFO:tasks.workunit.client.0.smithi044.stdout:4/930: dwrite dd/d35/d52/da9/dca/d79/d7f/dd1/fd4 [0,4194304] 0 2024-04-25T22:03:24.157 INFO:tasks.workunit.client.0.smithi044.stdout:2/966: chown d7/d7b/d81/d4e/d86/d6b/dd8/ded 28 1 2024-04-25T22:03:24.157 INFO:tasks.workunit.client.0.smithi044.stdout:7/878: dwrite d1c/d22/d28/d57/f5a [4194304,4194304] 0 2024-04-25T22:03:24.159 INFO:tasks.workunit.client.0.smithi044.stdout:7/879: write d1c/d22/d28/d30/d32/f9a [4123667,53689] 0 2024-04-25T22:03:24.161 INFO:tasks.workunit.client.0.smithi044.stdout:7/880: fsync d1c/f3a 0 2024-04-25T22:03:24.163 INFO:tasks.workunit.client.0.smithi044.stdout:7/881: creat d1c/d22/d28/d30/d32/d5d/d83/f10a x:0 0 0 2024-04-25T22:03:24.164 INFO:tasks.workunit.client.0.smithi044.stdout:4/931: dwrite dd/d19/f1d [4194304,4194304] 0 2024-04-25T22:03:24.165 INFO:tasks.workunit.client.0.smithi044.stdout:7/882: rename d1c/d88/fef to d1c/d22/d28/d4e/d6a/f10b 0 2024-04-25T22:03:24.166 INFO:tasks.workunit.client.0.smithi044.stdout:4/932: mknod dd/d35/d52/da9/dca/d79/d7f/dd1/de4/c132 0 2024-04-25T22:03:24.166 INFO:tasks.workunit.client.0.smithi044.stdout:7/883: mknod d1c/d22/d28/d30/c10c 0 2024-04-25T22:03:24.167 INFO:tasks.workunit.client.0.smithi044.stdout:7/884: write d1c/d22/d28/d4e/d7b/fe7 [146461,14212] 0 2024-04-25T22:03:24.168 INFO:tasks.workunit.client.0.smithi044.stdout:7/885: rename d1c/d22/d28/d30/f46 to d1c/d22/d28/df1/f10d 0 2024-04-25T22:03:24.168 INFO:tasks.workunit.client.0.smithi044.stdout:7/886: chown d1c/f38 4741 1 2024-04-25T22:03:24.172 INFO:tasks.workunit.client.0.smithi044.stdout:4/933: dwrite dd/d35/d52/da9/dca/d79/d7f/f97 [0,4194304] 0 2024-04-25T22:03:24.179 INFO:tasks.workunit.client.0.smithi044.stdout:4/934: dwrite dd/d35/d52/da9/dca/d79/d7f/dd1/f107 [0,4194304] 0 2024-04-25T22:03:24.180 INFO:tasks.workunit.client.0.smithi044.stdout:4/935: rmdir dd/d35 39 2024-04-25T22:03:24.181 INFO:tasks.workunit.client.0.smithi044.stdout:4/936: rmdir dd/d19/d91/d10e/d114 39 2024-04-25T22:03:24.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:24.181+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:24.186 INFO:tasks.workunit.client.0.smithi044.stdout:1/936: dread d3/d7/d83/df9/fc7 [0,4194304] 0 2024-04-25T22:03:24.186 INFO:tasks.workunit.client.0.smithi044.stdout:7/887: dread d1c/d22/d28/d4e/d7b/fe7 [0,4194304] 0 2024-04-25T22:03:24.187 INFO:tasks.workunit.client.0.smithi044.stdout:7/888: read - d1c/d22/d28/d30/df8/ffc zero size 2024-04-25T22:03:24.187 INFO:tasks.workunit.client.0.smithi044.stdout:4/937: dread dd/d35/d52/da9/dca/db6/df0/f121 [0,4194304] 0 2024-04-25T22:03:24.187 INFO:tasks.workunit.client.0.smithi044.stdout:1/937: link d3/d7/d83/df9/d97/l6f d3/d30/dbb/l127 0 2024-04-25T22:03:24.188 INFO:tasks.workunit.client.0.smithi044.stdout:7/889: creat d1c/d22/d28/d30/d32/d5d/f10e x:0 0 0 2024-04-25T22:03:24.188 INFO:tasks.workunit.client.0.smithi044.stdout:4/938: symlink dd/d35/d52/de9/d105/l133 0 2024-04-25T22:03:24.188 INFO:tasks.workunit.client.0.smithi044.stdout:1/938: creat d3/d7/db/d8f/d10b/d43/dd6/f128 x:0 0 0 2024-04-25T22:03:24.189 INFO:tasks.workunit.client.0.smithi044.stdout:7/890: chown d1c/d22/d28/d30/d32/d5d/f10e 0 1 2024-04-25T22:03:24.189 INFO:tasks.workunit.client.0.smithi044.stdout:4/939: creat dd/d35/d52/da9/dca/d79/d7f/dc3/f134 x:0 0 0 2024-04-25T22:03:24.189 INFO:tasks.workunit.client.0.smithi044.stdout:7/891: chown d1c/d22/d28/d30/c4c 0 1 2024-04-25T22:03:24.190 INFO:tasks.workunit.client.0.smithi044.stdout:4/940: truncate dd/d35/f47 6528829 0 2024-04-25T22:03:24.190 INFO:tasks.workunit.client.0.smithi044.stdout:7/892: rename d1c/d22/d28/d30/fd1 to d1c/d22/d28/d57/f10f 0 2024-04-25T22:03:24.190 INFO:tasks.workunit.client.0.smithi044.stdout:4/941: creat dd/d35/d52/f135 x:0 0 0 2024-04-25T22:03:24.191 INFO:tasks.workunit.client.0.smithi044.stdout:7/893: mknod d1c/d22/d28/d4e/d7b/c110 0 2024-04-25T22:03:24.191 INFO:tasks.workunit.client.0.smithi044.stdout:4/942: stat dd/d35/d52/f6a 0 2024-04-25T22:03:24.194 INFO:tasks.workunit.client.0.smithi044.stdout:1/939: dwrite d3/d54/d76/f9f [0,4194304] 0 2024-04-25T22:03:24.198 INFO:tasks.workunit.client.0.smithi044.stdout:4/943: dwrite dd/d35/d52/da9/d100/d129/f12e [0,4194304] 0 2024-04-25T22:03:24.199 INFO:tasks.workunit.client.0.smithi044.stdout:4/944: chown dd/d35/f47 32147937 1 2024-04-25T22:03:24.201 INFO:tasks.workunit.client.0.smithi044.stdout:1/940: dwrite d3/d7/d83/df9/dc2/ff1 [0,4194304] 0 2024-04-25T22:03:24.201 INFO:tasks.workunit.client.0.smithi044.stdout:4/945: getdents dd/d35/d52/da9/dca/d79/d7f/dd1 0 2024-04-25T22:03:24.202 INFO:tasks.workunit.client.0.smithi044.stdout:2/967: dread d7/d7b/d81/d4e/d86/d6b/d78/d44/f71 [0,4194304] 0 2024-04-25T22:03:24.202 INFO:tasks.workunit.client.0.smithi044.stdout:1/941: creat d3/d7/db/f129 x:0 0 0 2024-04-25T22:03:24.203 INFO:tasks.workunit.client.0.smithi044.stdout:2/968: read d7/d7b/d81/d4e/d86/d6b/d78/d44/fdd [1127681,95902] 0 2024-04-25T22:03:24.204 INFO:tasks.workunit.client.0.smithi044.stdout:2/969: unlink d7/d7b/d81/d4e/f8c 0 2024-04-25T22:03:24.204 INFO:tasks.workunit.client.0.smithi044.stdout:4/946: link dd/d35/d52/da9/dca/d79/fb7 dd/d19/f136 0 2024-04-25T22:03:24.204 INFO:tasks.workunit.client.0.smithi044.stdout:2/970: chown d7/d8/f3e 748721352 1 2024-04-25T22:03:24.205 INFO:tasks.workunit.client.0.smithi044.stdout:4/947: creat dd/d19/f137 x:0 0 0 2024-04-25T22:03:24.206 INFO:tasks.workunit.client.0.smithi044.stdout:2/971: creat d7/d7b/d81/d4e/d86/d6b/dd8/ded/f148 x:0 0 0 2024-04-25T22:03:24.206 INFO:tasks.workunit.client.0.smithi044.stdout:4/948: write dd/d19/d91/d10e/d114/f11d [392554,92377] 0 2024-04-25T22:03:24.208 INFO:tasks.workunit.client.0.smithi044.stdout:4/949: creat dd/d19/d91/d10e/d10f/f138 x:0 0 0 2024-04-25T22:03:24.209 INFO:tasks.workunit.client.0.smithi044.stdout:1/942: dwrite d3/f61 [0,4194304] 0 2024-04-25T22:03:24.209 INFO:tasks.workunit.client.0.smithi044.stdout:2/972: getdents d7/d7b/d81/d4e/d86/d6b/dd8/ded/de4/d10f/dfa 0 2024-04-25T22:03:24.209 INFO:tasks.workunit.client.0.smithi044.stdout:4/950: fdatasync dd/d19/d91/dd9/f11a 0 2024-04-25T22:03:24.210 INFO:tasks.workunit.client.0.smithi044.stdout:2/973: chown d7/d7b/d81/d4e/d86/d6b/d78/d44/dad/c110 0 1 2024-04-25T22:03:24.210 INFO:tasks.workunit.client.0.smithi044.stdout:1/943: creat d3/d7/d83/de3/f12a x:0 0 0 2024-04-25T22:03:24.211 INFO:tasks.workunit.client.0.smithi044.stdout:7/894: write d1c/d22/f75 [1147648,9084] 0 2024-04-25T22:03:24.211 INFO:tasks.workunit.client.0.smithi044.stdout:4/951: mkdir dd/d35/d52/d139 0 2024-04-25T22:03:24.212 INFO:tasks.workunit.client.0.smithi044.stdout:2/974: write d7/d8/d1c/d77/f121 [1028246,75865] 0 2024-04-25T22:03:24.212 INFO:tasks.workunit.client.0.smithi044.stdout:1/944: mknod d3/d7/db/d8f/c12b 0 2024-04-25T22:03:24.212 INFO:tasks.workunit.client.0.smithi044.stdout:1/945: chown d3/d7/db/c27 30841702 1 2024-04-25T22:03:24.213 INFO:tasks.workunit.client.0.smithi044.stdout:7/895: rename d1c/d22/d28/d30/d32/d97/ffd to d1c/d88/d8f/dce/f111 0 2024-04-25T22:03:24.213 INFO:tasks.workunit.client.0.smithi044.stdout:1/946: mkdir d3/d30/dbb/d12c 0 2024-04-25T22:03:24.213 INFO:tasks.workunit.client.0.smithi044.stdout:4/952: truncate dd/d35/d52/da9/dca/db6/df0/f121 894151 0 2024-04-25T22:03:24.214 INFO:tasks.workunit.client.0.smithi044.stdout:7/896: write d1c/d22/d28/d57/f10f [565077,96592] 0 2024-04-25T22:03:24.214 INFO:tasks.workunit.client.0.smithi044.stdout:1/947: rename d3/d7/d83/df9/d97/d10e to d3/d72/d12d 0 2024-04-25T22:03:24.215 INFO:tasks.workunit.client.0.smithi044.stdout:1/948: readlink d3/d30/d3f/lb7 0 2024-04-25T22:03:24.215 INFO:tasks.workunit.client.0.smithi044.stdout:4/953: mkdir dd/d35/d52/da9/dca/db6/df0/d11f/d13a 0 2024-04-25T22:03:24.215 INFO:tasks.workunit.client.0.smithi044.stdout:7/897: symlink d1c/d88/d8f/l112 0 2024-04-25T22:03:24.216 INFO:tasks.workunit.client.0.smithi044.stdout:4/954: stat dd/d35/d52/da9/dca/d79/d7f/dc3/faa 0 2024-04-25T22:03:24.216 INFO:tasks.workunit.client.0.smithi044.stdout:1/949: truncate d3/d7/d83/fc5 974534 0 2024-04-25T22:03:24.216 INFO:tasks.workunit.client.0.smithi044.stdout:7/898: mknod d1c/d22/d28/d4e/d6a/de4/c113 0 2024-04-25T22:03:24.217 INFO:tasks.workunit.client.0.smithi044.stdout:4/955: dread - dd/d35/d52/da9/fc5 zero size 2024-04-25T22:03:24.217 INFO:tasks.workunit.client.0.smithi044.stdout:7/899: write d1c/d22/d4a/faa [4515367,14431] 0 2024-04-25T22:03:24.217 INFO:tasks.workunit.client.0.smithi044.stdout:1/950: mkdir d3/d7/db/d10d/d112/d12e 0 2024-04-25T22:03:24.218 INFO:tasks.workunit.client.0.smithi044.stdout:7/900: creat d1c/d22/d4a/f114 x:0 0 0 2024-04-25T22:03:24.219 INFO:tasks.workunit.client.0.smithi044.stdout:1/951: getdents d3/d7/db/dda 0 2024-04-25T22:03:24.220 INFO:tasks.workunit.client.0.smithi044.stdout:7/901: truncate d1c/d22/d28/d4e/d6a/d9e/fe8 5120933 0 2024-04-25T22:03:24.220 INFO:tasks.workunit.client.0.smithi044.stdout:1/952: read d3/d30/d3f/f68 [508588,62294] 0 2024-04-25T22:03:24.221 INFO:tasks.workunit.client.0.smithi044.stdout:7/902: chown d1c/l1d 229761541 1 2024-04-25T22:03:24.221 INFO:tasks.workunit.client.0.smithi044.stdout:4/956: dread dd/d35/d52/da9/dca/d79/d7f/f85 [0,4194304] 0 2024-04-25T22:03:24.222 INFO:tasks.workunit.client.0.smithi044.stdout:7/903: chown d1c/d22/d28/d30/d32/d5d/d83/f10a 0 1 2024-04-25T22:03:24.224 INFO:tasks.workunit.client.0.smithi044.stdout:7/904: getdents d1c/d22/d4a/dcc 0 2024-04-25T22:03:24.224 INFO:tasks.workunit.client.0.smithi044.stdout:2/975: dread d7/d7b/d81/d4e/f24 [0,4194304] 0 2024-04-25T22:03:24.225 INFO:tasks.workunit.client.0.smithi044.stdout:2/976: write d7/d8/f9a [140135,48730] 0 2024-04-25T22:03:24.226 INFO:tasks.workunit.client.0.smithi044.stdout:1/953: truncate d3/f26 3439230 0 2024-04-25T22:03:24.227 INFO:tasks.workunit.client.0.smithi044.stdout:2/977: mkdir d7/d8/d5f/d70/d149 0 2024-04-25T22:03:24.227 INFO:tasks.workunit.client.0.smithi044.stdout:1/954: stat d3/l1f 0 2024-04-25T22:03:24.228 INFO:tasks.workunit.client.0.smithi044.stdout:4/957: dwrite dd/d35/d52/da9/dca/d79/d7f/de6/f130 [0,4194304] 0 2024-04-25T22:03:24.228 INFO:tasks.workunit.client.0.smithi044.stdout:1/955: write d3/d7/db/d8f/d10b/f35 [2333194,39165] 0 2024-04-25T22:03:24.230 INFO:tasks.workunit.client.0.smithi044.stdout:4/958: fsync dd/d35/d52/da9/dca/d79/fb7 0 2024-04-25T22:03:24.231 INFO:tasks.workunit.client.0.smithi044.stdout:7/905: dwrite d1c/d22/d4a/f72 [4194304,4194304] 0 2024-04-25T22:03:24.232 INFO:tasks.workunit.client.0.smithi044.stdout:4/959: mknod dd/d19/d91/d10e/d114/c13b 0 2024-04-25T22:03:24.233 INFO:tasks.workunit.client.0.smithi044.stdout:7/906: write d1c/d22/d28/d30/d32/f42 [753245,97582] 0 2024-04-25T22:03:24.234 INFO:tasks.workunit.client.0.smithi044.stdout:7/907: unlink d1c/d22/d28/d4e/d6a/f10b 0 2024-04-25T22:03:24.235 INFO:tasks.workunit.client.0.smithi044.stdout:7/908: mknod d1c/d22/d4a/dcc/c115 0 2024-04-25T22:03:24.237 INFO:tasks.workunit.client.0.smithi044.stdout:1/956: dwrite d3/d7/d83/df9/fc7 [0,4194304] 0 2024-04-25T22:03:24.237 INFO:tasks.workunit.client.0.smithi044.stdout:7/909: creat d1c/d22/d28/d30/d32/f116 x:0 0 0 2024-04-25T22:03:24.238 INFO:tasks.workunit.client.0.smithi044.stdout:7/910: rmdir d1c/d22/d28/d66 39 2024-04-25T22:03:24.238 INFO:tasks.workunit.client.0.smithi044.stdout:1/957: chown d3/d7/db/d8f/d10b/d43/f104 4438200 1 2024-04-25T22:03:24.239 INFO:tasks.workunit.client.0.smithi044.stdout:7/911: readlink d1c/d22/d28/d4e/d6a/l70 0 2024-04-25T22:03:24.241 INFO:tasks.workunit.client.0.smithi044.stdout:4/960: dwrite dd/d35/d52/da9/dca/db6/df0/f121 [0,4194304] 0 2024-04-25T22:03:24.241 INFO:tasks.workunit.client.0.smithi044.stdout:1/958: read d3/d30/d3f/f68 [595638,15407] 0 2024-04-25T22:03:24.241 INFO:tasks.workunit.client.0.smithi044.stdout:7/912: mkdir d1c/d22/d28/d4e/d6a/d9e/dfa/dee/d117 0 2024-04-25T22:03:24.242 INFO:tasks.workunit.client.0.smithi044.stdout:7/913: rmdir d1c 39 2024-04-25T22:03:24.242 INFO:tasks.workunit.client.0.smithi044.stdout:1/959: creat d3/d7/d81/dfe/f12f x:0 0 0 2024-04-25T22:03:24.243 INFO:tasks.workunit.client.0.smithi044.stdout:1/960: mknod d3/d7/db/d8f/d10b/d43/c130 0 2024-04-25T22:03:24.244 INFO:tasks.workunit.client.0.smithi044.stdout:1/961: mkdir d3/d7/db/d8f/d10b/d43/dd6/d131 0 2024-04-25T22:03:24.245 INFO:tasks.workunit.client.0.smithi044.stdout:1/962: write d3/d4b/ff8 [157971,21840] 0 2024-04-25T22:03:24.246 INFO:tasks.workunit.client.0.smithi044.stdout:4/961: dread dd/d35/d52/da9/dca/d79/d7f/dd1/fd7 [0,4194304] 0 2024-04-25T22:03:24.246 INFO:tasks.workunit.client.0.smithi044.stdout:7/914: dread d1c/d22/f5c [0,4194304] 0 2024-04-25T22:03:24.246 INFO:tasks.workunit.client.0.smithi044.stdout:4/962: chown dd/fff 11773 1 2024-04-25T22:03:24.246 INFO:tasks.workunit.client.0.smithi044.stdout:1/963: creat d3/f132 x:0 0 0 2024-04-25T22:03:24.247 INFO:tasks.workunit.client.0.smithi044.stdout:4/963: chown dd/f11 32526142 1 2024-04-25T22:03:24.247 INFO:tasks.workunit.client.0.smithi044.stdout:1/964: fdatasync d3/d7/db/d5d/f106 0 2024-04-25T22:03:24.247 INFO:tasks.workunit.client.0.smithi044.stdout:7/915: chown d1c/d22/d28/d4e/d6a/d9e/fdd 80545702 1 2024-04-25T22:03:24.248 INFO:tasks.workunit.client.0.smithi044.stdout:4/964: mknod dd/d35/d52/da9/dca/d79/d9c/d10b/c13c 0 2024-04-25T22:03:24.248 INFO:tasks.workunit.client.0.smithi044.stdout:7/916: readlink d1c/d22/d28/d30/l48 0 2024-04-25T22:03:24.248 INFO:tasks.workunit.client.0.smithi044.stdout:7/917: fdatasync d1c/d88/d8f/d9c/fc4 0 2024-04-25T22:03:24.249 INFO:tasks.workunit.client.0.smithi044.stdout:7/918: write f0 [5006948,15974] 0 2024-04-25T22:03:24.250 INFO:tasks.workunit.client.0.smithi044.stdout:7/919: chown d1c/d22/d28/d4e/ldb 358691 1 2024-04-25T22:03:24.250 INFO:tasks.workunit.client.0.smithi044.stdout:1/965: link d3/d7/d83/df9/ce8 d3/d7/d81/dfe/c133 0 2024-04-25T22:03:24.251 INFO:tasks.workunit.client.0.smithi044.stdout:7/920: creat d1c/df3/f118 x:0 0 0 2024-04-25T22:03:24.251 INFO:tasks.workunit.client.0.smithi044.stdout:1/966: fdatasync d3/d7/d83/df9/dc2/f10c 0 2024-04-25T22:03:24.251 INFO:tasks.workunit.client.0.smithi044.stdout:7/921: read d1c/d22/f71 [902287,86370] 0 2024-04-25T22:03:24.252 INFO:tasks.workunit.client.0.smithi044.stdout:1/967: chown d3/d7/db/d8f/f91 489239902 1 2024-04-25T22:03:24.253 INFO:tasks.workunit.client.0.smithi044.stdout:1/968: stat d3/d7/db/d10d/d112 0 2024-04-25T22:03:24.253 INFO:tasks.workunit.client.0.smithi044.stdout:7/922: creat d1c/d22/d28/d30/df8/f119 x:0 0 0 2024-04-25T22:03:24.253 INFO:tasks.workunit.client.0.smithi044.stdout:4/965: dwrite dd/d19/ff1 [0,4194304] 0 2024-04-25T22:03:24.253 INFO:tasks.workunit.client.0.smithi044.stdout:1/969: mknod d3/d4b/db6/c134 0 2024-04-25T22:03:24.257 INFO:tasks.workunit.client.0.smithi044.stdout:4/966: rename dd/d35/d52/da9/dca/d79/d7f/dc3/fee to dd/d35/d52/da9/dca/db6/d11e/f13d 0 2024-04-25T22:03:24.259 INFO:tasks.workunit.client.0.smithi044.stdout:4/967: creat dd/d35/d52/da9/dca/d79/d9c/d10b/f13e x:0 0 0 2024-04-25T22:03:24.259 INFO:tasks.workunit.client.0.smithi044.stdout:1/970: dwrite d3/d7/db/d8f/d10b/f39 [0,4194304] 0 2024-04-25T22:03:24.260 INFO:tasks.workunit.client.0.smithi044.stdout:4/968: fsync dd/d35/d52/da9/dca/d79/d7f/dc3/fa1 0 2024-04-25T22:03:24.261 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:24.261 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:24.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.261 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4564.0:15411 4.6 e67/58 4:6163718f:::1000000338d.00000000:head v 67'233, mlcod=67'231)", 2024-04-25T22:03:24.262 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:24.215850+0000", 2024-04-25T22:03:24.262 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.045236433, 2024-04-25T22:03:24.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045259667000000003, 2024-04-25T22:03:24.262 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.262 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.262 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:03:24.262 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.215850+0000", 2024-04-25T22:03:24.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.215850+0000", 2024-04-25T22:03:24.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.215851+0000", 2024-04-25T22:03:24.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3e-07 2024-04-25T22:03:24.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.223797+0000", 2024-04-25T22:03:24.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079466350000000005 2024-04-25T22:03:24.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.223817+0000", 2024-04-25T22:03:24.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9757000000000001e-05 2024-04-25T22:03:24.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.223825+0000", 2024-04-25T22:03:24.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0330000000000008e-06 2024-04-25T22:03:24.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.223892+0000", 2024-04-25T22:03:24.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6792999999999996e-05 2024-04-25T22:03:24.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.223915+0000", 2024-04-25T22:03:24.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2594000000000001e-05 2024-04-25T22:03:24.265 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.265 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.265 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.265 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:15425 4.3b 4:dead040c:::10000003a47.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:24.265 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:24.230058+0000", 2024-04-25T22:03:24.265 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.031028078000000001, 2024-04-25T22:03:24.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031097691, 2024-04-25T22:03:24.265 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.265 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.265 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:24.265 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.265 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.266 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.266 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15425 2024-04-25T22:03:24.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.266 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.230058+0000", 2024-04-25T22:03:24.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.230058+0000", 2024-04-25T22:03:24.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.230060+0000", 2024-04-25T22:03:24.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8789999999999999e-06 2024-04-25T22:03:24.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.236462+0000", 2024-04-25T22:03:24.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0064021360000000001 2024-04-25T22:03:24.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.236475+0000", 2024-04-25T22:03:24.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2055000000000001e-05 2024-04-25T22:03:24.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.236481+0000", 2024-04-25T22:03:24.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0480000000000004e-06 2024-04-25T22:03:24.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.236565+0000", 2024-04-25T22:03:24.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4794000000000002e-05 2024-04-25T22:03:24.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.236715+0000", 2024-04-25T22:03:24.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014922199999999999 2024-04-25T22:03:24.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.236865+0000", 2024-04-25T22:03:24.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015020699999999999 2024-04-25T22:03:24.269 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.269 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.269 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.269 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:15429 4.23 4:c4ca3998:::100000034e4.00000001:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:24.269 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:24.236714+0000", 2024-04-25T22:03:24.269 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.024372206, 2024-04-25T22:03:24.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024487379, 2024-04-25T22:03:24.269 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.269 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.269 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:24.270 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.270 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.270 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.270 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15429 2024-04-25T22:03:24.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.270 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.236714+0000", 2024-04-25T22:03:24.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.236714+0000", 2024-04-25T22:03:24.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.236715+0000", 2024-04-25T22:03:24.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5600000000000004e-07 2024-04-25T22:03:24.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.241382+0000", 2024-04-25T22:03:24.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046666160000000002 2024-04-25T22:03:24.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.241394+0000", 2024-04-25T22:03:24.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2520999999999999e-05 2024-04-25T22:03:24.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.241404+0000", 2024-04-25T22:03:24.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2289999999999992e-06 2024-04-25T22:03:24.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.241481+0000", 2024-04-25T22:03:24.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7838999999999998e-05 2024-04-25T22:03:24.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.241661+0000", 2024-04-25T22:03:24.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017977600000000001 2024-04-25T22:03:24.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.241831+0000", 2024-04-25T22:03:24.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000170027 2024-04-25T22:03:24.273 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.273 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.273 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.273 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:15433 4.2d 4:b55619f0:::1000000328d.00000000:head [write 0~4194304 [2@2267736] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:24.273 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:24.241827+0000", 2024-04-25T22:03:24.274 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019259627000000001, 2024-04-25T22:03:24.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0194164, 2024-04-25T22:03:24.274 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.274 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.274 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:24.274 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.274 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.274 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.274 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15433 2024-04-25T22:03:24.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.274 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.241827+0000", 2024-04-25T22:03:24.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.241827+0000", 2024-04-25T22:03:24.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.241828+0000", 2024-04-25T22:03:24.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8299999999999996e-07 2024-04-25T22:03:24.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246981+0000", 2024-04-25T22:03:24.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005152879 2024-04-25T22:03:24.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246992+0000", 2024-04-25T22:03:24.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1177e-05 2024-04-25T22:03:24.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.247001+0000", 2024-04-25T22:03:24.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2920000000000001e-06 2024-04-25T22:03:24.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.247142+0000", 2024-04-25T22:03:24.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000140786 2024-04-25T22:03:24.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.247267+0000", 2024-04-25T22:03:24.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000125074 2024-04-25T22:03:24.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.247363+0000", 2024-04-25T22:03:24.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6218999999999995e-05 2024-04-25T22:03:24.277 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.277 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.278 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.278 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:15435 4.26 4:679c4235:::10000003a0e.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:24.278 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:24.247031+0000", 2024-04-25T22:03:24.278 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.014055939999999999, 2024-04-25T22:03:24.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014259532, 2024-04-25T22:03:24.278 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.278 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.278 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:24.278 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.278 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.278 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.278 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15435 2024-04-25T22:03:24.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.279 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.247031+0000", 2024-04-25T22:03:24.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.247031+0000", 2024-04-25T22:03:24.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.247032+0000", 2024-04-25T22:03:24.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8020000000000001e-06 2024-04-25T22:03:24.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.251494+0000", 2024-04-25T22:03:24.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044618490000000004 2024-04-25T22:03:24.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.251516+0000", 2024-04-25T22:03:24.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2024000000000001e-05 2024-04-25T22:03:24.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.251529+0000", 2024-04-25T22:03:24.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2405999999999999e-05 2024-04-25T22:03:24.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.251629+0000", 2024-04-25T22:03:24.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010020499999999999 2024-04-25T22:03:24.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.251760+0000", 2024-04-25T22:03:24.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013081900000000001 2024-04-25T22:03:24.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:24.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.251960+0000", 2024-04-25T22:03:24.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020015199999999999 2024-04-25T22:03:24.282 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.282 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.282 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.282 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:15445 4.3e 4:7e770347:::100000039b0.00000000:head [write 157971~21840 in=21840b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:24.282 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:24.251561+0000", 2024-04-25T22:03:24.282 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0095257540000000009, 2024-04-25T22:03:24.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0097947239999999994, 2024-04-25T22:03:24.282 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.282 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.282 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:24.283 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.283 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.283 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.283 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15445 2024-04-25T22:03:24.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.283 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.251561+0000", 2024-04-25T22:03:24.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.251561+0000", 2024-04-25T22:03:24.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.251563+0000", 2024-04-25T22:03:24.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7710000000000001e-06 2024-04-25T22:03:24.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.251591+0000", 2024-04-25T22:03:24.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8515999999999999e-05 2024-04-25T22:03:24.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.251599+0000", 2024-04-25T22:03:24.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2009999999999999e-06 2024-04-25T22:03:24.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.251605+0000", 2024-04-25T22:03:24.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6200000000000004e-06 2024-04-25T22:03:24.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.258899+0000", 2024-04-25T22:03:24.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072938339999999999 2024-04-25T22:03:24.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.259362+0000", 2024-04-25T22:03:24.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000463676 2024-04-25T22:03:24.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.259549+0000", 2024-04-25T22:03:24.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018625099999999999 2024-04-25T22:03:24.286 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.286 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.286 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.286 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:15448 4.3b 4:dd0fd304:::1000000393d.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:24.286 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:24.254856+0000", 2024-04-25T22:03:24.286 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.006230658, 2024-04-25T22:03:24.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065706410000000003, 2024-04-25T22:03:24.287 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.287 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.287 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:24.287 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.287 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.287 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.287 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15448 2024-04-25T22:03:24.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.287 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.254856+0000", 2024-04-25T22:03:24.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.254856+0000", 2024-04-25T22:03:24.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.254858+0000", 2024-04-25T22:03:24.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1289999999999999e-06 2024-04-25T22:03:24.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.259652+0000", 2024-04-25T22:03:24.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047942979999999998 2024-04-25T22:03:24.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.259667+0000", 2024-04-25T22:03:24.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4346e-05 2024-04-25T22:03:24.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.259677+0000", 2024-04-25T22:03:24.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.023e-05 2024-04-25T22:03:24.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.259743+0000", 2024-04-25T22:03:24.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6582999999999996e-05 2024-04-25T22:03:24.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.259917+0000", 2024-04-25T22:03:24.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000174007 2024-04-25T22:03:24.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.260069+0000", 2024-04-25T22:03:24.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015182300000000001 2024-04-25T22:03:24.290 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.290 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.290 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.290 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.290 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-04-25T22:03:24.290 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 7 2024-04-25T22:03:24.291 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:24.293 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:24.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:24.289+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:24.295 INFO:tasks.workunit.client.0.smithi044.stdout:4/969: symlink dd/d35/d52/da9/dca/d79/d7f/de6/l13f 0 2024-04-25T22:03:24.295 INFO:tasks.workunit.client.0.smithi044.stdout:2/978: dread d7/d8/d48/dd9/d2c/d50/f90 [0,4194304] 0 2024-04-25T22:03:24.295 INFO:tasks.workunit.client.0.smithi044.stdout:7/923: dwrite d1c/d22/d28/d57/f60 [0,4194304] 0 2024-04-25T22:03:24.295 INFO:tasks.workunit.client.0.smithi044.stdout:2/979: truncate d7/d8/d48/dd9/d4b/dc1/de1/fe9 73256 0 2024-04-25T22:03:24.295 INFO:tasks.workunit.client.0.smithi044.stdout:4/970: write dd/d35/d52/d61/d76/fae [36055,24420] 0 2024-04-25T22:03:24.295 INFO:tasks.workunit.client.0.smithi044.stdout:2/980: unlink d7/d7b/d81/d4e/d86/d6b/ca8 0 2024-04-25T22:03:24.295 INFO:tasks.workunit.client.0.smithi044.stdout:2/981: mkdir d7/d7b/d14a 0 2024-04-25T22:03:24.295 INFO:tasks.workunit.client.0.smithi044.stdout:2/982: mkdir d7/d7b/d14b 0 2024-04-25T22:03:24.295 INFO:tasks.workunit.client.0.smithi044.stdout:2/983: symlink d7/d7b/d81/d4e/d86/d13f/l14c 0 2024-04-25T22:03:24.296 INFO:tasks.workunit.client.0.smithi044.stdout:2/984: dwrite d7/d8/d48/dd9/d4b/f82 [0,4194304] 0 2024-04-25T22:03:24.296 INFO:tasks.workunit.client.0.smithi044.stdout:2/985: fsync d7/d8/d5f/d70/fb6 0 2024-04-25T22:03:24.296 INFO:tasks.workunit.client.0.smithi044.stdout:4/971: dread dd/d19/fd0 [4194304,4194304] 0 2024-04-25T22:03:24.296 INFO:tasks.workunit.client.0.smithi044.stdout:4/972: mknod dd/d19/c140 0 2024-04-25T22:03:24.296 INFO:tasks.workunit.client.0.smithi044.stdout:2/986: link d7/d7b/d81/d4e/d86/d6b/dd8/ded/f148 d7/d7b/d81/d4e/d86/d6b/dd8/ded/f14d 0 2024-04-25T22:03:24.296 INFO:tasks.workunit.client.0.smithi044.stdout:2/987: mkdir d7/d7b/d14a/d14e 0 2024-04-25T22:03:24.296 INFO:tasks.workunit.client.0.smithi044.stdout:2/988: rename d7/d7b/d81/d4e/d86/f83 to d7/d7b/d81/d4e/d86/d6b/dd8/ded/f14f 0 2024-04-25T22:03:24.296 INFO:tasks.workunit.client.0.smithi044.stdout:2/989: symlink d7/d7b/d81/d105/l150 0 2024-04-25T22:03:24.296 INFO:tasks.workunit.client.0.smithi044.stdout:4/973: dread dd/d19/f2b [0,4194304] 0 2024-04-25T22:03:24.296 INFO:tasks.workunit.client.0.smithi044.stdout:4/974: creat dd/d35/d52/da9/d100/d129/f141 x:0 0 0 2024-04-25T22:03:24.296 INFO:tasks.workunit.client.0.smithi044.stdout:4/975: dread - dd/d19/d91/dd9/fe3 zero size 2024-04-25T22:03:24.296 INFO:tasks.workunit.client.0.smithi044.stdout:4/976: link dd/d19/l24 dd/d35/d52/de9/l142 0 2024-04-25T22:03:24.296 INFO:tasks.workunit.client.0.smithi044.stdout:2/990: dwrite d7/d7b/d81/d4e/f24 [0,4194304] 0 2024-04-25T22:03:24.296 INFO:tasks.workunit.client.0.smithi044.stdout:7/924: dread d1c/d22/d28/df1/ff4 [0,4194304] 0 2024-04-25T22:03:24.297 INFO:tasks.workunit.client.0.smithi044.stdout:7/925: write d1c/d22/d28/d4e/d7b/fe7 [236945,99304] 0 2024-04-25T22:03:24.297 INFO:tasks.workunit.client.0.smithi044.stdout:4/977: dwrite dd/ff [4194304,4194304] 0 2024-04-25T22:03:24.297 INFO:tasks.workunit.client.0.smithi044.stdout:7/926: creat d1c/d22/d28/df1/f11a x:0 0 0 2024-04-25T22:03:24.299 INFO:tasks.workunit.client.0.smithi044.stdout:7/927: write d1c/d22/d28/d30/d32/d5d/d83/f10a [473967,45300] 0 2024-04-25T22:03:24.299 INFO:tasks.workunit.client.0.smithi044.stdout:1/971: sync 2024-04-25T22:03:24.299 INFO:tasks.workunit.client.0.smithi044.stdout:4/978: rename dd/d35/d52/d61/c70 to dd/d35/d52/da9/dca/d79/d7f/dd1/c143 0 2024-04-25T22:03:24.300 INFO:tasks.workunit.client.0.smithi044.stdout:7/928: write d1c/d22/d28/d30/f7d [3468292,11362] 0 2024-04-25T22:03:24.300 INFO:tasks.workunit.client.0.smithi044.stdout:1/972: read - d3/d7/d83/fbd zero size 2024-04-25T22:03:24.301 INFO:tasks.workunit.client.0.smithi044.stdout:7/929: write d1c/d22/d28/d30/d32/d5d/f7e [1795964,16244] 0 2024-04-25T22:03:24.301 INFO:tasks.workunit.client.0.smithi044.stdout:2/991: dread d7/d8/d48/dd9/d2c/d50/f90 [0,4194304] 0 2024-04-25T22:03:24.302 INFO:tasks.workunit.client.0.smithi044.stdout:1/973: fsync d3/d30/d3f/dc3/f108 0 2024-04-25T22:03:24.302 INFO:tasks.workunit.client.0.smithi044.stdout:1/974: dread - d3/d7/d83/df9/dc2/f10c zero size 2024-04-25T22:03:24.302 INFO:tasks.workunit.client.0.smithi044.stdout:2/992: mkdir d7/d7b/d81/d4e/d86/d6b/d78/d151 0 2024-04-25T22:03:24.302 INFO:tasks.workunit.client.0.smithi044.stdout:7/930: write d1c/d22/d28/d30/f84 [4916623,130608] 0 2024-04-25T22:03:24.303 INFO:tasks.workunit.client.0.smithi044.stdout:7/931: readlink d1c/d22/d28/d30/l7f 0 2024-04-25T22:03:24.303 INFO:tasks.workunit.client.0.smithi044.stdout:2/993: read d7/d8/d48/dd9/fdf [389179,88502] 0 2024-04-25T22:03:24.304 INFO:tasks.workunit.client.0.smithi044.stdout:1/975: rename d3/l1f to d3/d7/db/d8f/d10b/l135 0 2024-04-25T22:03:24.305 INFO:tasks.workunit.client.0.smithi044.stdout:7/932: symlink d1c/d22/d28/d4e/d6a/d9e/dfa/dee/l11b 0 2024-04-25T22:03:24.305 INFO:tasks.workunit.client.0.smithi044.stdout:2/994: chown d7/f32 12 1 2024-04-25T22:03:24.305 INFO:tasks.workunit.client.0.smithi044.stdout:1/976: symlink d3/d59/d5c/l136 0 2024-04-25T22:03:24.305 INFO:tasks.workunit.client.0.smithi044.stdout:2/995: readlink d7/d7b/d81/d105/l150 0 2024-04-25T22:03:24.305 INFO:tasks.workunit.client.0.smithi044.stdout:4/979: dwrite dd/d19/f27 [0,4194304] 0 2024-04-25T22:03:24.306 INFO:tasks.workunit.client.0.smithi044.stdout:2/996: symlink d7/d7b/d81/d4e/l152 0 2024-04-25T22:03:24.306 INFO:tasks.workunit.client.0.smithi044.stdout:7/933: rename d1c/d22/d28/d30/d32/d97/fb7 to d1c/d22/f11c 0 2024-04-25T22:03:24.307 INFO:tasks.workunit.client.0.smithi044.stdout:4/980: chown dd/l12 3 1 2024-04-25T22:03:24.308 INFO:tasks.workunit.client.0.smithi044.stdout:7/934: rename d1c/d22/d4a/fbe to d1c/df3/f11d 0 2024-04-25T22:03:24.309 INFO:tasks.workunit.client.0.smithi044.stdout:7/935: rename d1c/d22/d4a/faa to d1c/d22/d28/d30/d32/d5d/f11e 0 2024-04-25T22:03:24.309 INFO:tasks.workunit.client.0.smithi044.stdout:7/936: chown d1c/d88/d8f/d9c/fad 248020151 1 2024-04-25T22:03:24.310 INFO:tasks.workunit.client.0.smithi044.stdout:7/937: chown d1c/d22/d28/d4e/da1/fd6 93493085 1 2024-04-25T22:03:24.316 INFO:tasks.workunit.client.0.smithi044.stdout:7/938: dwrite d1c/d22/d28/d30/d32/d5d/f10e [0,4194304] 0 2024-04-25T22:03:24.321 INFO:tasks.workunit.client.0.smithi044.stdout:7/939: dwrite d1c/df3/f11d [0,4194304] 0 2024-04-25T22:03:24.327 INFO:tasks.workunit.client.0.smithi044.stdout:7/940: dwrite d1c/d22/d28/d4e/d7b/fe7 [0,4194304] 0 2024-04-25T22:03:24.328 INFO:tasks.workunit.client.0.smithi044.stdout:7/941: creat d1c/df3/f11f x:0 0 0 2024-04-25T22:03:24.329 INFO:tasks.workunit.client.0.smithi044.stdout:7/942: chown d1c/d22/d4a/c54 1 1 2024-04-25T22:03:24.329 INFO:tasks.workunit.client.0.smithi044.stdout:7/943: dread - d1c/d22/d28/d30/d32/d97/f107 zero size 2024-04-25T22:03:24.330 INFO:tasks.workunit.client.0.smithi044.stdout:7/944: fsync d1c/d22/d28/d30/d32/d5d/d83/fc7 0 2024-04-25T22:03:24.333 INFO:tasks.workunit.client.0.smithi044.stdout:2/997: dread d7/d8/d1c/f5c [0,4194304] 0 2024-04-25T22:03:24.335 INFO:tasks.workunit.client.0.smithi044.stdout:2/998: creat d7/d7b/d81/d138/f153 x:0 0 0 2024-04-25T22:03:24.336 INFO:tasks.workunit.client.0.smithi044.stdout:2/999: mkdir d7/d7b/d81/d4e/d86/d13f/d154 0 2024-04-25T22:03:24.336 INFO:tasks.workunit.client.0.smithi044.stdout:1/977: dread d3/d30/f31 [0,4194304] 0 2024-04-25T22:03:24.336 INFO:tasks.workunit.client.0.smithi044.stdout:7/945: dwrite d1c/d22/d4a/dcc/f101 [0,4194304] 0 2024-04-25T22:03:24.338 INFO:tasks.workunit.client.0.smithi044.stdout:1/978: readlink d3/d7/db/d8f/d10b/d43/d85/le1 0 2024-04-25T22:03:24.338 INFO:tasks.workunit.client.0.smithi044.stdout:7/946: symlink d1c/d88/d8f/d9c/l120 0 2024-04-25T22:03:24.338 INFO:tasks.workunit.client.0.smithi044.stdout:1/979: creat d3/f137 x:0 0 0 2024-04-25T22:03:24.338 INFO:tasks.workunit.client.0.smithi044.stdout:7/947: chown d1c/d22/d4a/f4f 21 1 2024-04-25T22:03:24.339 INFO:tasks.workunit.client.0.smithi044.stdout:7/948: creat d1c/d88/d8f/f121 x:0 0 0 2024-04-25T22:03:24.340 INFO:tasks.workunit.client.0.smithi044.stdout:7/949: read d1c/d22/d28/d30/d32/d5d/f10e [2729254,80419] 0 2024-04-25T22:03:24.341 INFO:tasks.workunit.client.0.smithi044.stdout:7/950: write d1c/d22/d28/d4e/d7b/d59/f91 [1751890,122554] 0 2024-04-25T22:03:24.341 INFO:tasks.workunit.client.0.smithi044.stdout:7/951: chown d1c/d88 378 1 2024-04-25T22:03:24.360 INFO:tasks.workunit.client.0.smithi044.stdout:1/980: dread d3/fc6 [0,4194304] 0 2024-04-25T22:03:24.363 INFO:tasks.workunit.client.0.smithi044.stdout:7/952: dread d1c/d22/d28/d4e/d7b/fa0 [0,4194304] 0 2024-04-25T22:03:24.367 INFO:tasks.workunit.client.0.smithi044.stdout:7/953: truncate d1c/d22/d28/d30/d32/d5d/d83/f10a 345444 0 2024-04-25T22:03:24.368 INFO:tasks.workunit.client.0.smithi044.stdout:7/954: read d1c/d22/d28/f41 [247154,35984] 0 2024-04-25T22:03:24.369 INFO:tasks.workunit.client.0.smithi044.stdout:7/955: rename d1c/d22/d28/d30/f84 to d1c/d22/d28/d66/d86/d102/f122 0 2024-04-25T22:03:24.374 INFO:tasks.workunit.client.0.smithi044.stdout:7/956: dwrite d1c/f79 [4194304,4194304] 0 2024-04-25T22:03:24.376 INFO:tasks.workunit.client.0.smithi044.stdout:7/957: rename d1c/d22/d28/d4e/d6a/f8c to d1c/d22/d28/d57/f123 0 2024-04-25T22:03:24.377 INFO:tasks.workunit.client.0.smithi044.stdout:7/958: readlink d1c/l1d 0 2024-04-25T22:03:24.377 INFO:tasks.workunit.client.0.smithi044.stdout:7/959: rmdir d1c/d88/d8f/dce 39 2024-04-25T22:03:24.378 INFO:tasks.workunit.client.0.smithi044.stdout:7/960: write d1c/f50 [1203990,87471] 0 2024-04-25T22:03:24.379 INFO:tasks.workunit.client.0.smithi044.stdout:7/961: creat d1c/d88/d8f/f124 x:0 0 0 2024-04-25T22:03:24.379 INFO:tasks.workunit.client.0.smithi044.stdout:1/981: dread d3/d72/f8c [0,4194304] 0 2024-04-25T22:03:24.380 INFO:tasks.workunit.client.0.smithi044.stdout:7/962: mkdir d1c/d22/d28/d30/df8/d125 0 2024-04-25T22:03:24.380 INFO:tasks.workunit.client.0.smithi044.stdout:7/963: unlink d1c/d22/d28/d30/d32/d5d/d83/lf7 0 2024-04-25T22:03:24.393 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:24.392+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:24.401 INFO:tasks.workunit.client.0.smithi044.stdout:7/964: dread d1c/d22/d4a/f72 [0,4194304] 0 2024-04-25T22:03:24.406 INFO:tasks.workunit.client.0.smithi044.stdout:7/965: dwrite d1c/ffe [0,4194304] 0 2024-04-25T22:03:24.407 INFO:tasks.workunit.client.0.smithi044.stdout:7/966: write d1c/d22/d28/d4e/d6a/d9e/fdd [834235,39389] 0 2024-04-25T22:03:24.408 INFO:tasks.workunit.client.0.smithi044.stdout:7/967: getdents d1c/d22/d28/d30 0 2024-04-25T22:03:24.409 INFO:tasks.workunit.client.0.smithi044.stdout:7/968: chown d1c/d22/f5c 478601 1 2024-04-25T22:03:24.460 INFO:tasks.workunit.client.0.smithi044.stdout:4/981: sync 2024-04-25T22:03:24.460 INFO:tasks.workunit.client.0.smithi044.stdout:1/982: sync 2024-04-25T22:03:24.460 INFO:tasks.workunit.client.0.smithi044.stdout:7/969: sync 2024-04-25T22:03:24.461 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:24.461 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:24.461 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:03:24.461 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:03:24.461 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:24.462 INFO:tasks.workunit.client.0.smithi044.stdout:4/982: chown dd/d35/d52/da9/fea 17833258 1 2024-04-25T22:03:24.462 INFO:tasks.workunit.client.0.smithi044.stdout:1/983: fdatasync d3/d7/db/d8f/d10b/f35 0 2024-04-25T22:03:24.465 INFO:tasks.workunit.client.0.smithi044.stdout:7/970: write d1c/d22/d28/d30/d32/f9a [2560621,129406] 0 2024-04-25T22:03:24.467 INFO:tasks.workunit.client.0.smithi044.stdout:4/983: creat dd/d19/d91/d10e/f144 x:0 0 0 2024-04-25T22:03:24.475 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:24.476 INFO:tasks.workunit.client.0.smithi044.stdout:4/984: dread dd/d35/d52/da9/dca/d79/d7f/f85 [4194304,4194304] 0 2024-04-25T22:03:24.477 INFO:tasks.workunit.client.0.smithi044.stdout:1/984: dwrite d3/f132 [0,4194304] 0 2024-04-25T22:03:24.479 INFO:tasks.workunit.client.0.smithi044.stdout:1/985: stat d3/d7/f2a 0 2024-04-25T22:03:24.479 INFO:tasks.workunit.client.0.smithi044.stdout:7/971: dwrite d1c/d22/d28/d30/d32/f55 [0,4194304] 0 2024-04-25T22:03:24.480 INFO:tasks.workunit.client.0.smithi044.stdout:4/985: mkdir dd/d35/d52/da9/dca/d79/d9c/d10b/d145 0 2024-04-25T22:03:24.481 INFO:tasks.workunit.client.0.smithi044.stdout:1/986: truncate d3/d54/f117 993478 0 2024-04-25T22:03:24.481 INFO:tasks.workunit.client.0.smithi044.stdout:7/972: write d1c/d88/d8f/d9c/fc4 [1097481,59423] 0 2024-04-25T22:03:24.482 INFO:tasks.workunit.client.0.smithi044.stdout:7/973: readlink d1c/lab 0 2024-04-25T22:03:24.486 INFO:tasks.workunit.client.0.smithi044.stdout:7/974: write d1c/d22/d28/d30/f36 [5932539,119390] 0 2024-04-25T22:03:24.489 INFO:tasks.workunit.client.0.smithi044.stdout:7/975: chown d1c/d22/d28/d4e/d6a/d9e/dfa/dd2/ce5 7987216 1 2024-04-25T22:03:24.489 INFO:tasks.workunit.client.0.smithi044.stdout:1/987: dread d3/fc6 [0,4194304] 0 2024-04-25T22:03:24.493 INFO:tasks.workunit.client.0.smithi044.stdout:1/988: write d3/d7/db/d8f/d10b/d43/f123 [373286,95104] 0 2024-04-25T22:03:24.495 INFO:tasks.workunit.client.0.smithi044.stdout:1/989: write d3/d30/dbb/f102 [7960517,9796] 0 2024-04-25T22:03:24.497 INFO:tasks.workunit.client.0.smithi044.stdout:4/986: dwrite dd/d35/d52/da9/dca/d79/d7f/dc3/f134 [0,4194304] 0 2024-04-25T22:03:24.499 INFO:tasks.workunit.client.0.smithi044.stdout:1/990: creat d3/d7/d83/df9/d97/f138 x:0 0 0 2024-04-25T22:03:24.500 INFO:tasks.workunit.client.0.smithi044.stdout:4/987: write dd/d35/fda [955612,49833] 0 2024-04-25T22:03:24.503 INFO:tasks.workunit.client.0.smithi044.stdout:1/991: rename d3/d7/f20 to d3/d30/d3f/f139 0 2024-04-25T22:03:24.504 INFO:tasks.workunit.client.0.smithi044.stdout:4/988: write dd/d35/d52/da9/dca/d79/d7f/dc3/fa7 [873172,62431] 0 2024-04-25T22:03:24.505 INFO:tasks.workunit.client.0.smithi044.stdout:1/992: write d3/d4b/fd1 [127093,68088] 0 2024-04-25T22:03:24.506 INFO:tasks.workunit.client.0.smithi044.stdout:4/989: write dd/d35/fda [2045048,22782] 0 2024-04-25T22:03:24.507 INFO:tasks.workunit.client.0.smithi044.stdout:7/976: dwrite d1c/d22/d28/d30/d32/d5d/f10e [0,4194304] 0 2024-04-25T22:03:24.510 INFO:tasks.workunit.client.0.smithi044.stdout:7/977: creat d1c/d22/f126 x:0 0 0 2024-04-25T22:03:24.510 INFO:tasks.workunit.client.0.smithi044.stdout:4/990: dread - dd/d35/d52/da9/dca/d79/d7f/dd1/fe0 zero size 2024-04-25T22:03:24.513 INFO:tasks.workunit.client.0.smithi044.stdout:4/991: unlink dd/d35/d52/da9/dca/d79/d7f/dc3/l9a 0 2024-04-25T22:03:24.513 INFO:tasks.workunit.client.0.smithi044.stdout:7/978: link d1c/d22/d4a/f72 d1c/d22/d28/d4e/f127 0 2024-04-25T22:03:24.519 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:24.517+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:24.526 INFO:tasks.workunit.client.0.smithi044.stdout:4/992: dwrite dd/d35/d52/d61/fcf [0,4194304] 0 2024-04-25T22:03:24.538 INFO:tasks.workunit.client.0.smithi044.stdout:4/993: dwrite dd/d19/f6d [0,4194304] 0 2024-04-25T22:03:24.542 INFO:tasks.workunit.client.0.smithi044.stdout:4/994: creat dd/d19/d104/f146 x:0 0 0 2024-04-25T22:03:24.544 INFO:tasks.workunit.client.0.smithi044.stdout:4/995: mkdir dd/d35/d52/da9/dca/db6/df0/d147 0 2024-04-25T22:03:24.546 INFO:tasks.workunit.client.0.smithi044.stdout:4/996: mkdir dd/d35/d52/da9/d100/d129/d148 0 2024-04-25T22:03:24.548 INFO:tasks.workunit.client.0.smithi044.stdout:4/997: rename dd/lb5 to dd/d35/d52/da9/dca/db6/df0/l149 0 2024-04-25T22:03:24.551 INFO:tasks.workunit.client.0.smithi044.stdout:4/998: mkdir dd/d35/d52/da9/dca/d79/d9c/d14a 0 2024-04-25T22:03:24.552 INFO:tasks.workunit.client.0.smithi044.stdout:4/999: symlink dd/d35/d52/da9/l14b 0 2024-04-25T22:03:24.558 INFO:tasks.workunit.client.0.smithi044.stdout:7/979: truncate d1c/d22/d28/d30/d32/f43 1816951 0 2024-04-25T22:03:24.560 INFO:tasks.workunit.client.0.smithi044.stdout:1/993: creat d3/d7/db/d8f/d10b/d43/d85/dfc/f13a x:0 0 0 2024-04-25T22:03:24.563 INFO:tasks.workunit.client.0.smithi044.stdout:1/994: chown d3/d7/d83/df9/d97/d99/f78 7 1 2024-04-25T22:03:24.565 INFO:tasks.workunit.client.0.smithi044.stdout:1/995: mkdir d3/d7/db/dda/d13b 0 2024-04-25T22:03:24.569 INFO:tasks.workunit.client.0.smithi044.stdout:1/996: rename d3/d7/c1a to d3/d30/c13c 0 2024-04-25T22:03:24.572 INFO:tasks.workunit.client.0.smithi044.stdout:7/980: dwrite d1c/d22/f71 [0,4194304] 0 2024-04-25T22:03:24.573 INFO:tasks.workunit.client.0.smithi044.stdout:1/997: rename d3/d59/ff5 to d3/d30/f13d 0 2024-04-25T22:03:24.581 INFO:tasks.workunit.client.0.smithi044.stdout:7/981: dread d1c/d22/d28/d30/d32/d5d/f7e [0,4194304] 0 2024-04-25T22:03:24.588 INFO:tasks.workunit.client.0.smithi044.stdout:1/998: dwrite d3/d7/db/d5d/f110 [0,4194304] 0 2024-04-25T22:03:24.590 INFO:tasks.workunit.client.0.smithi044.stdout:1/999: mknod d3/d54/c13e 0 2024-04-25T22:03:24.591 INFO:tasks.workunit.client.0.smithi044.stdout:7/982: write d1c/d22/d28/df1/ff4 [2389436,70074] 0 2024-04-25T22:03:24.594 INFO:tasks.workunit.client.0.smithi044.stdout:7/983: write d1c/d22/f5c [1604359,95021] 0 2024-04-25T22:03:24.594 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:24.592+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:24.600 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.511654898000003, 2024-04-25T22:03:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.501654135000003, 2024-04-25T22:03:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.497489860999998, 2024-04-25T22:03:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.495893543999998, 2024-04-25T22:03:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.439107294000003, 2024-04-25T22:03:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.423463028, 2024-04-25T22:03:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.418624336999997, 2024-04-25T22:03:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10648 4.33 4:cc614d18:::100000030cb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 11.060021025999999, 2024-04-25T22:03:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13001143300000001, 2024-04-25T22:03:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10648 2024-04-25T22:03:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537181+0000", 2024-04-25T22:03:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.782e-06 2024-04-25T22:03:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541681+0000", 2024-04-25T22:03:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045008460000000002 2024-04-25T22:03:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541692+0000", 2024-04-25T22:03:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0726e-05 2024-04-25T22:03:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541698+0000", 2024-04-25T22:03:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-04-25T22:03:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541771+0000", 2024-04-25T22:03:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3070000000000003e-05 2024-04-25T22:03:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542021+0000", 2024-04-25T22:03:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025059799999999999 2024-04-25T22:03:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542246+0000", 2024-04-25T22:03:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022471000000000001 2024-04-25T22:03:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.579359+0000", 2024-04-25T22:03:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037113211 2024-04-25T22:03:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667067+0000", 2024-04-25T22:03:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087707255999999997 2024-04-25T22:03:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667134+0000", 2024-04-25T22:03:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7862999999999997e-05 2024-04-25T22:03:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667190+0000", 2024-04-25T22:03:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5698000000000001e-05 2024-04-25T22:03:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10651 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 11.000245248000001, 2024-04-25T22:03:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11324606800000001, 2024-04-25T22:03:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10651 2024-04-25T22:03:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596957+0000", 2024-04-25T22:03:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-04-25T22:03:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601272+0000", 2024-04-25T22:03:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004314834 2024-04-25T22:03:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601291+0000", 2024-04-25T22:03:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9380000000000001e-05 2024-04-25T22:03:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601302+0000", 2024-04-25T22:03:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0416e-05 2024-04-25T22:03:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.603978+0000", 2024-04-25T22:03:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026763109999999998 2024-04-25T22:03:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604327+0000", 2024-04-25T22:03:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034881099999999998 2024-04-25T22:03:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604571+0000", 2024-04-25T22:03:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024436100000000001 2024-04-25T22:03:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644439+0000", 2024-04-25T22:03:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039868270999999997 2024-04-25T22:03:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710091+0000", 2024-04-25T22:03:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.065651910999999993 2024-04-25T22:03:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710144+0000", 2024-04-25T22:03:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2444999999999997e-05 2024-04-25T22:03:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710201+0000", 2024-04-25T22:03:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6839999999999998e-05 2024-04-25T22:03:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10654 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.990418385, 2024-04-25T22:03:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.103958778, 2024-04-25T22:03:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10654 2024-04-25T22:03:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606782+0000", 2024-04-25T22:03:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1699999999999999e-07 2024-04-25T22:03:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611155+0000", 2024-04-25T22:03:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043728580000000003 2024-04-25T22:03:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611173+0000", 2024-04-25T22:03:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8267e-05 2024-04-25T22:03:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611183+0000", 2024-04-25T22:03:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9250000000000007e-06 2024-04-25T22:03:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644642+0000", 2024-04-25T22:03:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033458976000000001 2024-04-25T22:03:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644739+0000", 2024-04-25T22:03:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7189999999999996e-05 2024-04-25T22:03:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644864+0000", 2024-04-25T22:03:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000124867 2024-04-25T22:03:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.672556+0000", 2024-04-25T22:03:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027691653 2024-04-25T22:03:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710668+0000", 2024-04-25T22:03:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038111956000000002 2024-04-25T22:03:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710703+0000", 2024-04-25T22:03:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5577000000000002e-05 2024-04-25T22:03:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710740+0000", 2024-04-25T22:03:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7092000000000003e-05 2024-04-25T22:03:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11078 4.4 4:22be2a9e:::10000003224.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.5932917639999999, 2024-04-25T22:03:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.112294177, 2024-04-25T22:03:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11078 2024-04-25T22:03:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003909+0000", 2024-04-25T22:03:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2750000000000001e-06 2024-04-25T22:03:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009939+0000", 2024-04-25T22:03:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060293309999999998 2024-04-25T22:03:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009961+0000", 2024-04-25T22:03:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1889999999999999e-05 2024-04-25T22:03:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009976+0000", 2024-04-25T22:03:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5642e-05 2024-04-25T22:03:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042803+0000", 2024-04-25T22:03:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032827299999999997 2024-04-25T22:03:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042911+0000", 2024-04-25T22:03:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107747 2024-04-25T22:03:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042990+0000", 2024-04-25T22:03:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8832999999999996e-05 2024-04-25T22:03:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.088710+0000", 2024-04-25T22:03:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045720129999999998 2024-04-25T22:03:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116108+0000", 2024-04-25T22:03:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027397388000000002 2024-04-25T22:03:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116164+0000", 2024-04-25T22:03:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6283000000000003e-05 2024-04-25T22:03:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116202+0000", 2024-04-25T22:03:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8358000000000001e-05 2024-04-25T22:03:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11195 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.379929647, 2024-04-25T22:03:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1095062, 2024-04-25T22:03:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11195 2024-04-25T22:03:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217272+0000", 2024-04-25T22:03:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.533e-06 2024-04-25T22:03:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217385+0000", 2024-04-25T22:03:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113533 2024-04-25T22:03:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217396+0000", 2024-04-25T22:03:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0682e-05 2024-04-25T22:03:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217402+0000", 2024-04-25T22:03:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:03:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238476+0000", 2024-04-25T22:03:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021073312 2024-04-25T22:03:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238558+0000", 2024-04-25T22:03:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2193000000000004e-05 2024-04-25T22:03:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238695+0000", 2024-04-25T22:03:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013737800000000001 2024-04-25T22:03:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292860+0000", 2024-04-25T22:03:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054165224999999997 2024-04-25T22:03:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326638+0000", 2024-04-25T22:03:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033777517999999999 2024-04-25T22:03:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326686+0000", 2024-04-25T22:03:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8062000000000002e-05 2024-04-25T22:03:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326776+0000", 2024-04-25T22:03:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0393e-05 2024-04-25T22:03:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11197 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3195543~33670] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.3797876630000001, 2024-04-25T22:03:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953929499999999, 2024-04-25T22:03:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11197 2024-04-25T22:03:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217413+0000", 2024-04-25T22:03:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5600000000000005e-07 2024-04-25T22:03:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217445+0000", 2024-04-25T22:03:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2240999999999998e-05 2024-04-25T22:03:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217453+0000", 2024-04-25T22:03:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6070000000000002e-06 2024-04-25T22:03:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217458+0000", 2024-04-25T22:03:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3630000000000002e-06 2024-04-25T22:03:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240891+0000", 2024-04-25T22:03:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023432637999999999 2024-04-25T22:03:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240990+0000", 2024-04-25T22:03:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8995999999999999e-05 2024-04-25T22:03:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241123+0000", 2024-04-25T22:03:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013371699999999999 2024-04-25T22:03:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292866+0000", 2024-04-25T22:03:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051742332000000002 2024-04-25T22:03:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326849+0000", 2024-04-25T22:03:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033983140000000002 2024-04-25T22:03:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326908+0000", 2024-04-25T22:03:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8842999999999999e-05 2024-04-25T22:03:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326951+0000", 2024-04-25T22:03:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3761999999999999e-05 2024-04-25T22:03:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11198 4.4 4:22c4fea3:::10000003262.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.3797333040000002, 2024-04-25T22:03:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12381273600000001, 2024-04-25T22:03:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11198 2024-04-25T22:03:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217467+0000", 2024-04-25T22:03:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4499999999999997e-07 2024-04-25T22:03:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225449+0000", 2024-04-25T22:03:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079819439999999995 2024-04-25T22:03:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225466+0000", 2024-04-25T22:03:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6602000000000001e-05 2024-04-25T22:03:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225477+0000", 2024-04-25T22:03:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1603000000000001e-05 2024-04-25T22:03:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240866+0000", 2024-04-25T22:03:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015388389000000001 2024-04-25T22:03:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241081+0000", 2024-04-25T22:03:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021577400000000001 2024-04-25T22:03:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241212+0000", 2024-04-25T22:03:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013073499999999999 2024-04-25T22:03:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292876+0000", 2024-04-25T22:03:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051663584999999998 2024-04-25T22:03:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341159+0000", 2024-04-25T22:03:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048283421999999999 2024-04-25T22:03:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341222+0000", 2024-04-25T22:03:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:03:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341279+0000", 2024-04-25T22:03:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6780999999999997e-05 2024-04-25T22:03:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11207 4.4 4:233f6309:::10000003211.00000000:head [write 659836~128648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.3631153070000002, 2024-04-25T22:03:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10732727, 2024-04-25T22:03:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11207 2024-04-25T22:03:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234085+0000", 2024-04-25T22:03:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0399999999999995e-07 2024-04-25T22:03:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234550+0000", 2024-04-25T22:03:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000464909 2024-04-25T22:03:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234561+0000", 2024-04-25T22:03:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0744000000000001e-05 2024-04-25T22:03:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234569+0000", 2024-04-25T22:03:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6890000000000004e-06 2024-04-25T22:03:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267197+0000", 2024-04-25T22:03:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032628182999999998 2024-04-25T22:03:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267297+0000", 2024-04-25T22:03:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100222 2024-04-25T22:03:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267393+0000", 2024-04-25T22:03:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6275999999999998e-05 2024-04-25T22:03:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292880+0000", 2024-04-25T22:03:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025487058999999999 2024-04-25T22:03:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341326+0000", 2024-04-25T22:03:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048446031000000001 2024-04-25T22:03:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341374+0000", 2024-04-25T22:03:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7632000000000001e-05 2024-04-25T22:03:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341412+0000", 2024-04-25T22:03:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7821000000000003e-05 2024-04-25T22:03:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11219 4.4 4:210cd53e:::100000031ff.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.3441660970000004, 2024-04-25T22:03:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13181403, 2024-04-25T22:03:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11219 2024-04-25T22:03:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253035+0000", 2024-04-25T22:03:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.322e-06 2024-04-25T22:03:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258145+0000", 2024-04-25T22:03:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051095669999999998 2024-04-25T22:03:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258163+0000", 2024-04-25T22:03:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8377999999999999e-05 2024-04-25T22:03:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258174+0000", 2024-04-25T22:03:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0925e-05 2024-04-25T22:03:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270495+0000", 2024-04-25T22:03:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012321354 2024-04-25T22:03:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270581+0000", 2024-04-25T22:03:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5741999999999993e-05 2024-04-25T22:03:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270717+0000", 2024-04-25T22:03:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013571500000000001 2024-04-25T22:03:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326599+0000", 2024-04-25T22:03:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055882026000000001 2024-04-25T22:03:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384753+0000", 2024-04-25T22:03:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058154527999999997 2024-04-25T22:03:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384805+0000", 2024-04-25T22:03:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1592999999999999e-05 2024-04-25T22:03:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384848+0000", 2024-04-25T22:03:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2880000000000003e-05 2024-04-25T22:03:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11868 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.385202273, 2024-04-25T22:03:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12149908700000001, 2024-04-25T22:03:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11868 2024-04-25T22:03:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211999+0000", 2024-04-25T22:03:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:03:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219614+0000", 2024-04-25T22:03:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076153490000000004 2024-04-25T22:03:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219628+0000", 2024-04-25T22:03:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3597e-05 2024-04-25T22:03:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219635+0000", 2024-04-25T22:03:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7759999999999997e-06 2024-04-25T22:03:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229908+0000", 2024-04-25T22:03:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010272478 2024-04-25T22:03:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229966+0000", 2024-04-25T22:03:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8495000000000002e-05 2024-04-25T22:03:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.230082+0000", 2024-04-25T22:03:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011560799999999999 2024-04-25T22:03:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257530+0000", 2024-04-25T22:03:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027448034999999999 2024-04-25T22:03:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333408+0000", 2024-04-25T22:03:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075878105000000001 2024-04-25T22:03:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333457+0000", 2024-04-25T22:03:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8757000000000001e-05 2024-04-25T22:03:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333497+0000", 2024-04-25T22:03:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9721000000000001e-05 2024-04-25T22:03:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11870 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 4063232~131072] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.3775479190000004, 2024-04-25T22:03:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.114017408, 2024-04-25T22:03:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11870 2024-04-25T22:03:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219653+0000", 2024-04-25T22:03:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6139999999999999e-06 2024-04-25T22:03:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219722+0000", 2024-04-25T22:03:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8460000000000005e-05 2024-04-25T22:03:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219730+0000", 2024-04-25T22:03:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3420000000000008e-06 2024-04-25T22:03:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219736+0000", 2024-04-25T22:03:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9619999999999998e-06 2024-04-25T22:03:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247743+0000", 2024-04-25T22:03:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028006400000000001 2024-04-25T22:03:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247847+0000", 2024-04-25T22:03:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104017 2024-04-25T22:03:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247984+0000", 2024-04-25T22:03:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013701800000000001 2024-04-25T22:03:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257536+0000", 2024-04-25T22:03:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095520050000000006 2024-04-25T22:03:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333565+0000", 2024-04-25T22:03:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076029154000000002 2024-04-25T22:03:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333628+0000", 2024-04-25T22:03:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2853000000000003e-05 2024-04-25T22:03:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333669+0000", 2024-04-25T22:03:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1582999999999998e-05 2024-04-25T22:03:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11871 4.37 4:ee924968:::10000003393.00000000:head [write 2359296~1835008] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.3774549870000001, 2024-04-25T22:03:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.113885236, 2024-04-25T22:03:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11871 2024-04-25T22:03:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6100000000000001e-07 2024-04-25T22:03:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222469+0000", 2024-04-25T22:03:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027240060000000002 2024-04-25T22:03:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222482+0000", 2024-04-25T22:03:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3049e-05 2024-04-25T22:03:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222492+0000", 2024-04-25T22:03:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8020000000000003e-06 2024-04-25T22:03:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247903+0000", 2024-04-25T22:03:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025410578999999999 2024-04-25T22:03:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247962+0000", 2024-04-25T22:03:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9363000000000001e-05 2024-04-25T22:03:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.248049+0000", 2024-04-25T22:03:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6803000000000002e-05 2024-04-25T22:03:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257915+0000", 2024-04-25T22:03:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0098655730000000007 2024-04-25T22:03:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333544+0000", 2024-04-25T22:03:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075629030999999999 2024-04-25T22:03:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333594+0000", 2024-04-25T22:03:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0291999999999999e-05 2024-04-25T22:03:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333630+0000", 2024-04-25T22:03:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6177000000000003e-05 2024-04-25T22:03:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:15375 4.4 4:211dd80e:::10000003351.00000000:head [write 0~4194304 [2@1354921]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.460125595, 2024-04-25T22:03:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953555500000001, 2024-04-25T22:03:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-04-25T22:03:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137076+0000", 2024-04-25T22:03:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.683e-06 2024-04-25T22:03:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142168+0000", 2024-04-25T22:03:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050917280000000002 2024-04-25T22:03:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142192+0000", 2024-04-25T22:03:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:03:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142206+0000", 2024-04-25T22:03:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.396e-05 2024-04-25T22:03:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142280+0000", 2024-04-25T22:03:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4369000000000006e-05 2024-04-25T22:03:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142346+0000", 2024-04-25T22:03:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5957000000000006e-05 2024-04-25T22:03:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142440+0000", 2024-04-25T22:03:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3888999999999995e-05 2024-04-25T22:03:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.208451+0000", 2024-04-25T22:03:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066011350999999996 2024-04-25T22:03:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246473+0000", 2024-04-25T22:03:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038021428000000003 2024-04-25T22:03:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246530+0000", 2024-04-25T22:03:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7466000000000002e-05 2024-04-25T22:03:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246610+0000", 2024-04-25T22:03:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9484e-05 2024-04-25T22:03:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:24.713 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:24.713 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:03:24.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:24.717 INFO:tasks.workunit.client.0.smithi044.stdout:7/984: sync 2024-04-25T22:03:24.717 INFO:tasks.workunit.client.0.smithi044.stdout:7/985: write d1c/d22/f5c [1494104,34716] 0 2024-04-25T22:03:24.717 INFO:tasks.workunit.client.0.smithi044.stdout:7/986: link d1c/d22/d28/d57/d7c/c82 d1c/d22/d28/d30/d32/c128 0 2024-04-25T22:03:24.717 INFO:tasks.workunit.client.0.smithi044.stdout:7/987: mkdir d1c/d22/d28/d4e/da1/d129 0 2024-04-25T22:03:24.717 INFO:tasks.workunit.client.0.smithi044.stdout:7/988: fsync d1c/d22/d28/d30/d32/f52 0 2024-04-25T22:03:24.717 INFO:tasks.workunit.client.0.smithi044.stdout:7/989: creat d1c/d22/d28/d4e/f12a x:0 0 0 2024-04-25T22:03:24.717 INFO:tasks.workunit.client.0.smithi044.stdout:7/990: dwrite d1c/d22/d28/d30/d32/f9a [0,4194304] 0 2024-04-25T22:03:24.717 INFO:tasks.workunit.client.0.smithi044.stdout:7/991: dread d1c/d22/d4a/f64 [0,4194304] 0 2024-04-25T22:03:24.718 INFO:tasks.workunit.client.0.smithi044.stdout:7/992: getdents d1c/d22/d28/d4e/da1/d129 0 2024-04-25T22:03:24.718 INFO:tasks.workunit.client.0.smithi044.stdout:7/993: readlink d1c/d88/d8f/l112 0 2024-04-25T22:03:24.718 INFO:tasks.workunit.client.0.smithi044.stdout:7/994: creat d1c/d22/d28/d4e/da1/f12b x:0 0 0 2024-04-25T22:03:24.718 INFO:tasks.workunit.client.0.smithi044.stdout:7/995: rename d1c/d88/d8f/la8 to d1c/d88/d8f/l12c 0 2024-04-25T22:03:24.718 INFO:tasks.workunit.client.0.smithi044.stdout:7/996: dwrite d1c/d22/d28/f3d [0,4194304] 0 2024-04-25T22:03:24.718 INFO:tasks.workunit.client.0.smithi044.stdout:7/997: symlink d1c/d22/d28/d30/df8/l12d 0 2024-04-25T22:03:24.718 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:24.708+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:24.789 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-25T22:03:24.815 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:24.812+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:24.880 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:24.880 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:24.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.880 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:15548 4.5 e68/16 4:a0ee6455:::1000000336f.00000000:head v 68'246, mlcod=67'244)", 2024-04-25T22:03:24.880 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:24.858203+0000", 2024-04-25T22:03:24.881 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.021131563999999999, 2024-04-25T22:03:24.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.021151521, 2024-04-25T22:03:24.881 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:24.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:24.881 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:24.881 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:24.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:24.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.858203+0000", 2024-04-25T22:03:24.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:24.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:24.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.858203+0000", 2024-04-25T22:03:24.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:24.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:24.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.858204+0000", 2024-04-25T22:03:24.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:03:24.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:24.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.862461+0000", 2024-04-25T22:03:24.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042576380000000002 2024-04-25T22:03:24.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:24.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.862488+0000", 2024-04-25T22:03:24.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6800000000000001e-05 2024-04-25T22:03:24.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.862502+0000", 2024-04-25T22:03:24.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4202999999999999e-05 2024-04-25T22:03:24.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:24.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.862640+0000", 2024-04-25T22:03:24.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000137894 2024-04-25T22:03:24.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:24.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.862695+0000", 2024-04-25T22:03:24.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5133000000000002e-05 2024-04-25T22:03:24.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:24.884 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:24.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:24.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.884 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:3077 3.d e68/49 3:b02ffd62:::200.00000010:head v 68'468, mlcod=68'457)", 2024-04-25T22:03:24.884 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:24.876337+0000", 2024-04-25T22:03:24.884 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0029978520000000001, 2024-04-25T22:03:24.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003064223, 2024-04-25T22:03:24.884 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:24.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:24.884 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:24.885 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:24.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:24.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.876337+0000", 2024-04-25T22:03:24.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:24.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:24.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.876337+0000", 2024-04-25T22:03:24.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:24.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:24.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.876338+0000", 2024-04-25T22:03:24.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-04-25T22:03:24.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:24.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.876376+0000", 2024-04-25T22:03:24.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8148999999999997e-05 2024-04-25T22:03:24.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:24.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.876405+0000", 2024-04-25T22:03:24.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8489000000000001e-05 2024-04-25T22:03:24.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.876417+0000", 2024-04-25T22:03:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2323e-05 2024-04-25T22:03:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.876568+0000", 2024-04-25T22:03:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015080099999999999 2024-04-25T22:03:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.876598+0000", 2024-04-25T22:03:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0372999999999999e-05 2024-04-25T22:03:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(mds.0.3:3078 3.d e68/49 3:b02ffd62:::200.00000010:head v 68'469, mlcod=68'457)", 2024-04-25T22:03:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:24.878641+0000", 2024-04-25T22:03:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00069386399999999998, 2024-04-25T22:03:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00080002700000000003, 2024-04-25T22:03:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.878641+0000", 2024-04-25T22:03:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.878641+0000", 2024-04-25T22:03:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.878642+0000", 2024-04-25T22:03:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.657e-06 2024-04-25T22:03:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.878657+0000", 2024-04-25T22:03:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4725999999999999e-05 2024-04-25T22:03:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.878722+0000", 2024-04-25T22:03:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4953e-05 2024-04-25T22:03:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.878741+0000", 2024-04-25T22:03:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8848999999999999e-05 2024-04-25T22:03:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.878882+0000", 2024-04-25T22:03:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014087799999999999 2024-04-25T22:03:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:24.878919+0000", 2024-04-25T22:03:24.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7178999999999998e-05 2024-04-25T22:03:24.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:24.891 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:24.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:24.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:24.891 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-04-25T22:03:24.891 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 3 2024-04-25T22:03:24.891 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:24.891 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:24.892 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:24.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:24.902 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:24.902 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:24.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:24.913+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:24.917 INFO:tasks.workunit.client.0.smithi044.stdout:7/998: unlink d1c/l26 0 2024-04-25T22:03:24.918 INFO:tasks.workunit.client.0.smithi044.stdout:7/999: fdatasync d1c/d22/f5c 0 2024-04-25T22:03:24.921 INFO:tasks.workunit.client.0.smithi044.stderr:+ rm -rf -- ./tmp.YOF6MeUUoe 2024-04-25T22:03:24.921 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:25.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:25.013+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:25.032 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:25.032 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:25.047 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:25.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:25.117+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:25.181 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:25.181 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:25.195 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:25.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:25.217+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:25.322 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:25.320+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:25.333 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:25.333 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:25.347 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:25.433 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:25.432+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:25.516 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:25.516 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:25.523 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:25.520+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:25.530 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:25.625 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:25.624+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:25.702 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:25.702 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:25.717 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:25.765 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:25.764+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:25.827 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:25.820+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:25.851 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:25.852 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:25.866 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:25.928 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:25.920+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:25.994 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:25.994 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:26.009 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:26.029 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:26.024+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:26.128 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:26.128 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:26.130 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:26.128+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:26.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:26.231 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:26.224+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:26.275 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:26.275 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:26.291 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:26.333 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:26.328+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:26.387 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:03:26.387 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:03:26.388 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:03:26.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:26.429+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:26.460 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:26.460 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:26.475 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:26.535 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:26.532+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:26.604 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:26.604 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:26.619 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:26.665 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:26.664+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:26.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:03:26.713 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:03:26.729 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-04-25T22:03:25.596727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2147122561,"num_objects":11374,"num_object_clones":0,"num_object_copies":22748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11374,"num_whiteouts":0,"num_read":2615,"num_read_kb":1234139,"num_write":15568,"num_write_kb":4022854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15608,"ondisk_log_size":15608,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":555640,"kb_used_data":395480,"kb_used_omap":4,"kb_used_meta":160123,"kb_avail":282559880,"statfs":{"total":289910292480,"available":289341317120,"internally_reserved":0,"allocated":404971520,"data_stored":3738260089,"data_compressed":32120021,"data_compressed_allocated":257376256,"data_compressed_original":3646356360,"omap_allocated":4785,"internal_metadata":163966287},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,2,2,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1399918479,"num_objects":477,"num_object_clones":0,"num_object_copies":954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":477,"num_whiteouts":0,"num_read":2226,"num_read_kb":1158348,"num_write":2991,"num_write_kb":2718368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.817643"},"pg_stats":[{"pgid":"4.3f","version":"67'221","reported_seq":308,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.463766+0000","last_change":"2024-04-25T22:02:49.882976+0000","last_active":"2024-04-25T22:03:23.463766+0000","last_peered":"2024-04-25T22:03:23.463766+0000","last_clean":"2024-04-25T22:03:23.463766+0000","last_became_active":"2024-04-25T22:02:49.882308+0000","last_became_peered":"2024-04-25T22:02:49.882308+0000","last_unstale":"2024-04-25T22:03:23.463766+0000","last_undegraded":"2024-04-25T22:03:23.463766+0000","last_fullsized":"2024-04-25T22:03:23.463766+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:46.257798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38514698,"num_objects":185,"num_object_clones":0,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":41,"num_read_kb":25336,"num_write":219,"num_write_kb":80053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"67'207","reported_seq":290,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.334262+0000","last_change":"2024-04-25T22:02:49.882947+0000","last_active":"2024-04-25T22:03:23.334262+0000","last_peered":"2024-04-25T22:03:23.334262+0000","last_clean":"2024-04-25T22:03:23.334262+0000","last_became_active":"2024-04-25T22:02:49.882192+0000","last_became_peered":"2024-04-25T22:02:49.882192+0000","last_unstale":"2024-04-25T22:03:23.334262+0000","last_undegraded":"2024-04-25T22:03:23.334262+0000","last_fullsized":"2024-04-25T22:03:23.334262+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:07.474272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36369718,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":37,"num_read_kb":23541,"num_write":207,"num_write_kb":83536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"67'190","reported_seq":334,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.562936+0000","last_change":"2024-04-25T22:02:49.886973+0000","last_active":"2024-04-25T22:03:23.562936+0000","last_peered":"2024-04-25T22:03:23.562936+0000","last_clean":"2024-04-25T22:03:23.562936+0000","last_became_active":"2024-04-25T22:02:49.884097+0000","last_became_peered":"2024-04-25T22:02:49.884097+0000","last_unstale":"2024-04-25T22:03:23.562936+0000","last_undegraded":"2024-04-25T22:03:23.562936+0000","last_fullsized":"2024-04-25T22:03:23.562936+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19771466,"num_objects":170,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":170,"num_whiteouts":0,"num_read":35,"num_read_kb":18215,"num_write":190,"num_write_kb":42890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"67'194","reported_seq":347,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.810861+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:03:23.810861+0000","last_peered":"2024-04-25T22:03:23.810861+0000","last_clean":"2024-04-25T22:03:23.810861+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:03:23.810861+0000","last_undegraded":"2024-04-25T22:03:23.810861+0000","last_fullsized":"2024-04-25T22:03:23.810861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33664659,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":43,"num_read_kb":20785,"num_write":193,"num_write_kb":63519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"67'216","reported_seq":297,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.570596+0000","last_change":"2024-04-25T22:02:49.879514+0000","last_active":"2024-04-25T22:03:23.570596+0000","last_peered":"2024-04-25T22:03:23.570596+0000","last_clean":"2024-04-25T22:03:23.570596+0000","last_became_active":"2024-04-25T22:02:49.878964+0000","last_became_peered":"2024-04-25T22:02:49.878964+0000","last_unstale":"2024-04-25T22:03:23.570596+0000","last_undegraded":"2024-04-25T22:03:23.570596+0000","last_fullsized":"2024-04-25T22:03:23.570596+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.432134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42585794,"num_objects":184,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":35,"num_read_kb":20896,"num_write":213,"num_write_kb":91939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"67'179","reported_seq":310,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:22.968644+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:03:22.968644+0000","last_peered":"2024-04-25T22:03:22.968644+0000","last_clean":"2024-04-25T22:03:22.968644+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:03:22.968644+0000","last_undegraded":"2024-04-25T22:03:22.968644+0000","last_fullsized":"2024-04-25T22:03:22.968644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14388643,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":22,"num_read_kb":9362,"num_write":178,"num_write_kb":20831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"67'226","reported_seq":382,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.214258+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:03:23.214258+0000","last_peered":"2024-04-25T22:03:23.214258+0000","last_clean":"2024-04-25T22:03:23.214258+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:03:23.214258+0000","last_undegraded":"2024-04-25T22:03:23.214258+0000","last_fullsized":"2024-04-25T22:03:23.214258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45748730,"num_objects":184,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":47,"num_read_kb":25721,"num_write":224,"num_write_kb":64002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"67'195","reported_seq":364,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.586812+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:03:23.586812+0000","last_peered":"2024-04-25T22:03:23.586812+0000","last_clean":"2024-04-25T22:03:23.586812+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:03:23.586812+0000","last_undegraded":"2024-04-25T22:03:23.586812+0000","last_fullsized":"2024-04-25T22:03:23.586812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36713705,"num_objects":159,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":159,"num_whiteouts":0,"num_read":60,"num_read_kb":24749,"num_write":193,"num_write_kb":64139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"67'226","reported_seq":369,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.448892+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:03:23.448892+0000","last_peered":"2024-04-25T22:03:23.448892+0000","last_clean":"2024-04-25T22:03:23.448892+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:03:23.448892+0000","last_undegraded":"2024-04-25T22:03:23.448892+0000","last_fullsized":"2024-04-25T22:03:23.448892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39211201,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":33,"num_read_kb":10648,"num_write":223,"num_write_kb":80644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"67'188","reported_seq":261,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.460714+0000","last_change":"2024-04-25T22:02:49.885137+0000","last_active":"2024-04-25T22:03:23.460714+0000","last_peered":"2024-04-25T22:03:23.460714+0000","last_clean":"2024-04-25T22:03:23.460714+0000","last_became_active":"2024-04-25T22:02:49.884276+0000","last_became_peered":"2024-04-25T22:02:49.884276+0000","last_unstale":"2024-04-25T22:03:23.460714+0000","last_undegraded":"2024-04-25T22:03:23.460714+0000","last_fullsized":"2024-04-25T22:03:23.460714+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:12.408801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32739556,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":27,"num_read_kb":10696,"num_write":187,"num_write_kb":55067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"67'206","reported_seq":341,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.220910+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:03:23.220910+0000","last_peered":"2024-04-25T22:03:23.220910+0000","last_clean":"2024-04-25T22:03:23.220910+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:03:23.220910+0000","last_undegraded":"2024-04-25T22:03:23.220910+0000","last_fullsized":"2024-04-25T22:03:23.220910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24659804,"num_objects":167,"num_object_clones":0,"num_object_copies":334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":167,"num_whiteouts":0,"num_read":26,"num_read_kb":11259,"num_write":205,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"67'186","reported_seq":389,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.594178+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:03:23.594178+0000","last_peered":"2024-04-25T22:03:23.594178+0000","last_clean":"2024-04-25T22:03:23.594178+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:03:23.594178+0000","last_undegraded":"2024-04-25T22:03:23.594178+0000","last_fullsized":"2024-04-25T22:03:23.594178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29842758,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":93,"num_read_kb":47876,"num_write":183,"num_write_kb":51203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"67'214","reported_seq":299,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.633102+0000","last_change":"2024-04-25T22:02:49.878698+0000","last_active":"2024-04-25T22:03:23.633102+0000","last_peered":"2024-04-25T22:03:23.633102+0000","last_clean":"2024-04-25T22:03:23.633102+0000","last_became_active":"2024-04-25T22:02:49.878377+0000","last_became_peered":"2024-04-25T22:02:49.878377+0000","last_unstale":"2024-04-25T22:03:23.633102+0000","last_undegraded":"2024-04-25T22:03:23.633102+0000","last_fullsized":"2024-04-25T22:03:23.633102+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:31:39.262571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44736326,"num_objects":171,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":171,"num_whiteouts":0,"num_read":39,"num_read_kb":17620,"num_write":213,"num_write_kb":96443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"67'217","reported_seq":371,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.475682+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:03:23.475682+0000","last_peered":"2024-04-25T22:03:23.475682+0000","last_clean":"2024-04-25T22:03:23.475682+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:03:23.475682+0000","last_undegraded":"2024-04-25T22:03:23.475682+0000","last_fullsized":"2024-04-25T22:03:23.475682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34030543,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":45,"num_read_kb":27327,"num_write":216,"num_write_kb":76113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"67'188","reported_seq":343,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.485242+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:03:23.485242+0000","last_peered":"2024-04-25T22:03:23.485242+0000","last_clean":"2024-04-25T22:03:23.485242+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:03:23.485242+0000","last_undegraded":"2024-04-25T22:03:23.485242+0000","last_fullsized":"2024-04-25T22:03:23.485242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23684601,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":46,"num_read_kb":23986,"num_write":185,"num_write_kb":50639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"67'213","reported_seq":354,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.618082+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:03:23.618082+0000","last_peered":"2024-04-25T22:03:23.618082+0000","last_clean":"2024-04-25T22:03:23.618082+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:03:23.618082+0000","last_undegraded":"2024-04-25T22:03:23.618082+0000","last_fullsized":"2024-04-25T22:03:23.618082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26275152,"num_objects":190,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":190,"num_whiteouts":0,"num_read":32,"num_read_kb":13806,"num_write":211,"num_write_kb":38900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"67'221","reported_seq":370,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.497593+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:03:23.497593+0000","last_peered":"2024-04-25T22:03:23.497593+0000","last_clean":"2024-04-25T22:03:23.497593+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:03:23.497593+0000","last_undegraded":"2024-04-25T22:03:23.497593+0000","last_fullsized":"2024-04-25T22:03:23.497593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42989466,"num_objects":192,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":192,"num_whiteouts":0,"num_read":39,"num_read_kb":11085,"num_write":221,"num_write_kb":64153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"67'185","reported_seq":244,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.271648+0000","last_change":"2024-04-25T22:02:49.885489+0000","last_active":"2024-04-25T22:03:23.271648+0000","last_peered":"2024-04-25T22:03:23.271648+0000","last_clean":"2024-04-25T22:03:23.271648+0000","last_became_active":"2024-04-25T22:02:49.884784+0000","last_became_peered":"2024-04-25T22:02:49.884784+0000","last_unstale":"2024-04-25T22:03:23.271648+0000","last_undegraded":"2024-04-25T22:03:23.271648+0000","last_fullsized":"2024-04-25T22:03:23.271648+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21784519,"num_objects":170,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":170,"num_whiteouts":0,"num_read":13,"num_read_kb":2485,"num_write":181,"num_write_kb":30013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"67'226","reported_seq":356,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.262902+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:03:23.262902+0000","last_peered":"2024-04-25T22:03:23.262902+0000","last_clean":"2024-04-25T22:03:23.262902+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:03:23.262902+0000","last_undegraded":"2024-04-25T22:03:23.262902+0000","last_fullsized":"2024-04-25T22:03:23.262902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45503179,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":20,"num_read_kb":17993,"num_write":224,"num_write_kb":96413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"67'212","reported_seq":350,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.096955+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:03:23.096955+0000","last_peered":"2024-04-25T22:03:23.096955+0000","last_clean":"2024-04-25T22:03:23.096955+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:03:23.096955+0000","last_undegraded":"2024-04-25T22:03:23.096955+0000","last_fullsized":"2024-04-25T22:03:23.096955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19961595,"num_objects":187,"num_object_clones":0,"num_object_copies":374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":187,"num_whiteouts":0,"num_read":29,"num_read_kb":11886,"num_write":208,"num_write_kb":50898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'194","reported_seq":338,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.734572+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:03:23.734572+0000","last_peered":"2024-04-25T22:03:23.734572+0000","last_clean":"2024-04-25T22:03:23.734572+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:03:23.734572+0000","last_undegraded":"2024-04-25T22:03:23.734572+0000","last_fullsized":"2024-04-25T22:03:23.734572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51812808,"num_objects":173,"num_object_clones":0,"num_object_copies":346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":173,"num_whiteouts":0,"num_read":35,"num_read_kb":14711,"num_write":193,"num_write_kb":67541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"67'219","reported_seq":302,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.454175+0000","last_change":"2024-04-25T22:02:49.886169+0000","last_active":"2024-04-25T22:03:23.454175+0000","last_peered":"2024-04-25T22:03:23.454175+0000","last_clean":"2024-04-25T22:03:23.454175+0000","last_became_active":"2024-04-25T22:02:49.884516+0000","last_became_peered":"2024-04-25T22:02:49.884516+0000","last_unstale":"2024-04-25T22:03:23.454175+0000","last_undegraded":"2024-04-25T22:03:23.454175+0000","last_fullsized":"2024-04-25T22:03:23.454175+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:21.251127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28869800,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":37,"num_read_kb":11950,"num_write":216,"num_write_kb":63383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"67'192","reported_seq":323,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.494654+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:03:23.494654+0000","last_peered":"2024-04-25T22:03:23.494654+0000","last_clean":"2024-04-25T22:03:23.494654+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:03:23.494654+0000","last_undegraded":"2024-04-25T22:03:23.494654+0000","last_fullsized":"2024-04-25T22:03:23.494654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30887035,"num_objects":175,"num_object_clones":0,"num_object_copies":350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":175,"num_whiteouts":0,"num_read":21,"num_read_kb":6470,"num_write":190,"num_write_kb":51232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"67'218","reported_seq":315,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:22.969754+0000","last_change":"2024-04-25T22:02:49.876986+0000","last_active":"2024-04-25T22:03:22.969754+0000","last_peered":"2024-04-25T22:03:22.969754+0000","last_clean":"2024-04-25T22:03:22.969754+0000","last_became_active":"2024-04-25T22:02:49.876269+0000","last_became_peered":"2024-04-25T22:02:49.876269+0000","last_unstale":"2024-04-25T22:03:22.969754+0000","last_undegraded":"2024-04-25T22:03:22.969754+0000","last_fullsized":"2024-04-25T22:03:22.969754+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:35:35.547810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31631025,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":51,"num_read_kb":26950,"num_write":218,"num_write_kb":59131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"67'203","reported_seq":292,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.505228+0000","last_change":"2024-04-25T22:02:49.881388+0000","last_active":"2024-04-25T22:03:23.505228+0000","last_peered":"2024-04-25T22:03:23.505228+0000","last_clean":"2024-04-25T22:03:23.505228+0000","last_became_active":"2024-04-25T22:02:49.880527+0000","last_became_peered":"2024-04-25T22:02:49.880527+0000","last_unstale":"2024-04-25T22:03:23.505228+0000","last_undegraded":"2024-04-25T22:03:23.505228+0000","last_fullsized":"2024-04-25T22:03:23.505228+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20078448,"num_objects":184,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":43,"num_read_kb":25550,"num_write":202,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"67'240","reported_seq":413,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.599084+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:03:23.599084+0000","last_peered":"2024-04-25T22:03:23.599084+0000","last_clean":"2024-04-25T22:03:23.599084+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:03:23.599084+0000","last_undegraded":"2024-04-25T22:03:23.599084+0000","last_fullsized":"2024-04-25T22:03:23.599084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48061597,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":204,"num_whiteouts":0,"num_read":62,"num_read_kb":29534,"num_write":236,"num_write_kb":84555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"67'190","reported_seq":347,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.745187+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:03:23.745187+0000","last_peered":"2024-04-25T22:03:23.745187+0000","last_clean":"2024-04-25T22:03:23.745187+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:03:23.745187+0000","last_undegraded":"2024-04-25T22:03:23.745187+0000","last_fullsized":"2024-04-25T22:03:23.745187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37134821,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":47,"num_read_kb":20465,"num_write":185,"num_write_kb":46774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"67'213","reported_seq":385,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.745141+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:03:23.745141+0000","last_peered":"2024-04-25T22:03:23.745141+0000","last_clean":"2024-04-25T22:03:23.745141+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:03:23.745141+0000","last_undegraded":"2024-04-25T22:03:23.745141+0000","last_fullsized":"2024-04-25T22:03:23.745141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34628001,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":61,"num_read_kb":27522,"num_write":212,"num_write_kb":92320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"67'190","reported_seq":337,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.715767+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:03:23.715767+0000","last_peered":"2024-04-25T22:03:23.715767+0000","last_clean":"2024-04-25T22:03:23.715767+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:03:23.715767+0000","last_undegraded":"2024-04-25T22:03:23.715767+0000","last_fullsized":"2024-04-25T22:03:23.715767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35566577,"num_objects":170,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":170,"num_whiteouts":0,"num_read":36,"num_read_kb":22997,"num_write":190,"num_write_kb":47074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"67'234","reported_seq":344,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.640753+0000","last_change":"2024-04-25T22:02:49.885001+0000","last_active":"2024-04-25T22:03:23.640753+0000","last_peered":"2024-04-25T22:03:23.640753+0000","last_clean":"2024-04-25T22:03:23.640753+0000","last_became_active":"2024-04-25T22:02:49.883649+0000","last_became_peered":"2024-04-25T22:02:49.883649+0000","last_unstale":"2024-04-25T22:03:23.640753+0000","last_undegraded":"2024-04-25T22:03:23.640753+0000","last_fullsized":"2024-04-25T22:03:23.640753+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:07.474272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27661481,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":64,"num_read_kb":20717,"num_write":234,"num_write_kb":51850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"67'219","reported_seq":358,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.227740+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:03:23.227740+0000","last_peered":"2024-04-25T22:03:23.227740+0000","last_clean":"2024-04-25T22:03:23.227740+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:03:23.227740+0000","last_undegraded":"2024-04-25T22:03:23.227740+0000","last_fullsized":"2024-04-25T22:03:23.227740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20505945,"num_objects":187,"num_object_clones":0,"num_object_copies":374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":187,"num_whiteouts":0,"num_read":28,"num_read_kb":10758,"num_write":214,"num_write_kb":44705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"67'202","reported_seq":288,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.695563+0000","last_change":"2024-04-25T22:02:43.850984+0000","last_active":"2024-04-25T22:03:23.695563+0000","last_peered":"2024-04-25T22:03:23.695563+0000","last_clean":"2024-04-25T22:03:23.695563+0000","last_became_active":"2024-04-25T22:02:43.850651+0000","last_became_peered":"2024-04-25T22:02:43.850651+0000","last_unstale":"2024-04-25T22:03:23.695563+0000","last_undegraded":"2024-04-25T22:03:23.695563+0000","last_fullsized":"2024-04-25T22:03:23.695563+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:08.019453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25401734,"num_objects":185,"num_object_clones":0,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":34,"num_read_kb":24963,"num_write":202,"num_write_kb":35977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"67'201","reported_seq":287,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.596681+0000","last_change":"2024-04-25T22:02:49.881928+0000","last_active":"2024-04-25T22:03:23.596681+0000","last_peered":"2024-04-25T22:03:23.596681+0000","last_clean":"2024-04-25T22:03:23.596681+0000","last_became_active":"2024-04-25T22:02:49.881638+0000","last_became_peered":"2024-04-25T22:02:49.881638+0000","last_unstale":"2024-04-25T22:03:23.596681+0000","last_undegraded":"2024-04-25T22:03:23.596681+0000","last_fullsized":"2024-04-25T22:03:23.596681+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:53:47.483774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21087899,"num_objects":160,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":160,"num_whiteouts":0,"num_read":40,"num_read_kb":24595,"num_write":199,"num_write_kb":79597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"66'454","reported_seq":565,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.795574+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:03:21.795574+0000","last_peered":"2024-04-25T22:03:21.795574+0000","last_clean":"2024-04-25T22:03:21.795574+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:03:21.795574+0000","last_undegraded":"2024-04-25T22:03:21.795574+0000","last_fullsized":"2024-04-25T22:03:21.795574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"67'175","reported_seq":249,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:22.967999+0000","last_change":"2024-04-25T22:02:49.882694+0000","last_active":"2024-04-25T22:03:22.967999+0000","last_peered":"2024-04-25T22:03:22.967999+0000","last_clean":"2024-04-25T22:03:22.967999+0000","last_became_active":"2024-04-25T22:02:49.882085+0000","last_became_peered":"2024-04-25T22:02:49.882085+0000","last_unstale":"2024-04-25T22:03:22.967999+0000","last_undegraded":"2024-04-25T22:03:22.967999+0000","last_fullsized":"2024-04-25T22:03:22.967999+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:56.743509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31660855,"num_objects":163,"num_object_clones":0,"num_object_copies":326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":163,"num_whiteouts":0,"num_read":28,"num_read_kb":10908,"num_write":173,"num_write_kb":42629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":112,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.789154+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:03:21.789154+0000","last_peered":"2024-04-25T22:03:21.789154+0000","last_clean":"2024-04-25T22:03:21.789154+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:03:21.789154+0000","last_undegraded":"2024-04-25T22:03:21.789154+0000","last_fullsized":"2024-04-25T22:03:21.789154+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"67'209","reported_seq":370,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.632659+0000","last_change":"2024-04-25T22:03:05.707184+0000","last_active":"2024-04-25T22:03:23.632659+0000","last_peered":"2024-04-25T22:03:23.632659+0000","last_clean":"2024-04-25T22:03:23.632659+0000","last_became_active":"2024-04-25T22:03:05.704710+0000","last_became_peered":"2024-04-25T22:03:05.704710+0000","last_unstale":"2024-04-25T22:03:23.632659+0000","last_undegraded":"2024-04-25T22:03:23.632659+0000","last_fullsized":"2024-04-25T22:03:23.632659+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:53.632923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21240317,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":46,"num_read_kb":16339,"num_write":204,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"66'1","reported_seq":46,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.794996+0000","last_change":"2024-04-25T22:02:49.881219+0000","last_active":"2024-04-25T22:03:21.794996+0000","last_peered":"2024-04-25T22:03:21.794996+0000","last_clean":"2024-04-25T22:03:21.794996+0000","last_became_active":"2024-04-25T22:02:49.880475+0000","last_became_peered":"2024-04-25T22:02:49.880475+0000","last_unstale":"2024-04-25T22:03:21.794996+0000","last_undegraded":"2024-04-25T22:03:21.794996+0000","last_fullsized":"2024-04-25T22:03:21.794996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:49.944264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"67'171","reported_seq":304,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.175337+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:03:23.175337+0000","last_peered":"2024-04-25T22:03:23.175337+0000","last_clean":"2024-04-25T22:03:23.175337+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:03:23.175337+0000","last_undegraded":"2024-04-25T22:03:23.175337+0000","last_fullsized":"2024-04-25T22:03:23.175337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16371222,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":23,"num_read_kb":16032,"num_write":170,"num_write_kb":25661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"67'9","reported_seq":120,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.795055+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:03:21.795055+0000","last_peered":"2024-04-25T22:03:21.795055+0000","last_clean":"2024-04-25T22:03:21.795055+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:03:21.795055+0000","last_undegraded":"2024-04-25T22:03:21.795055+0000","last_fullsized":"2024-04-25T22:03:21.795055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":112,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.795490+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:03:21.795490+0000","last_peered":"2024-04-25T22:03:21.795490+0000","last_clean":"2024-04-25T22:03:21.795490+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:03:21.795490+0000","last_undegraded":"2024-04-25T22:03:21.795490+0000","last_fullsized":"2024-04-25T22:03:21.795490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"67'191","reported_seq":281,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.400333+0000","last_change":"2024-04-25T22:02:49.881394+0000","last_active":"2024-04-25T22:03:23.400333+0000","last_peered":"2024-04-25T22:03:23.400333+0000","last_clean":"2024-04-25T22:03:23.400333+0000","last_became_active":"2024-04-25T22:02:49.880690+0000","last_became_peered":"2024-04-25T22:02:49.880690+0000","last_unstale":"2024-04-25T22:03:23.400333+0000","last_undegraded":"2024-04-25T22:03:23.400333+0000","last_fullsized":"2024-04-25T22:03:23.400333+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:31:39.262571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17165204,"num_objects":175,"num_object_clones":0,"num_object_copies":350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":175,"num_whiteouts":0,"num_read":44,"num_read_kb":21114,"num_write":188,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"66'3","reported_seq":57,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.795442+0000","last_change":"2024-04-25T22:02:49.884340+0000","last_active":"2024-04-25T22:03:21.795442+0000","last_peered":"2024-04-25T22:03:21.795442+0000","last_clean":"2024-04-25T22:03:21.795442+0000","last_became_active":"2024-04-25T22:02:49.883397+0000","last_became_peered":"2024-04-25T22:02:49.883397+0000","last_unstale":"2024-04-25T22:03:21.795442+0000","last_undegraded":"2024-04-25T22:03:21.795442+0000","last_fullsized":"2024-04-25T22:03:21.795442+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:55.740324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"67'227","reported_seq":312,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.375990+0000","last_change":"2024-04-25T22:02:49.877784+0000","last_active":"2024-04-25T22:03:23.375990+0000","last_peered":"2024-04-25T22:03:23.375990+0000","last_clean":"2024-04-25T22:03:23.375990+0000","last_became_active":"2024-04-25T22:02:49.876644+0000","last_became_peered":"2024-04-25T22:02:49.876644+0000","last_unstale":"2024-04-25T22:03:23.375990+0000","last_undegraded":"2024-04-25T22:03:23.375990+0000","last_fullsized":"2024-04-25T22:03:23.375990+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:50.947449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38537986,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":39,"num_read_kb":28291,"num_write":225,"num_write_kb":72049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"67'271","reported_seq":381,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.799613+0000","last_change":"2024-04-25T22:02:49.885084+0000","last_active":"2024-04-25T22:03:23.799613+0000","last_peered":"2024-04-25T22:03:23.799613+0000","last_clean":"2024-04-25T22:03:23.799613+0000","last_became_active":"2024-04-25T22:02:49.883048+0000","last_became_peered":"2024-04-25T22:02:49.883048+0000","last_unstale":"2024-04-25T22:03:23.799613+0000","last_undegraded":"2024-04-25T22:03:23.799613+0000","last_fullsized":"2024-04-25T22:03:23.799613+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:12.276434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2766238,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":2807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'195","reported_seq":315,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.657733+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:03:23.657733+0000","last_peered":"2024-04-25T22:03:23.657733+0000","last_clean":"2024-04-25T22:03:23.657733+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:03:23.657733+0000","last_undegraded":"2024-04-25T22:03:23.657733+0000","last_fullsized":"2024-04-25T22:03:23.657733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32082794,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":10,"num_read_kb":4746,"num_write":191,"num_write_kb":42516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":51,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.797704+0000","last_change":"2024-04-25T22:02:43.853012+0000","last_active":"2024-04-25T22:03:21.797704+0000","last_peered":"2024-04-25T22:03:21.797704+0000","last_clean":"2024-04-25T22:03:21.797704+0000","last_became_active":"2024-04-25T22:02:43.852338+0000","last_became_peered":"2024-04-25T22:02:43.852338+0000","last_unstale":"2024-04-25T22:03:21.797704+0000","last_undegraded":"2024-04-25T22:03:21.797704+0000","last_fullsized":"2024-04-25T22:03:21.797704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:07.951790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"67'261","reported_seq":422,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.528380+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:03:23.528380+0000","last_peered":"2024-04-25T22:03:23.528380+0000","last_clean":"2024-04-25T22:03:23.528380+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:03:23.528380+0000","last_undegraded":"2024-04-25T22:03:23.528380+0000","last_fullsized":"2024-04-25T22:03:23.528380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41939260,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":51,"num_read_kb":22665,"num_write":260,"num_write_kb":133655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"64'61","reported_seq":173,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.789424+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:03:21.789424+0000","last_peered":"2024-04-25T22:03:21.789424+0000","last_clean":"2024-04-25T22:03:21.789424+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:03:21.789424+0000","last_undegraded":"2024-04-25T22:03:21.789424+0000","last_fullsized":"2024-04-25T22:03:21.789424+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"67'210","reported_seq":280,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:22.883161+0000","last_change":"2024-04-25T22:02:43.853286+0000","last_active":"2024-04-25T22:03:22.883161+0000","last_peered":"2024-04-25T22:03:22.883161+0000","last_clean":"2024-04-25T22:03:22.883161+0000","last_became_active":"2024-04-25T22:02:43.852555+0000","last_became_peered":"2024-04-25T22:02:43.852555+0000","last_unstale":"2024-04-25T22:03:22.883161+0000","last_undegraded":"2024-04-25T22:03:22.883161+0000","last_fullsized":"2024-04-25T22:03:22.883161+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:42:10.005523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22485117,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":18,"num_read_kb":3720,"num_write":209,"num_write_kb":22269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"64'1","reported_seq":113,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.796026+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:03:21.796026+0000","last_peered":"2024-04-25T22:03:21.796026+0000","last_clean":"2024-04-25T22:03:21.796026+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:03:21.796026+0000","last_undegraded":"2024-04-25T22:03:21.796026+0000","last_fullsized":"2024-04-25T22:03:21.796026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"67'201","reported_seq":353,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.567098+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:03:23.567098+0000","last_peered":"2024-04-25T22:03:23.567098+0000","last_clean":"2024-04-25T22:03:23.567098+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:03:23.567098+0000","last_undegraded":"2024-04-25T22:03:23.567098+0000","last_fullsized":"2024-04-25T22:03:23.567098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28876824,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":43,"num_read_kb":19090,"num_write":200,"num_write_kb":87849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":45,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.794871+0000","last_change":"2024-04-25T22:02:49.884995+0000","last_active":"2024-04-25T22:03:21.794871+0000","last_peered":"2024-04-25T22:03:21.794871+0000","last_clean":"2024-04-25T22:03:21.794871+0000","last_became_active":"2024-04-25T22:02:49.883112+0000","last_became_peered":"2024-04-25T22:02:49.883112+0000","last_unstale":"2024-04-25T22:03:21.794871+0000","last_undegraded":"2024-04-25T22:03:21.794871+0000","last_fullsized":"2024-04-25T22:03:21.794871+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:45.254613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"67'181","reported_seq":322,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.443609+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:03:23.443609+0000","last_peered":"2024-04-25T22:03:23.443609+0000","last_clean":"2024-04-25T22:03:23.443609+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:03:23.443609+0000","last_undegraded":"2024-04-25T22:03:23.443609+0000","last_fullsized":"2024-04-25T22:03:23.443609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31424458,"num_objects":159,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":159,"num_whiteouts":0,"num_read":32,"num_read_kb":21517,"num_write":179,"num_write_kb":62742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"67'397","reported_seq":442,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:22.784921+0000","last_change":"2024-04-25T22:02:49.878347+0000","last_active":"2024-04-25T22:03:22.784921+0000","last_peered":"2024-04-25T22:03:22.784921+0000","last_clean":"2024-04-25T22:03:22.784921+0000","last_became_active":"2024-04-25T22:02:49.876980+0000","last_became_peered":"2024-04-25T22:02:49.876980+0000","last_unstale":"2024-04-25T22:03:22.784921+0000","last_undegraded":"2024-04-25T22:03:22.784921+0000","last_fullsized":"2024-04-25T22:03:22.784921+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:49.595210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"67'198","reported_seq":347,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.463835+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:03:23.463835+0000","last_peered":"2024-04-25T22:03:23.463835+0000","last_clean":"2024-04-25T22:03:23.463835+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:03:23.463835+0000","last_undegraded":"2024-04-25T22:03:23.463835+0000","last_fullsized":"2024-04-25T22:03:23.463835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36930214,"num_objects":173,"num_object_clones":0,"num_object_copies":346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":173,"num_whiteouts":0,"num_read":39,"num_read_kb":17888,"num_write":198,"num_write_kb":63460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":320,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.795241+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:03:21.795241+0000","last_peered":"2024-04-25T22:03:21.795241+0000","last_clean":"2024-04-25T22:03:21.795241+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:03:21.795241+0000","last_undegraded":"2024-04-25T22:03:21.795241+0000","last_fullsized":"2024-04-25T22:03:21.795241+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":118,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.795688+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:03:21.795688+0000","last_peered":"2024-04-25T22:03:21.795688+0000","last_clean":"2024-04-25T22:03:21.795688+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:03:21.795688+0000","last_undegraded":"2024-04-25T22:03:21.795688+0000","last_fullsized":"2024-04-25T22:03:21.795688+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"65'134","reported_seq":247,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.789323+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:03:21.789323+0000","last_peered":"2024-04-25T22:03:21.789323+0000","last_clean":"2024-04-25T22:03:21.789323+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:03:21.789323+0000","last_undegraded":"2024-04-25T22:03:21.789323+0000","last_fullsized":"2024-04-25T22:03:21.789323+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'239","reported_seq":389,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.739176+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:03:23.739176+0000","last_peered":"2024-04-25T22:03:23.739176+0000","last_clean":"2024-04-25T22:03:23.739176+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:03:23.739176+0000","last_undegraded":"2024-04-25T22:03:23.739176+0000","last_fullsized":"2024-04-25T22:03:23.739176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48741525,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":40,"num_read_kb":21078,"num_write":236,"num_write_kb":108872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.795132+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:03:21.795132+0000","last_peered":"2024-04-25T22:03:21.795132+0000","last_clean":"2024-04-25T22:03:21.795132+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:03:21.795132+0000","last_undegraded":"2024-04-25T22:03:21.795132+0000","last_fullsized":"2024-04-25T22:03:21.795132+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"67'13","reported_seq":137,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:22.726002+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:03:22.726002+0000","last_peered":"2024-04-25T22:03:22.726002+0000","last_clean":"2024-04-25T22:03:22.726002+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:03:22.726002+0000","last_undegraded":"2024-04-25T22:03:22.726002+0000","last_fullsized":"2024-04-25T22:03:22.726002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13231,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":21,"num_write":11,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"67'232","reported_seq":346,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.747230+0000","last_change":"2024-04-25T22:03:05.702224+0000","last_active":"2024-04-25T22:03:23.747230+0000","last_peered":"2024-04-25T22:03:23.747230+0000","last_clean":"2024-04-25T22:03:23.747230+0000","last_became_active":"2024-04-25T22:03:05.699581+0000","last_became_peered":"2024-04-25T22:03:05.699581+0000","last_unstale":"2024-04-25T22:03:23.747230+0000","last_undegraded":"2024-04-25T22:03:23.747230+0000","last_fullsized":"2024-04-25T22:03:23.747230+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45105574,"num_objects":193,"num_object_clones":0,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":63,"num_read_kb":29981,"num_write":230,"num_write_kb":67806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":119,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.789490+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:03:21.789490+0000","last_peered":"2024-04-25T22:03:21.789490+0000","last_clean":"2024-04-25T22:03:21.789490+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:03:21.789490+0000","last_undegraded":"2024-04-25T22:03:21.789490+0000","last_fullsized":"2024-04-25T22:03:21.789490+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"66'254","reported_seq":367,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.794171+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:03:21.794171+0000","last_peered":"2024-04-25T22:03:21.794171+0000","last_clean":"2024-04-25T22:03:21.794171+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:03:21.794171+0000","last_undegraded":"2024-04-25T22:03:21.794171+0000","last_fullsized":"2024-04-25T22:03:21.794171+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"67'193","reported_seq":348,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.644522+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:03:23.644522+0000","last_peered":"2024-04-25T22:03:23.644522+0000","last_clean":"2024-04-25T22:03:23.644522+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:03:23.644522+0000","last_undegraded":"2024-04-25T22:03:23.644522+0000","last_fullsized":"2024-04-25T22:03:23.644522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30993166,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":44,"num_read_kb":28273,"num_write":191,"num_write_kb":83691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":118,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.796066+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:03:21.796066+0000","last_peered":"2024-04-25T22:03:21.796066+0000","last_clean":"2024-04-25T22:03:21.796066+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:03:21.796066+0000","last_undegraded":"2024-04-25T22:03:21.796066+0000","last_fullsized":"2024-04-25T22:03:21.796066+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"67'2","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.789260+0000","last_change":"2024-04-25T22:02:43.851416+0000","last_active":"2024-04-25T22:03:21.789260+0000","last_peered":"2024-04-25T22:03:21.789260+0000","last_clean":"2024-04-25T22:03:21.789260+0000","last_became_active":"2024-04-25T22:02:43.850822+0000","last_became_peered":"2024-04-25T22:02:43.850822+0000","last_unstale":"2024-04-25T22:03:21.789260+0000","last_undegraded":"2024-04-25T22:03:21.789260+0000","last_fullsized":"2024-04-25T22:03:21.789260+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:56:58.100216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"67'233","reported_seq":460,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.632118+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:03:23.632118+0000","last_peered":"2024-04-25T22:03:23.632118+0000","last_clean":"2024-04-25T22:03:23.632118+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:03:23.632118+0000","last_undegraded":"2024-04-25T22:03:23.632118+0000","last_fullsized":"2024-04-25T22:03:23.632118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72494580,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":116,"num_read_kb":67935,"num_write":232,"num_write_kb":134011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":112,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.808313+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:03:21.808313+0000","last_peered":"2024-04-25T22:03:21.808313+0000","last_clean":"2024-04-25T22:03:21.808313+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:03:21.808313+0000","last_undegraded":"2024-04-25T22:03:21.808313+0000","last_fullsized":"2024-04-25T22:03:21.808313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":119,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.797933+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:03:21.797933+0000","last_peered":"2024-04-25T22:03:21.797933+0000","last_clean":"2024-04-25T22:03:21.797933+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:03:21.797933+0000","last_undegraded":"2024-04-25T22:03:21.797933+0000","last_fullsized":"2024-04-25T22:03:21.797933+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"67'196","reported_seq":294,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.610628+0000","last_change":"2024-04-25T22:02:49.884459+0000","last_active":"2024-04-25T22:03:23.610628+0000","last_peered":"2024-04-25T22:03:23.610628+0000","last_clean":"2024-04-25T22:03:23.610628+0000","last_became_active":"2024-04-25T22:02:49.883467+0000","last_became_peered":"2024-04-25T22:02:49.883467+0000","last_unstale":"2024-04-25T22:03:23.610628+0000","last_undegraded":"2024-04-25T22:03:23.610628+0000","last_fullsized":"2024-04-25T22:03:23.610628+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:31.024577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44686385,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":52,"num_read_kb":25386,"num_write":195,"num_write_kb":67404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":113,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.797920+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:03:21.797920+0000","last_peered":"2024-04-25T22:03:21.797920+0000","last_clean":"2024-04-25T22:03:21.797920+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:03:21.797920+0000","last_undegraded":"2024-04-25T22:03:21.797920+0000","last_fullsized":"2024-04-25T22:03:21.797920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.815101+0000","last_change":"2024-04-25T22:03:05.701809+0000","last_active":"2024-04-25T22:03:21.815101+0000","last_peered":"2024-04-25T22:03:21.815101+0000","last_clean":"2024-04-25T22:03:21.815101+0000","last_became_active":"2024-04-25T22:03:05.701322+0000","last_became_peered":"2024-04-25T22:03:05.701322+0000","last_unstale":"2024-04-25T22:03:21.815101+0000","last_undegraded":"2024-04-25T22:03:21.815101+0000","last_fullsized":"2024-04-25T22:03:21.815101+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:45.907458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"67'203","reported_seq":353,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.627659+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:03:23.627659+0000","last_peered":"2024-04-25T22:03:23.627659+0000","last_clean":"2024-04-25T22:03:23.627659+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:03:23.627659+0000","last_undegraded":"2024-04-25T22:03:23.627659+0000","last_fullsized":"2024-04-25T22:03:23.627659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44505846,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":42,"num_read_kb":20287,"num_write":201,"num_write_kb":91565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":115,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.792149+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:03:21.792149+0000","last_peered":"2024-04-25T22:03:21.792149+0000","last_clean":"2024-04-25T22:03:21.792149+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:03:21.792149+0000","last_undegraded":"2024-04-25T22:03:21.792149+0000","last_fullsized":"2024-04-25T22:03:21.792149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":119,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.794186+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:03:21.794186+0000","last_peered":"2024-04-25T22:03:21.794186+0000","last_clean":"2024-04-25T22:03:21.794186+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:03:21.794186+0000","last_undegraded":"2024-04-25T22:03:21.794186+0000","last_fullsized":"2024-04-25T22:03:21.794186+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"67'189","reported_seq":316,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.338557+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:03:23.338557+0000","last_peered":"2024-04-25T22:03:23.338557+0000","last_clean":"2024-04-25T22:03:23.338557+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:03:23.338557+0000","last_undegraded":"2024-04-25T22:03:23.338557+0000","last_fullsized":"2024-04-25T22:03:23.338557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16016063,"num_objects":174,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":174,"num_whiteouts":0,"num_read":16,"num_read_kb":8797,"num_write":186,"num_write_kb":25815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"67'39","reported_seq":152,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.696365+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:03:23.696365+0000","last_peered":"2024-04-25T22:03:23.696365+0000","last_clean":"2024-04-25T22:03:23.696365+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:03:23.696365+0000","last_undegraded":"2024-04-25T22:03:23.696365+0000","last_fullsized":"2024-04-25T22:03:23.696365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":1158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.795608+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:03:21.795608+0000","last_peered":"2024-04-25T22:03:21.795608+0000","last_clean":"2024-04-25T22:03:21.795608+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:03:21.795608+0000","last_undegraded":"2024-04-25T22:03:21.795608+0000","last_fullsized":"2024-04-25T22:03:21.795608+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'210","reported_seq":298,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.711584+0000","last_change":"2024-04-25T22:02:49.881600+0000","last_active":"2024-04-25T22:03:23.711584+0000","last_peered":"2024-04-25T22:03:23.711584+0000","last_clean":"2024-04-25T22:03:23.711584+0000","last_became_active":"2024-04-25T22:02:49.880681+0000","last_became_peered":"2024-04-25T22:02:49.880681+0000","last_unstale":"2024-04-25T22:03:23.711584+0000","last_undegraded":"2024-04-25T22:03:23.711584+0000","last_fullsized":"2024-04-25T22:03:23.711584+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.432134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53631470,"num_objects":169,"num_object_clones":0,"num_object_copies":338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":169,"num_whiteouts":0,"num_read":42,"num_read_kb":18476,"num_write":208,"num_write_kb":88488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"67'196","reported_seq":370,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.262028+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:03:23.262028+0000","last_peered":"2024-04-25T22:03:23.262028+0000","last_clean":"2024-04-25T22:03:23.262028+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:03:23.262028+0000","last_undegraded":"2024-04-25T22:03:23.262028+0000","last_fullsized":"2024-04-25T22:03:23.262028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45570724,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":65,"num_read_kb":33923,"num_write":196,"num_write_kb":73891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"67'24","reported_seq":135,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.795737+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:03:21.795737+0000","last_peered":"2024-04-25T22:03:21.795737+0000","last_clean":"2024-04-25T22:03:21.795737+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:03:21.795737+0000","last_undegraded":"2024-04-25T22:03:21.795737+0000","last_fullsized":"2024-04-25T22:03:21.795737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"67'193","reported_seq":329,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.438661+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:03:23.438661+0000","last_peered":"2024-04-25T22:03:23.438661+0000","last_clean":"2024-04-25T22:03:23.438661+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:03:23.438661+0000","last_undegraded":"2024-04-25T22:03:23.438661+0000","last_fullsized":"2024-04-25T22:03:23.438661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27473596,"num_objects":176,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":176,"num_whiteouts":0,"num_read":26,"num_read_kb":14102,"num_write":191,"num_write_kb":46447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"67'14","reported_seq":126,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:22.744373+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:03:22.744373+0000","last_peered":"2024-04-25T22:03:22.744373+0000","last_clean":"2024-04-25T22:03:22.744373+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:03:22.744373+0000","last_undegraded":"2024-04-25T22:03:22.744373+0000","last_fullsized":"2024-04-25T22:03:22.744373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"67'2","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:22.748752+0000","last_change":"2024-04-25T22:02:43.852674+0000","last_active":"2024-04-25T22:03:22.748752+0000","last_peered":"2024-04-25T22:03:22.748752+0000","last_clean":"2024-04-25T22:03:22.748752+0000","last_became_active":"2024-04-25T22:02:43.852292+0000","last_became_peered":"2024-04-25T22:02:43.852292+0000","last_unstale":"2024-04-25T22:03:22.748752+0000","last_undegraded":"2024-04-25T22:03:22.748752+0000","last_fullsized":"2024-04-25T22:03:22.748752+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:57.388397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"67'240","reported_seq":398,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.686230+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:03:23.686230+0000","last_peered":"2024-04-25T22:03:23.686230+0000","last_clean":"2024-04-25T22:03:23.686230+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:03:23.686230+0000","last_undegraded":"2024-04-25T22:03:23.686230+0000","last_fullsized":"2024-04-25T22:03:23.686230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39266958,"num_objects":207,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":207,"num_whiteouts":0,"num_read":48,"num_read_kb":24709,"num_write":251,"num_write_kb":72507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"66'3","reported_seq":115,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.791982+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:03:21.791982+0000","last_peered":"2024-04-25T22:03:21.791982+0000","last_clean":"2024-04-25T22:03:21.791982+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:03:21.791982+0000","last_undegraded":"2024-04-25T22:03:21.791982+0000","last_fullsized":"2024-04-25T22:03:21.791982+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"67'211","reported_seq":344,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.449832+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:03:23.449832+0000","last_peered":"2024-04-25T22:03:23.449832+0000","last_clean":"2024-04-25T22:03:23.449832+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:03:23.449832+0000","last_undegraded":"2024-04-25T22:03:23.449832+0000","last_fullsized":"2024-04-25T22:03:23.449832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30261429,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":23,"num_read_kb":10333,"num_write":211,"num_write_kb":42802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"67'172","reported_seq":239,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.739402+0000","last_change":"2024-04-25T22:02:49.884155+0000","last_active":"2024-04-25T22:03:23.739402+0000","last_peered":"2024-04-25T22:03:23.739402+0000","last_clean":"2024-04-25T22:03:23.739402+0000","last_became_active":"2024-04-25T22:02:49.883314+0000","last_became_peered":"2024-04-25T22:02:49.883314+0000","last_unstale":"2024-04-25T22:03:23.739402+0000","last_undegraded":"2024-04-25T22:03:23.739402+0000","last_fullsized":"2024-04-25T22:03:23.739402+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:53:47.483774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19245308,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":21,"num_read_kb":18236,"num_write":170,"num_write_kb":38409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"66'490","reported_seq":602,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.788878+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:03:21.788878+0000","last_peered":"2024-04-25T22:03:21.788878+0000","last_clean":"2024-04-25T22:03:21.788878+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:03:21.788878+0000","last_undegraded":"2024-04-25T22:03:21.788878+0000","last_fullsized":"2024-04-25T22:03:21.788878+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":486,"num_write_kb":4305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"67'189","reported_seq":319,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.227399+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:03:23.227399+0000","last_peered":"2024-04-25T22:03:23.227399+0000","last_clean":"2024-04-25T22:03:23.227399+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:03:23.227399+0000","last_undegraded":"2024-04-25T22:03:23.227399+0000","last_fullsized":"2024-04-25T22:03:23.227399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22909131,"num_objects":166,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":19,"num_read_kb":6876,"num_write":188,"num_write_kb":46840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"66'3","reported_seq":115,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.788783+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:03:21.788783+0000","last_peered":"2024-04-25T22:03:21.788783+0000","last_clean":"2024-04-25T22:03:21.788783+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:03:21.788783+0000","last_undegraded":"2024-04-25T22:03:21.788783+0000","last_fullsized":"2024-04-25T22:03:21.788783+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"67'172","reported_seq":233,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.530189+0000","last_change":"2024-04-25T22:02:49.887569+0000","last_active":"2024-04-25T22:03:23.530189+0000","last_peered":"2024-04-25T22:03:23.530189+0000","last_clean":"2024-04-25T22:03:23.530189+0000","last_became_active":"2024-04-25T22:02:49.886732+0000","last_became_peered":"2024-04-25T22:02:49.886732+0000","last_unstale":"2024-04-25T22:03:23.530189+0000","last_undegraded":"2024-04-25T22:03:23.530189+0000","last_fullsized":"2024-04-25T22:03:23.530189+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:38.761184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32819922,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":15,"num_read_kb":6059,"num_write":170,"num_write_kb":37972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"57'3","reported_seq":51,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.803026+0000","last_change":"2024-04-25T22:03:05.702244+0000","last_active":"2024-04-25T22:03:21.803026+0000","last_peered":"2024-04-25T22:03:21.803026+0000","last_clean":"2024-04-25T22:03:21.803026+0000","last_became_active":"2024-04-25T22:03:05.701350+0000","last_became_peered":"2024-04-25T22:03:05.701350+0000","last_unstale":"2024-04-25T22:03:21.803026+0000","last_undegraded":"2024-04-25T22:03:21.803026+0000","last_fullsized":"2024-04-25T22:03:21.803026+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:31:38.259386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"67'193","reported_seq":276,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.684885+0000","last_change":"2024-04-25T22:02:49.882913+0000","last_active":"2024-04-25T22:03:23.684885+0000","last_peered":"2024-04-25T22:03:23.684885+0000","last_clean":"2024-04-25T22:03:23.684885+0000","last_became_active":"2024-04-25T22:02:49.882175+0000","last_became_peered":"2024-04-25T22:02:49.882175+0000","last_unstale":"2024-04-25T22:03:23.684885+0000","last_undegraded":"2024-04-25T22:03:23.684885+0000","last_fullsized":"2024-04-25T22:03:23.684885+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:31.024577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24034717,"num_objects":164,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":164,"num_whiteouts":0,"num_read":37,"num_read_kb":19110,"num_write":188,"num_write_kb":63003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"53'4","reported_seq":48,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.795018+0000","last_change":"2024-04-25T22:02:49.886319+0000","last_active":"2024-04-25T22:03:21.795018+0000","last_peered":"2024-04-25T22:03:21.795018+0000","last_clean":"2024-04-25T22:03:21.795018+0000","last_became_active":"2024-04-25T22:02:49.884039+0000","last_became_peered":"2024-04-25T22:02:49.884039+0000","last_unstale":"2024-04-25T22:03:21.795018+0000","last_undegraded":"2024-04-25T22:03:21.795018+0000","last_fullsized":"2024-04-25T22:03:21.795018+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:11.405616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"67'191","reported_seq":261,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.002012+0000","last_change":"2024-04-25T22:02:43.850869+0000","last_active":"2024-04-25T22:03:23.002012+0000","last_peered":"2024-04-25T22:03:23.002012+0000","last_clean":"2024-04-25T22:03:23.002012+0000","last_became_active":"2024-04-25T22:02:43.850568+0000","last_became_peered":"2024-04-25T22:02:43.850568+0000","last_unstale":"2024-04-25T22:03:23.002012+0000","last_undegraded":"2024-04-25T22:03:23.002012+0000","last_fullsized":"2024-04-25T22:03:23.002012+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:10:32.881419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22465585,"num_objects":169,"num_object_clones":0,"num_object_copies":338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":169,"num_whiteouts":0,"num_read":18,"num_read_kb":9341,"num_write":190,"num_write_kb":50765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"66'3","reported_seq":63,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.797582+0000","last_change":"2024-04-25T22:02:43.853253+0000","last_active":"2024-04-25T22:03:21.797582+0000","last_peered":"2024-04-25T22:03:21.797582+0000","last_clean":"2024-04-25T22:03:21.797582+0000","last_became_active":"2024-04-25T22:02:43.852769+0000","last_became_peered":"2024-04-25T22:02:43.852769+0000","last_unstale":"2024-04-25T22:03:21.797582+0000","last_undegraded":"2024-04-25T22:03:21.797582+0000","last_fullsized":"2024-04-25T22:03:21.797582+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:51:36.457092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"67'192","reported_seq":270,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.126821+0000","last_change":"2024-04-25T22:02:43.852778+0000","last_active":"2024-04-25T22:03:23.126821+0000","last_peered":"2024-04-25T22:03:23.126821+0000","last_clean":"2024-04-25T22:03:23.126821+0000","last_became_active":"2024-04-25T22:02:43.852263+0000","last_became_peered":"2024-04-25T22:02:43.852263+0000","last_unstale":"2024-04-25T22:03:23.126821+0000","last_undegraded":"2024-04-25T22:03:23.126821+0000","last_fullsized":"2024-04-25T22:03:23.126821+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:10:40.487543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25922822,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":26,"num_read_kb":13280,"num_write":189,"num_write_kb":45925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"67'100","reported_seq":154,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.795483+0000","last_change":"2024-04-25T22:02:49.887527+0000","last_active":"2024-04-25T22:03:21.795483+0000","last_peered":"2024-04-25T22:03:21.795483+0000","last_clean":"2024-04-25T22:03:21.795483+0000","last_became_active":"2024-04-25T22:02:49.886150+0000","last_became_peered":"2024-04-25T22:02:49.886150+0000","last_unstale":"2024-04-25T22:03:21.795483+0000","last_undegraded":"2024-04-25T22:03:21.795483+0000","last_fullsized":"2024-04-25T22:03:21.795483+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:23:43.687342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":8239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"67'198","reported_seq":254,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:22.968297+0000","last_change":"2024-04-25T22:02:49.876491+0000","last_active":"2024-04-25T22:03:22.968297+0000","last_peered":"2024-04-25T22:03:22.968297+0000","last_clean":"2024-04-25T22:03:22.968297+0000","last_became_active":"2024-04-25T22:02:49.876169+0000","last_became_peered":"2024-04-25T22:02:49.876169+0000","last_unstale":"2024-04-25T22:03:22.968297+0000","last_undegraded":"2024-04-25T22:03:22.968297+0000","last_fullsized":"2024-04-25T22:03:22.968297+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:56:41.591010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19180486,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":10,"num_read_kb":1478,"num_write":195,"num_write_kb":30326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"59'56","reported_seq":169,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.794082+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:03:21.794082+0000","last_peered":"2024-04-25T22:03:21.794082+0000","last_clean":"2024-04-25T22:03:21.794082+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:03:21.794082+0000","last_undegraded":"2024-04-25T22:03:21.794082+0000","last_fullsized":"2024-04-25T22:03:21.794082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"67'214","reported_seq":374,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:23.702546+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:03:23.702546+0000","last_peered":"2024-04-25T22:03:23.702546+0000","last_clean":"2024-04-25T22:03:23.702546+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:03:23.702546+0000","last_undegraded":"2024-04-25T22:03:23.702546+0000","last_fullsized":"2024-04-25T22:03:23.702546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30293942,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":51,"num_read_kb":31576,"num_write":213,"num_write_kb":66743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"66'7","reported_seq":120,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T22:03:21.791841+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:03:21.791841+0000","last_peered":"2024-04-25T22:03:21.791841+0000","last_clean":"2024-04-25T22:03:21.791841+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:03:21.791841+0000","last_undegraded":"2024-04-25T22:03:21.791841+0000","last_fullsized":"2024-04-25T22:03:21.791841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":2080836764,"num_objects":11334,"num_object_clones":0,"num_object_copies":22668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11334,"num_whiteouts":0,"num_read":2468,"num_read_kb":1234000,"num_write":12993,"num_write_kb":3953122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":385490944,"data_stored":3851803313,"data_compressed":21819646,"data_compressed_allocated":256000000,"data_compressed_original":3777184962,"omap_allocated":0,"internal_metadata":0},"log_size":13100,"ondisk_log_size":13100,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":65695429,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":11,"num_read_kb":21,"num_write":2372,"num_write_kb":66272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34369536,"data_stored":131294768,"data_compressed":10779267,"data_compressed_allocated":16982016,"data_compressed_original":113971200,"omap_allocated":0,"internal_metadata":0},"log_size":2351,"ondisk_log_size":2351,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738402,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192344,"kb_used_data":138960,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94179496,"statfs":{"total":96636764160,"available":96439803904,"internally_reserved":0,"allocated":142295040,"data_stored":1319797970,"data_compressed":10311810,"data_compressed_allocated":89616384,"data_compressed_original":1285331136,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738401,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187272,"kb_used_data":133880,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94184568,"statfs":{"total":96636764160,"available":96444997632,"internally_reserved":0,"allocated":137093120,"data_stored":1266907116,"data_compressed":11050688,"data_compressed_allocated":87732224,"data_compressed_original":1237257874,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738402,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":176024,"kb_used_data":122640,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94195816,"statfs":{"total":96636764160,"available":96456515584,"internally_reserved":0,"allocated":125583360,"data_stored":1151555003,"data_compressed":10757523,"data_compressed_allocated":80027648,"data_compressed_original":1123767350,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,1,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10338304,"data_stored":44728050,"data_compressed":3740902,"data_compressed_allocated":5758976,"data_compressed_original":40181760,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11116544,"data_stored":37762583,"data_compressed":3056146,"data_compressed_allocated":4923392,"data_compressed_original":31580160,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12914688,"data_stored":48804135,"data_compressed":3982219,"data_compressed_allocated":6299648,"data_compressed_original":42209280,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":119361536,"data_stored":1171475187,"data_compressed":7179507,"data_compressed_allocated":78422016,"data_compressed_original":1148016286,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":134483968,"data_stored":1370264276,"data_compressed":8202865,"data_compressed_allocated":91717632,"data_compressed_original":1346972234,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":131645440,"data_stored":1310063850,"data_compressed":6437274,"data_compressed_allocated":85860352,"data_compressed_original":1282196442,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:03:26.737 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:26.732+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:26.767 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:26.767 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:26.784 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:26.814 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:03:26.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:26.833+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:26.937 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:03:26.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:26.933+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:26.954 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:26.955 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:26.969 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:27.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:27.037+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:27.086 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:27.087 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:27.099 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:27.099 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:03:27.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:03:27.099 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T22:03:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.111239613999999, 2024-04-25T22:03:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.180276931, 2024-04-25T22:03:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4 2024-04-25T22:03:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983834+0000", 2024-04-25T22:03:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2900000000000001e-06 2024-04-25T22:03:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991787+0000", 2024-04-25T22:03:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079521690000000003 2024-04-25T22:03:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991826+0000", 2024-04-25T22:03:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9258999999999998e-05 2024-04-25T22:03:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991845+0000", 2024-04-25T22:03:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9360000000000001e-05 2024-04-25T22:03:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992058+0000", 2024-04-25T22:03:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212559 2024-04-25T22:03:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992213+0000", 2024-04-25T22:03:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015520700000000001 2024-04-25T22:03:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992414+0000", 2024-04-25T22:03:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020049 2024-04-25T22:03:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162511+0000", 2024-04-25T22:03:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.17009782900000001 2024-04-25T22:03:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163967+0000", 2024-04-25T22:03:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001455752 2024-04-25T22:03:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164045+0000", 2024-04-25T22:03:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7415000000000003e-05 2024-04-25T22:03:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164109+0000", 2024-04-25T22:03:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4601e-05 2024-04-25T22:03:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6847 4.16 4:68767fd1:::10000001f4f.00000000:head [write 0~7212] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.401600153, 2024-04-25T22:03:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0208302119999999, 2024-04-25T22:03:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6847 2024-04-25T22:03:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693473+0000", 2024-04-25T22:03:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.75e-06 2024-04-25T22:03:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693490+0000", 2024-04-25T22:03:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6540000000000001e-05 2024-04-25T22:03:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693509+0000", 2024-04-25T22:03:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9536999999999999e-05 2024-04-25T22:03:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693522+0000", 2024-04-25T22:03:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2099000000000001e-05 2024-04-25T22:03:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693677+0000", 2024-04-25T22:03:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015516799999999999 2024-04-25T22:03:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693705+0000", 2024-04-25T22:03:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8663e-05 2024-04-25T22:03:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705551+0000", 2024-04-25T22:03:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.011845495 2024-04-25T22:03:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705942+0000", 2024-04-25T22:03:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00039080099999999997 2024-04-25T22:03:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.706151+0000", 2024-04-25T22:03:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000209457 2024-04-25T22:03:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711141+0000", 2024-04-25T22:03:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049901240000000003 2024-04-25T22:03:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714005+0000", 2024-04-25T22:03:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028642229999999999 2024-04-25T22:03:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714180+0000", 2024-04-25T22:03:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017433699999999999 2024-04-25T22:03:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714302+0000", 2024-04-25T22:03:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122018 2024-04-25T22:03:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6960 4.16 4:6823d322:::10000001fd2.00000000:head [write 0~150] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.124596055000001, 2024-04-25T22:03:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.74417278899999995, 2024-04-25T22:03:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6960 2024-04-25T22:03:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970478+0000", 2024-04-25T22:03:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.939e-06 2024-04-25T22:03:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970488+0000", 2024-04-25T22:03:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9699999999999994e-06 2024-04-25T22:03:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970524+0000", 2024-04-25T22:03:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5963000000000001e-05 2024-04-25T22:03:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970537+0000", 2024-04-25T22:03:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.31e-05 2024-04-25T22:03:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970701+0000", 2024-04-25T22:03:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164177 2024-04-25T22:03:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970718+0000", 2024-04-25T22:03:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7323e-05 2024-04-25T22:03:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707632+0000", 2024-04-25T22:03:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.73691394300000002 2024-04-25T22:03:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707924+0000", 2024-04-25T22:03:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029223299999999998 2024-04-25T22:03:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.708389+0000", 2024-04-25T22:03:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046429300000000001 2024-04-25T22:03:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029039830000000002 2024-04-25T22:03:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714409+0000", 2024-04-25T22:03:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031159260000000002 2024-04-25T22:03:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714538+0000", 2024-04-25T22:03:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012952100000000001 2024-04-25T22:03:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714649+0000", 2024-04-25T22:03:27.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110418 2024-04-25T22:03:27.118 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.118 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.118 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.118 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7039 4.16 4:6919637e:::10000002032.00000000:head [write 0~2968] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:27.118 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:27.118 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.938549550000001, 2024-04-25T22:03:27.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.56024932199999999, 2024-04-25T22:03:27.118 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.119 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.119 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.119 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:27.119 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:27.119 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.119 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7039 2024-04-25T22:03:27.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.119 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:27.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:27.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156523+0000", 2024-04-25T22:03:27.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2130000000000001e-06 2024-04-25T22:03:27.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156530+0000", 2024-04-25T22:03:27.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9090000000000003e-06 2024-04-25T22:03:27.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156544+0000", 2024-04-25T22:03:27.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3271999999999999e-05 2024-04-25T22:03:27.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156551+0000", 2024-04-25T22:03:27.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4970000000000004e-06 2024-04-25T22:03:27.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156639+0000", 2024-04-25T22:03:27.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7638000000000004e-05 2024-04-25T22:03:27.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:27.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156649+0000", 2024-04-25T22:03:27.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0536e-05 2024-04-25T22:03:27.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709515+0000", 2024-04-25T22:03:27.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.55286568999999997 2024-04-25T22:03:27.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709836+0000", 2024-04-25T22:03:27.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032078899999999998 2024-04-25T22:03:27.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:27.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.710271+0000", 2024-04-25T22:03:27.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043530000000000001 2024-04-25T22:03:27.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716576+0000", 2024-04-25T22:03:27.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063045050000000002 2024-04-25T22:03:27.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716605+0000", 2024-04-25T22:03:27.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8949e-05 2024-04-25T22:03:27.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716706+0000", 2024-04-25T22:03:27.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101765 2024-04-25T22:03:27.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716772+0000", 2024-04-25T22:03:27.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5259000000000007e-05 2024-04-25T22:03:27.124 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.124 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.125 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.125 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7065 4.16 4:697a9f10:::10000002050.00000000:head [write 0~16297] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:27.125 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:27.125 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.880933601999999, 2024-04-25T22:03:27.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.50307290800000004, 2024-04-25T22:03:27.125 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.125 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.125 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.125 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:27.125 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:27.125 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.125 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7065 2024-04-25T22:03:27.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.126 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:27.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:27.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214139+0000", 2024-04-25T22:03:27.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.186e-06 2024-04-25T22:03:27.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214170+0000", 2024-04-25T22:03:27.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0419000000000001e-05 2024-04-25T22:03:27.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214186+0000", 2024-04-25T22:03:27.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6526000000000001e-05 2024-04-25T22:03:27.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214194+0000", 2024-04-25T22:03:27.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6769999999999995e-06 2024-04-25T22:03:27.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214380+0000", 2024-04-25T22:03:27.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018580699999999999 2024-04-25T22:03:27.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:27.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214399+0000", 2024-04-25T22:03:27.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9446e-05 2024-04-25T22:03:27.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711402+0000", 2024-04-25T22:03:27.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.497002901 2024-04-25T22:03:27.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711822+0000", 2024-04-25T22:03:27.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00041989399999999997 2024-04-25T22:03:27.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:27.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.712017+0000", 2024-04-25T22:03:27.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019540700000000001 2024-04-25T22:03:27.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716792+0000", 2024-04-25T22:03:27.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047748210000000003 2024-04-25T22:03:27.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716937+0000", 2024-04-25T22:03:27.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014479099999999999 2024-04-25T22:03:27.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717081+0000", 2024-04-25T22:03:27.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014412100000000001 2024-04-25T22:03:27.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717211+0000", 2024-04-25T22:03:27.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012991200000000001 2024-04-25T22:03:27.131 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.131 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.131 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.131 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7089 4.16 4:6868fcac:::1000000206b.00000000:head [write 0~5386] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:27.131 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:27.131 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.821379608000001, 2024-04-25T22:03:27.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44658810700000001, 2024-04-25T22:03:27.131 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.132 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.132 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.132 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:27.132 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:27.132 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.132 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7089 2024-04-25T22:03:27.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.132 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:27.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:27.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273695+0000", 2024-04-25T22:03:27.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.463e-06 2024-04-25T22:03:27.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273712+0000", 2024-04-25T22:03:27.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7842999999999998e-05 2024-04-25T22:03:27.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273742+0000", 2024-04-25T22:03:27.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9039000000000001e-05 2024-04-25T22:03:27.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273756+0000", 2024-04-25T22:03:27.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4406999999999999e-05 2024-04-25T22:03:27.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273943+0000", 2024-04-25T22:03:27.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018708 2024-04-25T22:03:27.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:27.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273961+0000", 2024-04-25T22:03:27.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7977000000000001e-05 2024-04-25T22:03:27.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714748+0000", 2024-04-25T22:03:27.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.440786605 2024-04-25T22:03:27.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715013+0000", 2024-04-25T22:03:27.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026558300000000001 2024-04-25T22:03:27.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:27.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715309+0000", 2024-04-25T22:03:27.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000295715 2024-04-25T22:03:27.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.719035+0000", 2024-04-25T22:03:27.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037256310000000001 2024-04-25T22:03:27.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720142+0000", 2024-04-25T22:03:27.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001107053 2024-04-25T22:03:27.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720221+0000", 2024-04-25T22:03:27.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9832000000000004e-05 2024-04-25T22:03:27.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720280+0000", 2024-04-25T22:03:27.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8879000000000003e-05 2024-04-25T22:03:27.137 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.137 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.137 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.138 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7090 4.16 4:69dc3034:::1000000206c.00000000:head [write 0~957] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:27.138 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:27.138 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.818755278000001, 2024-04-25T22:03:27.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44572077100000002, 2024-04-25T22:03:27.138 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.138 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.138 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.138 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:27.138 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:27.138 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.138 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7090 2024-04-25T22:03:27.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.139 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:27.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:27.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276319+0000", 2024-04-25T22:03:27.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3429999999999998e-06 2024-04-25T22:03:27.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276330+0000", 2024-04-25T22:03:27.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1567e-05 2024-04-25T22:03:27.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276362+0000", 2024-04-25T22:03:27.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1863000000000003e-05 2024-04-25T22:03:27.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276377+0000", 2024-04-25T22:03:27.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5102999999999999e-05 2024-04-25T22:03:27.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276564+0000", 2024-04-25T22:03:27.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018629700000000001 2024-04-25T22:03:27.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:27.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276583+0000", 2024-04-25T22:03:27.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9743000000000001e-05 2024-04-25T22:03:27.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717354+0000", 2024-04-25T22:03:27.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44077094900000002 2024-04-25T22:03:27.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717723+0000", 2024-04-25T22:03:27.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036839099999999998 2024-04-25T22:03:27.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:27.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.718097+0000", 2024-04-25T22:03:27.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037392099999999999 2024-04-25T22:03:27.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720305+0000", 2024-04-25T22:03:27.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022084439999999999 2024-04-25T22:03:27.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721866+0000", 2024-04-25T22:03:27.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015610260000000001 2024-04-25T22:03:27.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721944+0000", 2024-04-25T22:03:27.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7961999999999997e-05 2024-04-25T22:03:27.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.722037+0000", 2024-04-25T22:03:27.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3162e-05 2024-04-25T22:03:27.144 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.144 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.144 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.144 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:10647 4.35 4:ae7b229b:::100000030a9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:27.144 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:27.144 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.565710584, 2024-04-25T22:03:27.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14506126, 2024-04-25T22:03:27.145 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.145 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.145 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.145 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:27.145 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:27.145 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.145 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10647 2024-04-25T22:03:27.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.145 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:27.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:27.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529364+0000", 2024-04-25T22:03:27.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.286e-06 2024-04-25T22:03:27.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538917+0000", 2024-04-25T22:03:27.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0095530010000000002 2024-04-25T22:03:27.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538955+0000", 2024-04-25T22:03:27.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:03:27.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538977+0000", 2024-04-25T22:03:27.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.105e-05 2024-04-25T22:03:27.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568092+0000", 2024-04-25T22:03:27.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029115604999999999 2024-04-25T22:03:27.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568243+0000", 2024-04-25T22:03:27.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000151044 2024-04-25T22:03:27.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:27.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568498+0000", 2024-04-25T22:03:27.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025517399999999999 2024-04-25T22:03:27.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628005+0000", 2024-04-25T22:03:27.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059506991000000002 2024-04-25T22:03:27.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674273+0000", 2024-04-25T22:03:27.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.046267233999999997 2024-04-25T22:03:27.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674357+0000", 2024-04-25T22:03:27.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4745000000000003e-05 2024-04-25T22:03:27.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674422+0000", 2024-04-25T22:03:27.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5160999999999995e-05 2024-04-25T22:03:27.150 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.150 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.150 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.150 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3891938~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:27.150 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:27.150 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.4123909980000002, 2024-04-25T22:03:27.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.144195727, 2024-04-25T22:03:27.150 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.151 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.151 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.151 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:27.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:27.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682682+0000", 2024-04-25T22:03:27.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6000000000000003e-07 2024-04-25T22:03:27.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682686+0000", 2024-04-25T22:03:27.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4630000000000003e-06 2024-04-25T22:03:27.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682695+0000", 2024-04-25T22:03:27.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7360000000000007e-06 2024-04-25T22:03:27.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682702+0000", 2024-04-25T22:03:27.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1239999999999999e-06 2024-04-25T22:03:27.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821515+0000", 2024-04-25T22:03:27.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13881310499999999 2024-04-25T22:03:27.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821780+0000", 2024-04-25T22:03:27.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026492699999999998 2024-04-25T22:03:27.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821974+0000", 2024-04-25T22:03:27.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000194561 2024-04-25T22:03:27.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826533+0000", 2024-04-25T22:03:27.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045586649999999999 2024-04-25T22:03:27.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826574+0000", 2024-04-25T22:03:27.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0995999999999998e-05 2024-04-25T22:03:27.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826754+0000", 2024-04-25T22:03:27.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017955400000000001 2024-04-25T22:03:27.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826877+0000", 2024-04-25T22:03:27.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122836 2024-04-25T22:03:27.155 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.155 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.155 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.156 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3893337~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:27.156 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:27.156 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.4123611650000001, 2024-04-25T22:03:27.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.146040321, 2024-04-25T22:03:27.156 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.156 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.156 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.156 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:27.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:27.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:27.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:03:27.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682716+0000", 2024-04-25T22:03:27.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3930000000000001e-06 2024-04-25T22:03:27.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682724+0000", 2024-04-25T22:03:27.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5769999999999994e-06 2024-04-25T22:03:27.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682731+0000", 2024-04-25T22:03:27.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1629999999999999e-06 2024-04-25T22:03:27.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823295+0000", 2024-04-25T22:03:27.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14056342099999999 2024-04-25T22:03:27.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823578+0000", 2024-04-25T22:03:27.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028355299999999997 2024-04-25T22:03:27.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823777+0000", 2024-04-25T22:03:27.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000198791 2024-04-25T22:03:27.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826993+0000", 2024-04-25T22:03:27.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032162169999999999 2024-04-25T22:03:27.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828492+0000", 2024-04-25T22:03:27.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001498283 2024-04-25T22:03:27.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828633+0000", 2024-04-25T22:03:27.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000141225 2024-04-25T22:03:27.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828751+0000", 2024-04-25T22:03:27.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000118038 2024-04-25T22:03:27.161 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.161 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.161 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.161 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3899493~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:27.161 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:27.161 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.4027671509999999, 2024-04-25T22:03:27.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14539154500000001, 2024-04-25T22:03:27.161 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.161 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.161 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.162 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:27.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:27.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692307+0000", 2024-04-25T22:03:27.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.216e-06 2024-04-25T22:03:27.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692316+0000", 2024-04-25T22:03:27.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:03:27.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692357+0000", 2024-04-25T22:03:27.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233000000000003e-05 2024-04-25T22:03:27.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692375+0000", 2024-04-25T22:03:27.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7949999999999999e-05 2024-04-25T22:03:27.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828922+0000", 2024-04-25T22:03:27.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.136546426 2024-04-25T22:03:27.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.829064+0000", 2024-04-25T22:03:27.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014193499999999999 2024-04-25T22:03:27.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.829295+0000", 2024-04-25T22:03:27.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023144100000000001 2024-04-25T22:03:27.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832412+0000", 2024-04-25T22:03:27.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003117112 2024-04-25T22:03:27.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837543+0000", 2024-04-25T22:03:27.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005131147 2024-04-25T22:03:27.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837629+0000", 2024-04-25T22:03:27.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5378999999999997e-05 2024-04-25T22:03:27.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837696+0000", 2024-04-25T22:03:27.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7426000000000001e-05 2024-04-25T22:03:27.166 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.166 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.166 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.166 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3901402~4724 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:27.166 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:27.166 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.3992648499999998, 2024-04-25T22:03:27.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14672065500000001, 2024-04-25T22:03:27.167 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.167 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.167 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.167 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:27.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:27.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695809+0000", 2024-04-25T22:03:27.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1100000000000001e-06 2024-04-25T22:03:27.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695828+0000", 2024-04-25T22:03:27.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8618999999999999e-05 2024-04-25T22:03:27.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695850+0000", 2024-04-25T22:03:27.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2243e-05 2024-04-25T22:03:27.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695864+0000", 2024-04-25T22:03:27.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3687e-05 2024-04-25T22:03:27.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831024+0000", 2024-04-25T22:03:27.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13516004300000001 2024-04-25T22:03:27.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831155+0000", 2024-04-25T22:03:27.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000131605 2024-04-25T22:03:27.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831353+0000", 2024-04-25T22:03:27.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000197708 2024-04-25T22:03:27.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837521+0000", 2024-04-25T22:03:27.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0061684180000000002 2024-04-25T22:03:27.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842269+0000", 2024-04-25T22:03:27.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047475659999999999 2024-04-25T22:03:27.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842402+0000", 2024-04-25T22:03:27.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000132643 2024-04-25T22:03:27.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842528+0000", 2024-04-25T22:03:27.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012601299999999999 2024-04-25T22:03:27.171 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.171 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.171 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.172 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3906126~6707 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:27.172 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:27.172 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.396003093, 2024-04-25T22:03:27.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14563398599999999, 2024-04-25T22:03:27.172 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.172 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.172 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.172 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:27.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:27.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699071+0000", 2024-04-25T22:03:27.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.996e-06 2024-04-25T22:03:27.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699090+0000", 2024-04-25T22:03:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9449999999999998e-05 2024-04-25T22:03:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699112+0000", 2024-04-25T22:03:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2306e-05 2024-04-25T22:03:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699126+0000", 2024-04-25T22:03:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.383e-05 2024-04-25T22:03:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832497+0000", 2024-04-25T22:03:27.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13337096500000001 2024-04-25T22:03:27.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832632+0000", 2024-04-25T22:03:27.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013481499999999999 2024-04-25T22:03:27.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832828+0000", 2024-04-25T22:03:27.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000195558 2024-04-25T22:03:27.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837801+0000", 2024-04-25T22:03:27.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049729459999999998 2024-04-25T22:03:27.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844398+0000", 2024-04-25T22:03:27.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065972829999999998 2024-04-25T22:03:27.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844594+0000", 2024-04-25T22:03:27.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000195675 2024-04-25T22:03:27.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844703+0000", 2024-04-25T22:03:27.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109162 2024-04-25T22:03:27.177 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.177 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.177 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.177 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3024 3.d 3:b02ffd62:::200.00000010:head [write 3912833~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:27.177 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:27.177 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.39293837, 2024-04-25T22:03:27.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14279916000000001, 2024-04-25T22:03:27.177 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.177 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.178 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.178 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:27.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:27.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702135+0000", 2024-04-25T22:03:27.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9530000000000002e-06 2024-04-25T22:03:27.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702154+0000", 2024-04-25T22:03:27.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8496e-05 2024-04-25T22:03:27.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702180+0000", 2024-04-25T22:03:27.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6313e-05 2024-04-25T22:03:27.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702205+0000", 2024-04-25T22:03:27.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.478e-05 2024-04-25T22:03:27.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836035+0000", 2024-04-25T22:03:27.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.133830269 2024-04-25T22:03:27.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836168+0000", 2024-04-25T22:03:27.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013234799999999999 2024-04-25T22:03:27.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836364+0000", 2024-04-25T22:03:27.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000196398 2024-04-25T22:03:27.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844793+0000", 2024-04-25T22:03:27.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.008428685 2024-04-25T22:03:27.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844811+0000", 2024-04-25T22:03:27.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8719000000000002e-05 2024-04-25T22:03:27.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844881+0000", 2024-04-25T22:03:27.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9671000000000004e-05 2024-04-25T22:03:27.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844933+0000", 2024-04-25T22:03:27.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1527999999999999e-05 2024-04-25T22:03:27.182 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.182 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.182 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.182 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3026 3.d 3:b02ffd62:::200.00000010:head [write 3919976~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:27.183 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:27.183 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.3862534320000002, 2024-04-25T22:03:27.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14237590899999999, 2024-04-25T22:03:27.183 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.183 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.183 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.183 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:27.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:27.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708820+0000", 2024-04-25T22:03:27.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7600000000000001e-06 2024-04-25T22:03:27.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708832+0000", 2024-04-25T22:03:27.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1803e-05 2024-04-25T22:03:27.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708854+0000", 2024-04-25T22:03:27.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2467e-05 2024-04-25T22:03:27.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708872+0000", 2024-04-25T22:03:27.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7453e-05 2024-04-25T22:03:27.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842641+0000", 2024-04-25T22:03:27.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13376964099999999 2024-04-25T22:03:27.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842832+0000", 2024-04-25T22:03:27.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000190843 2024-04-25T22:03:27.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.843194+0000", 2024-04-25T22:03:27.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036169300000000001 2024-04-25T22:03:27.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845406+0000", 2024-04-25T22:03:27.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022118530000000002 2024-04-25T22:03:27.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851048+0000", 2024-04-25T22:03:27.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056423410000000004 2024-04-25T22:03:27.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851127+0000", 2024-04-25T22:03:27.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8461999999999995e-05 2024-04-25T22:03:27.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851194+0000", 2024-04-25T22:03:27.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7593000000000001e-05 2024-04-25T22:03:27.187 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.187 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.187 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.188 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3027 3.d 3:b02ffd62:::200.00000010:head [write 3922740~2927 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:27.188 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:27.188 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.3861481530000002, 2024-04-25T22:03:27.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14516088799999999, 2024-04-25T22:03:27.188 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.188 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.188 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.188 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:27.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:27.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708925+0000", 2024-04-25T22:03:27.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.683e-06 2024-04-25T22:03:27.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708936+0000", 2024-04-25T22:03:27.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.11e-05 2024-04-25T22:03:27.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708960+0000", 2024-04-25T22:03:27.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3839999999999999e-05 2024-04-25T22:03:27.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708977+0000", 2024-04-25T22:03:27.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6379e-05 2024-04-25T22:03:27.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845488+0000", 2024-04-25T22:03:27.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.136511414 2024-04-25T22:03:27.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845619+0000", 2024-04-25T22:03:27.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000130755 2024-04-25T22:03:27.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845817+0000", 2024-04-25T22:03:27.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000198271 2024-04-25T22:03:27.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849529+0000", 2024-04-25T22:03:27.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003711888 2024-04-25T22:03:27.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.853911+0000", 2024-04-25T22:03:27.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043815800000000004 2024-04-25T22:03:27.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854018+0000", 2024-04-25T22:03:27.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000107879 2024-04-25T22:03:27.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854085+0000", 2024-04-25T22:03:27.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6099000000000005e-05 2024-04-25T22:03:27.193 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.193 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.193 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.193 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3028 3.d 3:b02ffd62:::200.00000010:head [write 3925667~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:27.193 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:27.193 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.3856276090000001, 2024-04-25T22:03:27.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14478423600000001, 2024-04-25T22:03:27.193 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.193 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.194 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.194 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:27.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:27.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709446+0000", 2024-04-25T22:03:27.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.73e-06 2024-04-25T22:03:27.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709454+0000", 2024-04-25T22:03:27.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:03:27.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709470+0000", 2024-04-25T22:03:27.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5956000000000001e-05 2024-04-25T22:03:27.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709483+0000", 2024-04-25T22:03:27.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.216e-05 2024-04-25T22:03:27.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.846891+0000", 2024-04-25T22:03:27.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13740814600000001 2024-04-25T22:03:27.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.847019+0000", 2024-04-25T22:03:27.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000128121 2024-04-25T22:03:27.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.847227+0000", 2024-04-25T22:03:27.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020847800000000001 2024-04-25T22:03:27.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.852488+0000", 2024-04-25T22:03:27.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052603759999999998 2024-04-25T22:03:27.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854101+0000", 2024-04-25T22:03:27.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001613354 2024-04-25T22:03:27.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854170+0000", 2024-04-25T22:03:27.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8935000000000003e-05 2024-04-25T22:03:27.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854228+0000", 2024-04-25T22:03:27.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8437000000000003e-05 2024-04-25T22:03:27.198 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.199 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.199 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.199 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3029 3.d 3:b02ffd62:::200.00000010:head [write 3927576~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:27.199 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:27.199 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.3855497469999998, 2024-04-25T22:03:27.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14641235599999999, 2024-04-25T22:03:27.199 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.199 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.199 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.199 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:27.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:27.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709523+0000", 2024-04-25T22:03:27.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9999999999999995e-07 2024-04-25T22:03:27.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709530+0000", 2024-04-25T22:03:27.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7900000000000002e-06 2024-04-25T22:03:27.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709545+0000", 2024-04-25T22:03:27.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5563e-05 2024-04-25T22:03:27.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709554+0000", 2024-04-25T22:03:27.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7700000000000007e-06 2024-04-25T22:03:27.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848071+0000", 2024-04-25T22:03:27.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13851706499999999 2024-04-25T22:03:27.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848219+0000", 2024-04-25T22:03:27.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014761599999999999 2024-04-25T22:03:27.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848412+0000", 2024-04-25T22:03:27.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019303300000000001 2024-04-25T22:03:27.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854240+0000", 2024-04-25T22:03:27.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058282359999999997 2024-04-25T22:03:27.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855804+0000", 2024-04-25T22:03:27.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001563938 2024-04-25T22:03:27.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855879+0000", 2024-04-25T22:03:27.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4683000000000003e-05 2024-04-25T22:03:27.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855934+0000", 2024-04-25T22:03:27.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5661999999999997e-05 2024-04-25T22:03:27.204 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.204 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.204 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.204 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3030 3.d 3:b02ffd62:::200.00000010:head [write 3929994~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:27.204 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:27.204 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.384131338, 2024-04-25T22:03:27.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.146870588, 2024-04-25T22:03:27.205 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.205 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.205 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.205 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:27.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:27.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710942+0000", 2024-04-25T22:03:27.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.024e-06 2024-04-25T22:03:27.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710955+0000", 2024-04-25T22:03:27.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2103000000000001e-05 2024-04-25T22:03:27.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710977+0000", 2024-04-25T22:03:27.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2606e-05 2024-04-25T22:03:27.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710991+0000", 2024-04-25T22:03:27.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3689999999999999e-05 2024-04-25T22:03:27.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849638+0000", 2024-04-25T22:03:27.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.138646667 2024-04-25T22:03:27.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849809+0000", 2024-04-25T22:03:27.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000171495 2024-04-25T22:03:27.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.850048+0000", 2024-04-25T22:03:27.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023940699999999999 2024-04-25T22:03:27.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855954+0000", 2024-04-25T22:03:27.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059050919999999998 2024-04-25T22:03:27.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857670+0000", 2024-04-25T22:03:27.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017168489999999999 2024-04-25T22:03:27.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857747+0000", 2024-04-25T22:03:27.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6526000000000006e-05 2024-04-25T22:03:27.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857811+0000", 2024-04-25T22:03:27.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4128999999999995e-05 2024-04-25T22:03:27.209 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.209 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.209 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.210 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3031 3.d 3:b02ffd62:::200.00000010:head [write 3932758~2245 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:27.210 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:27.210 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.3839208900000002, 2024-04-25T22:03:27.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14694558999999999, 2024-04-25T22:03:27.210 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:27.210 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:27.210 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.210 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:27.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:27.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:27.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:27.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:27.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:27.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:27.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711152+0000", 2024-04-25T22:03:27.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5230000000000001e-06 2024-04-25T22:03:27.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:27.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711162+0000", 2024-04-25T22:03:27.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2299999999999997e-06 2024-04-25T22:03:27.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:27.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711179+0000", 2024-04-25T22:03:27.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7220000000000001e-05 2024-04-25T22:03:27.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711190+0000", 2024-04-25T22:03:27.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1323e-05 2024-04-25T22:03:27.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:27.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851296+0000", 2024-04-25T22:03:27.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14010541600000001 2024-04-25T22:03:27.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:27.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851436+0000", 2024-04-25T22:03:27.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140409 2024-04-25T22:03:27.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851641+0000", 2024-04-25T22:03:27.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020471700000000001 2024-04-25T22:03:27.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:27.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857847+0000", 2024-04-25T22:03:27.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062065310000000004 2024-04-25T22:03:27.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857952+0000", 2024-04-25T22:03:27.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105132 2024-04-25T22:03:27.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:27.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.858026+0000", 2024-04-25T22:03:27.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3799000000000003e-05 2024-04-25T22:03:27.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:27.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:27.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:27.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.858096+0000", 2024-04-25T22:03:27.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0290000000000006e-05 2024-04-25T22:03:27.214 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.214 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.214 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.214 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:27.214 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:27.215 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:27.218 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:27.219 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:27.219 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:27.220 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:27.221 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:27.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:27.213+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:27.320 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:27.316+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:27.355 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:27.356 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:27.356 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:03:27.356 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:27.370 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:27.422 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:27.416+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:27.494 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:27.494 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:27.494 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:03:27.494 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:03:27.494 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:27.509 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:27.524 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:27.520+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:27.624 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:27.620+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:27.646 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:27.646 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:27.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:27.646 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:27.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.646 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:27.646 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:27.646 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.556215919000003, 2024-04-25T22:03:27.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:27.646 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.647 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.647 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.647 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.647 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.647 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.647 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:27.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.647 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:27.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:27.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:27.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:27.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:27.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:27.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:27.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:27.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:27.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:27.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:27.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:27.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:27.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:27.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:27.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:27.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:27.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:27.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:27.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:27.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:27.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:27.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:27.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:27.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:27.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:27.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:27.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:27.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:27.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.652 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.653 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:27.653 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:27.653 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.546215156000002, 2024-04-25T22:03:27.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:27.653 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.653 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.653 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.653 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.653 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.653 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.653 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:27.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.653 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:27.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:27.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:27.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:27.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:27.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:27.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:27.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:27.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:27.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:27.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:27.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:27.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:27.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:27.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:27.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:27.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:27.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:27.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:27.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:27.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:27.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:27.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:27.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:27.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:27.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:27.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:27.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:27.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:27.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.659 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.659 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:27.659 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:27.659 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.542050881999998, 2024-04-25T22:03:27.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:27.659 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.659 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.659 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.660 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:27.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.660 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:27.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:27.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:27.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:27.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:27.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:27.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:27.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:27.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:27.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:27.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:27.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:27.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:27.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:27.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:27.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:27.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:27.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:27.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:27.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:27.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:27.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:27.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:27.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:27.664 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.664 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.665 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.665 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:27.665 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:27.665 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.540454564999997, 2024-04-25T22:03:27.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:27.665 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.665 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.665 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.665 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.665 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.665 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.665 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:27.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.665 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:27.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:27.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:27.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:27.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:27.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:27.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:27.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:27.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:27.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:27.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:27.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:27.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:27.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:27.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:27.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:27.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:27.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:27.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:27.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:27.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:27.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:27.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:27.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:27.670 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.670 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.670 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.670 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:27.670 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:27.670 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.483668315000003, 2024-04-25T22:03:27.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:27.671 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.671 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.671 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.671 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.671 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.671 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.671 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:27.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.671 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:27.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:27.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:27.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:27.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:27.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:27.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:27.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:27.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:27.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:27.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:27.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:27.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:27.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:27.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:27.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:27.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:27.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:27.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:27.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:27.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:27.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:27.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:27.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:27.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.676 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.676 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:27.676 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:27.676 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.468024049, 2024-04-25T22:03:27.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:27.676 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.676 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.677 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.677 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.677 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.677 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.677 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:27.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.677 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:27.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:27.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:27.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:27.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:27.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:27.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:27.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:27.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:27.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:27.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:27.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:27.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:27.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:27.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:27.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:27.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:27.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:27.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:27.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:27.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:27.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:27.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:27.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:27.682 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.682 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.682 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.682 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:27.682 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:27.682 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.463185357999997, 2024-04-25T22:03:27.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:27.682 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.682 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.682 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.682 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.683 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.683 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.683 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:27.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.683 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:27.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:27.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:27.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:27.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:27.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:27.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:27.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:27.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:27.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:27.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:27.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:27.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:27.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:27.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:27.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:27.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:27.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:27.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:27.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:27.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:27.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:27.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:27.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:27.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.688 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.688 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10648 4.33 4:cc614d18:::100000030cb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:27.688 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:27.688 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.104582046999999, 2024-04-25T22:03:27.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13001143300000001, 2024-04-25T22:03:27.688 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.688 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.688 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.689 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10648 2024-04-25T22:03:27.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.689 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:27.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:27.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537181+0000", 2024-04-25T22:03:27.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.782e-06 2024-04-25T22:03:27.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541681+0000", 2024-04-25T22:03:27.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045008460000000002 2024-04-25T22:03:27.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541692+0000", 2024-04-25T22:03:27.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0726e-05 2024-04-25T22:03:27.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541698+0000", 2024-04-25T22:03:27.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-04-25T22:03:27.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541771+0000", 2024-04-25T22:03:27.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3070000000000003e-05 2024-04-25T22:03:27.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542021+0000", 2024-04-25T22:03:27.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025059799999999999 2024-04-25T22:03:27.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542246+0000", 2024-04-25T22:03:27.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022471000000000001 2024-04-25T22:03:27.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.579359+0000", 2024-04-25T22:03:27.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037113211 2024-04-25T22:03:27.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667067+0000", 2024-04-25T22:03:27.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087707255999999997 2024-04-25T22:03:27.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667134+0000", 2024-04-25T22:03:27.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7862999999999997e-05 2024-04-25T22:03:27.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667190+0000", 2024-04-25T22:03:27.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5698000000000001e-05 2024-04-25T22:03:27.693 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.694 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.694 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.694 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10651 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:27.694 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:27.694 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.044806269, 2024-04-25T22:03:27.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11324606800000001, 2024-04-25T22:03:27.694 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.694 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.694 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.694 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.694 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.694 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.694 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10651 2024-04-25T22:03:27.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.695 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:27.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:27.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596957+0000", 2024-04-25T22:03:27.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-04-25T22:03:27.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601272+0000", 2024-04-25T22:03:27.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004314834 2024-04-25T22:03:27.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601291+0000", 2024-04-25T22:03:27.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9380000000000001e-05 2024-04-25T22:03:27.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601302+0000", 2024-04-25T22:03:27.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0416e-05 2024-04-25T22:03:27.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.603978+0000", 2024-04-25T22:03:27.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026763109999999998 2024-04-25T22:03:27.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604327+0000", 2024-04-25T22:03:27.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034881099999999998 2024-04-25T22:03:27.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:27.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604571+0000", 2024-04-25T22:03:27.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024436100000000001 2024-04-25T22:03:27.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644439+0000", 2024-04-25T22:03:27.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039868270999999997 2024-04-25T22:03:27.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710091+0000", 2024-04-25T22:03:27.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.065651910999999993 2024-04-25T22:03:27.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710144+0000", 2024-04-25T22:03:27.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2444999999999997e-05 2024-04-25T22:03:27.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710201+0000", 2024-04-25T22:03:27.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6839999999999998e-05 2024-04-25T22:03:27.699 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.699 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.699 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.700 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10654 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:27.700 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:27.700 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.034979406, 2024-04-25T22:03:27.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.103958778, 2024-04-25T22:03:27.700 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.700 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.700 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.700 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.700 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.700 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.700 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10654 2024-04-25T22:03:27.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.700 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:27.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:27.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606782+0000", 2024-04-25T22:03:27.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1699999999999999e-07 2024-04-25T22:03:27.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611155+0000", 2024-04-25T22:03:27.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043728580000000003 2024-04-25T22:03:27.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611173+0000", 2024-04-25T22:03:27.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8267e-05 2024-04-25T22:03:27.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611183+0000", 2024-04-25T22:03:27.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9250000000000007e-06 2024-04-25T22:03:27.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644642+0000", 2024-04-25T22:03:27.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033458976000000001 2024-04-25T22:03:27.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644739+0000", 2024-04-25T22:03:27.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7189999999999996e-05 2024-04-25T22:03:27.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:27.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644864+0000", 2024-04-25T22:03:27.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000124867 2024-04-25T22:03:27.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.672556+0000", 2024-04-25T22:03:27.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027691653 2024-04-25T22:03:27.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710668+0000", 2024-04-25T22:03:27.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038111956000000002 2024-04-25T22:03:27.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710703+0000", 2024-04-25T22:03:27.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5577000000000002e-05 2024-04-25T22:03:27.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710740+0000", 2024-04-25T22:03:27.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7092000000000003e-05 2024-04-25T22:03:27.705 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.705 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.705 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.705 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11078 4.4 4:22be2a9e:::10000003224.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:27.705 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:27.705 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.6378527849999998, 2024-04-25T22:03:27.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.112294177, 2024-04-25T22:03:27.705 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.705 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.706 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.706 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.706 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.706 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.706 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11078 2024-04-25T22:03:27.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.706 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:27.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:27.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003909+0000", 2024-04-25T22:03:27.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2750000000000001e-06 2024-04-25T22:03:27.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009939+0000", 2024-04-25T22:03:27.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060293309999999998 2024-04-25T22:03:27.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009961+0000", 2024-04-25T22:03:27.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1889999999999999e-05 2024-04-25T22:03:27.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009976+0000", 2024-04-25T22:03:27.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5642e-05 2024-04-25T22:03:27.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042803+0000", 2024-04-25T22:03:27.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032827299999999997 2024-04-25T22:03:27.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042911+0000", 2024-04-25T22:03:27.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107747 2024-04-25T22:03:27.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042990+0000", 2024-04-25T22:03:27.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8832999999999996e-05 2024-04-25T22:03:27.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.088710+0000", 2024-04-25T22:03:27.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045720129999999998 2024-04-25T22:03:27.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116108+0000", 2024-04-25T22:03:27.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027397388000000002 2024-04-25T22:03:27.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116164+0000", 2024-04-25T22:03:27.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6283000000000003e-05 2024-04-25T22:03:27.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116202+0000", 2024-04-25T22:03:27.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8358000000000001e-05 2024-04-25T22:03:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11195 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.4244906680000007, 2024-04-25T22:03:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1095062, 2024-04-25T22:03:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.711 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11195 2024-04-25T22:03:27.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.712 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:27.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:27.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217272+0000", 2024-04-25T22:03:27.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.533e-06 2024-04-25T22:03:27.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217385+0000", 2024-04-25T22:03:27.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113533 2024-04-25T22:03:27.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217396+0000", 2024-04-25T22:03:27.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0682e-05 2024-04-25T22:03:27.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217402+0000", 2024-04-25T22:03:27.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:03:27.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238476+0000", 2024-04-25T22:03:27.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021073312 2024-04-25T22:03:27.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238558+0000", 2024-04-25T22:03:27.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2193000000000004e-05 2024-04-25T22:03:27.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238695+0000", 2024-04-25T22:03:27.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013737800000000001 2024-04-25T22:03:27.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292860+0000", 2024-04-25T22:03:27.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054165224999999997 2024-04-25T22:03:27.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326638+0000", 2024-04-25T22:03:27.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033777517999999999 2024-04-25T22:03:27.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326686+0000", 2024-04-25T22:03:27.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8062000000000002e-05 2024-04-25T22:03:27.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326776+0000", 2024-04-25T22:03:27.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0393e-05 2024-04-25T22:03:27.716 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.716 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.716 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.716 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11197 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3195543~33670] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:27.716 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:27.717 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.4243486839999999, 2024-04-25T22:03:27.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953929499999999, 2024-04-25T22:03:27.717 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.717 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.717 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.717 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.717 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.717 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.717 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11197 2024-04-25T22:03:27.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.717 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:27.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:27.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217413+0000", 2024-04-25T22:03:27.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5600000000000005e-07 2024-04-25T22:03:27.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217445+0000", 2024-04-25T22:03:27.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2240999999999998e-05 2024-04-25T22:03:27.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217453+0000", 2024-04-25T22:03:27.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6070000000000002e-06 2024-04-25T22:03:27.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217458+0000", 2024-04-25T22:03:27.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3630000000000002e-06 2024-04-25T22:03:27.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240891+0000", 2024-04-25T22:03:27.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023432637999999999 2024-04-25T22:03:27.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240990+0000", 2024-04-25T22:03:27.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8995999999999999e-05 2024-04-25T22:03:27.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241123+0000", 2024-04-25T22:03:27.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013371699999999999 2024-04-25T22:03:27.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292866+0000", 2024-04-25T22:03:27.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051742332000000002 2024-04-25T22:03:27.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326849+0000", 2024-04-25T22:03:27.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033983140000000002 2024-04-25T22:03:27.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326908+0000", 2024-04-25T22:03:27.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8842999999999999e-05 2024-04-25T22:03:27.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326951+0000", 2024-04-25T22:03:27.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3761999999999999e-05 2024-04-25T22:03:27.721 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.722 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.722 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.722 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11198 4.4 4:22c4fea3:::10000003262.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:27.722 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:27.722 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.424294325, 2024-04-25T22:03:27.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12381273600000001, 2024-04-25T22:03:27.722 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.722 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.722 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.722 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.722 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.722 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11198 2024-04-25T22:03:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217467+0000", 2024-04-25T22:03:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4499999999999997e-07 2024-04-25T22:03:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225449+0000", 2024-04-25T22:03:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079819439999999995 2024-04-25T22:03:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225466+0000", 2024-04-25T22:03:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6602000000000001e-05 2024-04-25T22:03:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225477+0000", 2024-04-25T22:03:27.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1603000000000001e-05 2024-04-25T22:03:27.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240866+0000", 2024-04-25T22:03:27.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015388389000000001 2024-04-25T22:03:27.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241081+0000", 2024-04-25T22:03:27.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021577400000000001 2024-04-25T22:03:27.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241212+0000", 2024-04-25T22:03:27.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013073499999999999 2024-04-25T22:03:27.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292876+0000", 2024-04-25T22:03:27.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051663584999999998 2024-04-25T22:03:27.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341159+0000", 2024-04-25T22:03:27.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048283421999999999 2024-04-25T22:03:27.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341222+0000", 2024-04-25T22:03:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:03:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341279+0000", 2024-04-25T22:03:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6780999999999997e-05 2024-04-25T22:03:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.727 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11207 4.4 4:233f6309:::10000003211.00000000:head [write 659836~128648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.4076763280000009, 2024-04-25T22:03:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10732727, 2024-04-25T22:03:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11207 2024-04-25T22:03:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:27.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:27.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234085+0000", 2024-04-25T22:03:27.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0399999999999995e-07 2024-04-25T22:03:27.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234550+0000", 2024-04-25T22:03:27.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000464909 2024-04-25T22:03:27.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234561+0000", 2024-04-25T22:03:27.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0744000000000001e-05 2024-04-25T22:03:27.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234569+0000", 2024-04-25T22:03:27.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6890000000000004e-06 2024-04-25T22:03:27.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267197+0000", 2024-04-25T22:03:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032628182999999998 2024-04-25T22:03:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267297+0000", 2024-04-25T22:03:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100222 2024-04-25T22:03:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267393+0000", 2024-04-25T22:03:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6275999999999998e-05 2024-04-25T22:03:27.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292880+0000", 2024-04-25T22:03:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025487058999999999 2024-04-25T22:03:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341326+0000", 2024-04-25T22:03:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048446031000000001 2024-04-25T22:03:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341374+0000", 2024-04-25T22:03:27.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7632000000000001e-05 2024-04-25T22:03:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341412+0000", 2024-04-25T22:03:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7821000000000003e-05 2024-04-25T22:03:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11219 4.4 4:210cd53e:::100000031ff.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3887271180000003, 2024-04-25T22:03:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13181403, 2024-04-25T22:03:27.733 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11219 2024-04-25T22:03:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:27.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253035+0000", 2024-04-25T22:03:27.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.322e-06 2024-04-25T22:03:27.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258145+0000", 2024-04-25T22:03:27.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051095669999999998 2024-04-25T22:03:27.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258163+0000", 2024-04-25T22:03:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8377999999999999e-05 2024-04-25T22:03:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258174+0000", 2024-04-25T22:03:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0925e-05 2024-04-25T22:03:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270495+0000", 2024-04-25T22:03:27.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012321354 2024-04-25T22:03:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270581+0000", 2024-04-25T22:03:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5741999999999993e-05 2024-04-25T22:03:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270717+0000", 2024-04-25T22:03:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013571500000000001 2024-04-25T22:03:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326599+0000", 2024-04-25T22:03:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055882026000000001 2024-04-25T22:03:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384753+0000", 2024-04-25T22:03:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058154527999999997 2024-04-25T22:03:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384805+0000", 2024-04-25T22:03:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1592999999999999e-05 2024-04-25T22:03:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384848+0000", 2024-04-25T22:03:27.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2880000000000003e-05 2024-04-25T22:03:27.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.739 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.739 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11868 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:27.739 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:27.739 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.4297632940000007, 2024-04-25T22:03:27.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12149908700000001, 2024-04-25T22:03:27.739 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.740 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.740 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.740 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.740 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.740 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.740 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11868 2024-04-25T22:03:27.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.740 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:27.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211999+0000", 2024-04-25T22:03:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:03:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219614+0000", 2024-04-25T22:03:27.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076153490000000004 2024-04-25T22:03:27.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219628+0000", 2024-04-25T22:03:27.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3597e-05 2024-04-25T22:03:27.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219635+0000", 2024-04-25T22:03:27.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7759999999999997e-06 2024-04-25T22:03:27.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229908+0000", 2024-04-25T22:03:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010272478 2024-04-25T22:03:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229966+0000", 2024-04-25T22:03:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8495000000000002e-05 2024-04-25T22:03:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.230082+0000", 2024-04-25T22:03:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011560799999999999 2024-04-25T22:03:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257530+0000", 2024-04-25T22:03:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027448034999999999 2024-04-25T22:03:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333408+0000", 2024-04-25T22:03:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075878105000000001 2024-04-25T22:03:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333457+0000", 2024-04-25T22:03:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8757000000000001e-05 2024-04-25T22:03:27.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333497+0000", 2024-04-25T22:03:27.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9721000000000001e-05 2024-04-25T22:03:27.745 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.745 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.745 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.745 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11870 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 4063232~131072] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:27.745 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:27.745 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.4221089399999993, 2024-04-25T22:03:27.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.114017408, 2024-04-25T22:03:27.745 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11870 2024-04-25T22:03:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219653+0000", 2024-04-25T22:03:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6139999999999999e-06 2024-04-25T22:03:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219722+0000", 2024-04-25T22:03:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8460000000000005e-05 2024-04-25T22:03:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219730+0000", 2024-04-25T22:03:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3420000000000008e-06 2024-04-25T22:03:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219736+0000", 2024-04-25T22:03:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9619999999999998e-06 2024-04-25T22:03:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247743+0000", 2024-04-25T22:03:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028006400000000001 2024-04-25T22:03:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247847+0000", 2024-04-25T22:03:27.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104017 2024-04-25T22:03:27.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247984+0000", 2024-04-25T22:03:27.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013701800000000001 2024-04-25T22:03:27.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257536+0000", 2024-04-25T22:03:27.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095520050000000006 2024-04-25T22:03:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333565+0000", 2024-04-25T22:03:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076029154000000002 2024-04-25T22:03:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333628+0000", 2024-04-25T22:03:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2853000000000003e-05 2024-04-25T22:03:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333669+0000", 2024-04-25T22:03:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1582999999999998e-05 2024-04-25T22:03:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11871 4.37 4:ee924968:::10000003393.00000000:head [write 2359296~1835008] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.4220160079999999, 2024-04-25T22:03:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.113885236, 2024-04-25T22:03:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.751 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11871 2024-04-25T22:03:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6100000000000001e-07 2024-04-25T22:03:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222469+0000", 2024-04-25T22:03:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027240060000000002 2024-04-25T22:03:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222482+0000", 2024-04-25T22:03:27.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3049e-05 2024-04-25T22:03:27.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222492+0000", 2024-04-25T22:03:27.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8020000000000003e-06 2024-04-25T22:03:27.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247903+0000", 2024-04-25T22:03:27.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025410578999999999 2024-04-25T22:03:27.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247962+0000", 2024-04-25T22:03:27.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9363000000000001e-05 2024-04-25T22:03:27.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.248049+0000", 2024-04-25T22:03:27.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6803000000000002e-05 2024-04-25T22:03:27.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257915+0000", 2024-04-25T22:03:27.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0098655730000000007 2024-04-25T22:03:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333544+0000", 2024-04-25T22:03:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075629030999999999 2024-04-25T22:03:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333594+0000", 2024-04-25T22:03:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0291999999999999e-05 2024-04-25T22:03:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333630+0000", 2024-04-25T22:03:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6177000000000003e-05 2024-04-25T22:03:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:15375 4.4 4:211dd80e:::10000003351.00000000:head [write 0~4194304 [2@1354921]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.5046866159999999, 2024-04-25T22:03:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953555500000001, 2024-04-25T22:03:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:27.757 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-04-25T22:03:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:27.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137076+0000", 2024-04-25T22:03:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.683e-06 2024-04-25T22:03:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142168+0000", 2024-04-25T22:03:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050917280000000002 2024-04-25T22:03:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142192+0000", 2024-04-25T22:03:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:03:27.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142206+0000", 2024-04-25T22:03:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.396e-05 2024-04-25T22:03:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142280+0000", 2024-04-25T22:03:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4369000000000006e-05 2024-04-25T22:03:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142346+0000", 2024-04-25T22:03:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5957000000000006e-05 2024-04-25T22:03:27.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142440+0000", 2024-04-25T22:03:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3888999999999995e-05 2024-04-25T22:03:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.208451+0000", 2024-04-25T22:03:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066011350999999996 2024-04-25T22:03:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246473+0000", 2024-04-25T22:03:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038021428000000003 2024-04-25T22:03:27.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:27.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246530+0000", 2024-04-25T22:03:27.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7466000000000002e-05 2024-04-25T22:03:27.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:27.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:27.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:27.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246610+0000", 2024-04-25T22:03:27.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9484e-05 2024-04-25T22:03:27.762 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.762 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.762 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.762 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:27.762 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:27.763 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:27.764 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:27.756+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:27.765 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:27.813 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-25T22:03:27.865 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:27.860+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:27.900 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:03:27.900 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:27.915 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:28.005 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:28.000+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:28.066 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:28.060+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:28.085 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:03:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:03:28.085 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:28.099 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:28.167 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:28.164+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:28.268 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:28.264+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:28.272 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:03:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:03:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:4 4.32 e51/16 4:4def72d4:::10000000003.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:03:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.274972417999997, 2024-04-25T22:03:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10987878, 2024-04-25T22:03:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992461+0000", 2024-04-25T22:03:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5780000000000001e-06 2024-04-25T22:03:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997784+0000", 2024-04-25T22:03:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005323627 2024-04-25T22:03:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997815+0000", 2024-04-25T22:03:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0066999999999999e-05 2024-04-25T22:03:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997830+0000", 2024-04-25T22:03:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5290000000000001e-05 2024-04-25T22:03:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997927+0000", 2024-04-25T22:03:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7391000000000003e-05 2024-04-25T22:03:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997947+0000", 2024-04-25T22:03:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0259999999999999e-05 2024-04-25T22:03:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102225+0000", 2024-04-25T22:03:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10427777100000001 2024-04-25T22:03:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102337+0000", 2024-04-25T22:03:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000111796 2024-04-25T22:03:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:6 4.13 e51/16 4:cbe72331:::10000000003.00000002:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.180158433999999, 2024-04-25T22:03:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.11536371400000001, 2024-04-25T22:03:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087273+0000", 2024-04-25T22:03:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:03:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089358+0000", 2024-04-25T22:03:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0020848170000000001 2024-04-25T22:03:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089372+0000", 2024-04-25T22:03:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.452e-05 2024-04-25T22:03:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089381+0000", 2024-04-25T22:03:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5979999999999997e-06 2024-04-25T22:03:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089486+0000", 2024-04-25T22:03:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105573 2024-04-25T22:03:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089536+0000", 2024-04-25T22:03:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9505000000000001e-05 2024-04-25T22:03:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202556+0000", 2024-04-25T22:03:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.113020169 2024-04-25T22:03:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202636+0000", 2024-04-25T22:03:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9814000000000005e-05 2024-04-25T22:03:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:5 4.10 e51/16 4:09a4c37f:::10000000003.00000001:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.167582517, 2024-04-25T22:03:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.110104358, 2024-04-25T22:03:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099849+0000", 2024-04-25T22:03:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7000000000000003e-07 2024-04-25T22:03:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108349+0000", 2024-04-25T22:03:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085003230000000006 2024-04-25T22:03:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108391+0000", 2024-04-25T22:03:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2011999999999997e-05 2024-04-25T22:03:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108415+0000", 2024-04-25T22:03:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3702000000000001e-05 2024-04-25T22:03:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108504+0000", 2024-04-25T22:03:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8684999999999995e-05 2024-04-25T22:03:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108520+0000", 2024-04-25T22:03:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5931999999999999e-05 2024-04-25T22:03:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209918+0000", 2024-04-25T22:03:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.101398696 2024-04-25T22:03:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209952+0000", 2024-04-25T22:03:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4038000000000002e-05 2024-04-25T22:03:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11 4.28 e51/49 4:177a762d:::10000000201.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.158880590999999, 2024-04-25T22:03:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098799331000000004, 2024-04-25T22:03:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108551+0000", 2024-04-25T22:03:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0699999999999996e-07 2024-04-25T22:03:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108576+0000", 2024-04-25T22:03:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4856000000000001e-05 2024-04-25T22:03:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108593+0000", 2024-04-25T22:03:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7125999999999998e-05 2024-04-25T22:03:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108609+0000", 2024-04-25T22:03:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6535999999999999e-05 2024-04-25T22:03:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108713+0000", 2024-04-25T22:03:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010344999999999999 2024-04-25T22:03:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108762+0000", 2024-04-25T22:03:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8711000000000002e-05 2024-04-25T22:03:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207305+0000", 2024-04-25T22:03:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098543566999999999 2024-04-25T22:03:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207349+0000", 2024-04-25T22:03:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4178000000000003e-05 2024-04-25T22:03:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:12 4.28 e51/49 4:15246602:::10000000202.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:03:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.158799299999998, 2024-04-25T22:03:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098749009999999998, 2024-04-25T22:03:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108632+0000", 2024-04-25T22:03:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2699999999999999e-07 2024-04-25T22:03:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108647+0000", 2024-04-25T22:03:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4585e-05 2024-04-25T22:03:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108667+0000", 2024-04-25T22:03:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9887000000000001e-05 2024-04-25T22:03:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108680+0000", 2024-04-25T22:03:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3249e-05 2024-04-25T22:03:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109917+0000", 2024-04-25T22:03:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012367050000000001 2024-04-25T22:03:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109961+0000", 2024-04-25T22:03:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4029000000000001e-05 2024-04-25T22:03:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207351+0000", 2024-04-25T22:03:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.097390791000000004 2024-04-25T22:03:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207380+0000", 2024-04-25T22:03:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9037e-05 2024-04-25T22:03:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:8 4.3b e51/49 4:deccbd37:::100000001fe.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 36.158734396, 2024-04-25T22:03:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090839771, 2024-04-25T22:03:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108697+0000", 2024-04-25T22:03:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1399999999999997e-07 2024-04-25T22:03:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108712+0000", 2024-04-25T22:03:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4772e-05 2024-04-25T22:03:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108728+0000", 2024-04-25T22:03:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5943e-05 2024-04-25T22:03:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108740+0000", 2024-04-25T22:03:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.235e-05 2024-04-25T22:03:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108797+0000", 2024-04-25T22:03:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6879000000000002e-05 2024-04-25T22:03:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108812+0000", 2024-04-25T22:03:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5268999999999999e-05 2024-04-25T22:03:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199495+0000", 2024-04-25T22:03:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090683071000000004 2024-04-25T22:03:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199536+0000", 2024-04-25T22:03:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0873e-05 2024-04-25T22:03:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:6909 4.6 4:631b09cd:::10000001f99.00000000:head [write 0~1706] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.879622+0000", 2024-04-25T22:03:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.387808885999998, 2024-04-25T22:03:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83167118299999998, 2024-04-25T22:03:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 6909 2024-04-25T22:03:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879622+0000", 2024-04-25T22:03:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879622+0000", 2024-04-25T22:03:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879624+0000", 2024-04-25T22:03:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.429e-06 2024-04-25T22:03:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879639+0000", 2024-04-25T22:03:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4534e-05 2024-04-25T22:03:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879669+0000", 2024-04-25T22:03:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0349e-05 2024-04-25T22:03:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879684+0000", 2024-04-25T22:03:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:03:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879767+0000", 2024-04-25T22:03:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3410000000000003e-05 2024-04-25T22:03:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879783+0000", 2024-04-25T22:03:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5378000000000001e-05 2024-04-25T22:03:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.700268+0000", 2024-04-25T22:03:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.82048565699999998 2024-04-25T22:03:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.700627+0000", 2024-04-25T22:03:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035847800000000002 2024-04-25T22:03:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.700977+0000", 2024-04-25T22:03:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035024699999999998 2024-04-25T22:03:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.704901+0000", 2024-04-25T22:03:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039243230000000004 2024-04-25T22:03:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711150+0000", 2024-04-25T22:03:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0062490519999999997 2024-04-25T22:03:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711230+0000", 2024-04-25T22:03:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9370999999999996e-05 2024-04-25T22:03:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3221999999999999e-05 2024-04-25T22:03:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:6922 4.6 4:62b4ea5c:::10000001fab.00000000:head [write 0~7953] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.902807+0000", 2024-04-25T22:03:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.364623658999999, 2024-04-25T22:03:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80868129799999999, 2024-04-25T22:03:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 6922 2024-04-25T22:03:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902807+0000", 2024-04-25T22:03:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902807+0000", 2024-04-25T22:03:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902809+0000", 2024-04-25T22:03:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4099999999999998e-06 2024-04-25T22:03:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902830+0000", 2024-04-25T22:03:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0381999999999999e-05 2024-04-25T22:03:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902852+0000", 2024-04-25T22:03:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2357e-05 2024-04-25T22:03:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902864+0000", 2024-04-25T22:03:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2329e-05 2024-04-25T22:03:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902923+0000", 2024-04-25T22:03:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8485e-05 2024-04-25T22:03:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902930+0000", 2024-04-25T22:03:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4200000000000001e-06 2024-04-25T22:03:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.702506+0000", 2024-04-25T22:03:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.79957517899999997 2024-04-25T22:03:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.702674+0000", 2024-04-25T22:03:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016807200000000001 2024-04-25T22:03:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.702860+0000", 2024-04-25T22:03:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018624200000000001 2024-04-25T22:03:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706186+0000", 2024-04-25T22:03:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033265619999999999 2024-04-25T22:03:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711369+0000", 2024-04-25T22:03:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005182496 2024-04-25T22:03:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711436+0000", 2024-04-25T22:03:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7135e-05 2024-04-25T22:03:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711488+0000", 2024-04-25T22:03:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2228999999999997e-05 2024-04-25T22:03:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:6926 4.6 4:62749b46:::10000001faf.00000000:head [write 0~2676] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.908574+0000", 2024-04-25T22:03:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.358856810999999, 2024-04-25T22:03:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.803246511, 2024-04-25T22:03:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 6926 2024-04-25T22:03:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908574+0000", 2024-04-25T22:03:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908574+0000", 2024-04-25T22:03:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908576+0000", 2024-04-25T22:03:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.784e-06 2024-04-25T22:03:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908585+0000", 2024-04-25T22:03:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6420000000000002e-06 2024-04-25T22:03:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908609+0000", 2024-04-25T22:03:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3303e-05 2024-04-25T22:03:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908622+0000", 2024-04-25T22:03:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3783e-05 2024-04-25T22:03:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908730+0000", 2024-04-25T22:03:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107831 2024-04-25T22:03:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908748+0000", 2024-04-25T22:03:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7909000000000001e-05 2024-04-25T22:03:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.703586+0000", 2024-04-25T22:03:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.794838131 2024-04-25T22:03:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.703854+0000", 2024-04-25T22:03:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026782299999999999 2024-04-25T22:03:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.704060+0000", 2024-04-25T22:03:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020576200000000001 2024-04-25T22:03:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711121+0000", 2024-04-25T22:03:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070615510000000001 2024-04-25T22:03:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711705+0000", 2024-04-25T22:03:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00058315899999999998 2024-04-25T22:03:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711769+0000", 2024-04-25T22:03:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4877999999999998e-05 2024-04-25T22:03:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711820+0000", 2024-04-25T22:03:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0955000000000003e-05 2024-04-25T22:03:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7057 4.6 4:63cd8154:::10000002047.00000000:head [write 0~2047] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.194487+0000", 2024-04-25T22:03:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.072943900999999, 2024-04-25T22:03:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.51749014100000001, 2024-04-25T22:03:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7057 2024-04-25T22:03:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194487+0000", 2024-04-25T22:03:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194487+0000", 2024-04-25T22:03:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194489+0000", 2024-04-25T22:03:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-04-25T22:03:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194499+0000", 2024-04-25T22:03:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0117e-05 2024-04-25T22:03:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194522+0000", 2024-04-25T22:03:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2925000000000002e-05 2024-04-25T22:03:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194541+0000", 2024-04-25T22:03:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9137e-05 2024-04-25T22:03:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194712+0000", 2024-04-25T22:03:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000170602 2024-04-25T22:03:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194743+0000", 2024-04-25T22:03:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1479000000000001e-05 2024-04-25T22:03:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.704997+0000", 2024-04-25T22:03:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.51025366000000005 2024-04-25T22:03:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.705197+0000", 2024-04-25T22:03:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020022799999999999 2024-04-25T22:03:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.705399+0000", 2024-04-25T22:03:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020160499999999999 2024-04-25T22:03:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711586+0000", 2024-04-25T22:03:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061875350000000001 2024-04-25T22:03:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711841+0000", 2024-04-25T22:03:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025510300000000001 2024-04-25T22:03:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711906+0000", 2024-04-25T22:03:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4381999999999994e-05 2024-04-25T22:03:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711977+0000", 2024-04-25T22:03:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1295000000000001e-05 2024-04-25T22:03:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7114 4.6 4:63547153:::10000002086.00000000:head [write 0~67896] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.411903+0000", 2024-04-25T22:03:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.855527317, 2024-04-25T22:03:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.301551715, 2024-04-25T22:03:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7114 2024-04-25T22:03:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.411903+0000", 2024-04-25T22:03:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.411903+0000", 2024-04-25T22:03:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.411906+0000", 2024-04-25T22:03:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9469999999999999e-06 2024-04-25T22:03:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412184+0000", 2024-04-25T22:03:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027727600000000002 2024-04-25T22:03:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412215+0000", 2024-04-25T22:03:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1899000000000001e-05 2024-04-25T22:03:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412230+0000", 2024-04-25T22:03:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4703e-05 2024-04-25T22:03:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412384+0000", 2024-04-25T22:03:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015366300000000001 2024-04-25T22:03:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412405+0000", 2024-04-25T22:03:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0936000000000001e-05 2024-04-25T22:03:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706266+0000", 2024-04-25T22:03:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.29386084299999998 2024-04-25T22:03:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706440+0000", 2024-04-25T22:03:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174759 2024-04-25T22:03:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706655+0000", 2024-04-25T22:03:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021489100000000001 2024-04-25T22:03:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711675+0000", 2024-04-25T22:03:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050198639999999997 2024-04-25T22:03:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.713316+0000", 2024-04-25T22:03:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016410280000000001 2024-04-25T22:03:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.713391+0000", 2024-04-25T22:03:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5065e-05 2024-04-25T22:03:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.713455+0000", 2024-04-25T22:03:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3841000000000001e-05 2024-04-25T22:03:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7117 4.6 4:60a5b603:::10000002089.00000000:head [write 0~12740] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.421192+0000", 2024-04-25T22:03:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.846238919000001, 2024-04-25T22:03:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.29400416200000001, 2024-04-25T22:03:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7117 2024-04-25T22:03:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421192+0000", 2024-04-25T22:03:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421192+0000", 2024-04-25T22:03:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421194+0000", 2024-04-25T22:03:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3700000000000002e-06 2024-04-25T22:03:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421247+0000", 2024-04-25T22:03:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2539e-05 2024-04-25T22:03:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421278+0000", 2024-04-25T22:03:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1392e-05 2024-04-25T22:03:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421293+0000", 2024-04-25T22:03:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5133000000000001e-05 2024-04-25T22:03:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421487+0000", 2024-04-25T22:03:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019340899999999999 2024-04-25T22:03:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421506+0000", 2024-04-25T22:03:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9568999999999998e-05 2024-04-25T22:03:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.709232+0000", 2024-04-25T22:03:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.28772543699999997 2024-04-25T22:03:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.709416+0000", 2024-04-25T22:03:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000184019 2024-04-25T22:03:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.709668+0000", 2024-04-25T22:03:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025279000000000002 2024-04-25T22:03:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712068+0000", 2024-04-25T22:03:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002399558 2024-04-25T22:03:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.715072+0000", 2024-04-25T22:03:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030037800000000002 2024-04-25T22:03:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.715143+0000", 2024-04-25T22:03:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1000999999999993e-05 2024-04-25T22:03:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.715196+0000", 2024-04-25T22:03:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3164999999999997e-05 2024-04-25T22:03:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7136 4.6 4:60bfd03c:::100000020a0.00000000:head [write 0~1357] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.489503+0000", 2024-04-25T22:03:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.777928037999999, 2024-04-25T22:03:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.22876102600000001, 2024-04-25T22:03:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7136 2024-04-25T22:03:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489503+0000", 2024-04-25T22:03:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489503+0000", 2024-04-25T22:03:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489505+0000", 2024-04-25T22:03:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.486e-06 2024-04-25T22:03:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489517+0000", 2024-04-25T22:03:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.217e-05 2024-04-25T22:03:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489544+0000", 2024-04-25T22:03:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6852999999999999e-05 2024-04-25T22:03:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489559+0000", 2024-04-25T22:03:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:03:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489705+0000", 2024-04-25T22:03:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014583 2024-04-25T22:03:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489722+0000", 2024-04-25T22:03:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7376000000000001e-05 2024-04-25T22:03:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712122+0000", 2024-04-25T22:03:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.22239948300000001 2024-04-25T22:03:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712376+0000", 2024-04-25T22:03:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025398700000000001 2024-04-25T22:03:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712639+0000", 2024-04-25T22:03:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026326300000000002 2024-04-25T22:03:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.714861+0000", 2024-04-25T22:03:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00222236 2024-04-25T22:03:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.718091+0000", 2024-04-25T22:03:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032294400000000001 2024-04-25T22:03:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.718197+0000", 2024-04-25T22:03:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010655 2024-04-25T22:03:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.718264+0000", 2024-04-25T22:03:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6482000000000005e-05 2024-04-25T22:03:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:299 3.0 3:02ac1934:::200.00000009:head [write 0~3532922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T22:03:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:10.968409+0000", 2024-04-25T22:03:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.299022013999998, 2024-04-25T22:03:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.094675465, 2024-04-25T22:03:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.968409+0000", 2024-04-25T22:03:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.968409+0000", 2024-04-25T22:03:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.968411+0000", 2024-04-25T22:03:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.012e-06 2024-04-25T22:03:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974350+0000", 2024-04-25T22:03:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059392259999999997 2024-04-25T22:03:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974375+0000", 2024-04-25T22:03:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:03:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974386+0000", 2024-04-25T22:03:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0900000000000001e-05 2024-04-25T22:03:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974473+0000", 2024-04-25T22:03:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6942999999999997e-05 2024-04-25T22:03:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974562+0000", 2024-04-25T22:03:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8744000000000003e-05 2024-04-25T22:03:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974706+0000", 2024-04-25T22:03:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014392499999999999 2024-04-25T22:03:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.020272+0000", 2024-04-25T22:03:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.045566723000000003 2024-04-25T22:03:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.062890+0000", 2024-04-25T22:03:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042617796999999999 2024-04-25T22:03:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.063008+0000", 2024-04-25T22:03:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011757 2024-04-25T22:03:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.063084+0000", 2024-04-25T22:03:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6395000000000003e-05 2024-04-25T22:03:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:10648 4.33 e64/49 4:cc614d18:::100000030cb.00000000:head v 64'159, mlcod=64'157)", 2024-04-25T22:03:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:13.541451+0000", 2024-04-25T22:03:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.725980063, 2024-04-25T22:03:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.120967456, 2024-04-25T22:03:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.541451+0000", 2024-04-25T22:03:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.541451+0000", 2024-04-25T22:03:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.541453+0000", 2024-04-25T22:03:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3530000000000002e-06 2024-04-25T22:03:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.545862+0000", 2024-04-25T22:03:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004409451 2024-04-25T22:03:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.545895+0000", 2024-04-25T22:03:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2811999999999997e-05 2024-04-25T22:03:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.545918+0000", 2024-04-25T22:03:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2407000000000001e-05 2024-04-25T22:03:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.546085+0000", 2024-04-25T22:03:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000167159 2024-04-25T22:03:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.546149+0000", 2024-04-25T22:03:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4208999999999995e-05 2024-04-25T22:03:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.662281+0000", 2024-04-25T22:03:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.116132255 2024-04-25T22:03:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.662418+0000", 2024-04-25T22:03:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013681000000000001 2024-04-25T22:03:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11198 4.4 e65/16 4:22c4fea3:::10000003262.00000000:head v 65'175, mlcod=65'172)", 2024-04-25T22:03:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:18.240473+0000", 2024-04-25T22:03:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 10.026957503, 2024-04-25T22:03:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.099381791999999997, 2024-04-25T22:03:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.240473+0000", 2024-04-25T22:03:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.240473+0000", 2024-04-25T22:03:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.240474+0000", 2024-04-25T22:03:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1299999999999999e-07 2024-04-25T22:03:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.247661+0000", 2024-04-25T22:03:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0071873630000000004 2024-04-25T22:03:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.247677+0000", 2024-04-25T22:03:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5624000000000002e-05 2024-04-25T22:03:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.247687+0000", 2024-04-25T22:03:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9089999999999995e-06 2024-04-25T22:03:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.259136+0000", 2024-04-25T22:03:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011449002999999999 2024-04-25T22:03:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.259154+0000", 2024-04-25T22:03:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7849000000000001e-05 2024-04-25T22:03:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.339805+0000", 2024-04-25T22:03:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.080651013999999993 2024-04-25T22:03:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.339855+0000", 2024-04-25T22:03:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0317e-05 2024-04-25T22:03:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11219 4.4 e65/16 4:210cd53e:::100000031ff.00000000:head v 65'177, mlcod=65'173)", 2024-04-25T22:03:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:18.271403+0000", 2024-04-25T22:03:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.9960278680000005, 2024-04-25T22:03:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.093770510000000001, 2024-04-25T22:03:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.271403+0000", 2024-04-25T22:03:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.271403+0000", 2024-04-25T22:03:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.271403+0000", 2024-04-25T22:03:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8999999999999998e-07 2024-04-25T22:03:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.275340+0000", 2024-04-25T22:03:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039364889999999996 2024-04-25T22:03:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.275354+0000", 2024-04-25T22:03:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4864e-05 2024-04-25T22:03:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.275362+0000", 2024-04-25T22:03:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9710000000000004e-06 2024-04-25T22:03:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.283340+0000", 2024-04-25T22:03:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0079778739999999994 2024-04-25T22:03:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.283361+0000", 2024-04-25T22:03:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1214999999999999e-05 2024-04-25T22:03:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.365136+0000", 2024-04-25T22:03:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.081774327999999993 2024-04-25T22:03:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.365173+0000", 2024-04-25T22:03:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-04-25T22:03:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:11419 4.6 4:6132b542:::100000032bb.00000000:head [write 0~3932160 [2@1004150]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:18.522062+0000", 2024-04-25T22:03:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7453689909999994, 2024-04-25T22:03:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.091966376000000002, 2024-04-25T22:03:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 11419 2024-04-25T22:03:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.522062+0000", 2024-04-25T22:03:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.522062+0000", 2024-04-25T22:03:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.522063+0000", 2024-04-25T22:03:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.288e-06 2024-04-25T22:03:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527453+0000", 2024-04-25T22:03:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0053895530000000001 2024-04-25T22:03:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527469+0000", 2024-04-25T22:03:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:03:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527477+0000", 2024-04-25T22:03:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2320000000000001e-06 2024-04-25T22:03:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527541+0000", 2024-04-25T22:03:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3628999999999997e-05 2024-04-25T22:03:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527614+0000", 2024-04-25T22:03:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3479000000000006e-05 2024-04-25T22:03:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527727+0000", 2024-04-25T22:03:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113094 2024-04-25T22:03:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.547917+0000", 2024-04-25T22:03:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.020189983000000002 2024-04-25T22:03:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.613903+0000", 2024-04-25T22:03:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065985492000000007 2024-04-25T22:03:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.613968+0000", 2024-04-25T22:03:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5815000000000006e-05 2024-04-25T22:03:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.614028+0000", 2024-04-25T22:03:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9667999999999999e-05 2024-04-25T22:03:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:11421 4.6 4:6132b542:::100000032bb.00000000:head [write 3932160~262144 [2@1004150]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:18.527499+0000", 2024-04-25T22:03:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.7399318630000007, 2024-04-25T22:03:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.086691641, 2024-04-25T22:03:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 11421 2024-04-25T22:03:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527499+0000", 2024-04-25T22:03:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527499+0000", 2024-04-25T22:03:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527501+0000", 2024-04-25T22:03:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7600000000000001e-06 2024-04-25T22:03:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527714+0000", 2024-04-25T22:03:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000213919 2024-04-25T22:03:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527726+0000", 2024-04-25T22:03:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1114000000000001e-05 2024-04-25T22:03:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527734+0000", 2024-04-25T22:03:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6489999999999997e-06 2024-04-25T22:03:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.545454+0000", 2024-04-25T22:03:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017720058 2024-04-25T22:03:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.545551+0000", 2024-04-25T22:03:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6978000000000006e-05 2024-04-25T22:03:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.545713+0000", 2024-04-25T22:03:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016178199999999999 2024-04-25T22:03:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.551069+0000", 2024-04-25T22:03:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0053559519999999998 2024-04-25T22:03:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.614075+0000", 2024-04-25T22:03:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063006329999999999 2024-04-25T22:03:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.614148+0000", 2024-04-25T22:03:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2821e-05 2024-04-25T22:03:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.614190+0000", 2024-04-25T22:03:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2277999999999997e-05 2024-04-25T22:03:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11868 4.3f e66/49 4:ffca00d8:::1000000326a.00000001:head v 66'190, mlcod=66'188)", 2024-04-25T22:03:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:19.231425+0000", 2024-04-25T22:03:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.0360056429999993, 2024-04-25T22:03:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.097996501, 2024-04-25T22:03:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.231425+0000", 2024-04-25T22:03:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.231425+0000", 2024-04-25T22:03:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.231426+0000", 2024-04-25T22:03:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.147e-06 2024-04-25T22:03:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.238249+0000", 2024-04-25T22:03:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068231810000000002 2024-04-25T22:03:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.238259+0000", 2024-04-25T22:03:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9059999999999997e-06 2024-04-25T22:03:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.238270+0000", 2024-04-25T22:03:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.11e-05 2024-04-25T22:03:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.253394+0000", 2024-04-25T22:03:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015123559999999999 2024-04-25T22:03:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.253419+0000", 2024-04-25T22:03:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4989000000000001e-05 2024-04-25T22:03:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.329383+0000", 2024-04-25T22:03:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.075963944000000005 2024-04-25T22:03:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.329422+0000", 2024-04-25T22:03:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8674000000000003e-05 2024-04-25T22:03:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:28.372 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:28.374 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:28.374 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:28.372+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:28.476 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:28.472+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:28.514 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:28.514 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:28.514 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:03:28.514 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:28.529 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:28.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:28.573+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:28.661 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:03:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:03:28.661 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:28.676 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:28.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:28.673+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:28.778 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:28.772+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:28.816 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:28.816 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:03:28.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:03:28.816 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:28.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.816 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T22:03:28.816 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:28.816 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.82857533, 2024-04-25T22:03:28.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.180276931, 2024-04-25T22:03:28.816 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.817 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.817 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.817 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:28.817 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:28.817 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:28.817 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4 2024-04-25T22:03:28.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.817 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:28.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:28.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983834+0000", 2024-04-25T22:03:28.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2900000000000001e-06 2024-04-25T22:03:28.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991787+0000", 2024-04-25T22:03:28.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079521690000000003 2024-04-25T22:03:28.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991826+0000", 2024-04-25T22:03:28.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9258999999999998e-05 2024-04-25T22:03:28.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991845+0000", 2024-04-25T22:03:28.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9360000000000001e-05 2024-04-25T22:03:28.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992058+0000", 2024-04-25T22:03:28.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212559 2024-04-25T22:03:28.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992213+0000", 2024-04-25T22:03:28.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015520700000000001 2024-04-25T22:03:28.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:28.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992414+0000", 2024-04-25T22:03:28.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020049 2024-04-25T22:03:28.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162511+0000", 2024-04-25T22:03:28.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.17009782900000001 2024-04-25T22:03:28.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163967+0000", 2024-04-25T22:03:28.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001455752 2024-04-25T22:03:28.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164045+0000", 2024-04-25T22:03:28.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7415000000000003e-05 2024-04-25T22:03:28.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164109+0000", 2024-04-25T22:03:28.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4601e-05 2024-04-25T22:03:28.821 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.821 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.822 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.822 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6847 4.16 4:68767fd1:::10000001f4f.00000000:head [write 0~7212] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:28.822 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:28.822 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 24.118935869000001, 2024-04-25T22:03:28.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0208302119999999, 2024-04-25T22:03:28.822 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.822 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.822 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.822 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:28.822 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:28.822 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:28.823 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6847 2024-04-25T22:03:28.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.823 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:28.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:28.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693473+0000", 2024-04-25T22:03:28.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.75e-06 2024-04-25T22:03:28.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.824 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693490+0000", 2024-04-25T22:03:28.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6540000000000001e-05 2024-04-25T22:03:28.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.824 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693509+0000", 2024-04-25T22:03:28.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9536999999999999e-05 2024-04-25T22:03:28.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693522+0000", 2024-04-25T22:03:28.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2099000000000001e-05 2024-04-25T22:03:28.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693677+0000", 2024-04-25T22:03:28.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015516799999999999 2024-04-25T22:03:28.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:28.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693705+0000", 2024-04-25T22:03:28.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8663e-05 2024-04-25T22:03:28.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705551+0000", 2024-04-25T22:03:28.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.011845495 2024-04-25T22:03:28.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705942+0000", 2024-04-25T22:03:28.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00039080099999999997 2024-04-25T22:03:28.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:28.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.706151+0000", 2024-04-25T22:03:28.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000209457 2024-04-25T22:03:28.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711141+0000", 2024-04-25T22:03:28.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049901240000000003 2024-04-25T22:03:28.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714005+0000", 2024-04-25T22:03:28.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028642229999999999 2024-04-25T22:03:28.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714180+0000", 2024-04-25T22:03:28.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017433699999999999 2024-04-25T22:03:28.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714302+0000", 2024-04-25T22:03:28.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122018 2024-04-25T22:03:28.828 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.829 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.829 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.829 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6960 4.16 4:6823d322:::10000001fd2.00000000:head [write 0~150] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:28.829 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:28.829 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.841931770999999, 2024-04-25T22:03:28.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.74417278899999995, 2024-04-25T22:03:28.829 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.829 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.829 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.829 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:28.829 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:28.830 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:28.830 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6960 2024-04-25T22:03:28.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.830 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:28.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:28.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970478+0000", 2024-04-25T22:03:28.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.939e-06 2024-04-25T22:03:28.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970488+0000", 2024-04-25T22:03:28.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9699999999999994e-06 2024-04-25T22:03:28.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970524+0000", 2024-04-25T22:03:28.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5963000000000001e-05 2024-04-25T22:03:28.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970537+0000", 2024-04-25T22:03:28.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.31e-05 2024-04-25T22:03:28.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970701+0000", 2024-04-25T22:03:28.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164177 2024-04-25T22:03:28.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:28.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970718+0000", 2024-04-25T22:03:28.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7323e-05 2024-04-25T22:03:28.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707632+0000", 2024-04-25T22:03:28.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.73691394300000002 2024-04-25T22:03:28.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707924+0000", 2024-04-25T22:03:28.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029223299999999998 2024-04-25T22:03:28.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:28.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.708389+0000", 2024-04-25T22:03:28.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046429300000000001 2024-04-25T22:03:28.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:28.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029039830000000002 2024-04-25T22:03:28.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714409+0000", 2024-04-25T22:03:28.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031159260000000002 2024-04-25T22:03:28.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714538+0000", 2024-04-25T22:03:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012952100000000001 2024-04-25T22:03:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714649+0000", 2024-04-25T22:03:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110418 2024-04-25T22:03:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.836 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7039 4.16 4:6919637e:::10000002032.00000000:head [write 0~2968] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:28.836 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:28.836 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.655885265999999, 2024-04-25T22:03:28.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.56024932199999999, 2024-04-25T22:03:28.836 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.836 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.836 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.836 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:28.836 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:28.836 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:28.836 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7039 2024-04-25T22:03:28.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.836 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:28.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:28.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156523+0000", 2024-04-25T22:03:28.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2130000000000001e-06 2024-04-25T22:03:28.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156530+0000", 2024-04-25T22:03:28.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9090000000000003e-06 2024-04-25T22:03:28.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156544+0000", 2024-04-25T22:03:28.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3271999999999999e-05 2024-04-25T22:03:28.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156551+0000", 2024-04-25T22:03:28.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4970000000000004e-06 2024-04-25T22:03:28.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156639+0000", 2024-04-25T22:03:28.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7638000000000004e-05 2024-04-25T22:03:28.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:28.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156649+0000", 2024-04-25T22:03:28.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0536e-05 2024-04-25T22:03:28.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709515+0000", 2024-04-25T22:03:28.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.55286568999999997 2024-04-25T22:03:28.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709836+0000", 2024-04-25T22:03:28.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032078899999999998 2024-04-25T22:03:28.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:28.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.710271+0000", 2024-04-25T22:03:28.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043530000000000001 2024-04-25T22:03:28.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716576+0000", 2024-04-25T22:03:28.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063045050000000002 2024-04-25T22:03:28.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716605+0000", 2024-04-25T22:03:28.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8949e-05 2024-04-25T22:03:28.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716706+0000", 2024-04-25T22:03:28.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101765 2024-04-25T22:03:28.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716772+0000", 2024-04-25T22:03:28.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5259000000000007e-05 2024-04-25T22:03:28.842 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.842 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.842 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.843 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7065 4.16 4:697a9f10:::10000002050.00000000:head [write 0~16297] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:28.843 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:28.843 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.598269318, 2024-04-25T22:03:28.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.50307290800000004, 2024-04-25T22:03:28.843 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.843 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.843 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.843 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:28.843 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:28.843 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:28.843 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7065 2024-04-25T22:03:28.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.844 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:28.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:28.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214139+0000", 2024-04-25T22:03:28.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.186e-06 2024-04-25T22:03:28.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214170+0000", 2024-04-25T22:03:28.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0419000000000001e-05 2024-04-25T22:03:28.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214186+0000", 2024-04-25T22:03:28.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6526000000000001e-05 2024-04-25T22:03:28.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214194+0000", 2024-04-25T22:03:28.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6769999999999995e-06 2024-04-25T22:03:28.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214380+0000", 2024-04-25T22:03:28.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018580699999999999 2024-04-25T22:03:28.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:28.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214399+0000", 2024-04-25T22:03:28.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9446e-05 2024-04-25T22:03:28.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711402+0000", 2024-04-25T22:03:28.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.497002901 2024-04-25T22:03:28.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711822+0000", 2024-04-25T22:03:28.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00041989399999999997 2024-04-25T22:03:28.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:28.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.712017+0000", 2024-04-25T22:03:28.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019540700000000001 2024-04-25T22:03:28.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716792+0000", 2024-04-25T22:03:28.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047748210000000003 2024-04-25T22:03:28.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716937+0000", 2024-04-25T22:03:28.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014479099999999999 2024-04-25T22:03:28.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717081+0000", 2024-04-25T22:03:28.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014412100000000001 2024-04-25T22:03:28.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717211+0000", 2024-04-25T22:03:28.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012991200000000001 2024-04-25T22:03:28.849 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.849 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.849 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.849 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7089 4.16 4:6868fcac:::1000000206b.00000000:head [write 0~5386] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:28.850 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:28.850 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.538715324000002, 2024-04-25T22:03:28.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44658810700000001, 2024-04-25T22:03:28.850 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.850 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.850 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.850 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:28.850 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:28.850 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:28.850 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7089 2024-04-25T22:03:28.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.850 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:28.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:28.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273695+0000", 2024-04-25T22:03:28.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.463e-06 2024-04-25T22:03:28.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273712+0000", 2024-04-25T22:03:28.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7842999999999998e-05 2024-04-25T22:03:28.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273742+0000", 2024-04-25T22:03:28.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9039000000000001e-05 2024-04-25T22:03:28.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273756+0000", 2024-04-25T22:03:28.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4406999999999999e-05 2024-04-25T22:03:28.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273943+0000", 2024-04-25T22:03:28.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018708 2024-04-25T22:03:28.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:28.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273961+0000", 2024-04-25T22:03:28.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7977000000000001e-05 2024-04-25T22:03:28.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714748+0000", 2024-04-25T22:03:28.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.440786605 2024-04-25T22:03:28.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.854 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715013+0000", 2024-04-25T22:03:28.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026558300000000001 2024-04-25T22:03:28.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.854 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:28.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715309+0000", 2024-04-25T22:03:28.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000295715 2024-04-25T22:03:28.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.854 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.719035+0000", 2024-04-25T22:03:28.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037256310000000001 2024-04-25T22:03:28.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720142+0000", 2024-04-25T22:03:28.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001107053 2024-04-25T22:03:28.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720221+0000", 2024-04-25T22:03:28.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9832000000000004e-05 2024-04-25T22:03:28.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720280+0000", 2024-04-25T22:03:28.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8879000000000003e-05 2024-04-25T22:03:28.856 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.856 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.856 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.858 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7090 4.16 4:69dc3034:::1000000206c.00000000:head [write 0~957] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:28.858 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:28.858 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.536090993999998, 2024-04-25T22:03:28.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44572077100000002, 2024-04-25T22:03:28.858 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.858 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.858 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.858 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:28.858 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:28.858 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:28.858 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7090 2024-04-25T22:03:28.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.859 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:28.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:28.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276319+0000", 2024-04-25T22:03:28.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3429999999999998e-06 2024-04-25T22:03:28.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276330+0000", 2024-04-25T22:03:28.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1567e-05 2024-04-25T22:03:28.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276362+0000", 2024-04-25T22:03:28.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1863000000000003e-05 2024-04-25T22:03:28.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276377+0000", 2024-04-25T22:03:28.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5102999999999999e-05 2024-04-25T22:03:28.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276564+0000", 2024-04-25T22:03:28.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018629700000000001 2024-04-25T22:03:28.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:28.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276583+0000", 2024-04-25T22:03:28.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9743000000000001e-05 2024-04-25T22:03:28.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717354+0000", 2024-04-25T22:03:28.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44077094900000002 2024-04-25T22:03:28.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717723+0000", 2024-04-25T22:03:28.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036839099999999998 2024-04-25T22:03:28.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:28.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.718097+0000", 2024-04-25T22:03:28.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037392099999999999 2024-04-25T22:03:28.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720305+0000", 2024-04-25T22:03:28.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022084439999999999 2024-04-25T22:03:28.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721866+0000", 2024-04-25T22:03:28.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015610260000000001 2024-04-25T22:03:28.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721944+0000", 2024-04-25T22:03:28.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7961999999999997e-05 2024-04-25T22:03:28.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.722037+0000", 2024-04-25T22:03:28.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3162e-05 2024-04-25T22:03:28.864 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.864 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.864 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.864 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:10647 4.35 4:ae7b229b:::100000030a9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:28.864 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:28.864 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.283046300000001, 2024-04-25T22:03:28.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14506126, 2024-04-25T22:03:28.865 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.865 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.865 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.865 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:28.865 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:28.865 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:28.865 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10647 2024-04-25T22:03:28.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.865 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:28.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:28.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529364+0000", 2024-04-25T22:03:28.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.286e-06 2024-04-25T22:03:28.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538917+0000", 2024-04-25T22:03:28.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0095530010000000002 2024-04-25T22:03:28.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538955+0000", 2024-04-25T22:03:28.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:03:28.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538977+0000", 2024-04-25T22:03:28.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.105e-05 2024-04-25T22:03:28.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568092+0000", 2024-04-25T22:03:28.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029115604999999999 2024-04-25T22:03:28.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568243+0000", 2024-04-25T22:03:28.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000151044 2024-04-25T22:03:28.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:28.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568498+0000", 2024-04-25T22:03:28.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025517399999999999 2024-04-25T22:03:28.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628005+0000", 2024-04-25T22:03:28.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059506991000000002 2024-04-25T22:03:28.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674273+0000", 2024-04-25T22:03:28.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.046267233999999997 2024-04-25T22:03:28.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674357+0000", 2024-04-25T22:03:28.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4745000000000003e-05 2024-04-25T22:03:28.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674422+0000", 2024-04-25T22:03:28.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5160999999999995e-05 2024-04-25T22:03:28.870 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.870 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.870 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.870 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3891938~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:28.870 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:28.870 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.1297267140000002, 2024-04-25T22:03:28.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.144195727, 2024-04-25T22:03:28.870 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.870 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.871 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.871 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:28.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:28.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682682+0000", 2024-04-25T22:03:28.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6000000000000003e-07 2024-04-25T22:03:28.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682686+0000", 2024-04-25T22:03:28.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4630000000000003e-06 2024-04-25T22:03:28.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682695+0000", 2024-04-25T22:03:28.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7360000000000007e-06 2024-04-25T22:03:28.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682702+0000", 2024-04-25T22:03:28.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1239999999999999e-06 2024-04-25T22:03:28.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821515+0000", 2024-04-25T22:03:28.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13881310499999999 2024-04-25T22:03:28.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821780+0000", 2024-04-25T22:03:28.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026492699999999998 2024-04-25T22:03:28.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:28.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821974+0000", 2024-04-25T22:03:28.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000194561 2024-04-25T22:03:28.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826533+0000", 2024-04-25T22:03:28.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045586649999999999 2024-04-25T22:03:28.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826574+0000", 2024-04-25T22:03:28.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0995999999999998e-05 2024-04-25T22:03:28.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826754+0000", 2024-04-25T22:03:28.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017955400000000001 2024-04-25T22:03:28.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826877+0000", 2024-04-25T22:03:28.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122836 2024-04-25T22:03:28.875 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.875 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.875 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3893337~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.1296968810000001, 2024-04-25T22:03:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.146040321, 2024-04-25T22:03:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:28.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:28.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:03:28.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682716+0000", 2024-04-25T22:03:28.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3930000000000001e-06 2024-04-25T22:03:28.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682724+0000", 2024-04-25T22:03:28.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5769999999999994e-06 2024-04-25T22:03:28.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682731+0000", 2024-04-25T22:03:28.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1629999999999999e-06 2024-04-25T22:03:28.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823295+0000", 2024-04-25T22:03:28.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14056342099999999 2024-04-25T22:03:28.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823578+0000", 2024-04-25T22:03:28.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028355299999999997 2024-04-25T22:03:28.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:28.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823777+0000", 2024-04-25T22:03:28.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000198791 2024-04-25T22:03:28.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826993+0000", 2024-04-25T22:03:28.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032162169999999999 2024-04-25T22:03:28.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828492+0000", 2024-04-25T22:03:28.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001498283 2024-04-25T22:03:28.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828633+0000", 2024-04-25T22:03:28.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000141225 2024-04-25T22:03:28.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828751+0000", 2024-04-25T22:03:28.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000118038 2024-04-25T22:03:28.881 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.881 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.881 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.881 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3899493~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:28.881 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:28.881 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.1201028669999999, 2024-04-25T22:03:28.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14539154500000001, 2024-04-25T22:03:28.881 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.882 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.882 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.882 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:28.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:28.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692307+0000", 2024-04-25T22:03:28.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.216e-06 2024-04-25T22:03:28.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692316+0000", 2024-04-25T22:03:28.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:03:28.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692357+0000", 2024-04-25T22:03:28.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233000000000003e-05 2024-04-25T22:03:28.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692375+0000", 2024-04-25T22:03:28.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7949999999999999e-05 2024-04-25T22:03:28.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828922+0000", 2024-04-25T22:03:28.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.136546426 2024-04-25T22:03:28.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.829064+0000", 2024-04-25T22:03:28.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014193499999999999 2024-04-25T22:03:28.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:28.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.829295+0000", 2024-04-25T22:03:28.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023144100000000001 2024-04-25T22:03:28.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832412+0000", 2024-04-25T22:03:28.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003117112 2024-04-25T22:03:28.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837543+0000", 2024-04-25T22:03:28.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005131147 2024-04-25T22:03:28.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837629+0000", 2024-04-25T22:03:28.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5378999999999997e-05 2024-04-25T22:03:28.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837696+0000", 2024-04-25T22:03:28.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7426000000000001e-05 2024-04-25T22:03:28.886 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.886 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.886 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.886 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3901402~4724 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:28.887 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:28.887 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.1166005659999998, 2024-04-25T22:03:28.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14672065500000001, 2024-04-25T22:03:28.887 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.887 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.887 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.887 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:28.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:28.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695809+0000", 2024-04-25T22:03:28.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1100000000000001e-06 2024-04-25T22:03:28.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695828+0000", 2024-04-25T22:03:28.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8618999999999999e-05 2024-04-25T22:03:28.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695850+0000", 2024-04-25T22:03:28.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2243e-05 2024-04-25T22:03:28.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695864+0000", 2024-04-25T22:03:28.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3687e-05 2024-04-25T22:03:28.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831024+0000", 2024-04-25T22:03:28.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13516004300000001 2024-04-25T22:03:28.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831155+0000", 2024-04-25T22:03:28.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000131605 2024-04-25T22:03:28.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:28.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831353+0000", 2024-04-25T22:03:28.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000197708 2024-04-25T22:03:28.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837521+0000", 2024-04-25T22:03:28.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0061684180000000002 2024-04-25T22:03:28.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842269+0000", 2024-04-25T22:03:28.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047475659999999999 2024-04-25T22:03:28.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842402+0000", 2024-04-25T22:03:28.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000132643 2024-04-25T22:03:28.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842528+0000", 2024-04-25T22:03:28.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012601299999999999 2024-04-25T22:03:28.891 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.892 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.892 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.892 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3906126~6707 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:28.892 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:28.892 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.113338809, 2024-04-25T22:03:28.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14563398599999999, 2024-04-25T22:03:28.892 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.892 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.892 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.892 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:28.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:28.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699071+0000", 2024-04-25T22:03:28.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.996e-06 2024-04-25T22:03:28.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699090+0000", 2024-04-25T22:03:28.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9449999999999998e-05 2024-04-25T22:03:28.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699112+0000", 2024-04-25T22:03:28.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2306e-05 2024-04-25T22:03:28.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699126+0000", 2024-04-25T22:03:28.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.383e-05 2024-04-25T22:03:28.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832497+0000", 2024-04-25T22:03:28.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13337096500000001 2024-04-25T22:03:28.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832632+0000", 2024-04-25T22:03:28.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013481499999999999 2024-04-25T22:03:28.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:28.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832828+0000", 2024-04-25T22:03:28.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000195558 2024-04-25T22:03:28.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837801+0000", 2024-04-25T22:03:28.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049729459999999998 2024-04-25T22:03:28.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844398+0000", 2024-04-25T22:03:28.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065972829999999998 2024-04-25T22:03:28.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844594+0000", 2024-04-25T22:03:28.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000195675 2024-04-25T22:03:28.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844703+0000", 2024-04-25T22:03:28.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109162 2024-04-25T22:03:28.897 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.897 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.897 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.897 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3024 3.d 3:b02ffd62:::200.00000010:head [write 3912833~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:28.897 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:28.897 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.1102740860000004, 2024-04-25T22:03:28.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14279916000000001, 2024-04-25T22:03:28.898 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.898 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.898 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.898 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:28.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:28.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702135+0000", 2024-04-25T22:03:28.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9530000000000002e-06 2024-04-25T22:03:28.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702154+0000", 2024-04-25T22:03:28.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8496e-05 2024-04-25T22:03:28.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702180+0000", 2024-04-25T22:03:28.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6313e-05 2024-04-25T22:03:28.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702205+0000", 2024-04-25T22:03:28.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.478e-05 2024-04-25T22:03:28.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836035+0000", 2024-04-25T22:03:28.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.133830269 2024-04-25T22:03:28.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836168+0000", 2024-04-25T22:03:28.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013234799999999999 2024-04-25T22:03:28.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:28.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836364+0000", 2024-04-25T22:03:28.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000196398 2024-04-25T22:03:28.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844793+0000", 2024-04-25T22:03:28.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.008428685 2024-04-25T22:03:28.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844811+0000", 2024-04-25T22:03:28.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8719000000000002e-05 2024-04-25T22:03:28.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844881+0000", 2024-04-25T22:03:28.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9671000000000004e-05 2024-04-25T22:03:28.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844933+0000", 2024-04-25T22:03:28.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1527999999999999e-05 2024-04-25T22:03:28.903 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.903 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.903 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.903 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3026 3.d 3:b02ffd62:::200.00000010:head [write 3919976~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:28.903 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:28.903 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.1035891480000002, 2024-04-25T22:03:28.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14237590899999999, 2024-04-25T22:03:28.903 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.904 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.904 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.904 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:28.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:28.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708820+0000", 2024-04-25T22:03:28.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7600000000000001e-06 2024-04-25T22:03:28.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708832+0000", 2024-04-25T22:03:28.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1803e-05 2024-04-25T22:03:28.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708854+0000", 2024-04-25T22:03:28.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2467e-05 2024-04-25T22:03:28.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708872+0000", 2024-04-25T22:03:28.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7453e-05 2024-04-25T22:03:28.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842641+0000", 2024-04-25T22:03:28.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13376964099999999 2024-04-25T22:03:28.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842832+0000", 2024-04-25T22:03:28.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000190843 2024-04-25T22:03:28.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:28.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.843194+0000", 2024-04-25T22:03:28.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036169300000000001 2024-04-25T22:03:28.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845406+0000", 2024-04-25T22:03:28.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022118530000000002 2024-04-25T22:03:28.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851048+0000", 2024-04-25T22:03:28.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056423410000000004 2024-04-25T22:03:28.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851127+0000", 2024-04-25T22:03:28.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8461999999999995e-05 2024-04-25T22:03:28.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851194+0000", 2024-04-25T22:03:28.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7593000000000001e-05 2024-04-25T22:03:28.908 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.909 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.909 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.909 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3027 3.d 3:b02ffd62:::200.00000010:head [write 3922740~2927 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:28.909 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:28.909 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.1034838689999997, 2024-04-25T22:03:28.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14516088799999999, 2024-04-25T22:03:28.909 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.909 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.909 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.909 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:28.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:28.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708925+0000", 2024-04-25T22:03:28.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.683e-06 2024-04-25T22:03:28.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708936+0000", 2024-04-25T22:03:28.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.11e-05 2024-04-25T22:03:28.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708960+0000", 2024-04-25T22:03:28.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3839999999999999e-05 2024-04-25T22:03:28.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708977+0000", 2024-04-25T22:03:28.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6379e-05 2024-04-25T22:03:28.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845488+0000", 2024-04-25T22:03:28.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.136511414 2024-04-25T22:03:28.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845619+0000", 2024-04-25T22:03:28.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000130755 2024-04-25T22:03:28.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:28.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845817+0000", 2024-04-25T22:03:28.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000198271 2024-04-25T22:03:28.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849529+0000", 2024-04-25T22:03:28.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003711888 2024-04-25T22:03:28.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.853911+0000", 2024-04-25T22:03:28.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043815800000000004 2024-04-25T22:03:28.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854018+0000", 2024-04-25T22:03:28.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000107879 2024-04-25T22:03:28.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854085+0000", 2024-04-25T22:03:28.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6099000000000005e-05 2024-04-25T22:03:28.914 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.914 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.914 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.914 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3028 3.d 3:b02ffd62:::200.00000010:head [write 3925667~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:28.914 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:28.914 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.1029633250000002, 2024-04-25T22:03:28.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14478423600000001, 2024-04-25T22:03:28.914 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.915 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.915 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.915 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:28.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:28.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709446+0000", 2024-04-25T22:03:28.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.73e-06 2024-04-25T22:03:28.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709454+0000", 2024-04-25T22:03:28.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:03:28.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709470+0000", 2024-04-25T22:03:28.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5956000000000001e-05 2024-04-25T22:03:28.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709483+0000", 2024-04-25T22:03:28.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.216e-05 2024-04-25T22:03:28.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.846891+0000", 2024-04-25T22:03:28.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13740814600000001 2024-04-25T22:03:28.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.847019+0000", 2024-04-25T22:03:28.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000128121 2024-04-25T22:03:28.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:28.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.847227+0000", 2024-04-25T22:03:28.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020847800000000001 2024-04-25T22:03:28.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.852488+0000", 2024-04-25T22:03:28.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052603759999999998 2024-04-25T22:03:28.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854101+0000", 2024-04-25T22:03:28.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001613354 2024-04-25T22:03:28.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854170+0000", 2024-04-25T22:03:28.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8935000000000003e-05 2024-04-25T22:03:28.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854228+0000", 2024-04-25T22:03:28.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8437000000000003e-05 2024-04-25T22:03:28.920 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.920 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.920 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.920 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3029 3.d 3:b02ffd62:::200.00000010:head [write 3927576~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:28.920 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:28.920 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.1028854629999998, 2024-04-25T22:03:28.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14641235599999999, 2024-04-25T22:03:28.920 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.921 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.921 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.921 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:28.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:28.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709523+0000", 2024-04-25T22:03:28.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9999999999999995e-07 2024-04-25T22:03:28.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709530+0000", 2024-04-25T22:03:28.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7900000000000002e-06 2024-04-25T22:03:28.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709545+0000", 2024-04-25T22:03:28.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5563e-05 2024-04-25T22:03:28.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709554+0000", 2024-04-25T22:03:28.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7700000000000007e-06 2024-04-25T22:03:28.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848071+0000", 2024-04-25T22:03:28.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13851706499999999 2024-04-25T22:03:28.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848219+0000", 2024-04-25T22:03:28.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014761599999999999 2024-04-25T22:03:28.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:28.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848412+0000", 2024-04-25T22:03:28.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019303300000000001 2024-04-25T22:03:28.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854240+0000", 2024-04-25T22:03:28.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058282359999999997 2024-04-25T22:03:28.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855804+0000", 2024-04-25T22:03:28.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001563938 2024-04-25T22:03:28.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855879+0000", 2024-04-25T22:03:28.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4683000000000003e-05 2024-04-25T22:03:28.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855934+0000", 2024-04-25T22:03:28.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5661999999999997e-05 2024-04-25T22:03:28.925 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.925 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.925 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.926 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3030 3.d 3:b02ffd62:::200.00000010:head [write 3929994~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:28.926 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:28.926 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.1014670540000004, 2024-04-25T22:03:28.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.146870588, 2024-04-25T22:03:28.926 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.926 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.926 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.926 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:28.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:28.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710942+0000", 2024-04-25T22:03:28.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.024e-06 2024-04-25T22:03:28.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710955+0000", 2024-04-25T22:03:28.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2103000000000001e-05 2024-04-25T22:03:28.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710977+0000", 2024-04-25T22:03:28.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2606e-05 2024-04-25T22:03:28.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710991+0000", 2024-04-25T22:03:28.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3689999999999999e-05 2024-04-25T22:03:28.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849638+0000", 2024-04-25T22:03:28.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.138646667 2024-04-25T22:03:28.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849809+0000", 2024-04-25T22:03:28.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000171495 2024-04-25T22:03:28.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:28.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.850048+0000", 2024-04-25T22:03:28.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023940699999999999 2024-04-25T22:03:28.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855954+0000", 2024-04-25T22:03:28.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059050919999999998 2024-04-25T22:03:28.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857670+0000", 2024-04-25T22:03:28.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017168489999999999 2024-04-25T22:03:28.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857747+0000", 2024-04-25T22:03:28.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6526000000000006e-05 2024-04-25T22:03:28.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857811+0000", 2024-04-25T22:03:28.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4128999999999995e-05 2024-04-25T22:03:28.930 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.931 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.931 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.931 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3031 3.d 3:b02ffd62:::200.00000010:head [write 3932758~2245 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:28.931 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:28.931 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.1012566059999997, 2024-04-25T22:03:28.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14694558999999999, 2024-04-25T22:03:28.931 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:28.931 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:28.931 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:28.931 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:28.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:28.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:28.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:28.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:28.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:28.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:28.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711152+0000", 2024-04-25T22:03:28.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5230000000000001e-06 2024-04-25T22:03:28.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:28.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711162+0000", 2024-04-25T22:03:28.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2299999999999997e-06 2024-04-25T22:03:28.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:28.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711179+0000", 2024-04-25T22:03:28.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7220000000000001e-05 2024-04-25T22:03:28.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:28.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711190+0000", 2024-04-25T22:03:28.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1323e-05 2024-04-25T22:03:28.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:28.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851296+0000", 2024-04-25T22:03:28.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14010541600000001 2024-04-25T22:03:28.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:28.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851436+0000", 2024-04-25T22:03:28.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140409 2024-04-25T22:03:28.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:28.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851641+0000", 2024-04-25T22:03:28.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020471700000000001 2024-04-25T22:03:28.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:28.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857847+0000", 2024-04-25T22:03:28.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062065310000000004 2024-04-25T22:03:28.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:28.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857952+0000", 2024-04-25T22:03:28.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105132 2024-04-25T22:03:28.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:28.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.858026+0000", 2024-04-25T22:03:28.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3799000000000003e-05 2024-04-25T22:03:28.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:28.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:28.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:28.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.858096+0000", 2024-04-25T22:03:28.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0290000000000006e-05 2024-04-25T22:03:28.936 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.936 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.936 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.936 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:28.936 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:28.936 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:28.937 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:28.932+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:28.938 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:29.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:29.037+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:29.071 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:29.071 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:29.071 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:03:29.071 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:29.085 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:29.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:29.169+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:29.221 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:03:29.240 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:29.236+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:29.249 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:29.249 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:29.249 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:03:29.249 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:03:29.249 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:29.263 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:29.342 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:29.336+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:29.382 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:29.382 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:29.403 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:29.403 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:29.424 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:29.425 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:29.439 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:29.439 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:29.442 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:29.440+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:29.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:29.491 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T22:03:29.491 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T22:03:29.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:29.541+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:29.583 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:29.583 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:29.598 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:29.645 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:29.644+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:29.727 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:29.727 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:29.741 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:29.745 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:29.744+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:29.832 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:03:29.846 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:29.840+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:29.890 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:29.890 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:29.904 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:29.953 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:29.952+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:30.040 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:30.040 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:30.048 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:30.044+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:30.055 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:30.148 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:30.144+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:30.230 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:30.230 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:30.245 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:30.293 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:30.292+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:30.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:30.345+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:30.427 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:30.427 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:30.442 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:30.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:30.485+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:30.552 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:30.548+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:30.578 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:30.578 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:30.592 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:30.653 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:30.652+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:30.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:30.749+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:30.772 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:30.772 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:30.791 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:30.830 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-25T22:03:30.856 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:30.848+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:30.957 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:30.953+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:30.957 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:30.957 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:30.972 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:31.058 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:31.052+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:31.104 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:31.104 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:31.119 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:31.161 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:31.156+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:31.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:31.257+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:31.283 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:31.283 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:31.297 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:31.360 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:31.356+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:31.416 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:31.416 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:31.432 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:31.442 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:03:31.481 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:31.480+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:31.561 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:31.556+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:31.571 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:31.571 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:31.586 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:31.591 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:31.592 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:31.614 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:31.614 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:31.635 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:31.636 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:31.662 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:31.656+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:31.734 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:03:31.734 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:03:31.734 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-25T22:03:31.734 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.807073 2024-04-25T22:03:31.734 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.8070727933525811 2024-04-25T22:03:31.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:31.761+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:31.766 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:31.766 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:31.766 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:03:31.766 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:03:31.766 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:31.782 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:31.865 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:31.860+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:31.910 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:31.910 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:03:31.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:03:31.911 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:31.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.911 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T22:03:31.911 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:31.911 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 39.923647668999998, 2024-04-25T22:03:31.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.180276931, 2024-04-25T22:03:31.911 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:31.911 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:31.911 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:31.911 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:31.911 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:31.911 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:31.911 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4 2024-04-25T22:03:31.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.912 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:31.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:31.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:31.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:31.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:31.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:31.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983834+0000", 2024-04-25T22:03:31.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2900000000000001e-06 2024-04-25T22:03:31.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:31.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991787+0000", 2024-04-25T22:03:31.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079521690000000003 2024-04-25T22:03:31.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:31.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991826+0000", 2024-04-25T22:03:31.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9258999999999998e-05 2024-04-25T22:03:31.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:31.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991845+0000", 2024-04-25T22:03:31.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9360000000000001e-05 2024-04-25T22:03:31.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992058+0000", 2024-04-25T22:03:31.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212559 2024-04-25T22:03:31.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:31.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992213+0000", 2024-04-25T22:03:31.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015520700000000001 2024-04-25T22:03:31.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:31.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992414+0000", 2024-04-25T22:03:31.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020049 2024-04-25T22:03:31.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:31.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162511+0000", 2024-04-25T22:03:31.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.17009782900000001 2024-04-25T22:03:31.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:31.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163967+0000", 2024-04-25T22:03:31.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001455752 2024-04-25T22:03:31.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:31.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164045+0000", 2024-04-25T22:03:31.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7415000000000003e-05 2024-04-25T22:03:31.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:31.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164109+0000", 2024-04-25T22:03:31.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4601e-05 2024-04-25T22:03:31.916 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.916 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:31.916 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.916 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6847 4.16 4:68767fd1:::10000001f4f.00000000:head [write 0~7212] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:31.917 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:31.917 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.214008207999999, 2024-04-25T22:03:31.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0208302119999999, 2024-04-25T22:03:31.917 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:31.917 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:31.917 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:31.917 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:31.917 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:31.917 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:31.917 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6847 2024-04-25T22:03:31.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.917 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:31.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:31.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:31.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:31.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:31.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:31.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693473+0000", 2024-04-25T22:03:31.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.75e-06 2024-04-25T22:03:31.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:31.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693490+0000", 2024-04-25T22:03:31.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6540000000000001e-05 2024-04-25T22:03:31.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:31.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693509+0000", 2024-04-25T22:03:31.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9536999999999999e-05 2024-04-25T22:03:31.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:31.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693522+0000", 2024-04-25T22:03:31.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2099000000000001e-05 2024-04-25T22:03:31.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693677+0000", 2024-04-25T22:03:31.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015516799999999999 2024-04-25T22:03:31.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:31.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693705+0000", 2024-04-25T22:03:31.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8663e-05 2024-04-25T22:03:31.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705551+0000", 2024-04-25T22:03:31.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.011845495 2024-04-25T22:03:31.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:31.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705942+0000", 2024-04-25T22:03:31.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00039080099999999997 2024-04-25T22:03:31.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:31.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.706151+0000", 2024-04-25T22:03:31.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000209457 2024-04-25T22:03:31.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:31.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711141+0000", 2024-04-25T22:03:31.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049901240000000003 2024-04-25T22:03:31.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:31.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714005+0000", 2024-04-25T22:03:31.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028642229999999999 2024-04-25T22:03:31.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:31.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714180+0000", 2024-04-25T22:03:31.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017433699999999999 2024-04-25T22:03:31.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:31.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714302+0000", 2024-04-25T22:03:31.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122018 2024-04-25T22:03:31.922 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.922 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:31.922 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.923 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6960 4.16 4:6823d322:::10000001fd2.00000000:head [write 0~150] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:31.923 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:31.923 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.93700411, 2024-04-25T22:03:31.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.74417278899999995, 2024-04-25T22:03:31.923 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:31.923 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:31.923 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:31.923 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:31.923 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:31.923 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:31.923 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6960 2024-04-25T22:03:31.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.923 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:31.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:31.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:31.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:31.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:31.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:31.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970478+0000", 2024-04-25T22:03:31.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.939e-06 2024-04-25T22:03:31.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:31.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970488+0000", 2024-04-25T22:03:31.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9699999999999994e-06 2024-04-25T22:03:31.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:31.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970524+0000", 2024-04-25T22:03:31.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5963000000000001e-05 2024-04-25T22:03:31.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:31.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970537+0000", 2024-04-25T22:03:31.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.31e-05 2024-04-25T22:03:31.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970701+0000", 2024-04-25T22:03:31.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164177 2024-04-25T22:03:31.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:31.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970718+0000", 2024-04-25T22:03:31.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7323e-05 2024-04-25T22:03:31.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707632+0000", 2024-04-25T22:03:31.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.73691394300000002 2024-04-25T22:03:31.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:31.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707924+0000", 2024-04-25T22:03:31.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029223299999999998 2024-04-25T22:03:31.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:31.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.708389+0000", 2024-04-25T22:03:31.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046429300000000001 2024-04-25T22:03:31.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:31.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:31.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029039830000000002 2024-04-25T22:03:31.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:31.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714409+0000", 2024-04-25T22:03:31.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031159260000000002 2024-04-25T22:03:31.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:31.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714538+0000", 2024-04-25T22:03:31.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012952100000000001 2024-04-25T22:03:31.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:31.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714649+0000", 2024-04-25T22:03:31.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110418 2024-04-25T22:03:31.928 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.928 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:31.929 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.929 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7039 4.16 4:6919637e:::10000002032.00000000:head [write 0~2968] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:31.929 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:31.929 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.750957605, 2024-04-25T22:03:31.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.56024932199999999, 2024-04-25T22:03:31.929 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:31.929 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:31.929 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:31.929 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:31.929 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:31.929 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:31.929 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7039 2024-04-25T22:03:31.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.930 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:31.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:31.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:31.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:31.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:31.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:31.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156523+0000", 2024-04-25T22:03:31.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2130000000000001e-06 2024-04-25T22:03:31.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:31.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156530+0000", 2024-04-25T22:03:31.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9090000000000003e-06 2024-04-25T22:03:31.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:31.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156544+0000", 2024-04-25T22:03:31.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3271999999999999e-05 2024-04-25T22:03:31.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:31.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156551+0000", 2024-04-25T22:03:31.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4970000000000004e-06 2024-04-25T22:03:31.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156639+0000", 2024-04-25T22:03:31.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7638000000000004e-05 2024-04-25T22:03:31.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:31.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156649+0000", 2024-04-25T22:03:31.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0536e-05 2024-04-25T22:03:31.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709515+0000", 2024-04-25T22:03:31.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.55286568999999997 2024-04-25T22:03:31.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:31.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709836+0000", 2024-04-25T22:03:31.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032078899999999998 2024-04-25T22:03:31.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:31.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.710271+0000", 2024-04-25T22:03:31.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043530000000000001 2024-04-25T22:03:31.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:31.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716576+0000", 2024-04-25T22:03:31.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063045050000000002 2024-04-25T22:03:31.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:31.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716605+0000", 2024-04-25T22:03:31.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8949e-05 2024-04-25T22:03:31.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:31.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716706+0000", 2024-04-25T22:03:31.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101765 2024-04-25T22:03:31.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:31.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716772+0000", 2024-04-25T22:03:31.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5259000000000007e-05 2024-04-25T22:03:31.935 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.935 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:31.935 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.935 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7065 4.16 4:697a9f10:::10000002050.00000000:head [write 0~16297] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:31.935 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:31.935 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.693341657000001, 2024-04-25T22:03:31.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.50307290800000004, 2024-04-25T22:03:31.935 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:31.935 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:31.935 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:31.935 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:31.935 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:31.936 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:31.936 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7065 2024-04-25T22:03:31.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.936 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:31.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:31.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:31.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:31.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:31.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:31.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214139+0000", 2024-04-25T22:03:31.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.186e-06 2024-04-25T22:03:31.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:31.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214170+0000", 2024-04-25T22:03:31.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0419000000000001e-05 2024-04-25T22:03:31.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:31.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214186+0000", 2024-04-25T22:03:31.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6526000000000001e-05 2024-04-25T22:03:31.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:31.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214194+0000", 2024-04-25T22:03:31.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6769999999999995e-06 2024-04-25T22:03:31.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214380+0000", 2024-04-25T22:03:31.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018580699999999999 2024-04-25T22:03:31.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:31.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214399+0000", 2024-04-25T22:03:31.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9446e-05 2024-04-25T22:03:31.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711402+0000", 2024-04-25T22:03:31.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.497002901 2024-04-25T22:03:31.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:31.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711822+0000", 2024-04-25T22:03:31.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00041989399999999997 2024-04-25T22:03:31.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:31.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.712017+0000", 2024-04-25T22:03:31.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019540700000000001 2024-04-25T22:03:31.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:31.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716792+0000", 2024-04-25T22:03:31.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047748210000000003 2024-04-25T22:03:31.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:31.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716937+0000", 2024-04-25T22:03:31.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014479099999999999 2024-04-25T22:03:31.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:31.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717081+0000", 2024-04-25T22:03:31.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014412100000000001 2024-04-25T22:03:31.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:31.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717211+0000", 2024-04-25T22:03:31.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012991200000000001 2024-04-25T22:03:31.941 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.941 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:31.941 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.941 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7089 4.16 4:6868fcac:::1000000206b.00000000:head [write 0~5386] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:31.941 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:31.941 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.633787663, 2024-04-25T22:03:31.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44658810700000001, 2024-04-25T22:03:31.941 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:31.941 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:31.942 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:31.942 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:31.942 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:31.942 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:31.942 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7089 2024-04-25T22:03:31.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.942 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:31.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:31.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:31.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:31.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:31.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:31.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273695+0000", 2024-04-25T22:03:31.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.463e-06 2024-04-25T22:03:31.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:31.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273712+0000", 2024-04-25T22:03:31.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7842999999999998e-05 2024-04-25T22:03:31.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:31.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273742+0000", 2024-04-25T22:03:31.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9039000000000001e-05 2024-04-25T22:03:31.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:31.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273756+0000", 2024-04-25T22:03:31.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4406999999999999e-05 2024-04-25T22:03:31.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273943+0000", 2024-04-25T22:03:31.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018708 2024-04-25T22:03:31.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:31.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273961+0000", 2024-04-25T22:03:31.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7977000000000001e-05 2024-04-25T22:03:31.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714748+0000", 2024-04-25T22:03:31.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.440786605 2024-04-25T22:03:31.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:31.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715013+0000", 2024-04-25T22:03:31.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026558300000000001 2024-04-25T22:03:31.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:31.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715309+0000", 2024-04-25T22:03:31.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000295715 2024-04-25T22:03:31.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:31.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.719035+0000", 2024-04-25T22:03:31.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037256310000000001 2024-04-25T22:03:31.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:31.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720142+0000", 2024-04-25T22:03:31.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001107053 2024-04-25T22:03:31.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:31.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720221+0000", 2024-04-25T22:03:31.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9832000000000004e-05 2024-04-25T22:03:31.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:31.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720280+0000", 2024-04-25T22:03:31.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8879000000000003e-05 2024-04-25T22:03:31.947 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.947 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:31.947 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.948 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7090 4.16 4:69dc3034:::1000000206c.00000000:head [write 0~957] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:31.948 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:31.948 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.631163333, 2024-04-25T22:03:31.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44572077100000002, 2024-04-25T22:03:31.948 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:31.948 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:31.948 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:31.948 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:31.948 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:31.948 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:31.948 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7090 2024-04-25T22:03:31.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.948 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:31.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:31.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:31.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:31.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:31.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:31.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276319+0000", 2024-04-25T22:03:31.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3429999999999998e-06 2024-04-25T22:03:31.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:31.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276330+0000", 2024-04-25T22:03:31.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1567e-05 2024-04-25T22:03:31.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:31.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276362+0000", 2024-04-25T22:03:31.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1863000000000003e-05 2024-04-25T22:03:31.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:31.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276377+0000", 2024-04-25T22:03:31.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5102999999999999e-05 2024-04-25T22:03:31.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276564+0000", 2024-04-25T22:03:31.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018629700000000001 2024-04-25T22:03:31.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:31.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276583+0000", 2024-04-25T22:03:31.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9743000000000001e-05 2024-04-25T22:03:31.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717354+0000", 2024-04-25T22:03:31.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44077094900000002 2024-04-25T22:03:31.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:31.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717723+0000", 2024-04-25T22:03:31.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036839099999999998 2024-04-25T22:03:31.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:31.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.718097+0000", 2024-04-25T22:03:31.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037392099999999999 2024-04-25T22:03:31.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:31.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720305+0000", 2024-04-25T22:03:31.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022084439999999999 2024-04-25T22:03:31.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:31.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721866+0000", 2024-04-25T22:03:31.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015610260000000001 2024-04-25T22:03:31.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:31.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721944+0000", 2024-04-25T22:03:31.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7961999999999997e-05 2024-04-25T22:03:31.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:31.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.722037+0000", 2024-04-25T22:03:31.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3162e-05 2024-04-25T22:03:31.954 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.954 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:31.954 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.955 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:10647 4.35 4:ae7b229b:::100000030a9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:31.955 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:31.955 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.378118639, 2024-04-25T22:03:31.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14506126, 2024-04-25T22:03:31.955 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:31.955 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:31.955 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:31.955 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:31.955 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:31.955 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:31.955 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10647 2024-04-25T22:03:31.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.955 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:31.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:31.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:31.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:31.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:31.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:31.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529364+0000", 2024-04-25T22:03:31.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.286e-06 2024-04-25T22:03:31.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:31.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538917+0000", 2024-04-25T22:03:31.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0095530010000000002 2024-04-25T22:03:31.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:31.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538955+0000", 2024-04-25T22:03:31.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:03:31.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:31.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538977+0000", 2024-04-25T22:03:31.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.105e-05 2024-04-25T22:03:31.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568092+0000", 2024-04-25T22:03:31.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029115604999999999 2024-04-25T22:03:31.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:31.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568243+0000", 2024-04-25T22:03:31.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000151044 2024-04-25T22:03:31.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:31.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568498+0000", 2024-04-25T22:03:31.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025517399999999999 2024-04-25T22:03:31.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:31.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628005+0000", 2024-04-25T22:03:31.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059506991000000002 2024-04-25T22:03:31.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:31.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674273+0000", 2024-04-25T22:03:31.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.046267233999999997 2024-04-25T22:03:31.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:31.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674357+0000", 2024-04-25T22:03:31.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4745000000000003e-05 2024-04-25T22:03:31.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:31.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674422+0000", 2024-04-25T22:03:31.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5160999999999995e-05 2024-04-25T22:03:31.960 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.960 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:31.960 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.960 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3891938~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:31.960 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:31.960 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 7.2247990529999999, 2024-04-25T22:03:31.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.144195727, 2024-04-25T22:03:31.960 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:31.960 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:31.960 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:31.960 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:31.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:31.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:31.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:31.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:31.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:31.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682682+0000", 2024-04-25T22:03:31.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6000000000000003e-07 2024-04-25T22:03:31.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:31.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682686+0000", 2024-04-25T22:03:31.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4630000000000003e-06 2024-04-25T22:03:31.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:31.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682695+0000", 2024-04-25T22:03:31.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7360000000000007e-06 2024-04-25T22:03:31.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:31.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682702+0000", 2024-04-25T22:03:31.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1239999999999999e-06 2024-04-25T22:03:31.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821515+0000", 2024-04-25T22:03:31.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13881310499999999 2024-04-25T22:03:31.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:31.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821780+0000", 2024-04-25T22:03:31.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026492699999999998 2024-04-25T22:03:31.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:31.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821974+0000", 2024-04-25T22:03:31.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000194561 2024-04-25T22:03:31.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:31.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826533+0000", 2024-04-25T22:03:31.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045586649999999999 2024-04-25T22:03:31.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:31.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826574+0000", 2024-04-25T22:03:31.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0995999999999998e-05 2024-04-25T22:03:31.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:31.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826754+0000", 2024-04-25T22:03:31.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017955400000000001 2024-04-25T22:03:31.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:31.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826877+0000", 2024-04-25T22:03:31.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122836 2024-04-25T22:03:31.965 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.965 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:31.965 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.965 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3893337~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:31.965 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:31.965 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 7.2247692199999998, 2024-04-25T22:03:31.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.146040321, 2024-04-25T22:03:31.965 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:31.966 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:31.966 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:31.966 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:31.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:31.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:31.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:31.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:31.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:31.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:31.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:03:31.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:31.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682716+0000", 2024-04-25T22:03:31.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3930000000000001e-06 2024-04-25T22:03:31.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:31.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682724+0000", 2024-04-25T22:03:31.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5769999999999994e-06 2024-04-25T22:03:31.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:31.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682731+0000", 2024-04-25T22:03:31.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1629999999999999e-06 2024-04-25T22:03:31.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823295+0000", 2024-04-25T22:03:31.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14056342099999999 2024-04-25T22:03:31.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:31.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823578+0000", 2024-04-25T22:03:31.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028355299999999997 2024-04-25T22:03:31.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:31.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823777+0000", 2024-04-25T22:03:31.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000198791 2024-04-25T22:03:31.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:31.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826993+0000", 2024-04-25T22:03:31.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032162169999999999 2024-04-25T22:03:31.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:31.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828492+0000", 2024-04-25T22:03:31.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001498283 2024-04-25T22:03:31.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:31.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828633+0000", 2024-04-25T22:03:31.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000141225 2024-04-25T22:03:31.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:31.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828751+0000", 2024-04-25T22:03:31.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000118038 2024-04-25T22:03:31.970 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.970 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:31.970 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.970 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3899493~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:31.970 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:31.970 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 7.2151752059999996, 2024-04-25T22:03:31.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14539154500000001, 2024-04-25T22:03:31.970 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:31.970 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:31.971 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:31.971 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:31.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:31.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:31.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:31.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:31.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:31.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692307+0000", 2024-04-25T22:03:31.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.216e-06 2024-04-25T22:03:31.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:31.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692316+0000", 2024-04-25T22:03:31.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:03:31.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:31.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692357+0000", 2024-04-25T22:03:31.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233000000000003e-05 2024-04-25T22:03:31.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:31.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692375+0000", 2024-04-25T22:03:31.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7949999999999999e-05 2024-04-25T22:03:31.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828922+0000", 2024-04-25T22:03:31.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.136546426 2024-04-25T22:03:31.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:31.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.829064+0000", 2024-04-25T22:03:31.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014193499999999999 2024-04-25T22:03:31.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:31.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.829295+0000", 2024-04-25T22:03:31.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023144100000000001 2024-04-25T22:03:31.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:31.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832412+0000", 2024-04-25T22:03:31.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003117112 2024-04-25T22:03:31.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:31.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837543+0000", 2024-04-25T22:03:31.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005131147 2024-04-25T22:03:31.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:31.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837629+0000", 2024-04-25T22:03:31.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5378999999999997e-05 2024-04-25T22:03:31.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:31.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837696+0000", 2024-04-25T22:03:31.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7426000000000001e-05 2024-04-25T22:03:31.975 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.975 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:31.975 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.975 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3901402~4724 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:31.975 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:31.975 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 7.2116729050000004, 2024-04-25T22:03:31.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14672065500000001, 2024-04-25T22:03:31.976 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:31.976 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:31.976 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:31.976 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:31.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:31.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:31.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:31.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:31.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:31.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695809+0000", 2024-04-25T22:03:31.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1100000000000001e-06 2024-04-25T22:03:31.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:31.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695828+0000", 2024-04-25T22:03:31.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8618999999999999e-05 2024-04-25T22:03:31.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:31.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695850+0000", 2024-04-25T22:03:31.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2243e-05 2024-04-25T22:03:31.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:31.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695864+0000", 2024-04-25T22:03:31.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3687e-05 2024-04-25T22:03:31.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831024+0000", 2024-04-25T22:03:31.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13516004300000001 2024-04-25T22:03:31.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:31.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831155+0000", 2024-04-25T22:03:31.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000131605 2024-04-25T22:03:31.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:31.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831353+0000", 2024-04-25T22:03:31.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000197708 2024-04-25T22:03:31.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:31.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837521+0000", 2024-04-25T22:03:31.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0061684180000000002 2024-04-25T22:03:31.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:31.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842269+0000", 2024-04-25T22:03:31.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047475659999999999 2024-04-25T22:03:31.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:31.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842402+0000", 2024-04-25T22:03:31.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000132643 2024-04-25T22:03:31.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:31.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842528+0000", 2024-04-25T22:03:31.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012601299999999999 2024-04-25T22:03:31.980 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.980 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:31.980 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.980 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3906126~6707 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:31.980 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:31.981 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 7.2084111479999997, 2024-04-25T22:03:31.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14563398599999999, 2024-04-25T22:03:31.981 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:31.981 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:31.981 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:31.981 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:31.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:31.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:31.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:31.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:31.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:31.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699071+0000", 2024-04-25T22:03:31.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.996e-06 2024-04-25T22:03:31.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:31.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699090+0000", 2024-04-25T22:03:31.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9449999999999998e-05 2024-04-25T22:03:31.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:31.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699112+0000", 2024-04-25T22:03:31.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2306e-05 2024-04-25T22:03:31.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:31.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699126+0000", 2024-04-25T22:03:31.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.383e-05 2024-04-25T22:03:31.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832497+0000", 2024-04-25T22:03:31.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13337096500000001 2024-04-25T22:03:31.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:31.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832632+0000", 2024-04-25T22:03:31.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013481499999999999 2024-04-25T22:03:31.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:31.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832828+0000", 2024-04-25T22:03:31.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000195558 2024-04-25T22:03:31.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:31.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837801+0000", 2024-04-25T22:03:31.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049729459999999998 2024-04-25T22:03:31.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:31.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844398+0000", 2024-04-25T22:03:31.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065972829999999998 2024-04-25T22:03:31.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:31.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844594+0000", 2024-04-25T22:03:31.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000195675 2024-04-25T22:03:31.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:31.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844703+0000", 2024-04-25T22:03:31.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109162 2024-04-25T22:03:31.985 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.985 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:31.985 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.985 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3024 3.d 3:b02ffd62:::200.00000010:head [write 3912833~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:31.985 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:31.985 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 7.2053464250000001, 2024-04-25T22:03:31.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14279916000000001, 2024-04-25T22:03:31.986 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:31.986 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:31.986 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:31.986 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:31.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:31.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:31.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:31.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:31.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:31.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702135+0000", 2024-04-25T22:03:31.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9530000000000002e-06 2024-04-25T22:03:31.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:31.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702154+0000", 2024-04-25T22:03:31.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8496e-05 2024-04-25T22:03:31.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:31.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702180+0000", 2024-04-25T22:03:31.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6313e-05 2024-04-25T22:03:31.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:31.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702205+0000", 2024-04-25T22:03:31.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.478e-05 2024-04-25T22:03:31.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836035+0000", 2024-04-25T22:03:31.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.133830269 2024-04-25T22:03:31.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:31.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836168+0000", 2024-04-25T22:03:31.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013234799999999999 2024-04-25T22:03:31.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:31.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836364+0000", 2024-04-25T22:03:31.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000196398 2024-04-25T22:03:31.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:31.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844793+0000", 2024-04-25T22:03:31.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.008428685 2024-04-25T22:03:31.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:31.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844811+0000", 2024-04-25T22:03:31.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8719000000000002e-05 2024-04-25T22:03:31.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:31.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844881+0000", 2024-04-25T22:03:31.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9671000000000004e-05 2024-04-25T22:03:31.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:31.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844933+0000", 2024-04-25T22:03:31.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1527999999999999e-05 2024-04-25T22:03:31.990 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.990 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:31.990 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.991 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3026 3.d 3:b02ffd62:::200.00000010:head [write 3919976~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:31.991 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:31.991 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 7.1986614869999999, 2024-04-25T22:03:31.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14237590899999999, 2024-04-25T22:03:31.991 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:31.991 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:31.991 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:31.991 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:31.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:31.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:31.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:31.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:31.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:31.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708820+0000", 2024-04-25T22:03:31.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7600000000000001e-06 2024-04-25T22:03:31.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:31.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708832+0000", 2024-04-25T22:03:31.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1803e-05 2024-04-25T22:03:31.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:31.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708854+0000", 2024-04-25T22:03:31.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2467e-05 2024-04-25T22:03:31.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:31.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708872+0000", 2024-04-25T22:03:31.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7453e-05 2024-04-25T22:03:31.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842641+0000", 2024-04-25T22:03:31.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13376964099999999 2024-04-25T22:03:31.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:31.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842832+0000", 2024-04-25T22:03:31.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000190843 2024-04-25T22:03:31.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:31.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.843194+0000", 2024-04-25T22:03:31.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036169300000000001 2024-04-25T22:03:31.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:31.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845406+0000", 2024-04-25T22:03:31.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022118530000000002 2024-04-25T22:03:31.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:31.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851048+0000", 2024-04-25T22:03:31.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056423410000000004 2024-04-25T22:03:31.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:31.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851127+0000", 2024-04-25T22:03:31.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8461999999999995e-05 2024-04-25T22:03:31.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:31.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851194+0000", 2024-04-25T22:03:31.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7593000000000001e-05 2024-04-25T22:03:31.995 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.996 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:31.996 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:31.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.996 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3027 3.d 3:b02ffd62:::200.00000010:head [write 3922740~2927 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:31.996 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:31.996 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 7.1985562080000003, 2024-04-25T22:03:31.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14516088799999999, 2024-04-25T22:03:31.996 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:31.996 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:31.996 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:31.996 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:31.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:31.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:31.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:31.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:31.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:31.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:31.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708925+0000", 2024-04-25T22:03:31.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.683e-06 2024-04-25T22:03:31.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:31.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708936+0000", 2024-04-25T22:03:31.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.11e-05 2024-04-25T22:03:31.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:31.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708960+0000", 2024-04-25T22:03:31.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3839999999999999e-05 2024-04-25T22:03:31.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:31.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708977+0000", 2024-04-25T22:03:31.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6379e-05 2024-04-25T22:03:31.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:31.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845488+0000", 2024-04-25T22:03:31.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.136511414 2024-04-25T22:03:31.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:31.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845619+0000", 2024-04-25T22:03:31.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000130755 2024-04-25T22:03:31.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:31.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845817+0000", 2024-04-25T22:03:31.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000198271 2024-04-25T22:03:31.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:31.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:31.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849529+0000", 2024-04-25T22:03:32.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003711888 2024-04-25T22:03:32.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:32.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.853911+0000", 2024-04-25T22:03:32.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043815800000000004 2024-04-25T22:03:32.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:32.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854018+0000", 2024-04-25T22:03:32.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000107879 2024-04-25T22:03:32.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:32.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854085+0000", 2024-04-25T22:03:32.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6099000000000005e-05 2024-04-25T22:03:32.001 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:32.001 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:32.001 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:32.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.001 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3028 3.d 3:b02ffd62:::200.00000010:head [write 3925667~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:32.001 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:32.001 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 7.1980356639999998, 2024-04-25T22:03:32.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14478423600000001, 2024-04-25T22:03:32.001 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:32.001 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:32.001 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.002 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:32.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:32.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:32.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:32.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:32.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:32.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:32.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:32.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709446+0000", 2024-04-25T22:03:32.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.73e-06 2024-04-25T22:03:32.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:32.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709454+0000", 2024-04-25T22:03:32.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:03:32.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:32.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709470+0000", 2024-04-25T22:03:32.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5956000000000001e-05 2024-04-25T22:03:32.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709483+0000", 2024-04-25T22:03:32.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.216e-05 2024-04-25T22:03:32.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:32.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.846891+0000", 2024-04-25T22:03:32.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13740814600000001 2024-04-25T22:03:32.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:32.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.847019+0000", 2024-04-25T22:03:32.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000128121 2024-04-25T22:03:32.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.847227+0000", 2024-04-25T22:03:32.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020847800000000001 2024-04-25T22:03:32.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.852488+0000", 2024-04-25T22:03:32.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052603759999999998 2024-04-25T22:03:32.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:32.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854101+0000", 2024-04-25T22:03:32.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001613354 2024-04-25T22:03:32.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:32.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854170+0000", 2024-04-25T22:03:32.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8935000000000003e-05 2024-04-25T22:03:32.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:32.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854228+0000", 2024-04-25T22:03:32.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8437000000000003e-05 2024-04-25T22:03:32.006 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:32.006 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:32.006 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:32.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.006 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3029 3.d 3:b02ffd62:::200.00000010:head [write 3927576~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:32.006 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:32.007 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 7.1979578020000003, 2024-04-25T22:03:32.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14641235599999999, 2024-04-25T22:03:32.007 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:32.007 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:32.007 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.007 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:32.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:32.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:32.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:32.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:32.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:32.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:32.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:32.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709523+0000", 2024-04-25T22:03:32.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9999999999999995e-07 2024-04-25T22:03:32.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:32.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709530+0000", 2024-04-25T22:03:32.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7900000000000002e-06 2024-04-25T22:03:32.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:32.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709545+0000", 2024-04-25T22:03:32.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5563e-05 2024-04-25T22:03:32.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709554+0000", 2024-04-25T22:03:32.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7700000000000007e-06 2024-04-25T22:03:32.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:32.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848071+0000", 2024-04-25T22:03:32.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13851706499999999 2024-04-25T22:03:32.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:32.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848219+0000", 2024-04-25T22:03:32.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014761599999999999 2024-04-25T22:03:32.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848412+0000", 2024-04-25T22:03:32.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019303300000000001 2024-04-25T22:03:32.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:32.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854240+0000", 2024-04-25T22:03:32.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058282359999999997 2024-04-25T22:03:32.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855804+0000", 2024-04-25T22:03:32.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001563938 2024-04-25T22:03:32.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:32.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855879+0000", 2024-04-25T22:03:32.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4683000000000003e-05 2024-04-25T22:03:32.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:32.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855934+0000", 2024-04-25T22:03:32.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5661999999999997e-05 2024-04-25T22:03:32.011 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:32.011 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:32.011 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:32.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.012 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3030 3.d 3:b02ffd62:::200.00000010:head [write 3929994~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:32.012 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:32.012 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 7.1965393930000001, 2024-04-25T22:03:32.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.146870588, 2024-04-25T22:03:32.012 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:32.012 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:32.012 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.012 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:32.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:32.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:32.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:32.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:32.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:32.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:32.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:32.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710942+0000", 2024-04-25T22:03:32.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.024e-06 2024-04-25T22:03:32.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:32.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710955+0000", 2024-04-25T22:03:32.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2103000000000001e-05 2024-04-25T22:03:32.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:32.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710977+0000", 2024-04-25T22:03:32.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2606e-05 2024-04-25T22:03:32.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710991+0000", 2024-04-25T22:03:32.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3689999999999999e-05 2024-04-25T22:03:32.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:32.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849638+0000", 2024-04-25T22:03:32.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.138646667 2024-04-25T22:03:32.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:32.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849809+0000", 2024-04-25T22:03:32.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000171495 2024-04-25T22:03:32.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.850048+0000", 2024-04-25T22:03:32.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023940699999999999 2024-04-25T22:03:32.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:32.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855954+0000", 2024-04-25T22:03:32.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059050919999999998 2024-04-25T22:03:32.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857670+0000", 2024-04-25T22:03:32.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017168489999999999 2024-04-25T22:03:32.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:32.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857747+0000", 2024-04-25T22:03:32.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6526000000000006e-05 2024-04-25T22:03:32.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:32.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857811+0000", 2024-04-25T22:03:32.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4128999999999995e-05 2024-04-25T22:03:32.016 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:32.016 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:32.016 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:32.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.017 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3031 3.d 3:b02ffd62:::200.00000010:head [write 3932758~2245 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:32.017 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:32.017 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 7.1963289450000003, 2024-04-25T22:03:32.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14694558999999999, 2024-04-25T22:03:32.017 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:32.017 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:32.017 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.017 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:32.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:32.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:32.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:32.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:32.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:32.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:32.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:32.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711152+0000", 2024-04-25T22:03:32.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5230000000000001e-06 2024-04-25T22:03:32.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:32.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711162+0000", 2024-04-25T22:03:32.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2299999999999997e-06 2024-04-25T22:03:32.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:32.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711179+0000", 2024-04-25T22:03:32.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7220000000000001e-05 2024-04-25T22:03:32.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711190+0000", 2024-04-25T22:03:32.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1323e-05 2024-04-25T22:03:32.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:32.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851296+0000", 2024-04-25T22:03:32.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14010541600000001 2024-04-25T22:03:32.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:32.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851436+0000", 2024-04-25T22:03:32.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140409 2024-04-25T22:03:32.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851641+0000", 2024-04-25T22:03:32.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020471700000000001 2024-04-25T22:03:32.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:32.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857847+0000", 2024-04-25T22:03:32.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062065310000000004 2024-04-25T22:03:32.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857952+0000", 2024-04-25T22:03:32.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105132 2024-04-25T22:03:32.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:32.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.858026+0000", 2024-04-25T22:03:32.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3799000000000003e-05 2024-04-25T22:03:32.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:32.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:32.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:32.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.858096+0000", 2024-04-25T22:03:32.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0290000000000006e-05 2024-04-25T22:03:32.021 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:32.021 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:32.021 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:32.021 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:32.022 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:32.022 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:32.023 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:32.024 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:32.016+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:32.125 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:32.120+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:32.153 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:32.154 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:32.154 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:03:32.154 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:32.167 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:32.225 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:32.220+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:32.283 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:32.283 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:32.283 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:03:32.283 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:03:32.283 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:32.299 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:32.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:32.341+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:32.420 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 40.330320239999999, 2024-04-25T22:03:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 40.320319476999998, 2024-04-25T22:03:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.428 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:32.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.428 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:32.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:32.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 40.316155203000001, 2024-04-25T22:03:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 40.314558886, 2024-04-25T22:03:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 40.257772635999999, 2024-04-25T22:03:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 40.242128370000003, 2024-04-25T22:03:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 40.237289679, 2024-04-25T22:03:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10648 4.33 4:cc614d18:::100000030cb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.878686368, 2024-04-25T22:03:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13001143300000001, 2024-04-25T22:03:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10648 2024-04-25T22:03:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537181+0000", 2024-04-25T22:03:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.782e-06 2024-04-25T22:03:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541681+0000", 2024-04-25T22:03:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045008460000000002 2024-04-25T22:03:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541692+0000", 2024-04-25T22:03:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0726e-05 2024-04-25T22:03:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541698+0000", 2024-04-25T22:03:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-04-25T22:03:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541771+0000", 2024-04-25T22:03:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3070000000000003e-05 2024-04-25T22:03:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542021+0000", 2024-04-25T22:03:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025059799999999999 2024-04-25T22:03:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542246+0000", 2024-04-25T22:03:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022471000000000001 2024-04-25T22:03:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.579359+0000", 2024-04-25T22:03:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037113211 2024-04-25T22:03:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667067+0000", 2024-04-25T22:03:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087707255999999997 2024-04-25T22:03:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667134+0000", 2024-04-25T22:03:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7862999999999997e-05 2024-04-25T22:03:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667190+0000", 2024-04-25T22:03:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5698000000000001e-05 2024-04-25T22:03:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10651 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.818910590000002, 2024-04-25T22:03:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11324606800000001, 2024-04-25T22:03:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10651 2024-04-25T22:03:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596957+0000", 2024-04-25T22:03:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-04-25T22:03:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601272+0000", 2024-04-25T22:03:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004314834 2024-04-25T22:03:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601291+0000", 2024-04-25T22:03:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9380000000000001e-05 2024-04-25T22:03:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601302+0000", 2024-04-25T22:03:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0416e-05 2024-04-25T22:03:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.603978+0000", 2024-04-25T22:03:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026763109999999998 2024-04-25T22:03:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604327+0000", 2024-04-25T22:03:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034881099999999998 2024-04-25T22:03:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604571+0000", 2024-04-25T22:03:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024436100000000001 2024-04-25T22:03:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644439+0000", 2024-04-25T22:03:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039868270999999997 2024-04-25T22:03:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710091+0000", 2024-04-25T22:03:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.065651910999999993 2024-04-25T22:03:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710144+0000", 2024-04-25T22:03:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2444999999999997e-05 2024-04-25T22:03:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710201+0000", 2024-04-25T22:03:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6839999999999998e-05 2024-04-25T22:03:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10654 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.809083727000001, 2024-04-25T22:03:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.103958778, 2024-04-25T22:03:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10654 2024-04-25T22:03:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606782+0000", 2024-04-25T22:03:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1699999999999999e-07 2024-04-25T22:03:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611155+0000", 2024-04-25T22:03:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043728580000000003 2024-04-25T22:03:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611173+0000", 2024-04-25T22:03:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8267e-05 2024-04-25T22:03:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611183+0000", 2024-04-25T22:03:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9250000000000007e-06 2024-04-25T22:03:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644642+0000", 2024-04-25T22:03:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033458976000000001 2024-04-25T22:03:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644739+0000", 2024-04-25T22:03:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7189999999999996e-05 2024-04-25T22:03:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644864+0000", 2024-04-25T22:03:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000124867 2024-04-25T22:03:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.672556+0000", 2024-04-25T22:03:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027691653 2024-04-25T22:03:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710668+0000", 2024-04-25T22:03:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038111956000000002 2024-04-25T22:03:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710703+0000", 2024-04-25T22:03:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5577000000000002e-05 2024-04-25T22:03:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710740+0000", 2024-04-25T22:03:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7092000000000003e-05 2024-04-25T22:03:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11078 4.4 4:22be2a9e:::10000003224.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.411957105999999, 2024-04-25T22:03:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.112294177, 2024-04-25T22:03:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11078 2024-04-25T22:03:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003909+0000", 2024-04-25T22:03:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2750000000000001e-06 2024-04-25T22:03:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009939+0000", 2024-04-25T22:03:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060293309999999998 2024-04-25T22:03:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009961+0000", 2024-04-25T22:03:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1889999999999999e-05 2024-04-25T22:03:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009976+0000", 2024-04-25T22:03:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5642e-05 2024-04-25T22:03:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042803+0000", 2024-04-25T22:03:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032827299999999997 2024-04-25T22:03:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042911+0000", 2024-04-25T22:03:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107747 2024-04-25T22:03:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042990+0000", 2024-04-25T22:03:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8832999999999996e-05 2024-04-25T22:03:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.088710+0000", 2024-04-25T22:03:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045720129999999998 2024-04-25T22:03:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116108+0000", 2024-04-25T22:03:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027397388000000002 2024-04-25T22:03:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116164+0000", 2024-04-25T22:03:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6283000000000003e-05 2024-04-25T22:03:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116202+0000", 2024-04-25T22:03:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8358000000000001e-05 2024-04-25T22:03:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11195 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.198594989, 2024-04-25T22:03:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1095062, 2024-04-25T22:03:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11195 2024-04-25T22:03:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217272+0000", 2024-04-25T22:03:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.533e-06 2024-04-25T22:03:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217385+0000", 2024-04-25T22:03:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113533 2024-04-25T22:03:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217396+0000", 2024-04-25T22:03:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0682e-05 2024-04-25T22:03:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217402+0000", 2024-04-25T22:03:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:03:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238476+0000", 2024-04-25T22:03:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021073312 2024-04-25T22:03:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238558+0000", 2024-04-25T22:03:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2193000000000004e-05 2024-04-25T22:03:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238695+0000", 2024-04-25T22:03:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013737800000000001 2024-04-25T22:03:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292860+0000", 2024-04-25T22:03:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054165224999999997 2024-04-25T22:03:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326638+0000", 2024-04-25T22:03:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033777517999999999 2024-04-25T22:03:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326686+0000", 2024-04-25T22:03:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8062000000000002e-05 2024-04-25T22:03:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326776+0000", 2024-04-25T22:03:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0393e-05 2024-04-25T22:03:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11197 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3195543~33670] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.198453004999999, 2024-04-25T22:03:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953929499999999, 2024-04-25T22:03:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11197 2024-04-25T22:03:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217413+0000", 2024-04-25T22:03:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5600000000000005e-07 2024-04-25T22:03:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217445+0000", 2024-04-25T22:03:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2240999999999998e-05 2024-04-25T22:03:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217453+0000", 2024-04-25T22:03:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6070000000000002e-06 2024-04-25T22:03:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217458+0000", 2024-04-25T22:03:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3630000000000002e-06 2024-04-25T22:03:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240891+0000", 2024-04-25T22:03:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023432637999999999 2024-04-25T22:03:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240990+0000", 2024-04-25T22:03:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8995999999999999e-05 2024-04-25T22:03:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241123+0000", 2024-04-25T22:03:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013371699999999999 2024-04-25T22:03:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292866+0000", 2024-04-25T22:03:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051742332000000002 2024-04-25T22:03:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326849+0000", 2024-04-25T22:03:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033983140000000002 2024-04-25T22:03:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326908+0000", 2024-04-25T22:03:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8842999999999999e-05 2024-04-25T22:03:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326951+0000", 2024-04-25T22:03:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3761999999999999e-05 2024-04-25T22:03:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11198 4.4 4:22c4fea3:::10000003262.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.198398645999999, 2024-04-25T22:03:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12381273600000001, 2024-04-25T22:03:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11198 2024-04-25T22:03:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217467+0000", 2024-04-25T22:03:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4499999999999997e-07 2024-04-25T22:03:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225449+0000", 2024-04-25T22:03:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079819439999999995 2024-04-25T22:03:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225466+0000", 2024-04-25T22:03:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6602000000000001e-05 2024-04-25T22:03:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225477+0000", 2024-04-25T22:03:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1603000000000001e-05 2024-04-25T22:03:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240866+0000", 2024-04-25T22:03:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015388389000000001 2024-04-25T22:03:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241081+0000", 2024-04-25T22:03:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021577400000000001 2024-04-25T22:03:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241212+0000", 2024-04-25T22:03:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013073499999999999 2024-04-25T22:03:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292876+0000", 2024-04-25T22:03:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051663584999999998 2024-04-25T22:03:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341159+0000", 2024-04-25T22:03:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048283421999999999 2024-04-25T22:03:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341222+0000", 2024-04-25T22:03:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:03:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341279+0000", 2024-04-25T22:03:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6780999999999997e-05 2024-04-25T22:03:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11207 4.4 4:233f6309:::10000003211.00000000:head [write 659836~128648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.181780649, 2024-04-25T22:03:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10732727, 2024-04-25T22:03:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11207 2024-04-25T22:03:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234085+0000", 2024-04-25T22:03:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0399999999999995e-07 2024-04-25T22:03:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234550+0000", 2024-04-25T22:03:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000464909 2024-04-25T22:03:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234561+0000", 2024-04-25T22:03:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0744000000000001e-05 2024-04-25T22:03:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234569+0000", 2024-04-25T22:03:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6890000000000004e-06 2024-04-25T22:03:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267197+0000", 2024-04-25T22:03:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032628182999999998 2024-04-25T22:03:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267297+0000", 2024-04-25T22:03:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100222 2024-04-25T22:03:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267393+0000", 2024-04-25T22:03:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6275999999999998e-05 2024-04-25T22:03:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292880+0000", 2024-04-25T22:03:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025487058999999999 2024-04-25T22:03:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341326+0000", 2024-04-25T22:03:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048446031000000001 2024-04-25T22:03:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341374+0000", 2024-04-25T22:03:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7632000000000001e-05 2024-04-25T22:03:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341412+0000", 2024-04-25T22:03:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7821000000000003e-05 2024-04-25T22:03:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11219 4.4 4:210cd53e:::100000031ff.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.162831439, 2024-04-25T22:03:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13181403, 2024-04-25T22:03:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11219 2024-04-25T22:03:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253035+0000", 2024-04-25T22:03:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.322e-06 2024-04-25T22:03:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258145+0000", 2024-04-25T22:03:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051095669999999998 2024-04-25T22:03:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258163+0000", 2024-04-25T22:03:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8377999999999999e-05 2024-04-25T22:03:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258174+0000", 2024-04-25T22:03:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0925e-05 2024-04-25T22:03:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270495+0000", 2024-04-25T22:03:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012321354 2024-04-25T22:03:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270581+0000", 2024-04-25T22:03:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5741999999999993e-05 2024-04-25T22:03:32.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270717+0000", 2024-04-25T22:03:32.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013571500000000001 2024-04-25T22:03:32.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326599+0000", 2024-04-25T22:03:32.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055882026000000001 2024-04-25T22:03:32.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384753+0000", 2024-04-25T22:03:32.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058154527999999997 2024-04-25T22:03:32.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384805+0000", 2024-04-25T22:03:32.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1592999999999999e-05 2024-04-25T22:03:32.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384848+0000", 2024-04-25T22:03:32.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2880000000000003e-05 2024-04-25T22:03:32.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.515 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.516 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11868 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:32.516 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:32.516 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.203867615, 2024-04-25T22:03:32.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12149908700000001, 2024-04-25T22:03:32.516 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.516 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.516 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.516 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.516 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.516 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.516 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11868 2024-04-25T22:03:32.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.516 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:32.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:32.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211999+0000", 2024-04-25T22:03:32.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:03:32.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219614+0000", 2024-04-25T22:03:32.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076153490000000004 2024-04-25T22:03:32.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219628+0000", 2024-04-25T22:03:32.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3597e-05 2024-04-25T22:03:32.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219635+0000", 2024-04-25T22:03:32.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7759999999999997e-06 2024-04-25T22:03:32.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229908+0000", 2024-04-25T22:03:32.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010272478 2024-04-25T22:03:32.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229966+0000", 2024-04-25T22:03:32.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8495000000000002e-05 2024-04-25T22:03:32.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.230082+0000", 2024-04-25T22:03:32.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011560799999999999 2024-04-25T22:03:32.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257530+0000", 2024-04-25T22:03:32.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027448034999999999 2024-04-25T22:03:32.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333408+0000", 2024-04-25T22:03:32.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075878105000000001 2024-04-25T22:03:32.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333457+0000", 2024-04-25T22:03:32.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8757000000000001e-05 2024-04-25T22:03:32.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333497+0000", 2024-04-25T22:03:32.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9721000000000001e-05 2024-04-25T22:03:32.521 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.521 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.521 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.521 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11870 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 4063232~131072] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:32.521 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:32.521 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.196213261, 2024-04-25T22:03:32.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.114017408, 2024-04-25T22:03:32.521 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.521 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.521 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.521 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.521 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.521 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.521 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11870 2024-04-25T22:03:32.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.522 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:32.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:32.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219653+0000", 2024-04-25T22:03:32.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6139999999999999e-06 2024-04-25T22:03:32.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219722+0000", 2024-04-25T22:03:32.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8460000000000005e-05 2024-04-25T22:03:32.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219730+0000", 2024-04-25T22:03:32.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3420000000000008e-06 2024-04-25T22:03:32.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219736+0000", 2024-04-25T22:03:32.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9619999999999998e-06 2024-04-25T22:03:32.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247743+0000", 2024-04-25T22:03:32.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028006400000000001 2024-04-25T22:03:32.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247847+0000", 2024-04-25T22:03:32.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104017 2024-04-25T22:03:32.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247984+0000", 2024-04-25T22:03:32.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013701800000000001 2024-04-25T22:03:32.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257536+0000", 2024-04-25T22:03:32.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095520050000000006 2024-04-25T22:03:32.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333565+0000", 2024-04-25T22:03:32.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076029154000000002 2024-04-25T22:03:32.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333628+0000", 2024-04-25T22:03:32.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2853000000000003e-05 2024-04-25T22:03:32.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333669+0000", 2024-04-25T22:03:32.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1582999999999998e-05 2024-04-25T22:03:32.526 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.526 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.526 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.526 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11871 4.37 4:ee924968:::10000003393.00000000:head [write 2359296~1835008] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:32.526 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:32.526 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.196120328999999, 2024-04-25T22:03:32.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.113885236, 2024-04-25T22:03:32.526 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.527 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.527 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.527 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.527 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.527 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.527 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11871 2024-04-25T22:03:32.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.527 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:32.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:32.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:32.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6100000000000001e-07 2024-04-25T22:03:32.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222469+0000", 2024-04-25T22:03:32.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027240060000000002 2024-04-25T22:03:32.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222482+0000", 2024-04-25T22:03:32.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3049e-05 2024-04-25T22:03:32.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222492+0000", 2024-04-25T22:03:32.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8020000000000003e-06 2024-04-25T22:03:32.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247903+0000", 2024-04-25T22:03:32.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025410578999999999 2024-04-25T22:03:32.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247962+0000", 2024-04-25T22:03:32.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9363000000000001e-05 2024-04-25T22:03:32.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.248049+0000", 2024-04-25T22:03:32.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6803000000000002e-05 2024-04-25T22:03:32.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257915+0000", 2024-04-25T22:03:32.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0098655730000000007 2024-04-25T22:03:32.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333544+0000", 2024-04-25T22:03:32.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075629030999999999 2024-04-25T22:03:32.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333594+0000", 2024-04-25T22:03:32.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0291999999999999e-05 2024-04-25T22:03:32.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333630+0000", 2024-04-25T22:03:32.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6177000000000003e-05 2024-04-25T22:03:32.531 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.532 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.532 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.532 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:15375 4.4 4:211dd80e:::10000003351.00000000:head [write 0~4194304 [2@1354921]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:32.532 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:32.532 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.2787909370000001, 2024-04-25T22:03:32.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953555500000001, 2024-04-25T22:03:32.532 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:32.532 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:32.532 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:32.532 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:32.532 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:32.532 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:32.532 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-04-25T22:03:32.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.533 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:32.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:32.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:32.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:32.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:32.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:32.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:32.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137076+0000", 2024-04-25T22:03:32.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.683e-06 2024-04-25T22:03:32.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:32.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142168+0000", 2024-04-25T22:03:32.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050917280000000002 2024-04-25T22:03:32.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:32.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142192+0000", 2024-04-25T22:03:32.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:03:32.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:32.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142206+0000", 2024-04-25T22:03:32.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.396e-05 2024-04-25T22:03:32.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:32.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142280+0000", 2024-04-25T22:03:32.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4369000000000006e-05 2024-04-25T22:03:32.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:32.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142346+0000", 2024-04-25T22:03:32.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5957000000000006e-05 2024-04-25T22:03:32.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:32.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142440+0000", 2024-04-25T22:03:32.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3888999999999995e-05 2024-04-25T22:03:32.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:32.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.208451+0000", 2024-04-25T22:03:32.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066011350999999996 2024-04-25T22:03:32.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:32.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246473+0000", 2024-04-25T22:03:32.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038021428000000003 2024-04-25T22:03:32.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:32.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246530+0000", 2024-04-25T22:03:32.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7466000000000002e-05 2024-04-25T22:03:32.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:32.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:32.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:32.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246610+0000", 2024-04-25T22:03:32.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9484e-05 2024-04-25T22:03:32.537 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.537 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.537 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.537 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:32.537 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:32.537 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:32.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:32.540 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:32.536+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:32.639 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:32.636+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:32.674 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:32.674 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:32.674 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:03:32.674 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:32.690 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:32.740 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:32.732+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:32.818 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:32.818 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:32.818 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:03:32.818 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:03:32.818 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:32.832 INFO:teuthology.orchestra.run.smithi044.stderr:set osd.2 primary-affinity to 0.807073 (8528922) 2024-04-25T22:03:32.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:32.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:32.837+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:32.856 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:03:32.942 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:32.936+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:33.010 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:33.010 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:03:33.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:03:33.010 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:33.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.010 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:4 4.32 e51/16 4:4def72d4:::10000000003.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:03:33.010 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:33.010 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.013032551000002, 2024-04-25T22:03:33.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10987878, 2024-04-25T22:03:33.010 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.011 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.011 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:33.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992458+0000", 2024-04-25T22:03:33.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.992461+0000", 2024-04-25T22:03:33.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5780000000000001e-06 2024-04-25T22:03:33.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997784+0000", 2024-04-25T22:03:33.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005323627 2024-04-25T22:03:33.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997815+0000", 2024-04-25T22:03:33.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0066999999999999e-05 2024-04-25T22:03:33.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997830+0000", 2024-04-25T22:03:33.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5290000000000001e-05 2024-04-25T22:03:33.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997927+0000", 2024-04-25T22:03:33.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7391000000000003e-05 2024-04-25T22:03:33.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:51.997947+0000", 2024-04-25T22:03:33.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0259999999999999e-05 2024-04-25T22:03:33.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102225+0000", 2024-04-25T22:03:33.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.10427777100000001 2024-04-25T22:03:33.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.102337+0000", 2024-04-25T22:03:33.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000111796 2024-04-25T22:03:33.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.014 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.015 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:6 4.13 e51/16 4:cbe72331:::10000000003.00000002:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:33.015 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:33.015 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.918218566999997, 2024-04-25T22:03:33.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.11536371400000001, 2024-04-25T22:03:33.015 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.016 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.016 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:33.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087272+0000", 2024-04-25T22:03:33.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.087273+0000", 2024-04-25T22:03:33.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:03:33.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089358+0000", 2024-04-25T22:03:33.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0020848170000000001 2024-04-25T22:03:33.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089372+0000", 2024-04-25T22:03:33.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.452e-05 2024-04-25T22:03:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089381+0000", 2024-04-25T22:03:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5979999999999997e-06 2024-04-25T22:03:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089486+0000", 2024-04-25T22:03:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105573 2024-04-25T22:03:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.089536+0000", 2024-04-25T22:03:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9505000000000001e-05 2024-04-25T22:03:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202556+0000", 2024-04-25T22:03:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.113020169 2024-04-25T22:03:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.202636+0000", 2024-04-25T22:03:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9814000000000005e-05 2024-04-25T22:03:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:5 4.10 e51/16 4:09a4c37f:::10000000003.00000001:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.905642649999997, 2024-04-25T22:03:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.110104358, 2024-04-25T22:03:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099848+0000", 2024-04-25T22:03:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.099849+0000", 2024-04-25T22:03:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7000000000000003e-07 2024-04-25T22:03:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108349+0000", 2024-04-25T22:03:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085003230000000006 2024-04-25T22:03:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108391+0000", 2024-04-25T22:03:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2011999999999997e-05 2024-04-25T22:03:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108415+0000", 2024-04-25T22:03:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3702000000000001e-05 2024-04-25T22:03:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108504+0000", 2024-04-25T22:03:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8684999999999995e-05 2024-04-25T22:03:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108520+0000", 2024-04-25T22:03:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5931999999999999e-05 2024-04-25T22:03:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209918+0000", 2024-04-25T22:03:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.101398696 2024-04-25T22:03:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.209952+0000", 2024-04-25T22:03:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4038000000000002e-05 2024-04-25T22:03:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11 4.28 e51/49 4:177a762d:::10000000201.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.896940723999997, 2024-04-25T22:03:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098799331000000004, 2024-04-25T22:03:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108550+0000", 2024-04-25T22:03:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108551+0000", 2024-04-25T22:03:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0699999999999996e-07 2024-04-25T22:03:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108576+0000", 2024-04-25T22:03:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4856000000000001e-05 2024-04-25T22:03:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108593+0000", 2024-04-25T22:03:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7125999999999998e-05 2024-04-25T22:03:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108609+0000", 2024-04-25T22:03:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6535999999999999e-05 2024-04-25T22:03:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108713+0000", 2024-04-25T22:03:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010344999999999999 2024-04-25T22:03:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108762+0000", 2024-04-25T22:03:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8711000000000002e-05 2024-04-25T22:03:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207305+0000", 2024-04-25T22:03:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098543566999999999 2024-04-25T22:03:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207349+0000", 2024-04-25T22:03:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4178000000000003e-05 2024-04-25T22:03:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:12 4.28 e51/49 4:15246602:::10000000202.00000000:head v 51'2, mlcod=0'0)", 2024-04-25T22:03:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.896859433000003, 2024-04-25T22:03:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.098749009999999998, 2024-04-25T22:03:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108631+0000", 2024-04-25T22:03:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108632+0000", 2024-04-25T22:03:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2699999999999999e-07 2024-04-25T22:03:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108647+0000", 2024-04-25T22:03:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4585e-05 2024-04-25T22:03:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108667+0000", 2024-04-25T22:03:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9887000000000001e-05 2024-04-25T22:03:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108680+0000", 2024-04-25T22:03:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3249e-05 2024-04-25T22:03:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109917+0000", 2024-04-25T22:03:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012367050000000001 2024-04-25T22:03:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.109961+0000", 2024-04-25T22:03:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4029000000000001e-05 2024-04-25T22:03:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207351+0000", 2024-04-25T22:03:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.097390791000000004 2024-04-25T22:03:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.207380+0000", 2024-04-25T22:03:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9037e-05 2024-04-25T22:03:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:8 4.3b e51/49 4:deccbd37:::100000001fe.00000000:head v 51'1, mlcod=0'0)", 2024-04-25T22:03:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.896794528999997, 2024-04-25T22:03:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090839771, 2024-04-25T22:03:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.037 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.037 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:33.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108696+0000", 2024-04-25T22:03:33.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108697+0000", 2024-04-25T22:03:33.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1399999999999997e-07 2024-04-25T22:03:33.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108712+0000", 2024-04-25T22:03:33.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4772e-05 2024-04-25T22:03:33.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108728+0000", 2024-04-25T22:03:33.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5943e-05 2024-04-25T22:03:33.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108740+0000", 2024-04-25T22:03:33.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.235e-05 2024-04-25T22:03:33.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108797+0000", 2024-04-25T22:03:33.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6879000000000002e-05 2024-04-25T22:03:33.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.108812+0000", 2024-04-25T22:03:33.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5268999999999999e-05 2024-04-25T22:03:33.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199495+0000", 2024-04-25T22:03:33.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090683071000000004 2024-04-25T22:03:33.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:02:52.199536+0000", 2024-04-25T22:03:33.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0873e-05 2024-04-25T22:03:33.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.041 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.041 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:6909 4.6 4:631b09cd:::10000001f99.00000000:head [write 0~1706] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:33.041 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.879622+0000", 2024-04-25T22:03:33.041 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.125869019, 2024-04-25T22:03:33.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83167118299999998, 2024-04-25T22:03:33.041 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.041 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.041 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.041 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:33.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:33.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:33.042 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 6909 2024-04-25T22:03:33.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.042 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879622+0000", 2024-04-25T22:03:33.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879622+0000", 2024-04-25T22:03:33.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879624+0000", 2024-04-25T22:03:33.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.429e-06 2024-04-25T22:03:33.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879639+0000", 2024-04-25T22:03:33.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4534e-05 2024-04-25T22:03:33.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879669+0000", 2024-04-25T22:03:33.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0349e-05 2024-04-25T22:03:33.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879684+0000", 2024-04-25T22:03:33.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:03:33.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879767+0000", 2024-04-25T22:03:33.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3410000000000003e-05 2024-04-25T22:03:33.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:33.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.879783+0000", 2024-04-25T22:03:33.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5378000000000001e-05 2024-04-25T22:03:33.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.700268+0000", 2024-04-25T22:03:33.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.82048565699999998 2024-04-25T22:03:33.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.700627+0000", 2024-04-25T22:03:33.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035847800000000002 2024-04-25T22:03:33.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:33.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.700977+0000", 2024-04-25T22:03:33.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035024699999999998 2024-04-25T22:03:33.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.704901+0000", 2024-04-25T22:03:33.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039243230000000004 2024-04-25T22:03:33.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:33.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711150+0000", 2024-04-25T22:03:33.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0062490519999999997 2024-04-25T22:03:33.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711230+0000", 2024-04-25T22:03:33.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9370999999999996e-05 2024-04-25T22:03:33.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:33.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3221999999999999e-05 2024-04-25T22:03:33.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.047 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.047 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:6922 4.6 4:62b4ea5c:::10000001fab.00000000:head [write 0~7953] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:33.048 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.902807+0000", 2024-04-25T22:03:33.048 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.102683792000001, 2024-04-25T22:03:33.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80868129799999999, 2024-04-25T22:03:33.048 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.048 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.048 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:33.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:33.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:33.048 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 6922 2024-04-25T22:03:33.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.048 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902807+0000", 2024-04-25T22:03:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902807+0000", 2024-04-25T22:03:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902809+0000", 2024-04-25T22:03:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4099999999999998e-06 2024-04-25T22:03:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902830+0000", 2024-04-25T22:03:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0381999999999999e-05 2024-04-25T22:03:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902852+0000", 2024-04-25T22:03:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2357e-05 2024-04-25T22:03:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902864+0000", 2024-04-25T22:03:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2329e-05 2024-04-25T22:03:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902923+0000", 2024-04-25T22:03:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8485e-05 2024-04-25T22:03:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.902930+0000", 2024-04-25T22:03:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4200000000000001e-06 2024-04-25T22:03:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.702506+0000", 2024-04-25T22:03:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.79957517899999997 2024-04-25T22:03:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.702674+0000", 2024-04-25T22:03:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016807200000000001 2024-04-25T22:03:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.702860+0000", 2024-04-25T22:03:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018624200000000001 2024-04-25T22:03:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706186+0000", 2024-04-25T22:03:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033265619999999999 2024-04-25T22:03:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711369+0000", 2024-04-25T22:03:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005182496 2024-04-25T22:03:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711436+0000", 2024-04-25T22:03:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7135e-05 2024-04-25T22:03:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711488+0000", 2024-04-25T22:03:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2228999999999997e-05 2024-04-25T22:03:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.054 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:6926 4.6 4:62749b46:::10000001faf.00000000:head [write 0~2676] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:33.054 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:04.908574+0000", 2024-04-25T22:03:33.054 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.096916944, 2024-04-25T22:03:33.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.803246511, 2024-04-25T22:03:33.054 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.054 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.054 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.054 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:33.055 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:33.055 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:33.055 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 6926 2024-04-25T22:03:33.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.055 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908574+0000", 2024-04-25T22:03:33.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908574+0000", 2024-04-25T22:03:33.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908576+0000", 2024-04-25T22:03:33.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.784e-06 2024-04-25T22:03:33.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908585+0000", 2024-04-25T22:03:33.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6420000000000002e-06 2024-04-25T22:03:33.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908609+0000", 2024-04-25T22:03:33.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3303e-05 2024-04-25T22:03:33.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908622+0000", 2024-04-25T22:03:33.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3783e-05 2024-04-25T22:03:33.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908730+0000", 2024-04-25T22:03:33.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107831 2024-04-25T22:03:33.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:33.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:04.908748+0000", 2024-04-25T22:03:33.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7909000000000001e-05 2024-04-25T22:03:33.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.703586+0000", 2024-04-25T22:03:33.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.794838131 2024-04-25T22:03:33.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.703854+0000", 2024-04-25T22:03:33.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026782299999999999 2024-04-25T22:03:33.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:33.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.704060+0000", 2024-04-25T22:03:33.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020576200000000001 2024-04-25T22:03:33.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711121+0000", 2024-04-25T22:03:33.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070615510000000001 2024-04-25T22:03:33.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:33.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711705+0000", 2024-04-25T22:03:33.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00058315899999999998 2024-04-25T22:03:33.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711769+0000", 2024-04-25T22:03:33.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4877999999999998e-05 2024-04-25T22:03:33.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711820+0000", 2024-04-25T22:03:33.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0955000000000003e-05 2024-04-25T22:03:33.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.066 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.066 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7057 4.6 4:63cd8154:::10000002047.00000000:head [write 0~2047] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:33.067 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.194487+0000", 2024-04-25T22:03:33.067 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.811004034, 2024-04-25T22:03:33.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.51749014100000001, 2024-04-25T22:03:33.067 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.067 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.067 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:33.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:33.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:33.067 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7057 2024-04-25T22:03:33.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.067 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194487+0000", 2024-04-25T22:03:33.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194487+0000", 2024-04-25T22:03:33.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194489+0000", 2024-04-25T22:03:33.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-04-25T22:03:33.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194499+0000", 2024-04-25T22:03:33.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0117e-05 2024-04-25T22:03:33.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194522+0000", 2024-04-25T22:03:33.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2925000000000002e-05 2024-04-25T22:03:33.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194541+0000", 2024-04-25T22:03:33.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9137e-05 2024-04-25T22:03:33.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194712+0000", 2024-04-25T22:03:33.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000170602 2024-04-25T22:03:33.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:33.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.194743+0000", 2024-04-25T22:03:33.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1479000000000001e-05 2024-04-25T22:03:33.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.704997+0000", 2024-04-25T22:03:33.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.51025366000000005 2024-04-25T22:03:33.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.705197+0000", 2024-04-25T22:03:33.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020022799999999999 2024-04-25T22:03:33.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:33.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.705399+0000", 2024-04-25T22:03:33.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020160499999999999 2024-04-25T22:03:33.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711586+0000", 2024-04-25T22:03:33.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061875350000000001 2024-04-25T22:03:33.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:33.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711841+0000", 2024-04-25T22:03:33.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025510300000000001 2024-04-25T22:03:33.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711906+0000", 2024-04-25T22:03:33.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4381999999999994e-05 2024-04-25T22:03:33.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711977+0000", 2024-04-25T22:03:33.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1295000000000001e-05 2024-04-25T22:03:33.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.073 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.073 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7114 4.6 4:63547153:::10000002086.00000000:head [write 0~67896] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:33.073 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.411903+0000", 2024-04-25T22:03:33.073 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.593587450000001, 2024-04-25T22:03:33.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.301551715, 2024-04-25T22:03:33.073 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.073 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.074 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:33.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:33.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:33.074 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7114 2024-04-25T22:03:33.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.074 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.411903+0000", 2024-04-25T22:03:33.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.411903+0000", 2024-04-25T22:03:33.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.411906+0000", 2024-04-25T22:03:33.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9469999999999999e-06 2024-04-25T22:03:33.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412184+0000", 2024-04-25T22:03:33.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027727600000000002 2024-04-25T22:03:33.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412215+0000", 2024-04-25T22:03:33.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1899000000000001e-05 2024-04-25T22:03:33.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412230+0000", 2024-04-25T22:03:33.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4703e-05 2024-04-25T22:03:33.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412384+0000", 2024-04-25T22:03:33.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015366300000000001 2024-04-25T22:03:33.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:33.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.412405+0000", 2024-04-25T22:03:33.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0936000000000001e-05 2024-04-25T22:03:33.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706266+0000", 2024-04-25T22:03:33.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.29386084299999998 2024-04-25T22:03:33.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706440+0000", 2024-04-25T22:03:33.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000174759 2024-04-25T22:03:33.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:33.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.706655+0000", 2024-04-25T22:03:33.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021489100000000001 2024-04-25T22:03:33.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.711675+0000", 2024-04-25T22:03:33.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050198639999999997 2024-04-25T22:03:33.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:33.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.713316+0000", 2024-04-25T22:03:33.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016410280000000001 2024-04-25T22:03:33.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.713391+0000", 2024-04-25T22:03:33.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5065e-05 2024-04-25T22:03:33.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.713455+0000", 2024-04-25T22:03:33.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3841000000000001e-05 2024-04-25T22:03:33.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.079 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.080 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7117 4.6 4:60a5b603:::10000002089.00000000:head [write 0~12740] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:33.080 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.421192+0000", 2024-04-25T22:03:33.080 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.584299051999999, 2024-04-25T22:03:33.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.29400416200000001, 2024-04-25T22:03:33.080 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.080 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.080 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:33.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:33.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:33.080 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7117 2024-04-25T22:03:33.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.081 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421192+0000", 2024-04-25T22:03:33.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421192+0000", 2024-04-25T22:03:33.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421194+0000", 2024-04-25T22:03:33.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3700000000000002e-06 2024-04-25T22:03:33.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421247+0000", 2024-04-25T22:03:33.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2539e-05 2024-04-25T22:03:33.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421278+0000", 2024-04-25T22:03:33.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1392e-05 2024-04-25T22:03:33.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421293+0000", 2024-04-25T22:03:33.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5133000000000001e-05 2024-04-25T22:03:33.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421487+0000", 2024-04-25T22:03:33.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019340899999999999 2024-04-25T22:03:33.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:33.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.421506+0000", 2024-04-25T22:03:33.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9568999999999998e-05 2024-04-25T22:03:33.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.709232+0000", 2024-04-25T22:03:33.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.28772543699999997 2024-04-25T22:03:33.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.709416+0000", 2024-04-25T22:03:33.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000184019 2024-04-25T22:03:33.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:33.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.709668+0000", 2024-04-25T22:03:33.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025279000000000002 2024-04-25T22:03:33.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712068+0000", 2024-04-25T22:03:33.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002399558 2024-04-25T22:03:33.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:33.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.715072+0000", 2024-04-25T22:03:33.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030037800000000002 2024-04-25T22:03:33.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.715143+0000", 2024-04-25T22:03:33.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1000999999999993e-05 2024-04-25T22:03:33.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.715196+0000", 2024-04-25T22:03:33.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3164999999999997e-05 2024-04-25T22:03:33.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.086 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.086 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:7136 4.6 4:60bfd03c:::100000020a0.00000000:head [write 0~1357] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:33.086 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:05.489503+0000", 2024-04-25T22:03:33.086 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.515988171, 2024-04-25T22:03:33.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.22876102600000001, 2024-04-25T22:03:33.086 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.087 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.087 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.087 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:33.087 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:33.087 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:33.087 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 7136 2024-04-25T22:03:33.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.087 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489503+0000", 2024-04-25T22:03:33.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489503+0000", 2024-04-25T22:03:33.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489505+0000", 2024-04-25T22:03:33.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.486e-06 2024-04-25T22:03:33.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489517+0000", 2024-04-25T22:03:33.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.217e-05 2024-04-25T22:03:33.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489544+0000", 2024-04-25T22:03:33.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6852999999999999e-05 2024-04-25T22:03:33.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489559+0000", 2024-04-25T22:03:33.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4746000000000001e-05 2024-04-25T22:03:33.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489705+0000", 2024-04-25T22:03:33.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014583 2024-04-25T22:03:33.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:33.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.489722+0000", 2024-04-25T22:03:33.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7376000000000001e-05 2024-04-25T22:03:33.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712122+0000", 2024-04-25T22:03:33.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.22239948300000001 2024-04-25T22:03:33.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712376+0000", 2024-04-25T22:03:33.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025398700000000001 2024-04-25T22:03:33.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:33.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.712639+0000", 2024-04-25T22:03:33.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026326300000000002 2024-04-25T22:03:33.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.714861+0000", 2024-04-25T22:03:33.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00222236 2024-04-25T22:03:33.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:33.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.718091+0000", 2024-04-25T22:03:33.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032294400000000001 2024-04-25T22:03:33.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.718197+0000", 2024-04-25T22:03:33.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010655 2024-04-25T22:03:33.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:05.718264+0000", 2024-04-25T22:03:33.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6482000000000005e-05 2024-04-25T22:03:33.092 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.092 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.092 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.093 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:299 3.0 3:02ac1934:::200.00000009:head [write 0~3532922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T22:03:33.093 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:10.968409+0000", 2024-04-25T22:03:33.093 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.037082147, 2024-04-25T22:03:33.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.094675465, 2024-04-25T22:03:33.093 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.093 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.093 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.093 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.968409+0000", 2024-04-25T22:03:33.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.968409+0000", 2024-04-25T22:03:33.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.968411+0000", 2024-04-25T22:03:33.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.012e-06 2024-04-25T22:03:33.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974350+0000", 2024-04-25T22:03:33.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059392259999999997 2024-04-25T22:03:33.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974375+0000", 2024-04-25T22:03:33.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:03:33.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974386+0000", 2024-04-25T22:03:33.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0900000000000001e-05 2024-04-25T22:03:33.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974473+0000", 2024-04-25T22:03:33.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6942999999999997e-05 2024-04-25T22:03:33.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974562+0000", 2024-04-25T22:03:33.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8744000000000003e-05 2024-04-25T22:03:33.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:33.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:10.974706+0000", 2024-04-25T22:03:33.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014392499999999999 2024-04-25T22:03:33.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:33.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.020272+0000", 2024-04-25T22:03:33.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.045566723000000003 2024-04-25T22:03:33.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.062890+0000", 2024-04-25T22:03:33.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042617796999999999 2024-04-25T22:03:33.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.063008+0000", 2024-04-25T22:03:33.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011757 2024-04-25T22:03:33.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:11.063084+0000", 2024-04-25T22:03:33.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6395000000000003e-05 2024-04-25T22:03:33.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.098 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.099 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:10648 4.33 e64/49 4:cc614d18:::100000030cb.00000000:head v 64'159, mlcod=64'157)", 2024-04-25T22:03:33.099 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:13.541451+0000", 2024-04-25T22:03:33.099 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 19.464040195999999, 2024-04-25T22:03:33.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.120967456, 2024-04-25T22:03:33.099 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.099 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.099 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.099 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.541451+0000", 2024-04-25T22:03:33.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.541451+0000", 2024-04-25T22:03:33.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.541453+0000", 2024-04-25T22:03:33.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3530000000000002e-06 2024-04-25T22:03:33.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.545862+0000", 2024-04-25T22:03:33.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004409451 2024-04-25T22:03:33.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.545895+0000", 2024-04-25T22:03:33.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2811999999999997e-05 2024-04-25T22:03:33.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.545918+0000", 2024-04-25T22:03:33.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2407000000000001e-05 2024-04-25T22:03:33.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.546085+0000", 2024-04-25T22:03:33.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000167159 2024-04-25T22:03:33.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.546149+0000", 2024-04-25T22:03:33.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4208999999999995e-05 2024-04-25T22:03:33.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.662281+0000", 2024-04-25T22:03:33.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.116132255 2024-04-25T22:03:33.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:13.662418+0000", 2024-04-25T22:03:33.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013681000000000001 2024-04-25T22:03:33.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.103 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.104 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11198 4.4 e65/16 4:22c4fea3:::10000003262.00000000:head v 65'175, mlcod=65'172)", 2024-04-25T22:03:33.104 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:18.240473+0000", 2024-04-25T22:03:33.104 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.765017636, 2024-04-25T22:03:33.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.099381791999999997, 2024-04-25T22:03:33.104 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.104 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.104 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.104 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.240473+0000", 2024-04-25T22:03:33.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.240473+0000", 2024-04-25T22:03:33.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.240474+0000", 2024-04-25T22:03:33.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1299999999999999e-07 2024-04-25T22:03:33.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.247661+0000", 2024-04-25T22:03:33.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0071873630000000004 2024-04-25T22:03:33.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.247677+0000", 2024-04-25T22:03:33.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5624000000000002e-05 2024-04-25T22:03:33.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.247687+0000", 2024-04-25T22:03:33.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9089999999999995e-06 2024-04-25T22:03:33.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.259136+0000", 2024-04-25T22:03:33.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011449002999999999 2024-04-25T22:03:33.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.259154+0000", 2024-04-25T22:03:33.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7849000000000001e-05 2024-04-25T22:03:33.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.339805+0000", 2024-04-25T22:03:33.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.080651013999999993 2024-04-25T22:03:33.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.339855+0000", 2024-04-25T22:03:33.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0317e-05 2024-04-25T22:03:33.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.108 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.108 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11219 4.4 e65/16 4:210cd53e:::100000031ff.00000000:head v 65'177, mlcod=65'173)", 2024-04-25T22:03:33.108 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:18.271403+0000", 2024-04-25T22:03:33.108 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.734088001, 2024-04-25T22:03:33.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.093770510000000001, 2024-04-25T22:03:33.108 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.108 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.108 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.108 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.271403+0000", 2024-04-25T22:03:33.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.271403+0000", 2024-04-25T22:03:33.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.271403+0000", 2024-04-25T22:03:33.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8999999999999998e-07 2024-04-25T22:03:33.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.275340+0000", 2024-04-25T22:03:33.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039364889999999996 2024-04-25T22:03:33.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.275354+0000", 2024-04-25T22:03:33.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4864e-05 2024-04-25T22:03:33.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.275362+0000", 2024-04-25T22:03:33.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9710000000000004e-06 2024-04-25T22:03:33.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.283340+0000", 2024-04-25T22:03:33.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0079778739999999994 2024-04-25T22:03:33.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.283361+0000", 2024-04-25T22:03:33.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1214999999999999e-05 2024-04-25T22:03:33.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.365136+0000", 2024-04-25T22:03:33.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.081774327999999993 2024-04-25T22:03:33.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.365173+0000", 2024-04-25T22:03:33.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7478999999999998e-05 2024-04-25T22:03:33.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.112 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.112 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:11419 4.6 4:6132b542:::100000032bb.00000000:head [write 0~3932160 [2@1004150]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:33.113 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:18.522062+0000", 2024-04-25T22:03:33.113 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.483429124000001, 2024-04-25T22:03:33.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.091966376000000002, 2024-04-25T22:03:33.113 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.113 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.113 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:33.113 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:33.113 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:33.113 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 11419 2024-04-25T22:03:33.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.113 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.522062+0000", 2024-04-25T22:03:33.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.522062+0000", 2024-04-25T22:03:33.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.522063+0000", 2024-04-25T22:03:33.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.288e-06 2024-04-25T22:03:33.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527453+0000", 2024-04-25T22:03:33.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0053895530000000001 2024-04-25T22:03:33.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527469+0000", 2024-04-25T22:03:33.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:03:33.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527477+0000", 2024-04-25T22:03:33.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2320000000000001e-06 2024-04-25T22:03:33.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527541+0000", 2024-04-25T22:03:33.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3628999999999997e-05 2024-04-25T22:03:33.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527614+0000", 2024-04-25T22:03:33.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3479000000000006e-05 2024-04-25T22:03:33.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:33.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527727+0000", 2024-04-25T22:03:33.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113094 2024-04-25T22:03:33.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:33.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.547917+0000", 2024-04-25T22:03:33.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.020189983000000002 2024-04-25T22:03:33.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.613903+0000", 2024-04-25T22:03:33.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065985492000000007 2024-04-25T22:03:33.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.613968+0000", 2024-04-25T22:03:33.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5815000000000006e-05 2024-04-25T22:03:33.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.614028+0000", 2024-04-25T22:03:33.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9667999999999999e-05 2024-04-25T22:03:33.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.118 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.118 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4564.0:11421 4.6 4:6132b542:::100000032bb.00000000:head [write 3932160~262144 [2@1004150]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:33.118 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:18.527499+0000", 2024-04-25T22:03:33.118 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.477991996, 2024-04-25T22:03:33.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.086691641, 2024-04-25T22:03:33.119 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.119 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.119 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.119 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-04-25T22:03:33.119 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4564", 2024-04-25T22:03:33.119 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:33.119 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 11421 2024-04-25T22:03:33.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.119 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527499+0000", 2024-04-25T22:03:33.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527499+0000", 2024-04-25T22:03:33.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527501+0000", 2024-04-25T22:03:33.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7600000000000001e-06 2024-04-25T22:03:33.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527714+0000", 2024-04-25T22:03:33.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000213919 2024-04-25T22:03:33.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527726+0000", 2024-04-25T22:03:33.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1114000000000001e-05 2024-04-25T22:03:33.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.527734+0000", 2024-04-25T22:03:33.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6489999999999997e-06 2024-04-25T22:03:33.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.545454+0000", 2024-04-25T22:03:33.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017720058 2024-04-25T22:03:33.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.545551+0000", 2024-04-25T22:03:33.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6978000000000006e-05 2024-04-25T22:03:33.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:33.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.545713+0000", 2024-04-25T22:03:33.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016178199999999999 2024-04-25T22:03:33.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:33.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.551069+0000", 2024-04-25T22:03:33.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0053559519999999998 2024-04-25T22:03:33.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.614075+0000", 2024-04-25T22:03:33.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063006329999999999 2024-04-25T22:03:33.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.614148+0000", 2024-04-25T22:03:33.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2821e-05 2024-04-25T22:03:33.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:18.614190+0000", 2024-04-25T22:03:33.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2277999999999997e-05 2024-04-25T22:03:33.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.124 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.124 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4564.0:11868 4.3f e66/49 4:ffca00d8:::1000000326a.00000001:head v 66'190, mlcod=66'188)", 2024-04-25T22:03:33.124 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:19.231425+0000", 2024-04-25T22:03:33.124 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.774065776, 2024-04-25T22:03:33.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.097996501, 2024-04-25T22:03:33.124 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:33.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:33.125 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.125 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:33.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:33.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.231425+0000", 2024-04-25T22:03:33.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:33.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.231425+0000", 2024-04-25T22:03:33.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:33.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:33.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.231426+0000", 2024-04-25T22:03:33.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.147e-06 2024-04-25T22:03:33.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:33.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.238249+0000", 2024-04-25T22:03:33.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068231810000000002 2024-04-25T22:03:33.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:33.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.238259+0000", 2024-04-25T22:03:33.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9059999999999997e-06 2024-04-25T22:03:33.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.238270+0000", 2024-04-25T22:03:33.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.11e-05 2024-04-25T22:03:33.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:33.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.253394+0000", 2024-04-25T22:03:33.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015123559999999999 2024-04-25T22:03:33.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:33.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.253419+0000", 2024-04-25T22:03:33.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4989000000000001e-05 2024-04-25T22:03:33.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:33.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.329383+0000", 2024-04-25T22:03:33.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.075963944000000005 2024-04-25T22:03:33.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:33.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:33.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:33.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:19.329422+0000", 2024-04-25T22:03:33.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8674000000000003e-05 2024-04-25T22:03:33.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.128 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:33.128 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:33.128 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:33.130 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:33.124+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:33.130 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:33.231 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:33.228+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:33.270 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:33.270 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:33.271 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:03:33.271 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:33.285 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:33.332 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:33.328+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:33.432 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:33.424+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:33.462 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:33.462 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:33.462 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:03:33.462 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:03:33.462 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:33.478 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:33.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:33.533+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:33.608 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:33.608 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:03:33.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:03:33.608 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:33.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.608 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T22:03:33.608 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:33.608 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.621521502999997, 2024-04-25T22:03:33.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.180276931, 2024-04-25T22:03:33.608 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.609 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.609 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.609 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:33.609 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:33.609 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:33.609 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4 2024-04-25T22:03:33.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.609 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:33.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:33.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983834+0000", 2024-04-25T22:03:33.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2900000000000001e-06 2024-04-25T22:03:33.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991787+0000", 2024-04-25T22:03:33.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079521690000000003 2024-04-25T22:03:33.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991826+0000", 2024-04-25T22:03:33.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9258999999999998e-05 2024-04-25T22:03:33.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991845+0000", 2024-04-25T22:03:33.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9360000000000001e-05 2024-04-25T22:03:33.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992058+0000", 2024-04-25T22:03:33.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212559 2024-04-25T22:03:33.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992213+0000", 2024-04-25T22:03:33.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015520700000000001 2024-04-25T22:03:33.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:33.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992414+0000", 2024-04-25T22:03:33.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020049 2024-04-25T22:03:33.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162511+0000", 2024-04-25T22:03:33.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.17009782900000001 2024-04-25T22:03:33.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163967+0000", 2024-04-25T22:03:33.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001455752 2024-04-25T22:03:33.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164045+0000", 2024-04-25T22:03:33.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7415000000000003e-05 2024-04-25T22:03:33.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164109+0000", 2024-04-25T22:03:33.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4601e-05 2024-04-25T22:03:33.614 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.614 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.614 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.614 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6847 4.16 4:68767fd1:::10000001f4f.00000000:head [write 0~7212] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:33.614 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:33.614 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.911882041999998, 2024-04-25T22:03:33.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0208302119999999, 2024-04-25T22:03:33.614 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.614 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.614 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.615 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:33.615 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:33.615 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:33.615 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6847 2024-04-25T22:03:33.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.615 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:33.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:33.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693473+0000", 2024-04-25T22:03:33.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.75e-06 2024-04-25T22:03:33.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693490+0000", 2024-04-25T22:03:33.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6540000000000001e-05 2024-04-25T22:03:33.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693509+0000", 2024-04-25T22:03:33.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9536999999999999e-05 2024-04-25T22:03:33.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693522+0000", 2024-04-25T22:03:33.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2099000000000001e-05 2024-04-25T22:03:33.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693677+0000", 2024-04-25T22:03:33.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015516799999999999 2024-04-25T22:03:33.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:33.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693705+0000", 2024-04-25T22:03:33.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8663e-05 2024-04-25T22:03:33.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705551+0000", 2024-04-25T22:03:33.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.011845495 2024-04-25T22:03:33.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705942+0000", 2024-04-25T22:03:33.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00039080099999999997 2024-04-25T22:03:33.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:33.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.706151+0000", 2024-04-25T22:03:33.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000209457 2024-04-25T22:03:33.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711141+0000", 2024-04-25T22:03:33.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049901240000000003 2024-04-25T22:03:33.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714005+0000", 2024-04-25T22:03:33.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028642229999999999 2024-04-25T22:03:33.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714180+0000", 2024-04-25T22:03:33.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017433699999999999 2024-04-25T22:03:33.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714302+0000", 2024-04-25T22:03:33.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122018 2024-04-25T22:03:33.620 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.620 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.621 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.621 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6960 4.16 4:6823d322:::10000001fd2.00000000:head [write 0~150] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:33.621 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:33.621 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.634877943999999, 2024-04-25T22:03:33.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.74417278899999995, 2024-04-25T22:03:33.621 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.621 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.621 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.621 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:33.621 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:33.621 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:33.621 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6960 2024-04-25T22:03:33.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.622 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:33.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:33.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970478+0000", 2024-04-25T22:03:33.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.939e-06 2024-04-25T22:03:33.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970488+0000", 2024-04-25T22:03:33.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9699999999999994e-06 2024-04-25T22:03:33.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970524+0000", 2024-04-25T22:03:33.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5963000000000001e-05 2024-04-25T22:03:33.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970537+0000", 2024-04-25T22:03:33.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.31e-05 2024-04-25T22:03:33.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970701+0000", 2024-04-25T22:03:33.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164177 2024-04-25T22:03:33.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:33.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970718+0000", 2024-04-25T22:03:33.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7323e-05 2024-04-25T22:03:33.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707632+0000", 2024-04-25T22:03:33.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.73691394300000002 2024-04-25T22:03:33.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707924+0000", 2024-04-25T22:03:33.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029223299999999998 2024-04-25T22:03:33.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:33.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.708389+0000", 2024-04-25T22:03:33.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046429300000000001 2024-04-25T22:03:33.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:33.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029039830000000002 2024-04-25T22:03:33.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714409+0000", 2024-04-25T22:03:33.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031159260000000002 2024-04-25T22:03:33.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714538+0000", 2024-04-25T22:03:33.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012952100000000001 2024-04-25T22:03:33.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714649+0000", 2024-04-25T22:03:33.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110418 2024-04-25T22:03:33.627 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.627 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.627 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.627 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7039 4.16 4:6919637e:::10000002032.00000000:head [write 0~2968] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:33.627 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:33.627 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.448831438999999, 2024-04-25T22:03:33.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.56024932199999999, 2024-04-25T22:03:33.627 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.628 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.628 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.628 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:33.628 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:33.628 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:33.628 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7039 2024-04-25T22:03:33.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.628 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:33.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:33.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156523+0000", 2024-04-25T22:03:33.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2130000000000001e-06 2024-04-25T22:03:33.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156530+0000", 2024-04-25T22:03:33.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9090000000000003e-06 2024-04-25T22:03:33.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156544+0000", 2024-04-25T22:03:33.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3271999999999999e-05 2024-04-25T22:03:33.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156551+0000", 2024-04-25T22:03:33.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4970000000000004e-06 2024-04-25T22:03:33.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156639+0000", 2024-04-25T22:03:33.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7638000000000004e-05 2024-04-25T22:03:33.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:33.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156649+0000", 2024-04-25T22:03:33.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0536e-05 2024-04-25T22:03:33.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709515+0000", 2024-04-25T22:03:33.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.55286568999999997 2024-04-25T22:03:33.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709836+0000", 2024-04-25T22:03:33.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032078899999999998 2024-04-25T22:03:33.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:33.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.710271+0000", 2024-04-25T22:03:33.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043530000000000001 2024-04-25T22:03:33.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716576+0000", 2024-04-25T22:03:33.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063045050000000002 2024-04-25T22:03:33.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716605+0000", 2024-04-25T22:03:33.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8949e-05 2024-04-25T22:03:33.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716706+0000", 2024-04-25T22:03:33.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101765 2024-04-25T22:03:33.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716772+0000", 2024-04-25T22:03:33.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5259000000000007e-05 2024-04-25T22:03:33.633 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.633 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.634 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.634 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7065 4.16 4:697a9f10:::10000002050.00000000:head [write 0~16297] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:33.634 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:33.634 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.391215491000001, 2024-04-25T22:03:33.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.50307290800000004, 2024-04-25T22:03:33.634 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.634 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.634 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.634 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:33.634 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:33.634 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:33.634 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7065 2024-04-25T22:03:33.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.635 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:33.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:33.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214139+0000", 2024-04-25T22:03:33.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.186e-06 2024-04-25T22:03:33.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214170+0000", 2024-04-25T22:03:33.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0419000000000001e-05 2024-04-25T22:03:33.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214186+0000", 2024-04-25T22:03:33.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6526000000000001e-05 2024-04-25T22:03:33.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214194+0000", 2024-04-25T22:03:33.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6769999999999995e-06 2024-04-25T22:03:33.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214380+0000", 2024-04-25T22:03:33.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018580699999999999 2024-04-25T22:03:33.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:33.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214399+0000", 2024-04-25T22:03:33.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9446e-05 2024-04-25T22:03:33.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711402+0000", 2024-04-25T22:03:33.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.497002901 2024-04-25T22:03:33.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711822+0000", 2024-04-25T22:03:33.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00041989399999999997 2024-04-25T22:03:33.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:33.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.712017+0000", 2024-04-25T22:03:33.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019540700000000001 2024-04-25T22:03:33.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716792+0000", 2024-04-25T22:03:33.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047748210000000003 2024-04-25T22:03:33.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716937+0000", 2024-04-25T22:03:33.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014479099999999999 2024-04-25T22:03:33.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717081+0000", 2024-04-25T22:03:33.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014412100000000001 2024-04-25T22:03:33.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717211+0000", 2024-04-25T22:03:33.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012991200000000001 2024-04-25T22:03:33.640 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.640 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.640 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.640 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7089 4.16 4:6868fcac:::1000000206b.00000000:head [write 0~5386] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:33.641 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:33.641 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.331661496999999, 2024-04-25T22:03:33.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44658810700000001, 2024-04-25T22:03:33.641 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.641 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.641 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.641 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:33.641 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:33.641 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:33.641 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7089 2024-04-25T22:03:33.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.642 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:33.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:33.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273695+0000", 2024-04-25T22:03:33.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.463e-06 2024-04-25T22:03:33.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273712+0000", 2024-04-25T22:03:33.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7842999999999998e-05 2024-04-25T22:03:33.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273742+0000", 2024-04-25T22:03:33.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9039000000000001e-05 2024-04-25T22:03:33.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273756+0000", 2024-04-25T22:03:33.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4406999999999999e-05 2024-04-25T22:03:33.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273943+0000", 2024-04-25T22:03:33.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018708 2024-04-25T22:03:33.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:33.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273961+0000", 2024-04-25T22:03:33.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7977000000000001e-05 2024-04-25T22:03:33.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714748+0000", 2024-04-25T22:03:33.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.440786605 2024-04-25T22:03:33.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715013+0000", 2024-04-25T22:03:33.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026558300000000001 2024-04-25T22:03:33.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:33.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715309+0000", 2024-04-25T22:03:33.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000295715 2024-04-25T22:03:33.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.719035+0000", 2024-04-25T22:03:33.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037256310000000001 2024-04-25T22:03:33.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720142+0000", 2024-04-25T22:03:33.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001107053 2024-04-25T22:03:33.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720221+0000", 2024-04-25T22:03:33.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9832000000000004e-05 2024-04-25T22:03:33.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720280+0000", 2024-04-25T22:03:33.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8879000000000003e-05 2024-04-25T22:03:33.647 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.647 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.647 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.647 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7090 4.16 4:69dc3034:::1000000206c.00000000:head [write 0~957] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:33.647 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:33.647 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.329037166999999, 2024-04-25T22:03:33.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44572077100000002, 2024-04-25T22:03:33.648 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.648 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.648 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.648 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:33.648 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:33.648 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:33.648 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7090 2024-04-25T22:03:33.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.648 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:33.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:33.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276319+0000", 2024-04-25T22:03:33.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3429999999999998e-06 2024-04-25T22:03:33.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276330+0000", 2024-04-25T22:03:33.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1567e-05 2024-04-25T22:03:33.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276362+0000", 2024-04-25T22:03:33.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1863000000000003e-05 2024-04-25T22:03:33.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276377+0000", 2024-04-25T22:03:33.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5102999999999999e-05 2024-04-25T22:03:33.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276564+0000", 2024-04-25T22:03:33.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018629700000000001 2024-04-25T22:03:33.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:33.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276583+0000", 2024-04-25T22:03:33.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9743000000000001e-05 2024-04-25T22:03:33.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717354+0000", 2024-04-25T22:03:33.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44077094900000002 2024-04-25T22:03:33.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717723+0000", 2024-04-25T22:03:33.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036839099999999998 2024-04-25T22:03:33.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:33.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.718097+0000", 2024-04-25T22:03:33.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037392099999999999 2024-04-25T22:03:33.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720305+0000", 2024-04-25T22:03:33.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022084439999999999 2024-04-25T22:03:33.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721866+0000", 2024-04-25T22:03:33.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015610260000000001 2024-04-25T22:03:33.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721944+0000", 2024-04-25T22:03:33.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7961999999999997e-05 2024-04-25T22:03:33.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.722037+0000", 2024-04-25T22:03:33.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3162e-05 2024-04-25T22:03:33.653 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.653 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.653 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.654 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:10647 4.35 4:ae7b229b:::100000030a9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:33.654 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:33.654 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 20.075992472999999, 2024-04-25T22:03:33.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14506126, 2024-04-25T22:03:33.654 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.654 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.654 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.654 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:33.654 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:33.654 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:33.654 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10647 2024-04-25T22:03:33.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.654 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:33.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:33.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529364+0000", 2024-04-25T22:03:33.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.286e-06 2024-04-25T22:03:33.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538917+0000", 2024-04-25T22:03:33.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0095530010000000002 2024-04-25T22:03:33.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538955+0000", 2024-04-25T22:03:33.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:03:33.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538977+0000", 2024-04-25T22:03:33.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.105e-05 2024-04-25T22:03:33.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568092+0000", 2024-04-25T22:03:33.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029115604999999999 2024-04-25T22:03:33.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568243+0000", 2024-04-25T22:03:33.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000151044 2024-04-25T22:03:33.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:33.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568498+0000", 2024-04-25T22:03:33.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025517399999999999 2024-04-25T22:03:33.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628005+0000", 2024-04-25T22:03:33.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059506991000000002 2024-04-25T22:03:33.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674273+0000", 2024-04-25T22:03:33.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.046267233999999997 2024-04-25T22:03:33.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674357+0000", 2024-04-25T22:03:33.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4745000000000003e-05 2024-04-25T22:03:33.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674422+0000", 2024-04-25T22:03:33.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5160999999999995e-05 2024-04-25T22:03:33.659 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.660 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.660 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.660 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3891938~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:33.660 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:33.660 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.9226728870000009, 2024-04-25T22:03:33.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.144195727, 2024-04-25T22:03:33.660 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.660 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.660 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.660 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:33.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:33.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682682+0000", 2024-04-25T22:03:33.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6000000000000003e-07 2024-04-25T22:03:33.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682686+0000", 2024-04-25T22:03:33.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4630000000000003e-06 2024-04-25T22:03:33.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682695+0000", 2024-04-25T22:03:33.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7360000000000007e-06 2024-04-25T22:03:33.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682702+0000", 2024-04-25T22:03:33.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1239999999999999e-06 2024-04-25T22:03:33.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821515+0000", 2024-04-25T22:03:33.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13881310499999999 2024-04-25T22:03:33.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821780+0000", 2024-04-25T22:03:33.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026492699999999998 2024-04-25T22:03:33.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:33.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821974+0000", 2024-04-25T22:03:33.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000194561 2024-04-25T22:03:33.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826533+0000", 2024-04-25T22:03:33.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045586649999999999 2024-04-25T22:03:33.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826574+0000", 2024-04-25T22:03:33.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0995999999999998e-05 2024-04-25T22:03:33.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826754+0000", 2024-04-25T22:03:33.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017955400000000001 2024-04-25T22:03:33.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826877+0000", 2024-04-25T22:03:33.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122836 2024-04-25T22:03:33.665 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.665 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.665 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.665 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3893337~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:33.665 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:33.665 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.9226430539999999, 2024-04-25T22:03:33.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.146040321, 2024-04-25T22:03:33.666 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.666 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.666 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.666 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:33.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:33.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:33.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:03:33.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682716+0000", 2024-04-25T22:03:33.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3930000000000001e-06 2024-04-25T22:03:33.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682724+0000", 2024-04-25T22:03:33.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5769999999999994e-06 2024-04-25T22:03:33.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682731+0000", 2024-04-25T22:03:33.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1629999999999999e-06 2024-04-25T22:03:33.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823295+0000", 2024-04-25T22:03:33.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14056342099999999 2024-04-25T22:03:33.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823578+0000", 2024-04-25T22:03:33.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028355299999999997 2024-04-25T22:03:33.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:33.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823777+0000", 2024-04-25T22:03:33.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000198791 2024-04-25T22:03:33.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826993+0000", 2024-04-25T22:03:33.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032162169999999999 2024-04-25T22:03:33.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828492+0000", 2024-04-25T22:03:33.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001498283 2024-04-25T22:03:33.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828633+0000", 2024-04-25T22:03:33.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000141225 2024-04-25T22:03:33.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828751+0000", 2024-04-25T22:03:33.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000118038 2024-04-25T22:03:33.670 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.670 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.670 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.671 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3899493~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:33.671 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:33.671 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.9130490400000006, 2024-04-25T22:03:33.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14539154500000001, 2024-04-25T22:03:33.671 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.671 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.671 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.671 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:33.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:33.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692307+0000", 2024-04-25T22:03:33.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.216e-06 2024-04-25T22:03:33.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692316+0000", 2024-04-25T22:03:33.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:03:33.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692357+0000", 2024-04-25T22:03:33.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233000000000003e-05 2024-04-25T22:03:33.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692375+0000", 2024-04-25T22:03:33.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7949999999999999e-05 2024-04-25T22:03:33.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828922+0000", 2024-04-25T22:03:33.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.136546426 2024-04-25T22:03:33.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.829064+0000", 2024-04-25T22:03:33.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014193499999999999 2024-04-25T22:03:33.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:33.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.829295+0000", 2024-04-25T22:03:33.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023144100000000001 2024-04-25T22:03:33.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832412+0000", 2024-04-25T22:03:33.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003117112 2024-04-25T22:03:33.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837543+0000", 2024-04-25T22:03:33.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005131147 2024-04-25T22:03:33.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837629+0000", 2024-04-25T22:03:33.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5378999999999997e-05 2024-04-25T22:03:33.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837696+0000", 2024-04-25T22:03:33.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7426000000000001e-05 2024-04-25T22:03:33.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.676 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.676 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3901402~4724 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:33.676 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:33.676 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.9095467389999996, 2024-04-25T22:03:33.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14672065500000001, 2024-04-25T22:03:33.677 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.677 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.677 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.677 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:33.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:33.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695809+0000", 2024-04-25T22:03:33.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1100000000000001e-06 2024-04-25T22:03:33.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695828+0000", 2024-04-25T22:03:33.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8618999999999999e-05 2024-04-25T22:03:33.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695850+0000", 2024-04-25T22:03:33.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2243e-05 2024-04-25T22:03:33.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695864+0000", 2024-04-25T22:03:33.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3687e-05 2024-04-25T22:03:33.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831024+0000", 2024-04-25T22:03:33.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13516004300000001 2024-04-25T22:03:33.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831155+0000", 2024-04-25T22:03:33.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000131605 2024-04-25T22:03:33.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:33.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831353+0000", 2024-04-25T22:03:33.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000197708 2024-04-25T22:03:33.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837521+0000", 2024-04-25T22:03:33.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0061684180000000002 2024-04-25T22:03:33.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842269+0000", 2024-04-25T22:03:33.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047475659999999999 2024-04-25T22:03:33.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842402+0000", 2024-04-25T22:03:33.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000132643 2024-04-25T22:03:33.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842528+0000", 2024-04-25T22:03:33.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012601299999999999 2024-04-25T22:03:33.681 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.681 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.682 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.682 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3906126~6707 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:33.682 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:33.682 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.9062849820000007, 2024-04-25T22:03:33.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14563398599999999, 2024-04-25T22:03:33.682 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.682 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.682 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.682 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:33.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:33.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699071+0000", 2024-04-25T22:03:33.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.996e-06 2024-04-25T22:03:33.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699090+0000", 2024-04-25T22:03:33.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9449999999999998e-05 2024-04-25T22:03:33.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699112+0000", 2024-04-25T22:03:33.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2306e-05 2024-04-25T22:03:33.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699126+0000", 2024-04-25T22:03:33.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.383e-05 2024-04-25T22:03:33.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832497+0000", 2024-04-25T22:03:33.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13337096500000001 2024-04-25T22:03:33.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832632+0000", 2024-04-25T22:03:33.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013481499999999999 2024-04-25T22:03:33.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:33.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832828+0000", 2024-04-25T22:03:33.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000195558 2024-04-25T22:03:33.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837801+0000", 2024-04-25T22:03:33.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049729459999999998 2024-04-25T22:03:33.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844398+0000", 2024-04-25T22:03:33.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065972829999999998 2024-04-25T22:03:33.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844594+0000", 2024-04-25T22:03:33.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000195675 2024-04-25T22:03:33.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844703+0000", 2024-04-25T22:03:33.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109162 2024-04-25T22:03:33.687 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.687 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.687 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.687 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3024 3.d 3:b02ffd62:::200.00000010:head [write 3912833~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:33.687 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:33.688 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.9032202589999994, 2024-04-25T22:03:33.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14279916000000001, 2024-04-25T22:03:33.688 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.688 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.688 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.688 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:33.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:33.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702135+0000", 2024-04-25T22:03:33.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9530000000000002e-06 2024-04-25T22:03:33.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702154+0000", 2024-04-25T22:03:33.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8496e-05 2024-04-25T22:03:33.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702180+0000", 2024-04-25T22:03:33.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6313e-05 2024-04-25T22:03:33.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702205+0000", 2024-04-25T22:03:33.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.478e-05 2024-04-25T22:03:33.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836035+0000", 2024-04-25T22:03:33.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.133830269 2024-04-25T22:03:33.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836168+0000", 2024-04-25T22:03:33.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013234799999999999 2024-04-25T22:03:33.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:33.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836364+0000", 2024-04-25T22:03:33.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000196398 2024-04-25T22:03:33.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844793+0000", 2024-04-25T22:03:33.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.008428685 2024-04-25T22:03:33.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844811+0000", 2024-04-25T22:03:33.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8719000000000002e-05 2024-04-25T22:03:33.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844881+0000", 2024-04-25T22:03:33.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9671000000000004e-05 2024-04-25T22:03:33.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844933+0000", 2024-04-25T22:03:33.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1527999999999999e-05 2024-04-25T22:03:33.693 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.693 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.693 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.693 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3026 3.d 3:b02ffd62:::200.00000010:head [write 3919976~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:33.693 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:33.693 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.896535321, 2024-04-25T22:03:33.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14237590899999999, 2024-04-25T22:03:33.693 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.693 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.693 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.693 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:33.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:33.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708820+0000", 2024-04-25T22:03:33.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7600000000000001e-06 2024-04-25T22:03:33.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708832+0000", 2024-04-25T22:03:33.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1803e-05 2024-04-25T22:03:33.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708854+0000", 2024-04-25T22:03:33.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2467e-05 2024-04-25T22:03:33.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708872+0000", 2024-04-25T22:03:33.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7453e-05 2024-04-25T22:03:33.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842641+0000", 2024-04-25T22:03:33.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13376964099999999 2024-04-25T22:03:33.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842832+0000", 2024-04-25T22:03:33.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000190843 2024-04-25T22:03:33.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:33.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.843194+0000", 2024-04-25T22:03:33.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036169300000000001 2024-04-25T22:03:33.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845406+0000", 2024-04-25T22:03:33.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022118530000000002 2024-04-25T22:03:33.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851048+0000", 2024-04-25T22:03:33.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056423410000000004 2024-04-25T22:03:33.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851127+0000", 2024-04-25T22:03:33.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8461999999999995e-05 2024-04-25T22:03:33.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851194+0000", 2024-04-25T22:03:33.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7593000000000001e-05 2024-04-25T22:03:33.698 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.698 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.698 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.698 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3027 3.d 3:b02ffd62:::200.00000010:head [write 3922740~2927 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:33.698 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:33.698 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.8964300420000004, 2024-04-25T22:03:33.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14516088799999999, 2024-04-25T22:03:33.698 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.699 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.699 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.699 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:33.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:33.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708925+0000", 2024-04-25T22:03:33.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.683e-06 2024-04-25T22:03:33.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708936+0000", 2024-04-25T22:03:33.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.11e-05 2024-04-25T22:03:33.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708960+0000", 2024-04-25T22:03:33.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3839999999999999e-05 2024-04-25T22:03:33.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708977+0000", 2024-04-25T22:03:33.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6379e-05 2024-04-25T22:03:33.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845488+0000", 2024-04-25T22:03:33.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.136511414 2024-04-25T22:03:33.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845619+0000", 2024-04-25T22:03:33.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000130755 2024-04-25T22:03:33.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:33.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845817+0000", 2024-04-25T22:03:33.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000198271 2024-04-25T22:03:33.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849529+0000", 2024-04-25T22:03:33.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003711888 2024-04-25T22:03:33.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.853911+0000", 2024-04-25T22:03:33.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043815800000000004 2024-04-25T22:03:33.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854018+0000", 2024-04-25T22:03:33.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000107879 2024-04-25T22:03:33.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854085+0000", 2024-04-25T22:03:33.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6099000000000005e-05 2024-04-25T22:03:33.703 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.703 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.703 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.703 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3028 3.d 3:b02ffd62:::200.00000010:head [write 3925667~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:33.704 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:33.704 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.895909498, 2024-04-25T22:03:33.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14478423600000001, 2024-04-25T22:03:33.704 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.704 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.704 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.704 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:33.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:33.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709446+0000", 2024-04-25T22:03:33.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.73e-06 2024-04-25T22:03:33.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709454+0000", 2024-04-25T22:03:33.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:03:33.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709470+0000", 2024-04-25T22:03:33.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5956000000000001e-05 2024-04-25T22:03:33.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709483+0000", 2024-04-25T22:03:33.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.216e-05 2024-04-25T22:03:33.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.846891+0000", 2024-04-25T22:03:33.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13740814600000001 2024-04-25T22:03:33.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.847019+0000", 2024-04-25T22:03:33.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000128121 2024-04-25T22:03:33.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:33.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.847227+0000", 2024-04-25T22:03:33.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020847800000000001 2024-04-25T22:03:33.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.852488+0000", 2024-04-25T22:03:33.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052603759999999998 2024-04-25T22:03:33.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854101+0000", 2024-04-25T22:03:33.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001613354 2024-04-25T22:03:33.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854170+0000", 2024-04-25T22:03:33.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8935000000000003e-05 2024-04-25T22:03:33.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854228+0000", 2024-04-25T22:03:33.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8437000000000003e-05 2024-04-25T22:03:33.709 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.709 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.709 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.709 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3029 3.d 3:b02ffd62:::200.00000010:head [write 3927576~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:33.709 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:33.709 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.8958316360000005, 2024-04-25T22:03:33.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14641235599999999, 2024-04-25T22:03:33.709 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.709 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.709 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.709 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:33.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:33.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709523+0000", 2024-04-25T22:03:33.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9999999999999995e-07 2024-04-25T22:03:33.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709530+0000", 2024-04-25T22:03:33.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7900000000000002e-06 2024-04-25T22:03:33.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709545+0000", 2024-04-25T22:03:33.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5563e-05 2024-04-25T22:03:33.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709554+0000", 2024-04-25T22:03:33.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7700000000000007e-06 2024-04-25T22:03:33.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848071+0000", 2024-04-25T22:03:33.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13851706499999999 2024-04-25T22:03:33.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848219+0000", 2024-04-25T22:03:33.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014761599999999999 2024-04-25T22:03:33.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:33.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848412+0000", 2024-04-25T22:03:33.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019303300000000001 2024-04-25T22:03:33.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854240+0000", 2024-04-25T22:03:33.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058282359999999997 2024-04-25T22:03:33.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855804+0000", 2024-04-25T22:03:33.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001563938 2024-04-25T22:03:33.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855879+0000", 2024-04-25T22:03:33.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4683000000000003e-05 2024-04-25T22:03:33.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855934+0000", 2024-04-25T22:03:33.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5661999999999997e-05 2024-04-25T22:03:33.714 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.714 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.714 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.714 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3030 3.d 3:b02ffd62:::200.00000010:head [write 3929994~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:33.714 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:33.715 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.8944132269999994, 2024-04-25T22:03:33.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.146870588, 2024-04-25T22:03:33.715 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.715 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.715 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.715 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:33.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:33.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710942+0000", 2024-04-25T22:03:33.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.024e-06 2024-04-25T22:03:33.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710955+0000", 2024-04-25T22:03:33.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2103000000000001e-05 2024-04-25T22:03:33.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710977+0000", 2024-04-25T22:03:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2606e-05 2024-04-25T22:03:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710991+0000", 2024-04-25T22:03:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3689999999999999e-05 2024-04-25T22:03:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849638+0000", 2024-04-25T22:03:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.138646667 2024-04-25T22:03:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849809+0000", 2024-04-25T22:03:33.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000171495 2024-04-25T22:03:33.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:33.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.850048+0000", 2024-04-25T22:03:33.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023940699999999999 2024-04-25T22:03:33.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855954+0000", 2024-04-25T22:03:33.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059050919999999998 2024-04-25T22:03:33.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857670+0000", 2024-04-25T22:03:33.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017168489999999999 2024-04-25T22:03:33.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857747+0000", 2024-04-25T22:03:33.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6526000000000006e-05 2024-04-25T22:03:33.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857811+0000", 2024-04-25T22:03:33.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4128999999999995e-05 2024-04-25T22:03:33.720 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.720 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.720 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.720 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3031 3.d 3:b02ffd62:::200.00000010:head [write 3932758~2245 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:33.720 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:33.720 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.8942027790000004, 2024-04-25T22:03:33.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14694558999999999, 2024-04-25T22:03:33.720 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:33.721 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:33.721 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:33.721 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:33.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:33.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:33.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:33.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:33.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:33.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:33.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711152+0000", 2024-04-25T22:03:33.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5230000000000001e-06 2024-04-25T22:03:33.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:33.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711162+0000", 2024-04-25T22:03:33.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2299999999999997e-06 2024-04-25T22:03:33.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:33.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711179+0000", 2024-04-25T22:03:33.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7220000000000001e-05 2024-04-25T22:03:33.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711190+0000", 2024-04-25T22:03:33.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1323e-05 2024-04-25T22:03:33.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:33.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851296+0000", 2024-04-25T22:03:33.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14010541600000001 2024-04-25T22:03:33.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:33.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851436+0000", 2024-04-25T22:03:33.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140409 2024-04-25T22:03:33.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:33.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851641+0000", 2024-04-25T22:03:33.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020471700000000001 2024-04-25T22:03:33.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:33.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857847+0000", 2024-04-25T22:03:33.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062065310000000004 2024-04-25T22:03:33.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:33.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857952+0000", 2024-04-25T22:03:33.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105132 2024-04-25T22:03:33.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:33.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.858026+0000", 2024-04-25T22:03:33.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3799000000000003e-05 2024-04-25T22:03:33.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:33.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:33.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:33.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.858096+0000", 2024-04-25T22:03:33.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0290000000000006e-05 2024-04-25T22:03:33.725 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.725 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.725 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.726 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:33.726 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:33.726 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:33.726 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:03:33.728 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:33.720+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:33.729 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:33.828 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:33.824+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:33.849 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-25T22:03:33.869 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:33.869 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:33.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.870 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7287 3.1 3:86ee9bce:::500.00000001:head [write 346026~92819 in=92819b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:33.870 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:33.866274+0000", 2024-04-25T22:03:33.870 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0034077420000000001, 2024-04-25T22:03:33.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0034270279999999999, 2024-04-25T22:03:33.870 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:33.870 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:33.870 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:33.870 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:33.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:33.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.866274+0000", 2024-04-25T22:03:33.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:33.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:33.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.866274+0000", 2024-04-25T22:03:33.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:33.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:33.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.866277+0000", 2024-04-25T22:03:33.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.96e-06 2024-04-25T22:03:33.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:33.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.866526+0000", 2024-04-25T22:03:33.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024898999999999999 2024-04-25T22:03:33.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:33.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.866556+0000", 2024-04-25T22:03:33.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0358999999999999e-05 2024-04-25T22:03:33.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.866580+0000", 2024-04-25T22:03:33.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3808e-05 2024-04-25T22:03:33.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:33.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.866665+0000", 2024-04-25T22:03:33.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4902999999999997e-05 2024-04-25T22:03:33.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:33.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.866759+0000", 2024-04-25T22:03:33.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4096000000000002e-05 2024-04-25T22:03:33.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:33.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.866896+0000", 2024-04-25T22:03:33.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013687500000000001 2024-04-25T22:03:33.873 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:33.873 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:33.873 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:33.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.874 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:7289 4.3b 4:de5452c2:::10000001d01.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:33.874 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:33.867805+0000", 2024-04-25T22:03:33.874 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0018762340000000001, 2024-04-25T22:03:33.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001940928, 2024-04-25T22:03:33.874 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:33.874 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:33.874 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:33.874 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:33.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:33.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.867805+0000", 2024-04-25T22:03:33.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:33.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:33.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.867805+0000", 2024-04-25T22:03:33.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:33.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:33.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.867820+0000", 2024-04-25T22:03:33.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4762e-05 2024-04-25T22:03:33.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:33.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.867828+0000", 2024-04-25T22:03:33.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6969999999999993e-06 2024-04-25T22:03:33.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:33.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.867853+0000", 2024-04-25T22:03:33.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5034000000000001e-05 2024-04-25T22:03:33.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.867871+0000", 2024-04-25T22:03:33.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8312999999999999e-05 2024-04-25T22:03:33.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:33.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.868029+0000", 2024-04-25T22:03:33.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015848300000000001 2024-04-25T22:03:33.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:33.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.868347+0000", 2024-04-25T22:03:33.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031718399999999998 2024-04-25T22:03:33.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:33.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.868658+0000", 2024-04-25T22:03:33.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031121499999999999 2024-04-25T22:03:33.877 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:33.877 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:33.877 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:33.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.878 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:7123 4.2e e72/71 4:7732e3da:::10000001b4c.00000000:head v 72'225, mlcod=0'0)", 2024-04-25T22:03:33.878 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:33.868065+0000", 2024-04-25T22:03:33.878 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0016163449999999999, 2024-04-25T22:03:33.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017177659999999999, 2024-04-25T22:03:33.878 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:33.878 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:33.878 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:03:33.878 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:33.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:33.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.868065+0000", 2024-04-25T22:03:33.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:33.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:33.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.868065+0000", 2024-04-25T22:03:33.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:33.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:33.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.868066+0000", 2024-04-25T22:03:33.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0920000000000001e-06 2024-04-25T22:03:33.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:33.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.868076+0000", 2024-04-25T22:03:33.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7049999999999994e-06 2024-04-25T22:03:33.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:33.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.868094+0000", 2024-04-25T22:03:33.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8374000000000001e-05 2024-04-25T22:03:33.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:33.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.868108+0000", 2024-04-25T22:03:33.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3900000000000001e-05 2024-04-25T22:03:33.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:33.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.868211+0000", 2024-04-25T22:03:33.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010331999999999999 2024-04-25T22:03:33.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:33.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:33.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:33.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:33.868240+0000", 2024-04-25T22:03:33.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8356000000000001e-05 2024-04-25T22:03:33.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:33.881 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:33.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:33.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:33.881 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-04-25T22:03:33.881 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 3 2024-04-25T22:03:33.882 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:33.883 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:33.883 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:33.885 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:33.910 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:33.910 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:33.929 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:33.924+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:33.932 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:33.932 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:34.030 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:34.028+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:34.040 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:34.041 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:34.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:34.131 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:34.128+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:34.184 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:34.184 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:34.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:34.231 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:34.229+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:34.325 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:34.325 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:34.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:34.329+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:34.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:34.434 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:34.428+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:34.462 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:34.462 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:34.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:34.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:34.533+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:34.636 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:34.632+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:34.641 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:34.641 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:34.656 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:34.737 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:34.736+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:34.802 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:34.803 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:34.822 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:34.839 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:34.832+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:34.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:34.933+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:34.972 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:34.972 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:34.986 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:35.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:35.037+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:35.108 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:35.108 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:35.122 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:35.140 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:35.136+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:35.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:35.237+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:35.254 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:35.254 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:35.268 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:35.342 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:35.340+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:35.435 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:35.436 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:35.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:35.441+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:35.451 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:35.544 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:35.540+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:35.617 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:35.617 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:35.632 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:35.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:35.641+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:35.746 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:35.744+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:35.762 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:35.762 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:35.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:35.847 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:35.844+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:35.870 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:03:35.936 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:35.936 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:35.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:35.945+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:35.949 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:03:35.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:36.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:36.045+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:36.079 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:36.079 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:36.093 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:36.119 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:36.119 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:36.150 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:36.148+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:36.156 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:36.156 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:36.178 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:36.179 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:36.230 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:36.230 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:36.230 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:03:36.230 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:36.246 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:36.293 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:36.292+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:36.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:36.349+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:36.375 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:36.376 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:36.376 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:03:36.376 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:03:36.376 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:36.390 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:36.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:36.449+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:36.553 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:36.552+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:36.569 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:36.569 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:03:36.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:03:36.569 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:36.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.569 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T22:03:36.569 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:36.569 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.580592772999999, 2024-04-25T22:03:36.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.180276931, 2024-04-25T22:03:36.569 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.569 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.570 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.570 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:36.570 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:36.570 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:36.570 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4 2024-04-25T22:03:36.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.570 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:36.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983834+0000", 2024-04-25T22:03:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2900000000000001e-06 2024-04-25T22:03:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991787+0000", 2024-04-25T22:03:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079521690000000003 2024-04-25T22:03:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991826+0000", 2024-04-25T22:03:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9258999999999998e-05 2024-04-25T22:03:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991845+0000", 2024-04-25T22:03:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9360000000000001e-05 2024-04-25T22:03:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992058+0000", 2024-04-25T22:03:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212559 2024-04-25T22:03:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992213+0000", 2024-04-25T22:03:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015520700000000001 2024-04-25T22:03:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992414+0000", 2024-04-25T22:03:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020049 2024-04-25T22:03:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162511+0000", 2024-04-25T22:03:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.17009782900000001 2024-04-25T22:03:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163967+0000", 2024-04-25T22:03:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001455752 2024-04-25T22:03:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164045+0000", 2024-04-25T22:03:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7415000000000003e-05 2024-04-25T22:03:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164109+0000", 2024-04-25T22:03:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4601e-05 2024-04-25T22:03:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6847 4.16 4:68767fd1:::10000001f4f.00000000:head [write 0~7212] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.870953312000001, 2024-04-25T22:03:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0208302119999999, 2024-04-25T22:03:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6847 2024-04-25T22:03:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693473+0000", 2024-04-25T22:03:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.75e-06 2024-04-25T22:03:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693490+0000", 2024-04-25T22:03:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6540000000000001e-05 2024-04-25T22:03:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693509+0000", 2024-04-25T22:03:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9536999999999999e-05 2024-04-25T22:03:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693522+0000", 2024-04-25T22:03:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2099000000000001e-05 2024-04-25T22:03:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693677+0000", 2024-04-25T22:03:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015516799999999999 2024-04-25T22:03:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693705+0000", 2024-04-25T22:03:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8663e-05 2024-04-25T22:03:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705551+0000", 2024-04-25T22:03:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.011845495 2024-04-25T22:03:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705942+0000", 2024-04-25T22:03:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00039080099999999997 2024-04-25T22:03:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.706151+0000", 2024-04-25T22:03:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000209457 2024-04-25T22:03:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711141+0000", 2024-04-25T22:03:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049901240000000003 2024-04-25T22:03:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714005+0000", 2024-04-25T22:03:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028642229999999999 2024-04-25T22:03:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714180+0000", 2024-04-25T22:03:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017433699999999999 2024-04-25T22:03:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714302+0000", 2024-04-25T22:03:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122018 2024-04-25T22:03:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6960 4.16 4:6823d322:::10000001fd2.00000000:head [write 0~150] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.593949213999998, 2024-04-25T22:03:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.74417278899999995, 2024-04-25T22:03:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6960 2024-04-25T22:03:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970478+0000", 2024-04-25T22:03:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.939e-06 2024-04-25T22:03:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970488+0000", 2024-04-25T22:03:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9699999999999994e-06 2024-04-25T22:03:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970524+0000", 2024-04-25T22:03:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5963000000000001e-05 2024-04-25T22:03:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970537+0000", 2024-04-25T22:03:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.31e-05 2024-04-25T22:03:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970701+0000", 2024-04-25T22:03:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164177 2024-04-25T22:03:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970718+0000", 2024-04-25T22:03:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7323e-05 2024-04-25T22:03:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707632+0000", 2024-04-25T22:03:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.73691394300000002 2024-04-25T22:03:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707924+0000", 2024-04-25T22:03:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029223299999999998 2024-04-25T22:03:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.708389+0000", 2024-04-25T22:03:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046429300000000001 2024-04-25T22:03:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029039830000000002 2024-04-25T22:03:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714409+0000", 2024-04-25T22:03:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031159260000000002 2024-04-25T22:03:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714538+0000", 2024-04-25T22:03:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012952100000000001 2024-04-25T22:03:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714649+0000", 2024-04-25T22:03:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110418 2024-04-25T22:03:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7039 4.16 4:6919637e:::10000002032.00000000:head [write 0~2968] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.407902708999998, 2024-04-25T22:03:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.56024932199999999, 2024-04-25T22:03:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7039 2024-04-25T22:03:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156523+0000", 2024-04-25T22:03:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2130000000000001e-06 2024-04-25T22:03:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156530+0000", 2024-04-25T22:03:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9090000000000003e-06 2024-04-25T22:03:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156544+0000", 2024-04-25T22:03:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3271999999999999e-05 2024-04-25T22:03:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156551+0000", 2024-04-25T22:03:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4970000000000004e-06 2024-04-25T22:03:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156639+0000", 2024-04-25T22:03:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7638000000000004e-05 2024-04-25T22:03:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156649+0000", 2024-04-25T22:03:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0536e-05 2024-04-25T22:03:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709515+0000", 2024-04-25T22:03:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.55286568999999997 2024-04-25T22:03:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709836+0000", 2024-04-25T22:03:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032078899999999998 2024-04-25T22:03:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.710271+0000", 2024-04-25T22:03:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043530000000000001 2024-04-25T22:03:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716576+0000", 2024-04-25T22:03:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063045050000000002 2024-04-25T22:03:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716605+0000", 2024-04-25T22:03:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8949e-05 2024-04-25T22:03:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716706+0000", 2024-04-25T22:03:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101765 2024-04-25T22:03:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716772+0000", 2024-04-25T22:03:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5259000000000007e-05 2024-04-25T22:03:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7065 4.16 4:697a9f10:::10000002050.00000000:head [write 0~16297] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.350286761, 2024-04-25T22:03:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.50307290800000004, 2024-04-25T22:03:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7065 2024-04-25T22:03:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214139+0000", 2024-04-25T22:03:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.186e-06 2024-04-25T22:03:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214170+0000", 2024-04-25T22:03:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0419000000000001e-05 2024-04-25T22:03:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214186+0000", 2024-04-25T22:03:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6526000000000001e-05 2024-04-25T22:03:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214194+0000", 2024-04-25T22:03:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6769999999999995e-06 2024-04-25T22:03:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214380+0000", 2024-04-25T22:03:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018580699999999999 2024-04-25T22:03:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214399+0000", 2024-04-25T22:03:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9446e-05 2024-04-25T22:03:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711402+0000", 2024-04-25T22:03:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.497002901 2024-04-25T22:03:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711822+0000", 2024-04-25T22:03:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00041989399999999997 2024-04-25T22:03:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.712017+0000", 2024-04-25T22:03:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019540700000000001 2024-04-25T22:03:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716792+0000", 2024-04-25T22:03:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047748210000000003 2024-04-25T22:03:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716937+0000", 2024-04-25T22:03:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014479099999999999 2024-04-25T22:03:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717081+0000", 2024-04-25T22:03:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014412100000000001 2024-04-25T22:03:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717211+0000", 2024-04-25T22:03:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012991200000000001 2024-04-25T22:03:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7089 4.16 4:6868fcac:::1000000206b.00000000:head [write 0~5386] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.290732767000002, 2024-04-25T22:03:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44658810700000001, 2024-04-25T22:03:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7089 2024-04-25T22:03:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273695+0000", 2024-04-25T22:03:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.463e-06 2024-04-25T22:03:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273712+0000", 2024-04-25T22:03:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7842999999999998e-05 2024-04-25T22:03:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273742+0000", 2024-04-25T22:03:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9039000000000001e-05 2024-04-25T22:03:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273756+0000", 2024-04-25T22:03:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4406999999999999e-05 2024-04-25T22:03:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273943+0000", 2024-04-25T22:03:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018708 2024-04-25T22:03:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273961+0000", 2024-04-25T22:03:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7977000000000001e-05 2024-04-25T22:03:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714748+0000", 2024-04-25T22:03:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.440786605 2024-04-25T22:03:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715013+0000", 2024-04-25T22:03:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026558300000000001 2024-04-25T22:03:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715309+0000", 2024-04-25T22:03:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000295715 2024-04-25T22:03:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.719035+0000", 2024-04-25T22:03:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037256310000000001 2024-04-25T22:03:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720142+0000", 2024-04-25T22:03:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001107053 2024-04-25T22:03:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720221+0000", 2024-04-25T22:03:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9832000000000004e-05 2024-04-25T22:03:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720280+0000", 2024-04-25T22:03:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8879000000000003e-05 2024-04-25T22:03:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7090 4.16 4:69dc3034:::1000000206c.00000000:head [write 0~957] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.288108436999998, 2024-04-25T22:03:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44572077100000002, 2024-04-25T22:03:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7090 2024-04-25T22:03:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276319+0000", 2024-04-25T22:03:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3429999999999998e-06 2024-04-25T22:03:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276330+0000", 2024-04-25T22:03:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1567e-05 2024-04-25T22:03:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276362+0000", 2024-04-25T22:03:36.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1863000000000003e-05 2024-04-25T22:03:36.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276377+0000", 2024-04-25T22:03:36.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5102999999999999e-05 2024-04-25T22:03:36.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276564+0000", 2024-04-25T22:03:36.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018629700000000001 2024-04-25T22:03:36.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:36.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276583+0000", 2024-04-25T22:03:36.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9743000000000001e-05 2024-04-25T22:03:36.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717354+0000", 2024-04-25T22:03:36.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44077094900000002 2024-04-25T22:03:36.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717723+0000", 2024-04-25T22:03:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036839099999999998 2024-04-25T22:03:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.718097+0000", 2024-04-25T22:03:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037392099999999999 2024-04-25T22:03:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720305+0000", 2024-04-25T22:03:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022084439999999999 2024-04-25T22:03:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721866+0000", 2024-04-25T22:03:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015610260000000001 2024-04-25T22:03:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721944+0000", 2024-04-25T22:03:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7961999999999997e-05 2024-04-25T22:03:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.722037+0000", 2024-04-25T22:03:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3162e-05 2024-04-25T22:03:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:10647 4.35 4:ae7b229b:::100000030a9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.035063742999998, 2024-04-25T22:03:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14506126, 2024-04-25T22:03:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10647 2024-04-25T22:03:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529364+0000", 2024-04-25T22:03:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.286e-06 2024-04-25T22:03:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538917+0000", 2024-04-25T22:03:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0095530010000000002 2024-04-25T22:03:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538955+0000", 2024-04-25T22:03:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:03:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538977+0000", 2024-04-25T22:03:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.105e-05 2024-04-25T22:03:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568092+0000", 2024-04-25T22:03:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029115604999999999 2024-04-25T22:03:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568243+0000", 2024-04-25T22:03:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000151044 2024-04-25T22:03:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568498+0000", 2024-04-25T22:03:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025517399999999999 2024-04-25T22:03:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628005+0000", 2024-04-25T22:03:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059506991000000002 2024-04-25T22:03:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674273+0000", 2024-04-25T22:03:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.046267233999999997 2024-04-25T22:03:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674357+0000", 2024-04-25T22:03:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4745000000000003e-05 2024-04-25T22:03:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674422+0000", 2024-04-25T22:03:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5160999999999995e-05 2024-04-25T22:03:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3891938~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 11.881744157, 2024-04-25T22:03:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.144195727, 2024-04-25T22:03:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682682+0000", 2024-04-25T22:03:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6000000000000003e-07 2024-04-25T22:03:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682686+0000", 2024-04-25T22:03:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4630000000000003e-06 2024-04-25T22:03:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682695+0000", 2024-04-25T22:03:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7360000000000007e-06 2024-04-25T22:03:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682702+0000", 2024-04-25T22:03:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1239999999999999e-06 2024-04-25T22:03:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821515+0000", 2024-04-25T22:03:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13881310499999999 2024-04-25T22:03:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821780+0000", 2024-04-25T22:03:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026492699999999998 2024-04-25T22:03:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821974+0000", 2024-04-25T22:03:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000194561 2024-04-25T22:03:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826533+0000", 2024-04-25T22:03:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045586649999999999 2024-04-25T22:03:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826574+0000", 2024-04-25T22:03:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0995999999999998e-05 2024-04-25T22:03:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826754+0000", 2024-04-25T22:03:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017955400000000001 2024-04-25T22:03:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826877+0000", 2024-04-25T22:03:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122836 2024-04-25T22:03:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3893337~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 11.881714324000001, 2024-04-25T22:03:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.146040321, 2024-04-25T22:03:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:03:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682716+0000", 2024-04-25T22:03:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3930000000000001e-06 2024-04-25T22:03:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682724+0000", 2024-04-25T22:03:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5769999999999994e-06 2024-04-25T22:03:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682731+0000", 2024-04-25T22:03:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1629999999999999e-06 2024-04-25T22:03:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823295+0000", 2024-04-25T22:03:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14056342099999999 2024-04-25T22:03:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823578+0000", 2024-04-25T22:03:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028355299999999997 2024-04-25T22:03:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823777+0000", 2024-04-25T22:03:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000198791 2024-04-25T22:03:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826993+0000", 2024-04-25T22:03:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032162169999999999 2024-04-25T22:03:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828492+0000", 2024-04-25T22:03:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001498283 2024-04-25T22:03:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828633+0000", 2024-04-25T22:03:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000141225 2024-04-25T22:03:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828751+0000", 2024-04-25T22:03:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000118038 2024-04-25T22:03:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3899493~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 11.87212031, 2024-04-25T22:03:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14539154500000001, 2024-04-25T22:03:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692307+0000", 2024-04-25T22:03:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.216e-06 2024-04-25T22:03:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692316+0000", 2024-04-25T22:03:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:03:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692357+0000", 2024-04-25T22:03:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233000000000003e-05 2024-04-25T22:03:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692375+0000", 2024-04-25T22:03:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7949999999999999e-05 2024-04-25T22:03:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828922+0000", 2024-04-25T22:03:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.136546426 2024-04-25T22:03:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.829064+0000", 2024-04-25T22:03:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014193499999999999 2024-04-25T22:03:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.829295+0000", 2024-04-25T22:03:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023144100000000001 2024-04-25T22:03:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832412+0000", 2024-04-25T22:03:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003117112 2024-04-25T22:03:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837543+0000", 2024-04-25T22:03:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005131147 2024-04-25T22:03:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837629+0000", 2024-04-25T22:03:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5378999999999997e-05 2024-04-25T22:03:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837696+0000", 2024-04-25T22:03:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7426000000000001e-05 2024-04-25T22:03:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3901402~4724 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 11.868618009, 2024-04-25T22:03:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14672065500000001, 2024-04-25T22:03:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695809+0000", 2024-04-25T22:03:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1100000000000001e-06 2024-04-25T22:03:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695828+0000", 2024-04-25T22:03:36.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8618999999999999e-05 2024-04-25T22:03:36.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695850+0000", 2024-04-25T22:03:36.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2243e-05 2024-04-25T22:03:36.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695864+0000", 2024-04-25T22:03:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3687e-05 2024-04-25T22:03:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831024+0000", 2024-04-25T22:03:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13516004300000001 2024-04-25T22:03:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831155+0000", 2024-04-25T22:03:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000131605 2024-04-25T22:03:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831353+0000", 2024-04-25T22:03:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000197708 2024-04-25T22:03:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837521+0000", 2024-04-25T22:03:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0061684180000000002 2024-04-25T22:03:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842269+0000", 2024-04-25T22:03:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047475659999999999 2024-04-25T22:03:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842402+0000", 2024-04-25T22:03:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000132643 2024-04-25T22:03:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842528+0000", 2024-04-25T22:03:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012601299999999999 2024-04-25T22:03:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3906126~6707 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 11.865356252, 2024-04-25T22:03:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14563398599999999, 2024-04-25T22:03:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699071+0000", 2024-04-25T22:03:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.996e-06 2024-04-25T22:03:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699090+0000", 2024-04-25T22:03:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9449999999999998e-05 2024-04-25T22:03:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699112+0000", 2024-04-25T22:03:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2306e-05 2024-04-25T22:03:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699126+0000", 2024-04-25T22:03:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.383e-05 2024-04-25T22:03:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832497+0000", 2024-04-25T22:03:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13337096500000001 2024-04-25T22:03:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832632+0000", 2024-04-25T22:03:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013481499999999999 2024-04-25T22:03:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832828+0000", 2024-04-25T22:03:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000195558 2024-04-25T22:03:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837801+0000", 2024-04-25T22:03:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049729459999999998 2024-04-25T22:03:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844398+0000", 2024-04-25T22:03:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065972829999999998 2024-04-25T22:03:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844594+0000", 2024-04-25T22:03:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000195675 2024-04-25T22:03:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844703+0000", 2024-04-25T22:03:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109162 2024-04-25T22:03:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3024 3.d 3:b02ffd62:::200.00000010:head [write 3912833~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 11.862291529, 2024-04-25T22:03:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14279916000000001, 2024-04-25T22:03:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702135+0000", 2024-04-25T22:03:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9530000000000002e-06 2024-04-25T22:03:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702154+0000", 2024-04-25T22:03:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8496e-05 2024-04-25T22:03:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702180+0000", 2024-04-25T22:03:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6313e-05 2024-04-25T22:03:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702205+0000", 2024-04-25T22:03:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.478e-05 2024-04-25T22:03:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836035+0000", 2024-04-25T22:03:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.133830269 2024-04-25T22:03:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836168+0000", 2024-04-25T22:03:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013234799999999999 2024-04-25T22:03:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836364+0000", 2024-04-25T22:03:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000196398 2024-04-25T22:03:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844793+0000", 2024-04-25T22:03:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.008428685 2024-04-25T22:03:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844811+0000", 2024-04-25T22:03:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8719000000000002e-05 2024-04-25T22:03:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844881+0000", 2024-04-25T22:03:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9671000000000004e-05 2024-04-25T22:03:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844933+0000", 2024-04-25T22:03:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1527999999999999e-05 2024-04-25T22:03:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3026 3.d 3:b02ffd62:::200.00000010:head [write 3919976~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 11.855606591000001, 2024-04-25T22:03:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14237590899999999, 2024-04-25T22:03:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708820+0000", 2024-04-25T22:03:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7600000000000001e-06 2024-04-25T22:03:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708832+0000", 2024-04-25T22:03:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1803e-05 2024-04-25T22:03:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708854+0000", 2024-04-25T22:03:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2467e-05 2024-04-25T22:03:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708872+0000", 2024-04-25T22:03:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7453e-05 2024-04-25T22:03:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842641+0000", 2024-04-25T22:03:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13376964099999999 2024-04-25T22:03:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842832+0000", 2024-04-25T22:03:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000190843 2024-04-25T22:03:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.843194+0000", 2024-04-25T22:03:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036169300000000001 2024-04-25T22:03:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845406+0000", 2024-04-25T22:03:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022118530000000002 2024-04-25T22:03:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851048+0000", 2024-04-25T22:03:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056423410000000004 2024-04-25T22:03:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851127+0000", 2024-04-25T22:03:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8461999999999995e-05 2024-04-25T22:03:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851194+0000", 2024-04-25T22:03:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7593000000000001e-05 2024-04-25T22:03:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3027 3.d 3:b02ffd62:::200.00000010:head [write 3922740~2927 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 11.855501311999999, 2024-04-25T22:03:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14516088799999999, 2024-04-25T22:03:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708925+0000", 2024-04-25T22:03:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.683e-06 2024-04-25T22:03:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708936+0000", 2024-04-25T22:03:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.11e-05 2024-04-25T22:03:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708960+0000", 2024-04-25T22:03:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3839999999999999e-05 2024-04-25T22:03:36.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708977+0000", 2024-04-25T22:03:36.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6379e-05 2024-04-25T22:03:36.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845488+0000", 2024-04-25T22:03:36.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.136511414 2024-04-25T22:03:36.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845619+0000", 2024-04-25T22:03:36.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000130755 2024-04-25T22:03:36.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845817+0000", 2024-04-25T22:03:36.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000198271 2024-04-25T22:03:36.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849529+0000", 2024-04-25T22:03:36.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003711888 2024-04-25T22:03:36.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.853911+0000", 2024-04-25T22:03:36.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043815800000000004 2024-04-25T22:03:36.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854018+0000", 2024-04-25T22:03:36.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000107879 2024-04-25T22:03:36.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854085+0000", 2024-04-25T22:03:36.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6099000000000005e-05 2024-04-25T22:03:36.664 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.664 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.664 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.664 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3028 3.d 3:b02ffd62:::200.00000010:head [write 3925667~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:36.664 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:36.664 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 11.854980768000001, 2024-04-25T22:03:36.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14478423600000001, 2024-04-25T22:03:36.664 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.664 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.665 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.665 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:36.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:36.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709446+0000", 2024-04-25T22:03:36.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.73e-06 2024-04-25T22:03:36.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709454+0000", 2024-04-25T22:03:36.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:03:36.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709470+0000", 2024-04-25T22:03:36.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5956000000000001e-05 2024-04-25T22:03:36.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709483+0000", 2024-04-25T22:03:36.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.216e-05 2024-04-25T22:03:36.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.846891+0000", 2024-04-25T22:03:36.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13740814600000001 2024-04-25T22:03:36.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.847019+0000", 2024-04-25T22:03:36.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000128121 2024-04-25T22:03:36.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.847227+0000", 2024-04-25T22:03:36.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020847800000000001 2024-04-25T22:03:36.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.852488+0000", 2024-04-25T22:03:36.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052603759999999998 2024-04-25T22:03:36.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854101+0000", 2024-04-25T22:03:36.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001613354 2024-04-25T22:03:36.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854170+0000", 2024-04-25T22:03:36.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8935000000000003e-05 2024-04-25T22:03:36.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854228+0000", 2024-04-25T22:03:36.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8437000000000003e-05 2024-04-25T22:03:36.669 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.669 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.669 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.670 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3029 3.d 3:b02ffd62:::200.00000010:head [write 3927576~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:36.670 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:36.670 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 11.854902906, 2024-04-25T22:03:36.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14641235599999999, 2024-04-25T22:03:36.670 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.670 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.670 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.670 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:36.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:36.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709523+0000", 2024-04-25T22:03:36.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9999999999999995e-07 2024-04-25T22:03:36.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709530+0000", 2024-04-25T22:03:36.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7900000000000002e-06 2024-04-25T22:03:36.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709545+0000", 2024-04-25T22:03:36.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5563e-05 2024-04-25T22:03:36.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709554+0000", 2024-04-25T22:03:36.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7700000000000007e-06 2024-04-25T22:03:36.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848071+0000", 2024-04-25T22:03:36.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13851706499999999 2024-04-25T22:03:36.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848219+0000", 2024-04-25T22:03:36.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014761599999999999 2024-04-25T22:03:36.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848412+0000", 2024-04-25T22:03:36.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019303300000000001 2024-04-25T22:03:36.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854240+0000", 2024-04-25T22:03:36.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058282359999999997 2024-04-25T22:03:36.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855804+0000", 2024-04-25T22:03:36.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001563938 2024-04-25T22:03:36.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855879+0000", 2024-04-25T22:03:36.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4683000000000003e-05 2024-04-25T22:03:36.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855934+0000", 2024-04-25T22:03:36.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5661999999999997e-05 2024-04-25T22:03:36.675 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.675 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.675 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.675 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3030 3.d 3:b02ffd62:::200.00000010:head [write 3929994~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:36.675 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:36.675 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 11.853484497, 2024-04-25T22:03:36.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.146870588, 2024-04-25T22:03:36.676 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.676 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.676 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.676 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:36.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:36.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710942+0000", 2024-04-25T22:03:36.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.024e-06 2024-04-25T22:03:36.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710955+0000", 2024-04-25T22:03:36.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2103000000000001e-05 2024-04-25T22:03:36.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710977+0000", 2024-04-25T22:03:36.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2606e-05 2024-04-25T22:03:36.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710991+0000", 2024-04-25T22:03:36.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3689999999999999e-05 2024-04-25T22:03:36.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849638+0000", 2024-04-25T22:03:36.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.138646667 2024-04-25T22:03:36.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849809+0000", 2024-04-25T22:03:36.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000171495 2024-04-25T22:03:36.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.850048+0000", 2024-04-25T22:03:36.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023940699999999999 2024-04-25T22:03:36.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855954+0000", 2024-04-25T22:03:36.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059050919999999998 2024-04-25T22:03:36.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857670+0000", 2024-04-25T22:03:36.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017168489999999999 2024-04-25T22:03:36.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857747+0000", 2024-04-25T22:03:36.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6526000000000006e-05 2024-04-25T22:03:36.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857811+0000", 2024-04-25T22:03:36.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4128999999999995e-05 2024-04-25T22:03:36.681 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.681 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.681 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.681 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3031 3.d 3:b02ffd62:::200.00000010:head [write 3932758~2245 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:36.681 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:36.681 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 11.853274048999999, 2024-04-25T22:03:36.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14694558999999999, 2024-04-25T22:03:36.681 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:36.681 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:36.681 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:36.681 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:36.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:36.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:36.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:36.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:36.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:36.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:36.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711152+0000", 2024-04-25T22:03:36.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5230000000000001e-06 2024-04-25T22:03:36.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:36.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711162+0000", 2024-04-25T22:03:36.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2299999999999997e-06 2024-04-25T22:03:36.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:36.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711179+0000", 2024-04-25T22:03:36.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7220000000000001e-05 2024-04-25T22:03:36.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711190+0000", 2024-04-25T22:03:36.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1323e-05 2024-04-25T22:03:36.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:36.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851296+0000", 2024-04-25T22:03:36.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14010541600000001 2024-04-25T22:03:36.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:36.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851436+0000", 2024-04-25T22:03:36.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140409 2024-04-25T22:03:36.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851641+0000", 2024-04-25T22:03:36.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020471700000000001 2024-04-25T22:03:36.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:36.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857847+0000", 2024-04-25T22:03:36.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062065310000000004 2024-04-25T22:03:36.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:36.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857952+0000", 2024-04-25T22:03:36.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105132 2024-04-25T22:03:36.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:36.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.858026+0000", 2024-04-25T22:03:36.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3799000000000003e-05 2024-04-25T22:03:36.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:36.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:36.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:36.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.858096+0000", 2024-04-25T22:03:36.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0290000000000006e-05 2024-04-25T22:03:36.686 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.686 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.686 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.687 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:36.687 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:36.687 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:36.688 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:36.689 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:36.684+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:36.790 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:36.788+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:36.835 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:36.835 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:36.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.835 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:10920 4.f 4:f018392a:::1000000038f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:36.835 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.828494+0000", 2024-04-25T22:03:36.835 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0044357959999999997, 2024-04-25T22:03:36.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044916829999999998, 2024-04-25T22:03:36.835 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.835 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.835 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:36.836 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828494+0000", 2024-04-25T22:03:36.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828494+0000", 2024-04-25T22:03:36.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828494+0000", 2024-04-25T22:03:36.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1600000000000001e-07 2024-04-25T22:03:36.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828497+0000", 2024-04-25T22:03:36.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0750000000000002e-06 2024-04-25T22:03:36.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828505+0000", 2024-04-25T22:03:36.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:03:36.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828512+0000", 2024-04-25T22:03:36.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4389999999999997e-06 2024-04-25T22:03:36.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828620+0000", 2024-04-25T22:03:36.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107742 2024-04-25T22:03:36.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828951+0000", 2024-04-25T22:03:36.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033169800000000001 2024-04-25T22:03:36.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829265+0000", 2024-04-25T22:03:36.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031332799999999998 2024-04-25T22:03:36.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:36.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.831836+0000", 2024-04-25T22:03:36.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025719039999999999 2024-04-25T22:03:36.839 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.839 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.839 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.839 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:10890 4.c 4:321b7b00:::1000000025f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:36.840 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.821014+0000", 2024-04-25T22:03:36.840 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.011915112, 2024-04-25T22:03:36.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012077535, 2024-04-25T22:03:36.840 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.840 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.840 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:36.840 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.821014+0000", 2024-04-25T22:03:36.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.821014+0000", 2024-04-25T22:03:36.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.821016+0000", 2024-04-25T22:03:36.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3149999999999999e-06 2024-04-25T22:03:36.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.821019+0000", 2024-04-25T22:03:36.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.005e-06 2024-04-25T22:03:36.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.821030+0000", 2024-04-25T22:03:36.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0978999999999999e-05 2024-04-25T22:03:36.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.821036+0000", 2024-04-25T22:03:36.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6030000000000001e-06 2024-04-25T22:03:36.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.821115+0000", 2024-04-25T22:03:36.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8362999999999995e-05 2024-04-25T22:03:36.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.821325+0000", 2024-04-25T22:03:36.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021049299999999999 2024-04-25T22:03:36.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:36.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.821484+0000", 2024-04-25T22:03:36.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015922700000000001 2024-04-25T22:03:36.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:36.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.823854+0000", 2024-04-25T22:03:36.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023691179999999999 2024-04-25T22:03:36.844 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.844 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.844 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.845 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:10921 4.7 4:e2d740a6:::100000003a1.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:36.845 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.828535+0000", 2024-04-25T22:03:36.845 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0043948390000000002, 2024-04-25T22:03:36.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046333310000000001, 2024-04-25T22:03:36.845 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.845 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.845 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:36.845 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828535+0000", 2024-04-25T22:03:36.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828535+0000", 2024-04-25T22:03:36.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828535+0000", 2024-04-25T22:03:36.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7800000000000001e-07 2024-04-25T22:03:36.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828538+0000", 2024-04-25T22:03:36.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7070000000000001e-06 2024-04-25T22:03:36.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828547+0000", 2024-04-25T22:03:36.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9209999999999998e-06 2024-04-25T22:03:36.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828553+0000", 2024-04-25T22:03:36.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4069999999999998e-06 2024-04-25T22:03:36.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829073+0000", 2024-04-25T22:03:36.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051991199999999998 2024-04-25T22:03:36.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829185+0000", 2024-04-25T22:03:36.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011204700000000001 2024-04-25T22:03:36.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829259+0000", 2024-04-25T22:03:36.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4060000000000006e-05 2024-04-25T22:03:36.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:36.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.831804+0000", 2024-04-25T22:03:36.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025446560000000002 2024-04-25T22:03:36.849 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.849 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.849 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.850 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:10922 4.37 4:eeee4386:::100000003a3.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:36.850 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.828797+0000", 2024-04-25T22:03:36.850 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0041323360000000003, 2024-04-25T22:03:36.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044338950000000002, 2024-04-25T22:03:36.850 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.850 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.850 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:36.850 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828797+0000", 2024-04-25T22:03:36.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828797+0000", 2024-04-25T22:03:36.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828799+0000", 2024-04-25T22:03:36.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1799999999999999e-06 2024-04-25T22:03:36.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828810+0000", 2024-04-25T22:03:36.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0533999999999999e-05 2024-04-25T22:03:36.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828831+0000", 2024-04-25T22:03:36.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1460000000000001e-05 2024-04-25T22:03:36.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.828849+0000", 2024-04-25T22:03:36.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7235999999999999e-05 2024-04-25T22:03:36.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829746+0000", 2024-04-25T22:03:36.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00089748599999999997 2024-04-25T22:03:36.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829889+0000", 2024-04-25T22:03:36.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000142791 2024-04-25T22:03:36.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830011+0000", 2024-04-25T22:03:36.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121693 2024-04-25T22:03:36.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:36.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.831849+0000", 2024-04-25T22:03:36.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001837932 2024-04-25T22:03:36.854 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.854 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.855 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.855 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:10892 4.c 4:30919aa4:::100000002d2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:36.855 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.822013+0000", 2024-04-25T22:03:36.855 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.010916056, 2024-04-25T22:03:36.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011273754, 2024-04-25T22:03:36.855 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.855 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.855 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:36.855 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.822013+0000", 2024-04-25T22:03:36.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.822013+0000", 2024-04-25T22:03:36.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.822015+0000", 2024-04-25T22:03:36.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9400000000000001e-06 2024-04-25T22:03:36.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.822024+0000", 2024-04-25T22:03:36.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7700000000000007e-06 2024-04-25T22:03:36.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.822097+0000", 2024-04-25T22:03:36.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2488000000000001e-05 2024-04-25T22:03:36.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.822117+0000", 2024-04-25T22:03:36.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9836000000000001e-05 2024-04-25T22:03:36.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.822359+0000", 2024-04-25T22:03:36.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024283900000000001 2024-04-25T22:03:36.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.822683+0000", 2024-04-25T22:03:36.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000323686 2024-04-25T22:03:36.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:36.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.822919+0000", 2024-04-25T22:03:36.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023566599999999999 2024-04-25T22:03:36.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:36.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.824809+0000", 2024-04-25T22:03:36.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001890784 2024-04-25T22:03:36.859 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.859 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.859 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.859 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:10923 4.23 4:c4954b16:::100000003a4.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:36.859 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.829223+0000", 2024-04-25T22:03:36.859 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0037061939999999999, 2024-04-25T22:03:36.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004132485, 2024-04-25T22:03:36.859 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.860 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.860 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:36.860 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829223+0000", 2024-04-25T22:03:36.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829223+0000", 2024-04-25T22:03:36.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829225+0000", 2024-04-25T22:03:36.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7770000000000001e-06 2024-04-25T22:03:36.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829233+0000", 2024-04-25T22:03:36.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2139999999999996e-06 2024-04-25T22:03:36.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829255+0000", 2024-04-25T22:03:36.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1824999999999999e-05 2024-04-25T22:03:36.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829272+0000", 2024-04-25T22:03:36.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7028e-05 2024-04-25T22:03:36.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829371+0000", 2024-04-25T22:03:36.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8744000000000002e-05 2024-04-25T22:03:36.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829516+0000", 2024-04-25T22:03:36.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014465800000000001 2024-04-25T22:03:36.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829643+0000", 2024-04-25T22:03:36.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000127095 2024-04-25T22:03:36.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:36.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.831254+0000", 2024-04-25T22:03:36.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001611709 2024-04-25T22:03:36.863 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.863 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.863 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.864 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:10924 4.f 4:f03826fe:::100000003a5.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:36.864 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.829801+0000", 2024-04-25T22:03:36.864 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.003128441, 2024-04-25T22:03:36.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003622948, 2024-04-25T22:03:36.864 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.864 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.864 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:36.864 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829801+0000", 2024-04-25T22:03:36.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829801+0000", 2024-04-25T22:03:36.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829803+0000", 2024-04-25T22:03:36.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-04-25T22:03:36.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829810+0000", 2024-04-25T22:03:36.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3880000000000002e-06 2024-04-25T22:03:36.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829834+0000", 2024-04-25T22:03:36.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3237000000000001e-05 2024-04-25T22:03:36.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829849+0000", 2024-04-25T22:03:36.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5461999999999999e-05 2024-04-25T22:03:36.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830061+0000", 2024-04-25T22:03:36.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211762 2024-04-25T22:03:36.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830328+0000", 2024-04-25T22:03:36.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026724300000000002 2024-04-25T22:03:36.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830600+0000", 2024-04-25T22:03:36.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027189800000000002 2024-04-25T22:03:36.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:36.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832132+0000", 2024-04-25T22:03:36.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001532278 2024-04-25T22:03:36.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.868 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.869 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:10927 4.23 4:c4c40031:::100000003ab.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:36.869 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.830410+0000", 2024-04-25T22:03:36.869 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0025197539999999999, 2024-04-25T22:03:36.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0030854820000000001, 2024-04-25T22:03:36.869 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.869 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.869 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:36.870 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830410+0000", 2024-04-25T22:03:36.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830410+0000", 2024-04-25T22:03:36.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830411+0000", 2024-04-25T22:03:36.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0279999999999999e-06 2024-04-25T22:03:36.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830415+0000", 2024-04-25T22:03:36.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5340000000000001e-06 2024-04-25T22:03:36.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830427+0000", 2024-04-25T22:03:36.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2004000000000001e-05 2024-04-25T22:03:36.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830435+0000", 2024-04-25T22:03:36.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6140000000000003e-06 2024-04-25T22:03:36.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830485+0000", 2024-04-25T22:03:36.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9710999999999999e-05 2024-04-25T22:03:36.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830640+0000", 2024-04-25T22:03:36.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000155499 2024-04-25T22:03:36.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830788+0000", 2024-04-25T22:03:36.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014747999999999999 2024-04-25T22:03:36.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:36.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.831616+0000", 2024-04-25T22:03:36.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00082823900000000004 2024-04-25T22:03:36.873 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.873 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.873 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.874 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:10928 4.4 4:22f81c1a:::100000003ad.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:36.874 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.830451+0000", 2024-04-25T22:03:36.874 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0024787670000000002, 2024-04-25T22:03:36.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031024379999999999, 2024-04-25T22:03:36.874 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.874 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.874 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:36.874 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830451+0000", 2024-04-25T22:03:36.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830451+0000", 2024-04-25T22:03:36.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830451+0000", 2024-04-25T22:03:36.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5400000000000002e-07 2024-04-25T22:03:36.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830454+0000", 2024-04-25T22:03:36.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3649999999999998e-06 2024-04-25T22:03:36.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830461+0000", 2024-04-25T22:03:36.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0729999999999999e-06 2024-04-25T22:03:36.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830467+0000", 2024-04-25T22:03:36.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8869999999999997e-06 2024-04-25T22:03:36.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830641+0000", 2024-04-25T22:03:36.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017417600000000001 2024-04-25T22:03:36.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830925+0000", 2024-04-25T22:03:36.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028392499999999998 2024-04-25T22:03:36.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.831162+0000", 2024-04-25T22:03:36.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000237276 2024-04-25T22:03:36.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:36.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832517+0000", 2024-04-25T22:03:36.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013548329999999999 2024-04-25T22:03:36.878 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.878 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.878 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.878 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:10929 4.28 4:148ddd85:::100000003ae.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:36.878 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.830489+0000", 2024-04-25T22:03:36.878 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0024407119999999998, 2024-04-25T22:03:36.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003128474, 2024-04-25T22:03:36.879 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.879 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.879 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:36.879 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830489+0000", 2024-04-25T22:03:36.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830489+0000", 2024-04-25T22:03:36.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830489+0000", 2024-04-25T22:03:36.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7599999999999997e-07 2024-04-25T22:03:36.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830492+0000", 2024-04-25T22:03:36.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7149999999999998e-06 2024-04-25T22:03:36.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830500+0000", 2024-04-25T22:03:36.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9889999999999992e-06 2024-04-25T22:03:36.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830506+0000", 2024-04-25T22:03:36.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1940000000000003e-06 2024-04-25T22:03:36.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830585+0000", 2024-04-25T22:03:36.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8325000000000006e-05 2024-04-25T22:03:36.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830743+0000", 2024-04-25T22:03:36.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015857800000000001 2024-04-25T22:03:36.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830875+0000", 2024-04-25T22:03:36.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013197600000000001 2024-04-25T22:03:36.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:36.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832344+0000", 2024-04-25T22:03:36.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001468397 2024-04-25T22:03:36.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.883 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.883 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.883 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:10931 3.1 3:8411f002:::10000000c26.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:36.883 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.830544+0000", 2024-04-25T22:03:36.883 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0023852970000000002, 2024-04-25T22:03:36.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031122480000000002, 2024-04-25T22:03:36.883 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.883 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.883 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:03:36.883 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830544+0000", 2024-04-25T22:03:36.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830544+0000", 2024-04-25T22:03:36.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830545+0000", 2024-04-25T22:03:36.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8299999999999997e-07 2024-04-25T22:03:36.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830548+0000", 2024-04-25T22:03:36.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7769999999999998e-06 2024-04-25T22:03:36.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830556+0000", 2024-04-25T22:03:36.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2770000000000005e-06 2024-04-25T22:03:36.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.830562+0000", 2024-04-25T22:03:36.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9939999999999997e-06 2024-04-25T22:03:36.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.831237+0000", 2024-04-25T22:03:36.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067547699999999996 2024-04-25T22:03:36.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.831359+0000", 2024-04-25T22:03:36.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121656 2024-04-25T22:03:36.886 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.886 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.887 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.887 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:10925 4.6 e72/58 4:608b8126:::100000003a6.00000000:head v 72'331, mlcod=72'328)", 2024-04-25T22:03:36.887 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.832152+0000", 2024-04-25T22:03:36.887 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00077794699999999997, 2024-04-25T22:03:36.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015407960000000001, 2024-04-25T22:03:36.887 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.887 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.887 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:03:36.887 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832152+0000", 2024-04-25T22:03:36.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832152+0000", 2024-04-25T22:03:36.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832152+0000", 2024-04-25T22:03:36.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:03:36.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832161+0000", 2024-04-25T22:03:36.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0739999999999993e-06 2024-04-25T22:03:36.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832177+0000", 2024-04-25T22:03:36.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6444999999999999e-05 2024-04-25T22:03:36.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832189+0000", 2024-04-25T22:03:36.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.218e-05 2024-04-25T22:03:36.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832791+0000", 2024-04-25T22:03:36.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00060223299999999998 2024-04-25T22:03:36.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832809+0000", 2024-04-25T22:03:36.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7399000000000001e-05 2024-04-25T22:03:36.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.891 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.891 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:10932 3.3 3:c2a2f4fb:::10000000c27.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:36.891 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.832487+0000", 2024-04-25T22:03:36.891 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00044221799999999997, 2024-04-25T22:03:36.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001261287, 2024-04-25T22:03:36.891 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.891 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.892 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:03:36.892 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832487+0000", 2024-04-25T22:03:36.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832487+0000", 2024-04-25T22:03:36.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832489+0000", 2024-04-25T22:03:36.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9630000000000001e-06 2024-04-25T22:03:36.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832496+0000", 2024-04-25T22:03:36.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9260000000000003e-06 2024-04-25T22:03:36.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832519+0000", 2024-04-25T22:03:36.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2405e-05 2024-04-25T22:03:36.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832537+0000", 2024-04-25T22:03:36.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8014000000000001e-05 2024-04-25T22:03:36.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832628+0000", 2024-04-25T22:03:36.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1100000000000005e-05 2024-04-25T22:03:36.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832863+0000", 2024-04-25T22:03:36.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023553199999999999 2024-04-25T22:03:36.895 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.895 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.895 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.895 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:10933 4.28 4:17ad7bb0:::10000000c28.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:36.895 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.832667+0000", 2024-04-25T22:03:36.895 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00026281999999999998, 2024-04-25T22:03:36.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001150858, 2024-04-25T22:03:36.895 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.895 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.896 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:36.896 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832667+0000", 2024-04-25T22:03:36.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832667+0000", 2024-04-25T22:03:36.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832668+0000", 2024-04-25T22:03:36.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5650000000000001e-06 2024-04-25T22:03:36.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832675+0000", 2024-04-25T22:03:36.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3860000000000004e-06 2024-04-25T22:03:36.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832700+0000", 2024-04-25T22:03:36.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4879e-05 2024-04-25T22:03:36.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832715+0000", 2024-04-25T22:03:36.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.52e-05 2024-04-25T22:03:36.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832780+0000", 2024-04-25T22:03:36.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5530000000000004e-05 2024-04-25T22:03:36.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832897+0000", 2024-04-25T22:03:36.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011722000000000001 2024-04-25T22:03:36.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832985+0000", 2024-04-25T22:03:36.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7923999999999994e-05 2024-04-25T22:03:36.899 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.899 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.899 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.899 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:10909 4.c 4:321f1923:::100000002f2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:36.899 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.826487+0000", 2024-04-25T22:03:36.899 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0064427820000000002, 2024-04-25T22:03:36.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074034010000000004, 2024-04-25T22:03:36.900 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.900 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.900 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:36.900 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.826487+0000", 2024-04-25T22:03:36.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.826487+0000", 2024-04-25T22:03:36.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.826488+0000", 2024-04-25T22:03:36.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.06e-06 2024-04-25T22:03:36.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.826493+0000", 2024-04-25T22:03:36.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7890000000000002e-06 2024-04-25T22:03:36.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.826504+0000", 2024-04-25T22:03:36.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1902000000000001e-05 2024-04-25T22:03:36.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.826513+0000", 2024-04-25T22:03:36.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9900000000000003e-06 2024-04-25T22:03:36.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.826616+0000", 2024-04-25T22:03:36.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102112 2024-04-25T22:03:36.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.826843+0000", 2024-04-25T22:03:36.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022760799999999999 2024-04-25T22:03:36.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:36.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.827081+0000", 2024-04-25T22:03:36.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000237832 2024-04-25T22:03:36.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:36.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.829102+0000", 2024-04-25T22:03:36.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020212089999999999 2024-04-25T22:03:36.904 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.904 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.904 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.905 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:10935 4.15 4:aaf66091:::10000000c2a.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:36.905 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.832760+0000", 2024-04-25T22:03:36.905 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00016912599999999999, 2024-04-25T22:03:36.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001173143, 2024-04-25T22:03:36.905 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.905 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.905 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:36.905 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832760+0000", 2024-04-25T22:03:36.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832760+0000", 2024-04-25T22:03:36.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832762+0000", 2024-04-25T22:03:36.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.237e-06 2024-04-25T22:03:36.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832767+0000", 2024-04-25T22:03:36.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4369999999999998e-06 2024-04-25T22:03:36.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832785+0000", 2024-04-25T22:03:36.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7470999999999999e-05 2024-04-25T22:03:36.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832800+0000", 2024-04-25T22:03:36.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5417000000000002e-05 2024-04-25T22:03:36.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832917+0000", 2024-04-25T22:03:36.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011661 2024-04-25T22:03:36.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.833231+0000", 2024-04-25T22:03:36.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031405000000000002 2024-04-25T22:03:36.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:36.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.833480+0000", 2024-04-25T22:03:36.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000248946 2024-04-25T22:03:36.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.909 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.909 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.909 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:10910 4.2d 4:b42383e4:::100000002f3.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:36.909 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.826537+0000", 2024-04-25T22:03:36.909 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0063921489999999997, 2024-04-25T22:03:36.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007435952, 2024-04-25T22:03:36.909 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.909 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.909 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:03:36.909 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.826537+0000", 2024-04-25T22:03:36.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.826537+0000", 2024-04-25T22:03:36.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.826538+0000", 2024-04-25T22:03:36.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5600000000000004e-07 2024-04-25T22:03:36.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.826542+0000", 2024-04-25T22:03:36.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:03:36.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.826551+0000", 2024-04-25T22:03:36.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8579999999999995e-06 2024-04-25T22:03:36.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.826559+0000", 2024-04-25T22:03:36.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8960000000000003e-06 2024-04-25T22:03:36.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.826655+0000", 2024-04-25T22:03:36.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5754000000000005e-05 2024-04-25T22:03:36.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.826989+0000", 2024-04-25T22:03:36.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033402699999999998 2024-04-25T22:03:36.912 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.913 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.913 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(mds.0.3:10938 4.b 4:d1a2281b:::10000000c2d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-04-25T22:03:36.913 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.832824+0000", 2024-04-25T22:03:36.913 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.000105302, 2024-04-25T22:03:36.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001189372, 2024-04-25T22:03:36.913 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.913 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.913 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:36.913 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832824+0000", 2024-04-25T22:03:36.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832824+0000", 2024-04-25T22:03:36.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832825+0000", 2024-04-25T22:03:36.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.114e-06 2024-04-25T22:03:36.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832831+0000", 2024-04-25T22:03:36.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2290000000000002e-06 2024-04-25T22:03:36.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832847+0000", 2024-04-25T22:03:36.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6345e-05 2024-04-25T22:03:36.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.832861+0000", 2024-04-25T22:03:36.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4015999999999999e-05 2024-04-25T22:03:36.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.833017+0000", 2024-04-25T22:03:36.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015656399999999999 2024-04-25T22:03:36.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.833292+0000", 2024-04-25T22:03:36.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027477799999999999 2024-04-25T22:03:36.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:36.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.833520+0000", 2024-04-25T22:03:36.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000227433 2024-04-25T22:03:36.917 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.917 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.917 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.917 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(mds.0.3:10934 4.18 e72/16 4:1a89f8a9:::10000000c29.00000000:head v 72'314, mlcod=72'312)", 2024-04-25T22:03:36.917 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:36.833857+0000", 2024-04-25T22:03:36.917 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9990721, 2024-04-25T22:03:36.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000195236, 2024-04-25T22:03:36.917 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:36.917 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:36.917 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-04-25T22:03:36.917 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:36.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:36.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.833857+0000", 2024-04-25T22:03:36.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:36.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.833857+0000", 2024-04-25T22:03:36.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:36.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:36.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.833858+0000", 2024-04-25T22:03:36.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1399999999999996e-07 2024-04-25T22:03:36.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:36.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.833863+0000", 2024-04-25T22:03:36.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1710000000000001e-06 2024-04-25T22:03:36.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:36.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.833870+0000", 2024-04-25T22:03:36.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1489999999999997e-06 2024-04-25T22:03:36.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:36.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.833876+0000", 2024-04-25T22:03:36.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5770000000000001e-06 2024-04-25T22:03:36.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:36.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.833917+0000", 2024-04-25T22:03:36.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0825000000000003e-05 2024-04-25T22:03:36.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:36.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:36.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:36.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:36.833929+0000", 2024-04-25T22:03:36.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1895999999999999e-05 2024-04-25T22:03:36.920 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.920 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:36.920 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.920 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:36.920 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-04-25T22:03:36.921 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 19 2024-04-25T22:03:36.921 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:36.923 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-25T22:03:36.923 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:36.924 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:36.916+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:37.023 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:37.020+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:37.083 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:37.083 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:37.083 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:03:37.083 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:03:37.083 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:37.097 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:37.124 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:37.120+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:37.219 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:37.219 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:37.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:37.219 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:37.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.219 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:37.219 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:37.220 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 45.129955502000001, 2024-04-25T22:03:37.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:37.220 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.220 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.220 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.220 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.220 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.220 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.220 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:37.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.220 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:37.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:37.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:37.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:37.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:37.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:37.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:37.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:37.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:37.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:37.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:37.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:37.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:37.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:37.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:37.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:37.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:37.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:37.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:37.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:37.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:37.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:37.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:37.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:37.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:37.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:37.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:37.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:37.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:37.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:37.226 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.226 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.226 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.226 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:37.226 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:37.226 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 45.119954739000001, 2024-04-25T22:03:37.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:37.226 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.226 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.226 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.226 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.226 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.227 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.227 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:37.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.227 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:37.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:37.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:37.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:37.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:37.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:37.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:37.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:37.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:37.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:37.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:37.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:37.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:37.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:37.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:37.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:37.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:37.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:37.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:37.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:37.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:37.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:37.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:37.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:37.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:37.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:37.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:37.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:37.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:37.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:37.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.232 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.232 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:37.232 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:37.232 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 45.115790465000003, 2024-04-25T22:03:37.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:37.233 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.233 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.233 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.233 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:37.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.233 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:37.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:37.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:37.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:37.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:37.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:37.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:37.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:37.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:37.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:37.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:37.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:37.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:37.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:37.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:37.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:37.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:37.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:37.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:37.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:37.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:37.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:37.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:37.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:37.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:37.238 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.238 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.238 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.238 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:37.238 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:37.238 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 45.114194148000003, 2024-04-25T22:03:37.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:37.238 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.239 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.239 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.239 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.239 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.239 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.239 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:37.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.239 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:37.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:37.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:37.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:37.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:37.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:37.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:37.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:37.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:37.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:37.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:37.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:37.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:37.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:37.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:37.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:37.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:37.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:37.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:37.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:37.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:37.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:37.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:37.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:37.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:37.244 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.244 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.244 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.244 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:37.244 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:37.244 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 45.057407898000001, 2024-04-25T22:03:37.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:37.245 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.245 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.245 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.245 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.245 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.245 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.245 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:37.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.245 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:37.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:37.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:37.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:37.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:37.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:37.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:37.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:37.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:37.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:37.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:37.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:37.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:37.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:37.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:37.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:37.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:37.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:37.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:37.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:37.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:37.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:37.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:37.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:37.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:37.250 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.250 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.250 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.250 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:37.251 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:37.251 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 45.041763631999999, 2024-04-25T22:03:37.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:37.251 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.251 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.251 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.251 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.251 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.251 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.251 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:37.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.251 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:37.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:37.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:37.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:37.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:37.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:37.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:37.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:37.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:37.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:37.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:37.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:37.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:37.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:37.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:37.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:37.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:37.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:37.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:37.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:37.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:37.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:37.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:37.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:37.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:37.256 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.256 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.256 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.256 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:37.256 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:37.256 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 45.036924941000002, 2024-04-25T22:03:37.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:37.257 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.257 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.257 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.257 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.257 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.257 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.257 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:37.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.257 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:37.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:37.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:37.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:37.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:37.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:37.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:37.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:37.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:37.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:37.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:37.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:37.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:37.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:37.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:37.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:37.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:37.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:37.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:37.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:37.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:37.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:37.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:37.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:37.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:37.262 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.262 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.262 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.262 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10648 4.33 4:cc614d18:::100000030cb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:37.262 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:37.262 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.678321629999999, 2024-04-25T22:03:37.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13001143300000001, 2024-04-25T22:03:37.262 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.262 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.263 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.263 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.263 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.263 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.263 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10648 2024-04-25T22:03:37.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.263 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:37.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:37.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537181+0000", 2024-04-25T22:03:37.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.782e-06 2024-04-25T22:03:37.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541681+0000", 2024-04-25T22:03:37.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045008460000000002 2024-04-25T22:03:37.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541692+0000", 2024-04-25T22:03:37.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0726e-05 2024-04-25T22:03:37.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541698+0000", 2024-04-25T22:03:37.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-04-25T22:03:37.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541771+0000", 2024-04-25T22:03:37.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3070000000000003e-05 2024-04-25T22:03:37.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542021+0000", 2024-04-25T22:03:37.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025059799999999999 2024-04-25T22:03:37.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:37.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542246+0000", 2024-04-25T22:03:37.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022471000000000001 2024-04-25T22:03:37.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.579359+0000", 2024-04-25T22:03:37.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037113211 2024-04-25T22:03:37.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667067+0000", 2024-04-25T22:03:37.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087707255999999997 2024-04-25T22:03:37.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667134+0000", 2024-04-25T22:03:37.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7862999999999997e-05 2024-04-25T22:03:37.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667190+0000", 2024-04-25T22:03:37.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5698000000000001e-05 2024-04-25T22:03:37.268 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.268 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.268 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.268 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10651 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:37.268 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:37.268 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.618545852, 2024-04-25T22:03:37.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11324606800000001, 2024-04-25T22:03:37.268 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.268 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.268 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.269 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.269 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.269 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.269 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10651 2024-04-25T22:03:37.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.269 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:37.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:37.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596957+0000", 2024-04-25T22:03:37.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-04-25T22:03:37.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601272+0000", 2024-04-25T22:03:37.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004314834 2024-04-25T22:03:37.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601291+0000", 2024-04-25T22:03:37.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9380000000000001e-05 2024-04-25T22:03:37.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601302+0000", 2024-04-25T22:03:37.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0416e-05 2024-04-25T22:03:37.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.603978+0000", 2024-04-25T22:03:37.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026763109999999998 2024-04-25T22:03:37.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604327+0000", 2024-04-25T22:03:37.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034881099999999998 2024-04-25T22:03:37.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:37.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604571+0000", 2024-04-25T22:03:37.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024436100000000001 2024-04-25T22:03:37.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644439+0000", 2024-04-25T22:03:37.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039868270999999997 2024-04-25T22:03:37.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710091+0000", 2024-04-25T22:03:37.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.065651910999999993 2024-04-25T22:03:37.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710144+0000", 2024-04-25T22:03:37.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2444999999999997e-05 2024-04-25T22:03:37.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710201+0000", 2024-04-25T22:03:37.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6839999999999998e-05 2024-04-25T22:03:37.273 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.273 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.274 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.274 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10654 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:37.274 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:37.274 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.608718989, 2024-04-25T22:03:37.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.103958778, 2024-04-25T22:03:37.274 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.274 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.274 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.274 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.274 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.274 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.274 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10654 2024-04-25T22:03:37.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.275 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:37.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:37.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606782+0000", 2024-04-25T22:03:37.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1699999999999999e-07 2024-04-25T22:03:37.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611155+0000", 2024-04-25T22:03:37.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043728580000000003 2024-04-25T22:03:37.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611173+0000", 2024-04-25T22:03:37.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8267e-05 2024-04-25T22:03:37.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611183+0000", 2024-04-25T22:03:37.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9250000000000007e-06 2024-04-25T22:03:37.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644642+0000", 2024-04-25T22:03:37.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033458976000000001 2024-04-25T22:03:37.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644739+0000", 2024-04-25T22:03:37.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7189999999999996e-05 2024-04-25T22:03:37.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:37.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644864+0000", 2024-04-25T22:03:37.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000124867 2024-04-25T22:03:37.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.672556+0000", 2024-04-25T22:03:37.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027691653 2024-04-25T22:03:37.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710668+0000", 2024-04-25T22:03:37.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038111956000000002 2024-04-25T22:03:37.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710703+0000", 2024-04-25T22:03:37.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5577000000000002e-05 2024-04-25T22:03:37.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710740+0000", 2024-04-25T22:03:37.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7092000000000003e-05 2024-04-25T22:03:37.279 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.280 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.280 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.280 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11078 4.4 4:22be2a9e:::10000003224.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:37.280 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:37.280 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 19.211592368000002, 2024-04-25T22:03:37.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.112294177, 2024-04-25T22:03:37.280 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.280 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.280 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.280 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.280 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.280 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.280 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11078 2024-04-25T22:03:37.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.281 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:37.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:37.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003909+0000", 2024-04-25T22:03:37.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2750000000000001e-06 2024-04-25T22:03:37.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009939+0000", 2024-04-25T22:03:37.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060293309999999998 2024-04-25T22:03:37.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009961+0000", 2024-04-25T22:03:37.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1889999999999999e-05 2024-04-25T22:03:37.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009976+0000", 2024-04-25T22:03:37.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5642e-05 2024-04-25T22:03:37.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042803+0000", 2024-04-25T22:03:37.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032827299999999997 2024-04-25T22:03:37.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042911+0000", 2024-04-25T22:03:37.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107747 2024-04-25T22:03:37.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:37.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042990+0000", 2024-04-25T22:03:37.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8832999999999996e-05 2024-04-25T22:03:37.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.088710+0000", 2024-04-25T22:03:37.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045720129999999998 2024-04-25T22:03:37.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116108+0000", 2024-04-25T22:03:37.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027397388000000002 2024-04-25T22:03:37.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116164+0000", 2024-04-25T22:03:37.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6283000000000003e-05 2024-04-25T22:03:37.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116202+0000", 2024-04-25T22:03:37.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8358000000000001e-05 2024-04-25T22:03:37.285 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.285 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.285 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.286 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11195 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:37.286 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:37.286 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.998230250999999, 2024-04-25T22:03:37.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1095062, 2024-04-25T22:03:37.286 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.286 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.286 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.286 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.286 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.286 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.286 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11195 2024-04-25T22:03:37.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.287 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:37.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:37.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217272+0000", 2024-04-25T22:03:37.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.533e-06 2024-04-25T22:03:37.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217385+0000", 2024-04-25T22:03:37.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113533 2024-04-25T22:03:37.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217396+0000", 2024-04-25T22:03:37.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0682e-05 2024-04-25T22:03:37.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217402+0000", 2024-04-25T22:03:37.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:03:37.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238476+0000", 2024-04-25T22:03:37.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021073312 2024-04-25T22:03:37.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238558+0000", 2024-04-25T22:03:37.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2193000000000004e-05 2024-04-25T22:03:37.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:37.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238695+0000", 2024-04-25T22:03:37.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013737800000000001 2024-04-25T22:03:37.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292860+0000", 2024-04-25T22:03:37.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054165224999999997 2024-04-25T22:03:37.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326638+0000", 2024-04-25T22:03:37.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033777517999999999 2024-04-25T22:03:37.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326686+0000", 2024-04-25T22:03:37.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8062000000000002e-05 2024-04-25T22:03:37.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326776+0000", 2024-04-25T22:03:37.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0393e-05 2024-04-25T22:03:37.291 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.291 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.291 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.291 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11197 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3195543~33670] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:37.291 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:37.291 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.998088267, 2024-04-25T22:03:37.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953929499999999, 2024-04-25T22:03:37.292 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.292 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.292 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.292 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.292 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.292 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.292 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11197 2024-04-25T22:03:37.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.292 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:37.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:37.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217413+0000", 2024-04-25T22:03:37.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5600000000000005e-07 2024-04-25T22:03:37.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217445+0000", 2024-04-25T22:03:37.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2240999999999998e-05 2024-04-25T22:03:37.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217453+0000", 2024-04-25T22:03:37.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6070000000000002e-06 2024-04-25T22:03:37.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217458+0000", 2024-04-25T22:03:37.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3630000000000002e-06 2024-04-25T22:03:37.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240891+0000", 2024-04-25T22:03:37.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023432637999999999 2024-04-25T22:03:37.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240990+0000", 2024-04-25T22:03:37.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8995999999999999e-05 2024-04-25T22:03:37.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:37.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241123+0000", 2024-04-25T22:03:37.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013371699999999999 2024-04-25T22:03:37.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292866+0000", 2024-04-25T22:03:37.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051742332000000002 2024-04-25T22:03:37.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326849+0000", 2024-04-25T22:03:37.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033983140000000002 2024-04-25T22:03:37.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326908+0000", 2024-04-25T22:03:37.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8842999999999999e-05 2024-04-25T22:03:37.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326951+0000", 2024-04-25T22:03:37.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3761999999999999e-05 2024-04-25T22:03:37.297 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.297 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.297 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.297 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11198 4.4 4:22c4fea3:::10000003262.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:37.297 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:37.297 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.998033908, 2024-04-25T22:03:37.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12381273600000001, 2024-04-25T22:03:37.297 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.297 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.297 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.298 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.298 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.298 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.298 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11198 2024-04-25T22:03:37.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.298 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:37.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:37.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217467+0000", 2024-04-25T22:03:37.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4499999999999997e-07 2024-04-25T22:03:37.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225449+0000", 2024-04-25T22:03:37.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079819439999999995 2024-04-25T22:03:37.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225466+0000", 2024-04-25T22:03:37.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6602000000000001e-05 2024-04-25T22:03:37.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225477+0000", 2024-04-25T22:03:37.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1603000000000001e-05 2024-04-25T22:03:37.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240866+0000", 2024-04-25T22:03:37.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015388389000000001 2024-04-25T22:03:37.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241081+0000", 2024-04-25T22:03:37.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021577400000000001 2024-04-25T22:03:37.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:37.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241212+0000", 2024-04-25T22:03:37.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013073499999999999 2024-04-25T22:03:37.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292876+0000", 2024-04-25T22:03:37.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051663584999999998 2024-04-25T22:03:37.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341159+0000", 2024-04-25T22:03:37.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048283421999999999 2024-04-25T22:03:37.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341222+0000", 2024-04-25T22:03:37.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:03:37.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341279+0000", 2024-04-25T22:03:37.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6780999999999997e-05 2024-04-25T22:03:37.303 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.303 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.303 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.303 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11207 4.4 4:233f6309:::10000003211.00000000:head [write 659836~128648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:37.303 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:37.303 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.981415910999999, 2024-04-25T22:03:37.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10732727, 2024-04-25T22:03:37.303 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.303 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.303 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.303 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.303 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.304 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.304 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11207 2024-04-25T22:03:37.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.304 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:37.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:37.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234085+0000", 2024-04-25T22:03:37.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0399999999999995e-07 2024-04-25T22:03:37.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234550+0000", 2024-04-25T22:03:37.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000464909 2024-04-25T22:03:37.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234561+0000", 2024-04-25T22:03:37.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0744000000000001e-05 2024-04-25T22:03:37.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234569+0000", 2024-04-25T22:03:37.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6890000000000004e-06 2024-04-25T22:03:37.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267197+0000", 2024-04-25T22:03:37.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032628182999999998 2024-04-25T22:03:37.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267297+0000", 2024-04-25T22:03:37.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100222 2024-04-25T22:03:37.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:37.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267393+0000", 2024-04-25T22:03:37.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6275999999999998e-05 2024-04-25T22:03:37.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292880+0000", 2024-04-25T22:03:37.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025487058999999999 2024-04-25T22:03:37.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341326+0000", 2024-04-25T22:03:37.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048446031000000001 2024-04-25T22:03:37.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341374+0000", 2024-04-25T22:03:37.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7632000000000001e-05 2024-04-25T22:03:37.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341412+0000", 2024-04-25T22:03:37.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7821000000000003e-05 2024-04-25T22:03:37.308 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.308 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.308 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.309 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11219 4.4 4:210cd53e:::100000031ff.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:37.309 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:37.309 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.962466701, 2024-04-25T22:03:37.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13181403, 2024-04-25T22:03:37.309 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.309 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.309 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.309 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.309 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.309 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.309 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11219 2024-04-25T22:03:37.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.310 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:37.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:37.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253035+0000", 2024-04-25T22:03:37.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.322e-06 2024-04-25T22:03:37.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258145+0000", 2024-04-25T22:03:37.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051095669999999998 2024-04-25T22:03:37.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258163+0000", 2024-04-25T22:03:37.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8377999999999999e-05 2024-04-25T22:03:37.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258174+0000", 2024-04-25T22:03:37.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0925e-05 2024-04-25T22:03:37.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270495+0000", 2024-04-25T22:03:37.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012321354 2024-04-25T22:03:37.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270581+0000", 2024-04-25T22:03:37.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5741999999999993e-05 2024-04-25T22:03:37.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:37.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270717+0000", 2024-04-25T22:03:37.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013571500000000001 2024-04-25T22:03:37.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326599+0000", 2024-04-25T22:03:37.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055882026000000001 2024-04-25T22:03:37.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384753+0000", 2024-04-25T22:03:37.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058154527999999997 2024-04-25T22:03:37.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384805+0000", 2024-04-25T22:03:37.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1592999999999999e-05 2024-04-25T22:03:37.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384848+0000", 2024-04-25T22:03:37.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2880000000000003e-05 2024-04-25T22:03:37.314 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.314 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.314 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.315 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11868 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:37.315 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:37.315 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.003502876999999, 2024-04-25T22:03:37.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12149908700000001, 2024-04-25T22:03:37.315 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.315 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.315 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.315 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.315 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.315 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.315 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11868 2024-04-25T22:03:37.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.315 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:37.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:37.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211999+0000", 2024-04-25T22:03:37.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:03:37.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219614+0000", 2024-04-25T22:03:37.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076153490000000004 2024-04-25T22:03:37.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219628+0000", 2024-04-25T22:03:37.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3597e-05 2024-04-25T22:03:37.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219635+0000", 2024-04-25T22:03:37.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7759999999999997e-06 2024-04-25T22:03:37.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229908+0000", 2024-04-25T22:03:37.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010272478 2024-04-25T22:03:37.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229966+0000", 2024-04-25T22:03:37.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8495000000000002e-05 2024-04-25T22:03:37.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:37.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.230082+0000", 2024-04-25T22:03:37.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011560799999999999 2024-04-25T22:03:37.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257530+0000", 2024-04-25T22:03:37.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027448034999999999 2024-04-25T22:03:37.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333408+0000", 2024-04-25T22:03:37.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075878105000000001 2024-04-25T22:03:37.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333457+0000", 2024-04-25T22:03:37.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8757000000000001e-05 2024-04-25T22:03:37.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333497+0000", 2024-04-25T22:03:37.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9721000000000001e-05 2024-04-25T22:03:37.320 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.320 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.320 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.320 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11870 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 4063232~131072] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:37.320 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:37.321 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.995848522999999, 2024-04-25T22:03:37.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.114017408, 2024-04-25T22:03:37.321 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.321 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.321 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.321 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.321 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.321 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.321 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11870 2024-04-25T22:03:37.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.321 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:37.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:37.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219653+0000", 2024-04-25T22:03:37.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6139999999999999e-06 2024-04-25T22:03:37.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219722+0000", 2024-04-25T22:03:37.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8460000000000005e-05 2024-04-25T22:03:37.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219730+0000", 2024-04-25T22:03:37.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3420000000000008e-06 2024-04-25T22:03:37.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219736+0000", 2024-04-25T22:03:37.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9619999999999998e-06 2024-04-25T22:03:37.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247743+0000", 2024-04-25T22:03:37.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028006400000000001 2024-04-25T22:03:37.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247847+0000", 2024-04-25T22:03:37.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104017 2024-04-25T22:03:37.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:37.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247984+0000", 2024-04-25T22:03:37.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013701800000000001 2024-04-25T22:03:37.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257536+0000", 2024-04-25T22:03:37.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095520050000000006 2024-04-25T22:03:37.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333565+0000", 2024-04-25T22:03:37.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076029154000000002 2024-04-25T22:03:37.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333628+0000", 2024-04-25T22:03:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2853000000000003e-05 2024-04-25T22:03:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333669+0000", 2024-04-25T22:03:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1582999999999998e-05 2024-04-25T22:03:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11871 4.37 4:ee924968:::10000003393.00000000:head [write 2359296~1835008] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.995755590999998, 2024-04-25T22:03:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.113885236, 2024-04-25T22:03:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11871 2024-04-25T22:03:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6100000000000001e-07 2024-04-25T22:03:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222469+0000", 2024-04-25T22:03:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027240060000000002 2024-04-25T22:03:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222482+0000", 2024-04-25T22:03:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3049e-05 2024-04-25T22:03:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222492+0000", 2024-04-25T22:03:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8020000000000003e-06 2024-04-25T22:03:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247903+0000", 2024-04-25T22:03:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025410578999999999 2024-04-25T22:03:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247962+0000", 2024-04-25T22:03:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9363000000000001e-05 2024-04-25T22:03:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.248049+0000", 2024-04-25T22:03:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6803000000000002e-05 2024-04-25T22:03:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257915+0000", 2024-04-25T22:03:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0098655730000000007 2024-04-25T22:03:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333544+0000", 2024-04-25T22:03:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075629030999999999 2024-04-25T22:03:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333594+0000", 2024-04-25T22:03:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0291999999999999e-05 2024-04-25T22:03:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333630+0000", 2024-04-25T22:03:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6177000000000003e-05 2024-04-25T22:03:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:15375 4.4 4:211dd80e:::10000003351.00000000:head [write 0~4194304 [2@1354921]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.078426199000001, 2024-04-25T22:03:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953555500000001, 2024-04-25T22:03:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-04-25T22:03:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137076+0000", 2024-04-25T22:03:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.683e-06 2024-04-25T22:03:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142168+0000", 2024-04-25T22:03:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050917280000000002 2024-04-25T22:03:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142192+0000", 2024-04-25T22:03:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:03:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142206+0000", 2024-04-25T22:03:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.396e-05 2024-04-25T22:03:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142280+0000", 2024-04-25T22:03:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4369000000000006e-05 2024-04-25T22:03:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142346+0000", 2024-04-25T22:03:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5957000000000006e-05 2024-04-25T22:03:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142440+0000", 2024-04-25T22:03:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3888999999999995e-05 2024-04-25T22:03:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.208451+0000", 2024-04-25T22:03:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066011350999999996 2024-04-25T22:03:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246473+0000", 2024-04-25T22:03:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038021428000000003 2024-04-25T22:03:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246530+0000", 2024-04-25T22:03:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7466000000000002e-05 2024-04-25T22:03:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246610+0000", 2024-04-25T22:03:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9484e-05 2024-04-25T22:03:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:37.338 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:37.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:37.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:37.337+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:37.440 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:37.436+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:37.474 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:37.475 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:37.475 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:03:37.475 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:37.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:37.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:37.537+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:37.612 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:37.613 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:37.613 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:03:37.613 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:03:37.613 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:37.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:37.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:37.637+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:37.742 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:37.740+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:37.755 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:37.755 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:03:37.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:03:37.755 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:37.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.755 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7039 4.8 4:1138358d:::100000013f3.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.755 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:37.755 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9203149249999996, 2024-04-25T22:03:37.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.034656746, 2024-04-25T22:03:37.755 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.755 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:37.755 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:37.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:37.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831791+0000", 2024-04-25T22:03:37.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6359999999999998e-06 2024-04-25T22:03:37.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831801+0000", 2024-04-25T22:03:37.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0567000000000001e-05 2024-04-25T22:03:37.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831824+0000", 2024-04-25T22:03:37.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:03:37.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831839+0000", 2024-04-25T22:03:37.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5345999999999998e-05 2024-04-25T22:03:37.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832028+0000", 2024-04-25T22:03:37.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018899800000000001 2024-04-25T22:03:37.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:37.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832043+0000", 2024-04-25T22:03:37.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4805e-05 2024-04-25T22:03:37.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836259+0000", 2024-04-25T22:03:37.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042161819999999997 2024-04-25T22:03:37.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836422+0000", 2024-04-25T22:03:37.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000162404 2024-04-25T22:03:37.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.865428+0000", 2024-04-25T22:03:37.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0290065770000001 2024-04-25T22:03:37.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866445+0000", 2024-04-25T22:03:37.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001016561 2024-04-25T22:03:37.760 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.760 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.760 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.760 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7040 4.8 4:121f992c:::100000013f4.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.760 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:37.760 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9202260019999997, 2024-04-25T22:03:37.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0348302300000001, 2024-04-25T22:03:37.760 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:37.760 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:37.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:37.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831878+0000", 2024-04-25T22:03:37.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3659999999999999e-06 2024-04-25T22:03:37.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831885+0000", 2024-04-25T22:03:37.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7139999999999996e-06 2024-04-25T22:03:37.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831901+0000", 2024-04-25T22:03:37.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5982999999999999e-05 2024-04-25T22:03:37.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831910+0000", 2024-04-25T22:03:37.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7530000000000007e-06 2024-04-25T22:03:37.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832133+0000", 2024-04-25T22:03:37.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022307199999999999 2024-04-25T22:03:37.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:37.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832141+0000", 2024-04-25T22:03:37.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0080000000000002e-06 2024-04-25T22:03:37.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836611+0000", 2024-04-25T22:03:37.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044698389999999998 2024-04-25T22:03:37.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836629+0000", 2024-04-25T22:03:37.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8397e-05 2024-04-25T22:03:37.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866532+0000", 2024-04-25T22:03:37.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0299026200000001 2024-04-25T22:03:37.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866707+0000", 2024-04-25T22:03:37.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017547799999999999 2024-04-25T22:03:37.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.764 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.765 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7051 4.36 4:6e19a085:::100000013ff.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.765 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:37.765 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9201732229999999, 2024-04-25T22:03:37.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.032211298, 2024-04-25T22:03:37.765 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.765 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:37.765 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831931+0000", 2024-04-25T22:03:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.19e-06 2024-04-25T22:03:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831936+0000", 2024-04-25T22:03:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2059999999999998e-06 2024-04-25T22:03:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831950+0000", 2024-04-25T22:03:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3424000000000001e-05 2024-04-25T22:03:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831958+0000", 2024-04-25T22:03:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1659999999999994e-06 2024-04-25T22:03:37.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832033+0000", 2024-04-25T22:03:37.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4977999999999999e-05 2024-04-25T22:03:37.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:37.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832043+0000", 2024-04-25T22:03:37.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0268999999999999e-05 2024-04-25T22:03:37.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841105+0000", 2024-04-25T22:03:37.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090619829999999991 2024-04-25T22:03:37.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841118+0000", 2024-04-25T22:03:37.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2737e-05 2024-04-25T22:03:37.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.863240+0000", 2024-04-25T22:03:37.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0221224259999999 2024-04-25T22:03:37.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.864141+0000", 2024-04-25T22:03:37.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090091900000000003 2024-04-25T22:03:37.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.770 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.770 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7059 4.22 4:47c8979f:::10000001407.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.770 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:37.770 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9201220829999999, 2024-04-25T22:03:37.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0438401859999999, 2024-04-25T22:03:37.770 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.770 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.770 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:37.770 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:37.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:37.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831982+0000", 2024-04-25T22:03:37.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1030000000000001e-06 2024-04-25T22:03:37.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831987+0000", 2024-04-25T22:03:37.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-04-25T22:03:37.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832007+0000", 2024-04-25T22:03:37.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0126999999999999e-05 2024-04-25T22:03:37.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832022+0000", 2024-04-25T22:03:37.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4878999999999999e-05 2024-04-25T22:03:37.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832082+0000", 2024-04-25T22:03:37.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9552999999999997e-05 2024-04-25T22:03:37.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:37.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832088+0000", 2024-04-25T22:03:37.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9320000000000001e-06 2024-04-25T22:03:37.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836708+0000", 2024-04-25T22:03:37.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046199240000000001 2024-04-25T22:03:37.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836717+0000", 2024-04-25T22:03:37.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1840000000000005e-06 2024-04-25T22:03:37.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875475+0000", 2024-04-25T22:03:37.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0387584439999999 2024-04-25T22:03:37.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875821+0000", 2024-04-25T22:03:37.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00034578700000000001 2024-04-25T22:03:37.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.775 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.775 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7063 4.2 4:4331e060:::100000014df.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.775 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:37.775 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9200592939999996, 2024-04-25T22:03:37.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.047605189, 2024-04-25T22:03:37.775 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.775 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.775 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:37.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:37.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832045+0000", 2024-04-25T22:03:37.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:03:37.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832088+0000", 2024-04-25T22:03:37.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2483e-05 2024-04-25T22:03:37.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832100+0000", 2024-04-25T22:03:37.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2713e-05 2024-04-25T22:03:37.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832111+0000", 2024-04-25T22:03:37.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0457e-05 2024-04-25T22:03:37.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832155+0000", 2024-04-25T22:03:37.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4468999999999997e-05 2024-04-25T22:03:37.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:37.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832161+0000", 2024-04-25T22:03:37.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3369999999999999e-06 2024-04-25T22:03:37.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836779+0000", 2024-04-25T22:03:37.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046185030000000004 2024-04-25T22:03:37.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836787+0000", 2024-04-25T22:03:37.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5820000000000004e-06 2024-04-25T22:03:37.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.868721+0000", 2024-04-25T22:03:37.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0319339300000001 2024-04-25T22:03:37.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:37.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869179+0000", 2024-04-25T22:03:37.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000457916 2024-04-25T22:03:37.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:37.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869486+0000", 2024-04-25T22:03:37.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030764099999999999 2024-04-25T22:03:37.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:37.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879230+0000", 2024-04-25T22:03:37.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097433620000000002 2024-04-25T22:03:37.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879288+0000", 2024-04-25T22:03:37.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8813000000000001e-05 2024-04-25T22:03:37.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:37.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879542+0000", 2024-04-25T22:03:37.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025326999999999999 2024-04-25T22:03:37.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879649+0000", 2024-04-25T22:03:37.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107173 2024-04-25T22:03:37.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.781 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.781 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7068 4.33 4:cf543130:::100000014e4.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.781 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:37.781 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9199736019999998, 2024-04-25T22:03:37.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.044127671, 2024-04-25T22:03:37.782 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.782 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.782 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:37.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:37.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832131+0000", 2024-04-25T22:03:37.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:03:37.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832137+0000", 2024-04-25T22:03:37.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9859999999999999e-06 2024-04-25T22:03:37.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832155+0000", 2024-04-25T22:03:37.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8090000000000001e-05 2024-04-25T22:03:37.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832166+0000", 2024-04-25T22:03:37.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1776999999999999e-05 2024-04-25T22:03:37.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832235+0000", 2024-04-25T22:03:37.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8614000000000004e-05 2024-04-25T22:03:37.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:37.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832243+0000", 2024-04-25T22:03:37.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2719999999999997e-06 2024-04-25T22:03:37.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.834656+0000", 2024-04-25T22:03:37.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024123489999999998 2024-04-25T22:03:37.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.834666+0000", 2024-04-25T22:03:37.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8819999999999996e-06 2024-04-25T22:03:37.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.860770+0000", 2024-04-25T22:03:37.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.026104414 2024-04-25T22:03:37.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:37.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861849+0000", 2024-04-25T22:03:37.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010794559999999999 2024-04-25T22:03:37.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:37.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.865487+0000", 2024-04-25T22:03:37.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036373270000000001 2024-04-25T22:03:37.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869323+0000", 2024-04-25T22:03:37.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038362259999999999 2024-04-25T22:03:37.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:37.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876012+0000", 2024-04-25T22:03:37.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066894290000000002 2024-04-25T22:03:37.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:37.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876154+0000", 2024-04-25T22:03:37.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000141963 2024-04-25T22:03:37.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876257+0000", 2024-04-25T22:03:37.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102662 2024-04-25T22:03:37.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.788 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.788 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7069 4.36 4:6d2d0624:::100000014e5.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.788 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:37.788 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.919920845, 2024-04-25T22:03:37.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0457444709999999, 2024-04-25T22:03:37.788 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.788 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.789 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:37.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:37.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832183+0000", 2024-04-25T22:03:37.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1459999999999999e-06 2024-04-25T22:03:37.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832189+0000", 2024-04-25T22:03:37.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.614e-06 2024-04-25T22:03:37.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832206+0000", 2024-04-25T22:03:37.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.683e-05 2024-04-25T22:03:37.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832218+0000", 2024-04-25T22:03:37.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2266000000000001e-05 2024-04-25T22:03:37.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832265+0000", 2024-04-25T22:03:37.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7138999999999997e-05 2024-04-25T22:03:37.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:37.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832271+0000", 2024-04-25T22:03:37.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4280000000000004e-06 2024-04-25T22:03:37.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841149+0000", 2024-04-25T22:03:37.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088781429999999998 2024-04-25T22:03:37.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841158+0000", 2024-04-25T22:03:37.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7359999999999996e-06 2024-04-25T22:03:37.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867956+0000", 2024-04-25T22:03:37.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0267976969999999 2024-04-25T22:03:37.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:37.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.868991+0000", 2024-04-25T22:03:37.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010344810000000001 2024-04-25T22:03:37.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:37.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869248+0000", 2024-04-25T22:03:37.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025746699999999999 2024-04-25T22:03:37.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872721+0000", 2024-04-25T22:03:37.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034729959999999999 2024-04-25T22:03:37.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:37.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877064+0000", 2024-04-25T22:03:37.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043432770000000004 2024-04-25T22:03:37.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:37.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877767+0000", 2024-04-25T22:03:37.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070237700000000001 2024-04-25T22:03:37.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877927+0000", 2024-04-25T22:03:37.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015987400000000001 2024-04-25T22:03:37.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.794 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.795 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7071 4.22 4:45120e82:::100000014e7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.795 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:37.795 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9198674059999998, 2024-04-25T22:03:37.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.050578969, 2024-04-25T22:03:37.795 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.795 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.795 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.795 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:37.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:37.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832237+0000", 2024-04-25T22:03:37.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.003e-06 2024-04-25T22:03:37.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832243+0000", 2024-04-25T22:03:37.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-04-25T22:03:37.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832263+0000", 2024-04-25T22:03:37.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0066999999999999e-05 2024-04-25T22:03:37.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832293+0000", 2024-04-25T22:03:37.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9802999999999999e-05 2024-04-25T22:03:37.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832416+0000", 2024-04-25T22:03:37.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123566 2024-04-25T22:03:37.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:37.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832438+0000", 2024-04-25T22:03:37.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1433e-05 2024-04-25T22:03:37.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836745+0000", 2024-04-25T22:03:37.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043070260000000003 2024-04-25T22:03:37.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836752+0000", 2024-04-25T22:03:37.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2060000000000001e-06 2024-04-25T22:03:37.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875897+0000", 2024-04-25T22:03:37.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0391448489999999 2024-04-25T22:03:37.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:37.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876238+0000", 2024-04-25T22:03:37.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00034159400000000002 2024-04-25T22:03:37.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:37.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876491+0000", 2024-04-25T22:03:37.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025221500000000002 2024-04-25T22:03:37.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:37.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881289+0000", 2024-04-25T22:03:37.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047986510000000001 2024-04-25T22:03:37.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882627+0000", 2024-04-25T22:03:37.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013376340000000001 2024-04-25T22:03:37.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:37.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882707+0000", 2024-04-25T22:03:37.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0037000000000006e-05 2024-04-25T22:03:37.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882815+0000", 2024-04-25T22:03:37.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107645 2024-04-25T22:03:37.801 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.801 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.801 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.801 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7073 4.14 4:2af683fb:::100000014e9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.801 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:37.801 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.919786813, 2024-04-25T22:03:37.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.043944475, 2024-04-25T22:03:37.801 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.802 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.802 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:37.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:37.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832318+0000", 2024-04-25T22:03:37.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:03:37.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832323+0000", 2024-04-25T22:03:37.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6099999999999997e-06 2024-04-25T22:03:37.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832345+0000", 2024-04-25T22:03:37.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1353e-05 2024-04-25T22:03:37.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832390+0000", 2024-04-25T22:03:37.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5543000000000001e-05 2024-04-25T22:03:37.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832469+0000", 2024-04-25T22:03:37.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8770999999999995e-05 2024-04-25T22:03:37.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:37.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832475+0000", 2024-04-25T22:03:37.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0970000000000002e-06 2024-04-25T22:03:37.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843177+0000", 2024-04-25T22:03:37.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010702237999999999 2024-04-25T22:03:37.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843185+0000", 2024-04-25T22:03:37.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8490000000000006e-06 2024-04-25T22:03:37.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861478+0000", 2024-04-25T22:03:37.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.018292915 2024-04-25T22:03:37.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:37.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861880+0000", 2024-04-25T22:03:37.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00040182599999999998 2024-04-25T22:03:37.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:37.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862137+0000", 2024-04-25T22:03:37.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025741099999999998 2024-04-25T22:03:37.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866967+0000", 2024-04-25T22:03:37.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048298669999999998 2024-04-25T22:03:37.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:37.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875991+0000", 2024-04-25T22:03:37.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090235609999999994 2024-04-25T22:03:37.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:37.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876162+0000", 2024-04-25T22:03:37.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017075900000000001 2024-04-25T22:03:37.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876261+0000", 2024-04-25T22:03:37.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9072000000000003e-05 2024-04-25T22:03:37.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.807 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.808 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.808 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7077 4.27 4:e57158de:::100000014ed.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.808 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:37.808 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9196625379999999, 2024-04-25T22:03:37.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0562571009999999, 2024-04-25T22:03:37.808 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.808 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.808 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.808 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:37.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:37.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832442+0000", 2024-04-25T22:03:37.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.274e-06 2024-04-25T22:03:37.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832448+0000", 2024-04-25T22:03:37.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-04-25T22:03:37.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832466+0000", 2024-04-25T22:03:37.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7549000000000001e-05 2024-04-25T22:03:37.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832474+0000", 2024-04-25T22:03:37.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.337e-06 2024-04-25T22:03:37.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832545+0000", 2024-04-25T22:03:37.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0986000000000001e-05 2024-04-25T22:03:37.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:37.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832554+0000", 2024-04-25T22:03:37.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2269999999999999e-06 2024-04-25T22:03:37.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843167+0000", 2024-04-25T22:03:37.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010613058 2024-04-25T22:03:37.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843176+0000", 2024-04-25T22:03:37.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8629999999999997e-06 2024-04-25T22:03:37.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878195+0000", 2024-04-25T22:03:37.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0350192650000001 2024-04-25T22:03:37.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:37.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878952+0000", 2024-04-25T22:03:37.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00075638400000000003 2024-04-25T22:03:37.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:37.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879100+0000", 2024-04-25T22:03:37.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014883600000000001 2024-04-25T22:03:37.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:37.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.883699+0000", 2024-04-25T22:03:37.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045986880000000001 2024-04-25T22:03:37.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888487+0000", 2024-04-25T22:03:37.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047874670000000001 2024-04-25T22:03:37.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:37.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888603+0000", 2024-04-25T22:03:37.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011671900000000001 2024-04-25T22:03:37.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888698+0000", 2024-04-25T22:03:37.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4208000000000003e-05 2024-04-25T22:03:37.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.814 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.814 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7085 4.1f 4:f9b21afd:::10000001591.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.814 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:37.814 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9155979859999999, 2024-04-25T22:03:37.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0439952969999999, 2024-04-25T22:03:37.815 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.815 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.815 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:37.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:37.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836507+0000", 2024-04-25T22:03:37.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.17e-06 2024-04-25T22:03:37.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836517+0000", 2024-04-25T22:03:37.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9019999999999994e-06 2024-04-25T22:03:37.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836603+0000", 2024-04-25T22:03:37.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6248999999999994e-05 2024-04-25T22:03:37.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836614+0000", 2024-04-25T22:03:37.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0322e-05 2024-04-25T22:03:37.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841790+0000", 2024-04-25T22:03:37.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051763929999999996 2024-04-25T22:03:37.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841803+0000", 2024-04-25T22:03:37.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3023999999999999e-05 2024-04-25T22:03:37.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.870557+0000", 2024-04-25T22:03:37.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.02875396 2024-04-25T22:03:37.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:37.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872184+0000", 2024-04-25T22:03:37.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016268019999999999 2024-04-25T22:03:37.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:37.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872435+0000", 2024-04-25T22:03:37.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025088399999999999 2024-04-25T22:03:37.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879983+0000", 2024-04-25T22:03:37.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0075479379999999997 2024-04-25T22:03:37.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:37.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880150+0000", 2024-04-25T22:03:37.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016698900000000001 2024-04-25T22:03:37.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:37.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880300+0000", 2024-04-25T22:03:37.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000150789 2024-04-25T22:03:37.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880500+0000", 2024-04-25T22:03:37.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019987499999999999 2024-04-25T22:03:37.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.820 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.820 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7086 4.9 4:91594555:::10000001592.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.820 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:37.820 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9154702879999999, 2024-04-25T22:03:37.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0331164559999999, 2024-04-25T22:03:37.820 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.820 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.821 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:37.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:37.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836634+0000", 2024-04-25T22:03:37.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1510000000000001e-06 2024-04-25T22:03:37.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836638+0000", 2024-04-25T22:03:37.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9740000000000004e-06 2024-04-25T22:03:37.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836647+0000", 2024-04-25T22:03:37.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1269999999999992e-06 2024-04-25T22:03:37.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836653+0000", 2024-04-25T22:03:37.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8900000000000004e-06 2024-04-25T22:03:37.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841540+0000", 2024-04-25T22:03:37.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048869719999999998 2024-04-25T22:03:37.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841550+0000", 2024-04-25T22:03:37.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0644e-05 2024-04-25T22:03:37.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.857739+0000", 2024-04-25T22:03:37.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.016188589 2024-04-25T22:03:37.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:37.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.858099+0000", 2024-04-25T22:03:37.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036013100000000003 2024-04-25T22:03:37.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:37.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.858328+0000", 2024-04-25T22:03:37.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000228941 2024-04-25T22:03:37.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:37.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.864635+0000", 2024-04-25T22:03:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063073199999999999 2024-04-25T22:03:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869508+0000", 2024-04-25T22:03:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048727220000000003 2024-04-25T22:03:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869648+0000", 2024-04-25T22:03:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000140152 2024-04-25T22:03:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869749+0000", 2024-04-25T22:03:37.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100843 2024-04-25T22:03:37.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.826 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.826 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7096 4.9 4:90f65572:::100000016d2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.826 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:37.826 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9062762400000004, 2024-04-25T22:03:37.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0364832260000001, 2024-04-25T22:03:37.826 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.826 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.826 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.827 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:37.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:37.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845828+0000", 2024-04-25T22:03:37.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5199999999999995e-07 2024-04-25T22:03:37.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845834+0000", 2024-04-25T22:03:37.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4710000000000004e-06 2024-04-25T22:03:37.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845843+0000", 2024-04-25T22:03:37.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6119999999999999e-06 2024-04-25T22:03:37.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845848+0000", 2024-04-25T22:03:37.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8280000000000002e-06 2024-04-25T22:03:37.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845891+0000", 2024-04-25T22:03:37.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3234e-05 2024-04-25T22:03:37.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845898+0000", 2024-04-25T22:03:37.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3839999999999999e-06 2024-04-25T22:03:37.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.873643+0000", 2024-04-25T22:03:37.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.027745162 2024-04-25T22:03:37.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:37.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.873907+0000", 2024-04-25T22:03:37.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026328000000000001 2024-04-25T22:03:37.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:37.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.874143+0000", 2024-04-25T22:03:37.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023613799999999999 2024-04-25T22:03:37.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878861+0000", 2024-04-25T22:03:37.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047185710000000004 2024-04-25T22:03:37.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:37.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880222+0000", 2024-04-25T22:03:37.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001360984 2024-04-25T22:03:37.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:37.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880647+0000", 2024-04-25T22:03:37.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042470799999999999 2024-04-25T22:03:37.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882310+0000", 2024-04-25T22:03:37.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001662902 2024-04-25T22:03:37.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.832 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.832 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7098 3.9 3:9359a9e9:::100000016e0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.832 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:37.832 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9056731540000005, 2024-04-25T22:03:37.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.034065142, 2024-04-25T22:03:37.832 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.832 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:37.832 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:37.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:37.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846432+0000", 2024-04-25T22:03:37.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.88e-06 2024-04-25T22:03:37.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846440+0000", 2024-04-25T22:03:37.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7120000000000006e-06 2024-04-25T22:03:37.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846463+0000", 2024-04-25T22:03:37.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2416e-05 2024-04-25T22:03:37.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846479+0000", 2024-04-25T22:03:37.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6484999999999999e-05 2024-04-25T22:03:37.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846718+0000", 2024-04-25T22:03:37.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023839299999999999 2024-04-25T22:03:37.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846729+0000", 2024-04-25T22:03:37.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0896999999999999e-05 2024-04-25T22:03:37.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872537+0000", 2024-04-25T22:03:37.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0258087 2024-04-25T22:03:37.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:37.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872831+0000", 2024-04-25T22:03:37.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029391399999999999 2024-04-25T22:03:37.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880495+0000", 2024-04-25T22:03:37.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0076637449999999996 2024-04-25T22:03:37.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.836 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.836 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7100 4.1 4:83bc2484:::100000016e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.837 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:37.837 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9046200249999998, 2024-04-25T22:03:37.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.03260128, 2024-04-25T22:03:37.837 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.837 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.837 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:37.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:37.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847484+0000", 2024-04-25T22:03:37.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.443e-06 2024-04-25T22:03:37.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847491+0000", 2024-04-25T22:03:37.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4300000000000003e-06 2024-04-25T22:03:37.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847505+0000", 2024-04-25T22:03:37.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4014e-05 2024-04-25T22:03:37.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847514+0000", 2024-04-25T22:03:37.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4350000000000003e-06 2024-04-25T22:03:37.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847571+0000", 2024-04-25T22:03:37.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6338999999999997e-05 2024-04-25T22:03:37.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847580+0000", 2024-04-25T22:03:37.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0680000000000003e-06 2024-04-25T22:03:37.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862224+0000", 2024-04-25T22:03:37.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0146447279999999 2024-04-25T22:03:37.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:37.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862676+0000", 2024-04-25T22:03:37.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045117300000000003 2024-04-25T22:03:37.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:37.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862992+0000", 2024-04-25T22:03:37.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000316607 2024-04-25T22:03:37.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:37.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879035+0000", 2024-04-25T22:03:37.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016043168999999999 2024-04-25T22:03:37.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879762+0000", 2024-04-25T22:03:37.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00072643100000000004 2024-04-25T22:03:37.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:37.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879993+0000", 2024-04-25T22:03:37.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023091799999999999 2024-04-25T22:03:37.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880084+0000", 2024-04-25T22:03:37.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1525000000000002e-05 2024-04-25T22:03:37.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.842 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.842 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7105 4.1d 4:b83d3758:::10000001718.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.842 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:37.843 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9035697369999998, 2024-04-25T22:03:37.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0317263169999999, 2024-04-25T22:03:37.843 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.843 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.843 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:37.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:37.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848534+0000", 2024-04-25T22:03:37.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1200000000000001e-06 2024-04-25T22:03:37.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848541+0000", 2024-04-25T22:03:37.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4749999999999998e-06 2024-04-25T22:03:37.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848551+0000", 2024-04-25T22:03:37.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.039e-05 2024-04-25T22:03:37.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848558+0000", 2024-04-25T22:03:37.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2520000000000002e-06 2024-04-25T22:03:37.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848703+0000", 2024-04-25T22:03:37.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014466699999999999 2024-04-25T22:03:37.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848709+0000", 2024-04-25T22:03:37.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-04-25T22:03:37.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866810+0000", 2024-04-25T22:03:37.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.018101293 2024-04-25T22:03:37.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:37.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867282+0000", 2024-04-25T22:03:37.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047148999999999997 2024-04-25T22:03:37.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:37.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867555+0000", 2024-04-25T22:03:37.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027314100000000002 2024-04-25T22:03:37.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:37.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877648+0000", 2024-04-25T22:03:37.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010093275000000001 2024-04-25T22:03:37.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880012+0000", 2024-04-25T22:03:37.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023639590000000001 2024-04-25T22:03:37.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:37.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880157+0000", 2024-04-25T22:03:37.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000144532 2024-04-25T22:03:37.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880260+0000", 2024-04-25T22:03:37.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103016 2024-04-25T22:03:37.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.848 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.848 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7116 4.27 4:e60ee3a4:::10000001a5f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.848 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:37.848 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.8994151280000002, 2024-04-25T22:03:37.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0375457480000001, 2024-04-25T22:03:37.848 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.849 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.849 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:37.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:37.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:37.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-04-25T22:03:37.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852694+0000", 2024-04-25T22:03:37.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0360000000000003e-06 2024-04-25T22:03:37.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852702+0000", 2024-04-25T22:03:37.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1470000000000004e-06 2024-04-25T22:03:37.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852708+0000", 2024-04-25T22:03:37.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1210000000000003e-06 2024-04-25T22:03:37.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852762+0000", 2024-04-25T22:03:37.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4166000000000003e-05 2024-04-25T22:03:37.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852769+0000", 2024-04-25T22:03:37.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8000000000000001e-06 2024-04-25T22:03:37.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880804+0000", 2024-04-25T22:03:37.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.028035695 2024-04-25T22:03:37.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:37.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881105+0000", 2024-04-25T22:03:37.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030039999999999998 2024-04-25T22:03:37.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:37.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881373+0000", 2024-04-25T22:03:37.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026843499999999997 2024-04-25T22:03:37.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:37.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884999+0000", 2024-04-25T22:03:37.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036262070000000002 2024-04-25T22:03:37.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.889903+0000", 2024-04-25T22:03:37.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049036260000000003 2024-04-25T22:03:37.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:37.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890114+0000", 2024-04-25T22:03:37.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021130500000000001 2024-04-25T22:03:37.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890234+0000", 2024-04-25T22:03:37.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011922900000000001 2024-04-25T22:03:37.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.854 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.854 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7121 4.1f 4:fab6744c:::10000001a64.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.854 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:37.854 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.8989224570000003, 2024-04-25T22:03:37.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.031414587, 2024-04-25T22:03:37.854 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.854 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.855 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:37.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:37.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:37.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1299999999999999e-07 2024-04-25T22:03:37.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853184+0000", 2024-04-25T22:03:37.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1779999999999999e-06 2024-04-25T22:03:37.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853192+0000", 2024-04-25T22:03:37.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.294e-06 2024-04-25T22:03:37.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853196+0000", 2024-04-25T22:03:37.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6330000000000004e-06 2024-04-25T22:03:37.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853249+0000", 2024-04-25T22:03:37.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2785999999999999e-05 2024-04-25T22:03:37.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853260+0000", 2024-04-25T22:03:37.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1027e-05 2024-04-25T22:03:37.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875944+0000", 2024-04-25T22:03:37.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0226834810000001 2024-04-25T22:03:37.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:37.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876230+0000", 2024-04-25T22:03:37.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000286357 2024-04-25T22:03:37.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:37.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876512+0000", 2024-04-25T22:03:37.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028174500000000002 2024-04-25T22:03:37.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:37.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880727+0000", 2024-04-25T22:03:37.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042150520000000004 2024-04-25T22:03:37.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884386+0000", 2024-04-25T22:03:37.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036589069999999999 2024-04-25T22:03:37.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:37.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884502+0000", 2024-04-25T22:03:37.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000115862 2024-04-25T22:03:37.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884595+0000", 2024-04-25T22:03:37.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3552000000000001e-05 2024-04-25T22:03:37.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.860 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.860 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7127 4.22 4:476940b8:::10000001b50.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.860 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:37.860 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.8978144620000004, 2024-04-25T22:03:37.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.035873665, 2024-04-25T22:03:37.860 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.860 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.860 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.860 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:37.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:37.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854290+0000", 2024-04-25T22:03:37.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.313e-06 2024-04-25T22:03:37.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854295+0000", 2024-04-25T22:03:37.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3580000000000002e-06 2024-04-25T22:03:37.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854310+0000", 2024-04-25T22:03:37.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4742e-05 2024-04-25T22:03:37.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854318+0000", 2024-04-25T22:03:37.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2570000000000007e-06 2024-04-25T22:03:37.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854383+0000", 2024-04-25T22:03:37.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4535999999999993e-05 2024-04-25T22:03:37.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854390+0000", 2024-04-25T22:03:37.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3930000000000002e-06 2024-04-25T22:03:37.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879471+0000", 2024-04-25T22:03:37.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0250810260000001 2024-04-25T22:03:37.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:37.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879790+0000", 2024-04-25T22:03:37.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031862699999999998 2024-04-25T22:03:37.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:37.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880048+0000", 2024-04-25T22:03:37.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025776199999999998 2024-04-25T22:03:37.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:37.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882261+0000", 2024-04-25T22:03:37.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022130259999999999 2024-04-25T22:03:37.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.889734+0000", 2024-04-25T22:03:37.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0074735859999999999 2024-04-25T22:03:37.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:37.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890063+0000", 2024-04-25T22:03:37.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032892000000000002 2024-04-25T22:03:37.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890162+0000", 2024-04-25T22:03:37.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9118999999999997e-05 2024-04-25T22:03:37.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.866 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.866 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7135 4.27 4:e7bfb438:::10000001b58.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:37.866 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:37.866 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.895004932, 2024-04-25T22:03:37.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.033436429, 2024-04-25T22:03:37.866 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:37.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:37.866 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:37.866 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:37.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:37.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:37.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:37.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:37.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:37.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:37.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857099+0000", 2024-04-25T22:03:37.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0270000000000001e-06 2024-04-25T22:03:37.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:37.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857104+0000", 2024-04-25T22:03:37.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6909999999999996e-06 2024-04-25T22:03:37.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:37.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857116+0000", 2024-04-25T22:03:37.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2384999999999999e-05 2024-04-25T22:03:37.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:37.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857124+0000", 2024-04-25T22:03:37.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3080000000000008e-06 2024-04-25T22:03:37.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857175+0000", 2024-04-25T22:03:37.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0107e-05 2024-04-25T22:03:37.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:37.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857185+0000", 2024-04-25T22:03:37.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-04-25T22:03:37.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:37.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882135+0000", 2024-04-25T22:03:37.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.024950322 2024-04-25T22:03:37.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:37.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882426+0000", 2024-04-25T22:03:37.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029100699999999997 2024-04-25T22:03:37.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:37.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882689+0000", 2024-04-25T22:03:37.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026236800000000002 2024-04-25T22:03:37.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:37.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.885017+0000", 2024-04-25T22:03:37.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023282020000000001 2024-04-25T22:03:37.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:37.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890320+0000", 2024-04-25T22:03:37.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0053037049999999997 2024-04-25T22:03:37.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:37.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890428+0000", 2024-04-25T22:03:37.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107593 2024-04-25T22:03:37.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:37.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:37.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:37.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890534+0000", 2024-04-25T22:03:37.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106469 2024-04-25T22:03:37.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.871 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:37.871 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:37.872 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:37.872 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:03:37.872 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:03:37.873 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-25T22:03:37.873 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-25T22:03:37.873 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-25T22:03:37.873 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-25T22:03:37.875 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:37.872+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:37.875 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:37.974 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:37.972+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:38.032 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:38.032 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "" 2024-04-25T22:03:38.032 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:38.046 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:38.046 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:38.046 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:03:38.046 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:38.061 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:38.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:38.069+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:38.175 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:38.172+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:38.189 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:38.189 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:38.190 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:03:38.190 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:03:38.190 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:38.204 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:38.205 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:03:38.276 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:38.272+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:38.366 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:38.367 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:38.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:38.373+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:38.383 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:38.383 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:38.388 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:38.388 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:38.399 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:38.409 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:38.409 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:38.477 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:38.476+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:38.532 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:38.532 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:38.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:38.578 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:38.576+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:38.672 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:38.672 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:38.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:38.677+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:38.686 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:38.780 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:38.776+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:38.870 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:38.871 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:38.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:38.877+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:38.892 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:38.924 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:03:38.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:38.977+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:39.040 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:39.040 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:39.054 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:39.083 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:39.080+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:39.172 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:39.172 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:39.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:39.181+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:39.185 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:39.285 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:39.284+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:39.300 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:39.300 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:39.314 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:39.386 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:39.384+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:39.449 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:39.449 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:39.463 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:39.505 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:39.504+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:39.588 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:39.584+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:39.635 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:39.635 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:39.649 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:39.688 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:39.688+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:39.782 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:39.782 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:39.789 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:39.788+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:39.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:39.885 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-25T22:03:39.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:39.885+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:39.946 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:39.946 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:39.960 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:39.991 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:39.988+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:40.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:40.089+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:40.130 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:40.130 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:40.144 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:40.231 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:40.228+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:40.294 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:40.292+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:40.312 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:40.313 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:40.327 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:40.395 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:40.392+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:40.426 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:03:40.458 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:40.458 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:40.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:40.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:40.492+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:40.584 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:40.584 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:40.590 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:40.590 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:40.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:40.592+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:40.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:40.605 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:40.605 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:40.625 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:40.626 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:40.698 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:40.696+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:40.723 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:40.723 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:03:40.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:03:40.724 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:40.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.724 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7039 4.8 4:1138358d:::100000013f3.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.724 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:40.724 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8884757829999996, 2024-04-25T22:03:40.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.034656746, 2024-04-25T22:03:40.724 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.724 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.724 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:40.724 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:40.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:40.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831791+0000", 2024-04-25T22:03:40.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6359999999999998e-06 2024-04-25T22:03:40.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831801+0000", 2024-04-25T22:03:40.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0567000000000001e-05 2024-04-25T22:03:40.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831824+0000", 2024-04-25T22:03:40.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:03:40.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831839+0000", 2024-04-25T22:03:40.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5345999999999998e-05 2024-04-25T22:03:40.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832028+0000", 2024-04-25T22:03:40.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018899800000000001 2024-04-25T22:03:40.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:40.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832043+0000", 2024-04-25T22:03:40.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4805e-05 2024-04-25T22:03:40.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836259+0000", 2024-04-25T22:03:40.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042161819999999997 2024-04-25T22:03:40.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836422+0000", 2024-04-25T22:03:40.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000162404 2024-04-25T22:03:40.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.865428+0000", 2024-04-25T22:03:40.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0290065770000001 2024-04-25T22:03:40.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866445+0000", 2024-04-25T22:03:40.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001016561 2024-04-25T22:03:40.729 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.729 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.729 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.729 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7040 4.8 4:121f992c:::100000013f4.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.729 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:40.729 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8883868599999998, 2024-04-25T22:03:40.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0348302300000001, 2024-04-25T22:03:40.729 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.729 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.729 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:40.729 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:40.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:40.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831878+0000", 2024-04-25T22:03:40.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3659999999999999e-06 2024-04-25T22:03:40.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831885+0000", 2024-04-25T22:03:40.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7139999999999996e-06 2024-04-25T22:03:40.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831901+0000", 2024-04-25T22:03:40.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5982999999999999e-05 2024-04-25T22:03:40.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831910+0000", 2024-04-25T22:03:40.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7530000000000007e-06 2024-04-25T22:03:40.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832133+0000", 2024-04-25T22:03:40.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022307199999999999 2024-04-25T22:03:40.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:40.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832141+0000", 2024-04-25T22:03:40.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0080000000000002e-06 2024-04-25T22:03:40.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836611+0000", 2024-04-25T22:03:40.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044698389999999998 2024-04-25T22:03:40.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836629+0000", 2024-04-25T22:03:40.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8397e-05 2024-04-25T22:03:40.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866532+0000", 2024-04-25T22:03:40.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0299026200000001 2024-04-25T22:03:40.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866707+0000", 2024-04-25T22:03:40.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017547799999999999 2024-04-25T22:03:40.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.734 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.734 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7051 4.36 4:6e19a085:::100000013ff.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.734 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:40.734 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.888334081, 2024-04-25T22:03:40.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.032211298, 2024-04-25T22:03:40.734 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.735 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.735 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:40.735 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:40.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:40.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831931+0000", 2024-04-25T22:03:40.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.19e-06 2024-04-25T22:03:40.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831936+0000", 2024-04-25T22:03:40.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2059999999999998e-06 2024-04-25T22:03:40.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831950+0000", 2024-04-25T22:03:40.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3424000000000001e-05 2024-04-25T22:03:40.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831958+0000", 2024-04-25T22:03:40.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1659999999999994e-06 2024-04-25T22:03:40.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832033+0000", 2024-04-25T22:03:40.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4977999999999999e-05 2024-04-25T22:03:40.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:40.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832043+0000", 2024-04-25T22:03:40.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0268999999999999e-05 2024-04-25T22:03:40.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841105+0000", 2024-04-25T22:03:40.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090619829999999991 2024-04-25T22:03:40.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841118+0000", 2024-04-25T22:03:40.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2737e-05 2024-04-25T22:03:40.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.863240+0000", 2024-04-25T22:03:40.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0221224259999999 2024-04-25T22:03:40.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.864141+0000", 2024-04-25T22:03:40.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090091900000000003 2024-04-25T22:03:40.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.739 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.739 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7059 4.22 4:47c8979f:::10000001407.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.739 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:40.739 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8882829409999999, 2024-04-25T22:03:40.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0438401859999999, 2024-04-25T22:03:40.740 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.740 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.740 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:40.740 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:40.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:40.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831982+0000", 2024-04-25T22:03:40.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1030000000000001e-06 2024-04-25T22:03:40.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831987+0000", 2024-04-25T22:03:40.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-04-25T22:03:40.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832007+0000", 2024-04-25T22:03:40.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0126999999999999e-05 2024-04-25T22:03:40.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832022+0000", 2024-04-25T22:03:40.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4878999999999999e-05 2024-04-25T22:03:40.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832082+0000", 2024-04-25T22:03:40.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9552999999999997e-05 2024-04-25T22:03:40.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:40.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832088+0000", 2024-04-25T22:03:40.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9320000000000001e-06 2024-04-25T22:03:40.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836708+0000", 2024-04-25T22:03:40.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046199240000000001 2024-04-25T22:03:40.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836717+0000", 2024-04-25T22:03:40.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1840000000000005e-06 2024-04-25T22:03:40.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875475+0000", 2024-04-25T22:03:40.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0387584439999999 2024-04-25T22:03:40.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875821+0000", 2024-04-25T22:03:40.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00034578700000000001 2024-04-25T22:03:40.744 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.744 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.744 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.745 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7063 4.2 4:4331e060:::100000014df.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.745 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:40.745 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8882201519999997, 2024-04-25T22:03:40.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.047605189, 2024-04-25T22:03:40.745 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.745 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.745 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:40.745 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:40.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:40.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832045+0000", 2024-04-25T22:03:40.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:03:40.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832088+0000", 2024-04-25T22:03:40.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2483e-05 2024-04-25T22:03:40.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832100+0000", 2024-04-25T22:03:40.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2713e-05 2024-04-25T22:03:40.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832111+0000", 2024-04-25T22:03:40.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0457e-05 2024-04-25T22:03:40.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832155+0000", 2024-04-25T22:03:40.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4468999999999997e-05 2024-04-25T22:03:40.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:40.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832161+0000", 2024-04-25T22:03:40.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3369999999999999e-06 2024-04-25T22:03:40.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836779+0000", 2024-04-25T22:03:40.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046185030000000004 2024-04-25T22:03:40.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836787+0000", 2024-04-25T22:03:40.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5820000000000004e-06 2024-04-25T22:03:40.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.868721+0000", 2024-04-25T22:03:40.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0319339300000001 2024-04-25T22:03:40.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:40.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869179+0000", 2024-04-25T22:03:40.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000457916 2024-04-25T22:03:40.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:40.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869486+0000", 2024-04-25T22:03:40.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030764099999999999 2024-04-25T22:03:40.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:40.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879230+0000", 2024-04-25T22:03:40.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097433620000000002 2024-04-25T22:03:40.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:40.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879288+0000", 2024-04-25T22:03:40.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8813000000000001e-05 2024-04-25T22:03:40.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:40.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879542+0000", 2024-04-25T22:03:40.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025326999999999999 2024-04-25T22:03:40.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879649+0000", 2024-04-25T22:03:40.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107173 2024-04-25T22:03:40.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.752 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.752 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7068 4.33 4:cf543130:::100000014e4.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.752 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:40.752 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8881344599999998, 2024-04-25T22:03:40.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.044127671, 2024-04-25T22:03:40.752 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.752 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:40.752 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:40.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:40.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832131+0000", 2024-04-25T22:03:40.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:03:40.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832137+0000", 2024-04-25T22:03:40.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9859999999999999e-06 2024-04-25T22:03:40.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832155+0000", 2024-04-25T22:03:40.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8090000000000001e-05 2024-04-25T22:03:40.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832166+0000", 2024-04-25T22:03:40.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1776999999999999e-05 2024-04-25T22:03:40.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832235+0000", 2024-04-25T22:03:40.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8614000000000004e-05 2024-04-25T22:03:40.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:40.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832243+0000", 2024-04-25T22:03:40.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2719999999999997e-06 2024-04-25T22:03:40.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.834656+0000", 2024-04-25T22:03:40.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024123489999999998 2024-04-25T22:03:40.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.834666+0000", 2024-04-25T22:03:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8819999999999996e-06 2024-04-25T22:03:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.860770+0000", 2024-04-25T22:03:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.026104414 2024-04-25T22:03:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861849+0000", 2024-04-25T22:03:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010794559999999999 2024-04-25T22:03:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.865487+0000", 2024-04-25T22:03:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036373270000000001 2024-04-25T22:03:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869323+0000", 2024-04-25T22:03:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038362259999999999 2024-04-25T22:03:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876012+0000", 2024-04-25T22:03:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066894290000000002 2024-04-25T22:03:40.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:40.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876154+0000", 2024-04-25T22:03:40.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000141963 2024-04-25T22:03:40.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876257+0000", 2024-04-25T22:03:40.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102662 2024-04-25T22:03:40.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.758 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.759 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7069 4.36 4:6d2d0624:::100000014e5.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.759 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:40.759 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8880817030000001, 2024-04-25T22:03:40.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0457444709999999, 2024-04-25T22:03:40.759 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.759 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:40.759 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:40.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:40.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832183+0000", 2024-04-25T22:03:40.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1459999999999999e-06 2024-04-25T22:03:40.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832189+0000", 2024-04-25T22:03:40.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.614e-06 2024-04-25T22:03:40.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832206+0000", 2024-04-25T22:03:40.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.683e-05 2024-04-25T22:03:40.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832218+0000", 2024-04-25T22:03:40.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2266000000000001e-05 2024-04-25T22:03:40.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832265+0000", 2024-04-25T22:03:40.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7138999999999997e-05 2024-04-25T22:03:40.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:40.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832271+0000", 2024-04-25T22:03:40.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4280000000000004e-06 2024-04-25T22:03:40.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841149+0000", 2024-04-25T22:03:40.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088781429999999998 2024-04-25T22:03:40.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841158+0000", 2024-04-25T22:03:40.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7359999999999996e-06 2024-04-25T22:03:40.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867956+0000", 2024-04-25T22:03:40.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0267976969999999 2024-04-25T22:03:40.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:40.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.868991+0000", 2024-04-25T22:03:40.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010344810000000001 2024-04-25T22:03:40.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:40.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869248+0000", 2024-04-25T22:03:40.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025746699999999999 2024-04-25T22:03:40.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:40.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872721+0000", 2024-04-25T22:03:40.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034729959999999999 2024-04-25T22:03:40.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:40.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877064+0000", 2024-04-25T22:03:40.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043432770000000004 2024-04-25T22:03:40.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:40.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877767+0000", 2024-04-25T22:03:40.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070237700000000001 2024-04-25T22:03:40.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877927+0000", 2024-04-25T22:03:40.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015987400000000001 2024-04-25T22:03:40.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.765 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.765 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7071 4.22 4:45120e82:::100000014e7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.765 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:40.765 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8880282639999999, 2024-04-25T22:03:40.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.050578969, 2024-04-25T22:03:40.766 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.766 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:40.766 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:40.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:40.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832237+0000", 2024-04-25T22:03:40.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.003e-06 2024-04-25T22:03:40.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832243+0000", 2024-04-25T22:03:40.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-04-25T22:03:40.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832263+0000", 2024-04-25T22:03:40.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0066999999999999e-05 2024-04-25T22:03:40.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832293+0000", 2024-04-25T22:03:40.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9802999999999999e-05 2024-04-25T22:03:40.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832416+0000", 2024-04-25T22:03:40.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123566 2024-04-25T22:03:40.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:40.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832438+0000", 2024-04-25T22:03:40.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1433e-05 2024-04-25T22:03:40.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836745+0000", 2024-04-25T22:03:40.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043070260000000003 2024-04-25T22:03:40.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836752+0000", 2024-04-25T22:03:40.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2060000000000001e-06 2024-04-25T22:03:40.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875897+0000", 2024-04-25T22:03:40.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0391448489999999 2024-04-25T22:03:40.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:40.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876238+0000", 2024-04-25T22:03:40.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00034159400000000002 2024-04-25T22:03:40.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:40.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876491+0000", 2024-04-25T22:03:40.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025221500000000002 2024-04-25T22:03:40.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:40.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881289+0000", 2024-04-25T22:03:40.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047986510000000001 2024-04-25T22:03:40.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:40.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882627+0000", 2024-04-25T22:03:40.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013376340000000001 2024-04-25T22:03:40.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:40.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882707+0000", 2024-04-25T22:03:40.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0037000000000006e-05 2024-04-25T22:03:40.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882815+0000", 2024-04-25T22:03:40.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107645 2024-04-25T22:03:40.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.772 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.772 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7073 4.14 4:2af683fb:::100000014e9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.772 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:40.772 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.887947671, 2024-04-25T22:03:40.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.043944475, 2024-04-25T22:03:40.773 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.773 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:40.773 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:40.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:40.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832318+0000", 2024-04-25T22:03:40.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:03:40.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832323+0000", 2024-04-25T22:03:40.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6099999999999997e-06 2024-04-25T22:03:40.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832345+0000", 2024-04-25T22:03:40.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1353e-05 2024-04-25T22:03:40.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832390+0000", 2024-04-25T22:03:40.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5543000000000001e-05 2024-04-25T22:03:40.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832469+0000", 2024-04-25T22:03:40.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8770999999999995e-05 2024-04-25T22:03:40.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:40.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832475+0000", 2024-04-25T22:03:40.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0970000000000002e-06 2024-04-25T22:03:40.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843177+0000", 2024-04-25T22:03:40.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010702237999999999 2024-04-25T22:03:40.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843185+0000", 2024-04-25T22:03:40.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8490000000000006e-06 2024-04-25T22:03:40.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861478+0000", 2024-04-25T22:03:40.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.018292915 2024-04-25T22:03:40.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:40.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861880+0000", 2024-04-25T22:03:40.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00040182599999999998 2024-04-25T22:03:40.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:40.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862137+0000", 2024-04-25T22:03:40.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025741099999999998 2024-04-25T22:03:40.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:40.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866967+0000", 2024-04-25T22:03:40.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048298669999999998 2024-04-25T22:03:40.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:40.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875991+0000", 2024-04-25T22:03:40.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090235609999999994 2024-04-25T22:03:40.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:40.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876162+0000", 2024-04-25T22:03:40.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017075900000000001 2024-04-25T22:03:40.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876261+0000", 2024-04-25T22:03:40.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9072000000000003e-05 2024-04-25T22:03:40.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.779 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.779 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7077 4.27 4:e57158de:::100000014ed.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.779 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:40.779 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8878233959999999, 2024-04-25T22:03:40.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0562571009999999, 2024-04-25T22:03:40.780 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:40.780 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:40.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:40.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832442+0000", 2024-04-25T22:03:40.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.274e-06 2024-04-25T22:03:40.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832448+0000", 2024-04-25T22:03:40.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-04-25T22:03:40.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832466+0000", 2024-04-25T22:03:40.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7549000000000001e-05 2024-04-25T22:03:40.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832474+0000", 2024-04-25T22:03:40.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.337e-06 2024-04-25T22:03:40.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832545+0000", 2024-04-25T22:03:40.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0986000000000001e-05 2024-04-25T22:03:40.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:40.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832554+0000", 2024-04-25T22:03:40.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2269999999999999e-06 2024-04-25T22:03:40.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843167+0000", 2024-04-25T22:03:40.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010613058 2024-04-25T22:03:40.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843176+0000", 2024-04-25T22:03:40.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8629999999999997e-06 2024-04-25T22:03:40.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878195+0000", 2024-04-25T22:03:40.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0350192650000001 2024-04-25T22:03:40.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:40.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878952+0000", 2024-04-25T22:03:40.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00075638400000000003 2024-04-25T22:03:40.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:40.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879100+0000", 2024-04-25T22:03:40.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014883600000000001 2024-04-25T22:03:40.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:40.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.883699+0000", 2024-04-25T22:03:40.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045986880000000001 2024-04-25T22:03:40.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:40.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888487+0000", 2024-04-25T22:03:40.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047874670000000001 2024-04-25T22:03:40.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:40.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888603+0000", 2024-04-25T22:03:40.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011671900000000001 2024-04-25T22:03:40.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888698+0000", 2024-04-25T22:03:40.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4208000000000003e-05 2024-04-25T22:03:40.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.786 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.786 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7085 4.1f 4:f9b21afd:::10000001591.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.786 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:40.786 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8837588439999999, 2024-04-25T22:03:40.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0439952969999999, 2024-04-25T22:03:40.787 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.787 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:40.787 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:40.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:40.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836507+0000", 2024-04-25T22:03:40.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.17e-06 2024-04-25T22:03:40.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836517+0000", 2024-04-25T22:03:40.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9019999999999994e-06 2024-04-25T22:03:40.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836603+0000", 2024-04-25T22:03:40.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6248999999999994e-05 2024-04-25T22:03:40.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836614+0000", 2024-04-25T22:03:40.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0322e-05 2024-04-25T22:03:40.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841790+0000", 2024-04-25T22:03:40.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051763929999999996 2024-04-25T22:03:40.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841803+0000", 2024-04-25T22:03:40.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3023999999999999e-05 2024-04-25T22:03:40.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.870557+0000", 2024-04-25T22:03:40.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.02875396 2024-04-25T22:03:40.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:40.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872184+0000", 2024-04-25T22:03:40.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016268019999999999 2024-04-25T22:03:40.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:40.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872435+0000", 2024-04-25T22:03:40.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025088399999999999 2024-04-25T22:03:40.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:40.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879983+0000", 2024-04-25T22:03:40.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0075479379999999997 2024-04-25T22:03:40.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:40.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880150+0000", 2024-04-25T22:03:40.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016698900000000001 2024-04-25T22:03:40.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:40.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880300+0000", 2024-04-25T22:03:40.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000150789 2024-04-25T22:03:40.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880500+0000", 2024-04-25T22:03:40.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019987499999999999 2024-04-25T22:03:40.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.792 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.792 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7086 4.9 4:91594555:::10000001592.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.792 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:40.792 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8836311459999999, 2024-04-25T22:03:40.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0331164559999999, 2024-04-25T22:03:40.793 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.793 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:40.793 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:40.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:40.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836634+0000", 2024-04-25T22:03:40.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1510000000000001e-06 2024-04-25T22:03:40.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836638+0000", 2024-04-25T22:03:40.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9740000000000004e-06 2024-04-25T22:03:40.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836647+0000", 2024-04-25T22:03:40.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1269999999999992e-06 2024-04-25T22:03:40.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836653+0000", 2024-04-25T22:03:40.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8900000000000004e-06 2024-04-25T22:03:40.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841540+0000", 2024-04-25T22:03:40.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048869719999999998 2024-04-25T22:03:40.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841550+0000", 2024-04-25T22:03:40.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0644e-05 2024-04-25T22:03:40.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.857739+0000", 2024-04-25T22:03:40.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.016188589 2024-04-25T22:03:40.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:40.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.858099+0000", 2024-04-25T22:03:40.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036013100000000003 2024-04-25T22:03:40.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:40.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.858328+0000", 2024-04-25T22:03:40.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000228941 2024-04-25T22:03:40.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:40.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.864635+0000", 2024-04-25T22:03:40.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063073199999999999 2024-04-25T22:03:40.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:40.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869508+0000", 2024-04-25T22:03:40.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048727220000000003 2024-04-25T22:03:40.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:40.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869648+0000", 2024-04-25T22:03:40.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000140152 2024-04-25T22:03:40.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869749+0000", 2024-04-25T22:03:40.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100843 2024-04-25T22:03:40.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.798 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.799 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.799 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7096 4.9 4:90f65572:::100000016d2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.799 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:40.799 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8744370979999996, 2024-04-25T22:03:40.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0364832260000001, 2024-04-25T22:03:40.799 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.799 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.799 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:40.799 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:40.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:40.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845828+0000", 2024-04-25T22:03:40.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5199999999999995e-07 2024-04-25T22:03:40.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845834+0000", 2024-04-25T22:03:40.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4710000000000004e-06 2024-04-25T22:03:40.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845843+0000", 2024-04-25T22:03:40.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6119999999999999e-06 2024-04-25T22:03:40.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845848+0000", 2024-04-25T22:03:40.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8280000000000002e-06 2024-04-25T22:03:40.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845891+0000", 2024-04-25T22:03:40.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3234e-05 2024-04-25T22:03:40.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845898+0000", 2024-04-25T22:03:40.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3839999999999999e-06 2024-04-25T22:03:40.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.873643+0000", 2024-04-25T22:03:40.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.027745162 2024-04-25T22:03:40.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:40.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.873907+0000", 2024-04-25T22:03:40.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026328000000000001 2024-04-25T22:03:40.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:40.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.874143+0000", 2024-04-25T22:03:40.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023613799999999999 2024-04-25T22:03:40.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:40.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878861+0000", 2024-04-25T22:03:40.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047185710000000004 2024-04-25T22:03:40.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:40.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880222+0000", 2024-04-25T22:03:40.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001360984 2024-04-25T22:03:40.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:40.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880647+0000", 2024-04-25T22:03:40.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042470799999999999 2024-04-25T22:03:40.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882310+0000", 2024-04-25T22:03:40.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001662902 2024-04-25T22:03:40.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.805 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.805 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7098 3.9 3:9359a9e9:::100000016e0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.805 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:40.805 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8738340119999997, 2024-04-25T22:03:40.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.034065142, 2024-04-25T22:03:40.805 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.805 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.805 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:40.805 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:40.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:40.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846432+0000", 2024-04-25T22:03:40.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.88e-06 2024-04-25T22:03:40.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846440+0000", 2024-04-25T22:03:40.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7120000000000006e-06 2024-04-25T22:03:40.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846463+0000", 2024-04-25T22:03:40.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2416e-05 2024-04-25T22:03:40.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846479+0000", 2024-04-25T22:03:40.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6484999999999999e-05 2024-04-25T22:03:40.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846718+0000", 2024-04-25T22:03:40.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023839299999999999 2024-04-25T22:03:40.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846729+0000", 2024-04-25T22:03:40.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0896999999999999e-05 2024-04-25T22:03:40.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872537+0000", 2024-04-25T22:03:40.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0258087 2024-04-25T22:03:40.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:40.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872831+0000", 2024-04-25T22:03:40.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029391399999999999 2024-04-25T22:03:40.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880495+0000", 2024-04-25T22:03:40.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0076637449999999996 2024-04-25T22:03:40.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.809 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.810 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7100 4.1 4:83bc2484:::100000016e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.810 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:40.810 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8727808829999999, 2024-04-25T22:03:40.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.03260128, 2024-04-25T22:03:40.810 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.810 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:40.810 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:40.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:40.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847484+0000", 2024-04-25T22:03:40.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.443e-06 2024-04-25T22:03:40.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847491+0000", 2024-04-25T22:03:40.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4300000000000003e-06 2024-04-25T22:03:40.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847505+0000", 2024-04-25T22:03:40.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4014e-05 2024-04-25T22:03:40.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847514+0000", 2024-04-25T22:03:40.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4350000000000003e-06 2024-04-25T22:03:40.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847571+0000", 2024-04-25T22:03:40.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6338999999999997e-05 2024-04-25T22:03:40.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847580+0000", 2024-04-25T22:03:40.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0680000000000003e-06 2024-04-25T22:03:40.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862224+0000", 2024-04-25T22:03:40.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0146447279999999 2024-04-25T22:03:40.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:40.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862676+0000", 2024-04-25T22:03:40.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045117300000000003 2024-04-25T22:03:40.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:40.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862992+0000", 2024-04-25T22:03:40.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000316607 2024-04-25T22:03:40.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:40.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879035+0000", 2024-04-25T22:03:40.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016043168999999999 2024-04-25T22:03:40.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:40.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879762+0000", 2024-04-25T22:03:40.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00072643100000000004 2024-04-25T22:03:40.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:40.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879993+0000", 2024-04-25T22:03:40.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023091799999999999 2024-04-25T22:03:40.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880084+0000", 2024-04-25T22:03:40.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1525000000000002e-05 2024-04-25T22:03:40.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.815 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.816 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7105 4.1d 4:b83d3758:::10000001718.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.816 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:40.816 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8717305949999998, 2024-04-25T22:03:40.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0317263169999999, 2024-04-25T22:03:40.816 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.816 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:40.816 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:40.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:40.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848534+0000", 2024-04-25T22:03:40.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1200000000000001e-06 2024-04-25T22:03:40.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848541+0000", 2024-04-25T22:03:40.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4749999999999998e-06 2024-04-25T22:03:40.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848551+0000", 2024-04-25T22:03:40.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.039e-05 2024-04-25T22:03:40.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848558+0000", 2024-04-25T22:03:40.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2520000000000002e-06 2024-04-25T22:03:40.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848703+0000", 2024-04-25T22:03:40.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014466699999999999 2024-04-25T22:03:40.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848709+0000", 2024-04-25T22:03:40.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-04-25T22:03:40.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866810+0000", 2024-04-25T22:03:40.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.018101293 2024-04-25T22:03:40.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:40.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867282+0000", 2024-04-25T22:03:40.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047148999999999997 2024-04-25T22:03:40.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:40.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867555+0000", 2024-04-25T22:03:40.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027314100000000002 2024-04-25T22:03:40.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:40.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877648+0000", 2024-04-25T22:03:40.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010093275000000001 2024-04-25T22:03:40.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:40.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880012+0000", 2024-04-25T22:03:40.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023639590000000001 2024-04-25T22:03:40.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:40.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880157+0000", 2024-04-25T22:03:40.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000144532 2024-04-25T22:03:40.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880260+0000", 2024-04-25T22:03:40.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103016 2024-04-25T22:03:40.821 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.822 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.822 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7116 4.27 4:e60ee3a4:::10000001a5f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.822 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:40.822 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8675759860000003, 2024-04-25T22:03:40.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0375457480000001, 2024-04-25T22:03:40.822 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.822 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:40.822 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:40.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:40.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:40.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-04-25T22:03:40.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852694+0000", 2024-04-25T22:03:40.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0360000000000003e-06 2024-04-25T22:03:40.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852702+0000", 2024-04-25T22:03:40.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1470000000000004e-06 2024-04-25T22:03:40.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852708+0000", 2024-04-25T22:03:40.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1210000000000003e-06 2024-04-25T22:03:40.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852762+0000", 2024-04-25T22:03:40.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4166000000000003e-05 2024-04-25T22:03:40.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852769+0000", 2024-04-25T22:03:40.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8000000000000001e-06 2024-04-25T22:03:40.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880804+0000", 2024-04-25T22:03:40.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.028035695 2024-04-25T22:03:40.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:40.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881105+0000", 2024-04-25T22:03:40.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030039999999999998 2024-04-25T22:03:40.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:40.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881373+0000", 2024-04-25T22:03:40.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026843499999999997 2024-04-25T22:03:40.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:40.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884999+0000", 2024-04-25T22:03:40.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036262070000000002 2024-04-25T22:03:40.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:40.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.889903+0000", 2024-04-25T22:03:40.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049036260000000003 2024-04-25T22:03:40.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:40.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890114+0000", 2024-04-25T22:03:40.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021130500000000001 2024-04-25T22:03:40.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890234+0000", 2024-04-25T22:03:40.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011922900000000001 2024-04-25T22:03:40.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.828 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.828 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7121 4.1f 4:fab6744c:::10000001a64.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.828 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:40.828 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8670833150000004, 2024-04-25T22:03:40.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.031414587, 2024-04-25T22:03:40.828 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.829 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.829 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:40.829 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:40.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:40.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:40.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1299999999999999e-07 2024-04-25T22:03:40.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853184+0000", 2024-04-25T22:03:40.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1779999999999999e-06 2024-04-25T22:03:40.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853192+0000", 2024-04-25T22:03:40.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.294e-06 2024-04-25T22:03:40.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853196+0000", 2024-04-25T22:03:40.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6330000000000004e-06 2024-04-25T22:03:40.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853249+0000", 2024-04-25T22:03:40.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2785999999999999e-05 2024-04-25T22:03:40.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853260+0000", 2024-04-25T22:03:40.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1027e-05 2024-04-25T22:03:40.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875944+0000", 2024-04-25T22:03:40.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0226834810000001 2024-04-25T22:03:40.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:40.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876230+0000", 2024-04-25T22:03:40.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000286357 2024-04-25T22:03:40.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:40.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876512+0000", 2024-04-25T22:03:40.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028174500000000002 2024-04-25T22:03:40.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:40.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880727+0000", 2024-04-25T22:03:40.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042150520000000004 2024-04-25T22:03:40.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:40.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884386+0000", 2024-04-25T22:03:40.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036589069999999999 2024-04-25T22:03:40.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:40.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884502+0000", 2024-04-25T22:03:40.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000115862 2024-04-25T22:03:40.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884595+0000", 2024-04-25T22:03:40.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3552000000000001e-05 2024-04-25T22:03:40.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.834 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.834 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7127 4.22 4:476940b8:::10000001b50.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.834 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:40.835 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8659753200000004, 2024-04-25T22:03:40.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.035873665, 2024-04-25T22:03:40.835 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.835 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:40.835 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:40.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:40.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854290+0000", 2024-04-25T22:03:40.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.313e-06 2024-04-25T22:03:40.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854295+0000", 2024-04-25T22:03:40.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3580000000000002e-06 2024-04-25T22:03:40.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854310+0000", 2024-04-25T22:03:40.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4742e-05 2024-04-25T22:03:40.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854318+0000", 2024-04-25T22:03:40.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2570000000000007e-06 2024-04-25T22:03:40.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854383+0000", 2024-04-25T22:03:40.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4535999999999993e-05 2024-04-25T22:03:40.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854390+0000", 2024-04-25T22:03:40.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3930000000000002e-06 2024-04-25T22:03:40.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879471+0000", 2024-04-25T22:03:40.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0250810260000001 2024-04-25T22:03:40.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:40.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879790+0000", 2024-04-25T22:03:40.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031862699999999998 2024-04-25T22:03:40.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:40.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880048+0000", 2024-04-25T22:03:40.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025776199999999998 2024-04-25T22:03:40.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:40.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882261+0000", 2024-04-25T22:03:40.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022130259999999999 2024-04-25T22:03:40.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:40.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.889734+0000", 2024-04-25T22:03:40.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0074735859999999999 2024-04-25T22:03:40.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:40.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890063+0000", 2024-04-25T22:03:40.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032892000000000002 2024-04-25T22:03:40.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890162+0000", 2024-04-25T22:03:40.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9118999999999997e-05 2024-04-25T22:03:40.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.840 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.841 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7135 4.27 4:e7bfb438:::10000001b58.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:40.841 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:40.841 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.86316579, 2024-04-25T22:03:40.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.033436429, 2024-04-25T22:03:40.841 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:40.841 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:40.841 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:40.841 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:40.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:40.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:40.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:40.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:40.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:40.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:40.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857099+0000", 2024-04-25T22:03:40.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0270000000000001e-06 2024-04-25T22:03:40.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:40.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857104+0000", 2024-04-25T22:03:40.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6909999999999996e-06 2024-04-25T22:03:40.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:40.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857116+0000", 2024-04-25T22:03:40.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2384999999999999e-05 2024-04-25T22:03:40.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:40.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857124+0000", 2024-04-25T22:03:40.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3080000000000008e-06 2024-04-25T22:03:40.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857175+0000", 2024-04-25T22:03:40.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0107e-05 2024-04-25T22:03:40.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:40.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857185+0000", 2024-04-25T22:03:40.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-04-25T22:03:40.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:40.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882135+0000", 2024-04-25T22:03:40.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.024950322 2024-04-25T22:03:40.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:40.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882426+0000", 2024-04-25T22:03:40.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029100699999999997 2024-04-25T22:03:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882689+0000", 2024-04-25T22:03:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026236800000000002 2024-04-25T22:03:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.885017+0000", 2024-04-25T22:03:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023282020000000001 2024-04-25T22:03:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:40.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890320+0000", 2024-04-25T22:03:40.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0053037049999999997 2024-04-25T22:03:40.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:40.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890428+0000", 2024-04-25T22:03:40.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107593 2024-04-25T22:03:40.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:40.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:40.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:40.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890534+0000", 2024-04-25T22:03:40.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106469 2024-04-25T22:03:40.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.847 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:40.847 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:40.847 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:40.848 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:40.848+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:40.849 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:40.949 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:40.948+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:41.001 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:41.001 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:41.001 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:03:41.002 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:41.016 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:41.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:41.044+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:41.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:41.148+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:41.192 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:41.192 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:41.192 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:03:41.192 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:03:41.192 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:41.207 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:41.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:41.248+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:41.343 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:41.343 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:03:41.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:03:41.343 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:41.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.343 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T22:03:41.343 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:41.343 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.354177864, 2024-04-25T22:03:41.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.180276931, 2024-04-25T22:03:41.343 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.344 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.344 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.344 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:41.344 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:41.344 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:41.344 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4 2024-04-25T22:03:41.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.344 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:41.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:41.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983834+0000", 2024-04-25T22:03:41.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2900000000000001e-06 2024-04-25T22:03:41.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991787+0000", 2024-04-25T22:03:41.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079521690000000003 2024-04-25T22:03:41.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991826+0000", 2024-04-25T22:03:41.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9258999999999998e-05 2024-04-25T22:03:41.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991845+0000", 2024-04-25T22:03:41.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9360000000000001e-05 2024-04-25T22:03:41.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992058+0000", 2024-04-25T22:03:41.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212559 2024-04-25T22:03:41.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992213+0000", 2024-04-25T22:03:41.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015520700000000001 2024-04-25T22:03:41.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992414+0000", 2024-04-25T22:03:41.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020049 2024-04-25T22:03:41.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162511+0000", 2024-04-25T22:03:41.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.17009782900000001 2024-04-25T22:03:41.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163967+0000", 2024-04-25T22:03:41.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001455752 2024-04-25T22:03:41.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164045+0000", 2024-04-25T22:03:41.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7415000000000003e-05 2024-04-25T22:03:41.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164109+0000", 2024-04-25T22:03:41.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4601e-05 2024-04-25T22:03:41.350 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.350 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.350 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.350 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6847 4.16 4:68767fd1:::10000001f4f.00000000:head [write 0~7212] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:41.350 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:41.350 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.644538402999999, 2024-04-25T22:03:41.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0208302119999999, 2024-04-25T22:03:41.351 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.351 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.351 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.351 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:41.351 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:41.351 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:41.351 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6847 2024-04-25T22:03:41.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.351 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:41.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:41.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693473+0000", 2024-04-25T22:03:41.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.75e-06 2024-04-25T22:03:41.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693490+0000", 2024-04-25T22:03:41.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6540000000000001e-05 2024-04-25T22:03:41.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693509+0000", 2024-04-25T22:03:41.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9536999999999999e-05 2024-04-25T22:03:41.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693522+0000", 2024-04-25T22:03:41.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2099000000000001e-05 2024-04-25T22:03:41.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693677+0000", 2024-04-25T22:03:41.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015516799999999999 2024-04-25T22:03:41.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:41.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693705+0000", 2024-04-25T22:03:41.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8663e-05 2024-04-25T22:03:41.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705551+0000", 2024-04-25T22:03:41.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.011845495 2024-04-25T22:03:41.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705942+0000", 2024-04-25T22:03:41.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00039080099999999997 2024-04-25T22:03:41.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:41.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.706151+0000", 2024-04-25T22:03:41.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000209457 2024-04-25T22:03:41.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711141+0000", 2024-04-25T22:03:41.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049901240000000003 2024-04-25T22:03:41.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714005+0000", 2024-04-25T22:03:41.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028642229999999999 2024-04-25T22:03:41.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714180+0000", 2024-04-25T22:03:41.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017433699999999999 2024-04-25T22:03:41.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714302+0000", 2024-04-25T22:03:41.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122018 2024-04-25T22:03:41.356 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.356 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.357 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.357 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6960 4.16 4:6823d322:::10000001fd2.00000000:head [write 0~150] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:41.357 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:41.357 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.367534305, 2024-04-25T22:03:41.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.74417278899999995, 2024-04-25T22:03:41.357 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.357 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.357 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.357 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:41.357 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:41.357 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:41.357 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6960 2024-04-25T22:03:41.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.358 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:41.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:41.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970478+0000", 2024-04-25T22:03:41.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.939e-06 2024-04-25T22:03:41.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970488+0000", 2024-04-25T22:03:41.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9699999999999994e-06 2024-04-25T22:03:41.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970524+0000", 2024-04-25T22:03:41.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5963000000000001e-05 2024-04-25T22:03:41.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970537+0000", 2024-04-25T22:03:41.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.31e-05 2024-04-25T22:03:41.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970701+0000", 2024-04-25T22:03:41.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164177 2024-04-25T22:03:41.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:41.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970718+0000", 2024-04-25T22:03:41.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7323e-05 2024-04-25T22:03:41.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707632+0000", 2024-04-25T22:03:41.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.73691394300000002 2024-04-25T22:03:41.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707924+0000", 2024-04-25T22:03:41.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029223299999999998 2024-04-25T22:03:41.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:41.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.708389+0000", 2024-04-25T22:03:41.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046429300000000001 2024-04-25T22:03:41.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:41.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029039830000000002 2024-04-25T22:03:41.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714409+0000", 2024-04-25T22:03:41.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031159260000000002 2024-04-25T22:03:41.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714538+0000", 2024-04-25T22:03:41.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012952100000000001 2024-04-25T22:03:41.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714649+0000", 2024-04-25T22:03:41.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110418 2024-04-25T22:03:41.365 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.365 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.365 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.365 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7039 4.16 4:6919637e:::10000002032.00000000:head [write 0~2968] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:41.365 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:41.365 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.181487799999999, 2024-04-25T22:03:41.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.56024932199999999, 2024-04-25T22:03:41.366 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.366 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.366 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.366 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:41.366 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:41.366 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:41.366 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7039 2024-04-25T22:03:41.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.366 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:41.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:41.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156523+0000", 2024-04-25T22:03:41.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2130000000000001e-06 2024-04-25T22:03:41.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156530+0000", 2024-04-25T22:03:41.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9090000000000003e-06 2024-04-25T22:03:41.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156544+0000", 2024-04-25T22:03:41.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3271999999999999e-05 2024-04-25T22:03:41.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156551+0000", 2024-04-25T22:03:41.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4970000000000004e-06 2024-04-25T22:03:41.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156639+0000", 2024-04-25T22:03:41.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7638000000000004e-05 2024-04-25T22:03:41.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:41.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156649+0000", 2024-04-25T22:03:41.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0536e-05 2024-04-25T22:03:41.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709515+0000", 2024-04-25T22:03:41.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.55286568999999997 2024-04-25T22:03:41.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709836+0000", 2024-04-25T22:03:41.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032078899999999998 2024-04-25T22:03:41.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:41.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.710271+0000", 2024-04-25T22:03:41.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043530000000000001 2024-04-25T22:03:41.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716576+0000", 2024-04-25T22:03:41.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063045050000000002 2024-04-25T22:03:41.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716605+0000", 2024-04-25T22:03:41.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8949e-05 2024-04-25T22:03:41.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716706+0000", 2024-04-25T22:03:41.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101765 2024-04-25T22:03:41.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716772+0000", 2024-04-25T22:03:41.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5259000000000007e-05 2024-04-25T22:03:41.371 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.371 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.371 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.372 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7065 4.16 4:697a9f10:::10000002050.00000000:head [write 0~16297] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:41.372 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:41.372 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.123871852000001, 2024-04-25T22:03:41.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.50307290800000004, 2024-04-25T22:03:41.372 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.372 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.372 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.372 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:41.372 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:41.372 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:41.372 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7065 2024-04-25T22:03:41.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.372 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:41.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:41.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214139+0000", 2024-04-25T22:03:41.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.186e-06 2024-04-25T22:03:41.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214170+0000", 2024-04-25T22:03:41.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0419000000000001e-05 2024-04-25T22:03:41.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214186+0000", 2024-04-25T22:03:41.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6526000000000001e-05 2024-04-25T22:03:41.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214194+0000", 2024-04-25T22:03:41.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6769999999999995e-06 2024-04-25T22:03:41.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214380+0000", 2024-04-25T22:03:41.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018580699999999999 2024-04-25T22:03:41.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:41.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214399+0000", 2024-04-25T22:03:41.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9446e-05 2024-04-25T22:03:41.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711402+0000", 2024-04-25T22:03:41.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.497002901 2024-04-25T22:03:41.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711822+0000", 2024-04-25T22:03:41.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00041989399999999997 2024-04-25T22:03:41.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:41.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.712017+0000", 2024-04-25T22:03:41.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019540700000000001 2024-04-25T22:03:41.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716792+0000", 2024-04-25T22:03:41.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047748210000000003 2024-04-25T22:03:41.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716937+0000", 2024-04-25T22:03:41.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014479099999999999 2024-04-25T22:03:41.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717081+0000", 2024-04-25T22:03:41.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014412100000000001 2024-04-25T22:03:41.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717211+0000", 2024-04-25T22:03:41.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012991200000000001 2024-04-25T22:03:41.380 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.380 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.380 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.381 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7089 4.16 4:6868fcac:::1000000206b.00000000:head [write 0~5386] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:41.381 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:41.381 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.064317858000003, 2024-04-25T22:03:41.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44658810700000001, 2024-04-25T22:03:41.381 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.381 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.382 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.382 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:41.382 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:41.382 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:41.382 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7089 2024-04-25T22:03:41.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.383 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:41.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:41.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273695+0000", 2024-04-25T22:03:41.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.463e-06 2024-04-25T22:03:41.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273712+0000", 2024-04-25T22:03:41.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7842999999999998e-05 2024-04-25T22:03:41.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273742+0000", 2024-04-25T22:03:41.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9039000000000001e-05 2024-04-25T22:03:41.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273756+0000", 2024-04-25T22:03:41.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4406999999999999e-05 2024-04-25T22:03:41.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273943+0000", 2024-04-25T22:03:41.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018708 2024-04-25T22:03:41.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:41.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273961+0000", 2024-04-25T22:03:41.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7977000000000001e-05 2024-04-25T22:03:41.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714748+0000", 2024-04-25T22:03:41.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.440786605 2024-04-25T22:03:41.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715013+0000", 2024-04-25T22:03:41.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026558300000000001 2024-04-25T22:03:41.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:41.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715309+0000", 2024-04-25T22:03:41.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000295715 2024-04-25T22:03:41.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.719035+0000", 2024-04-25T22:03:41.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037256310000000001 2024-04-25T22:03:41.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720142+0000", 2024-04-25T22:03:41.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001107053 2024-04-25T22:03:41.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720221+0000", 2024-04-25T22:03:41.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9832000000000004e-05 2024-04-25T22:03:41.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720280+0000", 2024-04-25T22:03:41.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8879000000000003e-05 2024-04-25T22:03:41.390 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.390 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.391 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.391 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7090 4.16 4:69dc3034:::1000000206c.00000000:head [write 0~957] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:41.391 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:41.391 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.061693527999999, 2024-04-25T22:03:41.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44572077100000002, 2024-04-25T22:03:41.391 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.391 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.391 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.391 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:41.391 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:41.391 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:41.391 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7090 2024-04-25T22:03:41.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.392 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:41.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:41.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276319+0000", 2024-04-25T22:03:41.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3429999999999998e-06 2024-04-25T22:03:41.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276330+0000", 2024-04-25T22:03:41.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1567e-05 2024-04-25T22:03:41.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276362+0000", 2024-04-25T22:03:41.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1863000000000003e-05 2024-04-25T22:03:41.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276377+0000", 2024-04-25T22:03:41.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5102999999999999e-05 2024-04-25T22:03:41.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276564+0000", 2024-04-25T22:03:41.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018629700000000001 2024-04-25T22:03:41.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:41.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276583+0000", 2024-04-25T22:03:41.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9743000000000001e-05 2024-04-25T22:03:41.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717354+0000", 2024-04-25T22:03:41.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44077094900000002 2024-04-25T22:03:41.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717723+0000", 2024-04-25T22:03:41.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036839099999999998 2024-04-25T22:03:41.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:41.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.718097+0000", 2024-04-25T22:03:41.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037392099999999999 2024-04-25T22:03:41.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720305+0000", 2024-04-25T22:03:41.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022084439999999999 2024-04-25T22:03:41.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721866+0000", 2024-04-25T22:03:41.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015610260000000001 2024-04-25T22:03:41.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721944+0000", 2024-04-25T22:03:41.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7961999999999997e-05 2024-04-25T22:03:41.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.722037+0000", 2024-04-25T22:03:41.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3162e-05 2024-04-25T22:03:41.400 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.400 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.400 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.400 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:10647 4.35 4:ae7b229b:::100000030a9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:41.400 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:41.400 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.808648834, 2024-04-25T22:03:41.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14506126, 2024-04-25T22:03:41.401 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.401 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.401 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.401 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:41.401 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:41.401 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:41.401 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10647 2024-04-25T22:03:41.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.402 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:41.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:41.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529364+0000", 2024-04-25T22:03:41.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.286e-06 2024-04-25T22:03:41.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538917+0000", 2024-04-25T22:03:41.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0095530010000000002 2024-04-25T22:03:41.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538955+0000", 2024-04-25T22:03:41.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:03:41.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538977+0000", 2024-04-25T22:03:41.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.105e-05 2024-04-25T22:03:41.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568092+0000", 2024-04-25T22:03:41.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029115604999999999 2024-04-25T22:03:41.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568243+0000", 2024-04-25T22:03:41.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000151044 2024-04-25T22:03:41.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:41.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568498+0000", 2024-04-25T22:03:41.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025517399999999999 2024-04-25T22:03:41.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628005+0000", 2024-04-25T22:03:41.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059506991000000002 2024-04-25T22:03:41.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674273+0000", 2024-04-25T22:03:41.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.046267233999999997 2024-04-25T22:03:41.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674357+0000", 2024-04-25T22:03:41.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4745000000000003e-05 2024-04-25T22:03:41.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674422+0000", 2024-04-25T22:03:41.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5160999999999995e-05 2024-04-25T22:03:41.408 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.408 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.408 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.408 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3891938~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:41.409 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:41.409 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 16.655329248000001, 2024-04-25T22:03:41.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.144195727, 2024-04-25T22:03:41.409 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.409 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.409 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.409 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:41.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:41.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682682+0000", 2024-04-25T22:03:41.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6000000000000003e-07 2024-04-25T22:03:41.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682686+0000", 2024-04-25T22:03:41.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4630000000000003e-06 2024-04-25T22:03:41.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682695+0000", 2024-04-25T22:03:41.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7360000000000007e-06 2024-04-25T22:03:41.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682702+0000", 2024-04-25T22:03:41.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1239999999999999e-06 2024-04-25T22:03:41.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821515+0000", 2024-04-25T22:03:41.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13881310499999999 2024-04-25T22:03:41.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821780+0000", 2024-04-25T22:03:41.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026492699999999998 2024-04-25T22:03:41.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821974+0000", 2024-04-25T22:03:41.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000194561 2024-04-25T22:03:41.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826533+0000", 2024-04-25T22:03:41.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045586649999999999 2024-04-25T22:03:41.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826574+0000", 2024-04-25T22:03:41.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0995999999999998e-05 2024-04-25T22:03:41.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826754+0000", 2024-04-25T22:03:41.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017955400000000001 2024-04-25T22:03:41.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826877+0000", 2024-04-25T22:03:41.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122836 2024-04-25T22:03:41.414 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.414 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.414 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.414 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3893337~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:41.414 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:41.414 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 16.655299415000002, 2024-04-25T22:03:41.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.146040321, 2024-04-25T22:03:41.414 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.414 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.414 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.415 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:41.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:41.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:41.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:03:41.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682716+0000", 2024-04-25T22:03:41.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3930000000000001e-06 2024-04-25T22:03:41.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682724+0000", 2024-04-25T22:03:41.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5769999999999994e-06 2024-04-25T22:03:41.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682731+0000", 2024-04-25T22:03:41.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1629999999999999e-06 2024-04-25T22:03:41.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823295+0000", 2024-04-25T22:03:41.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14056342099999999 2024-04-25T22:03:41.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823578+0000", 2024-04-25T22:03:41.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028355299999999997 2024-04-25T22:03:41.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823777+0000", 2024-04-25T22:03:41.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000198791 2024-04-25T22:03:41.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826993+0000", 2024-04-25T22:03:41.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032162169999999999 2024-04-25T22:03:41.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828492+0000", 2024-04-25T22:03:41.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001498283 2024-04-25T22:03:41.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828633+0000", 2024-04-25T22:03:41.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000141225 2024-04-25T22:03:41.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828751+0000", 2024-04-25T22:03:41.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000118038 2024-04-25T22:03:41.419 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.419 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.419 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.419 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3899493~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:41.419 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:41.419 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 16.645705401000001, 2024-04-25T22:03:41.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14539154500000001, 2024-04-25T22:03:41.420 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.420 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.420 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.420 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:41.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:41.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692307+0000", 2024-04-25T22:03:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.216e-06 2024-04-25T22:03:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692316+0000", 2024-04-25T22:03:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:03:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692357+0000", 2024-04-25T22:03:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233000000000003e-05 2024-04-25T22:03:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692375+0000", 2024-04-25T22:03:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7949999999999999e-05 2024-04-25T22:03:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828922+0000", 2024-04-25T22:03:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.136546426 2024-04-25T22:03:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.829064+0000", 2024-04-25T22:03:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014193499999999999 2024-04-25T22:03:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.829295+0000", 2024-04-25T22:03:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023144100000000001 2024-04-25T22:03:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832412+0000", 2024-04-25T22:03:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003117112 2024-04-25T22:03:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837543+0000", 2024-04-25T22:03:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005131147 2024-04-25T22:03:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837629+0000", 2024-04-25T22:03:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5378999999999997e-05 2024-04-25T22:03:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837696+0000", 2024-04-25T22:03:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7426000000000001e-05 2024-04-25T22:03:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3901402~4724 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 16.6422031, 2024-04-25T22:03:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14672065500000001, 2024-04-25T22:03:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695809+0000", 2024-04-25T22:03:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1100000000000001e-06 2024-04-25T22:03:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695828+0000", 2024-04-25T22:03:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8618999999999999e-05 2024-04-25T22:03:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695850+0000", 2024-04-25T22:03:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2243e-05 2024-04-25T22:03:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695864+0000", 2024-04-25T22:03:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3687e-05 2024-04-25T22:03:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831024+0000", 2024-04-25T22:03:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13516004300000001 2024-04-25T22:03:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831155+0000", 2024-04-25T22:03:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000131605 2024-04-25T22:03:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831353+0000", 2024-04-25T22:03:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000197708 2024-04-25T22:03:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837521+0000", 2024-04-25T22:03:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0061684180000000002 2024-04-25T22:03:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842269+0000", 2024-04-25T22:03:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047475659999999999 2024-04-25T22:03:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842402+0000", 2024-04-25T22:03:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000132643 2024-04-25T22:03:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842528+0000", 2024-04-25T22:03:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012601299999999999 2024-04-25T22:03:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3906126~6707 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 16.638941342999999, 2024-04-25T22:03:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14563398599999999, 2024-04-25T22:03:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699071+0000", 2024-04-25T22:03:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.996e-06 2024-04-25T22:03:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699090+0000", 2024-04-25T22:03:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9449999999999998e-05 2024-04-25T22:03:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699112+0000", 2024-04-25T22:03:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2306e-05 2024-04-25T22:03:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699126+0000", 2024-04-25T22:03:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.383e-05 2024-04-25T22:03:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832497+0000", 2024-04-25T22:03:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13337096500000001 2024-04-25T22:03:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832632+0000", 2024-04-25T22:03:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013481499999999999 2024-04-25T22:03:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832828+0000", 2024-04-25T22:03:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000195558 2024-04-25T22:03:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837801+0000", 2024-04-25T22:03:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049729459999999998 2024-04-25T22:03:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844398+0000", 2024-04-25T22:03:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065972829999999998 2024-04-25T22:03:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844594+0000", 2024-04-25T22:03:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000195675 2024-04-25T22:03:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844703+0000", 2024-04-25T22:03:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109162 2024-04-25T22:03:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.436 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3024 3.d 3:b02ffd62:::200.00000010:head [write 3912833~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:41.436 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:41.436 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 16.635876620000001, 2024-04-25T22:03:41.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14279916000000001, 2024-04-25T22:03:41.436 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.436 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.436 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.436 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:41.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702135+0000", 2024-04-25T22:03:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9530000000000002e-06 2024-04-25T22:03:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702154+0000", 2024-04-25T22:03:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8496e-05 2024-04-25T22:03:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702180+0000", 2024-04-25T22:03:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6313e-05 2024-04-25T22:03:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702205+0000", 2024-04-25T22:03:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.478e-05 2024-04-25T22:03:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836035+0000", 2024-04-25T22:03:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.133830269 2024-04-25T22:03:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836168+0000", 2024-04-25T22:03:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013234799999999999 2024-04-25T22:03:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836364+0000", 2024-04-25T22:03:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000196398 2024-04-25T22:03:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844793+0000", 2024-04-25T22:03:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.008428685 2024-04-25T22:03:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844811+0000", 2024-04-25T22:03:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8719000000000002e-05 2024-04-25T22:03:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844881+0000", 2024-04-25T22:03:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9671000000000004e-05 2024-04-25T22:03:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844933+0000", 2024-04-25T22:03:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1527999999999999e-05 2024-04-25T22:03:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3026 3.d 3:b02ffd62:::200.00000010:head [write 3919976~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 16.629191681999998, 2024-04-25T22:03:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14237590899999999, 2024-04-25T22:03:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708820+0000", 2024-04-25T22:03:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7600000000000001e-06 2024-04-25T22:03:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708832+0000", 2024-04-25T22:03:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1803e-05 2024-04-25T22:03:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708854+0000", 2024-04-25T22:03:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2467e-05 2024-04-25T22:03:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708872+0000", 2024-04-25T22:03:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7453e-05 2024-04-25T22:03:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842641+0000", 2024-04-25T22:03:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13376964099999999 2024-04-25T22:03:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842832+0000", 2024-04-25T22:03:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000190843 2024-04-25T22:03:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.843194+0000", 2024-04-25T22:03:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036169300000000001 2024-04-25T22:03:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845406+0000", 2024-04-25T22:03:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022118530000000002 2024-04-25T22:03:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851048+0000", 2024-04-25T22:03:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056423410000000004 2024-04-25T22:03:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851127+0000", 2024-04-25T22:03:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8461999999999995e-05 2024-04-25T22:03:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851194+0000", 2024-04-25T22:03:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7593000000000001e-05 2024-04-25T22:03:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3027 3.d 3:b02ffd62:::200.00000010:head [write 3922740~2927 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 16.629086402999999, 2024-04-25T22:03:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14516088799999999, 2024-04-25T22:03:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708925+0000", 2024-04-25T22:03:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.683e-06 2024-04-25T22:03:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708936+0000", 2024-04-25T22:03:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.11e-05 2024-04-25T22:03:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708960+0000", 2024-04-25T22:03:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3839999999999999e-05 2024-04-25T22:03:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708977+0000", 2024-04-25T22:03:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6379e-05 2024-04-25T22:03:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845488+0000", 2024-04-25T22:03:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.136511414 2024-04-25T22:03:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845619+0000", 2024-04-25T22:03:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000130755 2024-04-25T22:03:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845817+0000", 2024-04-25T22:03:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000198271 2024-04-25T22:03:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849529+0000", 2024-04-25T22:03:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003711888 2024-04-25T22:03:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.853911+0000", 2024-04-25T22:03:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043815800000000004 2024-04-25T22:03:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854018+0000", 2024-04-25T22:03:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000107879 2024-04-25T22:03:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854085+0000", 2024-04-25T22:03:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6099000000000005e-05 2024-04-25T22:03:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3028 3.d 3:b02ffd62:::200.00000010:head [write 3925667~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 16.628565858999998, 2024-04-25T22:03:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14478423600000001, 2024-04-25T22:03:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709446+0000", 2024-04-25T22:03:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.73e-06 2024-04-25T22:03:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709454+0000", 2024-04-25T22:03:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:03:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709470+0000", 2024-04-25T22:03:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5956000000000001e-05 2024-04-25T22:03:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709483+0000", 2024-04-25T22:03:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.216e-05 2024-04-25T22:03:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.846891+0000", 2024-04-25T22:03:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13740814600000001 2024-04-25T22:03:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.847019+0000", 2024-04-25T22:03:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000128121 2024-04-25T22:03:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.847227+0000", 2024-04-25T22:03:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020847800000000001 2024-04-25T22:03:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.852488+0000", 2024-04-25T22:03:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052603759999999998 2024-04-25T22:03:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854101+0000", 2024-04-25T22:03:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001613354 2024-04-25T22:03:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854170+0000", 2024-04-25T22:03:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8935000000000003e-05 2024-04-25T22:03:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854228+0000", 2024-04-25T22:03:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8437000000000003e-05 2024-04-25T22:03:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3029 3.d 3:b02ffd62:::200.00000010:head [write 3927576~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 16.628487997000001, 2024-04-25T22:03:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14641235599999999, 2024-04-25T22:03:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709523+0000", 2024-04-25T22:03:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9999999999999995e-07 2024-04-25T22:03:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709530+0000", 2024-04-25T22:03:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7900000000000002e-06 2024-04-25T22:03:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709545+0000", 2024-04-25T22:03:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5563e-05 2024-04-25T22:03:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709554+0000", 2024-04-25T22:03:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7700000000000007e-06 2024-04-25T22:03:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848071+0000", 2024-04-25T22:03:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13851706499999999 2024-04-25T22:03:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848219+0000", 2024-04-25T22:03:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014761599999999999 2024-04-25T22:03:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848412+0000", 2024-04-25T22:03:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019303300000000001 2024-04-25T22:03:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854240+0000", 2024-04-25T22:03:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058282359999999997 2024-04-25T22:03:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855804+0000", 2024-04-25T22:03:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001563938 2024-04-25T22:03:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855879+0000", 2024-04-25T22:03:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4683000000000003e-05 2024-04-25T22:03:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855934+0000", 2024-04-25T22:03:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5661999999999997e-05 2024-04-25T22:03:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3030 3.d 3:b02ffd62:::200.00000010:head [write 3929994~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 16.627069588000001, 2024-04-25T22:03:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.146870588, 2024-04-25T22:03:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710942+0000", 2024-04-25T22:03:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.024e-06 2024-04-25T22:03:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710955+0000", 2024-04-25T22:03:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2103000000000001e-05 2024-04-25T22:03:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710977+0000", 2024-04-25T22:03:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2606e-05 2024-04-25T22:03:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710991+0000", 2024-04-25T22:03:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3689999999999999e-05 2024-04-25T22:03:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849638+0000", 2024-04-25T22:03:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.138646667 2024-04-25T22:03:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849809+0000", 2024-04-25T22:03:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000171495 2024-04-25T22:03:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.850048+0000", 2024-04-25T22:03:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023940699999999999 2024-04-25T22:03:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855954+0000", 2024-04-25T22:03:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059050919999999998 2024-04-25T22:03:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857670+0000", 2024-04-25T22:03:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017168489999999999 2024-04-25T22:03:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857747+0000", 2024-04-25T22:03:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6526000000000006e-05 2024-04-25T22:03:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857811+0000", 2024-04-25T22:03:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4128999999999995e-05 2024-04-25T22:03:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3031 3.d 3:b02ffd62:::200.00000010:head [write 3932758~2245 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 16.626859140000001, 2024-04-25T22:03:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14694558999999999, 2024-04-25T22:03:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711152+0000", 2024-04-25T22:03:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5230000000000001e-06 2024-04-25T22:03:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711162+0000", 2024-04-25T22:03:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2299999999999997e-06 2024-04-25T22:03:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711179+0000", 2024-04-25T22:03:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7220000000000001e-05 2024-04-25T22:03:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711190+0000", 2024-04-25T22:03:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1323e-05 2024-04-25T22:03:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851296+0000", 2024-04-25T22:03:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14010541600000001 2024-04-25T22:03:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851436+0000", 2024-04-25T22:03:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140409 2024-04-25T22:03:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851641+0000", 2024-04-25T22:03:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020471700000000001 2024-04-25T22:03:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857847+0000", 2024-04-25T22:03:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062065310000000004 2024-04-25T22:03:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857952+0000", 2024-04-25T22:03:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105132 2024-04-25T22:03:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.858026+0000", 2024-04-25T22:03:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3799000000000003e-05 2024-04-25T22:03:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.858096+0000", 2024-04-25T22:03:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0290000000000006e-05 2024-04-25T22:03:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:41.484 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:41.485 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:41.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:41.480+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:41.586 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:41.584+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:41.618 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:41.619 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:41.619 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:03:41.619 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:41.633 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:41.687 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:41.684+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:41.759 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:41.759 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:41.759 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:03:41.759 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:03:41.759 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:41.773 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:41.787 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:41.784+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:41.888 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:41.884+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:41.908 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:03:41.938 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 49.850614055999998, 2024-04-25T22:03:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 49.840613292999997, 2024-04-25T22:03:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 49.836449019, 2024-04-25T22:03:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 49.834852701999999, 2024-04-25T22:03:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 49.778066451999997, 2024-04-25T22:03:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:41.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:41.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 49.762422186000002, 2024-04-25T22:03:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 49.757583494999999, 2024-04-25T22:03:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10648 4.33 4:cc614d18:::100000030cb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.398980183999999, 2024-04-25T22:03:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13001143300000001, 2024-04-25T22:03:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10648 2024-04-25T22:03:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537181+0000", 2024-04-25T22:03:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.782e-06 2024-04-25T22:03:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541681+0000", 2024-04-25T22:03:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045008460000000002 2024-04-25T22:03:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541692+0000", 2024-04-25T22:03:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0726e-05 2024-04-25T22:03:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541698+0000", 2024-04-25T22:03:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-04-25T22:03:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541771+0000", 2024-04-25T22:03:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3070000000000003e-05 2024-04-25T22:03:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542021+0000", 2024-04-25T22:03:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025059799999999999 2024-04-25T22:03:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542246+0000", 2024-04-25T22:03:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022471000000000001 2024-04-25T22:03:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.579359+0000", 2024-04-25T22:03:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037113211 2024-04-25T22:03:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667067+0000", 2024-04-25T22:03:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087707255999999997 2024-04-25T22:03:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667134+0000", 2024-04-25T22:03:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7862999999999997e-05 2024-04-25T22:03:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667190+0000", 2024-04-25T22:03:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5698000000000001e-05 2024-04-25T22:03:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10651 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.339204406, 2024-04-25T22:03:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11324606800000001, 2024-04-25T22:03:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10651 2024-04-25T22:03:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596957+0000", 2024-04-25T22:03:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-04-25T22:03:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601272+0000", 2024-04-25T22:03:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004314834 2024-04-25T22:03:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601291+0000", 2024-04-25T22:03:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9380000000000001e-05 2024-04-25T22:03:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601302+0000", 2024-04-25T22:03:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0416e-05 2024-04-25T22:03:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.603978+0000", 2024-04-25T22:03:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026763109999999998 2024-04-25T22:03:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604327+0000", 2024-04-25T22:03:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034881099999999998 2024-04-25T22:03:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604571+0000", 2024-04-25T22:03:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024436100000000001 2024-04-25T22:03:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644439+0000", 2024-04-25T22:03:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039868270999999997 2024-04-25T22:03:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710091+0000", 2024-04-25T22:03:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.065651910999999993 2024-04-25T22:03:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710144+0000", 2024-04-25T22:03:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2444999999999997e-05 2024-04-25T22:03:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710201+0000", 2024-04-25T22:03:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6839999999999998e-05 2024-04-25T22:03:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10654 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.329377543, 2024-04-25T22:03:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.103958778, 2024-04-25T22:03:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10654 2024-04-25T22:03:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606782+0000", 2024-04-25T22:03:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1699999999999999e-07 2024-04-25T22:03:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611155+0000", 2024-04-25T22:03:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043728580000000003 2024-04-25T22:03:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611173+0000", 2024-04-25T22:03:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8267e-05 2024-04-25T22:03:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611183+0000", 2024-04-25T22:03:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9250000000000007e-06 2024-04-25T22:03:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644642+0000", 2024-04-25T22:03:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033458976000000001 2024-04-25T22:03:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644739+0000", 2024-04-25T22:03:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7189999999999996e-05 2024-04-25T22:03:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644864+0000", 2024-04-25T22:03:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000124867 2024-04-25T22:03:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.672556+0000", 2024-04-25T22:03:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027691653 2024-04-25T22:03:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710668+0000", 2024-04-25T22:03:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038111956000000002 2024-04-25T22:03:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710703+0000", 2024-04-25T22:03:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5577000000000002e-05 2024-04-25T22:03:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710740+0000", 2024-04-25T22:03:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7092000000000003e-05 2024-04-25T22:03:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11078 4.4 4:22be2a9e:::10000003224.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.932250922000001, 2024-04-25T22:03:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.112294177, 2024-04-25T22:03:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11078 2024-04-25T22:03:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003909+0000", 2024-04-25T22:03:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2750000000000001e-06 2024-04-25T22:03:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009939+0000", 2024-04-25T22:03:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060293309999999998 2024-04-25T22:03:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009961+0000", 2024-04-25T22:03:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1889999999999999e-05 2024-04-25T22:03:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009976+0000", 2024-04-25T22:03:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5642e-05 2024-04-25T22:03:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042803+0000", 2024-04-25T22:03:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032827299999999997 2024-04-25T22:03:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042911+0000", 2024-04-25T22:03:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107747 2024-04-25T22:03:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042990+0000", 2024-04-25T22:03:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8832999999999996e-05 2024-04-25T22:03:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.088710+0000", 2024-04-25T22:03:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045720129999999998 2024-04-25T22:03:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116108+0000", 2024-04-25T22:03:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027397388000000002 2024-04-25T22:03:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116164+0000", 2024-04-25T22:03:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6283000000000003e-05 2024-04-25T22:03:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116202+0000", 2024-04-25T22:03:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8358000000000001e-05 2024-04-25T22:03:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11195 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.718888804999999, 2024-04-25T22:03:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1095062, 2024-04-25T22:03:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11195 2024-04-25T22:03:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217272+0000", 2024-04-25T22:03:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.533e-06 2024-04-25T22:03:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217385+0000", 2024-04-25T22:03:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113533 2024-04-25T22:03:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217396+0000", 2024-04-25T22:03:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0682e-05 2024-04-25T22:03:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217402+0000", 2024-04-25T22:03:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:03:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238476+0000", 2024-04-25T22:03:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021073312 2024-04-25T22:03:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238558+0000", 2024-04-25T22:03:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2193000000000004e-05 2024-04-25T22:03:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238695+0000", 2024-04-25T22:03:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013737800000000001 2024-04-25T22:03:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292860+0000", 2024-04-25T22:03:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054165224999999997 2024-04-25T22:03:42.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326638+0000", 2024-04-25T22:03:42.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033777517999999999 2024-04-25T22:03:42.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:42.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326686+0000", 2024-04-25T22:03:42.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8062000000000002e-05 2024-04-25T22:03:42.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:42.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326776+0000", 2024-04-25T22:03:42.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0393e-05 2024-04-25T22:03:42.013 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.014 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:42.014 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.014 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11197 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3195543~33670] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:42.014 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:42.014 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.718746821, 2024-04-25T22:03:42.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953929499999999, 2024-04-25T22:03:42.014 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:42.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:42.014 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.014 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:42.014 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:42.014 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:42.015 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11197 2024-04-25T22:03:42.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.015 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:42.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:42.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:42.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:42.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:42.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:42.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217413+0000", 2024-04-25T22:03:42.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5600000000000005e-07 2024-04-25T22:03:42.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:42.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217445+0000", 2024-04-25T22:03:42.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2240999999999998e-05 2024-04-25T22:03:42.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:42.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217453+0000", 2024-04-25T22:03:42.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6070000000000002e-06 2024-04-25T22:03:42.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217458+0000", 2024-04-25T22:03:42.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3630000000000002e-06 2024-04-25T22:03:42.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:42.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240891+0000", 2024-04-25T22:03:42.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023432637999999999 2024-04-25T22:03:42.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:42.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240990+0000", 2024-04-25T22:03:42.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8995999999999999e-05 2024-04-25T22:03:42.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:42.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241123+0000", 2024-04-25T22:03:42.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013371699999999999 2024-04-25T22:03:42.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:42.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292866+0000", 2024-04-25T22:03:42.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051742332000000002 2024-04-25T22:03:42.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326849+0000", 2024-04-25T22:03:42.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033983140000000002 2024-04-25T22:03:42.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:42.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326908+0000", 2024-04-25T22:03:42.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8842999999999999e-05 2024-04-25T22:03:42.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:42.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326951+0000", 2024-04-25T22:03:42.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3761999999999999e-05 2024-04-25T22:03:42.019 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.019 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:42.019 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.019 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11198 4.4 4:22c4fea3:::10000003262.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:42.019 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:42.019 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.718692462, 2024-04-25T22:03:42.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12381273600000001, 2024-04-25T22:03:42.020 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:42.020 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:42.020 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.020 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:42.020 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:42.020 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:42.020 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11198 2024-04-25T22:03:42.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.020 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:42.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:42.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:42.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:42.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:42.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:42.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217467+0000", 2024-04-25T22:03:42.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4499999999999997e-07 2024-04-25T22:03:42.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:42.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225449+0000", 2024-04-25T22:03:42.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079819439999999995 2024-04-25T22:03:42.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:42.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225466+0000", 2024-04-25T22:03:42.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6602000000000001e-05 2024-04-25T22:03:42.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225477+0000", 2024-04-25T22:03:42.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1603000000000001e-05 2024-04-25T22:03:42.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:42.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240866+0000", 2024-04-25T22:03:42.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015388389000000001 2024-04-25T22:03:42.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:42.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241081+0000", 2024-04-25T22:03:42.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021577400000000001 2024-04-25T22:03:42.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:42.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241212+0000", 2024-04-25T22:03:42.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013073499999999999 2024-04-25T22:03:42.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:42.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292876+0000", 2024-04-25T22:03:42.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051663584999999998 2024-04-25T22:03:42.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341159+0000", 2024-04-25T22:03:42.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048283421999999999 2024-04-25T22:03:42.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:42.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341222+0000", 2024-04-25T22:03:42.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:03:42.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:42.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341279+0000", 2024-04-25T22:03:42.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6780999999999997e-05 2024-04-25T22:03:42.024 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.025 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:42.025 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.025 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11207 4.4 4:233f6309:::10000003211.00000000:head [write 659836~128648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:42.025 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:42.025 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.702074464999999, 2024-04-25T22:03:42.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10732727, 2024-04-25T22:03:42.025 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:42.025 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:42.025 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.025 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:42.025 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:42.025 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:42.026 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11207 2024-04-25T22:03:42.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.026 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:42.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:42.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:42.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:42.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:42.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:42.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234085+0000", 2024-04-25T22:03:42.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0399999999999995e-07 2024-04-25T22:03:42.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:42.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234550+0000", 2024-04-25T22:03:42.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000464909 2024-04-25T22:03:42.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:42.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234561+0000", 2024-04-25T22:03:42.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0744000000000001e-05 2024-04-25T22:03:42.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234569+0000", 2024-04-25T22:03:42.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6890000000000004e-06 2024-04-25T22:03:42.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:42.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267197+0000", 2024-04-25T22:03:42.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032628182999999998 2024-04-25T22:03:42.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:42.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267297+0000", 2024-04-25T22:03:42.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100222 2024-04-25T22:03:42.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:42.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267393+0000", 2024-04-25T22:03:42.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6275999999999998e-05 2024-04-25T22:03:42.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:42.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292880+0000", 2024-04-25T22:03:42.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025487058999999999 2024-04-25T22:03:42.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341326+0000", 2024-04-25T22:03:42.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048446031000000001 2024-04-25T22:03:42.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:42.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341374+0000", 2024-04-25T22:03:42.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7632000000000001e-05 2024-04-25T22:03:42.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:42.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341412+0000", 2024-04-25T22:03:42.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7821000000000003e-05 2024-04-25T22:03:42.030 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.030 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:42.030 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.031 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11219 4.4 4:210cd53e:::100000031ff.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:42.031 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:42.031 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.683125255, 2024-04-25T22:03:42.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13181403, 2024-04-25T22:03:42.031 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:42.031 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:42.031 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:42.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:42.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:42.031 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11219 2024-04-25T22:03:42.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.031 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:42.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:42.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:42.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:42.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:42.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:42.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253035+0000", 2024-04-25T22:03:42.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.322e-06 2024-04-25T22:03:42.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:42.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258145+0000", 2024-04-25T22:03:42.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051095669999999998 2024-04-25T22:03:42.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:42.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258163+0000", 2024-04-25T22:03:42.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8377999999999999e-05 2024-04-25T22:03:42.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258174+0000", 2024-04-25T22:03:42.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0925e-05 2024-04-25T22:03:42.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:42.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270495+0000", 2024-04-25T22:03:42.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012321354 2024-04-25T22:03:42.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:42.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270581+0000", 2024-04-25T22:03:42.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5741999999999993e-05 2024-04-25T22:03:42.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:42.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270717+0000", 2024-04-25T22:03:42.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013571500000000001 2024-04-25T22:03:42.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:42.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326599+0000", 2024-04-25T22:03:42.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055882026000000001 2024-04-25T22:03:42.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384753+0000", 2024-04-25T22:03:42.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058154527999999997 2024-04-25T22:03:42.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:42.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384805+0000", 2024-04-25T22:03:42.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1592999999999999e-05 2024-04-25T22:03:42.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:42.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384848+0000", 2024-04-25T22:03:42.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2880000000000003e-05 2024-04-25T22:03:42.036 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.036 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:42.036 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.036 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11868 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:42.036 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:42.036 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.724161430999999, 2024-04-25T22:03:42.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12149908700000001, 2024-04-25T22:03:42.036 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:42.036 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:42.036 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.036 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:42.037 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:42.037 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:42.037 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11868 2024-04-25T22:03:42.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.037 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:42.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:42.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:42.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:42.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:42.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:42.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211999+0000", 2024-04-25T22:03:42.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:03:42.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:42.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219614+0000", 2024-04-25T22:03:42.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076153490000000004 2024-04-25T22:03:42.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:42.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219628+0000", 2024-04-25T22:03:42.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3597e-05 2024-04-25T22:03:42.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219635+0000", 2024-04-25T22:03:42.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7759999999999997e-06 2024-04-25T22:03:42.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:42.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229908+0000", 2024-04-25T22:03:42.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010272478 2024-04-25T22:03:42.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:42.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229966+0000", 2024-04-25T22:03:42.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8495000000000002e-05 2024-04-25T22:03:42.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:42.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.230082+0000", 2024-04-25T22:03:42.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011560799999999999 2024-04-25T22:03:42.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:42.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257530+0000", 2024-04-25T22:03:42.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027448034999999999 2024-04-25T22:03:42.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333408+0000", 2024-04-25T22:03:42.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075878105000000001 2024-04-25T22:03:42.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:42.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333457+0000", 2024-04-25T22:03:42.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8757000000000001e-05 2024-04-25T22:03:42.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:42.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333497+0000", 2024-04-25T22:03:42.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9721000000000001e-05 2024-04-25T22:03:42.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.041 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:42.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.042 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11870 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 4063232~131072] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:42.042 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:42.042 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.716507076999999, 2024-04-25T22:03:42.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.114017408, 2024-04-25T22:03:42.042 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:42.042 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:42.042 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.042 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:42.042 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:42.042 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:42.042 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11870 2024-04-25T22:03:42.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.043 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:42.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:42.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:42.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:42.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:42.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:42.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219653+0000", 2024-04-25T22:03:42.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6139999999999999e-06 2024-04-25T22:03:42.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:42.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219722+0000", 2024-04-25T22:03:42.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8460000000000005e-05 2024-04-25T22:03:42.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:42.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219730+0000", 2024-04-25T22:03:42.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3420000000000008e-06 2024-04-25T22:03:42.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219736+0000", 2024-04-25T22:03:42.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9619999999999998e-06 2024-04-25T22:03:42.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:42.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247743+0000", 2024-04-25T22:03:42.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028006400000000001 2024-04-25T22:03:42.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:42.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247847+0000", 2024-04-25T22:03:42.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104017 2024-04-25T22:03:42.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:42.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247984+0000", 2024-04-25T22:03:42.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013701800000000001 2024-04-25T22:03:42.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:42.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257536+0000", 2024-04-25T22:03:42.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095520050000000006 2024-04-25T22:03:42.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333565+0000", 2024-04-25T22:03:42.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076029154000000002 2024-04-25T22:03:42.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:42.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333628+0000", 2024-04-25T22:03:42.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2853000000000003e-05 2024-04-25T22:03:42.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:42.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333669+0000", 2024-04-25T22:03:42.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1582999999999998e-05 2024-04-25T22:03:42.047 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.047 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:42.047 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.048 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11871 4.37 4:ee924968:::10000003393.00000000:head [write 2359296~1835008] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:42.048 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:42.048 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.716414145000002, 2024-04-25T22:03:42.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.113885236, 2024-04-25T22:03:42.048 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:42.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:42.048 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.048 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:42.048 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:42.048 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:42.048 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11871 2024-04-25T22:03:42.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.048 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:42.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:42.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:42.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:42.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:42.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:42.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:42.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6100000000000001e-07 2024-04-25T22:03:42.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:42.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222469+0000", 2024-04-25T22:03:42.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027240060000000002 2024-04-25T22:03:42.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:42.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222482+0000", 2024-04-25T22:03:42.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3049e-05 2024-04-25T22:03:42.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222492+0000", 2024-04-25T22:03:42.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8020000000000003e-06 2024-04-25T22:03:42.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:42.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247903+0000", 2024-04-25T22:03:42.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025410578999999999 2024-04-25T22:03:42.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:42.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247962+0000", 2024-04-25T22:03:42.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9363000000000001e-05 2024-04-25T22:03:42.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:42.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.248049+0000", 2024-04-25T22:03:42.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6803000000000002e-05 2024-04-25T22:03:42.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:42.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257915+0000", 2024-04-25T22:03:42.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0098655730000000007 2024-04-25T22:03:42.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333544+0000", 2024-04-25T22:03:42.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075629030999999999 2024-04-25T22:03:42.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:42.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333594+0000", 2024-04-25T22:03:42.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0291999999999999e-05 2024-04-25T22:03:42.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:42.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333630+0000", 2024-04-25T22:03:42.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6177000000000003e-05 2024-04-25T22:03:42.053 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.053 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:42.053 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.054 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:15375 4.4 4:211dd80e:::10000003351.00000000:head [write 0~4194304 [2@1354921]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:42.054 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:42.054 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.799084752999999, 2024-04-25T22:03:42.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953555500000001, 2024-04-25T22:03:42.054 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:42.054 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:42.054 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.054 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:42.054 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:42.054 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:42.054 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-04-25T22:03:42.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.055 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:42.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:42.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:42.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:42.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:42.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:42.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:42.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137076+0000", 2024-04-25T22:03:42.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.683e-06 2024-04-25T22:03:42.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:42.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142168+0000", 2024-04-25T22:03:42.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050917280000000002 2024-04-25T22:03:42.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:42.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142192+0000", 2024-04-25T22:03:42.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:03:42.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142206+0000", 2024-04-25T22:03:42.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.396e-05 2024-04-25T22:03:42.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:42.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142280+0000", 2024-04-25T22:03:42.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4369000000000006e-05 2024-04-25T22:03:42.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:42.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142346+0000", 2024-04-25T22:03:42.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5957000000000006e-05 2024-04-25T22:03:42.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:42.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142440+0000", 2024-04-25T22:03:42.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3888999999999995e-05 2024-04-25T22:03:42.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.208451+0000", 2024-04-25T22:03:42.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066011350999999996 2024-04-25T22:03:42.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:42.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246473+0000", 2024-04-25T22:03:42.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038021428000000003 2024-04-25T22:03:42.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:42.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246530+0000", 2024-04-25T22:03:42.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7466000000000002e-05 2024-04-25T22:03:42.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:42.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:42.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:42.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246610+0000", 2024-04-25T22:03:42.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9484e-05 2024-04-25T22:03:42.059 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.059 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:42.059 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.059 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:42.059 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:42.059 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:42.061 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:42.062 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:42.060+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:42.162 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:42.160+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:42.192 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:42.193 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:42.193 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:03:42.193 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:42.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:42.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:42.260+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:42.364 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:42.360+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:42.376 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:42.376 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:42.376 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:03:42.377 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:03:42.377 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:42.390 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:42.465 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:42.464+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:42.511 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:42.511 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:03:42.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:03:42.511 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:42.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.511 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7039 4.8 4:1138358d:::100000013f3.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.511 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:42.511 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6741790650000006, 2024-04-25T22:03:42.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.034656746, 2024-04-25T22:03:42.511 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831791+0000", 2024-04-25T22:03:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6359999999999998e-06 2024-04-25T22:03:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831801+0000", 2024-04-25T22:03:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0567000000000001e-05 2024-04-25T22:03:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831824+0000", 2024-04-25T22:03:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:03:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831839+0000", 2024-04-25T22:03:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5345999999999998e-05 2024-04-25T22:03:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832028+0000", 2024-04-25T22:03:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018899800000000001 2024-04-25T22:03:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832043+0000", 2024-04-25T22:03:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4805e-05 2024-04-25T22:03:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836259+0000", 2024-04-25T22:03:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042161819999999997 2024-04-25T22:03:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836422+0000", 2024-04-25T22:03:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000162404 2024-04-25T22:03:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.865428+0000", 2024-04-25T22:03:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0290065770000001 2024-04-25T22:03:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866445+0000", 2024-04-25T22:03:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001016561 2024-04-25T22:03:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7040 4.8 4:121f992c:::100000013f4.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6740901420000007, 2024-04-25T22:03:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0348302300000001, 2024-04-25T22:03:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831878+0000", 2024-04-25T22:03:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3659999999999999e-06 2024-04-25T22:03:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831885+0000", 2024-04-25T22:03:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7139999999999996e-06 2024-04-25T22:03:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831901+0000", 2024-04-25T22:03:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5982999999999999e-05 2024-04-25T22:03:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831910+0000", 2024-04-25T22:03:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7530000000000007e-06 2024-04-25T22:03:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832133+0000", 2024-04-25T22:03:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022307199999999999 2024-04-25T22:03:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832141+0000", 2024-04-25T22:03:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0080000000000002e-06 2024-04-25T22:03:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836611+0000", 2024-04-25T22:03:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044698389999999998 2024-04-25T22:03:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836629+0000", 2024-04-25T22:03:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8397e-05 2024-04-25T22:03:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866532+0000", 2024-04-25T22:03:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0299026200000001 2024-04-25T22:03:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866707+0000", 2024-04-25T22:03:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017547799999999999 2024-04-25T22:03:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7051 4.36 4:6e19a085:::100000013ff.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6740373630000001, 2024-04-25T22:03:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.032211298, 2024-04-25T22:03:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831931+0000", 2024-04-25T22:03:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.19e-06 2024-04-25T22:03:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831936+0000", 2024-04-25T22:03:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2059999999999998e-06 2024-04-25T22:03:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831950+0000", 2024-04-25T22:03:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3424000000000001e-05 2024-04-25T22:03:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831958+0000", 2024-04-25T22:03:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1659999999999994e-06 2024-04-25T22:03:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832033+0000", 2024-04-25T22:03:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4977999999999999e-05 2024-04-25T22:03:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832043+0000", 2024-04-25T22:03:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0268999999999999e-05 2024-04-25T22:03:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841105+0000", 2024-04-25T22:03:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090619829999999991 2024-04-25T22:03:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841118+0000", 2024-04-25T22:03:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2737e-05 2024-04-25T22:03:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.863240+0000", 2024-04-25T22:03:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0221224259999999 2024-04-25T22:03:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.864141+0000", 2024-04-25T22:03:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090091900000000003 2024-04-25T22:03:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7059 4.22 4:47c8979f:::10000001407.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.673986223, 2024-04-25T22:03:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0438401859999999, 2024-04-25T22:03:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831982+0000", 2024-04-25T22:03:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1030000000000001e-06 2024-04-25T22:03:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831987+0000", 2024-04-25T22:03:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-04-25T22:03:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832007+0000", 2024-04-25T22:03:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0126999999999999e-05 2024-04-25T22:03:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832022+0000", 2024-04-25T22:03:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4878999999999999e-05 2024-04-25T22:03:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832082+0000", 2024-04-25T22:03:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9552999999999997e-05 2024-04-25T22:03:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832088+0000", 2024-04-25T22:03:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9320000000000001e-06 2024-04-25T22:03:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836708+0000", 2024-04-25T22:03:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046199240000000001 2024-04-25T22:03:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836717+0000", 2024-04-25T22:03:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1840000000000005e-06 2024-04-25T22:03:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875475+0000", 2024-04-25T22:03:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0387584439999999 2024-04-25T22:03:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875821+0000", 2024-04-25T22:03:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00034578700000000001 2024-04-25T22:03:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7063 4.2 4:4331e060:::100000014df.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6739234340000007, 2024-04-25T22:03:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.047605189, 2024-04-25T22:03:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832045+0000", 2024-04-25T22:03:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:03:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832088+0000", 2024-04-25T22:03:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2483e-05 2024-04-25T22:03:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832100+0000", 2024-04-25T22:03:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2713e-05 2024-04-25T22:03:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832111+0000", 2024-04-25T22:03:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0457e-05 2024-04-25T22:03:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832155+0000", 2024-04-25T22:03:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4468999999999997e-05 2024-04-25T22:03:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832161+0000", 2024-04-25T22:03:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3369999999999999e-06 2024-04-25T22:03:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836779+0000", 2024-04-25T22:03:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046185030000000004 2024-04-25T22:03:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836787+0000", 2024-04-25T22:03:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5820000000000004e-06 2024-04-25T22:03:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.868721+0000", 2024-04-25T22:03:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0319339300000001 2024-04-25T22:03:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869179+0000", 2024-04-25T22:03:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000457916 2024-04-25T22:03:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869486+0000", 2024-04-25T22:03:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030764099999999999 2024-04-25T22:03:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879230+0000", 2024-04-25T22:03:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097433620000000002 2024-04-25T22:03:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879288+0000", 2024-04-25T22:03:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8813000000000001e-05 2024-04-25T22:03:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879542+0000", 2024-04-25T22:03:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025326999999999999 2024-04-25T22:03:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879649+0000", 2024-04-25T22:03:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107173 2024-04-25T22:03:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7068 4.33 4:cf543130:::100000014e4.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6738377419999999, 2024-04-25T22:03:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.044127671, 2024-04-25T22:03:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832131+0000", 2024-04-25T22:03:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:03:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832137+0000", 2024-04-25T22:03:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9859999999999999e-06 2024-04-25T22:03:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832155+0000", 2024-04-25T22:03:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8090000000000001e-05 2024-04-25T22:03:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832166+0000", 2024-04-25T22:03:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1776999999999999e-05 2024-04-25T22:03:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832235+0000", 2024-04-25T22:03:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8614000000000004e-05 2024-04-25T22:03:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832243+0000", 2024-04-25T22:03:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2719999999999997e-06 2024-04-25T22:03:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.834656+0000", 2024-04-25T22:03:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024123489999999998 2024-04-25T22:03:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.834666+0000", 2024-04-25T22:03:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8819999999999996e-06 2024-04-25T22:03:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.860770+0000", 2024-04-25T22:03:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.026104414 2024-04-25T22:03:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861849+0000", 2024-04-25T22:03:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010794559999999999 2024-04-25T22:03:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.865487+0000", 2024-04-25T22:03:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036373270000000001 2024-04-25T22:03:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869323+0000", 2024-04-25T22:03:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038362259999999999 2024-04-25T22:03:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876012+0000", 2024-04-25T22:03:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066894290000000002 2024-04-25T22:03:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876154+0000", 2024-04-25T22:03:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000141963 2024-04-25T22:03:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876257+0000", 2024-04-25T22:03:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102662 2024-04-25T22:03:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7069 4.36 4:6d2d0624:::100000014e5.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6737849849999993, 2024-04-25T22:03:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0457444709999999, 2024-04-25T22:03:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832183+0000", 2024-04-25T22:03:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1459999999999999e-06 2024-04-25T22:03:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832189+0000", 2024-04-25T22:03:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.614e-06 2024-04-25T22:03:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832206+0000", 2024-04-25T22:03:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.683e-05 2024-04-25T22:03:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832218+0000", 2024-04-25T22:03:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2266000000000001e-05 2024-04-25T22:03:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832265+0000", 2024-04-25T22:03:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7138999999999997e-05 2024-04-25T22:03:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832271+0000", 2024-04-25T22:03:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4280000000000004e-06 2024-04-25T22:03:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841149+0000", 2024-04-25T22:03:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088781429999999998 2024-04-25T22:03:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841158+0000", 2024-04-25T22:03:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7359999999999996e-06 2024-04-25T22:03:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867956+0000", 2024-04-25T22:03:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0267976969999999 2024-04-25T22:03:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.868991+0000", 2024-04-25T22:03:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010344810000000001 2024-04-25T22:03:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869248+0000", 2024-04-25T22:03:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025746699999999999 2024-04-25T22:03:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872721+0000", 2024-04-25T22:03:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034729959999999999 2024-04-25T22:03:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877064+0000", 2024-04-25T22:03:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043432770000000004 2024-04-25T22:03:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877767+0000", 2024-04-25T22:03:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070237700000000001 2024-04-25T22:03:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877927+0000", 2024-04-25T22:03:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015987400000000001 2024-04-25T22:03:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7071 4.22 4:45120e82:::100000014e7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6737315459999991, 2024-04-25T22:03:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.050578969, 2024-04-25T22:03:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832237+0000", 2024-04-25T22:03:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.003e-06 2024-04-25T22:03:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832243+0000", 2024-04-25T22:03:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-04-25T22:03:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832263+0000", 2024-04-25T22:03:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0066999999999999e-05 2024-04-25T22:03:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832293+0000", 2024-04-25T22:03:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9802999999999999e-05 2024-04-25T22:03:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832416+0000", 2024-04-25T22:03:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123566 2024-04-25T22:03:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832438+0000", 2024-04-25T22:03:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1433e-05 2024-04-25T22:03:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836745+0000", 2024-04-25T22:03:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043070260000000003 2024-04-25T22:03:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836752+0000", 2024-04-25T22:03:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2060000000000001e-06 2024-04-25T22:03:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875897+0000", 2024-04-25T22:03:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0391448489999999 2024-04-25T22:03:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876238+0000", 2024-04-25T22:03:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00034159400000000002 2024-04-25T22:03:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876491+0000", 2024-04-25T22:03:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025221500000000002 2024-04-25T22:03:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881289+0000", 2024-04-25T22:03:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047986510000000001 2024-04-25T22:03:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882627+0000", 2024-04-25T22:03:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013376340000000001 2024-04-25T22:03:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882707+0000", 2024-04-25T22:03:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0037000000000006e-05 2024-04-25T22:03:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882815+0000", 2024-04-25T22:03:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107645 2024-04-25T22:03:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7073 4.14 4:2af683fb:::100000014e9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6736509529999992, 2024-04-25T22:03:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.043944475, 2024-04-25T22:03:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832318+0000", 2024-04-25T22:03:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:03:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832323+0000", 2024-04-25T22:03:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6099999999999997e-06 2024-04-25T22:03:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832345+0000", 2024-04-25T22:03:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1353e-05 2024-04-25T22:03:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832390+0000", 2024-04-25T22:03:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5543000000000001e-05 2024-04-25T22:03:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832469+0000", 2024-04-25T22:03:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8770999999999995e-05 2024-04-25T22:03:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832475+0000", 2024-04-25T22:03:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0970000000000002e-06 2024-04-25T22:03:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843177+0000", 2024-04-25T22:03:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010702237999999999 2024-04-25T22:03:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843185+0000", 2024-04-25T22:03:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8490000000000006e-06 2024-04-25T22:03:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861478+0000", 2024-04-25T22:03:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.018292915 2024-04-25T22:03:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861880+0000", 2024-04-25T22:03:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00040182599999999998 2024-04-25T22:03:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862137+0000", 2024-04-25T22:03:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025741099999999998 2024-04-25T22:03:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866967+0000", 2024-04-25T22:03:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048298669999999998 2024-04-25T22:03:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875991+0000", 2024-04-25T22:03:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090235609999999994 2024-04-25T22:03:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876162+0000", 2024-04-25T22:03:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017075900000000001 2024-04-25T22:03:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876261+0000", 2024-04-25T22:03:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9072000000000003e-05 2024-04-25T22:03:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7077 4.27 4:e57158de:::100000014ed.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.673526678, 2024-04-25T22:03:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0562571009999999, 2024-04-25T22:03:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832442+0000", 2024-04-25T22:03:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.274e-06 2024-04-25T22:03:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832448+0000", 2024-04-25T22:03:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-04-25T22:03:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832466+0000", 2024-04-25T22:03:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7549000000000001e-05 2024-04-25T22:03:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832474+0000", 2024-04-25T22:03:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.337e-06 2024-04-25T22:03:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832545+0000", 2024-04-25T22:03:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0986000000000001e-05 2024-04-25T22:03:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832554+0000", 2024-04-25T22:03:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2269999999999999e-06 2024-04-25T22:03:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843167+0000", 2024-04-25T22:03:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010613058 2024-04-25T22:03:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843176+0000", 2024-04-25T22:03:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8629999999999997e-06 2024-04-25T22:03:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878195+0000", 2024-04-25T22:03:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0350192650000001 2024-04-25T22:03:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878952+0000", 2024-04-25T22:03:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00075638400000000003 2024-04-25T22:03:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879100+0000", 2024-04-25T22:03:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014883600000000001 2024-04-25T22:03:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.883699+0000", 2024-04-25T22:03:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045986880000000001 2024-04-25T22:03:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888487+0000", 2024-04-25T22:03:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047874670000000001 2024-04-25T22:03:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888603+0000", 2024-04-25T22:03:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011671900000000001 2024-04-25T22:03:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888698+0000", 2024-04-25T22:03:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4208000000000003e-05 2024-04-25T22:03:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7085 4.1f 4:f9b21afd:::10000001591.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6694621259999991, 2024-04-25T22:03:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0439952969999999, 2024-04-25T22:03:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836507+0000", 2024-04-25T22:03:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.17e-06 2024-04-25T22:03:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836517+0000", 2024-04-25T22:03:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9019999999999994e-06 2024-04-25T22:03:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836603+0000", 2024-04-25T22:03:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6248999999999994e-05 2024-04-25T22:03:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836614+0000", 2024-04-25T22:03:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0322e-05 2024-04-25T22:03:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841790+0000", 2024-04-25T22:03:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051763929999999996 2024-04-25T22:03:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841803+0000", 2024-04-25T22:03:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3023999999999999e-05 2024-04-25T22:03:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.870557+0000", 2024-04-25T22:03:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.02875396 2024-04-25T22:03:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872184+0000", 2024-04-25T22:03:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016268019999999999 2024-04-25T22:03:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872435+0000", 2024-04-25T22:03:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025088399999999999 2024-04-25T22:03:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879983+0000", 2024-04-25T22:03:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0075479379999999997 2024-04-25T22:03:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880150+0000", 2024-04-25T22:03:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016698900000000001 2024-04-25T22:03:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880300+0000", 2024-04-25T22:03:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000150789 2024-04-25T22:03:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880500+0000", 2024-04-25T22:03:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019987499999999999 2024-04-25T22:03:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7086 4.9 4:91594555:::10000001592.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6693344279999991, 2024-04-25T22:03:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0331164559999999, 2024-04-25T22:03:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836634+0000", 2024-04-25T22:03:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1510000000000001e-06 2024-04-25T22:03:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836638+0000", 2024-04-25T22:03:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9740000000000004e-06 2024-04-25T22:03:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836647+0000", 2024-04-25T22:03:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1269999999999992e-06 2024-04-25T22:03:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836653+0000", 2024-04-25T22:03:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8900000000000004e-06 2024-04-25T22:03:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841540+0000", 2024-04-25T22:03:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048869719999999998 2024-04-25T22:03:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841550+0000", 2024-04-25T22:03:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0644e-05 2024-04-25T22:03:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.857739+0000", 2024-04-25T22:03:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.016188589 2024-04-25T22:03:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.858099+0000", 2024-04-25T22:03:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036013100000000003 2024-04-25T22:03:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.858328+0000", 2024-04-25T22:03:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000228941 2024-04-25T22:03:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.864635+0000", 2024-04-25T22:03:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063073199999999999 2024-04-25T22:03:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869508+0000", 2024-04-25T22:03:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048727220000000003 2024-04-25T22:03:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869648+0000", 2024-04-25T22:03:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000140152 2024-04-25T22:03:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869749+0000", 2024-04-25T22:03:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100843 2024-04-25T22:03:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7096 4.9 4:90f65572:::100000016d2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6601403799999996, 2024-04-25T22:03:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0364832260000001, 2024-04-25T22:03:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845828+0000", 2024-04-25T22:03:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5199999999999995e-07 2024-04-25T22:03:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845834+0000", 2024-04-25T22:03:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4710000000000004e-06 2024-04-25T22:03:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845843+0000", 2024-04-25T22:03:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6119999999999999e-06 2024-04-25T22:03:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845848+0000", 2024-04-25T22:03:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8280000000000002e-06 2024-04-25T22:03:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845891+0000", 2024-04-25T22:03:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3234e-05 2024-04-25T22:03:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845898+0000", 2024-04-25T22:03:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3839999999999999e-06 2024-04-25T22:03:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.873643+0000", 2024-04-25T22:03:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.027745162 2024-04-25T22:03:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.873907+0000", 2024-04-25T22:03:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026328000000000001 2024-04-25T22:03:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.874143+0000", 2024-04-25T22:03:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023613799999999999 2024-04-25T22:03:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878861+0000", 2024-04-25T22:03:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047185710000000004 2024-04-25T22:03:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880222+0000", 2024-04-25T22:03:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001360984 2024-04-25T22:03:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880647+0000", 2024-04-25T22:03:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042470799999999999 2024-04-25T22:03:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882310+0000", 2024-04-25T22:03:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001662902 2024-04-25T22:03:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7098 3.9 3:9359a9e9:::100000016e0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6595372939999997, 2024-04-25T22:03:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.034065142, 2024-04-25T22:03:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846432+0000", 2024-04-25T22:03:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.88e-06 2024-04-25T22:03:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846440+0000", 2024-04-25T22:03:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7120000000000006e-06 2024-04-25T22:03:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846463+0000", 2024-04-25T22:03:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2416e-05 2024-04-25T22:03:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846479+0000", 2024-04-25T22:03:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6484999999999999e-05 2024-04-25T22:03:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846718+0000", 2024-04-25T22:03:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023839299999999999 2024-04-25T22:03:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846729+0000", 2024-04-25T22:03:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0896999999999999e-05 2024-04-25T22:03:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872537+0000", 2024-04-25T22:03:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0258087 2024-04-25T22:03:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872831+0000", 2024-04-25T22:03:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029391399999999999 2024-04-25T22:03:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880495+0000", 2024-04-25T22:03:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0076637449999999996 2024-04-25T22:03:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7100 4.1 4:83bc2484:::100000016e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6584841650000008, 2024-04-25T22:03:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.03260128, 2024-04-25T22:03:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847484+0000", 2024-04-25T22:03:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.443e-06 2024-04-25T22:03:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847491+0000", 2024-04-25T22:03:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4300000000000003e-06 2024-04-25T22:03:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847505+0000", 2024-04-25T22:03:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4014e-05 2024-04-25T22:03:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847514+0000", 2024-04-25T22:03:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4350000000000003e-06 2024-04-25T22:03:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847571+0000", 2024-04-25T22:03:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6338999999999997e-05 2024-04-25T22:03:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847580+0000", 2024-04-25T22:03:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0680000000000003e-06 2024-04-25T22:03:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862224+0000", 2024-04-25T22:03:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0146447279999999 2024-04-25T22:03:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862676+0000", 2024-04-25T22:03:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045117300000000003 2024-04-25T22:03:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862992+0000", 2024-04-25T22:03:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000316607 2024-04-25T22:03:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879035+0000", 2024-04-25T22:03:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016043168999999999 2024-04-25T22:03:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879762+0000", 2024-04-25T22:03:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00072643100000000004 2024-04-25T22:03:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879993+0000", 2024-04-25T22:03:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023091799999999999 2024-04-25T22:03:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880084+0000", 2024-04-25T22:03:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1525000000000002e-05 2024-04-25T22:03:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7105 4.1d 4:b83d3758:::10000001718.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6574338770000008, 2024-04-25T22:03:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0317263169999999, 2024-04-25T22:03:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848534+0000", 2024-04-25T22:03:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1200000000000001e-06 2024-04-25T22:03:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848541+0000", 2024-04-25T22:03:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4749999999999998e-06 2024-04-25T22:03:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848551+0000", 2024-04-25T22:03:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.039e-05 2024-04-25T22:03:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848558+0000", 2024-04-25T22:03:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2520000000000002e-06 2024-04-25T22:03:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848703+0000", 2024-04-25T22:03:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014466699999999999 2024-04-25T22:03:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848709+0000", 2024-04-25T22:03:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-04-25T22:03:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866810+0000", 2024-04-25T22:03:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.018101293 2024-04-25T22:03:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867282+0000", 2024-04-25T22:03:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047148999999999997 2024-04-25T22:03:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867555+0000", 2024-04-25T22:03:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027314100000000002 2024-04-25T22:03:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877648+0000", 2024-04-25T22:03:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010093275000000001 2024-04-25T22:03:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880012+0000", 2024-04-25T22:03:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023639590000000001 2024-04-25T22:03:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880157+0000", 2024-04-25T22:03:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000144532 2024-04-25T22:03:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880260+0000", 2024-04-25T22:03:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103016 2024-04-25T22:03:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7116 4.27 4:e60ee3a4:::10000001a5f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6532792680000004, 2024-04-25T22:03:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0375457480000001, 2024-04-25T22:03:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-04-25T22:03:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852694+0000", 2024-04-25T22:03:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0360000000000003e-06 2024-04-25T22:03:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852702+0000", 2024-04-25T22:03:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1470000000000004e-06 2024-04-25T22:03:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852708+0000", 2024-04-25T22:03:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1210000000000003e-06 2024-04-25T22:03:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852762+0000", 2024-04-25T22:03:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4166000000000003e-05 2024-04-25T22:03:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852769+0000", 2024-04-25T22:03:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8000000000000001e-06 2024-04-25T22:03:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880804+0000", 2024-04-25T22:03:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.028035695 2024-04-25T22:03:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881105+0000", 2024-04-25T22:03:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030039999999999998 2024-04-25T22:03:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881373+0000", 2024-04-25T22:03:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026843499999999997 2024-04-25T22:03:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884999+0000", 2024-04-25T22:03:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036262070000000002 2024-04-25T22:03:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.889903+0000", 2024-04-25T22:03:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049036260000000003 2024-04-25T22:03:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890114+0000", 2024-04-25T22:03:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021130500000000001 2024-04-25T22:03:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890234+0000", 2024-04-25T22:03:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011922900000000001 2024-04-25T22:03:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7121 4.1f 4:fab6744c:::10000001a64.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6527865970000004, 2024-04-25T22:03:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.031414587, 2024-04-25T22:03:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1299999999999999e-07 2024-04-25T22:03:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853184+0000", 2024-04-25T22:03:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1779999999999999e-06 2024-04-25T22:03:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853192+0000", 2024-04-25T22:03:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.294e-06 2024-04-25T22:03:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853196+0000", 2024-04-25T22:03:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6330000000000004e-06 2024-04-25T22:03:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853249+0000", 2024-04-25T22:03:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2785999999999999e-05 2024-04-25T22:03:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853260+0000", 2024-04-25T22:03:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1027e-05 2024-04-25T22:03:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875944+0000", 2024-04-25T22:03:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0226834810000001 2024-04-25T22:03:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876230+0000", 2024-04-25T22:03:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000286357 2024-04-25T22:03:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876512+0000", 2024-04-25T22:03:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028174500000000002 2024-04-25T22:03:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880727+0000", 2024-04-25T22:03:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042150520000000004 2024-04-25T22:03:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884386+0000", 2024-04-25T22:03:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036589069999999999 2024-04-25T22:03:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884502+0000", 2024-04-25T22:03:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000115862 2024-04-25T22:03:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884595+0000", 2024-04-25T22:03:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3552000000000001e-05 2024-04-25T22:03:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7127 4.22 4:476940b8:::10000001b50.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6516786020000005, 2024-04-25T22:03:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.035873665, 2024-04-25T22:03:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854290+0000", 2024-04-25T22:03:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.313e-06 2024-04-25T22:03:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854295+0000", 2024-04-25T22:03:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3580000000000002e-06 2024-04-25T22:03:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854310+0000", 2024-04-25T22:03:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4742e-05 2024-04-25T22:03:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854318+0000", 2024-04-25T22:03:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2570000000000007e-06 2024-04-25T22:03:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854383+0000", 2024-04-25T22:03:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4535999999999993e-05 2024-04-25T22:03:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854390+0000", 2024-04-25T22:03:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3930000000000002e-06 2024-04-25T22:03:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879471+0000", 2024-04-25T22:03:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0250810260000001 2024-04-25T22:03:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879790+0000", 2024-04-25T22:03:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031862699999999998 2024-04-25T22:03:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880048+0000", 2024-04-25T22:03:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025776199999999998 2024-04-25T22:03:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882261+0000", 2024-04-25T22:03:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022130259999999999 2024-04-25T22:03:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.889734+0000", 2024-04-25T22:03:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0074735859999999999 2024-04-25T22:03:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890063+0000", 2024-04-25T22:03:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032892000000000002 2024-04-25T22:03:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890162+0000", 2024-04-25T22:03:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9118999999999997e-05 2024-04-25T22:03:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7135 4.27 4:e7bfb438:::10000001b58.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6488690720000001, 2024-04-25T22:03:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.033436429, 2024-04-25T22:03:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857099+0000", 2024-04-25T22:03:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0270000000000001e-06 2024-04-25T22:03:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857104+0000", 2024-04-25T22:03:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6909999999999996e-06 2024-04-25T22:03:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857116+0000", 2024-04-25T22:03:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2384999999999999e-05 2024-04-25T22:03:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857124+0000", 2024-04-25T22:03:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3080000000000008e-06 2024-04-25T22:03:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857175+0000", 2024-04-25T22:03:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0107e-05 2024-04-25T22:03:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857185+0000", 2024-04-25T22:03:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-04-25T22:03:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882135+0000", 2024-04-25T22:03:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.024950322 2024-04-25T22:03:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882426+0000", 2024-04-25T22:03:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029100699999999997 2024-04-25T22:03:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882689+0000", 2024-04-25T22:03:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026236800000000002 2024-04-25T22:03:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.885017+0000", 2024-04-25T22:03:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023282020000000001 2024-04-25T22:03:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890320+0000", 2024-04-25T22:03:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0053037049999999997 2024-04-25T22:03:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890428+0000", 2024-04-25T22:03:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107593 2024-04-25T22:03:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890534+0000", 2024-04-25T22:03:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106469 2024-04-25T22:03:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:42.639 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:42.641 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:42.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:42.636+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:42.644 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:03:42.741 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:42.740+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:42.781 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:16350 3.5 3:a055a6fb:::200.0000001d:head [write 2680240~9731 [fadvise_dontneed] in=9731b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e74)", 2024-04-25T22:03:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:42.780853+0000", 2024-04-25T22:03:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00041133899999999999, 2024-04-25T22:03:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049765200000000001, 2024-04-25T22:03:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:42.780853+0000", 2024-04-25T22:03:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:42.780853+0000", 2024-04-25T22:03:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:42.780855+0000", 2024-04-25T22:03:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.04e-06 2024-04-25T22:03:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:42.780877+0000", 2024-04-25T22:03:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759999999999998e-05 2024-04-25T22:03:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:42.780906+0000", 2024-04-25T22:03:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9207e-05 2024-04-25T22:03:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:42.780921+0000", 2024-04-25T22:03:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4659e-05 2024-04-25T22:03:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:42.780995+0000", 2024-04-25T22:03:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3948000000000004e-05 2024-04-25T22:03:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:42.781057+0000", 2024-04-25T22:03:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2063000000000005e-05 2024-04-25T22:03:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:42.781122+0000", 2024-04-25T22:03:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5529000000000002e-05 2024-04-25T22:03:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:42.786 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:42.786 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:42.786 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:42.786 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:03:42.786 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 1 2024-04-25T22:03:42.786 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:42.788 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:42.788 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:42.797 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:42.810 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:42.810 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:42.838 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:42.838 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:42.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:42.840+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:42.895 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-25T22:03:42.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:42.936+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:42.973 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:42.973 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:42.989 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:43.043 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:43.040+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:43.047 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:03:43.047 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:03:43.047 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-04-25T22:03:43.047 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-04-25T22:03:43.110 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:43.110 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:43.125 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:43.144 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:43.140+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:43.204 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-04-25T22:03:43.245 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:43.244+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:43.260 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:43.261 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:43.275 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:43.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:43.340+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:43.359 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-04-25T22:03:43.398 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:43.399 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:43.414 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:43.447 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:43.444+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:43.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:43.544+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:43.582 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:43.582 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:43.596 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:43.649 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:43.648+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:43.729 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:43.730 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:43.744 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:43.750 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:43.748+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:43.850 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:43.848+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:43.941 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:43.942 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:43.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:43.948+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:43.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:44.052 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:44.048+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:44.134 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:44.134 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:44.149 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:44.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:44.148+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:44.179 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-25T22:03:44.179 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T22:03:44.255 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:44.252+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:44.285 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:44.285 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:44.301 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:44.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:44.352+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:44.456 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:44.456+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:44.463 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:44.463 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:44.477 DEBUG:teuthology.parallel:result is None 2024-04-25T22:03:44.477 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T22:03:44.478 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:44.497 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T22:03:44.498 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T22:03:44.507 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T22:03:44.507 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T22:03:44.507 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T22:03:44.546 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T22:03:44.546 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T22:03:44.557 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:44.556+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:44.595 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:03:44.597 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:44.597 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:44.612 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:44.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:44.656+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:44.746 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:44.746 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:44.759 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:44.756+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:44.760 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:44.855 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:03:44.861 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:44.860+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:44.914 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:03:44.942 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:03:44.942 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":75,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:03:42.887354+0000","last_up_change":"2024-04-25T22:01:03.432353+0000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5804032,"flags_set":["nodeep-scrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:01:03.632568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.80488592386245728,"average_primary_affinity":0.80000001192092896,"average_primary_affinity_weighted":0.80000001192092896}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:01:07.995071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.80488592386245728,"average_primary_affinity":0.80000001192092896,"average_primary_affinity_weighted":0.80000001192092896}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:01:12.514055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.80488592386245728,"average_primary_affinity":0.80000001192092896,"average_primary_affinity_weighted":0.80000001192092896}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:01:12.963831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":0.80488592386245728,"average_primary_affinity":0.80000001192092896,"average_primary_affinity_weighted":0.80000001192092896}}],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":1,"in":1,"weight":1,"primary_affinity":0.6649932861328125,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6801","nonce":2385981072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6803","nonce":2385981072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6807","nonce":2385981072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6805","nonce":2385981072}]},"public_addr":"172.21.15.57:6801/2385981072","cluster_addr":"172.21.15.57:6803/2385981072","heartbeat_back_addr":"172.21.15.57:6807/2385981072","heartbeat_front_addr":"172.21.15.57:6805/2385981072","state":["exists","up"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":1,"in":1,"weight":1,"primary_affinity":0.942596435546875,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6801","nonce":29975895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6803","nonce":29975895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6807","nonce":29975895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6805","nonce":29975895}]},"public_addr":"172.21.15.79:6801/29975895","cluster_addr":"172.21.15.79:6803/29975895","heartbeat_back_addr":"172.21.15.79:6807/29975895","heartbeat_front_addr":"172.21.15.79:6805/29975895","state":["exists","up"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":1,"in":1,"weight":1,"primary_affinity":0.80706787109375,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6801","nonce":3918111900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6803","nonce":3918111900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6807","nonce":3918111900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6805","nonce":3918111900}]},"public_addr":"172.21.15.81:6801/3918111900","cluster_addr":"172.21.15.81:6803/3918111900","heartbeat_back_addr":"172.21.15.81:6807/3918111900","heartbeat_front_addr":"172.21.15.81:6805/3918111900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:59.025944+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.986080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.971238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:03:44.943 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:44.944 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:44.959 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:44.961 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:01:03.632568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8048859238624573, 'average_primary_affinity': 0.800000011920929, 'average_primary_affinity_weighted': 0.800000011920929}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:01:07.995071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8048859238624573, 'average_primary_affinity': 0.800000011920929, 'average_primary_affinity_weighted': 0.800000011920929}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:01:12.514055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8048859238624573, 'average_primary_affinity': 0.800000011920929, 'average_primary_affinity_weighted': 0.800000011920929}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:01:12.963831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 0.8048859238624573, 'average_primary_affinity': 0.800000011920929, 'average_primary_affinity_weighted': 0.800000011920929}}] 2024-04-25T22:03:44.962 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:03:44.963 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:44.960+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:44.996 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:44.997 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:45.016 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:45.017 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:45.037 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:45.037 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:45.062 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:45.060+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:45.093 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 53.006107403000001, 2024-04-25T22:03:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.996106640000001, 2024-04-25T22:03:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.991942366000004, 2024-04-25T22:03:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.990346049000003, 2024-04-25T22:03:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.933559799000001, 2024-04-25T22:03:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.917915532999999, 2024-04-25T22:03:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.913076842000002, 2024-04-25T22:03:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10648 4.33 4:cc614d18:::100000030cb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.554473530999999, 2024-04-25T22:03:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13001143300000001, 2024-04-25T22:03:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10648 2024-04-25T22:03:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537181+0000", 2024-04-25T22:03:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.782e-06 2024-04-25T22:03:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541681+0000", 2024-04-25T22:03:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045008460000000002 2024-04-25T22:03:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541692+0000", 2024-04-25T22:03:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0726e-05 2024-04-25T22:03:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541698+0000", 2024-04-25T22:03:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-04-25T22:03:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541771+0000", 2024-04-25T22:03:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3070000000000003e-05 2024-04-25T22:03:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542021+0000", 2024-04-25T22:03:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025059799999999999 2024-04-25T22:03:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542246+0000", 2024-04-25T22:03:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022471000000000001 2024-04-25T22:03:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.579359+0000", 2024-04-25T22:03:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037113211 2024-04-25T22:03:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667067+0000", 2024-04-25T22:03:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087707255999999997 2024-04-25T22:03:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667134+0000", 2024-04-25T22:03:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7862999999999997e-05 2024-04-25T22:03:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667190+0000", 2024-04-25T22:03:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5698000000000001e-05 2024-04-25T22:03:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10651 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.494697753000001, 2024-04-25T22:03:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11324606800000001, 2024-04-25T22:03:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10651 2024-04-25T22:03:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596957+0000", 2024-04-25T22:03:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-04-25T22:03:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601272+0000", 2024-04-25T22:03:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004314834 2024-04-25T22:03:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601291+0000", 2024-04-25T22:03:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9380000000000001e-05 2024-04-25T22:03:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601302+0000", 2024-04-25T22:03:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0416e-05 2024-04-25T22:03:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.603978+0000", 2024-04-25T22:03:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026763109999999998 2024-04-25T22:03:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604327+0000", 2024-04-25T22:03:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034881099999999998 2024-04-25T22:03:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604571+0000", 2024-04-25T22:03:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024436100000000001 2024-04-25T22:03:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644439+0000", 2024-04-25T22:03:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039868270999999997 2024-04-25T22:03:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710091+0000", 2024-04-25T22:03:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.065651910999999993 2024-04-25T22:03:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710144+0000", 2024-04-25T22:03:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2444999999999997e-05 2024-04-25T22:03:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710201+0000", 2024-04-25T22:03:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6839999999999998e-05 2024-04-25T22:03:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10654 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.48487089, 2024-04-25T22:03:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.103958778, 2024-04-25T22:03:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10654 2024-04-25T22:03:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606782+0000", 2024-04-25T22:03:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1699999999999999e-07 2024-04-25T22:03:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611155+0000", 2024-04-25T22:03:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043728580000000003 2024-04-25T22:03:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611173+0000", 2024-04-25T22:03:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8267e-05 2024-04-25T22:03:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611183+0000", 2024-04-25T22:03:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9250000000000007e-06 2024-04-25T22:03:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644642+0000", 2024-04-25T22:03:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033458976000000001 2024-04-25T22:03:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644739+0000", 2024-04-25T22:03:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7189999999999996e-05 2024-04-25T22:03:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644864+0000", 2024-04-25T22:03:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000124867 2024-04-25T22:03:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.672556+0000", 2024-04-25T22:03:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027691653 2024-04-25T22:03:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710668+0000", 2024-04-25T22:03:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038111956000000002 2024-04-25T22:03:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710703+0000", 2024-04-25T22:03:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5577000000000002e-05 2024-04-25T22:03:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710740+0000", 2024-04-25T22:03:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7092000000000003e-05 2024-04-25T22:03:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.150 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.150 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11078 4.4 4:22be2a9e:::10000003224.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:45.150 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:45.150 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.087744269000002, 2024-04-25T22:03:45.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.112294177, 2024-04-25T22:03:45.150 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.150 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.150 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.150 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.150 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.150 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11078 2024-04-25T22:03:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003909+0000", 2024-04-25T22:03:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2750000000000001e-06 2024-04-25T22:03:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009939+0000", 2024-04-25T22:03:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060293309999999998 2024-04-25T22:03:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009961+0000", 2024-04-25T22:03:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1889999999999999e-05 2024-04-25T22:03:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009976+0000", 2024-04-25T22:03:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5642e-05 2024-04-25T22:03:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042803+0000", 2024-04-25T22:03:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032827299999999997 2024-04-25T22:03:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042911+0000", 2024-04-25T22:03:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107747 2024-04-25T22:03:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042990+0000", 2024-04-25T22:03:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8832999999999996e-05 2024-04-25T22:03:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.088710+0000", 2024-04-25T22:03:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045720129999999998 2024-04-25T22:03:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116108+0000", 2024-04-25T22:03:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027397388000000002 2024-04-25T22:03:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116164+0000", 2024-04-25T22:03:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6283000000000003e-05 2024-04-25T22:03:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116202+0000", 2024-04-25T22:03:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8358000000000001e-05 2024-04-25T22:03:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11195 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.874382151999999, 2024-04-25T22:03:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1095062, 2024-04-25T22:03:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11195 2024-04-25T22:03:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217272+0000", 2024-04-25T22:03:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.533e-06 2024-04-25T22:03:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217385+0000", 2024-04-25T22:03:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113533 2024-04-25T22:03:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217396+0000", 2024-04-25T22:03:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0682e-05 2024-04-25T22:03:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217402+0000", 2024-04-25T22:03:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:03:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238476+0000", 2024-04-25T22:03:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021073312 2024-04-25T22:03:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238558+0000", 2024-04-25T22:03:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2193000000000004e-05 2024-04-25T22:03:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238695+0000", 2024-04-25T22:03:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013737800000000001 2024-04-25T22:03:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292860+0000", 2024-04-25T22:03:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054165224999999997 2024-04-25T22:03:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326638+0000", 2024-04-25T22:03:45.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033777517999999999 2024-04-25T22:03:45.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326686+0000", 2024-04-25T22:03:45.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8062000000000002e-05 2024-04-25T22:03:45.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326776+0000", 2024-04-25T22:03:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0393e-05 2024-04-25T22:03:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11197 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3195543~33670] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.874240168, 2024-04-25T22:03:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953929499999999, 2024-04-25T22:03:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11197 2024-04-25T22:03:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217413+0000", 2024-04-25T22:03:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5600000000000005e-07 2024-04-25T22:03:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217445+0000", 2024-04-25T22:03:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2240999999999998e-05 2024-04-25T22:03:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217453+0000", 2024-04-25T22:03:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6070000000000002e-06 2024-04-25T22:03:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217458+0000", 2024-04-25T22:03:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3630000000000002e-06 2024-04-25T22:03:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240891+0000", 2024-04-25T22:03:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023432637999999999 2024-04-25T22:03:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240990+0000", 2024-04-25T22:03:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8995999999999999e-05 2024-04-25T22:03:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241123+0000", 2024-04-25T22:03:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013371699999999999 2024-04-25T22:03:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292866+0000", 2024-04-25T22:03:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051742332000000002 2024-04-25T22:03:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326849+0000", 2024-04-25T22:03:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033983140000000002 2024-04-25T22:03:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326908+0000", 2024-04-25T22:03:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8842999999999999e-05 2024-04-25T22:03:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326951+0000", 2024-04-25T22:03:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3761999999999999e-05 2024-04-25T22:03:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11198 4.4 4:22c4fea3:::10000003262.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.874185809, 2024-04-25T22:03:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12381273600000001, 2024-04-25T22:03:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11198 2024-04-25T22:03:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217467+0000", 2024-04-25T22:03:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4499999999999997e-07 2024-04-25T22:03:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225449+0000", 2024-04-25T22:03:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079819439999999995 2024-04-25T22:03:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225466+0000", 2024-04-25T22:03:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6602000000000001e-05 2024-04-25T22:03:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225477+0000", 2024-04-25T22:03:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1603000000000001e-05 2024-04-25T22:03:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240866+0000", 2024-04-25T22:03:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015388389000000001 2024-04-25T22:03:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241081+0000", 2024-04-25T22:03:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021577400000000001 2024-04-25T22:03:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241212+0000", 2024-04-25T22:03:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013073499999999999 2024-04-25T22:03:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292876+0000", 2024-04-25T22:03:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051663584999999998 2024-04-25T22:03:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341159+0000", 2024-04-25T22:03:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048283421999999999 2024-04-25T22:03:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341222+0000", 2024-04-25T22:03:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:03:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341279+0000", 2024-04-25T22:03:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6780999999999997e-05 2024-04-25T22:03:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11207 4.4 4:233f6309:::10000003211.00000000:head [write 659836~128648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.857567811999999, 2024-04-25T22:03:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10732727, 2024-04-25T22:03:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11207 2024-04-25T22:03:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234085+0000", 2024-04-25T22:03:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0399999999999995e-07 2024-04-25T22:03:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234550+0000", 2024-04-25T22:03:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000464909 2024-04-25T22:03:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234561+0000", 2024-04-25T22:03:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0744000000000001e-05 2024-04-25T22:03:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234569+0000", 2024-04-25T22:03:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6890000000000004e-06 2024-04-25T22:03:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267197+0000", 2024-04-25T22:03:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032628182999999998 2024-04-25T22:03:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267297+0000", 2024-04-25T22:03:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100222 2024-04-25T22:03:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267393+0000", 2024-04-25T22:03:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6275999999999998e-05 2024-04-25T22:03:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292880+0000", 2024-04-25T22:03:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025487058999999999 2024-04-25T22:03:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341326+0000", 2024-04-25T22:03:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048446031000000001 2024-04-25T22:03:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341374+0000", 2024-04-25T22:03:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7632000000000001e-05 2024-04-25T22:03:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341412+0000", 2024-04-25T22:03:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7821000000000003e-05 2024-04-25T22:03:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11219 4.4 4:210cd53e:::100000031ff.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.838618602, 2024-04-25T22:03:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13181403, 2024-04-25T22:03:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11219 2024-04-25T22:03:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253035+0000", 2024-04-25T22:03:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.322e-06 2024-04-25T22:03:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258145+0000", 2024-04-25T22:03:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051095669999999998 2024-04-25T22:03:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258163+0000", 2024-04-25T22:03:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8377999999999999e-05 2024-04-25T22:03:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258174+0000", 2024-04-25T22:03:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0925e-05 2024-04-25T22:03:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270495+0000", 2024-04-25T22:03:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012321354 2024-04-25T22:03:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270581+0000", 2024-04-25T22:03:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5741999999999993e-05 2024-04-25T22:03:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270717+0000", 2024-04-25T22:03:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013571500000000001 2024-04-25T22:03:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326599+0000", 2024-04-25T22:03:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055882026000000001 2024-04-25T22:03:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384753+0000", 2024-04-25T22:03:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058154527999999997 2024-04-25T22:03:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384805+0000", 2024-04-25T22:03:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1592999999999999e-05 2024-04-25T22:03:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384848+0000", 2024-04-25T22:03:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2880000000000003e-05 2024-04-25T22:03:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11868 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.879654777999999, 2024-04-25T22:03:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12149908700000001, 2024-04-25T22:03:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11868 2024-04-25T22:03:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211999+0000", 2024-04-25T22:03:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:03:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219614+0000", 2024-04-25T22:03:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076153490000000004 2024-04-25T22:03:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219628+0000", 2024-04-25T22:03:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3597e-05 2024-04-25T22:03:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219635+0000", 2024-04-25T22:03:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7759999999999997e-06 2024-04-25T22:03:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229908+0000", 2024-04-25T22:03:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010272478 2024-04-25T22:03:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229966+0000", 2024-04-25T22:03:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8495000000000002e-05 2024-04-25T22:03:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.230082+0000", 2024-04-25T22:03:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011560799999999999 2024-04-25T22:03:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257530+0000", 2024-04-25T22:03:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027448034999999999 2024-04-25T22:03:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333408+0000", 2024-04-25T22:03:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075878105000000001 2024-04-25T22:03:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333457+0000", 2024-04-25T22:03:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8757000000000001e-05 2024-04-25T22:03:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333497+0000", 2024-04-25T22:03:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9721000000000001e-05 2024-04-25T22:03:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11870 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 4063232~131072] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.872000423999999, 2024-04-25T22:03:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.114017408, 2024-04-25T22:03:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11870 2024-04-25T22:03:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219653+0000", 2024-04-25T22:03:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6139999999999999e-06 2024-04-25T22:03:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219722+0000", 2024-04-25T22:03:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8460000000000005e-05 2024-04-25T22:03:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219730+0000", 2024-04-25T22:03:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3420000000000008e-06 2024-04-25T22:03:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219736+0000", 2024-04-25T22:03:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9619999999999998e-06 2024-04-25T22:03:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247743+0000", 2024-04-25T22:03:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028006400000000001 2024-04-25T22:03:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247847+0000", 2024-04-25T22:03:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104017 2024-04-25T22:03:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247984+0000", 2024-04-25T22:03:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013701800000000001 2024-04-25T22:03:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257536+0000", 2024-04-25T22:03:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095520050000000006 2024-04-25T22:03:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333565+0000", 2024-04-25T22:03:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076029154000000002 2024-04-25T22:03:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333628+0000", 2024-04-25T22:03:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2853000000000003e-05 2024-04-25T22:03:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333669+0000", 2024-04-25T22:03:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1582999999999998e-05 2024-04-25T22:03:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11871 4.37 4:ee924968:::10000003393.00000000:head [write 2359296~1835008] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.871907491999998, 2024-04-25T22:03:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.113885236, 2024-04-25T22:03:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11871 2024-04-25T22:03:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6100000000000001e-07 2024-04-25T22:03:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222469+0000", 2024-04-25T22:03:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027240060000000002 2024-04-25T22:03:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222482+0000", 2024-04-25T22:03:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3049e-05 2024-04-25T22:03:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222492+0000", 2024-04-25T22:03:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8020000000000003e-06 2024-04-25T22:03:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247903+0000", 2024-04-25T22:03:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025410578999999999 2024-04-25T22:03:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247962+0000", 2024-04-25T22:03:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9363000000000001e-05 2024-04-25T22:03:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.248049+0000", 2024-04-25T22:03:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6803000000000002e-05 2024-04-25T22:03:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257915+0000", 2024-04-25T22:03:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0098655730000000007 2024-04-25T22:03:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333544+0000", 2024-04-25T22:03:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075629030999999999 2024-04-25T22:03:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333594+0000", 2024-04-25T22:03:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0291999999999999e-05 2024-04-25T22:03:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333630+0000", 2024-04-25T22:03:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6177000000000003e-05 2024-04-25T22:03:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:15375 4.4 4:211dd80e:::10000003351.00000000:head [write 0~4194304 [2@1354921]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.954578099999999, 2024-04-25T22:03:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953555500000001, 2024-04-25T22:03:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-04-25T22:03:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137076+0000", 2024-04-25T22:03:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.683e-06 2024-04-25T22:03:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142168+0000", 2024-04-25T22:03:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050917280000000002 2024-04-25T22:03:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142192+0000", 2024-04-25T22:03:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:03:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142206+0000", 2024-04-25T22:03:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.396e-05 2024-04-25T22:03:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142280+0000", 2024-04-25T22:03:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4369000000000006e-05 2024-04-25T22:03:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142346+0000", 2024-04-25T22:03:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5957000000000006e-05 2024-04-25T22:03:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142440+0000", 2024-04-25T22:03:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3888999999999995e-05 2024-04-25T22:03:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.208451+0000", 2024-04-25T22:03:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066011350999999996 2024-04-25T22:03:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246473+0000", 2024-04-25T22:03:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038021428000000003 2024-04-25T22:03:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246530+0000", 2024-04-25T22:03:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7466000000000002e-05 2024-04-25T22:03:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246610+0000", 2024-04-25T22:03:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9484e-05 2024-04-25T22:03:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:45.206 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:45.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:45.208 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:45.204+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:45.278 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-04-25T22:03:45.296 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:03:45.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:45.308+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:45.338 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:45.338 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:45.338 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:03:45.338 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:45.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:45.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:45.408+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:45.472 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:03:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:03:45.472 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:45.486 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:45.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:45.504+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:45.591 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 8 2024-04-25T22:03:45.607 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:45.607 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:03:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:03:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7039 4.8 4:1138358d:::100000013f3.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.771139534, 2024-04-25T22:03:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.034656746, 2024-04-25T22:03:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831791+0000", 2024-04-25T22:03:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6359999999999998e-06 2024-04-25T22:03:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831801+0000", 2024-04-25T22:03:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0567000000000001e-05 2024-04-25T22:03:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831824+0000", 2024-04-25T22:03:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:03:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831839+0000", 2024-04-25T22:03:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5345999999999998e-05 2024-04-25T22:03:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832028+0000", 2024-04-25T22:03:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018899800000000001 2024-04-25T22:03:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832043+0000", 2024-04-25T22:03:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4805e-05 2024-04-25T22:03:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836259+0000", 2024-04-25T22:03:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042161819999999997 2024-04-25T22:03:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836422+0000", 2024-04-25T22:03:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000162404 2024-04-25T22:03:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.865428+0000", 2024-04-25T22:03:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0290065770000001 2024-04-25T22:03:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866445+0000", 2024-04-25T22:03:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001016561 2024-04-25T22:03:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7040 4.8 4:121f992c:::100000013f4.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.771050611, 2024-04-25T22:03:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0348302300000001, 2024-04-25T22:03:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831878+0000", 2024-04-25T22:03:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3659999999999999e-06 2024-04-25T22:03:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831885+0000", 2024-04-25T22:03:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7139999999999996e-06 2024-04-25T22:03:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831901+0000", 2024-04-25T22:03:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5982999999999999e-05 2024-04-25T22:03:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831910+0000", 2024-04-25T22:03:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7530000000000007e-06 2024-04-25T22:03:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832133+0000", 2024-04-25T22:03:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022307199999999999 2024-04-25T22:03:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832141+0000", 2024-04-25T22:03:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0080000000000002e-06 2024-04-25T22:03:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836611+0000", 2024-04-25T22:03:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044698389999999998 2024-04-25T22:03:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836629+0000", 2024-04-25T22:03:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8397e-05 2024-04-25T22:03:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866532+0000", 2024-04-25T22:03:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0299026200000001 2024-04-25T22:03:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866707+0000", 2024-04-25T22:03:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017547799999999999 2024-04-25T22:03:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7051 4.36 4:6e19a085:::100000013ff.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.770997832000001, 2024-04-25T22:03:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.032211298, 2024-04-25T22:03:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831931+0000", 2024-04-25T22:03:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.19e-06 2024-04-25T22:03:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831936+0000", 2024-04-25T22:03:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2059999999999998e-06 2024-04-25T22:03:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831950+0000", 2024-04-25T22:03:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3424000000000001e-05 2024-04-25T22:03:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831958+0000", 2024-04-25T22:03:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1659999999999994e-06 2024-04-25T22:03:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832033+0000", 2024-04-25T22:03:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4977999999999999e-05 2024-04-25T22:03:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832043+0000", 2024-04-25T22:03:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0268999999999999e-05 2024-04-25T22:03:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841105+0000", 2024-04-25T22:03:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090619829999999991 2024-04-25T22:03:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841118+0000", 2024-04-25T22:03:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2737e-05 2024-04-25T22:03:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.863240+0000", 2024-04-25T22:03:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0221224259999999 2024-04-25T22:03:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.864141+0000", 2024-04-25T22:03:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090091900000000003 2024-04-25T22:03:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7059 4.22 4:47c8979f:::10000001407.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.770946692000001, 2024-04-25T22:03:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0438401859999999, 2024-04-25T22:03:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831982+0000", 2024-04-25T22:03:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1030000000000001e-06 2024-04-25T22:03:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831987+0000", 2024-04-25T22:03:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-04-25T22:03:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832007+0000", 2024-04-25T22:03:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0126999999999999e-05 2024-04-25T22:03:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832022+0000", 2024-04-25T22:03:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4878999999999999e-05 2024-04-25T22:03:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832082+0000", 2024-04-25T22:03:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9552999999999997e-05 2024-04-25T22:03:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832088+0000", 2024-04-25T22:03:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9320000000000001e-06 2024-04-25T22:03:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836708+0000", 2024-04-25T22:03:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046199240000000001 2024-04-25T22:03:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836717+0000", 2024-04-25T22:03:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1840000000000005e-06 2024-04-25T22:03:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875475+0000", 2024-04-25T22:03:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0387584439999999 2024-04-25T22:03:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875821+0000", 2024-04-25T22:03:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00034578700000000001 2024-04-25T22:03:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7063 4.2 4:4331e060:::100000014df.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.770883903, 2024-04-25T22:03:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.047605189, 2024-04-25T22:03:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832045+0000", 2024-04-25T22:03:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:03:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832088+0000", 2024-04-25T22:03:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2483e-05 2024-04-25T22:03:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832100+0000", 2024-04-25T22:03:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2713e-05 2024-04-25T22:03:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832111+0000", 2024-04-25T22:03:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0457e-05 2024-04-25T22:03:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832155+0000", 2024-04-25T22:03:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4468999999999997e-05 2024-04-25T22:03:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832161+0000", 2024-04-25T22:03:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3369999999999999e-06 2024-04-25T22:03:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836779+0000", 2024-04-25T22:03:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046185030000000004 2024-04-25T22:03:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836787+0000", 2024-04-25T22:03:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5820000000000004e-06 2024-04-25T22:03:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.868721+0000", 2024-04-25T22:03:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0319339300000001 2024-04-25T22:03:45.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:45.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869179+0000", 2024-04-25T22:03:45.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000457916 2024-04-25T22:03:45.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:45.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869486+0000", 2024-04-25T22:03:45.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030764099999999999 2024-04-25T22:03:45.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:45.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879230+0000", 2024-04-25T22:03:45.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097433620000000002 2024-04-25T22:03:45.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879288+0000", 2024-04-25T22:03:45.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8813000000000001e-05 2024-04-25T22:03:45.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:45.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879542+0000", 2024-04-25T22:03:45.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025326999999999999 2024-04-25T22:03:45.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879649+0000", 2024-04-25T22:03:45.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107173 2024-04-25T22:03:45.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.636 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.636 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7068 4.33 4:cf543130:::100000014e4.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.636 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:45.636 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.770798211000001, 2024-04-25T22:03:45.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.044127671, 2024-04-25T22:03:45.636 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.636 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.636 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:45.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:45.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832131+0000", 2024-04-25T22:03:45.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:03:45.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832137+0000", 2024-04-25T22:03:45.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9859999999999999e-06 2024-04-25T22:03:45.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832155+0000", 2024-04-25T22:03:45.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8090000000000001e-05 2024-04-25T22:03:45.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832166+0000", 2024-04-25T22:03:45.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1776999999999999e-05 2024-04-25T22:03:45.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832235+0000", 2024-04-25T22:03:45.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8614000000000004e-05 2024-04-25T22:03:45.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:45.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832243+0000", 2024-04-25T22:03:45.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2719999999999997e-06 2024-04-25T22:03:45.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.834656+0000", 2024-04-25T22:03:45.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024123489999999998 2024-04-25T22:03:45.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.834666+0000", 2024-04-25T22:03:45.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8819999999999996e-06 2024-04-25T22:03:45.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.860770+0000", 2024-04-25T22:03:45.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.026104414 2024-04-25T22:03:45.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:45.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861849+0000", 2024-04-25T22:03:45.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010794559999999999 2024-04-25T22:03:45.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:45.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.865487+0000", 2024-04-25T22:03:45.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036373270000000001 2024-04-25T22:03:45.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869323+0000", 2024-04-25T22:03:45.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038362259999999999 2024-04-25T22:03:45.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:45.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876012+0000", 2024-04-25T22:03:45.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066894290000000002 2024-04-25T22:03:45.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:45.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876154+0000", 2024-04-25T22:03:45.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000141963 2024-04-25T22:03:45.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876257+0000", 2024-04-25T22:03:45.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102662 2024-04-25T22:03:45.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.642 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.643 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7069 4.36 4:6d2d0624:::100000014e5.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.643 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:45.643 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.770745454, 2024-04-25T22:03:45.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0457444709999999, 2024-04-25T22:03:45.643 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.643 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.643 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:45.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:45.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832183+0000", 2024-04-25T22:03:45.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1459999999999999e-06 2024-04-25T22:03:45.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832189+0000", 2024-04-25T22:03:45.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.614e-06 2024-04-25T22:03:45.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832206+0000", 2024-04-25T22:03:45.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.683e-05 2024-04-25T22:03:45.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832218+0000", 2024-04-25T22:03:45.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2266000000000001e-05 2024-04-25T22:03:45.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832265+0000", 2024-04-25T22:03:45.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7138999999999997e-05 2024-04-25T22:03:45.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:45.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832271+0000", 2024-04-25T22:03:45.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4280000000000004e-06 2024-04-25T22:03:45.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841149+0000", 2024-04-25T22:03:45.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088781429999999998 2024-04-25T22:03:45.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841158+0000", 2024-04-25T22:03:45.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7359999999999996e-06 2024-04-25T22:03:45.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867956+0000", 2024-04-25T22:03:45.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0267976969999999 2024-04-25T22:03:45.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:45.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.868991+0000", 2024-04-25T22:03:45.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010344810000000001 2024-04-25T22:03:45.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:45.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869248+0000", 2024-04-25T22:03:45.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025746699999999999 2024-04-25T22:03:45.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872721+0000", 2024-04-25T22:03:45.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034729959999999999 2024-04-25T22:03:45.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:45.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877064+0000", 2024-04-25T22:03:45.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043432770000000004 2024-04-25T22:03:45.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:45.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877767+0000", 2024-04-25T22:03:45.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070237700000000001 2024-04-25T22:03:45.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877927+0000", 2024-04-25T22:03:45.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015987400000000001 2024-04-25T22:03:45.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.649 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.649 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7071 4.22 4:45120e82:::100000014e7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.649 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:45.649 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.770692015, 2024-04-25T22:03:45.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.050578969, 2024-04-25T22:03:45.649 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.649 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.649 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.650 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:45.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:45.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832237+0000", 2024-04-25T22:03:45.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.003e-06 2024-04-25T22:03:45.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832243+0000", 2024-04-25T22:03:45.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-04-25T22:03:45.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832263+0000", 2024-04-25T22:03:45.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0066999999999999e-05 2024-04-25T22:03:45.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832293+0000", 2024-04-25T22:03:45.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9802999999999999e-05 2024-04-25T22:03:45.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832416+0000", 2024-04-25T22:03:45.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123566 2024-04-25T22:03:45.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:45.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832438+0000", 2024-04-25T22:03:45.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1433e-05 2024-04-25T22:03:45.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836745+0000", 2024-04-25T22:03:45.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043070260000000003 2024-04-25T22:03:45.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836752+0000", 2024-04-25T22:03:45.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2060000000000001e-06 2024-04-25T22:03:45.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875897+0000", 2024-04-25T22:03:45.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0391448489999999 2024-04-25T22:03:45.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:45.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876238+0000", 2024-04-25T22:03:45.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00034159400000000002 2024-04-25T22:03:45.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:45.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876491+0000", 2024-04-25T22:03:45.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025221500000000002 2024-04-25T22:03:45.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:45.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881289+0000", 2024-04-25T22:03:45.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047986510000000001 2024-04-25T22:03:45.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882627+0000", 2024-04-25T22:03:45.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013376340000000001 2024-04-25T22:03:45.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:45.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882707+0000", 2024-04-25T22:03:45.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0037000000000006e-05 2024-04-25T22:03:45.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882815+0000", 2024-04-25T22:03:45.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107645 2024-04-25T22:03:45.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.656 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.656 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7073 4.14 4:2af683fb:::100000014e9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.656 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:45.656 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.770611422, 2024-04-25T22:03:45.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.043944475, 2024-04-25T22:03:45.657 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.657 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.657 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:45.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:45.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832318+0000", 2024-04-25T22:03:45.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:03:45.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832323+0000", 2024-04-25T22:03:45.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6099999999999997e-06 2024-04-25T22:03:45.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832345+0000", 2024-04-25T22:03:45.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1353e-05 2024-04-25T22:03:45.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832390+0000", 2024-04-25T22:03:45.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5543000000000001e-05 2024-04-25T22:03:45.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832469+0000", 2024-04-25T22:03:45.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8770999999999995e-05 2024-04-25T22:03:45.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:45.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832475+0000", 2024-04-25T22:03:45.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0970000000000002e-06 2024-04-25T22:03:45.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843177+0000", 2024-04-25T22:03:45.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010702237999999999 2024-04-25T22:03:45.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843185+0000", 2024-04-25T22:03:45.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8490000000000006e-06 2024-04-25T22:03:45.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861478+0000", 2024-04-25T22:03:45.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.018292915 2024-04-25T22:03:45.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:45.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861880+0000", 2024-04-25T22:03:45.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00040182599999999998 2024-04-25T22:03:45.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:45.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862137+0000", 2024-04-25T22:03:45.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025741099999999998 2024-04-25T22:03:45.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866967+0000", 2024-04-25T22:03:45.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048298669999999998 2024-04-25T22:03:45.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:45.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875991+0000", 2024-04-25T22:03:45.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090235609999999994 2024-04-25T22:03:45.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:45.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876162+0000", 2024-04-25T22:03:45.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017075900000000001 2024-04-25T22:03:45.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876261+0000", 2024-04-25T22:03:45.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9072000000000003e-05 2024-04-25T22:03:45.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.663 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.663 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7077 4.27 4:e57158de:::100000014ed.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.663 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:45.663 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.770487147000001, 2024-04-25T22:03:45.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0562571009999999, 2024-04-25T22:03:45.663 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.663 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.664 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.664 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:45.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:45.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832442+0000", 2024-04-25T22:03:45.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.274e-06 2024-04-25T22:03:45.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832448+0000", 2024-04-25T22:03:45.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-04-25T22:03:45.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832466+0000", 2024-04-25T22:03:45.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7549000000000001e-05 2024-04-25T22:03:45.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832474+0000", 2024-04-25T22:03:45.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.337e-06 2024-04-25T22:03:45.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832545+0000", 2024-04-25T22:03:45.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0986000000000001e-05 2024-04-25T22:03:45.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:45.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832554+0000", 2024-04-25T22:03:45.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2269999999999999e-06 2024-04-25T22:03:45.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843167+0000", 2024-04-25T22:03:45.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010613058 2024-04-25T22:03:45.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843176+0000", 2024-04-25T22:03:45.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8629999999999997e-06 2024-04-25T22:03:45.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878195+0000", 2024-04-25T22:03:45.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0350192650000001 2024-04-25T22:03:45.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:45.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878952+0000", 2024-04-25T22:03:45.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00075638400000000003 2024-04-25T22:03:45.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:45.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879100+0000", 2024-04-25T22:03:45.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014883600000000001 2024-04-25T22:03:45.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:45.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.883699+0000", 2024-04-25T22:03:45.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045986880000000001 2024-04-25T22:03:45.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888487+0000", 2024-04-25T22:03:45.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047874670000000001 2024-04-25T22:03:45.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:45.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888603+0000", 2024-04-25T22:03:45.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011671900000000001 2024-04-25T22:03:45.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888698+0000", 2024-04-25T22:03:45.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4208000000000003e-05 2024-04-25T22:03:45.670 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.670 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.670 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.670 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7085 4.1f 4:f9b21afd:::10000001591.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.670 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:45.670 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.766422595, 2024-04-25T22:03:45.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0439952969999999, 2024-04-25T22:03:45.671 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.671 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.671 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.671 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:45.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:45.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836507+0000", 2024-04-25T22:03:45.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.17e-06 2024-04-25T22:03:45.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836517+0000", 2024-04-25T22:03:45.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9019999999999994e-06 2024-04-25T22:03:45.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836603+0000", 2024-04-25T22:03:45.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6248999999999994e-05 2024-04-25T22:03:45.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836614+0000", 2024-04-25T22:03:45.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0322e-05 2024-04-25T22:03:45.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841790+0000", 2024-04-25T22:03:45.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051763929999999996 2024-04-25T22:03:45.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841803+0000", 2024-04-25T22:03:45.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3023999999999999e-05 2024-04-25T22:03:45.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.870557+0000", 2024-04-25T22:03:45.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.02875396 2024-04-25T22:03:45.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:45.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872184+0000", 2024-04-25T22:03:45.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016268019999999999 2024-04-25T22:03:45.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:45.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872435+0000", 2024-04-25T22:03:45.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025088399999999999 2024-04-25T22:03:45.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879983+0000", 2024-04-25T22:03:45.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0075479379999999997 2024-04-25T22:03:45.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:45.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880150+0000", 2024-04-25T22:03:45.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016698900000000001 2024-04-25T22:03:45.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:45.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880300+0000", 2024-04-25T22:03:45.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000150789 2024-04-25T22:03:45.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880500+0000", 2024-04-25T22:03:45.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019987499999999999 2024-04-25T22:03:45.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.676 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.676 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7086 4.9 4:91594555:::10000001592.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.677 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:45.677 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.766294897, 2024-04-25T22:03:45.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0331164559999999, 2024-04-25T22:03:45.677 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.677 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.677 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.677 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:45.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:45.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836634+0000", 2024-04-25T22:03:45.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1510000000000001e-06 2024-04-25T22:03:45.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836638+0000", 2024-04-25T22:03:45.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9740000000000004e-06 2024-04-25T22:03:45.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836647+0000", 2024-04-25T22:03:45.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1269999999999992e-06 2024-04-25T22:03:45.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836653+0000", 2024-04-25T22:03:45.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8900000000000004e-06 2024-04-25T22:03:45.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841540+0000", 2024-04-25T22:03:45.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048869719999999998 2024-04-25T22:03:45.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841550+0000", 2024-04-25T22:03:45.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0644e-05 2024-04-25T22:03:45.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.857739+0000", 2024-04-25T22:03:45.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.016188589 2024-04-25T22:03:45.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:45.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.858099+0000", 2024-04-25T22:03:45.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036013100000000003 2024-04-25T22:03:45.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:45.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.858328+0000", 2024-04-25T22:03:45.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000228941 2024-04-25T22:03:45.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:45.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.864635+0000", 2024-04-25T22:03:45.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063073199999999999 2024-04-25T22:03:45.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869508+0000", 2024-04-25T22:03:45.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048727220000000003 2024-04-25T22:03:45.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:45.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869648+0000", 2024-04-25T22:03:45.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000140152 2024-04-25T22:03:45.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869749+0000", 2024-04-25T22:03:45.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100843 2024-04-25T22:03:45.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.682 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.683 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7096 4.9 4:90f65572:::100000016d2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.683 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:45.683 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.757100849, 2024-04-25T22:03:45.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0364832260000001, 2024-04-25T22:03:45.683 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.683 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.683 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.683 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:45.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:45.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845828+0000", 2024-04-25T22:03:45.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5199999999999995e-07 2024-04-25T22:03:45.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845834+0000", 2024-04-25T22:03:45.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4710000000000004e-06 2024-04-25T22:03:45.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845843+0000", 2024-04-25T22:03:45.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6119999999999999e-06 2024-04-25T22:03:45.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845848+0000", 2024-04-25T22:03:45.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8280000000000002e-06 2024-04-25T22:03:45.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845891+0000", 2024-04-25T22:03:45.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3234e-05 2024-04-25T22:03:45.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845898+0000", 2024-04-25T22:03:45.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3839999999999999e-06 2024-04-25T22:03:45.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.873643+0000", 2024-04-25T22:03:45.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.027745162 2024-04-25T22:03:45.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:45.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.873907+0000", 2024-04-25T22:03:45.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026328000000000001 2024-04-25T22:03:45.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:45.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.874143+0000", 2024-04-25T22:03:45.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023613799999999999 2024-04-25T22:03:45.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878861+0000", 2024-04-25T22:03:45.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047185710000000004 2024-04-25T22:03:45.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:45.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880222+0000", 2024-04-25T22:03:45.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001360984 2024-04-25T22:03:45.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:45.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880647+0000", 2024-04-25T22:03:45.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042470799999999999 2024-04-25T22:03:45.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882310+0000", 2024-04-25T22:03:45.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001662902 2024-04-25T22:03:45.689 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.689 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.689 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.689 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7098 3.9 3:9359a9e9:::100000016e0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.689 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:45.689 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.756497763, 2024-04-25T22:03:45.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.034065142, 2024-04-25T22:03:45.689 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.689 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.689 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:45.689 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:45.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:45.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846432+0000", 2024-04-25T22:03:45.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.88e-06 2024-04-25T22:03:45.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846440+0000", 2024-04-25T22:03:45.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7120000000000006e-06 2024-04-25T22:03:45.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846463+0000", 2024-04-25T22:03:45.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2416e-05 2024-04-25T22:03:45.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846479+0000", 2024-04-25T22:03:45.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6484999999999999e-05 2024-04-25T22:03:45.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846718+0000", 2024-04-25T22:03:45.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023839299999999999 2024-04-25T22:03:45.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846729+0000", 2024-04-25T22:03:45.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0896999999999999e-05 2024-04-25T22:03:45.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872537+0000", 2024-04-25T22:03:45.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0258087 2024-04-25T22:03:45.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:45.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872831+0000", 2024-04-25T22:03:45.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029391399999999999 2024-04-25T22:03:45.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880495+0000", 2024-04-25T22:03:45.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0076637449999999996 2024-04-25T22:03:45.693 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.693 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.693 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.693 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7100 4.1 4:83bc2484:::100000016e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.694 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:45.694 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.755444634, 2024-04-25T22:03:45.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.03260128, 2024-04-25T22:03:45.694 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.694 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.694 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.694 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:45.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:45.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847484+0000", 2024-04-25T22:03:45.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.443e-06 2024-04-25T22:03:45.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847491+0000", 2024-04-25T22:03:45.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4300000000000003e-06 2024-04-25T22:03:45.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847505+0000", 2024-04-25T22:03:45.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4014e-05 2024-04-25T22:03:45.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847514+0000", 2024-04-25T22:03:45.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4350000000000003e-06 2024-04-25T22:03:45.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847571+0000", 2024-04-25T22:03:45.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6338999999999997e-05 2024-04-25T22:03:45.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847580+0000", 2024-04-25T22:03:45.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0680000000000003e-06 2024-04-25T22:03:45.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862224+0000", 2024-04-25T22:03:45.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0146447279999999 2024-04-25T22:03:45.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:45.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862676+0000", 2024-04-25T22:03:45.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045117300000000003 2024-04-25T22:03:45.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:45.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862992+0000", 2024-04-25T22:03:45.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000316607 2024-04-25T22:03:45.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:45.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879035+0000", 2024-04-25T22:03:45.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016043168999999999 2024-04-25T22:03:45.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879762+0000", 2024-04-25T22:03:45.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00072643100000000004 2024-04-25T22:03:45.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:45.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879993+0000", 2024-04-25T22:03:45.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023091799999999999 2024-04-25T22:03:45.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880084+0000", 2024-04-25T22:03:45.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1525000000000002e-05 2024-04-25T22:03:45.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.700 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.700 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7105 4.1d 4:b83d3758:::10000001718.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.700 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:45.700 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.754394346, 2024-04-25T22:03:45.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0317263169999999, 2024-04-25T22:03:45.700 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.700 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.700 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.700 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:45.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:45.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848534+0000", 2024-04-25T22:03:45.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1200000000000001e-06 2024-04-25T22:03:45.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848541+0000", 2024-04-25T22:03:45.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4749999999999998e-06 2024-04-25T22:03:45.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848551+0000", 2024-04-25T22:03:45.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.039e-05 2024-04-25T22:03:45.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848558+0000", 2024-04-25T22:03:45.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2520000000000002e-06 2024-04-25T22:03:45.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848703+0000", 2024-04-25T22:03:45.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014466699999999999 2024-04-25T22:03:45.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848709+0000", 2024-04-25T22:03:45.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-04-25T22:03:45.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866810+0000", 2024-04-25T22:03:45.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.018101293 2024-04-25T22:03:45.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:45.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867282+0000", 2024-04-25T22:03:45.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047148999999999997 2024-04-25T22:03:45.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:45.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867555+0000", 2024-04-25T22:03:45.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027314100000000002 2024-04-25T22:03:45.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:45.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877648+0000", 2024-04-25T22:03:45.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010093275000000001 2024-04-25T22:03:45.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880012+0000", 2024-04-25T22:03:45.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023639590000000001 2024-04-25T22:03:45.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:45.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880157+0000", 2024-04-25T22:03:45.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000144532 2024-04-25T22:03:45.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880260+0000", 2024-04-25T22:03:45.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103016 2024-04-25T22:03:45.706 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.706 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.706 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.706 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7116 4.27 4:e60ee3a4:::10000001a5f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.706 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:45.706 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.750239736999999, 2024-04-25T22:03:45.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0375457480000001, 2024-04-25T22:03:45.706 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.706 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.706 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.706 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:45.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:45.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:45.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-04-25T22:03:45.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852694+0000", 2024-04-25T22:03:45.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0360000000000003e-06 2024-04-25T22:03:45.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852702+0000", 2024-04-25T22:03:45.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1470000000000004e-06 2024-04-25T22:03:45.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852708+0000", 2024-04-25T22:03:45.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1210000000000003e-06 2024-04-25T22:03:45.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852762+0000", 2024-04-25T22:03:45.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4166000000000003e-05 2024-04-25T22:03:45.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852769+0000", 2024-04-25T22:03:45.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8000000000000001e-06 2024-04-25T22:03:45.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880804+0000", 2024-04-25T22:03:45.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.028035695 2024-04-25T22:03:45.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:45.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881105+0000", 2024-04-25T22:03:45.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030039999999999998 2024-04-25T22:03:45.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:45.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881373+0000", 2024-04-25T22:03:45.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026843499999999997 2024-04-25T22:03:45.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:45.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884999+0000", 2024-04-25T22:03:45.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036262070000000002 2024-04-25T22:03:45.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.889903+0000", 2024-04-25T22:03:45.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049036260000000003 2024-04-25T22:03:45.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:45.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890114+0000", 2024-04-25T22:03:45.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021130500000000001 2024-04-25T22:03:45.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890234+0000", 2024-04-25T22:03:45.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011922900000000001 2024-04-25T22:03:45.712 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.712 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.712 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.712 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7121 4.1f 4:fab6744c:::10000001a64.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.712 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:45.712 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.749747065999999, 2024-04-25T22:03:45.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.031414587, 2024-04-25T22:03:45.712 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.712 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.712 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.712 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:45.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:45.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:45.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1299999999999999e-07 2024-04-25T22:03:45.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853184+0000", 2024-04-25T22:03:45.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1779999999999999e-06 2024-04-25T22:03:45.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853192+0000", 2024-04-25T22:03:45.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.294e-06 2024-04-25T22:03:45.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853196+0000", 2024-04-25T22:03:45.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6330000000000004e-06 2024-04-25T22:03:45.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853249+0000", 2024-04-25T22:03:45.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2785999999999999e-05 2024-04-25T22:03:45.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853260+0000", 2024-04-25T22:03:45.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1027e-05 2024-04-25T22:03:45.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875944+0000", 2024-04-25T22:03:45.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0226834810000001 2024-04-25T22:03:45.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:45.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876230+0000", 2024-04-25T22:03:45.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000286357 2024-04-25T22:03:45.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:45.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876512+0000", 2024-04-25T22:03:45.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028174500000000002 2024-04-25T22:03:45.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:45.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880727+0000", 2024-04-25T22:03:45.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042150520000000004 2024-04-25T22:03:45.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884386+0000", 2024-04-25T22:03:45.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036589069999999999 2024-04-25T22:03:45.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:45.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884502+0000", 2024-04-25T22:03:45.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000115862 2024-04-25T22:03:45.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884595+0000", 2024-04-25T22:03:45.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3552000000000001e-05 2024-04-25T22:03:45.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.718 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.718 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7127 4.22 4:476940b8:::10000001b50.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.718 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:45.718 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.748639070999999, 2024-04-25T22:03:45.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.035873665, 2024-04-25T22:03:45.719 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.719 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.719 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.719 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:45.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:45.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854290+0000", 2024-04-25T22:03:45.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.313e-06 2024-04-25T22:03:45.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854295+0000", 2024-04-25T22:03:45.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3580000000000002e-06 2024-04-25T22:03:45.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854310+0000", 2024-04-25T22:03:45.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4742e-05 2024-04-25T22:03:45.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854318+0000", 2024-04-25T22:03:45.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2570000000000007e-06 2024-04-25T22:03:45.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854383+0000", 2024-04-25T22:03:45.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4535999999999993e-05 2024-04-25T22:03:45.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854390+0000", 2024-04-25T22:03:45.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3930000000000002e-06 2024-04-25T22:03:45.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879471+0000", 2024-04-25T22:03:45.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0250810260000001 2024-04-25T22:03:45.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:45.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879790+0000", 2024-04-25T22:03:45.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031862699999999998 2024-04-25T22:03:45.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:45.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880048+0000", 2024-04-25T22:03:45.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025776199999999998 2024-04-25T22:03:45.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:45.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882261+0000", 2024-04-25T22:03:45.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022130259999999999 2024-04-25T22:03:45.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.889734+0000", 2024-04-25T22:03:45.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0074735859999999999 2024-04-25T22:03:45.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:45.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890063+0000", 2024-04-25T22:03:45.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032892000000000002 2024-04-25T22:03:45.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890162+0000", 2024-04-25T22:03:45.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9118999999999997e-05 2024-04-25T22:03:45.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.725 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.725 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7135 4.27 4:e7bfb438:::10000001b58.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:45.725 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:45.725 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.745829540999999, 2024-04-25T22:03:45.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.033436429, 2024-04-25T22:03:45.725 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:45.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:45.726 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:45.726 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:45.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:45.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:45.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:45.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:45.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:45.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:45.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857099+0000", 2024-04-25T22:03:45.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0270000000000001e-06 2024-04-25T22:03:45.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:45.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857104+0000", 2024-04-25T22:03:45.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6909999999999996e-06 2024-04-25T22:03:45.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:45.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857116+0000", 2024-04-25T22:03:45.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2384999999999999e-05 2024-04-25T22:03:45.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857124+0000", 2024-04-25T22:03:45.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3080000000000008e-06 2024-04-25T22:03:45.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857175+0000", 2024-04-25T22:03:45.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0107e-05 2024-04-25T22:03:45.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:45.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857185+0000", 2024-04-25T22:03:45.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-04-25T22:03:45.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:45.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882135+0000", 2024-04-25T22:03:45.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.024950322 2024-04-25T22:03:45.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:45.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882426+0000", 2024-04-25T22:03:45.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029100699999999997 2024-04-25T22:03:45.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:45.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882689+0000", 2024-04-25T22:03:45.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026236800000000002 2024-04-25T22:03:45.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:45.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.885017+0000", 2024-04-25T22:03:45.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023282020000000001 2024-04-25T22:03:45.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:45.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890320+0000", 2024-04-25T22:03:45.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0053037049999999997 2024-04-25T22:03:45.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:45.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890428+0000", 2024-04-25T22:03:45.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107593 2024-04-25T22:03:45.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:45.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:45.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:45.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890534+0000", 2024-04-25T22:03:45.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106469 2024-04-25T22:03:45.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.731 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:45.731 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:45.731 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:45.733 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T22:03:45.734 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:45.735 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:45.732+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:45.833 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:45.832+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:45.880 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18733 4.30 4:0e9f34ca:::10000002720.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e75)", 2024-04-25T22:03:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:45.876117+0000", 2024-04-25T22:03:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.002629316, 2024-04-25T22:03:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0026476730000000001, 2024-04-25T22:03:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:45.881 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:45.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:45.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876117+0000", 2024-04-25T22:03:45.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:45.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876117+0000", 2024-04-25T22:03:45.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:45.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876124+0000", 2024-04-25T22:03:45.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8329999999999996e-06 2024-04-25T22:03:45.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:45.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876135+0000", 2024-04-25T22:03:45.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0924000000000001e-05 2024-04-25T22:03:45.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:45.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876188+0000", 2024-04-25T22:03:45.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2666e-05 2024-04-25T22:03:45.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876209+0000", 2024-04-25T22:03:45.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1693000000000001e-05 2024-04-25T22:03:45.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:45.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876339+0000", 2024-04-25T22:03:45.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012991500000000001 2024-04-25T22:03:45.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:45.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876647+0000", 2024-04-25T22:03:45.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030787399999999997 2024-04-25T22:03:45.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:45.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876812+0000", 2024-04-25T22:03:45.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000165119 2024-04-25T22:03:45.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:45.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.877879+0000", 2024-04-25T22:03:45.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0010668559999999999 2024-04-25T22:03:45.884 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.885 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:45.885 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.885 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18735 4.3a 4:5fa5684d:::10000002722.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e75)", 2024-04-25T22:03:45.885 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:45.876258+0000", 2024-04-25T22:03:45.885 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0024887500000000001, 2024-04-25T22:03:45.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025556250000000002, 2024-04-25T22:03:45.885 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:45.885 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:45.885 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:45.885 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:45.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:45.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876258+0000", 2024-04-25T22:03:45.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:45.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876258+0000", 2024-04-25T22:03:45.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:45.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876260+0000", 2024-04-25T22:03:45.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:03:45.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:45.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876266+0000", 2024-04-25T22:03:45.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7329999999999997e-06 2024-04-25T22:03:45.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:45.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876289+0000", 2024-04-25T22:03:45.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2544e-05 2024-04-25T22:03:45.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876305+0000", 2024-04-25T22:03:45.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6416e-05 2024-04-25T22:03:45.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:45.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876428+0000", 2024-04-25T22:03:45.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012261499999999999 2024-04-25T22:03:45.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:45.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876513+0000", 2024-04-25T22:03:45.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5024000000000005e-05 2024-04-25T22:03:45.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:45.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876569+0000", 2024-04-25T22:03:45.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6048999999999998e-05 2024-04-25T22:03:45.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:45.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.877611+0000", 2024-04-25T22:03:45.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0010423419999999999 2024-04-25T22:03:45.889 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.889 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:45.889 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.889 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18739 4.a 4:5275ca27:::1000000272b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e75)", 2024-04-25T22:03:45.889 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:45.878029+0000", 2024-04-25T22:03:45.889 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00071727200000000003, 2024-04-25T22:03:45.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00086306000000000002, 2024-04-25T22:03:45.889 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:45.889 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:45.890 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:45.890 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:45.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:45.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878029+0000", 2024-04-25T22:03:45.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:45.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878029+0000", 2024-04-25T22:03:45.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:45.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878030+0000", 2024-04-25T22:03:45.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.61e-07 2024-04-25T22:03:45.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:45.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878033+0000", 2024-04-25T22:03:45.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3179999999999998e-06 2024-04-25T22:03:45.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:45.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878043+0000", 2024-04-25T22:03:45.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3759999999999997e-06 2024-04-25T22:03:45.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878049+0000", 2024-04-25T22:03:45.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8719999999999999e-06 2024-04-25T22:03:45.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:45.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878088+0000", 2024-04-25T22:03:45.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9007000000000001e-05 2024-04-25T22:03:45.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:45.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878202+0000", 2024-04-25T22:03:45.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011423500000000001 2024-04-25T22:03:45.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:45.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878524+0000", 2024-04-25T22:03:45.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032208999999999997 2024-04-25T22:03:45.893 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.893 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:45.893 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.894 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop_reply(mds.0.3:18727 4.a e75/16)", 2024-04-25T22:03:45.894 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:45.878143+0000", 2024-04-25T22:03:45.894 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.000603839, 2024-04-25T22:03:45.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00079452600000000004, 2024-04-25T22:03:45.894 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:45.894 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:45.894 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-25T22:03:45.894 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:45.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:45.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878143+0000", 2024-04-25T22:03:45.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:45.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878143+0000", 2024-04-25T22:03:45.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:45.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878143+0000", 2024-04-25T22:03:45.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9200000000000002e-07 2024-04-25T22:03:45.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:45.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878146+0000", 2024-04-25T22:03:45.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4760000000000001e-06 2024-04-25T22:03:45.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:45.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878153+0000", 2024-04-25T22:03:45.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1280000000000002e-06 2024-04-25T22:03:45.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878158+0000", 2024-04-25T22:03:45.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.814e-06 2024-04-25T22:03:45.896 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.896 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:45.896 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.897 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:18713 4.11 e75/16 4:883df653:::10000002700.00000000:head v 75'461, mlcod=75'459)", 2024-04-25T22:03:45.897 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:45.878191+0000", 2024-04-25T22:03:45.897 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00055524000000000003, 2024-04-25T22:03:45.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00079194699999999999, 2024-04-25T22:03:45.897 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:45.897 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:45.897 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-25T22:03:45.897 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:45.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:45.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878191+0000", 2024-04-25T22:03:45.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:45.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878191+0000", 2024-04-25T22:03:45.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:45.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878192+0000", 2024-04-25T22:03:45.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5600000000000001e-07 2024-04-25T22:03:45.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:45.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878208+0000", 2024-04-25T22:03:45.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5809000000000001e-05 2024-04-25T22:03:45.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:45.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878215+0000", 2024-04-25T22:03:45.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3200000000000002e-06 2024-04-25T22:03:45.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878220+0000", 2024-04-25T22:03:45.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1030000000000001e-06 2024-04-25T22:03:45.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:45.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878316+0000", 2024-04-25T22:03:45.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5958000000000005e-05 2024-04-25T22:03:45.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:45.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878418+0000", 2024-04-25T22:03:45.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102326 2024-04-25T22:03:45.900 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.900 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:45.900 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.900 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:18701 4.c e75/46 4:32edadb2:::100000026f4.00000000:head v 75'410, mlcod=75'408)", 2024-04-25T22:03:45.900 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:45.878234+0000", 2024-04-25T22:03:45.900 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00051239600000000003, 2024-04-25T22:03:45.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00078185500000000003, 2024-04-25T22:03:45.901 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:45.901 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:45.901 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-25T22:03:45.901 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:45.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:45.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878234+0000", 2024-04-25T22:03:45.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:45.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878234+0000", 2024-04-25T22:03:45.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:45.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878235+0000", 2024-04-25T22:03:45.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5999999999999999e-07 2024-04-25T22:03:45.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:45.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878238+0000", 2024-04-25T22:03:45.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4319999999999999e-06 2024-04-25T22:03:45.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:45.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878246+0000", 2024-04-25T22:03:45.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1119999999999996e-06 2024-04-25T22:03:45.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878252+0000", 2024-04-25T22:03:45.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1120000000000001e-06 2024-04-25T22:03:45.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:45.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878300+0000", 2024-04-25T22:03:45.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7834999999999999e-05 2024-04-25T22:03:45.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:45.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878318+0000", 2024-04-25T22:03:45.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8161000000000001e-05 2024-04-25T22:03:45.904 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.904 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:45.904 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.904 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18750 4.3c 4:3dd679f7:::1000000275d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e75)", 2024-04-25T22:03:45.904 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:45.878698+0000", 2024-04-25T22:03:45.904 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.8602e-05, 2024-04-25T22:03:45.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035467700000000002, 2024-04-25T22:03:45.904 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:45.904 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:45.904 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:45.905 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:45.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:45.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878698+0000", 2024-04-25T22:03:45.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:45.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878698+0000", 2024-04-25T22:03:45.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:45.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878699+0000", 2024-04-25T22:03:45.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:03:45.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:45.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878704+0000", 2024-04-25T22:03:45.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0669999999999999e-06 2024-04-25T22:03:45.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:45.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878716+0000", 2024-04-25T22:03:45.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1202999999999999e-05 2024-04-25T22:03:45.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878722+0000", 2024-04-25T22:03:45.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.567e-06 2024-04-25T22:03:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878777+0000", 2024-04-25T22:03:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5064e-05 2024-04-25T22:03:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878849+0000", 2024-04-25T22:03:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2018000000000001e-05 2024-04-25T22:03:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878920+0000", 2024-04-25T22:03:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1070999999999998e-05 2024-04-25T22:03:45.907 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.19 epoch 75/15 rep_tid 15138 entries 75'198 (0'0) error 3:98c4222a:::1000000271c.00000000:head by mds.0.3:18729 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 75'196)", 2024-04-25T22:03:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:45.878826+0000", 2024-04-25T22:03:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9999204, 2024-04-25T22:03:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027378199999999998, 2024-04-25T22:03:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-25T22:03:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878826+0000", 2024-04-25T22:03:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878826+0000", 2024-04-25T22:03:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878827+0000", 2024-04-25T22:03:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7299999999999995e-07 2024-04-25T22:03:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878834+0000", 2024-04-25T22:03:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.413e-06 2024-04-25T22:03:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878851+0000", 2024-04-25T22:03:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.698e-05 2024-04-25T22:03:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878865+0000", 2024-04-25T22:03:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3558e-05 2024-04-25T22:03:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.878939+0000", 2024-04-25T22:03:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4077000000000002e-05 2024-04-25T22:03:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.910 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18727 4.a 4:5005c55b:::1000000271a.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e75)", 2024-04-25T22:03:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:45.874571+0000", 2024-04-25T22:03:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0041753169999999996, 2024-04-25T22:03:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045596860000000003, 2024-04-25T22:03:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.874571+0000", 2024-04-25T22:03:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.874571+0000", 2024-04-25T22:03:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.874572+0000", 2024-04-25T22:03:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7299999999999995e-07 2024-04-25T22:03:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.874576+0000", 2024-04-25T22:03:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8029999999999998e-06 2024-04-25T22:03:45.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.874590+0000", 2024-04-25T22:03:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.378e-05 2024-04-25T22:03:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.874594+0000", 2024-04-25T22:03:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7849999999999999e-06 2024-04-25T22:03:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.874642+0000", 2024-04-25T22:03:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7837000000000003e-05 2024-04-25T22:03:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.874722+0000", 2024-04-25T22:03:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0103000000000002e-05 2024-04-25T22:03:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.874773+0000", 2024-04-25T22:03:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1034e-05 2024-04-25T22:03:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876869+0000", 2024-04-25T22:03:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00209531 2024-04-25T22:03:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18732 4.18 4:197e1532:::1000000271f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e75)", 2024-04-25T22:03:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:45.875760+0000", 2024-04-25T22:03:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0029865880000000001, 2024-04-25T22:03:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034117560000000002, 2024-04-25T22:03:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:45.915 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:03:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.875760+0000", 2024-04-25T22:03:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.875760+0000", 2024-04-25T22:03:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.875761+0000", 2024-04-25T22:03:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7199999999999999e-07 2024-04-25T22:03:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.875763+0000", 2024-04-25T22:03:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4059999999999999e-06 2024-04-25T22:03:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.875771+0000", 2024-04-25T22:03:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6120000000000001e-06 2024-04-25T22:03:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.875776+0000", 2024-04-25T22:03:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3279999999999996e-06 2024-04-25T22:03:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.875835+0000", 2024-04-25T22:03:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8823000000000002e-05 2024-04-25T22:03:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.875965+0000", 2024-04-25T22:03:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013004299999999999 2024-04-25T22:03:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.876089+0000", 2024-04-25T22:03:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000124597 2024-04-25T22:03:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:45.877571+0000", 2024-04-25T22:03:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014812339999999999 2024-04-25T22:03:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:03:45.919 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 10 2024-04-25T22:03:45.919 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:45.921 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:45.934 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:45.932+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:46.004 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-25T22:03:46.035 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:46.032+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:46.060 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-04-25T22:03:46.079 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T22:03:46.086 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:46.086 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:46.086 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:03:46.086 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:03:46.086 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:46.100 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:46.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:46.136+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:46.229 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:03:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:03:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T22:03:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 54.240488417999998, 2024-04-25T22:03:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.180276931, 2024-04-25T22:03:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4 2024-04-25T22:03:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983834+0000", 2024-04-25T22:03:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2900000000000001e-06 2024-04-25T22:03:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991787+0000", 2024-04-25T22:03:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079521690000000003 2024-04-25T22:03:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991826+0000", 2024-04-25T22:03:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9258999999999998e-05 2024-04-25T22:03:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991845+0000", 2024-04-25T22:03:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9360000000000001e-05 2024-04-25T22:03:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992058+0000", 2024-04-25T22:03:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212559 2024-04-25T22:03:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992213+0000", 2024-04-25T22:03:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015520700000000001 2024-04-25T22:03:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992414+0000", 2024-04-25T22:03:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020049 2024-04-25T22:03:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162511+0000", 2024-04-25T22:03:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.17009782900000001 2024-04-25T22:03:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163967+0000", 2024-04-25T22:03:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001455752 2024-04-25T22:03:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164045+0000", 2024-04-25T22:03:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7415000000000003e-05 2024-04-25T22:03:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164109+0000", 2024-04-25T22:03:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4601e-05 2024-04-25T22:03:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6847 4.16 4:68767fd1:::10000001f4f.00000000:head [write 0~7212] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.530848957000003, 2024-04-25T22:03:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0208302119999999, 2024-04-25T22:03:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6847 2024-04-25T22:03:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693473+0000", 2024-04-25T22:03:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.75e-06 2024-04-25T22:03:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693490+0000", 2024-04-25T22:03:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6540000000000001e-05 2024-04-25T22:03:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693509+0000", 2024-04-25T22:03:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9536999999999999e-05 2024-04-25T22:03:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693522+0000", 2024-04-25T22:03:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2099000000000001e-05 2024-04-25T22:03:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693677+0000", 2024-04-25T22:03:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015516799999999999 2024-04-25T22:03:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693705+0000", 2024-04-25T22:03:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8663e-05 2024-04-25T22:03:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705551+0000", 2024-04-25T22:03:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.011845495 2024-04-25T22:03:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705942+0000", 2024-04-25T22:03:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00039080099999999997 2024-04-25T22:03:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.706151+0000", 2024-04-25T22:03:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000209457 2024-04-25T22:03:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711141+0000", 2024-04-25T22:03:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049901240000000003 2024-04-25T22:03:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714005+0000", 2024-04-25T22:03:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028642229999999999 2024-04-25T22:03:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714180+0000", 2024-04-25T22:03:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017433699999999999 2024-04-25T22:03:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714302+0000", 2024-04-25T22:03:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122018 2024-04-25T22:03:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6960 4.16 4:6823d322:::10000001fd2.00000000:head [write 0~150] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.253844858999997, 2024-04-25T22:03:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.74417278899999995, 2024-04-25T22:03:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6960 2024-04-25T22:03:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970478+0000", 2024-04-25T22:03:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.939e-06 2024-04-25T22:03:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970488+0000", 2024-04-25T22:03:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9699999999999994e-06 2024-04-25T22:03:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970524+0000", 2024-04-25T22:03:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5963000000000001e-05 2024-04-25T22:03:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970537+0000", 2024-04-25T22:03:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.31e-05 2024-04-25T22:03:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970701+0000", 2024-04-25T22:03:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164177 2024-04-25T22:03:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970718+0000", 2024-04-25T22:03:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7323e-05 2024-04-25T22:03:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707632+0000", 2024-04-25T22:03:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.73691394300000002 2024-04-25T22:03:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707924+0000", 2024-04-25T22:03:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029223299999999998 2024-04-25T22:03:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.708389+0000", 2024-04-25T22:03:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046429300000000001 2024-04-25T22:03:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029039830000000002 2024-04-25T22:03:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714409+0000", 2024-04-25T22:03:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031159260000000002 2024-04-25T22:03:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714538+0000", 2024-04-25T22:03:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012952100000000001 2024-04-25T22:03:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714649+0000", 2024-04-25T22:03:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110418 2024-04-25T22:03:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7039 4.16 4:6919637e:::10000002032.00000000:head [write 0~2968] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.067798353999997, 2024-04-25T22:03:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.56024932199999999, 2024-04-25T22:03:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7039 2024-04-25T22:03:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156523+0000", 2024-04-25T22:03:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2130000000000001e-06 2024-04-25T22:03:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156530+0000", 2024-04-25T22:03:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9090000000000003e-06 2024-04-25T22:03:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156544+0000", 2024-04-25T22:03:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3271999999999999e-05 2024-04-25T22:03:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156551+0000", 2024-04-25T22:03:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4970000000000004e-06 2024-04-25T22:03:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156639+0000", 2024-04-25T22:03:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7638000000000004e-05 2024-04-25T22:03:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156649+0000", 2024-04-25T22:03:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0536e-05 2024-04-25T22:03:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709515+0000", 2024-04-25T22:03:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.55286568999999997 2024-04-25T22:03:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709836+0000", 2024-04-25T22:03:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032078899999999998 2024-04-25T22:03:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.710271+0000", 2024-04-25T22:03:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043530000000000001 2024-04-25T22:03:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716576+0000", 2024-04-25T22:03:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063045050000000002 2024-04-25T22:03:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716605+0000", 2024-04-25T22:03:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8949e-05 2024-04-25T22:03:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716706+0000", 2024-04-25T22:03:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101765 2024-04-25T22:03:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716772+0000", 2024-04-25T22:03:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5259000000000007e-05 2024-04-25T22:03:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7065 4.16 4:697a9f10:::10000002050.00000000:head [write 0~16297] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.010182405999998, 2024-04-25T22:03:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.50307290800000004, 2024-04-25T22:03:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7065 2024-04-25T22:03:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214139+0000", 2024-04-25T22:03:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.186e-06 2024-04-25T22:03:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214170+0000", 2024-04-25T22:03:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0419000000000001e-05 2024-04-25T22:03:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214186+0000", 2024-04-25T22:03:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6526000000000001e-05 2024-04-25T22:03:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214194+0000", 2024-04-25T22:03:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6769999999999995e-06 2024-04-25T22:03:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214380+0000", 2024-04-25T22:03:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018580699999999999 2024-04-25T22:03:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214399+0000", 2024-04-25T22:03:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9446e-05 2024-04-25T22:03:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711402+0000", 2024-04-25T22:03:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.497002901 2024-04-25T22:03:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711822+0000", 2024-04-25T22:03:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00041989399999999997 2024-04-25T22:03:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.712017+0000", 2024-04-25T22:03:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019540700000000001 2024-04-25T22:03:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716792+0000", 2024-04-25T22:03:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047748210000000003 2024-04-25T22:03:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716937+0000", 2024-04-25T22:03:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014479099999999999 2024-04-25T22:03:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717081+0000", 2024-04-25T22:03:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014412100000000001 2024-04-25T22:03:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717211+0000", 2024-04-25T22:03:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012991200000000001 2024-04-25T22:03:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7089 4.16 4:6868fcac:::1000000206b.00000000:head [write 0~5386] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.950628412, 2024-04-25T22:03:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44658810700000001, 2024-04-25T22:03:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7089 2024-04-25T22:03:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273695+0000", 2024-04-25T22:03:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.463e-06 2024-04-25T22:03:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273712+0000", 2024-04-25T22:03:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7842999999999998e-05 2024-04-25T22:03:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273742+0000", 2024-04-25T22:03:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9039000000000001e-05 2024-04-25T22:03:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273756+0000", 2024-04-25T22:03:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4406999999999999e-05 2024-04-25T22:03:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273943+0000", 2024-04-25T22:03:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018708 2024-04-25T22:03:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273961+0000", 2024-04-25T22:03:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7977000000000001e-05 2024-04-25T22:03:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714748+0000", 2024-04-25T22:03:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.440786605 2024-04-25T22:03:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715013+0000", 2024-04-25T22:03:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026558300000000001 2024-04-25T22:03:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715309+0000", 2024-04-25T22:03:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000295715 2024-04-25T22:03:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.719035+0000", 2024-04-25T22:03:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037256310000000001 2024-04-25T22:03:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720142+0000", 2024-04-25T22:03:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001107053 2024-04-25T22:03:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720221+0000", 2024-04-25T22:03:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9832000000000004e-05 2024-04-25T22:03:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720280+0000", 2024-04-25T22:03:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8879000000000003e-05 2024-04-25T22:03:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7090 4.16 4:69dc3034:::1000000206c.00000000:head [write 0~957] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.948004081999997, 2024-04-25T22:03:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44572077100000002, 2024-04-25T22:03:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7090 2024-04-25T22:03:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276319+0000", 2024-04-25T22:03:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3429999999999998e-06 2024-04-25T22:03:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276330+0000", 2024-04-25T22:03:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1567e-05 2024-04-25T22:03:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276362+0000", 2024-04-25T22:03:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1863000000000003e-05 2024-04-25T22:03:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276377+0000", 2024-04-25T22:03:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5102999999999999e-05 2024-04-25T22:03:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276564+0000", 2024-04-25T22:03:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018629700000000001 2024-04-25T22:03:46.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:46.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276583+0000", 2024-04-25T22:03:46.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9743000000000001e-05 2024-04-25T22:03:46.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717354+0000", 2024-04-25T22:03:46.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44077094900000002 2024-04-25T22:03:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717723+0000", 2024-04-25T22:03:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036839099999999998 2024-04-25T22:03:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.718097+0000", 2024-04-25T22:03:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037392099999999999 2024-04-25T22:03:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720305+0000", 2024-04-25T22:03:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022084439999999999 2024-04-25T22:03:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721866+0000", 2024-04-25T22:03:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015610260000000001 2024-04-25T22:03:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721944+0000", 2024-04-25T22:03:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7961999999999997e-05 2024-04-25T22:03:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.722037+0000", 2024-04-25T22:03:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3162e-05 2024-04-25T22:03:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:10647 4.35 4:ae7b229b:::100000030a9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.694959388000001, 2024-04-25T22:03:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14506126, 2024-04-25T22:03:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10647 2024-04-25T22:03:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529364+0000", 2024-04-25T22:03:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.286e-06 2024-04-25T22:03:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538917+0000", 2024-04-25T22:03:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0095530010000000002 2024-04-25T22:03:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538955+0000", 2024-04-25T22:03:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:03:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538977+0000", 2024-04-25T22:03:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.105e-05 2024-04-25T22:03:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568092+0000", 2024-04-25T22:03:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029115604999999999 2024-04-25T22:03:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568243+0000", 2024-04-25T22:03:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000151044 2024-04-25T22:03:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568498+0000", 2024-04-25T22:03:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025517399999999999 2024-04-25T22:03:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628005+0000", 2024-04-25T22:03:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059506991000000002 2024-04-25T22:03:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674273+0000", 2024-04-25T22:03:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.046267233999999997 2024-04-25T22:03:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674357+0000", 2024-04-25T22:03:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4745000000000003e-05 2024-04-25T22:03:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674422+0000", 2024-04-25T22:03:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5160999999999995e-05 2024-04-25T22:03:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3891938~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.541639801999999, 2024-04-25T22:03:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.144195727, 2024-04-25T22:03:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682682+0000", 2024-04-25T22:03:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6000000000000003e-07 2024-04-25T22:03:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682686+0000", 2024-04-25T22:03:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4630000000000003e-06 2024-04-25T22:03:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682695+0000", 2024-04-25T22:03:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7360000000000007e-06 2024-04-25T22:03:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682702+0000", 2024-04-25T22:03:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1239999999999999e-06 2024-04-25T22:03:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821515+0000", 2024-04-25T22:03:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13881310499999999 2024-04-25T22:03:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821780+0000", 2024-04-25T22:03:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026492699999999998 2024-04-25T22:03:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821974+0000", 2024-04-25T22:03:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000194561 2024-04-25T22:03:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826533+0000", 2024-04-25T22:03:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045586649999999999 2024-04-25T22:03:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826574+0000", 2024-04-25T22:03:46.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0995999999999998e-05 2024-04-25T22:03:46.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826754+0000", 2024-04-25T22:03:46.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017955400000000001 2024-04-25T22:03:46.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826877+0000", 2024-04-25T22:03:46.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122836 2024-04-25T22:03:46.282 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.282 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3893337~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.541609969, 2024-04-25T22:03:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.146040321, 2024-04-25T22:03:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:03:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682716+0000", 2024-04-25T22:03:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3930000000000001e-06 2024-04-25T22:03:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682724+0000", 2024-04-25T22:03:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5769999999999994e-06 2024-04-25T22:03:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682731+0000", 2024-04-25T22:03:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1629999999999999e-06 2024-04-25T22:03:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823295+0000", 2024-04-25T22:03:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14056342099999999 2024-04-25T22:03:46.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823578+0000", 2024-04-25T22:03:46.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028355299999999997 2024-04-25T22:03:46.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823777+0000", 2024-04-25T22:03:46.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000198791 2024-04-25T22:03:46.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826993+0000", 2024-04-25T22:03:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032162169999999999 2024-04-25T22:03:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828492+0000", 2024-04-25T22:03:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001498283 2024-04-25T22:03:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828633+0000", 2024-04-25T22:03:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000141225 2024-04-25T22:03:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828751+0000", 2024-04-25T22:03:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000118038 2024-04-25T22:03:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3899493~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.532015954999999, 2024-04-25T22:03:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14539154500000001, 2024-04-25T22:03:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692307+0000", 2024-04-25T22:03:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.216e-06 2024-04-25T22:03:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692316+0000", 2024-04-25T22:03:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:03:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692357+0000", 2024-04-25T22:03:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233000000000003e-05 2024-04-25T22:03:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692375+0000", 2024-04-25T22:03:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7949999999999999e-05 2024-04-25T22:03:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828922+0000", 2024-04-25T22:03:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.136546426 2024-04-25T22:03:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.829064+0000", 2024-04-25T22:03:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014193499999999999 2024-04-25T22:03:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.829295+0000", 2024-04-25T22:03:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023144100000000001 2024-04-25T22:03:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832412+0000", 2024-04-25T22:03:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003117112 2024-04-25T22:03:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837543+0000", 2024-04-25T22:03:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005131147 2024-04-25T22:03:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837629+0000", 2024-04-25T22:03:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5378999999999997e-05 2024-04-25T22:03:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837696+0000", 2024-04-25T22:03:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7426000000000001e-05 2024-04-25T22:03:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3901402~4724 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.528513654000001, 2024-04-25T22:03:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14672065500000001, 2024-04-25T22:03:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695809+0000", 2024-04-25T22:03:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1100000000000001e-06 2024-04-25T22:03:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695828+0000", 2024-04-25T22:03:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8618999999999999e-05 2024-04-25T22:03:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695850+0000", 2024-04-25T22:03:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2243e-05 2024-04-25T22:03:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695864+0000", 2024-04-25T22:03:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3687e-05 2024-04-25T22:03:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831024+0000", 2024-04-25T22:03:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13516004300000001 2024-04-25T22:03:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831155+0000", 2024-04-25T22:03:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000131605 2024-04-25T22:03:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831353+0000", 2024-04-25T22:03:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000197708 2024-04-25T22:03:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837521+0000", 2024-04-25T22:03:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0061684180000000002 2024-04-25T22:03:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842269+0000", 2024-04-25T22:03:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047475659999999999 2024-04-25T22:03:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842402+0000", 2024-04-25T22:03:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000132643 2024-04-25T22:03:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842528+0000", 2024-04-25T22:03:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012601299999999999 2024-04-25T22:03:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3906126~6707 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.525251897, 2024-04-25T22:03:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14563398599999999, 2024-04-25T22:03:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699071+0000", 2024-04-25T22:03:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.996e-06 2024-04-25T22:03:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699090+0000", 2024-04-25T22:03:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9449999999999998e-05 2024-04-25T22:03:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699112+0000", 2024-04-25T22:03:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2306e-05 2024-04-25T22:03:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699126+0000", 2024-04-25T22:03:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.383e-05 2024-04-25T22:03:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832497+0000", 2024-04-25T22:03:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13337096500000001 2024-04-25T22:03:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832632+0000", 2024-04-25T22:03:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013481499999999999 2024-04-25T22:03:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832828+0000", 2024-04-25T22:03:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000195558 2024-04-25T22:03:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837801+0000", 2024-04-25T22:03:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049729459999999998 2024-04-25T22:03:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844398+0000", 2024-04-25T22:03:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065972829999999998 2024-04-25T22:03:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844594+0000", 2024-04-25T22:03:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000195675 2024-04-25T22:03:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844703+0000", 2024-04-25T22:03:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109162 2024-04-25T22:03:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3024 3.d 3:b02ffd62:::200.00000010:head [write 3912833~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.522187173999999, 2024-04-25T22:03:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14279916000000001, 2024-04-25T22:03:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702135+0000", 2024-04-25T22:03:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9530000000000002e-06 2024-04-25T22:03:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702154+0000", 2024-04-25T22:03:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8496e-05 2024-04-25T22:03:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702180+0000", 2024-04-25T22:03:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6313e-05 2024-04-25T22:03:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702205+0000", 2024-04-25T22:03:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.478e-05 2024-04-25T22:03:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836035+0000", 2024-04-25T22:03:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.133830269 2024-04-25T22:03:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836168+0000", 2024-04-25T22:03:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013234799999999999 2024-04-25T22:03:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836364+0000", 2024-04-25T22:03:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000196398 2024-04-25T22:03:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844793+0000", 2024-04-25T22:03:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.008428685 2024-04-25T22:03:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844811+0000", 2024-04-25T22:03:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8719000000000002e-05 2024-04-25T22:03:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844881+0000", 2024-04-25T22:03:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9671000000000004e-05 2024-04-25T22:03:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844933+0000", 2024-04-25T22:03:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1527999999999999e-05 2024-04-25T22:03:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3026 3.d 3:b02ffd62:::200.00000010:head [write 3919976~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.515502236, 2024-04-25T22:03:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14237590899999999, 2024-04-25T22:03:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708820+0000", 2024-04-25T22:03:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7600000000000001e-06 2024-04-25T22:03:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708832+0000", 2024-04-25T22:03:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1803e-05 2024-04-25T22:03:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708854+0000", 2024-04-25T22:03:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2467e-05 2024-04-25T22:03:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708872+0000", 2024-04-25T22:03:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7453e-05 2024-04-25T22:03:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842641+0000", 2024-04-25T22:03:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13376964099999999 2024-04-25T22:03:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842832+0000", 2024-04-25T22:03:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000190843 2024-04-25T22:03:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.843194+0000", 2024-04-25T22:03:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036169300000000001 2024-04-25T22:03:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845406+0000", 2024-04-25T22:03:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022118530000000002 2024-04-25T22:03:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851048+0000", 2024-04-25T22:03:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056423410000000004 2024-04-25T22:03:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851127+0000", 2024-04-25T22:03:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8461999999999995e-05 2024-04-25T22:03:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851194+0000", 2024-04-25T22:03:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7593000000000001e-05 2024-04-25T22:03:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3027 3.d 3:b02ffd62:::200.00000010:head [write 3922740~2927 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.515396957, 2024-04-25T22:03:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14516088799999999, 2024-04-25T22:03:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708925+0000", 2024-04-25T22:03:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.683e-06 2024-04-25T22:03:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708936+0000", 2024-04-25T22:03:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.11e-05 2024-04-25T22:03:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708960+0000", 2024-04-25T22:03:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3839999999999999e-05 2024-04-25T22:03:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708977+0000", 2024-04-25T22:03:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6379e-05 2024-04-25T22:03:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845488+0000", 2024-04-25T22:03:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.136511414 2024-04-25T22:03:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845619+0000", 2024-04-25T22:03:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000130755 2024-04-25T22:03:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845817+0000", 2024-04-25T22:03:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000198271 2024-04-25T22:03:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849529+0000", 2024-04-25T22:03:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003711888 2024-04-25T22:03:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.853911+0000", 2024-04-25T22:03:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043815800000000004 2024-04-25T22:03:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854018+0000", 2024-04-25T22:03:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000107879 2024-04-25T22:03:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854085+0000", 2024-04-25T22:03:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6099000000000005e-05 2024-04-25T22:03:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3028 3.d 3:b02ffd62:::200.00000010:head [write 3925667~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.514876413, 2024-04-25T22:03:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14478423600000001, 2024-04-25T22:03:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709446+0000", 2024-04-25T22:03:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.73e-06 2024-04-25T22:03:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709454+0000", 2024-04-25T22:03:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:03:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709470+0000", 2024-04-25T22:03:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5956000000000001e-05 2024-04-25T22:03:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709483+0000", 2024-04-25T22:03:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.216e-05 2024-04-25T22:03:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.846891+0000", 2024-04-25T22:03:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13740814600000001 2024-04-25T22:03:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.847019+0000", 2024-04-25T22:03:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000128121 2024-04-25T22:03:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.847227+0000", 2024-04-25T22:03:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020847800000000001 2024-04-25T22:03:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.852488+0000", 2024-04-25T22:03:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052603759999999998 2024-04-25T22:03:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854101+0000", 2024-04-25T22:03:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001613354 2024-04-25T22:03:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854170+0000", 2024-04-25T22:03:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8935000000000003e-05 2024-04-25T22:03:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854228+0000", 2024-04-25T22:03:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8437000000000003e-05 2024-04-25T22:03:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3029 3.d 3:b02ffd62:::200.00000010:head [write 3927576~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.514798550999998, 2024-04-25T22:03:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14641235599999999, 2024-04-25T22:03:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709523+0000", 2024-04-25T22:03:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9999999999999995e-07 2024-04-25T22:03:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709530+0000", 2024-04-25T22:03:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7900000000000002e-06 2024-04-25T22:03:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709545+0000", 2024-04-25T22:03:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5563e-05 2024-04-25T22:03:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709554+0000", 2024-04-25T22:03:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7700000000000007e-06 2024-04-25T22:03:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848071+0000", 2024-04-25T22:03:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13851706499999999 2024-04-25T22:03:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848219+0000", 2024-04-25T22:03:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014761599999999999 2024-04-25T22:03:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848412+0000", 2024-04-25T22:03:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019303300000000001 2024-04-25T22:03:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854240+0000", 2024-04-25T22:03:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058282359999999997 2024-04-25T22:03:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855804+0000", 2024-04-25T22:03:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001563938 2024-04-25T22:03:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855879+0000", 2024-04-25T22:03:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4683000000000003e-05 2024-04-25T22:03:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855934+0000", 2024-04-25T22:03:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5661999999999997e-05 2024-04-25T22:03:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3030 3.d 3:b02ffd62:::200.00000010:head [write 3929994~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.513380141999999, 2024-04-25T22:03:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.146870588, 2024-04-25T22:03:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710942+0000", 2024-04-25T22:03:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.024e-06 2024-04-25T22:03:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710955+0000", 2024-04-25T22:03:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2103000000000001e-05 2024-04-25T22:03:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710977+0000", 2024-04-25T22:03:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2606e-05 2024-04-25T22:03:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710991+0000", 2024-04-25T22:03:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3689999999999999e-05 2024-04-25T22:03:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849638+0000", 2024-04-25T22:03:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.138646667 2024-04-25T22:03:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849809+0000", 2024-04-25T22:03:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000171495 2024-04-25T22:03:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.850048+0000", 2024-04-25T22:03:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023940699999999999 2024-04-25T22:03:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855954+0000", 2024-04-25T22:03:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059050919999999998 2024-04-25T22:03:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857670+0000", 2024-04-25T22:03:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017168489999999999 2024-04-25T22:03:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857747+0000", 2024-04-25T22:03:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6526000000000006e-05 2024-04-25T22:03:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857811+0000", 2024-04-25T22:03:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4128999999999995e-05 2024-04-25T22:03:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3031 3.d 3:b02ffd62:::200.00000010:head [write 3932758~2245 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.513169693999998, 2024-04-25T22:03:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14694558999999999, 2024-04-25T22:03:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711152+0000", 2024-04-25T22:03:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5230000000000001e-06 2024-04-25T22:03:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711162+0000", 2024-04-25T22:03:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2299999999999997e-06 2024-04-25T22:03:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711179+0000", 2024-04-25T22:03:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7220000000000001e-05 2024-04-25T22:03:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711190+0000", 2024-04-25T22:03:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1323e-05 2024-04-25T22:03:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851296+0000", 2024-04-25T22:03:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14010541600000001 2024-04-25T22:03:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851436+0000", 2024-04-25T22:03:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140409 2024-04-25T22:03:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851641+0000", 2024-04-25T22:03:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020471700000000001 2024-04-25T22:03:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857847+0000", 2024-04-25T22:03:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062065310000000004 2024-04-25T22:03:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857952+0000", 2024-04-25T22:03:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105132 2024-04-25T22:03:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.858026+0000", 2024-04-25T22:03:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3799000000000003e-05 2024-04-25T22:03:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.858096+0000", 2024-04-25T22:03:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0290000000000006e-05 2024-04-25T22:03:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:46.339 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:46.341 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:46.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:46.336+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:46.425 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-04-25T22:03:46.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:46.436+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:46.445 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T22:03:46.473 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:46.473 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:46.473 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:03:46.473 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:46.486 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:46.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:46.572+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:46.643 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:46.640+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:46.652 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:03:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:03:46.652 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:46.666 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:46.752 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-04-25T22:03:46.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:46.752+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:46.772 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-04-25T22:03:46.772 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T22:03:46.778 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:03:46.839 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:46.839 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:46.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:46.839 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:46.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.839 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:46.839 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:46.839 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 54.749510475000001, 2024-04-25T22:03:46.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:46.839 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.839 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.839 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.839 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.840 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.840 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.840 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:46.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.840 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:46.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:46.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:46.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:46.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:46.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:46.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:46.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:46.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:46.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:46.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:46.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:46.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:46.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:46.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:46.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:46.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:46.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:46.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:46.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:46.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:46.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:46.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:46.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:46.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:46.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:46.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:46.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:46.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:46.845 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.845 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.845 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.845 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:46.845 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:46.845 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 54.739509712, 2024-04-25T22:03:46.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:46.846 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.846 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.846 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.846 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.846 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.846 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.846 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:46.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.846 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:46.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:46.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:46.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:46.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:46.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:46.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:46.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:46.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:46.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:46.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:46.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:46.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:46.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:46.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:46.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:46.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:46.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:46.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:46.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:46.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:46.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:46.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:46.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:46.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:46.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:46.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:46.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:46.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:46.851 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.851 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.851 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.852 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:46.852 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:46.852 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 54.735345438000003, 2024-04-25T22:03:46.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:46.852 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.852 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.852 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.852 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.852 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.852 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.852 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:46.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.852 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:46.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:46.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:46.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:46.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:46.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:46.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:46.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:46.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:46.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:46.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:46.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:46.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:46.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:46.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:46.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:46.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:46.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:46.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:46.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:46.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:46.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:46.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:46.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:46.857 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.857 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.857 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.857 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:46.857 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:46.857 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 54.733749121000002, 2024-04-25T22:03:46.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:46.858 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.858 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.858 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.858 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.858 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.858 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.858 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:46.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.858 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:46.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:46.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:46.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:46.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:46.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:46.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:46.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:46.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:46.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:46.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:46.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:46.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:46.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:46.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:46.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:46.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:46.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:46.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:46.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:46.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:46.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:46.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:46.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:46.862 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.862 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.862 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.863 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:46.863 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:46.863 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 54.676962871000001, 2024-04-25T22:03:46.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:46.863 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.863 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.863 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.863 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.863 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.863 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.863 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:46.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.863 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:46.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:46.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:46.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:46.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:46.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:46.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:46.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:46.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:46.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:46.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:46.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:46.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:46.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:46.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:46.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:46.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:46.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:46.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:46.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:46.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:46.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:46.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:46.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:46.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.868 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.868 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:46.868 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:46.868 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 54.661318604999998, 2024-04-25T22:03:46.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:46.869 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.869 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.869 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.869 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:46.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.869 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:46.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:46.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:46.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:46.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:46.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:46.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:46.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:46.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:46.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:46.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:46.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:46.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:46.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:46.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:46.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:46.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:46.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:46.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:46.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:46.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:46.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:46.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:46.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:46.874 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.874 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.874 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.874 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:46.874 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:46.874 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 54.656479914000002, 2024-04-25T22:03:46.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:46.874 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.874 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.874 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.874 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.875 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.875 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.875 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:46.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.875 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:46.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:46.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:46.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:46.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:46.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:46.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:46.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:46.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:46.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:46.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:46.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:46.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:46.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:46.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:46.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:46.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:46.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:46.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:46.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:46.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:46.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:46.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:46.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:46.879 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.879 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.879 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.880 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10648 4.33 4:cc614d18:::100000030cb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:46.880 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:46.880 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.297876602999999, 2024-04-25T22:03:46.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13001143300000001, 2024-04-25T22:03:46.880 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.880 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.880 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.880 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.880 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.880 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.880 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10648 2024-04-25T22:03:46.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.880 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:46.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:46.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537181+0000", 2024-04-25T22:03:46.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.782e-06 2024-04-25T22:03:46.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541681+0000", 2024-04-25T22:03:46.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045008460000000002 2024-04-25T22:03:46.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541692+0000", 2024-04-25T22:03:46.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0726e-05 2024-04-25T22:03:46.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541698+0000", 2024-04-25T22:03:46.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-04-25T22:03:46.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541771+0000", 2024-04-25T22:03:46.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3070000000000003e-05 2024-04-25T22:03:46.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542021+0000", 2024-04-25T22:03:46.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025059799999999999 2024-04-25T22:03:46.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542246+0000", 2024-04-25T22:03:46.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022471000000000001 2024-04-25T22:03:46.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.579359+0000", 2024-04-25T22:03:46.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037113211 2024-04-25T22:03:46.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667067+0000", 2024-04-25T22:03:46.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087707255999999997 2024-04-25T22:03:46.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667134+0000", 2024-04-25T22:03:46.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7862999999999997e-05 2024-04-25T22:03:46.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667190+0000", 2024-04-25T22:03:46.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5698000000000001e-05 2024-04-25T22:03:46.885 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.885 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.885 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.885 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10651 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:46.885 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:46.885 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.238100824999997, 2024-04-25T22:03:46.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11324606800000001, 2024-04-25T22:03:46.885 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.885 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.885 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.885 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.885 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.885 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.886 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10651 2024-04-25T22:03:46.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.886 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:46.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:46.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596957+0000", 2024-04-25T22:03:46.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-04-25T22:03:46.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601272+0000", 2024-04-25T22:03:46.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004314834 2024-04-25T22:03:46.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601291+0000", 2024-04-25T22:03:46.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9380000000000001e-05 2024-04-25T22:03:46.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601302+0000", 2024-04-25T22:03:46.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0416e-05 2024-04-25T22:03:46.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.603978+0000", 2024-04-25T22:03:46.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026763109999999998 2024-04-25T22:03:46.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604327+0000", 2024-04-25T22:03:46.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034881099999999998 2024-04-25T22:03:46.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:46.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604571+0000", 2024-04-25T22:03:46.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024436100000000001 2024-04-25T22:03:46.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644439+0000", 2024-04-25T22:03:46.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039868270999999997 2024-04-25T22:03:46.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710091+0000", 2024-04-25T22:03:46.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.065651910999999993 2024-04-25T22:03:46.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710144+0000", 2024-04-25T22:03:46.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2444999999999997e-05 2024-04-25T22:03:46.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710201+0000", 2024-04-25T22:03:46.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6839999999999998e-05 2024-04-25T22:03:46.892 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.892 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.892 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.893 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10654 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:46.893 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:46.893 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.228273962000003, 2024-04-25T22:03:46.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.103958778, 2024-04-25T22:03:46.893 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.893 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.893 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.893 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.893 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.893 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.893 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10654 2024-04-25T22:03:46.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.893 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:46.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:46.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606782+0000", 2024-04-25T22:03:46.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1699999999999999e-07 2024-04-25T22:03:46.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611155+0000", 2024-04-25T22:03:46.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043728580000000003 2024-04-25T22:03:46.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611173+0000", 2024-04-25T22:03:46.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8267e-05 2024-04-25T22:03:46.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611183+0000", 2024-04-25T22:03:46.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9250000000000007e-06 2024-04-25T22:03:46.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644642+0000", 2024-04-25T22:03:46.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033458976000000001 2024-04-25T22:03:46.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644739+0000", 2024-04-25T22:03:46.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7189999999999996e-05 2024-04-25T22:03:46.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:46.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644864+0000", 2024-04-25T22:03:46.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000124867 2024-04-25T22:03:46.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.672556+0000", 2024-04-25T22:03:46.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027691653 2024-04-25T22:03:46.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710668+0000", 2024-04-25T22:03:46.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038111956000000002 2024-04-25T22:03:46.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710703+0000", 2024-04-25T22:03:46.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5577000000000002e-05 2024-04-25T22:03:46.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710740+0000", 2024-04-25T22:03:46.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7092000000000003e-05 2024-04-25T22:03:46.898 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.898 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.898 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.898 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11078 4.4 4:22be2a9e:::10000003224.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:46.898 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:46.898 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.831147341000001, 2024-04-25T22:03:46.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.112294177, 2024-04-25T22:03:46.899 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.899 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.899 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.899 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.899 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.899 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.899 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11078 2024-04-25T22:03:46.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.899 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:46.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:46.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003909+0000", 2024-04-25T22:03:46.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2750000000000001e-06 2024-04-25T22:03:46.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009939+0000", 2024-04-25T22:03:46.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060293309999999998 2024-04-25T22:03:46.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009961+0000", 2024-04-25T22:03:46.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1889999999999999e-05 2024-04-25T22:03:46.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009976+0000", 2024-04-25T22:03:46.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5642e-05 2024-04-25T22:03:46.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042803+0000", 2024-04-25T22:03:46.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032827299999999997 2024-04-25T22:03:46.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042911+0000", 2024-04-25T22:03:46.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107747 2024-04-25T22:03:46.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042990+0000", 2024-04-25T22:03:46.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8832999999999996e-05 2024-04-25T22:03:46.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.088710+0000", 2024-04-25T22:03:46.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045720129999999998 2024-04-25T22:03:46.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116108+0000", 2024-04-25T22:03:46.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027397388000000002 2024-04-25T22:03:46.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116164+0000", 2024-04-25T22:03:46.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6283000000000003e-05 2024-04-25T22:03:46.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116202+0000", 2024-04-25T22:03:46.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8358000000000001e-05 2024-04-25T22:03:46.904 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.904 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.904 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.904 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11195 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:46.904 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:46.904 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.617785223999999, 2024-04-25T22:03:46.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1095062, 2024-04-25T22:03:46.904 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.904 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.904 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.904 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.904 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.905 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.905 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11195 2024-04-25T22:03:46.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.905 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:46.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:46.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217272+0000", 2024-04-25T22:03:46.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.533e-06 2024-04-25T22:03:46.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217385+0000", 2024-04-25T22:03:46.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113533 2024-04-25T22:03:46.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217396+0000", 2024-04-25T22:03:46.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0682e-05 2024-04-25T22:03:46.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217402+0000", 2024-04-25T22:03:46.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:03:46.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238476+0000", 2024-04-25T22:03:46.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021073312 2024-04-25T22:03:46.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238558+0000", 2024-04-25T22:03:46.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2193000000000004e-05 2024-04-25T22:03:46.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238695+0000", 2024-04-25T22:03:46.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013737800000000001 2024-04-25T22:03:46.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292860+0000", 2024-04-25T22:03:46.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054165224999999997 2024-04-25T22:03:46.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326638+0000", 2024-04-25T22:03:46.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033777517999999999 2024-04-25T22:03:46.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326686+0000", 2024-04-25T22:03:46.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8062000000000002e-05 2024-04-25T22:03:46.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326776+0000", 2024-04-25T22:03:46.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0393e-05 2024-04-25T22:03:46.909 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.909 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.909 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.909 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11197 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3195543~33670] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:46.910 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:46.910 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.61764324, 2024-04-25T22:03:46.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953929499999999, 2024-04-25T22:03:46.910 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.910 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.910 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.910 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.910 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.910 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.910 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11197 2024-04-25T22:03:46.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.910 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:46.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:46.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217413+0000", 2024-04-25T22:03:46.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5600000000000005e-07 2024-04-25T22:03:46.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217445+0000", 2024-04-25T22:03:46.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2240999999999998e-05 2024-04-25T22:03:46.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217453+0000", 2024-04-25T22:03:46.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6070000000000002e-06 2024-04-25T22:03:46.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217458+0000", 2024-04-25T22:03:46.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3630000000000002e-06 2024-04-25T22:03:46.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240891+0000", 2024-04-25T22:03:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023432637999999999 2024-04-25T22:03:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240990+0000", 2024-04-25T22:03:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8995999999999999e-05 2024-04-25T22:03:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241123+0000", 2024-04-25T22:03:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013371699999999999 2024-04-25T22:03:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292866+0000", 2024-04-25T22:03:46.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051742332000000002 2024-04-25T22:03:46.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326849+0000", 2024-04-25T22:03:46.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033983140000000002 2024-04-25T22:03:46.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326908+0000", 2024-04-25T22:03:46.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8842999999999999e-05 2024-04-25T22:03:46.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326951+0000", 2024-04-25T22:03:46.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3761999999999999e-05 2024-04-25T22:03:46.915 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.915 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.915 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.915 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11198 4.4 4:22c4fea3:::10000003262.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:46.915 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:46.915 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.617588881, 2024-04-25T22:03:46.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12381273600000001, 2024-04-25T22:03:46.915 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.916 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.916 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.916 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.916 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.916 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.916 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11198 2024-04-25T22:03:46.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.916 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:46.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:46.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217467+0000", 2024-04-25T22:03:46.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4499999999999997e-07 2024-04-25T22:03:46.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225449+0000", 2024-04-25T22:03:46.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079819439999999995 2024-04-25T22:03:46.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225466+0000", 2024-04-25T22:03:46.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6602000000000001e-05 2024-04-25T22:03:46.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225477+0000", 2024-04-25T22:03:46.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1603000000000001e-05 2024-04-25T22:03:46.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240866+0000", 2024-04-25T22:03:46.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015388389000000001 2024-04-25T22:03:46.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241081+0000", 2024-04-25T22:03:46.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021577400000000001 2024-04-25T22:03:46.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241212+0000", 2024-04-25T22:03:46.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013073499999999999 2024-04-25T22:03:46.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292876+0000", 2024-04-25T22:03:46.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051663584999999998 2024-04-25T22:03:46.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341159+0000", 2024-04-25T22:03:46.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048283421999999999 2024-04-25T22:03:46.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341222+0000", 2024-04-25T22:03:46.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:03:46.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341279+0000", 2024-04-25T22:03:46.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6780999999999997e-05 2024-04-25T22:03:46.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.921 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.921 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11207 4.4 4:233f6309:::10000003211.00000000:head [write 659836~128648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:46.921 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:46.921 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.600970883999999, 2024-04-25T22:03:46.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10732727, 2024-04-25T22:03:46.921 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.921 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.921 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.921 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.921 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.921 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.922 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11207 2024-04-25T22:03:46.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.922 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:46.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:46.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234085+0000", 2024-04-25T22:03:46.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0399999999999995e-07 2024-04-25T22:03:46.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234550+0000", 2024-04-25T22:03:46.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000464909 2024-04-25T22:03:46.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234561+0000", 2024-04-25T22:03:46.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0744000000000001e-05 2024-04-25T22:03:46.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234569+0000", 2024-04-25T22:03:46.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6890000000000004e-06 2024-04-25T22:03:46.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267197+0000", 2024-04-25T22:03:46.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032628182999999998 2024-04-25T22:03:46.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267297+0000", 2024-04-25T22:03:46.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100222 2024-04-25T22:03:46.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267393+0000", 2024-04-25T22:03:46.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6275999999999998e-05 2024-04-25T22:03:46.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292880+0000", 2024-04-25T22:03:46.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025487058999999999 2024-04-25T22:03:46.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341326+0000", 2024-04-25T22:03:46.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048446031000000001 2024-04-25T22:03:46.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341374+0000", 2024-04-25T22:03:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7632000000000001e-05 2024-04-25T22:03:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341412+0000", 2024-04-25T22:03:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7821000000000003e-05 2024-04-25T22:03:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11219 4.4 4:210cd53e:::100000031ff.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:46.926 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.582021674, 2024-04-25T22:03:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13181403, 2024-04-25T22:03:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11219 2024-04-25T22:03:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253035+0000", 2024-04-25T22:03:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.322e-06 2024-04-25T22:03:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258145+0000", 2024-04-25T22:03:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051095669999999998 2024-04-25T22:03:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258163+0000", 2024-04-25T22:03:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8377999999999999e-05 2024-04-25T22:03:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258174+0000", 2024-04-25T22:03:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0925e-05 2024-04-25T22:03:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270495+0000", 2024-04-25T22:03:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012321354 2024-04-25T22:03:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270581+0000", 2024-04-25T22:03:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5741999999999993e-05 2024-04-25T22:03:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270717+0000", 2024-04-25T22:03:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013571500000000001 2024-04-25T22:03:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326599+0000", 2024-04-25T22:03:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055882026000000001 2024-04-25T22:03:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384753+0000", 2024-04-25T22:03:46.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058154527999999997 2024-04-25T22:03:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384805+0000", 2024-04-25T22:03:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1592999999999999e-05 2024-04-25T22:03:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384848+0000", 2024-04-25T22:03:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2880000000000003e-05 2024-04-25T22:03:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11868 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.623057849999999, 2024-04-25T22:03:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12149908700000001, 2024-04-25T22:03:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11868 2024-04-25T22:03:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211999+0000", 2024-04-25T22:03:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:03:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219614+0000", 2024-04-25T22:03:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076153490000000004 2024-04-25T22:03:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219628+0000", 2024-04-25T22:03:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3597e-05 2024-04-25T22:03:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219635+0000", 2024-04-25T22:03:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7759999999999997e-06 2024-04-25T22:03:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229908+0000", 2024-04-25T22:03:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010272478 2024-04-25T22:03:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229966+0000", 2024-04-25T22:03:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8495000000000002e-05 2024-04-25T22:03:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.230082+0000", 2024-04-25T22:03:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011560799999999999 2024-04-25T22:03:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257530+0000", 2024-04-25T22:03:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027448034999999999 2024-04-25T22:03:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333408+0000", 2024-04-25T22:03:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075878105000000001 2024-04-25T22:03:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333457+0000", 2024-04-25T22:03:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8757000000000001e-05 2024-04-25T22:03:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333497+0000", 2024-04-25T22:03:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9721000000000001e-05 2024-04-25T22:03:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11870 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 4063232~131072] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.615403495999999, 2024-04-25T22:03:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.114017408, 2024-04-25T22:03:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.937 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11870 2024-04-25T22:03:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:46.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219653+0000", 2024-04-25T22:03:46.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6139999999999999e-06 2024-04-25T22:03:46.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219722+0000", 2024-04-25T22:03:46.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8460000000000005e-05 2024-04-25T22:03:46.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219730+0000", 2024-04-25T22:03:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3420000000000008e-06 2024-04-25T22:03:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219736+0000", 2024-04-25T22:03:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9619999999999998e-06 2024-04-25T22:03:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247743+0000", 2024-04-25T22:03:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028006400000000001 2024-04-25T22:03:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247847+0000", 2024-04-25T22:03:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104017 2024-04-25T22:03:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247984+0000", 2024-04-25T22:03:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013701800000000001 2024-04-25T22:03:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257536+0000", 2024-04-25T22:03:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095520050000000006 2024-04-25T22:03:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333565+0000", 2024-04-25T22:03:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076029154000000002 2024-04-25T22:03:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333628+0000", 2024-04-25T22:03:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2853000000000003e-05 2024-04-25T22:03:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333669+0000", 2024-04-25T22:03:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1582999999999998e-05 2024-04-25T22:03:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.942 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11871 4.37 4:ee924968:::10000003393.00000000:head [write 2359296~1835008] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.615310564000001, 2024-04-25T22:03:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.113885236, 2024-04-25T22:03:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11871 2024-04-25T22:03:46.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:46.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6100000000000001e-07 2024-04-25T22:03:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222469+0000", 2024-04-25T22:03:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027240060000000002 2024-04-25T22:03:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222482+0000", 2024-04-25T22:03:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3049e-05 2024-04-25T22:03:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222492+0000", 2024-04-25T22:03:46.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8020000000000003e-06 2024-04-25T22:03:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247903+0000", 2024-04-25T22:03:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025410578999999999 2024-04-25T22:03:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247962+0000", 2024-04-25T22:03:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9363000000000001e-05 2024-04-25T22:03:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.248049+0000", 2024-04-25T22:03:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6803000000000002e-05 2024-04-25T22:03:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257915+0000", 2024-04-25T22:03:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0098655730000000007 2024-04-25T22:03:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333544+0000", 2024-04-25T22:03:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075629030999999999 2024-04-25T22:03:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333594+0000", 2024-04-25T22:03:46.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0291999999999999e-05 2024-04-25T22:03:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333630+0000", 2024-04-25T22:03:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6177000000000003e-05 2024-04-25T22:03:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:15375 4.4 4:211dd80e:::10000003351.00000000:head [write 0~4194304 [2@1354921]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.697981171999999, 2024-04-25T22:03:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953555500000001, 2024-04-25T22:03:46.948 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-04-25T22:03:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137076+0000", 2024-04-25T22:03:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.683e-06 2024-04-25T22:03:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142168+0000", 2024-04-25T22:03:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050917280000000002 2024-04-25T22:03:46.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142192+0000", 2024-04-25T22:03:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:03:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142206+0000", 2024-04-25T22:03:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.396e-05 2024-04-25T22:03:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142280+0000", 2024-04-25T22:03:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4369000000000006e-05 2024-04-25T22:03:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142346+0000", 2024-04-25T22:03:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5957000000000006e-05 2024-04-25T22:03:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142440+0000", 2024-04-25T22:03:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3888999999999995e-05 2024-04-25T22:03:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.208451+0000", 2024-04-25T22:03:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066011350999999996 2024-04-25T22:03:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246473+0000", 2024-04-25T22:03:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038021428000000003 2024-04-25T22:03:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246530+0000", 2024-04-25T22:03:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7466000000000002e-05 2024-04-25T22:03:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246610+0000", 2024-04-25T22:03:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9484e-05 2024-04-25T22:03:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.953 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:46.954 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:46.954 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:46.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:46.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:46.952+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:47.056 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:03:47.056 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:47.056+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:47.087 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:47.088 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:47.088 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:03:47.088 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:47.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:47.130 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:03:47.130 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":76,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:03:45.994132+0000","last_up_change":"2024-04-25T22:01:03.432353+0000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:01:03.632568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.80488592386245728,"average_primary_affinity":0.80000001192092896,"average_primary_affinity_weighted":0.80000001192092896}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:01:07.995071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.80488592386245728,"average_primary_affinity":0.80000001192092896,"average_primary_affinity_weighted":0.80000001192092896}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:01:12.514055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.80488592386245728,"average_primary_affinity":0.80000001192092896,"average_primary_affinity_weighted":0.80000001192092896}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:01:12.963831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":0.80488592386245728,"average_primary_affinity":0.80000001192092896,"average_primary_affinity_weighted":0.80000001192092896}}],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":1,"in":1,"weight":1,"primary_affinity":0.6649932861328125,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6801","nonce":2385981072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6803","nonce":2385981072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6807","nonce":2385981072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2385981072},{"type":"v1","addr":"172.21.15.57:6805","nonce":2385981072}]},"public_addr":"172.21.15.57:6801/2385981072","cluster_addr":"172.21.15.57:6803/2385981072","heartbeat_back_addr":"172.21.15.57:6807/2385981072","heartbeat_front_addr":"172.21.15.57:6805/2385981072","state":["exists","up"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":1,"in":1,"weight":1,"primary_affinity":0.942596435546875,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6801","nonce":29975895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6803","nonce":29975895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6807","nonce":29975895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6805","nonce":29975895}]},"public_addr":"172.21.15.79:6801/29975895","cluster_addr":"172.21.15.79:6803/29975895","heartbeat_back_addr":"172.21.15.79:6807/29975895","heartbeat_front_addr":"172.21.15.79:6805/29975895","state":["exists","up"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":1,"in":1,"weight":1,"primary_affinity":0.80706787109375,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6801","nonce":3918111900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6803","nonce":3918111900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6807","nonce":3918111900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6805","nonce":3918111900}]},"public_addr":"172.21.15.81:6801/3918111900","cluster_addr":"172.21.15.81:6803/3918111900","heartbeat_back_addr":"172.21.15.81:6807/3918111900","heartbeat_front_addr":"172.21.15.81:6805/3918111900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:59.025944+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.986080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.971238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:03:47.148 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:01:03.632568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8048859238624573, 'average_primary_affinity': 0.800000011920929, 'average_primary_affinity_weighted': 0.800000011920929}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:01:07.995071+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8048859238624573, 'average_primary_affinity': 0.800000011920929, 'average_primary_affinity_weighted': 0.800000011920929}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:01:12.514055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8048859238624573, 'average_primary_affinity': 0.800000011920929, 'average_primary_affinity_weighted': 0.800000011920929}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:01:12.963831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 0.8048859238624573, 'average_primary_affinity': 0.800000011920929, 'average_primary_affinity_weighted': 0.800000011920929}}] 2024-04-25T22:03:47.149 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:03:47.157 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:47.156+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:47.202 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:47.202 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:47.222 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:47.223 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:47.223 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:47.223 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:47.223 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:03:47.223 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:03:47.223 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:47.237 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:47.240 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:47.240 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:47.281 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:47.280+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:47.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:47.352+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:47.404 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:47.404 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:47.418 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:47.432 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-04-25T22:03:47.450 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:03:47.459 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:47.456+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:47.553 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:47.553 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:47.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:47.556+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:47.567 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:47.661 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:47.660+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:47.693 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:47.693 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:47.707 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:47.752 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 8 2024-04-25T22:03:47.762 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:47.760+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:47.772 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T22:03:47.828 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:47.828 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:47.844 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:47.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:47.888+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:47.964 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:47.960+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:47.976 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:47.976 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:47.990 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:48.025 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:03:48.069 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-04-25T22:03:48.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:48.072+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:48.087 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T22:03:48.152 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:48.152 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:48.166 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:48.167 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:48.164+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:48.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:48.260+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:48.330 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:48.330 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:48.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:48.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:48.384+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:48.440 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-04-25T22:03:48.458 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T22:03:48.468 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:48.464+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:48.473 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:48.473 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:48.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:48.517 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:03:48.517 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T22:03:48.573 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:48.572+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:48.652 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:48.652 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:48.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:48.709 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:48.708+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:48.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:48.768+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:48.771 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-04-25T22:03:48.798 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2024-04-25T22:03:48.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:03:48.798 DEBUG:teuthology.orchestra.run.smithi044:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T22:03:48.820 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[22891]: fuse finished with error 0 and tester_r 0 2024-04-25T22:03:48.820 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:03:48.838 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:48.838 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:48.860 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:48.872 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:48.868+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:48.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:48.968+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:49.006 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:49.006 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:49.012 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is set 2024-04-25T22:03:49.012 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T22:03:49.022 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:49.039 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T22:03:49.072 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:49.068+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:49.145 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:49.145 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:49.159 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:49.201 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:49.200+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:49.257 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:03:49.274 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:49.272+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:49.329 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:49.329 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:49.344 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:49.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:49.388+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:49.403 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:49.422 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:49.423 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:49.446 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:49.446 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:49.475 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:49.475 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:49.475 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:03:49.475 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:49.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:49.472+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:49.489 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:49.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:49.572+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:49.654 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:49.654 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:49.654 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:03:49.654 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:03:49.654 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:49.668 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:49.677 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:49.676+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:49.778 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:49.776+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:49.841 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:49.841 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:49.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:49.842 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:49.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.842 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:49.842 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:49.842 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.752326007999997, 2024-04-25T22:03:49.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:49.842 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.842 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.842 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.842 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.842 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.842 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.842 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:49.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:49.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:49.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:49.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:49.847 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.742325245000004, 2024-04-25T22:03:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:49.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:49.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:49.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:49.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:49.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:49.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:49.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:49.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:49.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:49.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:49.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:49.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:49.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:49.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:49.854 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.854 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.854 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.855 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:49.855 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:49.855 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.738160970999999, 2024-04-25T22:03:49.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:49.855 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.855 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.855 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.855 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.855 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.855 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.855 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:49.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.855 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:49.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:49.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:49.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:49.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:49.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:49.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:49.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:49.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:49.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:49.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:49.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:49.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.736564653999999, 2024-04-25T22:03:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:49.860 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:49.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:49.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:49.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:49.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:49.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:49.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:49.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:49.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:49.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:49.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:49.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:49.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:49.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:49.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:49.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:49.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:49.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:49.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:49.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:49.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:49.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:49.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:49.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:49.865 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.865 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.866 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.866 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:49.866 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:49.866 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.679778403999997, 2024-04-25T22:03:49.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:49.866 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.866 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.866 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.866 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.866 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.866 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.866 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:49.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.867 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:49.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:49.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:49.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:49.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:49.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:49.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:49.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:49.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:49.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:49.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:49.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:49.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:49.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:49.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:49.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:49.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:49.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:49.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:49.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:49.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:49.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:49.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:49.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:49.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:49.871 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.871 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.871 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.871 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:49.871 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:49.871 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.664134138000001, 2024-04-25T22:03:49.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:49.872 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.872 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.872 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.872 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:49.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.872 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:49.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:49.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:49.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:49.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:49.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:49.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:49.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.876 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.659295446999998, 2024-04-25T22:03:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:49.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:49.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10648 4.33 4:cc614d18:::100000030cb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.300692136000002, 2024-04-25T22:03:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13001143300000001, 2024-04-25T22:03:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10648 2024-04-25T22:03:49.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537181+0000", 2024-04-25T22:03:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.782e-06 2024-04-25T22:03:49.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541681+0000", 2024-04-25T22:03:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045008460000000002 2024-04-25T22:03:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541692+0000", 2024-04-25T22:03:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0726e-05 2024-04-25T22:03:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541698+0000", 2024-04-25T22:03:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-04-25T22:03:49.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541771+0000", 2024-04-25T22:03:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3070000000000003e-05 2024-04-25T22:03:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542021+0000", 2024-04-25T22:03:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025059799999999999 2024-04-25T22:03:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542246+0000", 2024-04-25T22:03:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022471000000000001 2024-04-25T22:03:49.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.579359+0000", 2024-04-25T22:03:49.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037113211 2024-04-25T22:03:49.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667067+0000", 2024-04-25T22:03:49.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087707255999999997 2024-04-25T22:03:49.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667134+0000", 2024-04-25T22:03:49.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7862999999999997e-05 2024-04-25T22:03:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667190+0000", 2024-04-25T22:03:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5698000000000001e-05 2024-04-25T22:03:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10651 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.240916358, 2024-04-25T22:03:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11324606800000001, 2024-04-25T22:03:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.887 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10651 2024-04-25T22:03:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596957+0000", 2024-04-25T22:03:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-04-25T22:03:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601272+0000", 2024-04-25T22:03:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004314834 2024-04-25T22:03:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601291+0000", 2024-04-25T22:03:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9380000000000001e-05 2024-04-25T22:03:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601302+0000", 2024-04-25T22:03:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0416e-05 2024-04-25T22:03:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.603978+0000", 2024-04-25T22:03:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026763109999999998 2024-04-25T22:03:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604327+0000", 2024-04-25T22:03:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034881099999999998 2024-04-25T22:03:49.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604571+0000", 2024-04-25T22:03:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024436100000000001 2024-04-25T22:03:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644439+0000", 2024-04-25T22:03:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039868270999999997 2024-04-25T22:03:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710091+0000", 2024-04-25T22:03:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.065651910999999993 2024-04-25T22:03:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710144+0000", 2024-04-25T22:03:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2444999999999997e-05 2024-04-25T22:03:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710201+0000", 2024-04-25T22:03:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6839999999999998e-05 2024-04-25T22:03:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10654 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.231089494999999, 2024-04-25T22:03:49.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.103958778, 2024-04-25T22:03:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10654 2024-04-25T22:03:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:49.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606782+0000", 2024-04-25T22:03:49.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1699999999999999e-07 2024-04-25T22:03:49.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611155+0000", 2024-04-25T22:03:49.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043728580000000003 2024-04-25T22:03:49.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611173+0000", 2024-04-25T22:03:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8267e-05 2024-04-25T22:03:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611183+0000", 2024-04-25T22:03:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9250000000000007e-06 2024-04-25T22:03:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644642+0000", 2024-04-25T22:03:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033458976000000001 2024-04-25T22:03:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644739+0000", 2024-04-25T22:03:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7189999999999996e-05 2024-04-25T22:03:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644864+0000", 2024-04-25T22:03:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000124867 2024-04-25T22:03:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.672556+0000", 2024-04-25T22:03:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027691653 2024-04-25T22:03:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710668+0000", 2024-04-25T22:03:49.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038111956000000002 2024-04-25T22:03:49.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710703+0000", 2024-04-25T22:03:49.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5577000000000002e-05 2024-04-25T22:03:49.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710740+0000", 2024-04-25T22:03:49.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7092000000000003e-05 2024-04-25T22:03:49.897 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11078 4.4 4:22be2a9e:::10000003224.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.833962874000001, 2024-04-25T22:03:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.112294177, 2024-04-25T22:03:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.898 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11078 2024-04-25T22:03:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003909+0000", 2024-04-25T22:03:49.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2750000000000001e-06 2024-04-25T22:03:49.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009939+0000", 2024-04-25T22:03:49.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060293309999999998 2024-04-25T22:03:49.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009961+0000", 2024-04-25T22:03:49.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1889999999999999e-05 2024-04-25T22:03:49.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009976+0000", 2024-04-25T22:03:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5642e-05 2024-04-25T22:03:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042803+0000", 2024-04-25T22:03:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032827299999999997 2024-04-25T22:03:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042911+0000", 2024-04-25T22:03:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107747 2024-04-25T22:03:49.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042990+0000", 2024-04-25T22:03:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8832999999999996e-05 2024-04-25T22:03:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.088710+0000", 2024-04-25T22:03:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045720129999999998 2024-04-25T22:03:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116108+0000", 2024-04-25T22:03:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027397388000000002 2024-04-25T22:03:49.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116164+0000", 2024-04-25T22:03:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6283000000000003e-05 2024-04-25T22:03:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116202+0000", 2024-04-25T22:03:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8358000000000001e-05 2024-04-25T22:03:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11195 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:49.903 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.620600756999998, 2024-04-25T22:03:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1095062, 2024-04-25T22:03:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11195 2024-04-25T22:03:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217272+0000", 2024-04-25T22:03:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.533e-06 2024-04-25T22:03:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217385+0000", 2024-04-25T22:03:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113533 2024-04-25T22:03:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217396+0000", 2024-04-25T22:03:49.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0682e-05 2024-04-25T22:03:49.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217402+0000", 2024-04-25T22:03:49.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:03:49.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238476+0000", 2024-04-25T22:03:49.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021073312 2024-04-25T22:03:49.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238558+0000", 2024-04-25T22:03:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2193000000000004e-05 2024-04-25T22:03:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238695+0000", 2024-04-25T22:03:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013737800000000001 2024-04-25T22:03:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292860+0000", 2024-04-25T22:03:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054165224999999997 2024-04-25T22:03:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326638+0000", 2024-04-25T22:03:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033777517999999999 2024-04-25T22:03:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326686+0000", 2024-04-25T22:03:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8062000000000002e-05 2024-04-25T22:03:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326776+0000", 2024-04-25T22:03:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0393e-05 2024-04-25T22:03:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11197 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3195543~33670] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.620458772999999, 2024-04-25T22:03:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953929499999999, 2024-04-25T22:03:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11197 2024-04-25T22:03:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:49.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217413+0000", 2024-04-25T22:03:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5600000000000005e-07 2024-04-25T22:03:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217445+0000", 2024-04-25T22:03:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2240999999999998e-05 2024-04-25T22:03:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217453+0000", 2024-04-25T22:03:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6070000000000002e-06 2024-04-25T22:03:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217458+0000", 2024-04-25T22:03:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3630000000000002e-06 2024-04-25T22:03:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240891+0000", 2024-04-25T22:03:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023432637999999999 2024-04-25T22:03:49.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240990+0000", 2024-04-25T22:03:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8995999999999999e-05 2024-04-25T22:03:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241123+0000", 2024-04-25T22:03:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013371699999999999 2024-04-25T22:03:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292866+0000", 2024-04-25T22:03:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051742332000000002 2024-04-25T22:03:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326849+0000", 2024-04-25T22:03:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033983140000000002 2024-04-25T22:03:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326908+0000", 2024-04-25T22:03:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8842999999999999e-05 2024-04-25T22:03:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326951+0000", 2024-04-25T22:03:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3761999999999999e-05 2024-04-25T22:03:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.913 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11198 4.4 4:22c4fea3:::10000003262.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.620404413999999, 2024-04-25T22:03:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12381273600000001, 2024-04-25T22:03:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11198 2024-04-25T22:03:49.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217467+0000", 2024-04-25T22:03:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4499999999999997e-07 2024-04-25T22:03:49.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225449+0000", 2024-04-25T22:03:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079819439999999995 2024-04-25T22:03:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225466+0000", 2024-04-25T22:03:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6602000000000001e-05 2024-04-25T22:03:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225477+0000", 2024-04-25T22:03:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1603000000000001e-05 2024-04-25T22:03:49.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240866+0000", 2024-04-25T22:03:49.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015388389000000001 2024-04-25T22:03:49.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241081+0000", 2024-04-25T22:03:49.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021577400000000001 2024-04-25T22:03:49.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:49.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241212+0000", 2024-04-25T22:03:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013073499999999999 2024-04-25T22:03:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292876+0000", 2024-04-25T22:03:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051663584999999998 2024-04-25T22:03:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341159+0000", 2024-04-25T22:03:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048283421999999999 2024-04-25T22:03:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341222+0000", 2024-04-25T22:03:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:03:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341279+0000", 2024-04-25T22:03:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6780999999999997e-05 2024-04-25T22:03:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11207 4.4 4:233f6309:::10000003211.00000000:head [write 659836~128648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:49.919 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.603786416999998, 2024-04-25T22:03:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10732727, 2024-04-25T22:03:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11207 2024-04-25T22:03:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:49.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:49.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234085+0000", 2024-04-25T22:03:49.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0399999999999995e-07 2024-04-25T22:03:49.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234550+0000", 2024-04-25T22:03:49.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000464909 2024-04-25T22:03:49.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234561+0000", 2024-04-25T22:03:49.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0744000000000001e-05 2024-04-25T22:03:49.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234569+0000", 2024-04-25T22:03:49.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6890000000000004e-06 2024-04-25T22:03:49.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267197+0000", 2024-04-25T22:03:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032628182999999998 2024-04-25T22:03:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267297+0000", 2024-04-25T22:03:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100222 2024-04-25T22:03:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267393+0000", 2024-04-25T22:03:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6275999999999998e-05 2024-04-25T22:03:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292880+0000", 2024-04-25T22:03:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025487058999999999 2024-04-25T22:03:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341326+0000", 2024-04-25T22:03:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048446031000000001 2024-04-25T22:03:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341374+0000", 2024-04-25T22:03:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7632000000000001e-05 2024-04-25T22:03:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341412+0000", 2024-04-25T22:03:49.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7821000000000003e-05 2024-04-25T22:03:49.925 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.925 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.925 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.925 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11219 4.4 4:210cd53e:::100000031ff.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:49.925 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:49.925 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.584837207, 2024-04-25T22:03:49.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13181403, 2024-04-25T22:03:49.925 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.925 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.925 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.925 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.925 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.925 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11219 2024-04-25T22:03:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253035+0000", 2024-04-25T22:03:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.322e-06 2024-04-25T22:03:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258145+0000", 2024-04-25T22:03:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051095669999999998 2024-04-25T22:03:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258163+0000", 2024-04-25T22:03:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8377999999999999e-05 2024-04-25T22:03:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258174+0000", 2024-04-25T22:03:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0925e-05 2024-04-25T22:03:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270495+0000", 2024-04-25T22:03:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012321354 2024-04-25T22:03:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270581+0000", 2024-04-25T22:03:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5741999999999993e-05 2024-04-25T22:03:49.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270717+0000", 2024-04-25T22:03:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013571500000000001 2024-04-25T22:03:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326599+0000", 2024-04-25T22:03:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055882026000000001 2024-04-25T22:03:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384753+0000", 2024-04-25T22:03:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058154527999999997 2024-04-25T22:03:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384805+0000", 2024-04-25T22:03:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1592999999999999e-05 2024-04-25T22:03:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384848+0000", 2024-04-25T22:03:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2880000000000003e-05 2024-04-25T22:03:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11868 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.625873382999998, 2024-04-25T22:03:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12149908700000001, 2024-04-25T22:03:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11868 2024-04-25T22:03:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211999+0000", 2024-04-25T22:03:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:03:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219614+0000", 2024-04-25T22:03:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076153490000000004 2024-04-25T22:03:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219628+0000", 2024-04-25T22:03:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3597e-05 2024-04-25T22:03:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219635+0000", 2024-04-25T22:03:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7759999999999997e-06 2024-04-25T22:03:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229908+0000", 2024-04-25T22:03:49.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010272478 2024-04-25T22:03:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229966+0000", 2024-04-25T22:03:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8495000000000002e-05 2024-04-25T22:03:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.230082+0000", 2024-04-25T22:03:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011560799999999999 2024-04-25T22:03:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257530+0000", 2024-04-25T22:03:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027448034999999999 2024-04-25T22:03:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333408+0000", 2024-04-25T22:03:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075878105000000001 2024-04-25T22:03:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333457+0000", 2024-04-25T22:03:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8757000000000001e-05 2024-04-25T22:03:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333497+0000", 2024-04-25T22:03:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9721000000000001e-05 2024-04-25T22:03:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11870 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 4063232~131072] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.618219028999999, 2024-04-25T22:03:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.114017408, 2024-04-25T22:03:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.936 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11870 2024-04-25T22:03:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219653+0000", 2024-04-25T22:03:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6139999999999999e-06 2024-04-25T22:03:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219722+0000", 2024-04-25T22:03:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8460000000000005e-05 2024-04-25T22:03:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219730+0000", 2024-04-25T22:03:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3420000000000008e-06 2024-04-25T22:03:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219736+0000", 2024-04-25T22:03:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9619999999999998e-06 2024-04-25T22:03:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247743+0000", 2024-04-25T22:03:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028006400000000001 2024-04-25T22:03:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247847+0000", 2024-04-25T22:03:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104017 2024-04-25T22:03:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247984+0000", 2024-04-25T22:03:49.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013701800000000001 2024-04-25T22:03:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257536+0000", 2024-04-25T22:03:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095520050000000006 2024-04-25T22:03:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333565+0000", 2024-04-25T22:03:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076029154000000002 2024-04-25T22:03:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333628+0000", 2024-04-25T22:03:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2853000000000003e-05 2024-04-25T22:03:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333669+0000", 2024-04-25T22:03:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1582999999999998e-05 2024-04-25T22:03:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11871 4.37 4:ee924968:::10000003393.00000000:head [write 2359296~1835008] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.618126097000001, 2024-04-25T22:03:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.113885236, 2024-04-25T22:03:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.941 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11871 2024-04-25T22:03:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:49.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6100000000000001e-07 2024-04-25T22:03:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222469+0000", 2024-04-25T22:03:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027240060000000002 2024-04-25T22:03:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222482+0000", 2024-04-25T22:03:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3049e-05 2024-04-25T22:03:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222492+0000", 2024-04-25T22:03:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8020000000000003e-06 2024-04-25T22:03:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247903+0000", 2024-04-25T22:03:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025410578999999999 2024-04-25T22:03:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247962+0000", 2024-04-25T22:03:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9363000000000001e-05 2024-04-25T22:03:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.248049+0000", 2024-04-25T22:03:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6803000000000002e-05 2024-04-25T22:03:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257915+0000", 2024-04-25T22:03:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0098655730000000007 2024-04-25T22:03:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333544+0000", 2024-04-25T22:03:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075629030999999999 2024-04-25T22:03:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333594+0000", 2024-04-25T22:03:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0291999999999999e-05 2024-04-25T22:03:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333630+0000", 2024-04-25T22:03:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6177000000000003e-05 2024-04-25T22:03:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:15375 4.4 4:211dd80e:::10000003351.00000000:head [write 0~4194304 [2@1354921]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:49.946 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.700796704999998, 2024-04-25T22:03:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953555500000001, 2024-04-25T22:03:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-04-25T22:03:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:49.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137076+0000", 2024-04-25T22:03:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.683e-06 2024-04-25T22:03:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142168+0000", 2024-04-25T22:03:49.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050917280000000002 2024-04-25T22:03:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142192+0000", 2024-04-25T22:03:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:03:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142206+0000", 2024-04-25T22:03:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.396e-05 2024-04-25T22:03:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142280+0000", 2024-04-25T22:03:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4369000000000006e-05 2024-04-25T22:03:49.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142346+0000", 2024-04-25T22:03:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5957000000000006e-05 2024-04-25T22:03:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142440+0000", 2024-04-25T22:03:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3888999999999995e-05 2024-04-25T22:03:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.208451+0000", 2024-04-25T22:03:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066011350999999996 2024-04-25T22:03:49.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246473+0000", 2024-04-25T22:03:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038021428000000003 2024-04-25T22:03:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246530+0000", 2024-04-25T22:03:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7466000000000002e-05 2024-04-25T22:03:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246610+0000", 2024-04-25T22:03:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9484e-05 2024-04-25T22:03:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.951 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.952 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.952 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:49.952 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:49.952 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:49.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:49.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:49.948+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:50.017 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T22:03:50.043 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T22:03:50.054 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:50.052+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:50.085 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:03:50.085 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:50.099 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:50.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:50.148+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:50.255 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:50.252+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:50.261 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:03:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:03:50.262 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:50.275 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:50.356 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:50.352+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:50.438 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:03:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:03:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7039 4.8 4:1138358d:::100000013f3.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.601114828, 2024-04-25T22:03:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.034656746, 2024-04-25T22:03:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831791+0000", 2024-04-25T22:03:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6359999999999998e-06 2024-04-25T22:03:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831801+0000", 2024-04-25T22:03:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0567000000000001e-05 2024-04-25T22:03:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831824+0000", 2024-04-25T22:03:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:03:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831839+0000", 2024-04-25T22:03:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5345999999999998e-05 2024-04-25T22:03:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832028+0000", 2024-04-25T22:03:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018899800000000001 2024-04-25T22:03:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832043+0000", 2024-04-25T22:03:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4805e-05 2024-04-25T22:03:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836259+0000", 2024-04-25T22:03:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042161819999999997 2024-04-25T22:03:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836422+0000", 2024-04-25T22:03:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000162404 2024-04-25T22:03:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.865428+0000", 2024-04-25T22:03:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0290065770000001 2024-04-25T22:03:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866445+0000", 2024-04-25T22:03:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001016561 2024-04-25T22:03:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7040 4.8 4:121f992c:::100000013f4.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.601025905, 2024-04-25T22:03:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0348302300000001, 2024-04-25T22:03:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831878+0000", 2024-04-25T22:03:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3659999999999999e-06 2024-04-25T22:03:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831885+0000", 2024-04-25T22:03:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7139999999999996e-06 2024-04-25T22:03:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831901+0000", 2024-04-25T22:03:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5982999999999999e-05 2024-04-25T22:03:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831910+0000", 2024-04-25T22:03:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7530000000000007e-06 2024-04-25T22:03:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832133+0000", 2024-04-25T22:03:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022307199999999999 2024-04-25T22:03:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832141+0000", 2024-04-25T22:03:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0080000000000002e-06 2024-04-25T22:03:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836611+0000", 2024-04-25T22:03:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044698389999999998 2024-04-25T22:03:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836629+0000", 2024-04-25T22:03:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8397e-05 2024-04-25T22:03:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866532+0000", 2024-04-25T22:03:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0299026200000001 2024-04-25T22:03:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866707+0000", 2024-04-25T22:03:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017547799999999999 2024-04-25T22:03:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7051 4.36 4:6e19a085:::100000013ff.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.600973126, 2024-04-25T22:03:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.032211298, 2024-04-25T22:03:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831931+0000", 2024-04-25T22:03:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.19e-06 2024-04-25T22:03:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831936+0000", 2024-04-25T22:03:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2059999999999998e-06 2024-04-25T22:03:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831950+0000", 2024-04-25T22:03:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3424000000000001e-05 2024-04-25T22:03:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831958+0000", 2024-04-25T22:03:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1659999999999994e-06 2024-04-25T22:03:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832033+0000", 2024-04-25T22:03:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4977999999999999e-05 2024-04-25T22:03:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832043+0000", 2024-04-25T22:03:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0268999999999999e-05 2024-04-25T22:03:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841105+0000", 2024-04-25T22:03:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090619829999999991 2024-04-25T22:03:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841118+0000", 2024-04-25T22:03:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2737e-05 2024-04-25T22:03:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.863240+0000", 2024-04-25T22:03:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0221224259999999 2024-04-25T22:03:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.864141+0000", 2024-04-25T22:03:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090091900000000003 2024-04-25T22:03:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7059 4.22 4:47c8979f:::10000001407.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.600921985999999, 2024-04-25T22:03:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0438401859999999, 2024-04-25T22:03:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831982+0000", 2024-04-25T22:03:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1030000000000001e-06 2024-04-25T22:03:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831987+0000", 2024-04-25T22:03:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-04-25T22:03:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832007+0000", 2024-04-25T22:03:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0126999999999999e-05 2024-04-25T22:03:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832022+0000", 2024-04-25T22:03:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4878999999999999e-05 2024-04-25T22:03:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832082+0000", 2024-04-25T22:03:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9552999999999997e-05 2024-04-25T22:03:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832088+0000", 2024-04-25T22:03:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9320000000000001e-06 2024-04-25T22:03:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836708+0000", 2024-04-25T22:03:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046199240000000001 2024-04-25T22:03:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836717+0000", 2024-04-25T22:03:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1840000000000005e-06 2024-04-25T22:03:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875475+0000", 2024-04-25T22:03:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0387584439999999 2024-04-25T22:03:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875821+0000", 2024-04-25T22:03:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00034578700000000001 2024-04-25T22:03:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7063 4.2 4:4331e060:::100000014df.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.600859196999998, 2024-04-25T22:03:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.047605189, 2024-04-25T22:03:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832045+0000", 2024-04-25T22:03:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:03:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832088+0000", 2024-04-25T22:03:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2483e-05 2024-04-25T22:03:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832100+0000", 2024-04-25T22:03:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2713e-05 2024-04-25T22:03:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832111+0000", 2024-04-25T22:03:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0457e-05 2024-04-25T22:03:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832155+0000", 2024-04-25T22:03:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4468999999999997e-05 2024-04-25T22:03:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832161+0000", 2024-04-25T22:03:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3369999999999999e-06 2024-04-25T22:03:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836779+0000", 2024-04-25T22:03:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046185030000000004 2024-04-25T22:03:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836787+0000", 2024-04-25T22:03:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5820000000000004e-06 2024-04-25T22:03:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.868721+0000", 2024-04-25T22:03:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0319339300000001 2024-04-25T22:03:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869179+0000", 2024-04-25T22:03:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000457916 2024-04-25T22:03:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869486+0000", 2024-04-25T22:03:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030764099999999999 2024-04-25T22:03:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879230+0000", 2024-04-25T22:03:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097433620000000002 2024-04-25T22:03:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879288+0000", 2024-04-25T22:03:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8813000000000001e-05 2024-04-25T22:03:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879542+0000", 2024-04-25T22:03:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025326999999999999 2024-04-25T22:03:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879649+0000", 2024-04-25T22:03:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107173 2024-04-25T22:03:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7068 4.33 4:cf543130:::100000014e4.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.600773504999999, 2024-04-25T22:03:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.044127671, 2024-04-25T22:03:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832131+0000", 2024-04-25T22:03:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:03:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832137+0000", 2024-04-25T22:03:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9859999999999999e-06 2024-04-25T22:03:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832155+0000", 2024-04-25T22:03:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8090000000000001e-05 2024-04-25T22:03:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832166+0000", 2024-04-25T22:03:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1776999999999999e-05 2024-04-25T22:03:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832235+0000", 2024-04-25T22:03:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8614000000000004e-05 2024-04-25T22:03:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832243+0000", 2024-04-25T22:03:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2719999999999997e-06 2024-04-25T22:03:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.834656+0000", 2024-04-25T22:03:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024123489999999998 2024-04-25T22:03:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.834666+0000", 2024-04-25T22:03:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8819999999999996e-06 2024-04-25T22:03:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.860770+0000", 2024-04-25T22:03:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.026104414 2024-04-25T22:03:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861849+0000", 2024-04-25T22:03:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010794559999999999 2024-04-25T22:03:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.865487+0000", 2024-04-25T22:03:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036373270000000001 2024-04-25T22:03:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869323+0000", 2024-04-25T22:03:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038362259999999999 2024-04-25T22:03:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876012+0000", 2024-04-25T22:03:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066894290000000002 2024-04-25T22:03:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:50.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876154+0000", 2024-04-25T22:03:50.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000141963 2024-04-25T22:03:50.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876257+0000", 2024-04-25T22:03:50.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102662 2024-04-25T22:03:50.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.472 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.472 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7069 4.36 4:6d2d0624:::100000014e5.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.472 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:50.473 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.600720748000001, 2024-04-25T22:03:50.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0457444709999999, 2024-04-25T22:03:50.473 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.473 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.473 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.473 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:50.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832183+0000", 2024-04-25T22:03:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1459999999999999e-06 2024-04-25T22:03:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832189+0000", 2024-04-25T22:03:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.614e-06 2024-04-25T22:03:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832206+0000", 2024-04-25T22:03:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.683e-05 2024-04-25T22:03:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832218+0000", 2024-04-25T22:03:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2266000000000001e-05 2024-04-25T22:03:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832265+0000", 2024-04-25T22:03:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7138999999999997e-05 2024-04-25T22:03:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832271+0000", 2024-04-25T22:03:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4280000000000004e-06 2024-04-25T22:03:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841149+0000", 2024-04-25T22:03:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088781429999999998 2024-04-25T22:03:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841158+0000", 2024-04-25T22:03:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7359999999999996e-06 2024-04-25T22:03:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867956+0000", 2024-04-25T22:03:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0267976969999999 2024-04-25T22:03:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.868991+0000", 2024-04-25T22:03:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010344810000000001 2024-04-25T22:03:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869248+0000", 2024-04-25T22:03:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025746699999999999 2024-04-25T22:03:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872721+0000", 2024-04-25T22:03:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034729959999999999 2024-04-25T22:03:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877064+0000", 2024-04-25T22:03:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043432770000000004 2024-04-25T22:03:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877767+0000", 2024-04-25T22:03:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070237700000000001 2024-04-25T22:03:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877927+0000", 2024-04-25T22:03:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015987400000000001 2024-04-25T22:03:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7071 4.22 4:45120e82:::100000014e7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.600667308999999, 2024-04-25T22:03:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.050578969, 2024-04-25T22:03:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832237+0000", 2024-04-25T22:03:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.003e-06 2024-04-25T22:03:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832243+0000", 2024-04-25T22:03:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-04-25T22:03:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832263+0000", 2024-04-25T22:03:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0066999999999999e-05 2024-04-25T22:03:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832293+0000", 2024-04-25T22:03:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9802999999999999e-05 2024-04-25T22:03:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832416+0000", 2024-04-25T22:03:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123566 2024-04-25T22:03:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832438+0000", 2024-04-25T22:03:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1433e-05 2024-04-25T22:03:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836745+0000", 2024-04-25T22:03:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043070260000000003 2024-04-25T22:03:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836752+0000", 2024-04-25T22:03:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2060000000000001e-06 2024-04-25T22:03:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875897+0000", 2024-04-25T22:03:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0391448489999999 2024-04-25T22:03:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876238+0000", 2024-04-25T22:03:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00034159400000000002 2024-04-25T22:03:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876491+0000", 2024-04-25T22:03:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025221500000000002 2024-04-25T22:03:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881289+0000", 2024-04-25T22:03:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047986510000000001 2024-04-25T22:03:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882627+0000", 2024-04-25T22:03:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013376340000000001 2024-04-25T22:03:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882707+0000", 2024-04-25T22:03:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0037000000000006e-05 2024-04-25T22:03:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882815+0000", 2024-04-25T22:03:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107645 2024-04-25T22:03:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7073 4.14 4:2af683fb:::100000014e9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.600586715999999, 2024-04-25T22:03:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.043944475, 2024-04-25T22:03:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832318+0000", 2024-04-25T22:03:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:03:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832323+0000", 2024-04-25T22:03:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6099999999999997e-06 2024-04-25T22:03:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832345+0000", 2024-04-25T22:03:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1353e-05 2024-04-25T22:03:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832390+0000", 2024-04-25T22:03:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5543000000000001e-05 2024-04-25T22:03:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832469+0000", 2024-04-25T22:03:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8770999999999995e-05 2024-04-25T22:03:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832475+0000", 2024-04-25T22:03:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0970000000000002e-06 2024-04-25T22:03:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843177+0000", 2024-04-25T22:03:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010702237999999999 2024-04-25T22:03:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843185+0000", 2024-04-25T22:03:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8490000000000006e-06 2024-04-25T22:03:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861478+0000", 2024-04-25T22:03:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.018292915 2024-04-25T22:03:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861880+0000", 2024-04-25T22:03:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00040182599999999998 2024-04-25T22:03:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862137+0000", 2024-04-25T22:03:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025741099999999998 2024-04-25T22:03:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866967+0000", 2024-04-25T22:03:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048298669999999998 2024-04-25T22:03:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875991+0000", 2024-04-25T22:03:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090235609999999994 2024-04-25T22:03:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876162+0000", 2024-04-25T22:03:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017075900000000001 2024-04-25T22:03:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876261+0000", 2024-04-25T22:03:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9072000000000003e-05 2024-04-25T22:03:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7077 4.27 4:e57158de:::100000014ed.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.600462441000001, 2024-04-25T22:03:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0562571009999999, 2024-04-25T22:03:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832442+0000", 2024-04-25T22:03:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.274e-06 2024-04-25T22:03:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832448+0000", 2024-04-25T22:03:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-04-25T22:03:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832466+0000", 2024-04-25T22:03:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7549000000000001e-05 2024-04-25T22:03:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832474+0000", 2024-04-25T22:03:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.337e-06 2024-04-25T22:03:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832545+0000", 2024-04-25T22:03:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0986000000000001e-05 2024-04-25T22:03:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832554+0000", 2024-04-25T22:03:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2269999999999999e-06 2024-04-25T22:03:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843167+0000", 2024-04-25T22:03:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010613058 2024-04-25T22:03:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843176+0000", 2024-04-25T22:03:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8629999999999997e-06 2024-04-25T22:03:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878195+0000", 2024-04-25T22:03:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0350192650000001 2024-04-25T22:03:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878952+0000", 2024-04-25T22:03:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00075638400000000003 2024-04-25T22:03:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879100+0000", 2024-04-25T22:03:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014883600000000001 2024-04-25T22:03:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.883699+0000", 2024-04-25T22:03:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045986880000000001 2024-04-25T22:03:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888487+0000", 2024-04-25T22:03:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047874670000000001 2024-04-25T22:03:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888603+0000", 2024-04-25T22:03:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011671900000000001 2024-04-25T22:03:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888698+0000", 2024-04-25T22:03:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4208000000000003e-05 2024-04-25T22:03:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7085 4.1f 4:f9b21afd:::10000001591.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.596397888999999, 2024-04-25T22:03:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0439952969999999, 2024-04-25T22:03:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836507+0000", 2024-04-25T22:03:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.17e-06 2024-04-25T22:03:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836517+0000", 2024-04-25T22:03:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9019999999999994e-06 2024-04-25T22:03:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836603+0000", 2024-04-25T22:03:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6248999999999994e-05 2024-04-25T22:03:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836614+0000", 2024-04-25T22:03:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0322e-05 2024-04-25T22:03:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841790+0000", 2024-04-25T22:03:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051763929999999996 2024-04-25T22:03:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841803+0000", 2024-04-25T22:03:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3023999999999999e-05 2024-04-25T22:03:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.870557+0000", 2024-04-25T22:03:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.02875396 2024-04-25T22:03:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872184+0000", 2024-04-25T22:03:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016268019999999999 2024-04-25T22:03:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872435+0000", 2024-04-25T22:03:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025088399999999999 2024-04-25T22:03:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879983+0000", 2024-04-25T22:03:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0075479379999999997 2024-04-25T22:03:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880150+0000", 2024-04-25T22:03:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016698900000000001 2024-04-25T22:03:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880300+0000", 2024-04-25T22:03:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000150789 2024-04-25T22:03:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880500+0000", 2024-04-25T22:03:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019987499999999999 2024-04-25T22:03:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7086 4.9 4:91594555:::10000001592.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.596270190999999, 2024-04-25T22:03:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0331164559999999, 2024-04-25T22:03:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836634+0000", 2024-04-25T22:03:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1510000000000001e-06 2024-04-25T22:03:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836638+0000", 2024-04-25T22:03:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9740000000000004e-06 2024-04-25T22:03:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836647+0000", 2024-04-25T22:03:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1269999999999992e-06 2024-04-25T22:03:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836653+0000", 2024-04-25T22:03:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8900000000000004e-06 2024-04-25T22:03:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841540+0000", 2024-04-25T22:03:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048869719999999998 2024-04-25T22:03:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841550+0000", 2024-04-25T22:03:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0644e-05 2024-04-25T22:03:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.857739+0000", 2024-04-25T22:03:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.016188589 2024-04-25T22:03:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.858099+0000", 2024-04-25T22:03:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036013100000000003 2024-04-25T22:03:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.858328+0000", 2024-04-25T22:03:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000228941 2024-04-25T22:03:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.864635+0000", 2024-04-25T22:03:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063073199999999999 2024-04-25T22:03:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869508+0000", 2024-04-25T22:03:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048727220000000003 2024-04-25T22:03:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869648+0000", 2024-04-25T22:03:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000140152 2024-04-25T22:03:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869749+0000", 2024-04-25T22:03:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100843 2024-04-25T22:03:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7096 4.9 4:90f65572:::100000016d2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.587076143000001, 2024-04-25T22:03:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0364832260000001, 2024-04-25T22:03:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845828+0000", 2024-04-25T22:03:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5199999999999995e-07 2024-04-25T22:03:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845834+0000", 2024-04-25T22:03:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4710000000000004e-06 2024-04-25T22:03:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845843+0000", 2024-04-25T22:03:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6119999999999999e-06 2024-04-25T22:03:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845848+0000", 2024-04-25T22:03:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8280000000000002e-06 2024-04-25T22:03:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845891+0000", 2024-04-25T22:03:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3234e-05 2024-04-25T22:03:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845898+0000", 2024-04-25T22:03:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3839999999999999e-06 2024-04-25T22:03:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.873643+0000", 2024-04-25T22:03:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.027745162 2024-04-25T22:03:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.873907+0000", 2024-04-25T22:03:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026328000000000001 2024-04-25T22:03:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.874143+0000", 2024-04-25T22:03:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023613799999999999 2024-04-25T22:03:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878861+0000", 2024-04-25T22:03:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047185710000000004 2024-04-25T22:03:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880222+0000", 2024-04-25T22:03:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001360984 2024-04-25T22:03:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880647+0000", 2024-04-25T22:03:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042470799999999999 2024-04-25T22:03:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882310+0000", 2024-04-25T22:03:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001662902 2024-04-25T22:03:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7098 3.9 3:9359a9e9:::100000016e0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.586473056999999, 2024-04-25T22:03:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.034065142, 2024-04-25T22:03:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846432+0000", 2024-04-25T22:03:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.88e-06 2024-04-25T22:03:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846440+0000", 2024-04-25T22:03:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7120000000000006e-06 2024-04-25T22:03:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846463+0000", 2024-04-25T22:03:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2416e-05 2024-04-25T22:03:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846479+0000", 2024-04-25T22:03:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6484999999999999e-05 2024-04-25T22:03:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846718+0000", 2024-04-25T22:03:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023839299999999999 2024-04-25T22:03:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846729+0000", 2024-04-25T22:03:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0896999999999999e-05 2024-04-25T22:03:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872537+0000", 2024-04-25T22:03:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0258087 2024-04-25T22:03:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872831+0000", 2024-04-25T22:03:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029391399999999999 2024-04-25T22:03:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880495+0000", 2024-04-25T22:03:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0076637449999999996 2024-04-25T22:03:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7100 4.1 4:83bc2484:::100000016e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.585419928, 2024-04-25T22:03:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.03260128, 2024-04-25T22:03:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847484+0000", 2024-04-25T22:03:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.443e-06 2024-04-25T22:03:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847491+0000", 2024-04-25T22:03:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4300000000000003e-06 2024-04-25T22:03:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847505+0000", 2024-04-25T22:03:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4014e-05 2024-04-25T22:03:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847514+0000", 2024-04-25T22:03:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4350000000000003e-06 2024-04-25T22:03:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847571+0000", 2024-04-25T22:03:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6338999999999997e-05 2024-04-25T22:03:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847580+0000", 2024-04-25T22:03:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0680000000000003e-06 2024-04-25T22:03:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862224+0000", 2024-04-25T22:03:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0146447279999999 2024-04-25T22:03:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862676+0000", 2024-04-25T22:03:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045117300000000003 2024-04-25T22:03:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862992+0000", 2024-04-25T22:03:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000316607 2024-04-25T22:03:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879035+0000", 2024-04-25T22:03:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016043168999999999 2024-04-25T22:03:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879762+0000", 2024-04-25T22:03:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00072643100000000004 2024-04-25T22:03:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879993+0000", 2024-04-25T22:03:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023091799999999999 2024-04-25T22:03:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880084+0000", 2024-04-25T22:03:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1525000000000002e-05 2024-04-25T22:03:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7105 4.1d 4:b83d3758:::10000001718.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.584369639999998, 2024-04-25T22:03:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0317263169999999, 2024-04-25T22:03:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848534+0000", 2024-04-25T22:03:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1200000000000001e-06 2024-04-25T22:03:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848541+0000", 2024-04-25T22:03:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4749999999999998e-06 2024-04-25T22:03:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848551+0000", 2024-04-25T22:03:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.039e-05 2024-04-25T22:03:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848558+0000", 2024-04-25T22:03:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2520000000000002e-06 2024-04-25T22:03:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848703+0000", 2024-04-25T22:03:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014466699999999999 2024-04-25T22:03:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848709+0000", 2024-04-25T22:03:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-04-25T22:03:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866810+0000", 2024-04-25T22:03:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.018101293 2024-04-25T22:03:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867282+0000", 2024-04-25T22:03:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047148999999999997 2024-04-25T22:03:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867555+0000", 2024-04-25T22:03:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027314100000000002 2024-04-25T22:03:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877648+0000", 2024-04-25T22:03:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010093275000000001 2024-04-25T22:03:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880012+0000", 2024-04-25T22:03:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023639590000000001 2024-04-25T22:03:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880157+0000", 2024-04-25T22:03:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000144532 2024-04-25T22:03:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880260+0000", 2024-04-25T22:03:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103016 2024-04-25T22:03:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7116 4.27 4:e60ee3a4:::10000001a5f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.580215031000002, 2024-04-25T22:03:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0375457480000001, 2024-04-25T22:03:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-04-25T22:03:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852694+0000", 2024-04-25T22:03:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0360000000000003e-06 2024-04-25T22:03:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852702+0000", 2024-04-25T22:03:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1470000000000004e-06 2024-04-25T22:03:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852708+0000", 2024-04-25T22:03:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1210000000000003e-06 2024-04-25T22:03:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852762+0000", 2024-04-25T22:03:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4166000000000003e-05 2024-04-25T22:03:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852769+0000", 2024-04-25T22:03:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8000000000000001e-06 2024-04-25T22:03:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880804+0000", 2024-04-25T22:03:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.028035695 2024-04-25T22:03:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881105+0000", 2024-04-25T22:03:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030039999999999998 2024-04-25T22:03:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881373+0000", 2024-04-25T22:03:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026843499999999997 2024-04-25T22:03:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884999+0000", 2024-04-25T22:03:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036262070000000002 2024-04-25T22:03:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.889903+0000", 2024-04-25T22:03:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049036260000000003 2024-04-25T22:03:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890114+0000", 2024-04-25T22:03:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021130500000000001 2024-04-25T22:03:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890234+0000", 2024-04-25T22:03:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011922900000000001 2024-04-25T22:03:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7121 4.1f 4:fab6744c:::10000001a64.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.579722360000002, 2024-04-25T22:03:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.031414587, 2024-04-25T22:03:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1299999999999999e-07 2024-04-25T22:03:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853184+0000", 2024-04-25T22:03:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1779999999999999e-06 2024-04-25T22:03:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853192+0000", 2024-04-25T22:03:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.294e-06 2024-04-25T22:03:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853196+0000", 2024-04-25T22:03:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6330000000000004e-06 2024-04-25T22:03:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853249+0000", 2024-04-25T22:03:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2785999999999999e-05 2024-04-25T22:03:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853260+0000", 2024-04-25T22:03:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1027e-05 2024-04-25T22:03:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875944+0000", 2024-04-25T22:03:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0226834810000001 2024-04-25T22:03:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876230+0000", 2024-04-25T22:03:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000286357 2024-04-25T22:03:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876512+0000", 2024-04-25T22:03:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028174500000000002 2024-04-25T22:03:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880727+0000", 2024-04-25T22:03:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042150520000000004 2024-04-25T22:03:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884386+0000", 2024-04-25T22:03:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036589069999999999 2024-04-25T22:03:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884502+0000", 2024-04-25T22:03:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000115862 2024-04-25T22:03:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884595+0000", 2024-04-25T22:03:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3552000000000001e-05 2024-04-25T22:03:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7127 4.22 4:476940b8:::10000001b50.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.578614365, 2024-04-25T22:03:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.035873665, 2024-04-25T22:03:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854290+0000", 2024-04-25T22:03:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.313e-06 2024-04-25T22:03:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854295+0000", 2024-04-25T22:03:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3580000000000002e-06 2024-04-25T22:03:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854310+0000", 2024-04-25T22:03:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4742e-05 2024-04-25T22:03:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854318+0000", 2024-04-25T22:03:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2570000000000007e-06 2024-04-25T22:03:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854383+0000", 2024-04-25T22:03:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4535999999999993e-05 2024-04-25T22:03:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854390+0000", 2024-04-25T22:03:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3930000000000002e-06 2024-04-25T22:03:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879471+0000", 2024-04-25T22:03:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0250810260000001 2024-04-25T22:03:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879790+0000", 2024-04-25T22:03:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031862699999999998 2024-04-25T22:03:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880048+0000", 2024-04-25T22:03:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025776199999999998 2024-04-25T22:03:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882261+0000", 2024-04-25T22:03:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022130259999999999 2024-04-25T22:03:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.889734+0000", 2024-04-25T22:03:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0074735859999999999 2024-04-25T22:03:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890063+0000", 2024-04-25T22:03:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032892000000000002 2024-04-25T22:03:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890162+0000", 2024-04-25T22:03:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9118999999999997e-05 2024-04-25T22:03:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7135 4.27 4:e7bfb438:::10000001b58.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.575804835, 2024-04-25T22:03:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.033436429, 2024-04-25T22:03:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857099+0000", 2024-04-25T22:03:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0270000000000001e-06 2024-04-25T22:03:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857104+0000", 2024-04-25T22:03:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6909999999999996e-06 2024-04-25T22:03:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857116+0000", 2024-04-25T22:03:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2384999999999999e-05 2024-04-25T22:03:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857124+0000", 2024-04-25T22:03:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3080000000000008e-06 2024-04-25T22:03:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857175+0000", 2024-04-25T22:03:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0107e-05 2024-04-25T22:03:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857185+0000", 2024-04-25T22:03:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-04-25T22:03:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882135+0000", 2024-04-25T22:03:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.024950322 2024-04-25T22:03:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882426+0000", 2024-04-25T22:03:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029100699999999997 2024-04-25T22:03:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882689+0000", 2024-04-25T22:03:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026236800000000002 2024-04-25T22:03:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.885017+0000", 2024-04-25T22:03:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023282020000000001 2024-04-25T22:03:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890320+0000", 2024-04-25T22:03:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0053037049999999997 2024-04-25T22:03:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890428+0000", 2024-04-25T22:03:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107593 2024-04-25T22:03:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890534+0000", 2024-04-25T22:03:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106469 2024-04-25T22:03:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.556 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:50.556 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:50.556 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:50.557 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:03:50.558 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:50.556+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:50.658 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:50.656+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:50.692 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:50.693 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:50.693 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:03:50.693 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:50.708 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:03:50.759 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:50.756+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:50.836 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:50.836 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:03:50.836 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-25T22:03:50.836 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-25T22:03:50.836 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:50.850 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:03:50.897 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:50.896+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:50.960 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:50.956+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:50.973 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:03:50.973 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-25T22:03:50.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-25T22:03:50.973 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-25T22:03:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-25T22:03:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.985654891999999, 2024-04-25T22:03:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.180276931, 2024-04-25T22:03:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4 2024-04-25T22:03:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:50.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:50.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:50.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:50.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983832+0000", 2024-04-25T22:03:50.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:50.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:50.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.983834+0000", 2024-04-25T22:03:50.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2900000000000001e-06 2024-04-25T22:03:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991787+0000", 2024-04-25T22:03:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079521690000000003 2024-04-25T22:03:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991826+0000", 2024-04-25T22:03:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9258999999999998e-05 2024-04-25T22:03:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.991845+0000", 2024-04-25T22:03:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9360000000000001e-05 2024-04-25T22:03:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992058+0000", 2024-04-25T22:03:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212559 2024-04-25T22:03:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992213+0000", 2024-04-25T22:03:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015520700000000001 2024-04-25T22:03:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:51.992414+0000", 2024-04-25T22:03:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020049 2024-04-25T22:03:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.162511+0000", 2024-04-25T22:03:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.17009782900000001 2024-04-25T22:03:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.163967+0000", 2024-04-25T22:03:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001455752 2024-04-25T22:03:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164045+0000", 2024-04-25T22:03:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7415000000000003e-05 2024-04-25T22:03:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:02:52.164109+0000", 2024-04-25T22:03:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4601e-05 2024-04-25T22:03:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6847 4.16 4:68767fd1:::10000001f4f.00000000:head [write 0~7212] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.276015430999998, 2024-04-25T22:03:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0208302119999999, 2024-04-25T22:03:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6847 2024-04-25T22:03:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693472+0000", 2024-04-25T22:03:50.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:50.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:50.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693473+0000", 2024-04-25T22:03:50.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.75e-06 2024-04-25T22:03:50.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:50.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693490+0000", 2024-04-25T22:03:50.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6540000000000001e-05 2024-04-25T22:03:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693509+0000", 2024-04-25T22:03:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9536999999999999e-05 2024-04-25T22:03:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693522+0000", 2024-04-25T22:03:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2099000000000001e-05 2024-04-25T22:03:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693677+0000", 2024-04-25T22:03:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015516799999999999 2024-04-25T22:03:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.693705+0000", 2024-04-25T22:03:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8663e-05 2024-04-25T22:03:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705551+0000", 2024-04-25T22:03:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.011845495 2024-04-25T22:03:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.705942+0000", 2024-04-25T22:03:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00039080099999999997 2024-04-25T22:03:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.706151+0000", 2024-04-25T22:03:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000209457 2024-04-25T22:03:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711141+0000", 2024-04-25T22:03:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049901240000000003 2024-04-25T22:03:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714005+0000", 2024-04-25T22:03:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028642229999999999 2024-04-25T22:03:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714180+0000", 2024-04-25T22:03:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017433699999999999 2024-04-25T22:03:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714302+0000", 2024-04-25T22:03:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122018 2024-04-25T22:03:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:6960 4.16 4:6823d322:::10000001fd2.00000000:head [write 0~150] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.999011332999999, 2024-04-25T22:03:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.74417278899999995, 2024-04-25T22:03:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6960 2024-04-25T22:03:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970476+0000", 2024-04-25T22:03:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970478+0000", 2024-04-25T22:03:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.939e-06 2024-04-25T22:03:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970488+0000", 2024-04-25T22:03:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9699999999999994e-06 2024-04-25T22:03:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970524+0000", 2024-04-25T22:03:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5963000000000001e-05 2024-04-25T22:03:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970537+0000", 2024-04-25T22:03:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.31e-05 2024-04-25T22:03:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970701+0000", 2024-04-25T22:03:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164177 2024-04-25T22:03:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:04.970718+0000", 2024-04-25T22:03:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7323e-05 2024-04-25T22:03:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707632+0000", 2024-04-25T22:03:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.73691394300000002 2024-04-25T22:03:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.707924+0000", 2024-04-25T22:03:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029223299999999998 2024-04-25T22:03:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.708389+0000", 2024-04-25T22:03:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046429300000000001 2024-04-25T22:03:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711293+0000", 2024-04-25T22:03:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029039830000000002 2024-04-25T22:03:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714409+0000", 2024-04-25T22:03:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031159260000000002 2024-04-25T22:03:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714538+0000", 2024-04-25T22:03:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012952100000000001 2024-04-25T22:03:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714649+0000", 2024-04-25T22:03:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110418 2024-04-25T22:03:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7039 4.16 4:6919637e:::10000002032.00000000:head [write 0~2968] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:50.992 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:50.992 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.812964827999998, 2024-04-25T22:03:50.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.56024932199999999, 2024-04-25T22:03:50.992 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:50.992 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:50.992 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.992 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:50.992 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:50.992 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:50.992 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7039 2024-04-25T22:03:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156522+0000", 2024-04-25T22:03:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156523+0000", 2024-04-25T22:03:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2130000000000001e-06 2024-04-25T22:03:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156530+0000", 2024-04-25T22:03:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9090000000000003e-06 2024-04-25T22:03:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156544+0000", 2024-04-25T22:03:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3271999999999999e-05 2024-04-25T22:03:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156551+0000", 2024-04-25T22:03:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4970000000000004e-06 2024-04-25T22:03:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156639+0000", 2024-04-25T22:03:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7638000000000004e-05 2024-04-25T22:03:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.156649+0000", 2024-04-25T22:03:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0536e-05 2024-04-25T22:03:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709515+0000", 2024-04-25T22:03:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.55286568999999997 2024-04-25T22:03:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.709836+0000", 2024-04-25T22:03:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00032078899999999998 2024-04-25T22:03:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.710271+0000", 2024-04-25T22:03:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043530000000000001 2024-04-25T22:03:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716576+0000", 2024-04-25T22:03:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063045050000000002 2024-04-25T22:03:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716605+0000", 2024-04-25T22:03:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8949e-05 2024-04-25T22:03:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716706+0000", 2024-04-25T22:03:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101765 2024-04-25T22:03:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716772+0000", 2024-04-25T22:03:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5259000000000007e-05 2024-04-25T22:03:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7065 4.16 4:697a9f10:::10000002050.00000000:head [write 0~16297] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.75534888, 2024-04-25T22:03:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.50307290800000004, 2024-04-25T22:03:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:50.999 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:50.999 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:50.999 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:50.999 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7065 2024-04-25T22:03:50.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.999 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:50.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:50.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:50.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:50.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:50.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:50.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214138+0000", 2024-04-25T22:03:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214139+0000", 2024-04-25T22:03:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.186e-06 2024-04-25T22:03:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214170+0000", 2024-04-25T22:03:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0419000000000001e-05 2024-04-25T22:03:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214186+0000", 2024-04-25T22:03:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6526000000000001e-05 2024-04-25T22:03:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214194+0000", 2024-04-25T22:03:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6769999999999995e-06 2024-04-25T22:03:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214380+0000", 2024-04-25T22:03:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018580699999999999 2024-04-25T22:03:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:51.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.214399+0000", 2024-04-25T22:03:51.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9446e-05 2024-04-25T22:03:51.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711402+0000", 2024-04-25T22:03:51.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.497002901 2024-04-25T22:03:51.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.711822+0000", 2024-04-25T22:03:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00041989399999999997 2024-04-25T22:03:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.712017+0000", 2024-04-25T22:03:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019540700000000001 2024-04-25T22:03:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716792+0000", 2024-04-25T22:03:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047748210000000003 2024-04-25T22:03:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.716937+0000", 2024-04-25T22:03:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014479099999999999 2024-04-25T22:03:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717081+0000", 2024-04-25T22:03:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014412100000000001 2024-04-25T22:03:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717211+0000", 2024-04-25T22:03:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012991200000000001 2024-04-25T22:03:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7089 4.16 4:6868fcac:::1000000206b.00000000:head [write 0~5386] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.695794886000002, 2024-04-25T22:03:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44658810700000001, 2024-04-25T22:03:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7089 2024-04-25T22:03:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273692+0000", 2024-04-25T22:03:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273695+0000", 2024-04-25T22:03:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.463e-06 2024-04-25T22:03:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273712+0000", 2024-04-25T22:03:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7842999999999998e-05 2024-04-25T22:03:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273742+0000", 2024-04-25T22:03:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9039000000000001e-05 2024-04-25T22:03:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273756+0000", 2024-04-25T22:03:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4406999999999999e-05 2024-04-25T22:03:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273943+0000", 2024-04-25T22:03:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018708 2024-04-25T22:03:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.273961+0000", 2024-04-25T22:03:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7977000000000001e-05 2024-04-25T22:03:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.714748+0000", 2024-04-25T22:03:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.440786605 2024-04-25T22:03:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715013+0000", 2024-04-25T22:03:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026558300000000001 2024-04-25T22:03:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.715309+0000", 2024-04-25T22:03:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000295715 2024-04-25T22:03:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.719035+0000", 2024-04-25T22:03:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037256310000000001 2024-04-25T22:03:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720142+0000", 2024-04-25T22:03:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001107053 2024-04-25T22:03:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720221+0000", 2024-04-25T22:03:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9832000000000004e-05 2024-04-25T22:03:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720280+0000", 2024-04-25T22:03:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8879000000000003e-05 2024-04-25T22:03:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:7090 4.16 4:69dc3034:::1000000206c.00000000:head [write 0~957] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-25T22:03:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.693170555999998, 2024-04-25T22:03:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44572077100000002, 2024-04-25T22:03:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7090 2024-04-25T22:03:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276317+0000", 2024-04-25T22:03:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276319+0000", 2024-04-25T22:03:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3429999999999998e-06 2024-04-25T22:03:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276330+0000", 2024-04-25T22:03:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1567e-05 2024-04-25T22:03:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276362+0000", 2024-04-25T22:03:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1863000000000003e-05 2024-04-25T22:03:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276377+0000", 2024-04-25T22:03:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5102999999999999e-05 2024-04-25T22:03:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276564+0000", 2024-04-25T22:03:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018629700000000001 2024-04-25T22:03:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2024-04-25T22:03:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.276583+0000", 2024-04-25T22:03:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9743000000000001e-05 2024-04-25T22:03:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717354+0000", 2024-04-25T22:03:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.44077094900000002 2024-04-25T22:03:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.717723+0000", 2024-04-25T22:03:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036839099999999998 2024-04-25T22:03:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.718097+0000", 2024-04-25T22:03:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037392099999999999 2024-04-25T22:03:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.720305+0000", 2024-04-25T22:03:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022084439999999999 2024-04-25T22:03:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721866+0000", 2024-04-25T22:03:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015610260000000001 2024-04-25T22:03:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.721944+0000", 2024-04-25T22:03:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7961999999999997e-05 2024-04-25T22:03:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:05.722037+0000", 2024-04-25T22:03:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3162e-05 2024-04-25T22:03:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4564.0:10647 4.35 4:ae7b229b:::100000030a9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.440125862000002, 2024-04-25T22:03:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14506126, 2024-04-25T22:03:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-25T22:03:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4564", 2024-04-25T22:03:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10647 2024-04-25T22:03:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529361+0000", 2024-04-25T22:03:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.529364+0000", 2024-04-25T22:03:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.286e-06 2024-04-25T22:03:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538917+0000", 2024-04-25T22:03:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0095530010000000002 2024-04-25T22:03:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538955+0000", 2024-04-25T22:03:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:03:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.538977+0000", 2024-04-25T22:03:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.105e-05 2024-04-25T22:03:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568092+0000", 2024-04-25T22:03:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029115604999999999 2024-04-25T22:03:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568243+0000", 2024-04-25T22:03:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000151044 2024-04-25T22:03:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.568498+0000", 2024-04-25T22:03:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025517399999999999 2024-04-25T22:03:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.628005+0000", 2024-04-25T22:03:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059506991000000002 2024-04-25T22:03:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674273+0000", 2024-04-25T22:03:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.046267233999999997 2024-04-25T22:03:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674357+0000", 2024-04-25T22:03:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4745000000000003e-05 2024-04-25T22:03:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:13.674422+0000", 2024-04-25T22:03:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5160999999999995e-05 2024-04-25T22:03:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3016 3.d 3:b02ffd62:::200.00000010:head [write 3891938~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.286806276, 2024-04-25T22:03:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.144195727, 2024-04-25T22:03:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682681+0000", 2024-04-25T22:03:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682682+0000", 2024-04-25T22:03:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6000000000000003e-07 2024-04-25T22:03:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682686+0000", 2024-04-25T22:03:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4630000000000003e-06 2024-04-25T22:03:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682695+0000", 2024-04-25T22:03:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7360000000000007e-06 2024-04-25T22:03:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682702+0000", 2024-04-25T22:03:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1239999999999999e-06 2024-04-25T22:03:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821515+0000", 2024-04-25T22:03:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13881310499999999 2024-04-25T22:03:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821780+0000", 2024-04-25T22:03:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026492699999999998 2024-04-25T22:03:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.821974+0000", 2024-04-25T22:03:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000194561 2024-04-25T22:03:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826533+0000", 2024-04-25T22:03:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045586649999999999 2024-04-25T22:03:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826574+0000", 2024-04-25T22:03:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0995999999999998e-05 2024-04-25T22:03:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826754+0000", 2024-04-25T22:03:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017955400000000001 2024-04-25T22:03:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826877+0000", 2024-04-25T22:03:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122836 2024-04-25T22:03:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3017 3.d 3:b02ffd62:::200.00000010:head [write 3893337~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.286776443000001, 2024-04-25T22:03:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.146040321, 2024-04-25T22:03:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682711+0000", 2024-04-25T22:03:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:03:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682716+0000", 2024-04-25T22:03:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3930000000000001e-06 2024-04-25T22:03:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682724+0000", 2024-04-25T22:03:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5769999999999994e-06 2024-04-25T22:03:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.682731+0000", 2024-04-25T22:03:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1629999999999999e-06 2024-04-25T22:03:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823295+0000", 2024-04-25T22:03:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14056342099999999 2024-04-25T22:03:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823578+0000", 2024-04-25T22:03:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028355299999999997 2024-04-25T22:03:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.823777+0000", 2024-04-25T22:03:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000198791 2024-04-25T22:03:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.826993+0000", 2024-04-25T22:03:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032162169999999999 2024-04-25T22:03:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828492+0000", 2024-04-25T22:03:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001498283 2024-04-25T22:03:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828633+0000", 2024-04-25T22:03:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000141225 2024-04-25T22:03:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828751+0000", 2024-04-25T22:03:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000118038 2024-04-25T22:03:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3021 3.d 3:b02ffd62:::200.00000010:head [write 3899493~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.277182429, 2024-04-25T22:03:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14539154500000001, 2024-04-25T22:03:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692305+0000", 2024-04-25T22:03:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692307+0000", 2024-04-25T22:03:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.216e-06 2024-04-25T22:03:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692316+0000", 2024-04-25T22:03:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:03:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692357+0000", 2024-04-25T22:03:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233000000000003e-05 2024-04-25T22:03:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.692375+0000", 2024-04-25T22:03:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7949999999999999e-05 2024-04-25T22:03:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.828922+0000", 2024-04-25T22:03:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.136546426 2024-04-25T22:03:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.829064+0000", 2024-04-25T22:03:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014193499999999999 2024-04-25T22:03:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.829295+0000", 2024-04-25T22:03:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023144100000000001 2024-04-25T22:03:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832412+0000", 2024-04-25T22:03:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003117112 2024-04-25T22:03:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837543+0000", 2024-04-25T22:03:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005131147 2024-04-25T22:03:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837629+0000", 2024-04-25T22:03:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5378999999999997e-05 2024-04-25T22:03:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837696+0000", 2024-04-25T22:03:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7426000000000001e-05 2024-04-25T22:03:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3022 3.d 3:b02ffd62:::200.00000010:head [write 3901402~4724 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.273680127999999, 2024-04-25T22:03:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14672065500000001, 2024-04-25T22:03:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695807+0000", 2024-04-25T22:03:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695809+0000", 2024-04-25T22:03:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1100000000000001e-06 2024-04-25T22:03:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695828+0000", 2024-04-25T22:03:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8618999999999999e-05 2024-04-25T22:03:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695850+0000", 2024-04-25T22:03:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2243e-05 2024-04-25T22:03:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.695864+0000", 2024-04-25T22:03:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3687e-05 2024-04-25T22:03:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831024+0000", 2024-04-25T22:03:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13516004300000001 2024-04-25T22:03:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831155+0000", 2024-04-25T22:03:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000131605 2024-04-25T22:03:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.831353+0000", 2024-04-25T22:03:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000197708 2024-04-25T22:03:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837521+0000", 2024-04-25T22:03:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0061684180000000002 2024-04-25T22:03:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842269+0000", 2024-04-25T22:03:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047475659999999999 2024-04-25T22:03:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842402+0000", 2024-04-25T22:03:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000132643 2024-04-25T22:03:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842528+0000", 2024-04-25T22:03:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012601299999999999 2024-04-25T22:03:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3023 3.d 3:b02ffd62:::200.00000010:head [write 3906126~6707 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.270418371000002, 2024-04-25T22:03:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14563398599999999, 2024-04-25T22:03:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699069+0000", 2024-04-25T22:03:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699071+0000", 2024-04-25T22:03:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.996e-06 2024-04-25T22:03:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699090+0000", 2024-04-25T22:03:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9449999999999998e-05 2024-04-25T22:03:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699112+0000", 2024-04-25T22:03:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2306e-05 2024-04-25T22:03:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.699126+0000", 2024-04-25T22:03:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.383e-05 2024-04-25T22:03:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832497+0000", 2024-04-25T22:03:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13337096500000001 2024-04-25T22:03:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832632+0000", 2024-04-25T22:03:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013481499999999999 2024-04-25T22:03:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.832828+0000", 2024-04-25T22:03:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000195558 2024-04-25T22:03:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.837801+0000", 2024-04-25T22:03:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049729459999999998 2024-04-25T22:03:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844398+0000", 2024-04-25T22:03:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065972829999999998 2024-04-25T22:03:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844594+0000", 2024-04-25T22:03:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000195675 2024-04-25T22:03:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844703+0000", 2024-04-25T22:03:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109162 2024-04-25T22:03:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3024 3.d 3:b02ffd62:::200.00000010:head [write 3912833~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.267353648, 2024-04-25T22:03:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14279916000000001, 2024-04-25T22:03:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702133+0000", 2024-04-25T22:03:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702135+0000", 2024-04-25T22:03:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9530000000000002e-06 2024-04-25T22:03:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702154+0000", 2024-04-25T22:03:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8496e-05 2024-04-25T22:03:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702180+0000", 2024-04-25T22:03:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6313e-05 2024-04-25T22:03:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.702205+0000", 2024-04-25T22:03:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.478e-05 2024-04-25T22:03:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836035+0000", 2024-04-25T22:03:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.133830269 2024-04-25T22:03:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836168+0000", 2024-04-25T22:03:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013234799999999999 2024-04-25T22:03:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.836364+0000", 2024-04-25T22:03:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000196398 2024-04-25T22:03:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844793+0000", 2024-04-25T22:03:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.008428685 2024-04-25T22:03:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844811+0000", 2024-04-25T22:03:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8719000000000002e-05 2024-04-25T22:03:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844881+0000", 2024-04-25T22:03:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9671000000000004e-05 2024-04-25T22:03:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.844933+0000", 2024-04-25T22:03:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1527999999999999e-05 2024-04-25T22:03:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3026 3.d 3:b02ffd62:::200.00000010:head [write 3919976~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.260668710000001, 2024-04-25T22:03:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14237590899999999, 2024-04-25T22:03:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708818+0000", 2024-04-25T22:03:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708820+0000", 2024-04-25T22:03:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7600000000000001e-06 2024-04-25T22:03:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708832+0000", 2024-04-25T22:03:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1803e-05 2024-04-25T22:03:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708854+0000", 2024-04-25T22:03:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2467e-05 2024-04-25T22:03:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708872+0000", 2024-04-25T22:03:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7453e-05 2024-04-25T22:03:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842641+0000", 2024-04-25T22:03:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13376964099999999 2024-04-25T22:03:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.842832+0000", 2024-04-25T22:03:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000190843 2024-04-25T22:03:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.843194+0000", 2024-04-25T22:03:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036169300000000001 2024-04-25T22:03:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845406+0000", 2024-04-25T22:03:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022118530000000002 2024-04-25T22:03:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851048+0000", 2024-04-25T22:03:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056423410000000004 2024-04-25T22:03:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851127+0000", 2024-04-25T22:03:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8461999999999995e-05 2024-04-25T22:03:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851194+0000", 2024-04-25T22:03:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7593000000000001e-05 2024-04-25T22:03:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3027 3.d 3:b02ffd62:::200.00000010:head [write 3922740~2927 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.260563431000001, 2024-04-25T22:03:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14516088799999999, 2024-04-25T22:03:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708924+0000", 2024-04-25T22:03:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708925+0000", 2024-04-25T22:03:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.683e-06 2024-04-25T22:03:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708936+0000", 2024-04-25T22:03:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.11e-05 2024-04-25T22:03:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708960+0000", 2024-04-25T22:03:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3839999999999999e-05 2024-04-25T22:03:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.708977+0000", 2024-04-25T22:03:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6379e-05 2024-04-25T22:03:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845488+0000", 2024-04-25T22:03:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.136511414 2024-04-25T22:03:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845619+0000", 2024-04-25T22:03:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000130755 2024-04-25T22:03:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.845817+0000", 2024-04-25T22:03:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000198271 2024-04-25T22:03:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849529+0000", 2024-04-25T22:03:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003711888 2024-04-25T22:03:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.853911+0000", 2024-04-25T22:03:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043815800000000004 2024-04-25T22:03:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854018+0000", 2024-04-25T22:03:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000107879 2024-04-25T22:03:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854085+0000", 2024-04-25T22:03:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6099000000000005e-05 2024-04-25T22:03:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3028 3.d 3:b02ffd62:::200.00000010:head [write 3925667~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.260042887000001, 2024-04-25T22:03:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14478423600000001, 2024-04-25T22:03:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709444+0000", 2024-04-25T22:03:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709446+0000", 2024-04-25T22:03:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.73e-06 2024-04-25T22:03:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709454+0000", 2024-04-25T22:03:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:03:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709470+0000", 2024-04-25T22:03:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5956000000000001e-05 2024-04-25T22:03:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709483+0000", 2024-04-25T22:03:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.216e-05 2024-04-25T22:03:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.846891+0000", 2024-04-25T22:03:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13740814600000001 2024-04-25T22:03:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.847019+0000", 2024-04-25T22:03:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000128121 2024-04-25T22:03:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.847227+0000", 2024-04-25T22:03:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020847800000000001 2024-04-25T22:03:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.852488+0000", 2024-04-25T22:03:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052603759999999998 2024-04-25T22:03:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854101+0000", 2024-04-25T22:03:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001613354 2024-04-25T22:03:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854170+0000", 2024-04-25T22:03:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8935000000000003e-05 2024-04-25T22:03:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854228+0000", 2024-04-25T22:03:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8437000000000003e-05 2024-04-25T22:03:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3029 3.d 3:b02ffd62:::200.00000010:head [write 3927576~2418 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.259965025, 2024-04-25T22:03:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14641235599999999, 2024-04-25T22:03:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709522+0000", 2024-04-25T22:03:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709523+0000", 2024-04-25T22:03:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9999999999999995e-07 2024-04-25T22:03:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709530+0000", 2024-04-25T22:03:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7900000000000002e-06 2024-04-25T22:03:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709545+0000", 2024-04-25T22:03:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5563e-05 2024-04-25T22:03:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.709554+0000", 2024-04-25T22:03:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7700000000000007e-06 2024-04-25T22:03:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848071+0000", 2024-04-25T22:03:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.13851706499999999 2024-04-25T22:03:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848219+0000", 2024-04-25T22:03:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014761599999999999 2024-04-25T22:03:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.848412+0000", 2024-04-25T22:03:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019303300000000001 2024-04-25T22:03:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.854240+0000", 2024-04-25T22:03:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058282359999999997 2024-04-25T22:03:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855804+0000", 2024-04-25T22:03:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001563938 2024-04-25T22:03:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855879+0000", 2024-04-25T22:03:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4683000000000003e-05 2024-04-25T22:03:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855934+0000", 2024-04-25T22:03:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5661999999999997e-05 2024-04-25T22:03:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3030 3.d 3:b02ffd62:::200.00000010:head [write 3929994~2764 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.258546616, 2024-04-25T22:03:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.146870588, 2024-04-25T22:03:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710940+0000", 2024-04-25T22:03:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710942+0000", 2024-04-25T22:03:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.024e-06 2024-04-25T22:03:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710955+0000", 2024-04-25T22:03:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2103000000000001e-05 2024-04-25T22:03:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710977+0000", 2024-04-25T22:03:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2606e-05 2024-04-25T22:03:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.710991+0000", 2024-04-25T22:03:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3689999999999999e-05 2024-04-25T22:03:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849638+0000", 2024-04-25T22:03:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.138646667 2024-04-25T22:03:51.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.849809+0000", 2024-04-25T22:03:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000171495 2024-04-25T22:03:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.850048+0000", 2024-04-25T22:03:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023940699999999999 2024-04-25T22:03:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.855954+0000", 2024-04-25T22:03:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059050919999999998 2024-04-25T22:03:51.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857670+0000", 2024-04-25T22:03:51.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017168489999999999 2024-04-25T22:03:51.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:51.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857747+0000", 2024-04-25T22:03:51.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6526000000000006e-05 2024-04-25T22:03:51.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857811+0000", 2024-04-25T22:03:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4128999999999995e-05 2024-04-25T22:03:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:3031 3.d 3:b02ffd62:::200.00000010:head [write 3932758~2245 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-25T22:03:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.258336168, 2024-04-25T22:03:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14694558999999999, 2024-04-25T22:03:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: "continuous": false, 2024-04-25T22:03:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-25T22:03:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-25T22:03:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-25T22:03:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-25T22:03:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711151+0000", 2024-04-25T22:03:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-25T22:03:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-25T22:03:51.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711152+0000", 2024-04-25T22:03:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5230000000000001e-06 2024-04-25T22:03:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-25T22:03:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711162+0000", 2024-04-25T22:03:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2299999999999997e-06 2024-04-25T22:03:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-25T22:03:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711179+0000", 2024-04-25T22:03:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7220000000000001e-05 2024-04-25T22:03:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.711190+0000", 2024-04-25T22:03:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1323e-05 2024-04-25T22:03:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-25T22:03:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851296+0000", 2024-04-25T22:03:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.14010541600000001 2024-04-25T22:03:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-25T22:03:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851436+0000", 2024-04-25T22:03:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000140409 2024-04-25T22:03:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.851641+0000", 2024-04-25T22:03:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020471700000000001 2024-04-25T22:03:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-25T22:03:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857847+0000", 2024-04-25T22:03:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062065310000000004 2024-04-25T22:03:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.857952+0000", 2024-04-25T22:03:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105132 2024-04-25T22:03:51.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-25T22:03:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.858026+0000", 2024-04-25T22:03:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3799000000000003e-05 2024-04-25T22:03:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:03:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:03:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-25T22:03:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-25T22:03:24.858096+0000", 2024-04-25T22:03:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0290000000000006e-05 2024-04-25T22:03:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.086 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:03:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:03:51.087 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:03:51.087 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:03:51.089 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T22:03:51.089 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:51.090 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T22:03:51.090 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:03:51.091 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:51.088+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:51.189 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:51.188+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:51.224 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:51.224 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:51.224 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:03:51.224 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:51.238 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:51.290 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:51.288+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:51.361 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:51.361 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:51.361 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:03:51.361 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:03:51.361 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:51.374 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:51.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:51.416+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:51.432 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:03:51.434 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:03:51.450 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-04-25T22:03:51.035195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127965280,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2864,"num_read_kb":1340487,"num_write":29401,"num_write_kb":4408197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32745,"ondisk_log_size":32745,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":298348,"kb_used_data":71752,"kb_used_omap":4,"kb_used_meta":226555,"kb_avail":282817172,"statfs":{"total":289910292480,"available":289604784128,"internally_reserved":0,"allocated":73474048,"data_stored":256670202,"data_compressed":21842414,"data_compressed_allocated":35356672,"data_compressed_original":219611136,"omap_allocated":4785,"internal_metadata":231992655},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12394663,"num_objects":-1924,"num_object_clones":0,"num_object_copies":-3848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1924,"num_whiteouts":0,"num_read":10,"num_read_kb":237,"num_write":1989,"num_write_kb":3054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.433956"},"pg_stats":[{"pgid":"4.3f","version":"76'438","reported_seq":549,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.878952+0000","last_change":"2024-04-25T22:03:33.876369+0000","last_active":"2024-04-25T22:03:46.878952+0000","last_peered":"2024-04-25T22:03:46.878952+0000","last_clean":"2024-04-25T22:03:46.878952+0000","last_became_active":"2024-04-25T22:03:33.873739+0000","last_became_peered":"2024-04-25T22:03:33.873739+0000","last_unstale":"2024-04-25T22:03:46.878952+0000","last_undegraded":"2024-04-25T22:03:46.878952+0000","last_fullsized":"2024-04-25T22:03:46.878952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:32.529707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29432,"num_write":407,"num_write_kb":84235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"76'413","reported_seq":519,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.917933+0000","last_change":"2024-04-25T22:03:33.861269+0000","last_active":"2024-04-25T22:03:46.917933+0000","last_peered":"2024-04-25T22:03:46.917933+0000","last_clean":"2024-04-25T22:03:46.917933+0000","last_became_active":"2024-04-25T22:03:33.859221+0000","last_became_peered":"2024-04-25T22:03:33.859221+0000","last_unstale":"2024-04-25T22:03:46.917933+0000","last_undegraded":"2024-04-25T22:03:46.917933+0000","last_fullsized":"2024-04-25T22:03:46.917933+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:23:44.690527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":23541,"num_write":389,"num_write_kb":87654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"76'382","reported_seq":549,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.909574+0000","last_change":"2024-04-25T22:03:33.865905+0000","last_active":"2024-04-25T22:03:46.909574+0000","last_peered":"2024-04-25T22:03:46.909574+0000","last_clean":"2024-04-25T22:03:46.909574+0000","last_became_active":"2024-04-25T22:03:33.863788+0000","last_became_peered":"2024-04-25T22:03:33.863788+0000","last_unstale":"2024-04-25T22:03:46.909574+0000","last_undegraded":"2024-04-25T22:03:46.909574+0000","last_fullsized":"2024-04-25T22:03:46.909574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:01:10.252145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22311,"num_write":361,"num_write_kb":42975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'391","reported_seq":559,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:48.850851+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:03:48.850851+0000","last_peered":"2024-04-25T22:03:48.850851+0000","last_clean":"2024-04-25T22:03:48.850851+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:03:48.850851+0000","last_undegraded":"2024-04-25T22:03:48.850851+0000","last_fullsized":"2024-04-25T22:03:48.850851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":20785,"num_write":367,"num_write_kb":63746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"76'425","reported_seq":524,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.896796+0000","last_change":"2024-04-25T22:02:49.879514+0000","last_active":"2024-04-25T22:03:46.896796+0000","last_peered":"2024-04-25T22:03:46.896796+0000","last_clean":"2024-04-25T22:03:46.896796+0000","last_became_active":"2024-04-25T22:02:49.878964+0000","last_became_peered":"2024-04-25T22:02:49.878964+0000","last_unstale":"2024-04-25T22:03:46.896796+0000","last_undegraded":"2024-04-25T22:03:46.896796+0000","last_fullsized":"2024-04-25T22:03:46.896796+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.432134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":20896,"num_write":403,"num_write_kb":100255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"76'363","reported_seq":513,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.887661+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:03:46.887661+0000","last_peered":"2024-04-25T22:03:46.887661+0000","last_clean":"2024-04-25T22:03:46.887661+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:03:46.887661+0000","last_undegraded":"2024-04-25T22:03:46.887661+0000","last_fullsized":"2024-04-25T22:03:46.887661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9362,"num_write":344,"num_write_kb":20831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"76'433","reported_seq":609,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.892971+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:03:46.892971+0000","last_peered":"2024-04-25T22:03:46.892971+0000","last_clean":"2024-04-25T22:03:46.892971+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:03:46.892971+0000","last_undegraded":"2024-04-25T22:03:46.892971+0000","last_fullsized":"2024-04-25T22:03:46.892971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25961,"num_write":415,"num_write_kb":72541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'385","reported_seq":572,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.920884+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:03:46.920884+0000","last_peered":"2024-04-25T22:03:46.920884+0000","last_clean":"2024-04-25T22:03:46.920884+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:03:46.920884+0000","last_undegraded":"2024-04-25T22:03:46.920884+0000","last_fullsized":"2024-04-25T22:03:46.920884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":24749,"num_write":354,"num_write_kb":64232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"76'432","reported_seq":594,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.921800+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:03:46.921800+0000","last_peered":"2024-04-25T22:03:46.921800+0000","last_clean":"2024-04-25T22:03:46.921800+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:03:46.921800+0000","last_undegraded":"2024-04-25T22:03:46.921800+0000","last_fullsized":"2024-04-25T22:03:46.921800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":10648,"num_write":411,"num_write_kb":92932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'376","reported_seq":472,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.911061+0000","last_change":"2024-04-25T22:03:33.862062+0000","last_active":"2024-04-25T22:03:46.911061+0000","last_peered":"2024-04-25T22:03:46.911061+0000","last_clean":"2024-04-25T22:03:46.911061+0000","last_became_active":"2024-04-25T22:03:33.859382+0000","last_became_peered":"2024-04-25T22:03:33.859382+0000","last_unstale":"2024-04-25T22:03:46.911061+0000","last_undegraded":"2024-04-25T22:03:46.911061+0000","last_fullsized":"2024-04-25T22:03:46.911061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:22.713919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10696,"num_write":359,"num_write_kb":63259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"76'386","reported_seq":540,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.923144+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:03:46.923144+0000","last_peered":"2024-04-25T22:03:46.923144+0000","last_clean":"2024-04-25T22:03:46.923144+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:03:46.923144+0000","last_undegraded":"2024-04-25T22:03:46.923144+0000","last_fullsized":"2024-04-25T22:03:46.923144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11259,"num_write":372,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"76'358","reported_seq":586,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.912698+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:03:46.912698+0000","last_peered":"2024-04-25T22:03:46.912698+0000","last_clean":"2024-04-25T22:03:46.912698+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:03:46.912698+0000","last_undegraded":"2024-04-25T22:03:46.912698+0000","last_fullsized":"2024-04-25T22:03:46.912698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":51972,"num_write":340,"num_write_kb":51203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"76'410","reported_seq":517,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.896298+0000","last_change":"2024-04-25T22:03:33.866815+0000","last_active":"2024-04-25T22:03:46.896298+0000","last_peered":"2024-04-25T22:03:46.896298+0000","last_clean":"2024-04-25T22:03:46.896298+0000","last_became_active":"2024-04-25T22:03:33.859376+0000","last_became_peered":"2024-04-25T22:03:33.859376+0000","last_unstale":"2024-04-25T22:03:46.896298+0000","last_undegraded":"2024-04-25T22:03:46.896298+0000","last_fullsized":"2024-04-25T22:03:46.896298+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:08.620311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17620,"num_write":386,"num_write_kb":100613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"76'429","reported_seq":599,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.917175+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:03:46.917175+0000","last_peered":"2024-04-25T22:03:46.917175+0000","last_clean":"2024-04-25T22:03:46.917175+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:03:46.917175+0000","last_undegraded":"2024-04-25T22:03:46.917175+0000","last_fullsized":"2024-04-25T22:03:46.917175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27327,"num_write":398,"num_write_kb":76113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"76'384","reported_seq":555,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:48.863323+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:03:48.863323+0000","last_peered":"2024-04-25T22:03:48.863323+0000","last_clean":"2024-04-25T22:03:48.863323+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:03:48.863323+0000","last_undegraded":"2024-04-25T22:03:48.863323+0000","last_fullsized":"2024-04-25T22:03:48.863323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23986,"num_write":352,"num_write_kb":50754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"76'425","reported_seq":585,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.912940+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:03:46.912940+0000","last_peered":"2024-04-25T22:03:46.912940+0000","last_clean":"2024-04-25T22:03:46.912940+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:03:46.912940+0000","last_undegraded":"2024-04-25T22:03:46.912940+0000","last_fullsized":"2024-04-25T22:03:46.912940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":13806,"num_write":403,"num_write_kb":38995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"76'436","reported_seq":604,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.921788+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:03:46.921788+0000","last_peered":"2024-04-25T22:03:46.921788+0000","last_clean":"2024-04-25T22:03:46.921788+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:03:46.921788+0000","last_undegraded":"2024-04-25T22:03:46.921788+0000","last_fullsized":"2024-04-25T22:03:46.921788+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":11085,"num_write":416,"num_write_kb":68377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'386","reported_seq":474,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.894623+0000","last_change":"2024-04-25T22:03:33.862762+0000","last_active":"2024-04-25T22:03:46.894623+0000","last_peered":"2024-04-25T22:03:46.894623+0000","last_clean":"2024-04-25T22:03:46.894623+0000","last_became_active":"2024-04-25T22:03:33.861082+0000","last_became_peered":"2024-04-25T22:03:33.861082+0000","last_unstale":"2024-04-25T22:03:46.894623+0000","last_undegraded":"2024-04-25T22:03:46.894623+0000","last_fullsized":"2024-04-25T22:03:46.894623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:15.823113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6581,"num_write":355,"num_write_kb":34159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"76'440","reported_seq":595,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.901926+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:03:46.901926+0000","last_peered":"2024-04-25T22:03:46.901926+0000","last_clean":"2024-04-25T22:03:46.901926+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:03:46.901926+0000","last_undegraded":"2024-04-25T22:03:46.901926+0000","last_fullsized":"2024-04-25T22:03:46.901926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22089,"num_write":411,"num_write_kb":104750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'426","reported_seq":576,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.907281+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:03:46.907281+0000","last_peered":"2024-04-25T22:03:46.907281+0000","last_clean":"2024-04-25T22:03:46.907281+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:03:46.907281+0000","last_undegraded":"2024-04-25T22:03:46.907281+0000","last_fullsized":"2024-04-25T22:03:46.907281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11886,"num_write":398,"num_write_kb":55010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":573,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:48.879017+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:03:48.879017+0000","last_peered":"2024-04-25T22:03:48.879017+0000","last_clean":"2024-04-25T22:03:48.879017+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:03:48.879017+0000","last_undegraded":"2024-04-25T22:03:48.879017+0000","last_fullsized":"2024-04-25T22:03:48.879017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23004,"num_write":370,"num_write_kb":75802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'426","reported_seq":527,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.910400+0000","last_change":"2024-04-25T22:02:49.886169+0000","last_active":"2024-04-25T22:03:46.910400+0000","last_peered":"2024-04-25T22:03:46.910400+0000","last_clean":"2024-04-25T22:03:46.910400+0000","last_became_active":"2024-04-25T22:02:49.884516+0000","last_became_peered":"2024-04-25T22:02:49.884516+0000","last_unstale":"2024-04-25T22:03:46.910400+0000","last_undegraded":"2024-04-25T22:03:46.910400+0000","last_fullsized":"2024-04-25T22:03:46.910400+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:21.251127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11950,"num_write":408,"num_write_kb":67524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'395","reported_seq":546,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.890146+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:03:46.890146+0000","last_peered":"2024-04-25T22:03:46.890146+0000","last_clean":"2024-04-25T22:03:46.890146+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:03:46.890146+0000","last_undegraded":"2024-04-25T22:03:46.890146+0000","last_fullsized":"2024-04-25T22:03:46.890146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":6507,"num_write":370,"num_write_kb":51513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'443","reported_seq":561,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.903132+0000","last_change":"2024-04-25T22:02:49.876986+0000","last_active":"2024-04-25T22:03:46.903132+0000","last_peered":"2024-04-25T22:03:46.903132+0000","last_clean":"2024-04-25T22:03:46.903132+0000","last_became_active":"2024-04-25T22:02:49.876269+0000","last_became_peered":"2024-04-25T22:02:49.876269+0000","last_unstale":"2024-04-25T22:03:46.903132+0000","last_undegraded":"2024-04-25T22:03:46.903132+0000","last_fullsized":"2024-04-25T22:03:46.903132+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:35:35.547810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27047,"num_write":417,"num_write_kb":63386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"76'404","reported_seq":515,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.885193+0000","last_change":"2024-04-25T22:03:33.869313+0000","last_active":"2024-04-25T22:03:46.885193+0000","last_peered":"2024-04-25T22:03:46.885193+0000","last_clean":"2024-04-25T22:03:46.885193+0000","last_became_active":"2024-04-25T22:03:33.864163+0000","last_became_peered":"2024-04-25T22:03:33.864163+0000","last_unstale":"2024-04-25T22:03:46.885193+0000","last_undegraded":"2024-04-25T22:03:46.885193+0000","last_fullsized":"2024-04-25T22:03:46.885193+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:51:33.564347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25550,"num_write":386,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"76'470","reported_seq":667,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.921401+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:03:46.921401+0000","last_peered":"2024-04-25T22:03:46.921401+0000","last_clean":"2024-04-25T22:03:46.921401+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:03:46.921401+0000","last_undegraded":"2024-04-25T22:03:46.921401+0000","last_fullsized":"2024-04-25T22:03:46.921401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":30714,"num_write":444,"num_write_kb":92836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'387","reported_seq":565,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:48.890455+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:03:48.890455+0000","last_peered":"2024-04-25T22:03:48.890455+0000","last_clean":"2024-04-25T22:03:48.890455+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:03:48.890455+0000","last_undegraded":"2024-04-25T22:03:48.890455+0000","last_fullsized":"2024-04-25T22:03:48.890455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21644,"num_write":354,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"76'401","reported_seq":591,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.895022+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:03:46.895022+0000","last_peered":"2024-04-25T22:03:46.895022+0000","last_clean":"2024-04-25T22:03:46.895022+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:03:46.895022+0000","last_undegraded":"2024-04-25T22:03:46.895022+0000","last_fullsized":"2024-04-25T22:03:46.895022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27522,"num_write":375,"num_write_kb":96416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"76'389","reported_seq":566,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.861185+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:03:46.861185+0000","last_peered":"2024-04-25T22:03:46.861185+0000","last_clean":"2024-04-25T22:03:46.861185+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:03:46.861185+0000","last_undegraded":"2024-04-25T22:03:46.861185+0000","last_fullsized":"2024-04-25T22:03:46.861185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28501,"num_write":367,"num_write_kb":63458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'459","reported_seq":592,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.921994+0000","last_change":"2024-04-25T22:03:33.874970+0000","last_active":"2024-04-25T22:03:46.921994+0000","last_peered":"2024-04-25T22:03:46.921994+0000","last_clean":"2024-04-25T22:03:46.921994+0000","last_became_active":"2024-04-25T22:03:33.870488+0000","last_became_peered":"2024-04-25T22:03:33.870488+0000","last_unstale":"2024-04-25T22:03:46.921994+0000","last_undegraded":"2024-04-25T22:03:46.921994+0000","last_fullsized":"2024-04-25T22:03:46.921994+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:37.847781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":20717,"num_write":435,"num_write_kb":55985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"76'432","reported_seq":589,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.912205+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:03:46.912205+0000","last_peered":"2024-04-25T22:03:46.912205+0000","last_clean":"2024-04-25T22:03:46.912205+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:03:46.912205+0000","last_undegraded":"2024-04-25T22:03:46.912205+0000","last_fullsized":"2024-04-25T22:03:46.912205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":10758,"num_write":401,"num_write_kb":44705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'413","reported_seq":524,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.918292+0000","last_change":"2024-04-25T22:02:43.850984+0000","last_active":"2024-04-25T22:03:46.918292+0000","last_peered":"2024-04-25T22:03:46.918292+0000","last_clean":"2024-04-25T22:03:46.918292+0000","last_became_active":"2024-04-25T22:02:43.850651+0000","last_became_peered":"2024-04-25T22:02:43.850651+0000","last_unstale":"2024-04-25T22:03:46.918292+0000","last_undegraded":"2024-04-25T22:03:46.918292+0000","last_fullsized":"2024-04-25T22:03:46.918292+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:08.019453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":29059,"num_write":391,"num_write_kb":40233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"76'386","reported_seq":503,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.920912+0000","last_change":"2024-04-25T22:03:33.860944+0000","last_active":"2024-04-25T22:03:46.920912+0000","last_peered":"2024-04-25T22:03:46.920912+0000","last_clean":"2024-04-25T22:03:46.920912+0000","last_became_active":"2024-04-25T22:03:33.859229+0000","last_became_peered":"2024-04-25T22:03:33.859229+0000","last_unstale":"2024-04-25T22:03:46.920912+0000","last_undegraded":"2024-04-25T22:03:46.920912+0000","last_fullsized":"2024-04-25T22:03:46.920912+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:12.408801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28857,"num_write":363,"num_write_kb":87969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"75'515","reported_seq":645,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.705450+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:03:46.705450+0000","last_peered":"2024-04-25T22:03:46.705450+0000","last_clean":"2024-04-25T22:03:46.705450+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:03:46.705450+0000","last_undegraded":"2024-04-25T22:03:46.705450+0000","last_fullsized":"2024-04-25T22:03:46.705450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"76'369","reported_seq":468,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.901844+0000","last_change":"2024-04-25T22:02:49.882694+0000","last_active":"2024-04-25T22:03:46.901844+0000","last_peered":"2024-04-25T22:03:46.901844+0000","last_clean":"2024-04-25T22:03:46.901844+0000","last_became_active":"2024-04-25T22:02:49.882085+0000","last_became_peered":"2024-04-25T22:02:49.882085+0000","last_unstale":"2024-04-25T22:03:46.901844+0000","last_undegraded":"2024-04-25T22:03:46.901844+0000","last_fullsized":"2024-04-25T22:03:46.901844+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:56.743509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14983,"num_write":339,"num_write_kb":46748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"76'53","reported_seq":184,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008362+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:03:46.008362+0000","last_peered":"2024-04-25T22:03:46.008362+0000","last_clean":"2024-04-25T22:03:46.008362+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:03:46.008362+0000","last_undegraded":"2024-04-25T22:03:46.008362+0000","last_fullsized":"2024-04-25T22:03:46.008362+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'426","reported_seq":604,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.921420+0000","last_change":"2024-04-25T22:03:05.707184+0000","last_active":"2024-04-25T22:03:46.921420+0000","last_peered":"2024-04-25T22:03:46.921420+0000","last_clean":"2024-04-25T22:03:46.921420+0000","last_became_active":"2024-04-25T22:03:05.704710+0000","last_became_peered":"2024-04-25T22:03:05.704710+0000","last_unstale":"2024-04-25T22:03:46.921420+0000","last_undegraded":"2024-04-25T22:03:46.921420+0000","last_fullsized":"2024-04-25T22:03:46.921420+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:53.632923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":17843,"num_write":388,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"75'71","reported_seq":134,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008746+0000","last_change":"2024-04-25T22:03:33.869003+0000","last_active":"2024-04-25T22:03:46.008746+0000","last_peered":"2024-04-25T22:03:46.008746+0000","last_clean":"2024-04-25T22:03:46.008746+0000","last_became_active":"2024-04-25T22:03:33.864095+0000","last_became_peered":"2024-04-25T22:03:33.864095+0000","last_unstale":"2024-04-25T22:03:46.008746+0000","last_undegraded":"2024-04-25T22:03:46.008746+0000","last_fullsized":"2024-04-25T22:03:46.008746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:40:47.994311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'357","reported_seq":509,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.912214+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:03:46.912214+0000","last_peered":"2024-04-25T22:03:46.912214+0000","last_clean":"2024-04-25T22:03:46.912214+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:03:46.912214+0000","last_undegraded":"2024-04-25T22:03:46.912214+0000","last_fullsized":"2024-04-25T22:03:46.912214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":16032,"num_write":334,"num_write_kb":25754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'63","reported_seq":193,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.704579+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:03:46.704579+0000","last_peered":"2024-04-25T22:03:46.704579+0000","last_clean":"2024-04-25T22:03:46.704579+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:03:46.704579+0000","last_undegraded":"2024-04-25T22:03:46.704579+0000","last_fullsized":"2024-04-25T22:03:46.704579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"76'148","reported_seq":278,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.871087+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:03:46.871087+0000","last_peered":"2024-04-25T22:03:46.871087+0000","last_clean":"2024-04-25T22:03:46.871087+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:03:46.871087+0000","last_undegraded":"2024-04-25T22:03:46.871087+0000","last_fullsized":"2024-04-25T22:03:46.871087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"76'393","reported_seq":505,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.862991+0000","last_change":"2024-04-25T22:03:33.865011+0000","last_active":"2024-04-25T22:03:46.862991+0000","last_peered":"2024-04-25T22:03:46.862991+0000","last_clean":"2024-04-25T22:03:46.862991+0000","last_became_active":"2024-04-25T22:03:33.863467+0000","last_became_peered":"2024-04-25T22:03:33.863467+0000","last_unstale":"2024-04-25T22:03:46.862991+0000","last_undegraded":"2024-04-25T22:03:46.862991+0000","last_fullsized":"2024-04-25T22:03:46.862991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:23.819171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21114,"num_write":364,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"75'250","reported_seq":320,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.009833+0000","last_change":"2024-04-25T22:03:33.869133+0000","last_active":"2024-04-25T22:03:46.009833+0000","last_peered":"2024-04-25T22:03:46.009833+0000","last_clean":"2024-04-25T22:03:46.009833+0000","last_became_active":"2024-04-25T22:03:33.864788+0000","last_became_peered":"2024-04-25T22:03:33.864788+0000","last_unstale":"2024-04-25T22:03:46.009833+0000","last_undegraded":"2024-04-25T22:03:46.009833+0000","last_fullsized":"2024-04-25T22:03:46.009833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:31.486981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"76'458","reported_seq":585,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.917616+0000","last_change":"2024-04-25T22:03:33.861055+0000","last_active":"2024-04-25T22:03:46.917616+0000","last_peered":"2024-04-25T22:03:46.917616+0000","last_clean":"2024-04-25T22:03:46.917616+0000","last_became_active":"2024-04-25T22:03:33.856638+0000","last_became_peered":"2024-04-25T22:03:33.856638+0000","last_unstale":"2024-04-25T22:03:46.917616+0000","last_undegraded":"2024-04-25T22:03:46.917616+0000","last_fullsized":"2024-04-25T22:03:46.917616+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":39774,"num_write":433,"num_write_kb":80294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'556","reported_seq":685,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.706357+0000","last_change":"2024-04-25T22:02:49.885084+0000","last_active":"2024-04-25T22:03:46.706357+0000","last_peered":"2024-04-25T22:03:46.706357+0000","last_clean":"2024-04-25T22:03:46.706357+0000","last_became_active":"2024-04-25T22:02:49.883048+0000","last_became_peered":"2024-04-25T22:02:49.883048+0000","last_unstale":"2024-04-25T22:03:46.706357+0000","last_undegraded":"2024-04-25T22:03:46.706357+0000","last_fullsized":"2024-04-25T22:03:46.706357+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:12.276434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":509,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"76'409","reported_seq":548,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.910650+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:03:46.910650+0000","last_peered":"2024-04-25T22:03:46.910650+0000","last_clean":"2024-04-25T22:03:46.910650+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:03:46.910650+0000","last_undegraded":"2024-04-25T22:03:46.910650+0000","last_fullsized":"2024-04-25T22:03:46.910650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4858,"num_write":378,"num_write_kb":46741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"76'66","reported_seq":135,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008921+0000","last_change":"2024-04-25T22:02:43.853012+0000","last_active":"2024-04-25T22:03:46.008921+0000","last_peered":"2024-04-25T22:03:46.008921+0000","last_clean":"2024-04-25T22:03:46.008921+0000","last_became_active":"2024-04-25T22:02:43.852338+0000","last_became_peered":"2024-04-25T22:02:43.852338+0000","last_unstale":"2024-04-25T22:03:46.008921+0000","last_undegraded":"2024-04-25T22:03:46.008921+0000","last_fullsized":"2024-04-25T22:03:46.008921+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:07.951790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"76'481","reported_seq":668,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008728+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:03:46.008728+0000","last_peered":"2024-04-25T22:03:46.008728+0000","last_clean":"2024-04-25T22:03:46.008728+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:03:46.008728+0000","last_undegraded":"2024-04-25T22:03:46.008728+0000","last_fullsized":"2024-04-25T22:03:46.008728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":26829,"num_write":457,"num_write_kb":137840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"75'193","reported_seq":324,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008766+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:03:46.008766+0000","last_peered":"2024-04-25T22:03:46.008766+0000","last_clean":"2024-04-25T22:03:46.008766+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:03:46.008766+0000","last_undegraded":"2024-04-25T22:03:46.008766+0000","last_fullsized":"2024-04-25T22:03:46.008766+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'431","reported_seq":519,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.907516+0000","last_change":"2024-04-25T22:02:43.853286+0000","last_active":"2024-04-25T22:03:46.907516+0000","last_peered":"2024-04-25T22:03:46.907516+0000","last_clean":"2024-04-25T22:03:46.907516+0000","last_became_active":"2024-04-25T22:02:43.852555+0000","last_became_peered":"2024-04-25T22:02:43.852555+0000","last_unstale":"2024-04-25T22:03:46.907516+0000","last_undegraded":"2024-04-25T22:03:46.907516+0000","last_fullsized":"2024-04-25T22:03:46.907516+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:42:10.005523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3720,"num_write":406,"num_write_kb":30461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"76'106","reported_seq":236,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.705398+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:03:46.705398+0000","last_peered":"2024-04-25T22:03:46.705398+0000","last_clean":"2024-04-25T22:03:46.705398+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:03:46.705398+0000","last_undegraded":"2024-04-25T22:03:46.705398+0000","last_fullsized":"2024-04-25T22:03:46.705398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"76'409","reported_seq":578,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:48.890833+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:03:48.890833+0000","last_peered":"2024-04-25T22:03:48.890833+0000","last_clean":"2024-04-25T22:03:48.890833+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:03:48.890833+0000","last_undegraded":"2024-04-25T22:03:48.890833+0000","last_fullsized":"2024-04-25T22:03:48.890833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19178,"num_write":380,"num_write_kb":91945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"75'51","reported_seq":128,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.009073+0000","last_change":"2024-04-25T22:03:33.870525+0000","last_active":"2024-04-25T22:03:46.009073+0000","last_peered":"2024-04-25T22:03:46.009073+0000","last_clean":"2024-04-25T22:03:46.009073+0000","last_became_active":"2024-04-25T22:03:33.865178+0000","last_became_peered":"2024-04-25T22:03:33.865178+0000","last_unstale":"2024-04-25T22:03:46.009073+0000","last_undegraded":"2024-04-25T22:03:46.009073+0000","last_fullsized":"2024-04-25T22:03:46.009073+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:23.174248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"76'377","reported_seq":537,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:48.890967+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:03:48.890967+0000","last_peered":"2024-04-25T22:03:48.890967+0000","last_clean":"2024-04-25T22:03:48.890967+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:03:48.890967+0000","last_undegraded":"2024-04-25T22:03:48.890967+0000","last_fullsized":"2024-04-25T22:03:48.890967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21517,"num_write":342,"num_write_kb":66898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"75'449","reported_seq":499,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008402+0000","last_change":"2024-04-25T22:03:33.860386+0000","last_active":"2024-04-25T22:03:46.008402+0000","last_peered":"2024-04-25T22:03:46.008402+0000","last_clean":"2024-04-25T22:03:46.008402+0000","last_became_active":"2024-04-25T22:03:33.859539+0000","last_became_peered":"2024-04-25T22:03:33.859539+0000","last_unstale":"2024-04-25T22:03:46.008402+0000","last_undegraded":"2024-04-25T22:03:46.008402+0000","last_fullsized":"2024-04-25T22:03:46.008402+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:20.247942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'390","reported_seq":558,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.914864+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:03:46.914864+0000","last_peered":"2024-04-25T22:03:46.914864+0000","last_clean":"2024-04-25T22:03:46.914864+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:03:46.914864+0000","last_undegraded":"2024-04-25T22:03:46.914864+0000","last_fullsized":"2024-04-25T22:03:46.914864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17888,"num_write":373,"num_write_kb":67556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":338,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.704800+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:03:46.704800+0000","last_peered":"2024-04-25T22:03:46.704800+0000","last_clean":"2024-04-25T22:03:46.704800+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:03:46.704800+0000","last_undegraded":"2024-04-25T22:03:46.704800+0000","last_fullsized":"2024-04-25T22:03:46.704800+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":136,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.705927+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:03:46.705927+0000","last_peered":"2024-04-25T22:03:46.705927+0000","last_clean":"2024-04-25T22:03:46.705927+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:03:46.705927+0000","last_undegraded":"2024-04-25T22:03:46.705927+0000","last_fullsized":"2024-04-25T22:03:46.705927+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"75'393","reported_seq":524,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008475+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:03:46.008475+0000","last_peered":"2024-04-25T22:03:46.008475+0000","last_clean":"2024-04-25T22:03:46.008475+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:03:46.008475+0000","last_undegraded":"2024-04-25T22:03:46.008475+0000","last_fullsized":"2024-04-25T22:03:46.008475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'463","reported_seq":641,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:48.890468+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:03:48.890468+0000","last_peered":"2024-04-25T22:03:48.890468+0000","last_clean":"2024-04-25T22:03:48.890468+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:03:48.890468+0000","last_undegraded":"2024-04-25T22:03:48.890468+0000","last_fullsized":"2024-04-25T22:03:48.890468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29270,"num_write":426,"num_write_kb":129367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":136,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.704528+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:03:46.704528+0000","last_peered":"2024-04-25T22:03:46.704528+0000","last_clean":"2024-04-25T22:03:46.704528+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:03:46.704528+0000","last_undegraded":"2024-04-25T22:03:46.704528+0000","last_fullsized":"2024-04-25T22:03:46.704528+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"76'125","reported_seq":319,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.853484+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:03:46.853484+0000","last_peered":"2024-04-25T22:03:46.853484+0000","last_clean":"2024-04-25T22:03:46.853484+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:03:46.853484+0000","last_undegraded":"2024-04-25T22:03:46.853484+0000","last_fullsized":"2024-04-25T22:03:46.853484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464197,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":63,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'450","reported_seq":592,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.920907+0000","last_change":"2024-04-25T22:03:05.702224+0000","last_active":"2024-04-25T22:03:46.920907+0000","last_peered":"2024-04-25T22:03:46.920907+0000","last_clean":"2024-04-25T22:03:46.920907+0000","last_became_active":"2024-04-25T22:03:05.699581+0000","last_became_peered":"2024-04-25T22:03:05.699581+0000","last_unstale":"2024-04-25T22:03:46.920907+0000","last_undegraded":"2024-04-25T22:03:46.920907+0000","last_fullsized":"2024-04-25T22:03:46.920907+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":34759,"num_write":424,"num_write_kb":71902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":137,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008179+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:03:46.008179+0000","last_peered":"2024-04-25T22:03:46.008179+0000","last_clean":"2024-04-25T22:03:46.008179+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:03:46.008179+0000","last_undegraded":"2024-04-25T22:03:46.008179+0000","last_fullsized":"2024-04-25T22:03:46.008179+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"75'311","reported_seq":442,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008551+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:03:46.008551+0000","last_peered":"2024-04-25T22:03:46.008551+0000","last_clean":"2024-04-25T22:03:46.008551+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:03:46.008551+0000","last_undegraded":"2024-04-25T22:03:46.008551+0000","last_fullsized":"2024-04-25T22:03:46.008551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"76'368","reported_seq":541,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.866991+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:03:46.866991+0000","last_peered":"2024-04-25T22:03:46.866991+0000","last_clean":"2024-04-25T22:03:46.866991+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:03:46.866991+0000","last_undegraded":"2024-04-25T22:03:46.866991+0000","last_fullsized":"2024-04-25T22:03:46.866991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28273,"num_write":350,"num_write_kb":87787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":136,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.705304+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:03:46.705304+0000","last_peered":"2024-04-25T22:03:46.705304+0000","last_clean":"2024-04-25T22:03:46.705304+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:03:46.705304+0000","last_undegraded":"2024-04-25T22:03:46.705304+0000","last_fullsized":"2024-04-25T22:03:46.705304+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"76'75","reported_seq":144,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.893286+0000","last_change":"2024-04-25T22:02:43.851416+0000","last_active":"2024-04-25T22:03:46.893286+0000","last_peered":"2024-04-25T22:03:46.893286+0000","last_clean":"2024-04-25T22:03:46.893286+0000","last_became_active":"2024-04-25T22:02:43.850822+0000","last_became_peered":"2024-04-25T22:02:43.850822+0000","last_unstale":"2024-04-25T22:03:46.893286+0000","last_undegraded":"2024-04-25T22:03:46.893286+0000","last_fullsized":"2024-04-25T22:03:46.893286+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:56:58.100216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"76'452","reported_seq":698,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.898879+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:03:46.898879+0000","last_peered":"2024-04-25T22:03:46.898879+0000","last_clean":"2024-04-25T22:03:46.898879+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:03:46.898879+0000","last_undegraded":"2024-04-25T22:03:46.898879+0000","last_fullsized":"2024-04-25T22:03:46.898879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":67984,"num_write":425,"num_write_kb":154741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"76'268","reported_seq":398,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.900360+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:03:46.900360+0000","last_peered":"2024-04-25T22:03:46.900360+0000","last_clean":"2024-04-25T22:03:46.900360+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:03:46.900360+0000","last_undegraded":"2024-04-25T22:03:46.900360+0000","last_fullsized":"2024-04-25T22:03:46.900360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":137,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.009248+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:03:46.009248+0000","last_peered":"2024-04-25T22:03:46.009248+0000","last_clean":"2024-04-25T22:03:46.009248+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:03:46.009248+0000","last_undegraded":"2024-04-25T22:03:46.009248+0000","last_fullsized":"2024-04-25T22:03:46.009248+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'390","reported_seq":516,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.906720+0000","last_change":"2024-04-25T22:03:33.867587+0000","last_active":"2024-04-25T22:03:46.906720+0000","last_peered":"2024-04-25T22:03:46.906720+0000","last_clean":"2024-04-25T22:03:46.906720+0000","last_became_active":"2024-04-25T22:03:33.865330+0000","last_became_peered":"2024-04-25T22:03:33.865330+0000","last_unstale":"2024-04-25T22:03:46.906720+0000","last_undegraded":"2024-04-25T22:03:46.906720+0000","last_fullsized":"2024-04-25T22:03:46.906720+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:10:37.149246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":26599,"num_write":366,"num_write_kb":75612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"76'47","reported_seq":178,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.900004+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:03:46.900004+0000","last_peered":"2024-04-25T22:03:46.900004+0000","last_clean":"2024-04-25T22:03:46.900004+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:03:46.900004+0000","last_undegraded":"2024-04-25T22:03:46.900004+0000","last_fullsized":"2024-04-25T22:03:46.900004+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.010143+0000","last_change":"2024-04-25T22:03:05.701809+0000","last_active":"2024-04-25T22:03:46.010143+0000","last_peered":"2024-04-25T22:03:46.010143+0000","last_clean":"2024-04-25T22:03:46.010143+0000","last_became_active":"2024-04-25T22:03:05.701322+0000","last_became_peered":"2024-04-25T22:03:05.701322+0000","last_unstale":"2024-04-25T22:03:46.010143+0000","last_undegraded":"2024-04-25T22:03:46.010143+0000","last_fullsized":"2024-04-25T22:03:46.010143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:45.907458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"76'399","reported_seq":581,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.914625+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:03:46.914625+0000","last_peered":"2024-04-25T22:03:46.914625+0000","last_clean":"2024-04-25T22:03:46.914625+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:03:46.914625+0000","last_undegraded":"2024-04-25T22:03:46.914625+0000","last_fullsized":"2024-04-25T22:03:46.914625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25634,"num_write":377,"num_write_kb":103970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"76'64","reported_seq":195,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.865179+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:03:46.865179+0000","last_peered":"2024-04-25T22:03:46.865179+0000","last_clean":"2024-04-25T22:03:46.865179+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:03:46.865179+0000","last_undegraded":"2024-04-25T22:03:46.865179+0000","last_fullsized":"2024-04-25T22:03:46.865179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":137,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.009380+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:03:46.009380+0000","last_peered":"2024-04-25T22:03:46.009380+0000","last_clean":"2024-04-25T22:03:46.009380+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:03:46.009380+0000","last_undegraded":"2024-04-25T22:03:46.009380+0000","last_fullsized":"2024-04-25T22:03:46.009380+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'394","reported_seq":544,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008228+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:03:46.008228+0000","last_peered":"2024-04-25T22:03:46.008228+0000","last_clean":"2024-04-25T22:03:46.008228+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:03:46.008228+0000","last_undegraded":"2024-04-25T22:03:46.008228+0000","last_fullsized":"2024-04-25T22:03:46.008228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9572,"num_write":361,"num_write_kb":29911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"76'126","reported_seq":257,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.868239+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:03:46.868239+0000","last_peered":"2024-04-25T22:03:46.868239+0000","last_clean":"2024-04-25T22:03:46.868239+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:03:46.868239+0000","last_undegraded":"2024-04-25T22:03:46.868239+0000","last_fullsized":"2024-04-25T22:03:46.868239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":1301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":136,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.706430+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:03:46.706430+0000","last_peered":"2024-04-25T22:03:46.706430+0000","last_clean":"2024-04-25T22:03:46.706430+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:03:46.706430+0000","last_undegraded":"2024-04-25T22:03:46.706430+0000","last_fullsized":"2024-04-25T22:03:46.706430+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"76'410","reported_seq":537,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.914155+0000","last_change":"2024-04-25T22:03:33.861820+0000","last_active":"2024-04-25T22:03:46.914155+0000","last_peered":"2024-04-25T22:03:46.914155+0000","last_clean":"2024-04-25T22:03:46.914155+0000","last_became_active":"2024-04-25T22:03:33.859807+0000","last_became_peered":"2024-04-25T22:03:33.859807+0000","last_unstale":"2024-04-25T22:03:46.914155+0000","last_undegraded":"2024-04-25T22:03:46.914155+0000","last_fullsized":"2024-04-25T22:03:46.914155+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:38.761184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27345,"num_write":384,"num_write_kb":92854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"76'406","reported_seq":592,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:48.892642+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:03:48.892642+0000","last_peered":"2024-04-25T22:03:48.892642+0000","last_clean":"2024-04-25T22:03:48.892642+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:03:48.892642+0000","last_undegraded":"2024-04-25T22:03:48.892642+0000","last_fullsized":"2024-04-25T22:03:48.892642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33923,"num_write":372,"num_write_kb":82083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"76'258","reported_seq":388,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.906439+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:03:46.906439+0000","last_peered":"2024-04-25T22:03:46.906439+0000","last_clean":"2024-04-25T22:03:46.906439+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:03:46.906439+0000","last_undegraded":"2024-04-25T22:03:46.906439+0000","last_fullsized":"2024-04-25T22:03:46.906439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8469405,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":8372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"76'399","reported_seq":555,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.896080+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:03:46.896080+0000","last_peered":"2024-04-25T22:03:46.896080+0000","last_clean":"2024-04-25T22:03:46.896080+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:03:46.896080+0000","last_undegraded":"2024-04-25T22:03:46.896080+0000","last_fullsized":"2024-04-25T22:03:46.896080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14178,"num_write":370,"num_write_kb":58735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'104","reported_seq":235,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.919278+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:03:46.919278+0000","last_peered":"2024-04-25T22:03:46.919278+0000","last_clean":"2024-04-25T22:03:46.919278+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:03:46.919278+0000","last_undegraded":"2024-04-25T22:03:46.919278+0000","last_fullsized":"2024-04-25T22:03:46.919278+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"75'232","reported_seq":301,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008795+0000","last_change":"2024-04-25T22:02:43.852674+0000","last_active":"2024-04-25T22:03:46.008795+0000","last_peered":"2024-04-25T22:03:46.008795+0000","last_clean":"2024-04-25T22:03:46.008795+0000","last_became_active":"2024-04-25T22:02:43.852292+0000","last_became_peered":"2024-04-25T22:02:43.852292+0000","last_unstale":"2024-04-25T22:03:46.008795+0000","last_undegraded":"2024-04-25T22:03:46.008795+0000","last_fullsized":"2024-04-25T22:03:46.008795+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:57.388397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"76'477","reported_seq":654,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.907376+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:03:46.907376+0000","last_peered":"2024-04-25T22:03:46.907376+0000","last_clean":"2024-04-25T22:03:46.907376+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:03:46.907376+0000","last_undegraded":"2024-04-25T22:03:46.907376+0000","last_fullsized":"2024-04-25T22:03:46.907376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24709,"num_write":463,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"75'60","reported_seq":191,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.009001+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:03:46.009001+0000","last_peered":"2024-04-25T22:03:46.009001+0000","last_clean":"2024-04-25T22:03:46.009001+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:03:46.009001+0000","last_undegraded":"2024-04-25T22:03:46.009001+0000","last_fullsized":"2024-04-25T22:03:46.009001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'438","reported_seq":596,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.896090+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:03:46.896090+0000","last_peered":"2024-04-25T22:03:46.896090+0000","last_clean":"2024-04-25T22:03:46.896090+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:03:46.896090+0000","last_undegraded":"2024-04-25T22:03:46.896090+0000","last_fullsized":"2024-04-25T22:03:46.896090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14429,"num_write":416,"num_write_kb":59186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'349","reported_seq":439,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.874982+0000","last_change":"2024-04-25T22:03:33.870025+0000","last_active":"2024-04-25T22:03:46.874982+0000","last_peered":"2024-04-25T22:03:46.874982+0000","last_clean":"2024-04-25T22:03:46.874982+0000","last_became_active":"2024-04-25T22:03:33.866366+0000","last_became_peered":"2024-04-25T22:03:33.866366+0000","last_unstale":"2024-04-25T22:03:46.874982+0000","last_undegraded":"2024-04-25T22:03:46.874982+0000","last_fullsized":"2024-04-25T22:03:46.874982+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:02:00.490754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18236,"num_write":332,"num_write_kb":42553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"76'742","reported_seq":873,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.885316+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:03:46.885316+0000","last_peered":"2024-04-25T22:03:46.885316+0000","last_clean":"2024-04-25T22:03:46.885316+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:03:46.885316+0000","last_undegraded":"2024-04-25T22:03:46.885316+0000","last_fullsized":"2024-04-25T22:03:46.885316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'373","reported_seq":521,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.911398+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:03:46.911398+0000","last_peered":"2024-04-25T22:03:46.911398+0000","last_clean":"2024-04-25T22:03:46.911398+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:03:46.911398+0000","last_undegraded":"2024-04-25T22:03:46.911398+0000","last_fullsized":"2024-04-25T22:03:46.911398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6876,"num_write":354,"num_write_kb":46840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"76'204","reported_seq":335,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.007998+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:03:46.007998+0000","last_peered":"2024-04-25T22:03:46.007998+0000","last_clean":"2024-04-25T22:03:46.007998+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:03:46.007998+0000","last_undegraded":"2024-04-25T22:03:46.007998+0000","last_fullsized":"2024-04-25T22:03:46.007998+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'362","reported_seq":446,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.920127+0000","last_change":"2024-04-25T22:03:33.866383+0000","last_active":"2024-04-25T22:03:46.920127+0000","last_peered":"2024-04-25T22:03:46.920127+0000","last_clean":"2024-04-25T22:03:46.920127+0000","last_became_active":"2024-04-25T22:03:33.864179+0000","last_became_peered":"2024-04-25T22:03:33.864179+0000","last_unstale":"2024-04-25T22:03:46.920127+0000","last_undegraded":"2024-04-25T22:03:46.920127+0000","last_fullsized":"2024-04-25T22:03:46.920127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:53.632923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6059,"num_write":332,"num_write_kb":37972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"76'217","reported_seq":284,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.894258+0000","last_change":"2024-04-25T22:03:05.702244+0000","last_active":"2024-04-25T22:03:46.894258+0000","last_peered":"2024-04-25T22:03:46.894258+0000","last_clean":"2024-04-25T22:03:46.894258+0000","last_became_active":"2024-04-25T22:03:05.701350+0000","last_became_peered":"2024-04-25T22:03:05.701350+0000","last_unstale":"2024-04-25T22:03:46.894258+0000","last_undegraded":"2024-04-25T22:03:46.894258+0000","last_fullsized":"2024-04-25T22:03:46.894258+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:31:38.259386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"76'380","reported_seq":486,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.913615+0000","last_change":"2024-04-25T22:03:33.862286+0000","last_active":"2024-04-25T22:03:46.913615+0000","last_peered":"2024-04-25T22:03:46.913615+0000","last_clean":"2024-04-25T22:03:46.913615+0000","last_became_active":"2024-04-25T22:03:33.860800+0000","last_became_peered":"2024-04-25T22:03:33.860800+0000","last_unstale":"2024-04-25T22:03:46.913615+0000","last_undegraded":"2024-04-25T22:03:46.913615+0000","last_fullsized":"2024-04-25T22:03:46.913615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:04.528174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19110,"num_write":355,"num_write_kb":63152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'51","reported_seq":72,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.009334+0000","last_change":"2024-04-25T22:03:33.869667+0000","last_active":"2024-04-25T22:03:46.009334+0000","last_peered":"2024-04-25T22:03:46.009334+0000","last_clean":"2024-04-25T22:03:46.009334+0000","last_became_active":"2024-04-25T22:03:33.867980+0000","last_became_peered":"2024-04-25T22:03:33.867980+0000","last_unstale":"2024-04-25T22:03:46.009334+0000","last_undegraded":"2024-04-25T22:03:46.009334+0000","last_fullsized":"2024-04-25T22:03:46.009334+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:47.891133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"76'378","reported_seq":476,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.917927+0000","last_change":"2024-04-25T22:02:43.850869+0000","last_active":"2024-04-25T22:03:46.917927+0000","last_peered":"2024-04-25T22:03:46.917927+0000","last_clean":"2024-04-25T22:03:46.917927+0000","last_became_active":"2024-04-25T22:02:43.850568+0000","last_became_peered":"2024-04-25T22:02:43.850568+0000","last_unstale":"2024-04-25T22:03:46.917927+0000","last_undegraded":"2024-04-25T22:03:46.917927+0000","last_fullsized":"2024-04-25T22:03:46.917927+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:10:32.881419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14050,"num_write":362,"num_write_kb":58957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"76'188","reported_seq":266,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.009054+0000","last_change":"2024-04-25T22:02:43.853253+0000","last_active":"2024-04-25T22:03:46.009054+0000","last_peered":"2024-04-25T22:03:46.009054+0000","last_clean":"2024-04-25T22:03:46.009054+0000","last_became_active":"2024-04-25T22:02:43.852769+0000","last_became_peered":"2024-04-25T22:02:43.852769+0000","last_unstale":"2024-04-25T22:03:46.009054+0000","last_undegraded":"2024-04-25T22:03:46.009054+0000","last_fullsized":"2024-04-25T22:03:46.009054+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:51:36.457092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"76'390","reported_seq":486,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.908175+0000","last_change":"2024-04-25T22:02:43.852778+0000","last_active":"2024-04-25T22:03:46.908175+0000","last_peered":"2024-04-25T22:03:46.908175+0000","last_clean":"2024-04-25T22:03:46.908175+0000","last_became_active":"2024-04-25T22:02:43.852263+0000","last_became_peered":"2024-04-25T22:02:43.852263+0000","last_unstale":"2024-04-25T22:03:46.908175+0000","last_undegraded":"2024-04-25T22:03:46.908175+0000","last_fullsized":"2024-04-25T22:03:46.908175+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:10:40.487543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13280,"num_write":364,"num_write_kb":46108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"75'284","reported_seq":360,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.009987+0000","last_change":"2024-04-25T22:03:33.870087+0000","last_active":"2024-04-25T22:03:46.009987+0000","last_peered":"2024-04-25T22:03:46.009987+0000","last_clean":"2024-04-25T22:03:46.009987+0000","last_became_active":"2024-04-25T22:03:33.865557+0000","last_became_peered":"2024-04-25T22:03:33.865557+0000","last_unstale":"2024-04-25T22:03:46.009987+0000","last_undegraded":"2024-04-25T22:03:46.009987+0000","last_fullsized":"2024-04-25T22:03:46.009987+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:25:54.518550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":12398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"76'402","reported_seq":481,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.913528+0000","last_change":"2024-04-25T22:03:33.864136+0000","last_active":"2024-04-25T22:03:46.913528+0000","last_peered":"2024-04-25T22:03:46.913528+0000","last_clean":"2024-04-25T22:03:46.913528+0000","last_became_active":"2024-04-25T22:03:33.862435+0000","last_became_peered":"2024-04-25T22:03:33.862435+0000","last_unstale":"2024-04-25T22:03:46.913528+0000","last_undegraded":"2024-04-25T22:03:46.913528+0000","last_fullsized":"2024-04-25T22:03:46.913528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:08.119964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":1478,"num_write":377,"num_write_kb":34422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"76'127","reported_seq":258,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.861249+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:03:46.861249+0000","last_peered":"2024-04-25T22:03:46.861249+0000","last_clean":"2024-04-25T22:03:46.861249+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:03:46.861249+0000","last_undegraded":"2024-04-25T22:03:46.861249+0000","last_fullsized":"2024-04-25T22:03:46.861249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'438","reported_seq":616,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.889860+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:03:46.889860+0000","last_peered":"2024-04-25T22:03:46.889860+0000","last_clean":"2024-04-25T22:03:46.889860+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:03:46.889860+0000","last_undegraded":"2024-04-25T22:03:46.889860+0000","last_fullsized":"2024-04-25T22:03:46.889860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31576,"num_write":414,"num_write_kb":70915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"75'46","reported_seq":177,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008893+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:03:46.008893+0000","last_peered":"2024-04-25T22:03:46.008893+0000","last_clean":"2024-04-25T22:03:46.008893+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:03:46.008893+0000","last_undegraded":"2024-04-25T22:03:46.008893+0000","last_fullsized":"2024-04-25T22:03:46.008893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2665,"num_read_kb":1338898,"num_write":24540,"num_write_kb":4276910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26145,"ondisk_log_size":26145,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127374912,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":4658,"num_write_kb":127827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":71483392,"data_stored":254669699,"data_compressed":21831095,"data_compressed_allocated":35295232,"data_compressed_original":218542080,"omap_allocated":0,"internal_metadata":0},"log_size":6443,"ondisk_log_size":6443,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738407,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99468,"kb_used_data":23936,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272372,"statfs":{"total":96636764160,"available":96534908928,"internally_reserved":0,"allocated":24510464,"data_stored":84777266,"data_compressed":7031744,"data_compressed_allocated":11419648,"data_compressed_original":72040448,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738406,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99180,"kb_used_data":23648,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272660,"statfs":{"total":96636764160,"available":96535203840,"internally_reserved":0,"allocated":24215552,"data_stored":81456553,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738407,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99700,"kb_used_data":24168,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272140,"statfs":{"total":96636764160,"available":96534671360,"internally_reserved":0,"allocated":24748032,"data_stored":90436383,"data_compressed":7814117,"data_compressed_allocated":12587008,"data_compressed_original":78639104,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24076288,"data_stored":89626176,"data_compressed":7811005,"data_compressed_allocated":12562432,"data_compressed_original":78143488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23584768,"data_stored":81156589,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23822336,"data_stored":83886934,"data_compressed":7023537,"data_compressed_allocated":11382784,"data_compressed_original":71467008,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:03:51.454 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:03:51.464 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:03:51.491 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:51.488+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:51.494 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.404891603999999, 2024-04-25T22:03:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.394890840999999, 2024-04-25T22:03:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.390726567000002, 2024-04-25T22:03:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.506 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:51.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.507 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:51.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:51.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:51.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:51.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:51.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:51.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:51.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:51.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:51.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:51.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:51.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:51.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:51.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:51.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:51.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:51.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:51.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:51.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.511 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.511 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:51.511 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:51.511 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.389130250000001, 2024-04-25T22:03:51.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:51.512 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.512 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.512 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.512 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:51.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.512 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:51.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:51.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:51.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:51.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:51.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:51.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:51.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:51.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:51.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:51.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:51.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:51.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:51.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:51.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:51.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:51.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:51.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:51.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:51.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:51.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:51.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:51.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:51.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:51.517 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.517 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.517 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.517 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:51.517 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:51.517 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.332343999999999, 2024-04-25T22:03:51.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:51.518 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.518 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.518 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.518 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.518 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.518 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.518 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:51.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.518 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:51.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:51.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:51.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:51.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:51.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:51.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:51.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:51.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:51.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:51.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:51.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:51.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:51.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:51.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:51.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:51.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:51.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:51.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:51.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:51.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:51.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:51.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:51.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:51.523 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.523 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.523 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.523 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:51.523 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:51.523 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.316699733999997, 2024-04-25T22:03:51.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:51.523 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.523 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.523 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.523 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.524 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.524 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.524 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:51.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.524 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:51.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:51.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:51.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:51.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:51.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:51.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:51.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:51.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:51.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:51.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:51.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:51.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:51.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:51.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:51.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:51.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:51.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:51.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:51.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:51.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:51.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:51.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:51.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:51.528 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.528 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.528 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.528 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:51.528 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:51.528 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.311861043, 2024-04-25T22:03:51.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:51.529 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.529 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.529 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.529 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.529 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.529 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.529 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:51.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.529 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:51.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:51.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:51.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:51.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:51.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:51.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:51.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:51.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:51.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:51.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:51.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:51.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:51.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:51.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:51.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:51.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:51.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:51.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:51.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:51.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:51.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:51.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:51.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:51.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.533 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.534 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10648 4.33 4:cc614d18:::100000030cb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:51.534 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:51.534 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.953257731999997, 2024-04-25T22:03:51.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13001143300000001, 2024-04-25T22:03:51.534 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.534 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.534 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.534 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.534 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.534 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.534 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10648 2024-04-25T22:03:51.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.535 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:51.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:51.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537181+0000", 2024-04-25T22:03:51.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.782e-06 2024-04-25T22:03:51.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541681+0000", 2024-04-25T22:03:51.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045008460000000002 2024-04-25T22:03:51.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541692+0000", 2024-04-25T22:03:51.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0726e-05 2024-04-25T22:03:51.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541698+0000", 2024-04-25T22:03:51.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-04-25T22:03:51.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541771+0000", 2024-04-25T22:03:51.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3070000000000003e-05 2024-04-25T22:03:51.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542021+0000", 2024-04-25T22:03:51.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025059799999999999 2024-04-25T22:03:51.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542246+0000", 2024-04-25T22:03:51.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022471000000000001 2024-04-25T22:03:51.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.579359+0000", 2024-04-25T22:03:51.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037113211 2024-04-25T22:03:51.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667067+0000", 2024-04-25T22:03:51.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087707255999999997 2024-04-25T22:03:51.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667134+0000", 2024-04-25T22:03:51.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7862999999999997e-05 2024-04-25T22:03:51.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667190+0000", 2024-04-25T22:03:51.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5698000000000001e-05 2024-04-25T22:03:51.539 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.539 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.539 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.539 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10651 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:51.539 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:51.540 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.893481954000002, 2024-04-25T22:03:51.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11324606800000001, 2024-04-25T22:03:51.540 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.540 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.540 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.540 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.540 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.540 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.540 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10651 2024-04-25T22:03:51.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.540 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:51.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596957+0000", 2024-04-25T22:03:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-04-25T22:03:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601272+0000", 2024-04-25T22:03:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004314834 2024-04-25T22:03:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601291+0000", 2024-04-25T22:03:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9380000000000001e-05 2024-04-25T22:03:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601302+0000", 2024-04-25T22:03:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0416e-05 2024-04-25T22:03:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.603978+0000", 2024-04-25T22:03:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026763109999999998 2024-04-25T22:03:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604327+0000", 2024-04-25T22:03:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034881099999999998 2024-04-25T22:03:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604571+0000", 2024-04-25T22:03:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024436100000000001 2024-04-25T22:03:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644439+0000", 2024-04-25T22:03:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039868270999999997 2024-04-25T22:03:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710091+0000", 2024-04-25T22:03:51.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.065651910999999993 2024-04-25T22:03:51.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710144+0000", 2024-04-25T22:03:51.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2444999999999997e-05 2024-04-25T22:03:51.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710201+0000", 2024-04-25T22:03:51.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6839999999999998e-05 2024-04-25T22:03:51.544 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.544 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.544 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.545 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10654 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:51.545 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:51.545 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.883655091000001, 2024-04-25T22:03:51.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.103958778, 2024-04-25T22:03:51.545 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.545 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.545 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.545 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.545 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.545 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.545 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10654 2024-04-25T22:03:51.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.545 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606782+0000", 2024-04-25T22:03:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1699999999999999e-07 2024-04-25T22:03:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611155+0000", 2024-04-25T22:03:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043728580000000003 2024-04-25T22:03:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611173+0000", 2024-04-25T22:03:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8267e-05 2024-04-25T22:03:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611183+0000", 2024-04-25T22:03:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9250000000000007e-06 2024-04-25T22:03:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644642+0000", 2024-04-25T22:03:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033458976000000001 2024-04-25T22:03:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644739+0000", 2024-04-25T22:03:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7189999999999996e-05 2024-04-25T22:03:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644864+0000", 2024-04-25T22:03:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000124867 2024-04-25T22:03:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.672556+0000", 2024-04-25T22:03:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027691653 2024-04-25T22:03:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710668+0000", 2024-04-25T22:03:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038111956000000002 2024-04-25T22:03:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710703+0000", 2024-04-25T22:03:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5577000000000002e-05 2024-04-25T22:03:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710740+0000", 2024-04-25T22:03:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7092000000000003e-05 2024-04-25T22:03:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11078 4.4 4:22be2a9e:::10000003224.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.486528470000003, 2024-04-25T22:03:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.112294177, 2024-04-25T22:03:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11078 2024-04-25T22:03:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003909+0000", 2024-04-25T22:03:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2750000000000001e-06 2024-04-25T22:03:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009939+0000", 2024-04-25T22:03:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060293309999999998 2024-04-25T22:03:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009961+0000", 2024-04-25T22:03:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1889999999999999e-05 2024-04-25T22:03:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009976+0000", 2024-04-25T22:03:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5642e-05 2024-04-25T22:03:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042803+0000", 2024-04-25T22:03:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032827299999999997 2024-04-25T22:03:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042911+0000", 2024-04-25T22:03:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107747 2024-04-25T22:03:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042990+0000", 2024-04-25T22:03:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8832999999999996e-05 2024-04-25T22:03:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.088710+0000", 2024-04-25T22:03:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045720129999999998 2024-04-25T22:03:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116108+0000", 2024-04-25T22:03:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027397388000000002 2024-04-25T22:03:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116164+0000", 2024-04-25T22:03:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6283000000000003e-05 2024-04-25T22:03:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116202+0000", 2024-04-25T22:03:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8358000000000001e-05 2024-04-25T22:03:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11195 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.273166353000001, 2024-04-25T22:03:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1095062, 2024-04-25T22:03:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11195 2024-04-25T22:03:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217272+0000", 2024-04-25T22:03:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.533e-06 2024-04-25T22:03:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217385+0000", 2024-04-25T22:03:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113533 2024-04-25T22:03:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217396+0000", 2024-04-25T22:03:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0682e-05 2024-04-25T22:03:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217402+0000", 2024-04-25T22:03:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:03:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238476+0000", 2024-04-25T22:03:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021073312 2024-04-25T22:03:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238558+0000", 2024-04-25T22:03:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2193000000000004e-05 2024-04-25T22:03:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238695+0000", 2024-04-25T22:03:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013737800000000001 2024-04-25T22:03:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292860+0000", 2024-04-25T22:03:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054165224999999997 2024-04-25T22:03:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326638+0000", 2024-04-25T22:03:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033777517999999999 2024-04-25T22:03:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326686+0000", 2024-04-25T22:03:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8062000000000002e-05 2024-04-25T22:03:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326776+0000", 2024-04-25T22:03:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0393e-05 2024-04-25T22:03:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11197 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3195543~33670] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.273024368999998, 2024-04-25T22:03:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953929499999999, 2024-04-25T22:03:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11197 2024-04-25T22:03:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217413+0000", 2024-04-25T22:03:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5600000000000005e-07 2024-04-25T22:03:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217445+0000", 2024-04-25T22:03:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2240999999999998e-05 2024-04-25T22:03:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217453+0000", 2024-04-25T22:03:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6070000000000002e-06 2024-04-25T22:03:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217458+0000", 2024-04-25T22:03:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3630000000000002e-06 2024-04-25T22:03:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240891+0000", 2024-04-25T22:03:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023432637999999999 2024-04-25T22:03:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240990+0000", 2024-04-25T22:03:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8995999999999999e-05 2024-04-25T22:03:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241123+0000", 2024-04-25T22:03:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013371699999999999 2024-04-25T22:03:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292866+0000", 2024-04-25T22:03:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051742332000000002 2024-04-25T22:03:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326849+0000", 2024-04-25T22:03:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033983140000000002 2024-04-25T22:03:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326908+0000", 2024-04-25T22:03:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8842999999999999e-05 2024-04-25T22:03:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326951+0000", 2024-04-25T22:03:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3761999999999999e-05 2024-04-25T22:03:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11198 4.4 4:22c4fea3:::10000003262.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.272970010000002, 2024-04-25T22:03:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12381273600000001, 2024-04-25T22:03:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11198 2024-04-25T22:03:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217467+0000", 2024-04-25T22:03:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4499999999999997e-07 2024-04-25T22:03:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225449+0000", 2024-04-25T22:03:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079819439999999995 2024-04-25T22:03:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225466+0000", 2024-04-25T22:03:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6602000000000001e-05 2024-04-25T22:03:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225477+0000", 2024-04-25T22:03:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1603000000000001e-05 2024-04-25T22:03:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240866+0000", 2024-04-25T22:03:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015388389000000001 2024-04-25T22:03:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241081+0000", 2024-04-25T22:03:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021577400000000001 2024-04-25T22:03:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241212+0000", 2024-04-25T22:03:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013073499999999999 2024-04-25T22:03:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292876+0000", 2024-04-25T22:03:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051663584999999998 2024-04-25T22:03:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341159+0000", 2024-04-25T22:03:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048283421999999999 2024-04-25T22:03:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341222+0000", 2024-04-25T22:03:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:03:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341279+0000", 2024-04-25T22:03:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6780999999999997e-05 2024-04-25T22:03:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11207 4.4 4:233f6309:::10000003211.00000000:head [write 659836~128648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.256352012999997, 2024-04-25T22:03:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10732727, 2024-04-25T22:03:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11207 2024-04-25T22:03:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234085+0000", 2024-04-25T22:03:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0399999999999995e-07 2024-04-25T22:03:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234550+0000", 2024-04-25T22:03:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000464909 2024-04-25T22:03:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234561+0000", 2024-04-25T22:03:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0744000000000001e-05 2024-04-25T22:03:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234569+0000", 2024-04-25T22:03:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6890000000000004e-06 2024-04-25T22:03:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267197+0000", 2024-04-25T22:03:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032628182999999998 2024-04-25T22:03:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267297+0000", 2024-04-25T22:03:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100222 2024-04-25T22:03:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267393+0000", 2024-04-25T22:03:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6275999999999998e-05 2024-04-25T22:03:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292880+0000", 2024-04-25T22:03:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025487058999999999 2024-04-25T22:03:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341326+0000", 2024-04-25T22:03:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048446031000000001 2024-04-25T22:03:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341374+0000", 2024-04-25T22:03:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7632000000000001e-05 2024-04-25T22:03:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341412+0000", 2024-04-25T22:03:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7821000000000003e-05 2024-04-25T22:03:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11219 4.4 4:210cd53e:::100000031ff.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.237402803000002, 2024-04-25T22:03:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13181403, 2024-04-25T22:03:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11219 2024-04-25T22:03:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253035+0000", 2024-04-25T22:03:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.322e-06 2024-04-25T22:03:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258145+0000", 2024-04-25T22:03:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051095669999999998 2024-04-25T22:03:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258163+0000", 2024-04-25T22:03:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8377999999999999e-05 2024-04-25T22:03:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258174+0000", 2024-04-25T22:03:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0925e-05 2024-04-25T22:03:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270495+0000", 2024-04-25T22:03:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012321354 2024-04-25T22:03:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270581+0000", 2024-04-25T22:03:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5741999999999993e-05 2024-04-25T22:03:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270717+0000", 2024-04-25T22:03:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013571500000000001 2024-04-25T22:03:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326599+0000", 2024-04-25T22:03:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055882026000000001 2024-04-25T22:03:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384753+0000", 2024-04-25T22:03:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058154527999999997 2024-04-25T22:03:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384805+0000", 2024-04-25T22:03:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1592999999999999e-05 2024-04-25T22:03:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384848+0000", 2024-04-25T22:03:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2880000000000003e-05 2024-04-25T22:03:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11868 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.278438979000001, 2024-04-25T22:03:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12149908700000001, 2024-04-25T22:03:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11868 2024-04-25T22:03:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211999+0000", 2024-04-25T22:03:51.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:03:51.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219614+0000", 2024-04-25T22:03:51.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076153490000000004 2024-04-25T22:03:51.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219628+0000", 2024-04-25T22:03:51.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3597e-05 2024-04-25T22:03:51.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219635+0000", 2024-04-25T22:03:51.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7759999999999997e-06 2024-04-25T22:03:51.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229908+0000", 2024-04-25T22:03:51.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010272478 2024-04-25T22:03:51.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229966+0000", 2024-04-25T22:03:51.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8495000000000002e-05 2024-04-25T22:03:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.230082+0000", 2024-04-25T22:03:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011560799999999999 2024-04-25T22:03:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257530+0000", 2024-04-25T22:03:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027448034999999999 2024-04-25T22:03:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333408+0000", 2024-04-25T22:03:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075878105000000001 2024-04-25T22:03:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333457+0000", 2024-04-25T22:03:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8757000000000001e-05 2024-04-25T22:03:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333497+0000", 2024-04-25T22:03:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9721000000000001e-05 2024-04-25T22:03:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11870 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 4063232~131072] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.270784624999997, 2024-04-25T22:03:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.114017408, 2024-04-25T22:03:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11870 2024-04-25T22:03:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219653+0000", 2024-04-25T22:03:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6139999999999999e-06 2024-04-25T22:03:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219722+0000", 2024-04-25T22:03:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8460000000000005e-05 2024-04-25T22:03:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219730+0000", 2024-04-25T22:03:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3420000000000008e-06 2024-04-25T22:03:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219736+0000", 2024-04-25T22:03:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9619999999999998e-06 2024-04-25T22:03:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247743+0000", 2024-04-25T22:03:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028006400000000001 2024-04-25T22:03:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247847+0000", 2024-04-25T22:03:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104017 2024-04-25T22:03:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247984+0000", 2024-04-25T22:03:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013701800000000001 2024-04-25T22:03:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257536+0000", 2024-04-25T22:03:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095520050000000006 2024-04-25T22:03:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333565+0000", 2024-04-25T22:03:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076029154000000002 2024-04-25T22:03:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333628+0000", 2024-04-25T22:03:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2853000000000003e-05 2024-04-25T22:03:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333669+0000", 2024-04-25T22:03:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1582999999999998e-05 2024-04-25T22:03:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11871 4.37 4:ee924968:::10000003393.00000000:head [write 2359296~1835008] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.270691693000003, 2024-04-25T22:03:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.113885236, 2024-04-25T22:03:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11871 2024-04-25T22:03:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6100000000000001e-07 2024-04-25T22:03:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222469+0000", 2024-04-25T22:03:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027240060000000002 2024-04-25T22:03:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222482+0000", 2024-04-25T22:03:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3049e-05 2024-04-25T22:03:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222492+0000", 2024-04-25T22:03:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8020000000000003e-06 2024-04-25T22:03:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247903+0000", 2024-04-25T22:03:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025410578999999999 2024-04-25T22:03:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247962+0000", 2024-04-25T22:03:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9363000000000001e-05 2024-04-25T22:03:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.248049+0000", 2024-04-25T22:03:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6803000000000002e-05 2024-04-25T22:03:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257915+0000", 2024-04-25T22:03:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0098655730000000007 2024-04-25T22:03:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333544+0000", 2024-04-25T22:03:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075629030999999999 2024-04-25T22:03:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333594+0000", 2024-04-25T22:03:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0291999999999999e-05 2024-04-25T22:03:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333630+0000", 2024-04-25T22:03:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6177000000000003e-05 2024-04-25T22:03:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:15375 4.4 4:211dd80e:::10000003351.00000000:head [write 0~4194304 [2@1354921]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.353362301000001, 2024-04-25T22:03:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953555500000001, 2024-04-25T22:03:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-04-25T22:03:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137076+0000", 2024-04-25T22:03:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.683e-06 2024-04-25T22:03:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142168+0000", 2024-04-25T22:03:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050917280000000002 2024-04-25T22:03:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142192+0000", 2024-04-25T22:03:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:03:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142206+0000", 2024-04-25T22:03:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.396e-05 2024-04-25T22:03:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142280+0000", 2024-04-25T22:03:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4369000000000006e-05 2024-04-25T22:03:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142346+0000", 2024-04-25T22:03:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5957000000000006e-05 2024-04-25T22:03:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142440+0000", 2024-04-25T22:03:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3888999999999995e-05 2024-04-25T22:03:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.208451+0000", 2024-04-25T22:03:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066011350999999996 2024-04-25T22:03:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246473+0000", 2024-04-25T22:03:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038021428000000003 2024-04-25T22:03:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246530+0000", 2024-04-25T22:03:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7466000000000002e-05 2024-04-25T22:03:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246610+0000", 2024-04-25T22:03:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9484e-05 2024-04-25T22:03:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:51.610 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:51.611 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:03:51.608+0000 7f5831b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21546) UID: 0 2024-04-25T22:03:51.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:51.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:51.708+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:51.744 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:51.744 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:51.744 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:03:51.744 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:51.754 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:51.755 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:51.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:51.775 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:51.775 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:51.792 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:51.792 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:51.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:51.808+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:51.881 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:51.881 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:51.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:51.910 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:03:51.912 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:03:51.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:51.912+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:51.930 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-04-25T22:03:51.603011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127965280,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2864,"num_read_kb":1340487,"num_write":29401,"num_write_kb":4408197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32745,"ondisk_log_size":32745,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":298348,"kb_used_data":71752,"kb_used_omap":4,"kb_used_meta":226555,"kb_avail":282817172,"statfs":{"total":289910292480,"available":289604784128,"internally_reserved":0,"allocated":73474048,"data_stored":256670202,"data_compressed":21842414,"data_compressed_allocated":35356672,"data_compressed_original":219611136,"omap_allocated":4785,"internal_metadata":231992655},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12394663,"num_objects":-1924,"num_object_clones":0,"num_object_copies":-3848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1924,"num_whiteouts":0,"num_read":10,"num_read_kb":237,"num_write":1989,"num_write_kb":3054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.595924"},"pg_stats":[{"pgid":"4.3f","version":"76'438","reported_seq":549,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.878952+0000","last_change":"2024-04-25T22:03:33.876369+0000","last_active":"2024-04-25T22:03:46.878952+0000","last_peered":"2024-04-25T22:03:46.878952+0000","last_clean":"2024-04-25T22:03:46.878952+0000","last_became_active":"2024-04-25T22:03:33.873739+0000","last_became_peered":"2024-04-25T22:03:33.873739+0000","last_unstale":"2024-04-25T22:03:46.878952+0000","last_undegraded":"2024-04-25T22:03:46.878952+0000","last_fullsized":"2024-04-25T22:03:46.878952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:32.529707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29432,"num_write":407,"num_write_kb":84235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"76'413","reported_seq":519,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.917933+0000","last_change":"2024-04-25T22:03:33.861269+0000","last_active":"2024-04-25T22:03:46.917933+0000","last_peered":"2024-04-25T22:03:46.917933+0000","last_clean":"2024-04-25T22:03:46.917933+0000","last_became_active":"2024-04-25T22:03:33.859221+0000","last_became_peered":"2024-04-25T22:03:33.859221+0000","last_unstale":"2024-04-25T22:03:46.917933+0000","last_undegraded":"2024-04-25T22:03:46.917933+0000","last_fullsized":"2024-04-25T22:03:46.917933+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:23:44.690527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":23541,"num_write":389,"num_write_kb":87654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"76'382","reported_seq":549,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.909574+0000","last_change":"2024-04-25T22:03:33.865905+0000","last_active":"2024-04-25T22:03:46.909574+0000","last_peered":"2024-04-25T22:03:46.909574+0000","last_clean":"2024-04-25T22:03:46.909574+0000","last_became_active":"2024-04-25T22:03:33.863788+0000","last_became_peered":"2024-04-25T22:03:33.863788+0000","last_unstale":"2024-04-25T22:03:46.909574+0000","last_undegraded":"2024-04-25T22:03:46.909574+0000","last_fullsized":"2024-04-25T22:03:46.909574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:01:10.252145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22311,"num_write":361,"num_write_kb":42975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"76'391","reported_seq":559,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:48.850851+0000","last_change":"2024-04-25T22:01:14.652266+0000","last_active":"2024-04-25T22:03:48.850851+0000","last_peered":"2024-04-25T22:03:48.850851+0000","last_clean":"2024-04-25T22:03:48.850851+0000","last_became_active":"2024-04-25T22:01:14.651646+0000","last_became_peered":"2024-04-25T22:01:14.651646+0000","last_unstale":"2024-04-25T22:03:48.850851+0000","last_undegraded":"2024-04-25T22:03:48.850851+0000","last_fullsized":"2024-04-25T22:03:48.850851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":20785,"num_write":367,"num_write_kb":63746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"76'425","reported_seq":524,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.896796+0000","last_change":"2024-04-25T22:02:49.879514+0000","last_active":"2024-04-25T22:03:46.896796+0000","last_peered":"2024-04-25T22:03:46.896796+0000","last_clean":"2024-04-25T22:03:46.896796+0000","last_became_active":"2024-04-25T22:02:49.878964+0000","last_became_peered":"2024-04-25T22:02:49.878964+0000","last_unstale":"2024-04-25T22:03:46.896796+0000","last_undegraded":"2024-04-25T22:03:46.896796+0000","last_fullsized":"2024-04-25T22:03:46.896796+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:21:30.432134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":20896,"num_write":403,"num_write_kb":100255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"76'363","reported_seq":513,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.887661+0000","last_change":"2024-04-25T22:01:14.655839+0000","last_active":"2024-04-25T22:03:46.887661+0000","last_peered":"2024-04-25T22:03:46.887661+0000","last_clean":"2024-04-25T22:03:46.887661+0000","last_became_active":"2024-04-25T22:01:14.653367+0000","last_became_peered":"2024-04-25T22:01:14.653367+0000","last_unstale":"2024-04-25T22:03:46.887661+0000","last_undegraded":"2024-04-25T22:03:46.887661+0000","last_fullsized":"2024-04-25T22:03:46.887661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9362,"num_write":344,"num_write_kb":20831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"76'433","reported_seq":609,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.892971+0000","last_change":"2024-04-25T22:01:14.653704+0000","last_active":"2024-04-25T22:03:46.892971+0000","last_peered":"2024-04-25T22:03:46.892971+0000","last_clean":"2024-04-25T22:03:46.892971+0000","last_became_active":"2024-04-25T22:01:14.652829+0000","last_became_peered":"2024-04-25T22:01:14.652829+0000","last_unstale":"2024-04-25T22:03:46.892971+0000","last_undegraded":"2024-04-25T22:03:46.892971+0000","last_fullsized":"2024-04-25T22:03:46.892971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25961,"num_write":415,"num_write_kb":72541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'385","reported_seq":572,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.920884+0000","last_change":"2024-04-25T22:01:14.658559+0000","last_active":"2024-04-25T22:03:46.920884+0000","last_peered":"2024-04-25T22:03:46.920884+0000","last_clean":"2024-04-25T22:03:46.920884+0000","last_became_active":"2024-04-25T22:01:14.656285+0000","last_became_peered":"2024-04-25T22:01:14.656285+0000","last_unstale":"2024-04-25T22:03:46.920884+0000","last_undegraded":"2024-04-25T22:03:46.920884+0000","last_fullsized":"2024-04-25T22:03:46.920884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":24749,"num_write":354,"num_write_kb":64232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"76'432","reported_seq":594,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.921800+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:03:46.921800+0000","last_peered":"2024-04-25T22:03:46.921800+0000","last_clean":"2024-04-25T22:03:46.921800+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:03:46.921800+0000","last_undegraded":"2024-04-25T22:03:46.921800+0000","last_fullsized":"2024-04-25T22:03:46.921800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":10648,"num_write":411,"num_write_kb":92932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'376","reported_seq":472,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.911061+0000","last_change":"2024-04-25T22:03:33.862062+0000","last_active":"2024-04-25T22:03:46.911061+0000","last_peered":"2024-04-25T22:03:46.911061+0000","last_clean":"2024-04-25T22:03:46.911061+0000","last_became_active":"2024-04-25T22:03:33.859382+0000","last_became_peered":"2024-04-25T22:03:33.859382+0000","last_unstale":"2024-04-25T22:03:46.911061+0000","last_undegraded":"2024-04-25T22:03:46.911061+0000","last_fullsized":"2024-04-25T22:03:46.911061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:22.713919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10696,"num_write":359,"num_write_kb":63259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"76'386","reported_seq":540,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.923144+0000","last_change":"2024-04-25T22:01:14.654133+0000","last_active":"2024-04-25T22:03:46.923144+0000","last_peered":"2024-04-25T22:03:46.923144+0000","last_clean":"2024-04-25T22:03:46.923144+0000","last_became_active":"2024-04-25T22:01:14.653336+0000","last_became_peered":"2024-04-25T22:01:14.653336+0000","last_unstale":"2024-04-25T22:03:46.923144+0000","last_undegraded":"2024-04-25T22:03:46.923144+0000","last_fullsized":"2024-04-25T22:03:46.923144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11259,"num_write":372,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"76'358","reported_seq":586,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.912698+0000","last_change":"2024-04-25T22:01:14.637015+0000","last_active":"2024-04-25T22:03:46.912698+0000","last_peered":"2024-04-25T22:03:46.912698+0000","last_clean":"2024-04-25T22:03:46.912698+0000","last_became_active":"2024-04-25T22:01:14.636117+0000","last_became_peered":"2024-04-25T22:01:14.636117+0000","last_unstale":"2024-04-25T22:03:46.912698+0000","last_undegraded":"2024-04-25T22:03:46.912698+0000","last_fullsized":"2024-04-25T22:03:46.912698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":51972,"num_write":340,"num_write_kb":51203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"76'410","reported_seq":517,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.896298+0000","last_change":"2024-04-25T22:03:33.866815+0000","last_active":"2024-04-25T22:03:46.896298+0000","last_peered":"2024-04-25T22:03:46.896298+0000","last_clean":"2024-04-25T22:03:46.896298+0000","last_became_active":"2024-04-25T22:03:33.859376+0000","last_became_peered":"2024-04-25T22:03:33.859376+0000","last_unstale":"2024-04-25T22:03:46.896298+0000","last_undegraded":"2024-04-25T22:03:46.896298+0000","last_fullsized":"2024-04-25T22:03:46.896298+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:08.620311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17620,"num_write":386,"num_write_kb":100613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"76'429","reported_seq":599,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.917175+0000","last_change":"2024-04-25T22:01:14.634309+0000","last_active":"2024-04-25T22:03:46.917175+0000","last_peered":"2024-04-25T22:03:46.917175+0000","last_clean":"2024-04-25T22:03:46.917175+0000","last_became_active":"2024-04-25T22:01:14.633837+0000","last_became_peered":"2024-04-25T22:01:14.633837+0000","last_unstale":"2024-04-25T22:03:46.917175+0000","last_undegraded":"2024-04-25T22:03:46.917175+0000","last_fullsized":"2024-04-25T22:03:46.917175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:43.108421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27327,"num_write":398,"num_write_kb":76113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"76'384","reported_seq":555,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:48.863323+0000","last_change":"2024-04-25T22:01:14.632463+0000","last_active":"2024-04-25T22:03:48.863323+0000","last_peered":"2024-04-25T22:03:48.863323+0000","last_clean":"2024-04-25T22:03:48.863323+0000","last_became_active":"2024-04-25T22:01:14.631859+0000","last_became_peered":"2024-04-25T22:01:14.631859+0000","last_unstale":"2024-04-25T22:03:48.863323+0000","last_undegraded":"2024-04-25T22:03:48.863323+0000","last_fullsized":"2024-04-25T22:03:48.863323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23986,"num_write":352,"num_write_kb":50754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"76'425","reported_seq":585,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.912940+0000","last_change":"2024-04-25T22:01:14.656895+0000","last_active":"2024-04-25T22:03:46.912940+0000","last_peered":"2024-04-25T22:03:46.912940+0000","last_clean":"2024-04-25T22:03:46.912940+0000","last_became_active":"2024-04-25T22:01:14.654368+0000","last_became_peered":"2024-04-25T22:01:14.654368+0000","last_unstale":"2024-04-25T22:03:46.912940+0000","last_undegraded":"2024-04-25T22:03:46.912940+0000","last_fullsized":"2024-04-25T22:03:46.912940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":13806,"num_write":403,"num_write_kb":38995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"76'436","reported_seq":604,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.921788+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:03:46.921788+0000","last_peered":"2024-04-25T22:03:46.921788+0000","last_clean":"2024-04-25T22:03:46.921788+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:03:46.921788+0000","last_undegraded":"2024-04-25T22:03:46.921788+0000","last_fullsized":"2024-04-25T22:03:46.921788+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":11085,"num_write":416,"num_write_kb":68377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'386","reported_seq":474,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.894623+0000","last_change":"2024-04-25T22:03:33.862762+0000","last_active":"2024-04-25T22:03:46.894623+0000","last_peered":"2024-04-25T22:03:46.894623+0000","last_clean":"2024-04-25T22:03:46.894623+0000","last_became_active":"2024-04-25T22:03:33.861082+0000","last_became_peered":"2024-04-25T22:03:33.861082+0000","last_unstale":"2024-04-25T22:03:46.894623+0000","last_undegraded":"2024-04-25T22:03:46.894623+0000","last_fullsized":"2024-04-25T22:03:46.894623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:15.823113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6581,"num_write":355,"num_write_kb":34159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"76'440","reported_seq":595,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.901926+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:03:46.901926+0000","last_peered":"2024-04-25T22:03:46.901926+0000","last_clean":"2024-04-25T22:03:46.901926+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:03:46.901926+0000","last_undegraded":"2024-04-25T22:03:46.901926+0000","last_fullsized":"2024-04-25T22:03:46.901926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22089,"num_write":411,"num_write_kb":104750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'426","reported_seq":576,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.907281+0000","last_change":"2024-04-25T22:01:14.649692+0000","last_active":"2024-04-25T22:03:46.907281+0000","last_peered":"2024-04-25T22:03:46.907281+0000","last_clean":"2024-04-25T22:03:46.907281+0000","last_became_active":"2024-04-25T22:01:14.648941+0000","last_became_peered":"2024-04-25T22:01:14.648941+0000","last_unstale":"2024-04-25T22:03:46.907281+0000","last_undegraded":"2024-04-25T22:03:46.907281+0000","last_fullsized":"2024-04-25T22:03:46.907281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:18.122691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11886,"num_write":398,"num_write_kb":55010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"76'404","reported_seq":573,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:48.879017+0000","last_change":"2024-04-25T22:01:14.649667+0000","last_active":"2024-04-25T22:03:48.879017+0000","last_peered":"2024-04-25T22:03:48.879017+0000","last_clean":"2024-04-25T22:03:48.879017+0000","last_became_active":"2024-04-25T22:01:14.648810+0000","last_became_peered":"2024-04-25T22:01:14.648810+0000","last_unstale":"2024-04-25T22:03:48.879017+0000","last_undegraded":"2024-04-25T22:03:48.879017+0000","last_fullsized":"2024-04-25T22:03:48.879017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:13:23.442016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23004,"num_write":370,"num_write_kb":75802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'426","reported_seq":527,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.910400+0000","last_change":"2024-04-25T22:02:49.886169+0000","last_active":"2024-04-25T22:03:46.910400+0000","last_peered":"2024-04-25T22:03:46.910400+0000","last_clean":"2024-04-25T22:03:46.910400+0000","last_became_active":"2024-04-25T22:02:49.884516+0000","last_became_peered":"2024-04-25T22:02:49.884516+0000","last_unstale":"2024-04-25T22:03:46.910400+0000","last_undegraded":"2024-04-25T22:03:46.910400+0000","last_fullsized":"2024-04-25T22:03:46.910400+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:21.251127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11950,"num_write":408,"num_write_kb":67524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"76'395","reported_seq":546,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.890146+0000","last_change":"2024-04-25T22:01:14.648088+0000","last_active":"2024-04-25T22:03:46.890146+0000","last_peered":"2024-04-25T22:03:46.890146+0000","last_clean":"2024-04-25T22:03:46.890146+0000","last_became_active":"2024-04-25T22:01:14.645377+0000","last_became_peered":"2024-04-25T22:01:14.645377+0000","last_unstale":"2024-04-25T22:03:46.890146+0000","last_undegraded":"2024-04-25T22:03:46.890146+0000","last_fullsized":"2024-04-25T22:03:46.890146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:55.425216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":6507,"num_write":370,"num_write_kb":51513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'443","reported_seq":561,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.903132+0000","last_change":"2024-04-25T22:02:49.876986+0000","last_active":"2024-04-25T22:03:46.903132+0000","last_peered":"2024-04-25T22:03:46.903132+0000","last_clean":"2024-04-25T22:03:46.903132+0000","last_became_active":"2024-04-25T22:02:49.876269+0000","last_became_peered":"2024-04-25T22:02:49.876269+0000","last_unstale":"2024-04-25T22:03:46.903132+0000","last_undegraded":"2024-04-25T22:03:46.903132+0000","last_fullsized":"2024-04-25T22:03:46.903132+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:35:35.547810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27047,"num_write":417,"num_write_kb":63386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"76'404","reported_seq":515,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.885193+0000","last_change":"2024-04-25T22:03:33.869313+0000","last_active":"2024-04-25T22:03:46.885193+0000","last_peered":"2024-04-25T22:03:46.885193+0000","last_clean":"2024-04-25T22:03:46.885193+0000","last_became_active":"2024-04-25T22:03:33.864163+0000","last_became_peered":"2024-04-25T22:03:33.864163+0000","last_unstale":"2024-04-25T22:03:46.885193+0000","last_undegraded":"2024-04-25T22:03:46.885193+0000","last_fullsized":"2024-04-25T22:03:46.885193+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:51:33.564347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25550,"num_write":386,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"76'470","reported_seq":667,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.921401+0000","last_change":"2024-04-25T22:01:14.645607+0000","last_active":"2024-04-25T22:03:46.921401+0000","last_peered":"2024-04-25T22:03:46.921401+0000","last_clean":"2024-04-25T22:03:46.921401+0000","last_became_active":"2024-04-25T22:01:14.644796+0000","last_became_peered":"2024-04-25T22:01:14.644796+0000","last_unstale":"2024-04-25T22:03:46.921401+0000","last_undegraded":"2024-04-25T22:03:46.921401+0000","last_fullsized":"2024-04-25T22:03:46.921401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":30714,"num_write":444,"num_write_kb":92836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'387","reported_seq":565,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:48.890455+0000","last_change":"2024-04-25T22:01:14.644459+0000","last_active":"2024-04-25T22:03:48.890455+0000","last_peered":"2024-04-25T22:03:48.890455+0000","last_clean":"2024-04-25T22:03:48.890455+0000","last_became_active":"2024-04-25T22:01:14.643448+0000","last_became_peered":"2024-04-25T22:01:14.643448+0000","last_unstale":"2024-04-25T22:03:48.890455+0000","last_undegraded":"2024-04-25T22:03:48.890455+0000","last_fullsized":"2024-04-25T22:03:48.890455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:16:46.058532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21644,"num_write":354,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"76'401","reported_seq":591,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.895022+0000","last_change":"2024-04-25T22:01:14.639015+0000","last_active":"2024-04-25T22:03:46.895022+0000","last_peered":"2024-04-25T22:03:46.895022+0000","last_clean":"2024-04-25T22:03:46.895022+0000","last_became_active":"2024-04-25T22:01:14.638245+0000","last_became_peered":"2024-04-25T22:01:14.638245+0000","last_unstale":"2024-04-25T22:03:46.895022+0000","last_undegraded":"2024-04-25T22:03:46.895022+0000","last_fullsized":"2024-04-25T22:03:46.895022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:39.100585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27522,"num_write":375,"num_write_kb":96416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"76'389","reported_seq":566,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.861185+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:03:46.861185+0000","last_peered":"2024-04-25T22:03:46.861185+0000","last_clean":"2024-04-25T22:03:46.861185+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:03:46.861185+0000","last_undegraded":"2024-04-25T22:03:46.861185+0000","last_fullsized":"2024-04-25T22:03:46.861185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28501,"num_write":367,"num_write_kb":63458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'459","reported_seq":592,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.921994+0000","last_change":"2024-04-25T22:03:33.874970+0000","last_active":"2024-04-25T22:03:46.921994+0000","last_peered":"2024-04-25T22:03:46.921994+0000","last_clean":"2024-04-25T22:03:46.921994+0000","last_became_active":"2024-04-25T22:03:33.870488+0000","last_became_peered":"2024-04-25T22:03:33.870488+0000","last_unstale":"2024-04-25T22:03:46.921994+0000","last_undegraded":"2024-04-25T22:03:46.921994+0000","last_fullsized":"2024-04-25T22:03:46.921994+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:13:37.847781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":20717,"num_write":435,"num_write_kb":55985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"76'432","reported_seq":589,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.912205+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:03:46.912205+0000","last_peered":"2024-04-25T22:03:46.912205+0000","last_clean":"2024-04-25T22:03:46.912205+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:03:46.912205+0000","last_undegraded":"2024-04-25T22:03:46.912205+0000","last_fullsized":"2024-04-25T22:03:46.912205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":10758,"num_write":401,"num_write_kb":44705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'413","reported_seq":524,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.918292+0000","last_change":"2024-04-25T22:02:43.850984+0000","last_active":"2024-04-25T22:03:46.918292+0000","last_peered":"2024-04-25T22:03:46.918292+0000","last_clean":"2024-04-25T22:03:46.918292+0000","last_became_active":"2024-04-25T22:02:43.850651+0000","last_became_peered":"2024-04-25T22:02:43.850651+0000","last_unstale":"2024-04-25T22:03:46.918292+0000","last_undegraded":"2024-04-25T22:03:46.918292+0000","last_fullsized":"2024-04-25T22:03:46.918292+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:08.019453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":29059,"num_write":391,"num_write_kb":40233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"76'386","reported_seq":503,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.920912+0000","last_change":"2024-04-25T22:03:33.860944+0000","last_active":"2024-04-25T22:03:46.920912+0000","last_peered":"2024-04-25T22:03:46.920912+0000","last_clean":"2024-04-25T22:03:46.920912+0000","last_became_active":"2024-04-25T22:03:33.859229+0000","last_became_peered":"2024-04-25T22:03:33.859229+0000","last_unstale":"2024-04-25T22:03:46.920912+0000","last_undegraded":"2024-04-25T22:03:46.920912+0000","last_fullsized":"2024-04-25T22:03:46.920912+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:12.408801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28857,"num_write":363,"num_write_kb":87969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"75'515","reported_seq":645,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.705450+0000","last_change":"2024-04-25T22:01:13.627362+0000","last_active":"2024-04-25T22:03:46.705450+0000","last_peered":"2024-04-25T22:03:46.705450+0000","last_clean":"2024-04-25T22:03:46.705450+0000","last_became_active":"2024-04-25T22:01:13.626146+0000","last_became_peered":"2024-04-25T22:01:13.626146+0000","last_unstale":"2024-04-25T22:03:46.705450+0000","last_undegraded":"2024-04-25T22:03:46.705450+0000","last_fullsized":"2024-04-25T22:03:46.705450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"76'369","reported_seq":468,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.901844+0000","last_change":"2024-04-25T22:02:49.882694+0000","last_active":"2024-04-25T22:03:46.901844+0000","last_peered":"2024-04-25T22:03:46.901844+0000","last_clean":"2024-04-25T22:03:46.901844+0000","last_became_active":"2024-04-25T22:02:49.882085+0000","last_became_peered":"2024-04-25T22:02:49.882085+0000","last_unstale":"2024-04-25T22:03:46.901844+0000","last_undegraded":"2024-04-25T22:03:46.901844+0000","last_fullsized":"2024-04-25T22:03:46.901844+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:56.743509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14983,"num_write":339,"num_write_kb":46748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"76'53","reported_seq":184,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008362+0000","last_change":"2024-04-25T22:01:13.630576+0000","last_active":"2024-04-25T22:03:46.008362+0000","last_peered":"2024-04-25T22:03:46.008362+0000","last_clean":"2024-04-25T22:03:46.008362+0000","last_became_active":"2024-04-25T22:01:13.629844+0000","last_became_peered":"2024-04-25T22:01:13.629844+0000","last_unstale":"2024-04-25T22:03:46.008362+0000","last_undegraded":"2024-04-25T22:03:46.008362+0000","last_fullsized":"2024-04-25T22:03:46.008362+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'426","reported_seq":604,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.921420+0000","last_change":"2024-04-25T22:03:05.707184+0000","last_active":"2024-04-25T22:03:46.921420+0000","last_peered":"2024-04-25T22:03:46.921420+0000","last_clean":"2024-04-25T22:03:46.921420+0000","last_became_active":"2024-04-25T22:03:05.704710+0000","last_became_peered":"2024-04-25T22:03:05.704710+0000","last_unstale":"2024-04-25T22:03:46.921420+0000","last_undegraded":"2024-04-25T22:03:46.921420+0000","last_fullsized":"2024-04-25T22:03:46.921420+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:53.632923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":17843,"num_write":388,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"75'71","reported_seq":134,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008746+0000","last_change":"2024-04-25T22:03:33.869003+0000","last_active":"2024-04-25T22:03:46.008746+0000","last_peered":"2024-04-25T22:03:46.008746+0000","last_clean":"2024-04-25T22:03:46.008746+0000","last_became_active":"2024-04-25T22:03:33.864095+0000","last_became_peered":"2024-04-25T22:03:33.864095+0000","last_unstale":"2024-04-25T22:03:46.008746+0000","last_undegraded":"2024-04-25T22:03:46.008746+0000","last_fullsized":"2024-04-25T22:03:46.008746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:40:47.994311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'357","reported_seq":509,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.912214+0000","last_change":"2024-04-25T22:01:14.646159+0000","last_active":"2024-04-25T22:03:46.912214+0000","last_peered":"2024-04-25T22:03:46.912214+0000","last_clean":"2024-04-25T22:03:46.912214+0000","last_became_active":"2024-04-25T22:01:14.645231+0000","last_became_peered":"2024-04-25T22:01:14.645231+0000","last_unstale":"2024-04-25T22:03:46.912214+0000","last_undegraded":"2024-04-25T22:03:46.912214+0000","last_fullsized":"2024-04-25T22:03:46.912214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:13.791782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":16032,"num_write":334,"num_write_kb":25754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'63","reported_seq":193,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.704579+0000","last_change":"2024-04-25T22:01:13.631868+0000","last_active":"2024-04-25T22:03:46.704579+0000","last_peered":"2024-04-25T22:03:46.704579+0000","last_clean":"2024-04-25T22:03:46.704579+0000","last_became_active":"2024-04-25T22:01:13.631030+0000","last_became_peered":"2024-04-25T22:01:13.631030+0000","last_unstale":"2024-04-25T22:03:46.704579+0000","last_undegraded":"2024-04-25T22:03:46.704579+0000","last_fullsized":"2024-04-25T22:03:46.704579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:59.322999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"76'148","reported_seq":278,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.871087+0000","last_change":"2024-04-25T22:01:13.631244+0000","last_active":"2024-04-25T22:03:46.871087+0000","last_peered":"2024-04-25T22:03:46.871087+0000","last_clean":"2024-04-25T22:03:46.871087+0000","last_became_active":"2024-04-25T22:01:13.630109+0000","last_became_peered":"2024-04-25T22:01:13.630109+0000","last_unstale":"2024-04-25T22:03:46.871087+0000","last_undegraded":"2024-04-25T22:03:46.871087+0000","last_fullsized":"2024-04-25T22:03:46.871087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"76'393","reported_seq":505,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.862991+0000","last_change":"2024-04-25T22:03:33.865011+0000","last_active":"2024-04-25T22:03:46.862991+0000","last_peered":"2024-04-25T22:03:46.862991+0000","last_clean":"2024-04-25T22:03:46.862991+0000","last_became_active":"2024-04-25T22:03:33.863467+0000","last_became_peered":"2024-04-25T22:03:33.863467+0000","last_unstale":"2024-04-25T22:03:46.862991+0000","last_undegraded":"2024-04-25T22:03:46.862991+0000","last_fullsized":"2024-04-25T22:03:46.862991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:23.819171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21114,"num_write":364,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"75'250","reported_seq":320,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.009833+0000","last_change":"2024-04-25T22:03:33.869133+0000","last_active":"2024-04-25T22:03:46.009833+0000","last_peered":"2024-04-25T22:03:46.009833+0000","last_clean":"2024-04-25T22:03:46.009833+0000","last_became_active":"2024-04-25T22:03:33.864788+0000","last_became_peered":"2024-04-25T22:03:33.864788+0000","last_unstale":"2024-04-25T22:03:46.009833+0000","last_undegraded":"2024-04-25T22:03:46.009833+0000","last_fullsized":"2024-04-25T22:03:46.009833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:31.486981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"76'458","reported_seq":585,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.917616+0000","last_change":"2024-04-25T22:03:33.861055+0000","last_active":"2024-04-25T22:03:46.917616+0000","last_peered":"2024-04-25T22:03:46.917616+0000","last_clean":"2024-04-25T22:03:46.917616+0000","last_became_active":"2024-04-25T22:03:33.856638+0000","last_became_peered":"2024-04-25T22:03:33.856638+0000","last_unstale":"2024-04-25T22:03:46.917616+0000","last_undegraded":"2024-04-25T22:03:46.917616+0000","last_fullsized":"2024-04-25T22:03:46.917616+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":39774,"num_write":433,"num_write_kb":80294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'556","reported_seq":685,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.706357+0000","last_change":"2024-04-25T22:02:49.885084+0000","last_active":"2024-04-25T22:03:46.706357+0000","last_peered":"2024-04-25T22:03:46.706357+0000","last_clean":"2024-04-25T22:03:46.706357+0000","last_became_active":"2024-04-25T22:02:49.883048+0000","last_became_peered":"2024-04-25T22:02:49.883048+0000","last_unstale":"2024-04-25T22:03:46.706357+0000","last_undegraded":"2024-04-25T22:03:46.706357+0000","last_fullsized":"2024-04-25T22:03:46.706357+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:12.276434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":509,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"76'409","reported_seq":548,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.910650+0000","last_change":"2024-04-25T22:01:14.648338+0000","last_active":"2024-04-25T22:03:46.910650+0000","last_peered":"2024-04-25T22:03:46.910650+0000","last_clean":"2024-04-25T22:03:46.910650+0000","last_became_active":"2024-04-25T22:01:14.647360+0000","last_became_peered":"2024-04-25T22:01:14.647360+0000","last_unstale":"2024-04-25T22:03:46.910650+0000","last_undegraded":"2024-04-25T22:03:46.910650+0000","last_fullsized":"2024-04-25T22:03:46.910650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:06:17.721175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4858,"num_write":378,"num_write_kb":46741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"76'66","reported_seq":135,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008921+0000","last_change":"2024-04-25T22:02:43.853012+0000","last_active":"2024-04-25T22:03:46.008921+0000","last_peered":"2024-04-25T22:03:46.008921+0000","last_clean":"2024-04-25T22:03:46.008921+0000","last_became_active":"2024-04-25T22:02:43.852338+0000","last_became_peered":"2024-04-25T22:02:43.852338+0000","last_unstale":"2024-04-25T22:03:46.008921+0000","last_undegraded":"2024-04-25T22:03:46.008921+0000","last_fullsized":"2024-04-25T22:03:46.008921+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:07.951790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"76'481","reported_seq":668,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008728+0000","last_change":"2024-04-25T22:01:14.648511+0000","last_active":"2024-04-25T22:03:46.008728+0000","last_peered":"2024-04-25T22:03:46.008728+0000","last_clean":"2024-04-25T22:03:46.008728+0000","last_became_active":"2024-04-25T22:01:14.645518+0000","last_became_peered":"2024-04-25T22:01:14.645518+0000","last_unstale":"2024-04-25T22:03:46.008728+0000","last_undegraded":"2024-04-25T22:03:46.008728+0000","last_fullsized":"2024-04-25T22:03:46.008728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:34:06.283758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":26829,"num_write":457,"num_write_kb":137840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"75'193","reported_seq":324,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008766+0000","last_change":"2024-04-25T22:01:13.632657+0000","last_active":"2024-04-25T22:03:46.008766+0000","last_peered":"2024-04-25T22:03:46.008766+0000","last_clean":"2024-04-25T22:03:46.008766+0000","last_became_active":"2024-04-25T22:01:13.631261+0000","last_became_peered":"2024-04-25T22:01:13.631261+0000","last_unstale":"2024-04-25T22:03:46.008766+0000","last_undegraded":"2024-04-25T22:03:46.008766+0000","last_fullsized":"2024-04-25T22:03:46.008766+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:33.142038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'431","reported_seq":519,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.907516+0000","last_change":"2024-04-25T22:02:43.853286+0000","last_active":"2024-04-25T22:03:46.907516+0000","last_peered":"2024-04-25T22:03:46.907516+0000","last_clean":"2024-04-25T22:03:46.907516+0000","last_became_active":"2024-04-25T22:02:43.852555+0000","last_became_peered":"2024-04-25T22:02:43.852555+0000","last_unstale":"2024-04-25T22:03:46.907516+0000","last_undegraded":"2024-04-25T22:03:46.907516+0000","last_fullsized":"2024-04-25T22:03:46.907516+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:42:10.005523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3720,"num_write":406,"num_write_kb":30461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"76'106","reported_seq":236,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.705398+0000","last_change":"2024-04-25T22:01:13.627447+0000","last_active":"2024-04-25T22:03:46.705398+0000","last_peered":"2024-04-25T22:03:46.705398+0000","last_clean":"2024-04-25T22:03:46.705398+0000","last_became_active":"2024-04-25T22:01:13.626295+0000","last_became_peered":"2024-04-25T22:01:13.626295+0000","last_unstale":"2024-04-25T22:03:46.705398+0000","last_undegraded":"2024-04-25T22:03:46.705398+0000","last_fullsized":"2024-04-25T22:03:46.705398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"76'409","reported_seq":578,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:48.890833+0000","last_change":"2024-04-25T22:01:14.645331+0000","last_active":"2024-04-25T22:03:48.890833+0000","last_peered":"2024-04-25T22:03:48.890833+0000","last_clean":"2024-04-25T22:03:48.890833+0000","last_became_active":"2024-04-25T22:01:14.644329+0000","last_became_peered":"2024-04-25T22:01:14.644329+0000","last_unstale":"2024-04-25T22:03:48.890833+0000","last_undegraded":"2024-04-25T22:03:48.890833+0000","last_fullsized":"2024-04-25T22:03:48.890833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:52.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19178,"num_write":380,"num_write_kb":91945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"75'51","reported_seq":128,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.009073+0000","last_change":"2024-04-25T22:03:33.870525+0000","last_active":"2024-04-25T22:03:46.009073+0000","last_peered":"2024-04-25T22:03:46.009073+0000","last_clean":"2024-04-25T22:03:46.009073+0000","last_became_active":"2024-04-25T22:03:33.865178+0000","last_became_peered":"2024-04-25T22:03:33.865178+0000","last_unstale":"2024-04-25T22:03:46.009073+0000","last_undegraded":"2024-04-25T22:03:46.009073+0000","last_fullsized":"2024-04-25T22:03:46.009073+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:23.174248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"76'377","reported_seq":537,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:48.890967+0000","last_change":"2024-04-25T22:01:14.632937+0000","last_active":"2024-04-25T22:03:48.890967+0000","last_peered":"2024-04-25T22:03:48.890967+0000","last_clean":"2024-04-25T22:03:48.890967+0000","last_became_active":"2024-04-25T22:01:14.632197+0000","last_became_peered":"2024-04-25T22:01:14.632197+0000","last_unstale":"2024-04-25T22:03:48.890967+0000","last_undegraded":"2024-04-25T22:03:48.890967+0000","last_fullsized":"2024-04-25T22:03:48.890967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:24.299988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21517,"num_write":342,"num_write_kb":66898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"75'449","reported_seq":499,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008402+0000","last_change":"2024-04-25T22:03:33.860386+0000","last_active":"2024-04-25T22:03:46.008402+0000","last_peered":"2024-04-25T22:03:46.008402+0000","last_clean":"2024-04-25T22:03:46.008402+0000","last_became_active":"2024-04-25T22:03:33.859539+0000","last_became_peered":"2024-04-25T22:03:33.859539+0000","last_unstale":"2024-04-25T22:03:46.008402+0000","last_undegraded":"2024-04-25T22:03:46.008402+0000","last_fullsized":"2024-04-25T22:03:46.008402+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:20.247942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'390","reported_seq":558,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.914864+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:03:46.914864+0000","last_peered":"2024-04-25T22:03:46.914864+0000","last_clean":"2024-04-25T22:03:46.914864+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:03:46.914864+0000","last_undegraded":"2024-04-25T22:03:46.914864+0000","last_fullsized":"2024-04-25T22:03:46.914864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17888,"num_write":373,"num_write_kb":67556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":338,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.704800+0000","last_change":"2024-04-25T22:01:05.454242+0000","last_active":"2024-04-25T22:03:46.704800+0000","last_peered":"2024-04-25T22:03:46.704800+0000","last_clean":"2024-04-25T22:03:46.704800+0000","last_became_active":"2024-04-25T22:01:05.453521+0000","last_became_peered":"2024-04-25T22:01:05.453521+0000","last_unstale":"2024-04-25T22:03:46.704800+0000","last_undegraded":"2024-04-25T22:03:46.704800+0000","last_fullsized":"2024-04-25T22:03:46.704800+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:51.378337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":136,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.705927+0000","last_change":"2024-04-25T22:01:09.582701+0000","last_active":"2024-04-25T22:03:46.705927+0000","last_peered":"2024-04-25T22:03:46.705927+0000","last_clean":"2024-04-25T22:03:46.705927+0000","last_became_active":"2024-04-25T22:01:09.582094+0000","last_became_peered":"2024-04-25T22:01:09.582094+0000","last_unstale":"2024-04-25T22:03:46.705927+0000","last_undegraded":"2024-04-25T22:03:46.705927+0000","last_fullsized":"2024-04-25T22:03:46.705927+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:16:56.052171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"75'393","reported_seq":524,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008475+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:03:46.008475+0000","last_peered":"2024-04-25T22:03:46.008475+0000","last_clean":"2024-04-25T22:03:46.008475+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:03:46.008475+0000","last_undegraded":"2024-04-25T22:03:46.008475+0000","last_fullsized":"2024-04-25T22:03:46.008475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'463","reported_seq":641,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:48.890468+0000","last_change":"2024-04-25T22:01:14.645070+0000","last_active":"2024-04-25T22:03:48.890468+0000","last_peered":"2024-04-25T22:03:48.890468+0000","last_clean":"2024-04-25T22:03:48.890468+0000","last_became_active":"2024-04-25T22:01:14.643419+0000","last_became_peered":"2024-04-25T22:01:14.643419+0000","last_unstale":"2024-04-25T22:03:48.890468+0000","last_undegraded":"2024-04-25T22:03:48.890468+0000","last_fullsized":"2024-04-25T22:03:48.890468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:54:39.132729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29270,"num_write":426,"num_write_kb":129367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":136,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.704528+0000","last_change":"2024-04-25T22:01:09.576454+0000","last_active":"2024-04-25T22:03:46.704528+0000","last_peered":"2024-04-25T22:03:46.704528+0000","last_clean":"2024-04-25T22:03:46.704528+0000","last_became_active":"2024-04-25T22:01:09.575851+0000","last_became_peered":"2024-04-25T22:01:09.575851+0000","last_unstale":"2024-04-25T22:03:46.704528+0000","last_undegraded":"2024-04-25T22:03:46.704528+0000","last_fullsized":"2024-04-25T22:03:46.704528+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:29.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"76'125","reported_seq":319,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.853484+0000","last_change":"2024-04-25T22:01:13.630197+0000","last_active":"2024-04-25T22:03:46.853484+0000","last_peered":"2024-04-25T22:03:46.853484+0000","last_clean":"2024-04-25T22:03:46.853484+0000","last_became_active":"2024-04-25T22:01:13.629433+0000","last_became_peered":"2024-04-25T22:01:13.629433+0000","last_unstale":"2024-04-25T22:03:46.853484+0000","last_undegraded":"2024-04-25T22:03:46.853484+0000","last_fullsized":"2024-04-25T22:03:46.853484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:28:53.857562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464197,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":63,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'450","reported_seq":592,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.920907+0000","last_change":"2024-04-25T22:03:05.702224+0000","last_active":"2024-04-25T22:03:46.920907+0000","last_peered":"2024-04-25T22:03:46.920907+0000","last_clean":"2024-04-25T22:03:46.920907+0000","last_became_active":"2024-04-25T22:03:05.699581+0000","last_became_peered":"2024-04-25T22:03:05.699581+0000","last_unstale":"2024-04-25T22:03:46.920907+0000","last_undegraded":"2024-04-25T22:03:46.920907+0000","last_fullsized":"2024-04-25T22:03:46.920907+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":34759,"num_write":424,"num_write_kb":71902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":137,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008179+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:03:46.008179+0000","last_peered":"2024-04-25T22:03:46.008179+0000","last_clean":"2024-04-25T22:03:46.008179+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:03:46.008179+0000","last_undegraded":"2024-04-25T22:03:46.008179+0000","last_fullsized":"2024-04-25T22:03:46.008179+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"75'311","reported_seq":442,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008551+0000","last_change":"2024-04-25T22:01:13.632019+0000","last_active":"2024-04-25T22:03:46.008551+0000","last_peered":"2024-04-25T22:03:46.008551+0000","last_clean":"2024-04-25T22:03:46.008551+0000","last_became_active":"2024-04-25T22:01:13.631321+0000","last_became_peered":"2024-04-25T22:01:13.631321+0000","last_unstale":"2024-04-25T22:03:46.008551+0000","last_undegraded":"2024-04-25T22:03:46.008551+0000","last_fullsized":"2024-04-25T22:03:46.008551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:48.760546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"76'368","reported_seq":541,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.866991+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:03:46.866991+0000","last_peered":"2024-04-25T22:03:46.866991+0000","last_clean":"2024-04-25T22:03:46.866991+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:03:46.866991+0000","last_undegraded":"2024-04-25T22:03:46.866991+0000","last_fullsized":"2024-04-25T22:03:46.866991+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28273,"num_write":350,"num_write_kb":87787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":136,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.705304+0000","last_change":"2024-04-25T22:01:09.580050+0000","last_active":"2024-04-25T22:03:46.705304+0000","last_peered":"2024-04-25T22:03:46.705304+0000","last_clean":"2024-04-25T22:03:46.705304+0000","last_became_active":"2024-04-25T22:01:09.579426+0000","last_became_peered":"2024-04-25T22:01:09.579426+0000","last_unstale":"2024-04-25T22:03:46.705304+0000","last_undegraded":"2024-04-25T22:03:46.705304+0000","last_fullsized":"2024-04-25T22:03:46.705304+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:16.993883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"76'75","reported_seq":144,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.893286+0000","last_change":"2024-04-25T22:02:43.851416+0000","last_active":"2024-04-25T22:03:46.893286+0000","last_peered":"2024-04-25T22:03:46.893286+0000","last_clean":"2024-04-25T22:03:46.893286+0000","last_became_active":"2024-04-25T22:02:43.850822+0000","last_became_peered":"2024-04-25T22:02:43.850822+0000","last_unstale":"2024-04-25T22:03:46.893286+0000","last_undegraded":"2024-04-25T22:03:46.893286+0000","last_fullsized":"2024-04-25T22:03:46.893286+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:56:58.100216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"76'452","reported_seq":698,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.898879+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:03:46.898879+0000","last_peered":"2024-04-25T22:03:46.898879+0000","last_clean":"2024-04-25T22:03:46.898879+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:03:46.898879+0000","last_undegraded":"2024-04-25T22:03:46.898879+0000","last_fullsized":"2024-04-25T22:03:46.898879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":67984,"num_write":425,"num_write_kb":154741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"76'268","reported_seq":398,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.900360+0000","last_change":"2024-04-25T22:01:13.627972+0000","last_active":"2024-04-25T22:03:46.900360+0000","last_peered":"2024-04-25T22:03:46.900360+0000","last_clean":"2024-04-25T22:03:46.900360+0000","last_became_active":"2024-04-25T22:01:13.626251+0000","last_became_peered":"2024-04-25T22:01:13.626251+0000","last_unstale":"2024-04-25T22:03:46.900360+0000","last_undegraded":"2024-04-25T22:03:46.900360+0000","last_fullsized":"2024-04-25T22:03:46.900360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:23.969755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":137,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.009248+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:03:46.009248+0000","last_peered":"2024-04-25T22:03:46.009248+0000","last_clean":"2024-04-25T22:03:46.009248+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:03:46.009248+0000","last_undegraded":"2024-04-25T22:03:46.009248+0000","last_fullsized":"2024-04-25T22:03:46.009248+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'390","reported_seq":516,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.906720+0000","last_change":"2024-04-25T22:03:33.867587+0000","last_active":"2024-04-25T22:03:46.906720+0000","last_peered":"2024-04-25T22:03:46.906720+0000","last_clean":"2024-04-25T22:03:46.906720+0000","last_became_active":"2024-04-25T22:03:33.865330+0000","last_became_peered":"2024-04-25T22:03:33.865330+0000","last_unstale":"2024-04-25T22:03:46.906720+0000","last_undegraded":"2024-04-25T22:03:46.906720+0000","last_fullsized":"2024-04-25T22:03:46.906720+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:10:37.149246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":26599,"num_write":366,"num_write_kb":75612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"76'47","reported_seq":178,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.900004+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:03:46.900004+0000","last_peered":"2024-04-25T22:03:46.900004+0000","last_clean":"2024-04-25T22:03:46.900004+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:03:46.900004+0000","last_undegraded":"2024-04-25T22:03:46.900004+0000","last_fullsized":"2024-04-25T22:03:46.900004+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.010143+0000","last_change":"2024-04-25T22:03:05.701809+0000","last_active":"2024-04-25T22:03:46.010143+0000","last_peered":"2024-04-25T22:03:46.010143+0000","last_clean":"2024-04-25T22:03:46.010143+0000","last_became_active":"2024-04-25T22:03:05.701322+0000","last_became_peered":"2024-04-25T22:03:05.701322+0000","last_unstale":"2024-04-25T22:03:46.010143+0000","last_undegraded":"2024-04-25T22:03:46.010143+0000","last_fullsized":"2024-04-25T22:03:46.010143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:45.907458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"76'399","reported_seq":581,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.914625+0000","last_change":"2024-04-25T22:01:14.637514+0000","last_active":"2024-04-25T22:03:46.914625+0000","last_peered":"2024-04-25T22:03:46.914625+0000","last_clean":"2024-04-25T22:03:46.914625+0000","last_became_active":"2024-04-25T22:01:14.636370+0000","last_became_peered":"2024-04-25T22:01:14.636370+0000","last_unstale":"2024-04-25T22:03:46.914625+0000","last_undegraded":"2024-04-25T22:03:46.914625+0000","last_fullsized":"2024-04-25T22:03:46.914625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25634,"num_write":377,"num_write_kb":103970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"76'64","reported_seq":195,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.865179+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:03:46.865179+0000","last_peered":"2024-04-25T22:03:46.865179+0000","last_clean":"2024-04-25T22:03:46.865179+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:03:46.865179+0000","last_undegraded":"2024-04-25T22:03:46.865179+0000","last_fullsized":"2024-04-25T22:03:46.865179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":137,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.009380+0000","last_change":"2024-04-25T22:01:09.581416+0000","last_active":"2024-04-25T22:03:46.009380+0000","last_peered":"2024-04-25T22:03:46.009380+0000","last_clean":"2024-04-25T22:03:46.009380+0000","last_became_active":"2024-04-25T22:01:09.580704+0000","last_became_peered":"2024-04-25T22:01:09.580704+0000","last_unstale":"2024-04-25T22:03:46.009380+0000","last_undegraded":"2024-04-25T22:03:46.009380+0000","last_fullsized":"2024-04-25T22:03:46.009380+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"76'394","reported_seq":544,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008228+0000","last_change":"2024-04-25T22:01:14.644731+0000","last_active":"2024-04-25T22:03:46.008228+0000","last_peered":"2024-04-25T22:03:46.008228+0000","last_clean":"2024-04-25T22:03:46.008228+0000","last_became_active":"2024-04-25T22:01:14.642910+0000","last_became_peered":"2024-04-25T22:01:14.642910+0000","last_unstale":"2024-04-25T22:03:46.008228+0000","last_undegraded":"2024-04-25T22:03:46.008228+0000","last_fullsized":"2024-04-25T22:03:46.008228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:45.623774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9572,"num_write":361,"num_write_kb":29911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"76'126","reported_seq":257,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.868239+0000","last_change":"2024-04-25T22:01:13.633601+0000","last_active":"2024-04-25T22:03:46.868239+0000","last_peered":"2024-04-25T22:03:46.868239+0000","last_clean":"2024-04-25T22:03:46.868239+0000","last_became_active":"2024-04-25T22:01:13.631625+0000","last_became_peered":"2024-04-25T22:01:13.631625+0000","last_unstale":"2024-04-25T22:03:46.868239+0000","last_undegraded":"2024-04-25T22:03:46.868239+0000","last_fullsized":"2024-04-25T22:03:46.868239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:28.463385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":1301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":136,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.706430+0000","last_change":"2024-04-25T22:01:09.574148+0000","last_active":"2024-04-25T22:03:46.706430+0000","last_peered":"2024-04-25T22:03:46.706430+0000","last_clean":"2024-04-25T22:03:46.706430+0000","last_became_active":"2024-04-25T22:01:09.573459+0000","last_became_peered":"2024-04-25T22:01:09.573459+0000","last_unstale":"2024-04-25T22:03:46.706430+0000","last_undegraded":"2024-04-25T22:03:46.706430+0000","last_fullsized":"2024-04-25T22:03:46.706430+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:31.552200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"76'410","reported_seq":537,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.914155+0000","last_change":"2024-04-25T22:03:33.861820+0000","last_active":"2024-04-25T22:03:46.914155+0000","last_peered":"2024-04-25T22:03:46.914155+0000","last_clean":"2024-04-25T22:03:46.914155+0000","last_became_active":"2024-04-25T22:03:33.859807+0000","last_became_peered":"2024-04-25T22:03:33.859807+0000","last_unstale":"2024-04-25T22:03:46.914155+0000","last_undegraded":"2024-04-25T22:03:46.914155+0000","last_fullsized":"2024-04-25T22:03:46.914155+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:38.761184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27345,"num_write":384,"num_write_kb":92854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"76'406","reported_seq":592,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:48.892642+0000","last_change":"2024-04-25T22:01:14.633113+0000","last_active":"2024-04-25T22:03:48.892642+0000","last_peered":"2024-04-25T22:03:48.892642+0000","last_clean":"2024-04-25T22:03:48.892642+0000","last_became_active":"2024-04-25T22:01:14.632330+0000","last_became_peered":"2024-04-25T22:01:14.632330+0000","last_unstale":"2024-04-25T22:03:48.892642+0000","last_undegraded":"2024-04-25T22:03:48.892642+0000","last_fullsized":"2024-04-25T22:03:48.892642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:30.957524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33923,"num_write":372,"num_write_kb":82083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"76'258","reported_seq":388,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.906439+0000","last_change":"2024-04-25T22:01:13.631322+0000","last_active":"2024-04-25T22:03:46.906439+0000","last_peered":"2024-04-25T22:03:46.906439+0000","last_clean":"2024-04-25T22:03:46.906439+0000","last_became_active":"2024-04-25T22:01:13.630138+0000","last_became_peered":"2024-04-25T22:01:13.630138+0000","last_unstale":"2024-04-25T22:03:46.906439+0000","last_undegraded":"2024-04-25T22:03:46.906439+0000","last_fullsized":"2024-04-25T22:03:46.906439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8469405,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":8372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"76'399","reported_seq":555,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.896080+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:03:46.896080+0000","last_peered":"2024-04-25T22:03:46.896080+0000","last_clean":"2024-04-25T22:03:46.896080+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:03:46.896080+0000","last_undegraded":"2024-04-25T22:03:46.896080+0000","last_fullsized":"2024-04-25T22:03:46.896080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14178,"num_write":370,"num_write_kb":58735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'104","reported_seq":235,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.919278+0000","last_change":"2024-04-25T22:01:13.632166+0000","last_active":"2024-04-25T22:03:46.919278+0000","last_peered":"2024-04-25T22:03:46.919278+0000","last_clean":"2024-04-25T22:03:46.919278+0000","last_became_active":"2024-04-25T22:01:13.631403+0000","last_became_peered":"2024-04-25T22:01:13.631403+0000","last_unstale":"2024-04-25T22:03:46.919278+0000","last_undegraded":"2024-04-25T22:03:46.919278+0000","last_fullsized":"2024-04-25T22:03:46.919278+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:03.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"75'232","reported_seq":301,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008795+0000","last_change":"2024-04-25T22:02:43.852674+0000","last_active":"2024-04-25T22:03:46.008795+0000","last_peered":"2024-04-25T22:03:46.008795+0000","last_clean":"2024-04-25T22:03:46.008795+0000","last_became_active":"2024-04-25T22:02:43.852292+0000","last_became_peered":"2024-04-25T22:02:43.852292+0000","last_unstale":"2024-04-25T22:03:46.008795+0000","last_undegraded":"2024-04-25T22:03:46.008795+0000","last_fullsized":"2024-04-25T22:03:46.008795+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:57.388397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"76'477","reported_seq":654,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.907376+0000","last_change":"2024-04-25T22:01:14.645625+0000","last_active":"2024-04-25T22:03:46.907376+0000","last_peered":"2024-04-25T22:03:46.907376+0000","last_clean":"2024-04-25T22:03:46.907376+0000","last_became_active":"2024-04-25T22:01:14.644787+0000","last_became_peered":"2024-04-25T22:01:14.644787+0000","last_unstale":"2024-04-25T22:03:46.907376+0000","last_undegraded":"2024-04-25T22:03:46.907376+0000","last_fullsized":"2024-04-25T22:03:46.907376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:36.695561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24709,"num_write":463,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"75'60","reported_seq":191,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.009001+0000","last_change":"2024-04-25T22:01:13.632728+0000","last_active":"2024-04-25T22:03:46.009001+0000","last_peered":"2024-04-25T22:03:46.009001+0000","last_clean":"2024-04-25T22:03:46.009001+0000","last_became_active":"2024-04-25T22:01:13.631918+0000","last_became_peered":"2024-04-25T22:01:13.631918+0000","last_unstale":"2024-04-25T22:03:46.009001+0000","last_undegraded":"2024-04-25T22:03:46.009001+0000","last_fullsized":"2024-04-25T22:03:46.009001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:36.151864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'438","reported_seq":596,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.896090+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:03:46.896090+0000","last_peered":"2024-04-25T22:03:46.896090+0000","last_clean":"2024-04-25T22:03:46.896090+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:03:46.896090+0000","last_undegraded":"2024-04-25T22:03:46.896090+0000","last_fullsized":"2024-04-25T22:03:46.896090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14429,"num_write":416,"num_write_kb":59186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'349","reported_seq":439,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.874982+0000","last_change":"2024-04-25T22:03:33.870025+0000","last_active":"2024-04-25T22:03:46.874982+0000","last_peered":"2024-04-25T22:03:46.874982+0000","last_clean":"2024-04-25T22:03:46.874982+0000","last_became_active":"2024-04-25T22:03:33.866366+0000","last_became_peered":"2024-04-25T22:03:33.866366+0000","last_unstale":"2024-04-25T22:03:46.874982+0000","last_undegraded":"2024-04-25T22:03:46.874982+0000","last_fullsized":"2024-04-25T22:03:46.874982+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:02:00.490754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18236,"num_write":332,"num_write_kb":42553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"76'742","reported_seq":873,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.885316+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:03:46.885316+0000","last_peered":"2024-04-25T22:03:46.885316+0000","last_clean":"2024-04-25T22:03:46.885316+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:03:46.885316+0000","last_undegraded":"2024-04-25T22:03:46.885316+0000","last_fullsized":"2024-04-25T22:03:46.885316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'373","reported_seq":521,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.911398+0000","last_change":"2024-04-25T22:01:14.643237+0000","last_active":"2024-04-25T22:03:46.911398+0000","last_peered":"2024-04-25T22:03:46.911398+0000","last_clean":"2024-04-25T22:03:46.911398+0000","last_became_active":"2024-04-25T22:01:14.641740+0000","last_became_peered":"2024-04-25T22:01:14.641740+0000","last_unstale":"2024-04-25T22:03:46.911398+0000","last_undegraded":"2024-04-25T22:03:46.911398+0000","last_fullsized":"2024-04-25T22:03:46.911398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:13.043752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6876,"num_write":354,"num_write_kb":46840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"76'204","reported_seq":335,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.007998+0000","last_change":"2024-04-25T22:01:13.631010+0000","last_active":"2024-04-25T22:03:46.007998+0000","last_peered":"2024-04-25T22:03:46.007998+0000","last_clean":"2024-04-25T22:03:46.007998+0000","last_became_active":"2024-04-25T22:01:13.630337+0000","last_became_peered":"2024-04-25T22:01:13.630337+0000","last_unstale":"2024-04-25T22:03:46.007998+0000","last_undegraded":"2024-04-25T22:03:46.007998+0000","last_fullsized":"2024-04-25T22:03:46.007998+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:03:04.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'362","reported_seq":446,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.920127+0000","last_change":"2024-04-25T22:03:33.866383+0000","last_active":"2024-04-25T22:03:46.920127+0000","last_peered":"2024-04-25T22:03:46.920127+0000","last_clean":"2024-04-25T22:03:46.920127+0000","last_became_active":"2024-04-25T22:03:33.864179+0000","last_became_peered":"2024-04-25T22:03:33.864179+0000","last_unstale":"2024-04-25T22:03:46.920127+0000","last_undegraded":"2024-04-25T22:03:46.920127+0000","last_fullsized":"2024-04-25T22:03:46.920127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:53.632923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6059,"num_write":332,"num_write_kb":37972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"76'217","reported_seq":284,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.894258+0000","last_change":"2024-04-25T22:03:05.702244+0000","last_active":"2024-04-25T22:03:46.894258+0000","last_peered":"2024-04-25T22:03:46.894258+0000","last_clean":"2024-04-25T22:03:46.894258+0000","last_became_active":"2024-04-25T22:03:05.701350+0000","last_became_peered":"2024-04-25T22:03:05.701350+0000","last_unstale":"2024-04-25T22:03:46.894258+0000","last_undegraded":"2024-04-25T22:03:46.894258+0000","last_fullsized":"2024-04-25T22:03:46.894258+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:31:38.259386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"76'380","reported_seq":486,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.913615+0000","last_change":"2024-04-25T22:03:33.862286+0000","last_active":"2024-04-25T22:03:46.913615+0000","last_peered":"2024-04-25T22:03:46.913615+0000","last_clean":"2024-04-25T22:03:46.913615+0000","last_became_active":"2024-04-25T22:03:33.860800+0000","last_became_peered":"2024-04-25T22:03:33.860800+0000","last_unstale":"2024-04-25T22:03:46.913615+0000","last_undegraded":"2024-04-25T22:03:46.913615+0000","last_fullsized":"2024-04-25T22:03:46.913615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:04.528174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19110,"num_write":355,"num_write_kb":63152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'51","reported_seq":72,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.009334+0000","last_change":"2024-04-25T22:03:33.869667+0000","last_active":"2024-04-25T22:03:46.009334+0000","last_peered":"2024-04-25T22:03:46.009334+0000","last_clean":"2024-04-25T22:03:46.009334+0000","last_became_active":"2024-04-25T22:03:33.867980+0000","last_became_peered":"2024-04-25T22:03:33.867980+0000","last_unstale":"2024-04-25T22:03:46.009334+0000","last_undegraded":"2024-04-25T22:03:46.009334+0000","last_fullsized":"2024-04-25T22:03:46.009334+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:47.891133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"76'378","reported_seq":476,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.917927+0000","last_change":"2024-04-25T22:02:43.850869+0000","last_active":"2024-04-25T22:03:46.917927+0000","last_peered":"2024-04-25T22:03:46.917927+0000","last_clean":"2024-04-25T22:03:46.917927+0000","last_became_active":"2024-04-25T22:02:43.850568+0000","last_became_peered":"2024-04-25T22:02:43.850568+0000","last_unstale":"2024-04-25T22:03:46.917927+0000","last_undegraded":"2024-04-25T22:03:46.917927+0000","last_fullsized":"2024-04-25T22:03:46.917927+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:10:32.881419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14050,"num_write":362,"num_write_kb":58957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"76'188","reported_seq":266,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.009054+0000","last_change":"2024-04-25T22:02:43.853253+0000","last_active":"2024-04-25T22:03:46.009054+0000","last_peered":"2024-04-25T22:03:46.009054+0000","last_clean":"2024-04-25T22:03:46.009054+0000","last_became_active":"2024-04-25T22:02:43.852769+0000","last_became_peered":"2024-04-25T22:02:43.852769+0000","last_unstale":"2024-04-25T22:03:46.009054+0000","last_undegraded":"2024-04-25T22:03:46.009054+0000","last_fullsized":"2024-04-25T22:03:46.009054+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:51:36.457092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"76'390","reported_seq":486,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.908175+0000","last_change":"2024-04-25T22:02:43.852778+0000","last_active":"2024-04-25T22:03:46.908175+0000","last_peered":"2024-04-25T22:03:46.908175+0000","last_clean":"2024-04-25T22:03:46.908175+0000","last_became_active":"2024-04-25T22:02:43.852263+0000","last_became_peered":"2024-04-25T22:02:43.852263+0000","last_unstale":"2024-04-25T22:03:46.908175+0000","last_undegraded":"2024-04-25T22:03:46.908175+0000","last_fullsized":"2024-04-25T22:03:46.908175+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:10:40.487543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13280,"num_write":364,"num_write_kb":46108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"75'284","reported_seq":360,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.009987+0000","last_change":"2024-04-25T22:03:33.870087+0000","last_active":"2024-04-25T22:03:46.009987+0000","last_peered":"2024-04-25T22:03:46.009987+0000","last_clean":"2024-04-25T22:03:46.009987+0000","last_became_active":"2024-04-25T22:03:33.865557+0000","last_became_peered":"2024-04-25T22:03:33.865557+0000","last_unstale":"2024-04-25T22:03:46.009987+0000","last_undegraded":"2024-04-25T22:03:46.009987+0000","last_fullsized":"2024-04-25T22:03:46.009987+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:25:54.518550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":12398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"76'402","reported_seq":481,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.913528+0000","last_change":"2024-04-25T22:03:33.864136+0000","last_active":"2024-04-25T22:03:46.913528+0000","last_peered":"2024-04-25T22:03:46.913528+0000","last_clean":"2024-04-25T22:03:46.913528+0000","last_became_active":"2024-04-25T22:03:33.862435+0000","last_became_peered":"2024-04-25T22:03:33.862435+0000","last_unstale":"2024-04-25T22:03:46.913528+0000","last_undegraded":"2024-04-25T22:03:46.913528+0000","last_fullsized":"2024-04-25T22:03:46.913528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:08.119964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":1478,"num_write":377,"num_write_kb":34422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"76'127","reported_seq":258,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.861249+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:03:46.861249+0000","last_peered":"2024-04-25T22:03:46.861249+0000","last_clean":"2024-04-25T22:03:46.861249+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:03:46.861249+0000","last_undegraded":"2024-04-25T22:03:46.861249+0000","last_fullsized":"2024-04-25T22:03:46.861249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'438","reported_seq":616,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.889860+0000","last_change":"2024-04-25T22:01:14.653282+0000","last_active":"2024-04-25T22:03:46.889860+0000","last_peered":"2024-04-25T22:03:46.889860+0000","last_clean":"2024-04-25T22:03:46.889860+0000","last_became_active":"2024-04-25T22:01:14.652477+0000","last_became_peered":"2024-04-25T22:01:14.652477+0000","last_unstale":"2024-04-25T22:03:46.889860+0000","last_undegraded":"2024-04-25T22:03:46.889860+0000","last_fullsized":"2024-04-25T22:03:46.889860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31576,"num_write":414,"num_write_kb":70915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"75'46","reported_seq":177,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T22:03:46.008893+0000","last_change":"2024-04-25T22:01:13.633082+0000","last_active":"2024-04-25T22:03:46.008893+0000","last_peered":"2024-04-25T22:03:46.008893+0000","last_clean":"2024-04-25T22:03:46.008893+0000","last_became_active":"2024-04-25T22:01:13.631655+0000","last_became_peered":"2024-04-25T22:01:13.631655+0000","last_unstale":"2024-04-25T22:03:46.008893+0000","last_undegraded":"2024-04-25T22:03:46.008893+0000","last_fullsized":"2024-04-25T22:03:46.008893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:23.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2665,"num_read_kb":1338898,"num_write":24540,"num_write_kb":4276910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26145,"ondisk_log_size":26145,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127374912,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":4658,"num_write_kb":127827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":71483392,"data_stored":254669699,"data_compressed":21831095,"data_compressed_allocated":35295232,"data_compressed_original":218542080,"omap_allocated":0,"internal_metadata":0},"log_size":6443,"ondisk_log_size":6443,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738407,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99468,"kb_used_data":23936,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272372,"statfs":{"total":96636764160,"available":96534908928,"internally_reserved":0,"allocated":24510464,"data_stored":84777266,"data_compressed":7031744,"data_compressed_allocated":11419648,"data_compressed_original":72040448,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738406,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99180,"kb_used_data":23648,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272660,"statfs":{"total":96636764160,"available":96535203840,"internally_reserved":0,"allocated":24215552,"data_stored":81456553,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738407,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99700,"kb_used_data":24168,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272140,"statfs":{"total":96636764160,"available":96534671360,"internally_reserved":0,"allocated":24748032,"data_stored":90436383,"data_compressed":7814117,"data_compressed_allocated":12587008,"data_compressed_original":78639104,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24076288,"data_stored":89626176,"data_compressed":7811005,"data_compressed_allocated":12562432,"data_compressed_original":78143488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23584768,"data_stored":81156589,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23822336,"data_stored":83886934,"data_compressed":7023537,"data_compressed_allocated":11382784,"data_compressed_original":71467008,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:03:51.935 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T22:03:51.935 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:03:51.935 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2] 2024-04-25T22:03:51.935 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T22:03:51.935 INFO:teuthology.orchestra.console.smithi057:Power off 2024-04-25T22:03:51.935 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T22:03:51.959 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2024-04-25T22:03:51.960 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:03:51.985 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-04-25T22:03:52.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:52.012+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:52.017 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:52.017 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:52.031 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:52.043 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is set 2024-04-25T22:03:52.116 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:52.112+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:52.157 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:52.158 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:52.172 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:52.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:52.216+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:52.297 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:52.298 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:52.311 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:52.319 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:52.316+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:52.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:52.416+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:52.480 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:52.480 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:52.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:52.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:52.532+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:52.622 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:52.620+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:52.625 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:52.626 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:52.639 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:52.724 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:52.724+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:52.802 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:52.802 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:52.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:52.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:52.820+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:52.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:52.924+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:52.976 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:52.976 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:52.990 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:53.026 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:53.024+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:53.121 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:53.121 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:53.127 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:53.124+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:53.135 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:53.228 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:53.224+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:53.251 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:53.251 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:53.265 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:53.329 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:53.328+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:53.381 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:53.381 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:53.395 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:53.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:53.424+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:53.527 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:53.527 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:53.530 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:53.528+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:53.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:53.631 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:53.628+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:53.701 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:53.701 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:53.715 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:53.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:53.728+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:53.808 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:03:53.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:53.832+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:53.878 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-04-25T22:03:53.878 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:03:53.893 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:53.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:53.936+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:53.972 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0: {} 2024-04-25T22:03:53.972 INFO:teuthology.orchestra.run.smithi044.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:03:53.993 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1: {} 2024-04-25T22:03:53.993 INFO:teuthology.orchestra.run.smithi044.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:03:54.014 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2: {} 2024-04-25T22:03:54.014 INFO:teuthology.orchestra.run.smithi044.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:03:54.024 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:54.024 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:54.024 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:03:54.024 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:54.035 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:54.032+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:54.038 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:54.071 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:03:54.136 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:54.132+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:54.207 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:54.207 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:54.207 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:03:54.207 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:03:54.207 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:54.221 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:54.236 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:54.236+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:54.337 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:54.336+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:54.348 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:54.348 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:54.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:54.348 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:54.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.349 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:54.349 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:54.349 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 62.259115244, 2024-04-25T22:03:54.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:54.349 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.349 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.349 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.349 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.349 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.349 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.349 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:54.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.349 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:54.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:54.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:54.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:54.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:54.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:54.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:54.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:54.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:54.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:54.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:54.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:54.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:54.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:54.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:54.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:54.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:54.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:54.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:54.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:54.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:54.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:54.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:54.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:54.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:54.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:54.355 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.355 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.355 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.355 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:54.355 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:54.355 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 62.249114480999999, 2024-04-25T22:03:54.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:54.355 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.355 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.355 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.355 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.355 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.355 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.356 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:54.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.356 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:54.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:54.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:54.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:54.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:54.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:54.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:54.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:54.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:54.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:54.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:54.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:54.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:54.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:54.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:54.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:54.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:54.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:54.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:54.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:54.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:54.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:54.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:54.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:54.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:54.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:54.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:54.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:54.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:54.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:54.361 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.361 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.361 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.361 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:54.361 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:54.361 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 62.244950207000002, 2024-04-25T22:03:54.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:54.361 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.361 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.361 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.362 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.362 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.362 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.362 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:54.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.362 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:54.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:54.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:54.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:54.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:54.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:54.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:54.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:54.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:54.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:54.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:54.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:54.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:54.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:54.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:54.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:54.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:54.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:54.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:54.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:54.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:54.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:54.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:54.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:54.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:54.367 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.367 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.367 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.367 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:54.368 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:54.368 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 62.243353890000002, 2024-04-25T22:03:54.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:54.368 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.368 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.368 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.368 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.368 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.368 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.369 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:54.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.369 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:54.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:54.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:54.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:54.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:54.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:54.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:54.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:54.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:54.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:54.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:54.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:54.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:54.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:54.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:54.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:54.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:54.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:54.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:54.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:54.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:54.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:54.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:54.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:54.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:54.374 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.374 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.374 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.374 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:54.374 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:54.374 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 62.18656764, 2024-04-25T22:03:54.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:54.374 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.374 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.375 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.375 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.375 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.375 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.375 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:54.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.375 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:54.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:54.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:54.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:54.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:54.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:54.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:54.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:54.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:54.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:54.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:54.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:54.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:54.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:54.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:54.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:54.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:54.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:54.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:54.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:54.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:54.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:54.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:54.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:54.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:54.379 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.379 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.379 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.380 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:54.380 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:54.380 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 62.170923373999997, 2024-04-25T22:03:54.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:54.380 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.380 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.380 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.380 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.380 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.380 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.380 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:54.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.380 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:54.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:54.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:54.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:54.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:54.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:54.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:54.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:54.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:54.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:54.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:54.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:54.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:54.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:54.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:54.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:54.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:54.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:54.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:54.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:54.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:54.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:54.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:54.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:54.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:54.385 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.385 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.385 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.385 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:54.385 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:54.385 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 62.166084683000001, 2024-04-25T22:03:54.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:54.385 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.385 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.385 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.385 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.385 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.386 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.386 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:54.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.386 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:54.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:54.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:54.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:54.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:54.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:54.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:54.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:54.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:54.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:54.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:54.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:54.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:54.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:54.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:54.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:54.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:54.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:54.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:54.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:54.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:54.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:54.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:54.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:54.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:54.391 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.391 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.391 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.391 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10648 4.33 4:cc614d18:::100000030cb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:54.391 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:54.391 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 40.807481371999998, 2024-04-25T22:03:54.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13001143300000001, 2024-04-25T22:03:54.392 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.392 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.392 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.392 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.392 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.392 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.392 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10648 2024-04-25T22:03:54.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.392 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:54.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:54.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537181+0000", 2024-04-25T22:03:54.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.782e-06 2024-04-25T22:03:54.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541681+0000", 2024-04-25T22:03:54.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045008460000000002 2024-04-25T22:03:54.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541692+0000", 2024-04-25T22:03:54.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0726e-05 2024-04-25T22:03:54.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541698+0000", 2024-04-25T22:03:54.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-04-25T22:03:54.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541771+0000", 2024-04-25T22:03:54.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3070000000000003e-05 2024-04-25T22:03:54.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542021+0000", 2024-04-25T22:03:54.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025059799999999999 2024-04-25T22:03:54.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:54.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542246+0000", 2024-04-25T22:03:54.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022471000000000001 2024-04-25T22:03:54.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.579359+0000", 2024-04-25T22:03:54.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037113211 2024-04-25T22:03:54.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667067+0000", 2024-04-25T22:03:54.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087707255999999997 2024-04-25T22:03:54.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667134+0000", 2024-04-25T22:03:54.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7862999999999997e-05 2024-04-25T22:03:54.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667190+0000", 2024-04-25T22:03:54.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5698000000000001e-05 2024-04-25T22:03:54.396 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.396 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.397 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10651 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:54.397 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:54.397 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 40.747705594000003, 2024-04-25T22:03:54.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11324606800000001, 2024-04-25T22:03:54.397 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.397 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.397 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.397 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.397 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.397 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.397 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10651 2024-04-25T22:03:54.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.398 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:54.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:54.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596957+0000", 2024-04-25T22:03:54.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-04-25T22:03:54.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601272+0000", 2024-04-25T22:03:54.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004314834 2024-04-25T22:03:54.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601291+0000", 2024-04-25T22:03:54.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9380000000000001e-05 2024-04-25T22:03:54.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601302+0000", 2024-04-25T22:03:54.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0416e-05 2024-04-25T22:03:54.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.603978+0000", 2024-04-25T22:03:54.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026763109999999998 2024-04-25T22:03:54.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604327+0000", 2024-04-25T22:03:54.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034881099999999998 2024-04-25T22:03:54.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:54.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604571+0000", 2024-04-25T22:03:54.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024436100000000001 2024-04-25T22:03:54.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644439+0000", 2024-04-25T22:03:54.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039868270999999997 2024-04-25T22:03:54.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710091+0000", 2024-04-25T22:03:54.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.065651910999999993 2024-04-25T22:03:54.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710144+0000", 2024-04-25T22:03:54.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2444999999999997e-05 2024-04-25T22:03:54.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710201+0000", 2024-04-25T22:03:54.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6839999999999998e-05 2024-04-25T22:03:54.402 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.402 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.402 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.402 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10654 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:54.402 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:54.402 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 40.737878731000002, 2024-04-25T22:03:54.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.103958778, 2024-04-25T22:03:54.402 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.403 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.403 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.403 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.403 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.403 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.403 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10654 2024-04-25T22:03:54.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.403 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:54.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:54.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606782+0000", 2024-04-25T22:03:54.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1699999999999999e-07 2024-04-25T22:03:54.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611155+0000", 2024-04-25T22:03:54.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043728580000000003 2024-04-25T22:03:54.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611173+0000", 2024-04-25T22:03:54.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8267e-05 2024-04-25T22:03:54.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611183+0000", 2024-04-25T22:03:54.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9250000000000007e-06 2024-04-25T22:03:54.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644642+0000", 2024-04-25T22:03:54.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033458976000000001 2024-04-25T22:03:54.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644739+0000", 2024-04-25T22:03:54.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7189999999999996e-05 2024-04-25T22:03:54.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:54.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644864+0000", 2024-04-25T22:03:54.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000124867 2024-04-25T22:03:54.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.672556+0000", 2024-04-25T22:03:54.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027691653 2024-04-25T22:03:54.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710668+0000", 2024-04-25T22:03:54.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038111956000000002 2024-04-25T22:03:54.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710703+0000", 2024-04-25T22:03:54.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5577000000000002e-05 2024-04-25T22:03:54.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710740+0000", 2024-04-25T22:03:54.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7092000000000003e-05 2024-04-25T22:03:54.407 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.407 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.407 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.408 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11078 4.4 4:22be2a9e:::10000003224.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:54.408 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:54.408 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.340752109999997, 2024-04-25T22:03:54.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.112294177, 2024-04-25T22:03:54.408 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.408 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.408 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.408 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.408 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.408 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.408 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11078 2024-04-25T22:03:54.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.408 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:54.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:54.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003909+0000", 2024-04-25T22:03:54.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2750000000000001e-06 2024-04-25T22:03:54.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009939+0000", 2024-04-25T22:03:54.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060293309999999998 2024-04-25T22:03:54.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009961+0000", 2024-04-25T22:03:54.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1889999999999999e-05 2024-04-25T22:03:54.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009976+0000", 2024-04-25T22:03:54.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5642e-05 2024-04-25T22:03:54.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042803+0000", 2024-04-25T22:03:54.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032827299999999997 2024-04-25T22:03:54.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042911+0000", 2024-04-25T22:03:54.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107747 2024-04-25T22:03:54.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:54.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042990+0000", 2024-04-25T22:03:54.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8832999999999996e-05 2024-04-25T22:03:54.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.088710+0000", 2024-04-25T22:03:54.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045720129999999998 2024-04-25T22:03:54.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116108+0000", 2024-04-25T22:03:54.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027397388000000002 2024-04-25T22:03:54.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116164+0000", 2024-04-25T22:03:54.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6283000000000003e-05 2024-04-25T22:03:54.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116202+0000", 2024-04-25T22:03:54.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8358000000000001e-05 2024-04-25T22:03:54.414 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.414 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.414 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.415 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11195 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:54.415 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:54.415 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.127389993000001, 2024-04-25T22:03:54.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1095062, 2024-04-25T22:03:54.415 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.415 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.415 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.415 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.415 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.415 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.415 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11195 2024-04-25T22:03:54.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.415 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:54.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:54.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217272+0000", 2024-04-25T22:03:54.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.533e-06 2024-04-25T22:03:54.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217385+0000", 2024-04-25T22:03:54.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113533 2024-04-25T22:03:54.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217396+0000", 2024-04-25T22:03:54.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0682e-05 2024-04-25T22:03:54.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217402+0000", 2024-04-25T22:03:54.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:03:54.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238476+0000", 2024-04-25T22:03:54.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021073312 2024-04-25T22:03:54.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238558+0000", 2024-04-25T22:03:54.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2193000000000004e-05 2024-04-25T22:03:54.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:54.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238695+0000", 2024-04-25T22:03:54.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013737800000000001 2024-04-25T22:03:54.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292860+0000", 2024-04-25T22:03:54.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054165224999999997 2024-04-25T22:03:54.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326638+0000", 2024-04-25T22:03:54.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033777517999999999 2024-04-25T22:03:54.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326686+0000", 2024-04-25T22:03:54.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8062000000000002e-05 2024-04-25T22:03:54.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326776+0000", 2024-04-25T22:03:54.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0393e-05 2024-04-25T22:03:54.420 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.420 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.420 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.420 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11197 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3195543~33670] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:54.420 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:54.420 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.127248008999999, 2024-04-25T22:03:54.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953929499999999, 2024-04-25T22:03:54.420 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.420 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.420 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.420 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.421 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.421 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.421 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11197 2024-04-25T22:03:54.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.421 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:54.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:54.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217413+0000", 2024-04-25T22:03:54.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5600000000000005e-07 2024-04-25T22:03:54.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217445+0000", 2024-04-25T22:03:54.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2240999999999998e-05 2024-04-25T22:03:54.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217453+0000", 2024-04-25T22:03:54.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6070000000000002e-06 2024-04-25T22:03:54.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217458+0000", 2024-04-25T22:03:54.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3630000000000002e-06 2024-04-25T22:03:54.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240891+0000", 2024-04-25T22:03:54.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023432637999999999 2024-04-25T22:03:54.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240990+0000", 2024-04-25T22:03:54.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8995999999999999e-05 2024-04-25T22:03:54.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:54.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241123+0000", 2024-04-25T22:03:54.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013371699999999999 2024-04-25T22:03:54.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292866+0000", 2024-04-25T22:03:54.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051742332000000002 2024-04-25T22:03:54.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326849+0000", 2024-04-25T22:03:54.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033983140000000002 2024-04-25T22:03:54.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326908+0000", 2024-04-25T22:03:54.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8842999999999999e-05 2024-04-25T22:03:54.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326951+0000", 2024-04-25T22:03:54.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3761999999999999e-05 2024-04-25T22:03:54.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.425 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.425 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11198 4.4 4:22c4fea3:::10000003262.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:54.425 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:54.426 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.127193650000002, 2024-04-25T22:03:54.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12381273600000001, 2024-04-25T22:03:54.426 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.426 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.426 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.426 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.426 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.426 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.426 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11198 2024-04-25T22:03:54.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.426 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:54.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:54.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217467+0000", 2024-04-25T22:03:54.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4499999999999997e-07 2024-04-25T22:03:54.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225449+0000", 2024-04-25T22:03:54.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079819439999999995 2024-04-25T22:03:54.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225466+0000", 2024-04-25T22:03:54.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6602000000000001e-05 2024-04-25T22:03:54.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225477+0000", 2024-04-25T22:03:54.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1603000000000001e-05 2024-04-25T22:03:54.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240866+0000", 2024-04-25T22:03:54.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015388389000000001 2024-04-25T22:03:54.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241081+0000", 2024-04-25T22:03:54.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021577400000000001 2024-04-25T22:03:54.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:54.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241212+0000", 2024-04-25T22:03:54.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013073499999999999 2024-04-25T22:03:54.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292876+0000", 2024-04-25T22:03:54.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051663584999999998 2024-04-25T22:03:54.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341159+0000", 2024-04-25T22:03:54.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048283421999999999 2024-04-25T22:03:54.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341222+0000", 2024-04-25T22:03:54.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:03:54.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341279+0000", 2024-04-25T22:03:54.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6780999999999997e-05 2024-04-25T22:03:54.432 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.432 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.433 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11207 4.4 4:233f6309:::10000003211.00000000:head [write 659836~128648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:54.433 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:54.433 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.110575652999998, 2024-04-25T22:03:54.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10732727, 2024-04-25T22:03:54.433 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.433 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.434 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.434 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.434 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.434 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.434 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11207 2024-04-25T22:03:54.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.434 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:54.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:54.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234085+0000", 2024-04-25T22:03:54.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0399999999999995e-07 2024-04-25T22:03:54.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234550+0000", 2024-04-25T22:03:54.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000464909 2024-04-25T22:03:54.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234561+0000", 2024-04-25T22:03:54.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0744000000000001e-05 2024-04-25T22:03:54.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234569+0000", 2024-04-25T22:03:54.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6890000000000004e-06 2024-04-25T22:03:54.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267197+0000", 2024-04-25T22:03:54.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032628182999999998 2024-04-25T22:03:54.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267297+0000", 2024-04-25T22:03:54.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100222 2024-04-25T22:03:54.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:54.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267393+0000", 2024-04-25T22:03:54.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6275999999999998e-05 2024-04-25T22:03:54.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292880+0000", 2024-04-25T22:03:54.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025487058999999999 2024-04-25T22:03:54.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341326+0000", 2024-04-25T22:03:54.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048446031000000001 2024-04-25T22:03:54.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341374+0000", 2024-04-25T22:03:54.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7632000000000001e-05 2024-04-25T22:03:54.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341412+0000", 2024-04-25T22:03:54.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7821000000000003e-05 2024-04-25T22:03:54.439 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.439 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.439 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.439 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11219 4.4 4:210cd53e:::100000031ff.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:54.439 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:54.439 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.091626443000003, 2024-04-25T22:03:54.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13181403, 2024-04-25T22:03:54.439 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.439 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.439 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.439 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.439 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.439 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.440 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11219 2024-04-25T22:03:54.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.440 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:54.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:54.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253035+0000", 2024-04-25T22:03:54.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.322e-06 2024-04-25T22:03:54.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258145+0000", 2024-04-25T22:03:54.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051095669999999998 2024-04-25T22:03:54.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258163+0000", 2024-04-25T22:03:54.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8377999999999999e-05 2024-04-25T22:03:54.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258174+0000", 2024-04-25T22:03:54.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0925e-05 2024-04-25T22:03:54.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270495+0000", 2024-04-25T22:03:54.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012321354 2024-04-25T22:03:54.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270581+0000", 2024-04-25T22:03:54.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5741999999999993e-05 2024-04-25T22:03:54.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:54.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270717+0000", 2024-04-25T22:03:54.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013571500000000001 2024-04-25T22:03:54.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326599+0000", 2024-04-25T22:03:54.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055882026000000001 2024-04-25T22:03:54.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384753+0000", 2024-04-25T22:03:54.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058154527999999997 2024-04-25T22:03:54.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384805+0000", 2024-04-25T22:03:54.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1592999999999999e-05 2024-04-25T22:03:54.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384848+0000", 2024-04-25T22:03:54.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2880000000000003e-05 2024-04-25T22:03:54.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.444 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.444 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11868 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:54.444 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:54.444 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.132662619000001, 2024-04-25T22:03:54.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12149908700000001, 2024-04-25T22:03:54.445 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.445 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.445 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.445 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.445 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.445 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.445 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11868 2024-04-25T22:03:54.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.445 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:54.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:54.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211999+0000", 2024-04-25T22:03:54.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:03:54.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219614+0000", 2024-04-25T22:03:54.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076153490000000004 2024-04-25T22:03:54.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219628+0000", 2024-04-25T22:03:54.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3597e-05 2024-04-25T22:03:54.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219635+0000", 2024-04-25T22:03:54.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7759999999999997e-06 2024-04-25T22:03:54.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229908+0000", 2024-04-25T22:03:54.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010272478 2024-04-25T22:03:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229966+0000", 2024-04-25T22:03:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8495000000000002e-05 2024-04-25T22:03:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.230082+0000", 2024-04-25T22:03:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011560799999999999 2024-04-25T22:03:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257530+0000", 2024-04-25T22:03:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027448034999999999 2024-04-25T22:03:54.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333408+0000", 2024-04-25T22:03:54.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075878105000000001 2024-04-25T22:03:54.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333457+0000", 2024-04-25T22:03:54.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8757000000000001e-05 2024-04-25T22:03:54.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333497+0000", 2024-04-25T22:03:54.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9721000000000001e-05 2024-04-25T22:03:54.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.450 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.450 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11870 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 4063232~131072] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:54.450 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:54.450 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.125008264999998, 2024-04-25T22:03:54.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.114017408, 2024-04-25T22:03:54.450 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.450 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.450 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.450 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.450 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.450 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.451 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11870 2024-04-25T22:03:54.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.451 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:54.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:54.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219653+0000", 2024-04-25T22:03:54.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6139999999999999e-06 2024-04-25T22:03:54.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219722+0000", 2024-04-25T22:03:54.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8460000000000005e-05 2024-04-25T22:03:54.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219730+0000", 2024-04-25T22:03:54.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3420000000000008e-06 2024-04-25T22:03:54.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219736+0000", 2024-04-25T22:03:54.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9619999999999998e-06 2024-04-25T22:03:54.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247743+0000", 2024-04-25T22:03:54.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028006400000000001 2024-04-25T22:03:54.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247847+0000", 2024-04-25T22:03:54.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104017 2024-04-25T22:03:54.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:54.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247984+0000", 2024-04-25T22:03:54.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013701800000000001 2024-04-25T22:03:54.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257536+0000", 2024-04-25T22:03:54.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095520050000000006 2024-04-25T22:03:54.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333565+0000", 2024-04-25T22:03:54.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076029154000000002 2024-04-25T22:03:54.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333628+0000", 2024-04-25T22:03:54.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2853000000000003e-05 2024-04-25T22:03:54.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333669+0000", 2024-04-25T22:03:54.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1582999999999998e-05 2024-04-25T22:03:54.455 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.456 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.456 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.456 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11871 4.37 4:ee924968:::10000003393.00000000:head [write 2359296~1835008] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:54.456 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:54.456 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.124915332999997, 2024-04-25T22:03:54.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.113885236, 2024-04-25T22:03:54.456 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.457 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.457 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.457 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.457 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.457 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.457 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11871 2024-04-25T22:03:54.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.457 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:54.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:54.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:54.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6100000000000001e-07 2024-04-25T22:03:54.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222469+0000", 2024-04-25T22:03:54.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027240060000000002 2024-04-25T22:03:54.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222482+0000", 2024-04-25T22:03:54.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3049e-05 2024-04-25T22:03:54.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222492+0000", 2024-04-25T22:03:54.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8020000000000003e-06 2024-04-25T22:03:54.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247903+0000", 2024-04-25T22:03:54.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025410578999999999 2024-04-25T22:03:54.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247962+0000", 2024-04-25T22:03:54.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9363000000000001e-05 2024-04-25T22:03:54.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:54.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.248049+0000", 2024-04-25T22:03:54.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6803000000000002e-05 2024-04-25T22:03:54.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257915+0000", 2024-04-25T22:03:54.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0098655730000000007 2024-04-25T22:03:54.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333544+0000", 2024-04-25T22:03:54.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075629030999999999 2024-04-25T22:03:54.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333594+0000", 2024-04-25T22:03:54.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0291999999999999e-05 2024-04-25T22:03:54.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333630+0000", 2024-04-25T22:03:54.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6177000000000003e-05 2024-04-25T22:03:54.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.464 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.464 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:15375 4.4 4:211dd80e:::10000003351.00000000:head [write 0~4194304 [2@1354921]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:54.464 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:54.465 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.207585941000001, 2024-04-25T22:03:54.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953555500000001, 2024-04-25T22:03:54.465 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:54.465 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:54.465 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:54.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:54.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:54.465 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-04-25T22:03:54.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.465 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:54.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:54.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:54.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:54.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:54.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:54.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:54.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137076+0000", 2024-04-25T22:03:54.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.683e-06 2024-04-25T22:03:54.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:54.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142168+0000", 2024-04-25T22:03:54.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050917280000000002 2024-04-25T22:03:54.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:54.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142192+0000", 2024-04-25T22:03:54.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:03:54.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142206+0000", 2024-04-25T22:03:54.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.396e-05 2024-04-25T22:03:54.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:54.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142280+0000", 2024-04-25T22:03:54.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4369000000000006e-05 2024-04-25T22:03:54.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:54.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142346+0000", 2024-04-25T22:03:54.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5957000000000006e-05 2024-04-25T22:03:54.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:54.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142440+0000", 2024-04-25T22:03:54.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3888999999999995e-05 2024-04-25T22:03:54.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.208451+0000", 2024-04-25T22:03:54.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066011350999999996 2024-04-25T22:03:54.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:54.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246473+0000", 2024-04-25T22:03:54.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038021428000000003 2024-04-25T22:03:54.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:54.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246530+0000", 2024-04-25T22:03:54.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7466000000000002e-05 2024-04-25T22:03:54.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:54.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:54.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:54.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246610+0000", 2024-04-25T22:03:54.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9484e-05 2024-04-25T22:03:54.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.469 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.470 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.470 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:54.470 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:54.470 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:54.471 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:54.472 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:54.468+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:54.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:54.572+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:54.603 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:54.603 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:54.603 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:03:54.603 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:54.617 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:54.673 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:54.672+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:54.739 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:54.740 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:54.740 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:03:54.740 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:03:54.740 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:54.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:54.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:54.772+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:54.874 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:54.872+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:54.922 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-04-25T22:03:54.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:03:54.922 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T22:03:54.924 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:54.924 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:03:54.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:03:54.924 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:54.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.924 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7039 4.8 4:1138358d:::100000013f3.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:54.925 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:54.925 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.087571916999998, 2024-04-25T22:03:54.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.034656746, 2024-04-25T22:03:54.925 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:54.925 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:54.925 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:54.925 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:54.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:54.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:54.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:54.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:54.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:54.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831791+0000", 2024-04-25T22:03:54.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6359999999999998e-06 2024-04-25T22:03:54.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:54.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831801+0000", 2024-04-25T22:03:54.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0567000000000001e-05 2024-04-25T22:03:54.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:54.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831824+0000", 2024-04-25T22:03:54.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:03:54.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831839+0000", 2024-04-25T22:03:54.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5345999999999998e-05 2024-04-25T22:03:54.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832028+0000", 2024-04-25T22:03:54.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018899800000000001 2024-04-25T22:03:54.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:54.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832043+0000", 2024-04-25T22:03:54.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4805e-05 2024-04-25T22:03:54.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836259+0000", 2024-04-25T22:03:54.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042161819999999997 2024-04-25T22:03:54.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:54.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836422+0000", 2024-04-25T22:03:54.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000162404 2024-04-25T22:03:54.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.865428+0000", 2024-04-25T22:03:54.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0290065770000001 2024-04-25T22:03:54.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:54.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866445+0000", 2024-04-25T22:03:54.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001016561 2024-04-25T22:03:54.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.929 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:54.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.929 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7040 4.8 4:121f992c:::100000013f4.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:54.929 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:54.929 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.087482993999998, 2024-04-25T22:03:54.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0348302300000001, 2024-04-25T22:03:54.930 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:54.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:54.930 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:54.930 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:54.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:54.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:54.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:54.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:54.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:54.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831878+0000", 2024-04-25T22:03:54.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3659999999999999e-06 2024-04-25T22:03:54.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:54.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831885+0000", 2024-04-25T22:03:54.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7139999999999996e-06 2024-04-25T22:03:54.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:54.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831901+0000", 2024-04-25T22:03:54.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5982999999999999e-05 2024-04-25T22:03:54.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831910+0000", 2024-04-25T22:03:54.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7530000000000007e-06 2024-04-25T22:03:54.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832133+0000", 2024-04-25T22:03:54.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022307199999999999 2024-04-25T22:03:54.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:54.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832141+0000", 2024-04-25T22:03:54.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0080000000000002e-06 2024-04-25T22:03:54.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836611+0000", 2024-04-25T22:03:54.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044698389999999998 2024-04-25T22:03:54.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:54.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836629+0000", 2024-04-25T22:03:54.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8397e-05 2024-04-25T22:03:54.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866532+0000", 2024-04-25T22:03:54.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0299026200000001 2024-04-25T22:03:54.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:54.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866707+0000", 2024-04-25T22:03:54.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017547799999999999 2024-04-25T22:03:54.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.934 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:54.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.934 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7051 4.36 4:6e19a085:::100000013ff.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:54.934 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:54.934 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.087430215000001, 2024-04-25T22:03:54.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.032211298, 2024-04-25T22:03:54.935 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:54.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:54.935 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:54.935 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:54.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:54.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:54.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:54.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:54.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831931+0000", 2024-04-25T22:03:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.19e-06 2024-04-25T22:03:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831936+0000", 2024-04-25T22:03:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2059999999999998e-06 2024-04-25T22:03:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831950+0000", 2024-04-25T22:03:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3424000000000001e-05 2024-04-25T22:03:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831958+0000", 2024-04-25T22:03:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1659999999999994e-06 2024-04-25T22:03:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832033+0000", 2024-04-25T22:03:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4977999999999999e-05 2024-04-25T22:03:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832043+0000", 2024-04-25T22:03:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0268999999999999e-05 2024-04-25T22:03:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841105+0000", 2024-04-25T22:03:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090619829999999991 2024-04-25T22:03:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841118+0000", 2024-04-25T22:03:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2737e-05 2024-04-25T22:03:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.863240+0000", 2024-04-25T22:03:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0221224259999999 2024-04-25T22:03:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.864141+0000", 2024-04-25T22:03:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090091900000000003 2024-04-25T22:03:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7059 4.22 4:47c8979f:::10000001407.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.087379075000001, 2024-04-25T22:03:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0438401859999999, 2024-04-25T22:03:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831982+0000", 2024-04-25T22:03:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1030000000000001e-06 2024-04-25T22:03:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:54.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831987+0000", 2024-04-25T22:03:54.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-04-25T22:03:54.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:54.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832007+0000", 2024-04-25T22:03:54.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0126999999999999e-05 2024-04-25T22:03:54.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832022+0000", 2024-04-25T22:03:54.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4878999999999999e-05 2024-04-25T22:03:54.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832082+0000", 2024-04-25T22:03:54.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9552999999999997e-05 2024-04-25T22:03:54.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:54.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832088+0000", 2024-04-25T22:03:54.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9320000000000001e-06 2024-04-25T22:03:54.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836708+0000", 2024-04-25T22:03:54.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046199240000000001 2024-04-25T22:03:54.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:54.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836717+0000", 2024-04-25T22:03:54.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1840000000000005e-06 2024-04-25T22:03:54.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875475+0000", 2024-04-25T22:03:54.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0387584439999999 2024-04-25T22:03:54.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:54.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875821+0000", 2024-04-25T22:03:54.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00034578700000000001 2024-04-25T22:03:54.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.944 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:54.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.944 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7063 4.2 4:4331e060:::100000014df.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:54.944 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:54.944 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.087316286, 2024-04-25T22:03:54.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.047605189, 2024-04-25T22:03:54.944 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:54.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:54.944 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.944 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:54.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:54.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:54.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:54.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:54.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:54.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832045+0000", 2024-04-25T22:03:54.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:03:54.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:54.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832088+0000", 2024-04-25T22:03:54.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2483e-05 2024-04-25T22:03:54.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:54.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832100+0000", 2024-04-25T22:03:54.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2713e-05 2024-04-25T22:03:54.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832111+0000", 2024-04-25T22:03:54.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0457e-05 2024-04-25T22:03:54.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832155+0000", 2024-04-25T22:03:54.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4468999999999997e-05 2024-04-25T22:03:54.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:54.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832161+0000", 2024-04-25T22:03:54.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3369999999999999e-06 2024-04-25T22:03:54.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836779+0000", 2024-04-25T22:03:54.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046185030000000004 2024-04-25T22:03:54.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:54.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836787+0000", 2024-04-25T22:03:54.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5820000000000004e-06 2024-04-25T22:03:54.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.868721+0000", 2024-04-25T22:03:54.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0319339300000001 2024-04-25T22:03:54.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:54.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869179+0000", 2024-04-25T22:03:54.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000457916 2024-04-25T22:03:54.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:54.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869486+0000", 2024-04-25T22:03:54.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030764099999999999 2024-04-25T22:03:54.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:54.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879230+0000", 2024-04-25T22:03:54.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097433620000000002 2024-04-25T22:03:54.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879288+0000", 2024-04-25T22:03:54.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8813000000000001e-05 2024-04-25T22:03:54.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:54.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879542+0000", 2024-04-25T22:03:54.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025326999999999999 2024-04-25T22:03:54.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:54.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879649+0000", 2024-04-25T22:03:54.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107173 2024-04-25T22:03:54.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.951 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:54.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.951 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7068 4.33 4:cf543130:::100000014e4.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:54.951 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:54.951 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.087230594000001, 2024-04-25T22:03:54.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.044127671, 2024-04-25T22:03:54.951 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:54.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:54.952 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.952 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:54.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:54.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:54.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:54.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:54.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:54.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832131+0000", 2024-04-25T22:03:54.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:03:54.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:54.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832137+0000", 2024-04-25T22:03:54.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9859999999999999e-06 2024-04-25T22:03:54.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:54.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832155+0000", 2024-04-25T22:03:54.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8090000000000001e-05 2024-04-25T22:03:54.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832166+0000", 2024-04-25T22:03:54.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1776999999999999e-05 2024-04-25T22:03:54.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832235+0000", 2024-04-25T22:03:54.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8614000000000004e-05 2024-04-25T22:03:54.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:54.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832243+0000", 2024-04-25T22:03:54.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2719999999999997e-06 2024-04-25T22:03:54.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.834656+0000", 2024-04-25T22:03:54.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024123489999999998 2024-04-25T22:03:54.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:54.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.834666+0000", 2024-04-25T22:03:54.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8819999999999996e-06 2024-04-25T22:03:54.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.860770+0000", 2024-04-25T22:03:54.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.026104414 2024-04-25T22:03:54.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:54.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861849+0000", 2024-04-25T22:03:54.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010794559999999999 2024-04-25T22:03:54.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:54.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.865487+0000", 2024-04-25T22:03:54.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036373270000000001 2024-04-25T22:03:54.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869323+0000", 2024-04-25T22:03:54.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038362259999999999 2024-04-25T22:03:54.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:54.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876012+0000", 2024-04-25T22:03:54.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066894290000000002 2024-04-25T22:03:54.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:54.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876154+0000", 2024-04-25T22:03:54.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000141963 2024-04-25T22:03:54.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:54.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876257+0000", 2024-04-25T22:03:54.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102662 2024-04-25T22:03:54.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.958 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:54.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.958 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7069 4.36 4:6d2d0624:::100000014e5.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:54.958 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:54.958 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.087177836999999, 2024-04-25T22:03:54.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0457444709999999, 2024-04-25T22:03:54.958 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:54.958 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:54.958 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.958 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:54.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:54.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:54.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:54.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:54.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:54.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832183+0000", 2024-04-25T22:03:54.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1459999999999999e-06 2024-04-25T22:03:54.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:54.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832189+0000", 2024-04-25T22:03:54.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.614e-06 2024-04-25T22:03:54.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:54.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832206+0000", 2024-04-25T22:03:54.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.683e-05 2024-04-25T22:03:54.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832218+0000", 2024-04-25T22:03:54.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2266000000000001e-05 2024-04-25T22:03:54.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832265+0000", 2024-04-25T22:03:54.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7138999999999997e-05 2024-04-25T22:03:54.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:54.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832271+0000", 2024-04-25T22:03:54.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4280000000000004e-06 2024-04-25T22:03:54.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841149+0000", 2024-04-25T22:03:54.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088781429999999998 2024-04-25T22:03:54.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:54.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841158+0000", 2024-04-25T22:03:54.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7359999999999996e-06 2024-04-25T22:03:54.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867956+0000", 2024-04-25T22:03:54.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0267976969999999 2024-04-25T22:03:54.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:54.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.868991+0000", 2024-04-25T22:03:54.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010344810000000001 2024-04-25T22:03:54.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:54.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869248+0000", 2024-04-25T22:03:54.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025746699999999999 2024-04-25T22:03:54.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872721+0000", 2024-04-25T22:03:54.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034729959999999999 2024-04-25T22:03:54.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:54.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877064+0000", 2024-04-25T22:03:54.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043432770000000004 2024-04-25T22:03:54.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:54.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877767+0000", 2024-04-25T22:03:54.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070237700000000001 2024-04-25T22:03:54.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:54.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877927+0000", 2024-04-25T22:03:54.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015987400000000001 2024-04-25T22:03:54.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.966 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:54.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.966 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7071 4.22 4:45120e82:::100000014e7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:54.966 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:54.966 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.087124398, 2024-04-25T22:03:54.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.050578969, 2024-04-25T22:03:54.966 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:54.966 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:54.966 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.966 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:54.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:54.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:54.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:54.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:54.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:54.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832237+0000", 2024-04-25T22:03:54.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.003e-06 2024-04-25T22:03:54.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:54.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832243+0000", 2024-04-25T22:03:54.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-04-25T22:03:54.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:54.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832263+0000", 2024-04-25T22:03:54.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0066999999999999e-05 2024-04-25T22:03:54.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832293+0000", 2024-04-25T22:03:54.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9802999999999999e-05 2024-04-25T22:03:54.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832416+0000", 2024-04-25T22:03:54.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123566 2024-04-25T22:03:54.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:54.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832438+0000", 2024-04-25T22:03:54.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1433e-05 2024-04-25T22:03:54.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836745+0000", 2024-04-25T22:03:54.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043070260000000003 2024-04-25T22:03:54.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:54.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836752+0000", 2024-04-25T22:03:54.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2060000000000001e-06 2024-04-25T22:03:54.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875897+0000", 2024-04-25T22:03:54.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0391448489999999 2024-04-25T22:03:54.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:54.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876238+0000", 2024-04-25T22:03:54.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00034159400000000002 2024-04-25T22:03:54.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:54.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876491+0000", 2024-04-25T22:03:54.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025221500000000002 2024-04-25T22:03:54.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:54.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881289+0000", 2024-04-25T22:03:54.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047986510000000001 2024-04-25T22:03:54.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882627+0000", 2024-04-25T22:03:54.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013376340000000001 2024-04-25T22:03:54.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:54.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882707+0000", 2024-04-25T22:03:54.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0037000000000006e-05 2024-04-25T22:03:54.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:54.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882815+0000", 2024-04-25T22:03:54.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107645 2024-04-25T22:03:54.975 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.975 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:54.975 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.975 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7073 4.14 4:2af683fb:::100000014e9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:54.975 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:54.975 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.087043805, 2024-04-25T22:03:54.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.043944475, 2024-04-25T22:03:54.976 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:54.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:54.976 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.976 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:54.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:54.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:54.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:54.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:54.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:54.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832318+0000", 2024-04-25T22:03:54.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:03:54.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:54.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832323+0000", 2024-04-25T22:03:54.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6099999999999997e-06 2024-04-25T22:03:54.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:54.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832345+0000", 2024-04-25T22:03:54.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1353e-05 2024-04-25T22:03:54.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832390+0000", 2024-04-25T22:03:54.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5543000000000001e-05 2024-04-25T22:03:54.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832469+0000", 2024-04-25T22:03:54.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8770999999999995e-05 2024-04-25T22:03:54.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:54.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832475+0000", 2024-04-25T22:03:54.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0970000000000002e-06 2024-04-25T22:03:54.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843177+0000", 2024-04-25T22:03:54.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010702237999999999 2024-04-25T22:03:54.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:54.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843185+0000", 2024-04-25T22:03:54.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8490000000000006e-06 2024-04-25T22:03:54.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861478+0000", 2024-04-25T22:03:54.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.018292915 2024-04-25T22:03:54.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:54.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861880+0000", 2024-04-25T22:03:54.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00040182599999999998 2024-04-25T22:03:54.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:54.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862137+0000", 2024-04-25T22:03:54.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025741099999999998 2024-04-25T22:03:54.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866967+0000", 2024-04-25T22:03:54.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048298669999999998 2024-04-25T22:03:54.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:54.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875991+0000", 2024-04-25T22:03:54.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090235609999999994 2024-04-25T22:03:54.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:54.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876162+0000", 2024-04-25T22:03:54.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017075900000000001 2024-04-25T22:03:54.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:54.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876261+0000", 2024-04-25T22:03:54.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9072000000000003e-05 2024-04-25T22:03:54.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.982 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:54.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.982 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7077 4.27 4:e57158de:::100000014ed.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:54.982 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:54.982 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.086919529999999, 2024-04-25T22:03:54.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0562571009999999, 2024-04-25T22:03:54.982 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:54.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:54.982 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.983 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:54.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:54.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:54.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:54.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:54.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:54.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832442+0000", 2024-04-25T22:03:54.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.274e-06 2024-04-25T22:03:54.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:54.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832448+0000", 2024-04-25T22:03:54.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-04-25T22:03:54.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:54.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832466+0000", 2024-04-25T22:03:54.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7549000000000001e-05 2024-04-25T22:03:54.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832474+0000", 2024-04-25T22:03:54.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.337e-06 2024-04-25T22:03:54.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832545+0000", 2024-04-25T22:03:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0986000000000001e-05 2024-04-25T22:03:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832554+0000", 2024-04-25T22:03:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2269999999999999e-06 2024-04-25T22:03:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843167+0000", 2024-04-25T22:03:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010613058 2024-04-25T22:03:54.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843176+0000", 2024-04-25T22:03:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8629999999999997e-06 2024-04-25T22:03:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878195+0000", 2024-04-25T22:03:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0350192650000001 2024-04-25T22:03:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878952+0000", 2024-04-25T22:03:54.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00075638400000000003 2024-04-25T22:03:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879100+0000", 2024-04-25T22:03:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014883600000000001 2024-04-25T22:03:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.883699+0000", 2024-04-25T22:03:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045986880000000001 2024-04-25T22:03:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888487+0000", 2024-04-25T22:03:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047874670000000001 2024-04-25T22:03:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888603+0000", 2024-04-25T22:03:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011671900000000001 2024-04-25T22:03:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888698+0000", 2024-04-25T22:03:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4208000000000003e-05 2024-04-25T22:03:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7085 4.1f 4:f9b21afd:::10000001591.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.082854978, 2024-04-25T22:03:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0439952969999999, 2024-04-25T22:03:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836507+0000", 2024-04-25T22:03:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.17e-06 2024-04-25T22:03:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836517+0000", 2024-04-25T22:03:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9019999999999994e-06 2024-04-25T22:03:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836603+0000", 2024-04-25T22:03:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6248999999999994e-05 2024-04-25T22:03:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836614+0000", 2024-04-25T22:03:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0322e-05 2024-04-25T22:03:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841790+0000", 2024-04-25T22:03:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051763929999999996 2024-04-25T22:03:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841803+0000", 2024-04-25T22:03:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3023999999999999e-05 2024-04-25T22:03:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.870557+0000", 2024-04-25T22:03:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.02875396 2024-04-25T22:03:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872184+0000", 2024-04-25T22:03:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016268019999999999 2024-04-25T22:03:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872435+0000", 2024-04-25T22:03:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025088399999999999 2024-04-25T22:03:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879983+0000", 2024-04-25T22:03:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0075479379999999997 2024-04-25T22:03:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880150+0000", 2024-04-25T22:03:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016698900000000001 2024-04-25T22:03:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:54.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880300+0000", 2024-04-25T22:03:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000150789 2024-04-25T22:03:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880500+0000", 2024-04-25T22:03:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019987499999999999 2024-04-25T22:03:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7086 4.9 4:91594555:::10000001592.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:54.994 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.08272728, 2024-04-25T22:03:54.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0331164559999999, 2024-04-25T22:03:54.995 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:54.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:54.995 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:54.995 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:54.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:54.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836634+0000", 2024-04-25T22:03:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1510000000000001e-06 2024-04-25T22:03:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:54.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836638+0000", 2024-04-25T22:03:54.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9740000000000004e-06 2024-04-25T22:03:54.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:54.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836647+0000", 2024-04-25T22:03:54.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1269999999999992e-06 2024-04-25T22:03:54.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:54.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:54.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836653+0000", 2024-04-25T22:03:54.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8900000000000004e-06 2024-04-25T22:03:54.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:54.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841540+0000", 2024-04-25T22:03:55.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048869719999999998 2024-04-25T22:03:55.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:55.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841550+0000", 2024-04-25T22:03:55.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0644e-05 2024-04-25T22:03:55.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.857739+0000", 2024-04-25T22:03:55.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.016188589 2024-04-25T22:03:55.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:55.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.858099+0000", 2024-04-25T22:03:55.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036013100000000003 2024-04-25T22:03:55.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:55.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.858328+0000", 2024-04-25T22:03:55.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000228941 2024-04-25T22:03:55.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:55.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.864635+0000", 2024-04-25T22:03:55.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063073199999999999 2024-04-25T22:03:55.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869508+0000", 2024-04-25T22:03:55.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048727220000000003 2024-04-25T22:03:55.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:55.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869648+0000", 2024-04-25T22:03:55.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000140152 2024-04-25T22:03:55.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:55.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869749+0000", 2024-04-25T22:03:55.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100843 2024-04-25T22:03:55.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.005 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:55.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.005 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7096 4.9 4:90f65572:::100000016d2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:55.005 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:55.006 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.073533231999999, 2024-04-25T22:03:55.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0364832260000001, 2024-04-25T22:03:55.006 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:55.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:55.006 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.006 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:55.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:55.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:55.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:55.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:55.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:55.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845828+0000", 2024-04-25T22:03:55.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5199999999999995e-07 2024-04-25T22:03:55.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:55.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845834+0000", 2024-04-25T22:03:55.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4710000000000004e-06 2024-04-25T22:03:55.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:55.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845843+0000", 2024-04-25T22:03:55.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6119999999999999e-06 2024-04-25T22:03:55.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845848+0000", 2024-04-25T22:03:55.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8280000000000002e-06 2024-04-25T22:03:55.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845891+0000", 2024-04-25T22:03:55.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3234e-05 2024-04-25T22:03:55.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:55.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845898+0000", 2024-04-25T22:03:55.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3839999999999999e-06 2024-04-25T22:03:55.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.873643+0000", 2024-04-25T22:03:55.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.027745162 2024-04-25T22:03:55.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:55.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.873907+0000", 2024-04-25T22:03:55.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026328000000000001 2024-04-25T22:03:55.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:55.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.874143+0000", 2024-04-25T22:03:55.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023613799999999999 2024-04-25T22:03:55.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878861+0000", 2024-04-25T22:03:55.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047185710000000004 2024-04-25T22:03:55.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:55.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880222+0000", 2024-04-25T22:03:55.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001360984 2024-04-25T22:03:55.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:55.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880647+0000", 2024-04-25T22:03:55.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042470799999999999 2024-04-25T22:03:55.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:55.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882310+0000", 2024-04-25T22:03:55.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001662902 2024-04-25T22:03:55.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.011 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:55.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.011 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7098 3.9 3:9359a9e9:::100000016e0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:55.011 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:55.011 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.072930146000001, 2024-04-25T22:03:55.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.034065142, 2024-04-25T22:03:55.011 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:55.012 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:55.012 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:55.012 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:55.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:55.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:55.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:55.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:55.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:55.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846432+0000", 2024-04-25T22:03:55.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.88e-06 2024-04-25T22:03:55.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:55.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846440+0000", 2024-04-25T22:03:55.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7120000000000006e-06 2024-04-25T22:03:55.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:55.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846463+0000", 2024-04-25T22:03:55.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2416e-05 2024-04-25T22:03:55.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846479+0000", 2024-04-25T22:03:55.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6484999999999999e-05 2024-04-25T22:03:55.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846718+0000", 2024-04-25T22:03:55.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023839299999999999 2024-04-25T22:03:55.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:55.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846729+0000", 2024-04-25T22:03:55.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0896999999999999e-05 2024-04-25T22:03:55.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872537+0000", 2024-04-25T22:03:55.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0258087 2024-04-25T22:03:55.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:55.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872831+0000", 2024-04-25T22:03:55.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029391399999999999 2024-04-25T22:03:55.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:55.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880495+0000", 2024-04-25T22:03:55.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0076637449999999996 2024-04-25T22:03:55.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.016 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:55.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.016 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7100 4.1 4:83bc2484:::100000016e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:55.016 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:55.016 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.071877016999998, 2024-04-25T22:03:55.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.03260128, 2024-04-25T22:03:55.016 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:55.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:55.016 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.017 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:55.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:55.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:55.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:55.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:55.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:55.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847484+0000", 2024-04-25T22:03:55.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.443e-06 2024-04-25T22:03:55.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:55.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847491+0000", 2024-04-25T22:03:55.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4300000000000003e-06 2024-04-25T22:03:55.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:55.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847505+0000", 2024-04-25T22:03:55.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4014e-05 2024-04-25T22:03:55.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847514+0000", 2024-04-25T22:03:55.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4350000000000003e-06 2024-04-25T22:03:55.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847571+0000", 2024-04-25T22:03:55.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6338999999999997e-05 2024-04-25T22:03:55.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:55.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847580+0000", 2024-04-25T22:03:55.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0680000000000003e-06 2024-04-25T22:03:55.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862224+0000", 2024-04-25T22:03:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0146447279999999 2024-04-25T22:03:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862676+0000", 2024-04-25T22:03:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045117300000000003 2024-04-25T22:03:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862992+0000", 2024-04-25T22:03:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000316607 2024-04-25T22:03:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879035+0000", 2024-04-25T22:03:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016043168999999999 2024-04-25T22:03:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879762+0000", 2024-04-25T22:03:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00072643100000000004 2024-04-25T22:03:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879993+0000", 2024-04-25T22:03:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023091799999999999 2024-04-25T22:03:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880084+0000", 2024-04-25T22:03:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1525000000000002e-05 2024-04-25T22:03:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7105 4.1d 4:b83d3758:::10000001718.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.070826729, 2024-04-25T22:03:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0317263169999999, 2024-04-25T22:03:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848534+0000", 2024-04-25T22:03:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1200000000000001e-06 2024-04-25T22:03:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848541+0000", 2024-04-25T22:03:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4749999999999998e-06 2024-04-25T22:03:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848551+0000", 2024-04-25T22:03:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.039e-05 2024-04-25T22:03:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848558+0000", 2024-04-25T22:03:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2520000000000002e-06 2024-04-25T22:03:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848703+0000", 2024-04-25T22:03:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014466699999999999 2024-04-25T22:03:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848709+0000", 2024-04-25T22:03:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-04-25T22:03:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866810+0000", 2024-04-25T22:03:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.018101293 2024-04-25T22:03:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867282+0000", 2024-04-25T22:03:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047148999999999997 2024-04-25T22:03:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867555+0000", 2024-04-25T22:03:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027314100000000002 2024-04-25T22:03:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877648+0000", 2024-04-25T22:03:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010093275000000001 2024-04-25T22:03:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880012+0000", 2024-04-25T22:03:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023639590000000001 2024-04-25T22:03:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880157+0000", 2024-04-25T22:03:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000144532 2024-04-25T22:03:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880260+0000", 2024-04-25T22:03:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103016 2024-04-25T22:03:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7116 4.27 4:e60ee3a4:::10000001a5f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.06667212, 2024-04-25T22:03:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0375457480000001, 2024-04-25T22:03:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-04-25T22:03:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852694+0000", 2024-04-25T22:03:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0360000000000003e-06 2024-04-25T22:03:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852702+0000", 2024-04-25T22:03:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1470000000000004e-06 2024-04-25T22:03:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852708+0000", 2024-04-25T22:03:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1210000000000003e-06 2024-04-25T22:03:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852762+0000", 2024-04-25T22:03:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4166000000000003e-05 2024-04-25T22:03:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852769+0000", 2024-04-25T22:03:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8000000000000001e-06 2024-04-25T22:03:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880804+0000", 2024-04-25T22:03:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.028035695 2024-04-25T22:03:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881105+0000", 2024-04-25T22:03:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030039999999999998 2024-04-25T22:03:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881373+0000", 2024-04-25T22:03:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026843499999999997 2024-04-25T22:03:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884999+0000", 2024-04-25T22:03:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036262070000000002 2024-04-25T22:03:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.889903+0000", 2024-04-25T22:03:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049036260000000003 2024-04-25T22:03:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890114+0000", 2024-04-25T22:03:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021130500000000001 2024-04-25T22:03:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890234+0000", 2024-04-25T22:03:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011922900000000001 2024-04-25T22:03:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7121 4.1f 4:fab6744c:::10000001a64.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.066179449, 2024-04-25T22:03:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.031414587, 2024-04-25T22:03:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1299999999999999e-07 2024-04-25T22:03:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853184+0000", 2024-04-25T22:03:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1779999999999999e-06 2024-04-25T22:03:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853192+0000", 2024-04-25T22:03:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.294e-06 2024-04-25T22:03:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853196+0000", 2024-04-25T22:03:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6330000000000004e-06 2024-04-25T22:03:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853249+0000", 2024-04-25T22:03:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2785999999999999e-05 2024-04-25T22:03:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853260+0000", 2024-04-25T22:03:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1027e-05 2024-04-25T22:03:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875944+0000", 2024-04-25T22:03:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0226834810000001 2024-04-25T22:03:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876230+0000", 2024-04-25T22:03:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000286357 2024-04-25T22:03:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876512+0000", 2024-04-25T22:03:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028174500000000002 2024-04-25T22:03:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880727+0000", 2024-04-25T22:03:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042150520000000004 2024-04-25T22:03:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884386+0000", 2024-04-25T22:03:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036589069999999999 2024-04-25T22:03:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884502+0000", 2024-04-25T22:03:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000115862 2024-04-25T22:03:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884595+0000", 2024-04-25T22:03:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3552000000000001e-05 2024-04-25T22:03:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7127 4.22 4:476940b8:::10000001b50.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.065071454000002, 2024-04-25T22:03:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.035873665, 2024-04-25T22:03:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854290+0000", 2024-04-25T22:03:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.313e-06 2024-04-25T22:03:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854295+0000", 2024-04-25T22:03:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3580000000000002e-06 2024-04-25T22:03:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854310+0000", 2024-04-25T22:03:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4742e-05 2024-04-25T22:03:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854318+0000", 2024-04-25T22:03:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2570000000000007e-06 2024-04-25T22:03:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854383+0000", 2024-04-25T22:03:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4535999999999993e-05 2024-04-25T22:03:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854390+0000", 2024-04-25T22:03:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3930000000000002e-06 2024-04-25T22:03:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879471+0000", 2024-04-25T22:03:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0250810260000001 2024-04-25T22:03:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879790+0000", 2024-04-25T22:03:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031862699999999998 2024-04-25T22:03:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880048+0000", 2024-04-25T22:03:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025776199999999998 2024-04-25T22:03:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882261+0000", 2024-04-25T22:03:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022130259999999999 2024-04-25T22:03:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.889734+0000", 2024-04-25T22:03:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0074735859999999999 2024-04-25T22:03:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890063+0000", 2024-04-25T22:03:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032892000000000002 2024-04-25T22:03:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890162+0000", 2024-04-25T22:03:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9118999999999997e-05 2024-04-25T22:03:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7135 4.27 4:e7bfb438:::10000001b58.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.062261924000001, 2024-04-25T22:03:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.033436429, 2024-04-25T22:03:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857099+0000", 2024-04-25T22:03:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0270000000000001e-06 2024-04-25T22:03:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857104+0000", 2024-04-25T22:03:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6909999999999996e-06 2024-04-25T22:03:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857116+0000", 2024-04-25T22:03:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2384999999999999e-05 2024-04-25T22:03:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857124+0000", 2024-04-25T22:03:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3080000000000008e-06 2024-04-25T22:03:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857175+0000", 2024-04-25T22:03:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0107e-05 2024-04-25T22:03:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857185+0000", 2024-04-25T22:03:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-04-25T22:03:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882135+0000", 2024-04-25T22:03:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.024950322 2024-04-25T22:03:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882426+0000", 2024-04-25T22:03:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029100699999999997 2024-04-25T22:03:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882689+0000", 2024-04-25T22:03:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026236800000000002 2024-04-25T22:03:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.885017+0000", 2024-04-25T22:03:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023282020000000001 2024-04-25T22:03:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890320+0000", 2024-04-25T22:03:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0053037049999999997 2024-04-25T22:03:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890428+0000", 2024-04-25T22:03:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107593 2024-04-25T22:03:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890534+0000", 2024-04-25T22:03:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106469 2024-04-25T22:03:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:55.056 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:55.058 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:03:55.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-04-25T22:03:55.052+0000 7fd619663640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:03:55.065 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-25T22:03:55.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:03:55.073 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-04-25T22:03:55.138 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T22:03:55.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:03:55.138 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:03:55.159 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:55.156+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:55.188 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:55.189 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:55.189 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-04-25T22:03:55.189 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:55.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:03:55.194 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2024-04-25T22:03:55.202 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:03:55.260 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:55.256+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:55.318 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:55.318 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-04-25T22:03:55.318 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-04-25T22:03:55.318 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-04-25T22:03:55.319 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:55.332 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:03:55.361 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-04-25T22:03:55.360+0000 7fe8640bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21731) UID: 0 2024-04-25T22:03:55.368 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-25T22:03:55.379 INFO:tasks.thrashosds:joining thrashosds 2024-04-25T22:03:55.454 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-04-25T22:03:55.454 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-04-25T22:03:55.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-04-25T22:03:55.455 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-04-25T22:03:55.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.455 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:55.455 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:55.455 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.364834637000001, 2024-04-25T22:03:55.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.204462859, 2024-04-25T22:03:55.455 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.455 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.455 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.455 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 5 2024-04-25T22:03:55.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.456 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:55.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085545+0000", 2024-04-25T22:03:55.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.085548+0000", 2024-04-25T22:03:55.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:03:55.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094330+0000", 2024-04-25T22:03:55.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087826599999999994 2024-04-25T22:03:55.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094364+0000", 2024-04-25T22:03:55.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4205999999999997e-05 2024-04-25T22:03:55.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094381+0000", 2024-04-25T22:03:55.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6429000000000001e-05 2024-04-25T22:03:55.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094550+0000", 2024-04-25T22:03:55.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016930600000000001 2024-04-25T22:03:55.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:55.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.094566+0000", 2024-04-25T22:03:55.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5800000000000001e-05 2024-04-25T22:03:55.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099484+0000", 2024-04-25T22:03:55.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049185950000000004 2024-04-25T22:03:55.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099953+0000", 2024-04-25T22:03:55.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000468448 2024-04-25T22:03:55.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:55.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100309+0000", 2024-04-25T22:03:55.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000356015 2024-04-25T22:03:55.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285785+0000", 2024-04-25T22:03:55.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.185475898 2024-04-25T22:03:55.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289944+0000", 2024-04-25T22:03:55.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041593760000000002 2024-04-25T22:03:55.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.289977+0000", 2024-04-25T22:03:55.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2320999999999998e-05 2024-04-25T22:03:55.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290008+0000", 2024-04-25T22:03:55.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1185e-05 2024-04-25T22:03:55.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.461 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.461 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:55.461 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:55.461 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.354833874000001, 2024-04-25T22:03:55.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.105277088, 2024-04-25T22:03:55.461 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.461 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.461 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.462 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.462 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.462 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.462 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 8 2024-04-25T22:03:55.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.462 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:55.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095546+0000", 2024-04-25T22:03:55.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095547+0000", 2024-04-25T22:03:55.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7400000000000001e-06 2024-04-25T22:03:55.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095557+0000", 2024-04-25T22:03:55.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8600000000000005e-06 2024-04-25T22:03:55.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095574+0000", 2024-04-25T22:03:55.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:03:55.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095588+0000", 2024-04-25T22:03:55.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3799e-05 2024-04-25T22:03:55.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095753+0000", 2024-04-25T22:03:55.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016500900000000001 2024-04-25T22:03:55.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-04-25T22:03:55.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.095769+0000", 2024-04-25T22:03:55.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5934e-05 2024-04-25T22:03:55.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102458+0000", 2024-04-25T22:03:55.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066894609999999998 2024-04-25T22:03:55.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102728+0000", 2024-04-25T22:03:55.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000269373 2024-04-25T22:03:55.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:55.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.103056+0000", 2024-04-25T22:03:55.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032825200000000001 2024-04-25T22:03:55.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104933+0000", 2024-04-25T22:03:55.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001876981 2024-04-25T22:03:55.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200681+0000", 2024-04-25T22:03:55.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.095747979999999996 2024-04-25T22:03:55.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200754+0000", 2024-04-25T22:03:55.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3044000000000001e-05 2024-04-25T22:03:55.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.200823+0000", 2024-04-25T22:03:55.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8604999999999998e-05 2024-04-25T22:03:55.467 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.467 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.467 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.467 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:55.467 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:55.467 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.350669600000003, 2024-04-25T22:03:55.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18520008199999999, 2024-04-25T22:03:55.467 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.468 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.468 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.468 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.468 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.468 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.468 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-04-25T22:03:55.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.468 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:55.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099710+0000", 2024-04-25T22:03:55.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099712+0000", 2024-04-25T22:03:55.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5770000000000001e-06 2024-04-25T22:03:55.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099726+0000", 2024-04-25T22:03:55.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3759e-05 2024-04-25T22:03:55.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099745+0000", 2024-04-25T22:03:55.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8553e-05 2024-04-25T22:03:55.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.099757+0000", 2024-04-25T22:03:55.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.223e-05 2024-04-25T22:03:55.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100561+0000", 2024-04-25T22:03:55.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000804267 2024-04-25T22:03:55.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.100856+0000", 2024-04-25T22:03:55.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029451599999999998 2024-04-25T22:03:55.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:55.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101188+0000", 2024-04-25T22:03:55.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033197499999999998 2024-04-25T22:03:55.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104902+0000", 2024-04-25T22:03:55.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037146150000000001 2024-04-25T22:03:55.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284809+0000", 2024-04-25T22:03:55.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.179907068 2024-04-25T22:03:55.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284842+0000", 2024-04-25T22:03:55.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2577999999999999e-05 2024-04-25T22:03:55.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284910+0000", 2024-04-25T22:03:55.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7943999999999999e-05 2024-04-25T22:03:55.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.472 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.473 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.473 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:55.473 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:55.473 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.349073283000003, 2024-04-25T22:03:55.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183791074, 2024-04-25T22:03:55.473 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.473 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.473 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.473 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.473 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.473 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.473 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 12 2024-04-25T22:03:55.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.474 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:55.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101306+0000", 2024-04-25T22:03:55.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101308+0000", 2024-04-25T22:03:55.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1969999999999999e-06 2024-04-25T22:03:55.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101322+0000", 2024-04-25T22:03:55.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3067e-05 2024-04-25T22:03:55.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101464+0000", 2024-04-25T22:03:55.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014249900000000001 2024-04-25T22:03:55.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.101487+0000", 2024-04-25T22:03:55.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2623e-05 2024-04-25T22:03:55.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102271+0000", 2024-04-25T22:03:55.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078402400000000003 2024-04-25T22:03:55.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102615+0000", 2024-04-25T22:03:55.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034390499999999998 2024-04-25T22:03:55.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:55.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.102981+0000", 2024-04-25T22:03:55.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000366478 2024-04-25T22:03:55.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.104968+0000", 2024-04-25T22:03:55.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019870370000000001 2024-04-25T22:03:55.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284979+0000", 2024-04-25T22:03:55.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.18001120000000001 2024-04-25T22:03:55.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285050+0000", 2024-04-25T22:03:55.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0761999999999998e-05 2024-04-25T22:03:55.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285097+0000", 2024-04-25T22:03:55.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7281999999999999e-05 2024-04-25T22:03:55.478 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.478 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.478 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.478 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:51 4.10 4:083d5826:::1000000022a.00000000:head [write 0~2721] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:55.478 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:55.478 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.292287033000001, 2024-04-25T22:03:55.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.132097199, 2024-04-25T22:03:55.478 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.479 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.479 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.479 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.479 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.479 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.479 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 51 2024-04-25T22:03:55.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.479 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:55.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158092+0000", 2024-04-25T22:03:55.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158095+0000", 2024-04-25T22:03:55.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3329999999999999e-06 2024-04-25T22:03:55.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158107+0000", 2024-04-25T22:03:55.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.219e-05 2024-04-25T22:03:55.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158131+0000", 2024-04-25T22:03:55.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3638999999999998e-05 2024-04-25T22:03:55.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.158144+0000", 2024-04-25T22:03:55.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2967e-05 2024-04-25T22:03:55.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284619+0000", 2024-04-25T22:03:55.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12647517 2024-04-25T22:03:55.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.284926+0000", 2024-04-25T22:03:55.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000307459 2024-04-25T22:03:55.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:55.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285210+0000", 2024-04-25T22:03:55.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028377300000000002 2024-04-25T22:03:55.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287639+0000", 2024-04-25T22:03:55.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002429166 2024-04-25T22:03:55.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290147+0000", 2024-04-25T22:03:55.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002507872 2024-04-25T22:03:55.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290171+0000", 2024-04-25T22:03:55.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3612999999999999e-05 2024-04-25T22:03:55.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290190+0000", 2024-04-25T22:03:55.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9017000000000001e-05 2024-04-25T22:03:55.483 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.483 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.484 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.484 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:55.484 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:55.484 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.276642766999998, 2024-04-25T22:03:55.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.116363577, 2024-04-25T22:03:55.484 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.484 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.485 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.485 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.485 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.485 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.485 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60 2024-04-25T22:03:55.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.485 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:55.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173737+0000", 2024-04-25T22:03:55.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173741+0000", 2024-04-25T22:03:55.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7730000000000001e-06 2024-04-25T22:03:55.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173757+0000", 2024-04-25T22:03:55.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6056999999999999e-05 2024-04-25T22:03:55.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173794+0000", 2024-04-25T22:03:55.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7239e-05 2024-04-25T22:03:55.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.173818+0000", 2024-04-25T22:03:55.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3856e-05 2024-04-25T22:03:55.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285806+0000", 2024-04-25T22:03:55.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11198796699999999 2024-04-25T22:03:55.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285871+0000", 2024-04-25T22:03:55.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5046e-05 2024-04-25T22:03:55.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:55.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.285943+0000", 2024-04-25T22:03:55.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2337999999999998e-05 2024-04-25T22:03:55.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287632+0000", 2024-04-25T22:03:55.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016889139999999999 2024-04-25T22:03:55.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290043+0000", 2024-04-25T22:03:55.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024112529999999999 2024-04-25T22:03:55.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290077+0000", 2024-04-25T22:03:55.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3924999999999998e-05 2024-04-25T22:03:55.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290100+0000", 2024-04-25T22:03:55.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3209000000000001e-05 2024-04-25T22:03:55.489 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.489 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.490 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.490 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:63 4.28 4:1537fa38:::10000000236.00000000:head [write 0~1121] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-25T22:03:55.490 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:55.490 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.271804076000002, 2024-04-25T22:03:55.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11156806499999999, 2024-04-25T22:03:55.490 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.490 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.490 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.490 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.490 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.490 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.490 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 63 2024-04-25T22:03:55.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.491 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:55.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178575+0000", 2024-04-25T22:03:55.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178577+0000", 2024-04-25T22:03:55.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8500000000000001e-06 2024-04-25T22:03:55.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178590+0000", 2024-04-25T22:03:55.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-05 2024-04-25T22:03:55.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178614+0000", 2024-04-25T22:03:55.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099000000000001e-05 2024-04-25T22:03:55.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.178627+0000", 2024-04-25T22:03:55.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3723000000000001e-05 2024-04-25T22:03:55.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286171+0000", 2024-04-25T22:03:55.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1075439 2024-04-25T22:03:55.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286233+0000", 2024-04-25T22:03:55.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1301000000000001e-05 2024-04-25T22:03:55.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:55.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.286311+0000", 2024-04-25T22:03:55.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8481999999999998e-05 2024-04-25T22:03:55.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.287677+0000", 2024-04-25T22:03:55.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013653840000000001 2024-04-25T22:03:55.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290105+0000", 2024-04-25T22:03:55.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024281530000000002 2024-04-25T22:03:55.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290126+0000", 2024-04-25T22:03:55.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1197999999999999e-05 2024-04-25T22:03:55.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:02:52.290144+0000", 2024-04-25T22:03:55.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7635e-05 2024-04-25T22:03:55.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.495 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.495 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10648 4.33 4:cc614d18:::100000030cb.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:55.496 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:55.496 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.913200764999999, 2024-04-25T22:03:55.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13001143300000001, 2024-04-25T22:03:55.496 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.496 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.496 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.496 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.496 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.496 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.496 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10648 2024-04-25T22:03:55.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.496 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:55.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537179+0000", 2024-04-25T22:03:55.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.537181+0000", 2024-04-25T22:03:55.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.782e-06 2024-04-25T22:03:55.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541681+0000", 2024-04-25T22:03:55.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045008460000000002 2024-04-25T22:03:55.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541692+0000", 2024-04-25T22:03:55.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0726e-05 2024-04-25T22:03:55.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541698+0000", 2024-04-25T22:03:55.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-04-25T22:03:55.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.541771+0000", 2024-04-25T22:03:55.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3070000000000003e-05 2024-04-25T22:03:55.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542021+0000", 2024-04-25T22:03:55.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025059799999999999 2024-04-25T22:03:55.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:55.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.542246+0000", 2024-04-25T22:03:55.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022471000000000001 2024-04-25T22:03:55.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.579359+0000", 2024-04-25T22:03:55.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037113211 2024-04-25T22:03:55.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667067+0000", 2024-04-25T22:03:55.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.087707255999999997 2024-04-25T22:03:55.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667134+0000", 2024-04-25T22:03:55.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7862999999999997e-05 2024-04-25T22:03:55.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.667190+0000", 2024-04-25T22:03:55.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5698000000000001e-05 2024-04-25T22:03:55.501 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.501 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.501 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.501 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10651 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:55.501 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:55.501 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.853424986999997, 2024-04-25T22:03:55.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.11324606800000001, 2024-04-25T22:03:55.501 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.501 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.501 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.501 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.501 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.502 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.502 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10651 2024-04-25T22:03:55.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.502 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:55.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596955+0000", 2024-04-25T22:03:55.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.596957+0000", 2024-04-25T22:03:55.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-04-25T22:03:55.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601272+0000", 2024-04-25T22:03:55.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004314834 2024-04-25T22:03:55.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601291+0000", 2024-04-25T22:03:55.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9380000000000001e-05 2024-04-25T22:03:55.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.601302+0000", 2024-04-25T22:03:55.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0416e-05 2024-04-25T22:03:55.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.603978+0000", 2024-04-25T22:03:55.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026763109999999998 2024-04-25T22:03:55.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604327+0000", 2024-04-25T22:03:55.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034881099999999998 2024-04-25T22:03:55.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:55.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.604571+0000", 2024-04-25T22:03:55.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024436100000000001 2024-04-25T22:03:55.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644439+0000", 2024-04-25T22:03:55.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039868270999999997 2024-04-25T22:03:55.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710091+0000", 2024-04-25T22:03:55.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.065651910999999993 2024-04-25T22:03:55.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710144+0000", 2024-04-25T22:03:55.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2444999999999997e-05 2024-04-25T22:03:55.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710201+0000", 2024-04-25T22:03:55.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6839999999999998e-05 2024-04-25T22:03:55.506 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.506 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.506 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.506 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:10654 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [3@232599]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:03:55.507 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:55.507 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.843598124000003, 2024-04-25T22:03:55.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.103958778, 2024-04-25T22:03:55.507 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.507 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.507 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.507 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10654 2024-04-25T22:03:55.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.507 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:55.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606781+0000", 2024-04-25T22:03:55.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.606782+0000", 2024-04-25T22:03:55.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1699999999999999e-07 2024-04-25T22:03:55.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611155+0000", 2024-04-25T22:03:55.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043728580000000003 2024-04-25T22:03:55.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611173+0000", 2024-04-25T22:03:55.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8267e-05 2024-04-25T22:03:55.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.611183+0000", 2024-04-25T22:03:55.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9250000000000007e-06 2024-04-25T22:03:55.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644642+0000", 2024-04-25T22:03:55.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033458976000000001 2024-04-25T22:03:55.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644739+0000", 2024-04-25T22:03:55.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7189999999999996e-05 2024-04-25T22:03:55.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:55.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.644864+0000", 2024-04-25T22:03:55.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000124867 2024-04-25T22:03:55.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.672556+0000", 2024-04-25T22:03:55.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027691653 2024-04-25T22:03:55.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710668+0000", 2024-04-25T22:03:55.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038111956000000002 2024-04-25T22:03:55.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710703+0000", 2024-04-25T22:03:55.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5577000000000002e-05 2024-04-25T22:03:55.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:13.710740+0000", 2024-04-25T22:03:55.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7092000000000003e-05 2024-04-25T22:03:55.512 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.512 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.512 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.512 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11078 4.4 4:22be2a9e:::10000003224.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:55.512 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:55.512 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.446471502999998, 2024-04-25T22:03:55.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.112294177, 2024-04-25T22:03:55.513 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.513 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.513 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.513 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.513 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.513 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.513 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11078 2024-04-25T22:03:55.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.513 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:55.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003908+0000", 2024-04-25T22:03:55.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.003909+0000", 2024-04-25T22:03:55.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2750000000000001e-06 2024-04-25T22:03:55.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009939+0000", 2024-04-25T22:03:55.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060293309999999998 2024-04-25T22:03:55.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009961+0000", 2024-04-25T22:03:55.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1889999999999999e-05 2024-04-25T22:03:55.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.009976+0000", 2024-04-25T22:03:55.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5642e-05 2024-04-25T22:03:55.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042803+0000", 2024-04-25T22:03:55.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032827299999999997 2024-04-25T22:03:55.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042911+0000", 2024-04-25T22:03:55.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107747 2024-04-25T22:03:55.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:55.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.042990+0000", 2024-04-25T22:03:55.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8832999999999996e-05 2024-04-25T22:03:55.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.088710+0000", 2024-04-25T22:03:55.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045720129999999998 2024-04-25T22:03:55.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116108+0000", 2024-04-25T22:03:55.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027397388000000002 2024-04-25T22:03:55.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116164+0000", 2024-04-25T22:03:55.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6283000000000003e-05 2024-04-25T22:03:55.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.116202+0000", 2024-04-25T22:03:55.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8358000000000001e-05 2024-04-25T22:03:55.518 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.518 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.518 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.518 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11195 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:55.518 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:55.519 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.233109386000002, 2024-04-25T22:03:55.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.1095062, 2024-04-25T22:03:55.519 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.519 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.519 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.519 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.519 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.519 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.519 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11195 2024-04-25T22:03:55.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.519 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:55.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217270+0000", 2024-04-25T22:03:55.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217272+0000", 2024-04-25T22:03:55.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.533e-06 2024-04-25T22:03:55.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217385+0000", 2024-04-25T22:03:55.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113533 2024-04-25T22:03:55.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217396+0000", 2024-04-25T22:03:55.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0682e-05 2024-04-25T22:03:55.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217402+0000", 2024-04-25T22:03:55.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:03:55.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238476+0000", 2024-04-25T22:03:55.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021073312 2024-04-25T22:03:55.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238558+0000", 2024-04-25T22:03:55.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2193000000000004e-05 2024-04-25T22:03:55.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:55.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.238695+0000", 2024-04-25T22:03:55.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013737800000000001 2024-04-25T22:03:55.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292860+0000", 2024-04-25T22:03:55.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054165224999999997 2024-04-25T22:03:55.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326638+0000", 2024-04-25T22:03:55.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033777517999999999 2024-04-25T22:03:55.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326686+0000", 2024-04-25T22:03:55.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8062000000000002e-05 2024-04-25T22:03:55.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326776+0000", 2024-04-25T22:03:55.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0393e-05 2024-04-25T22:03:55.523 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.524 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.524 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.524 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11197 4.1c 4:38b085a0:::1000000320b.00000000:head [write 3195543~33670] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:55.524 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:55.524 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.232967402, 2024-04-25T22:03:55.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953929499999999, 2024-04-25T22:03:55.524 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.524 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.524 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.524 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.524 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.524 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.525 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11197 2024-04-25T22:03:55.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.525 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:55.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217412+0000", 2024-04-25T22:03:55.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217413+0000", 2024-04-25T22:03:55.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5600000000000005e-07 2024-04-25T22:03:55.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217445+0000", 2024-04-25T22:03:55.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2240999999999998e-05 2024-04-25T22:03:55.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217453+0000", 2024-04-25T22:03:55.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6070000000000002e-06 2024-04-25T22:03:55.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217458+0000", 2024-04-25T22:03:55.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3630000000000002e-06 2024-04-25T22:03:55.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240891+0000", 2024-04-25T22:03:55.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023432637999999999 2024-04-25T22:03:55.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240990+0000", 2024-04-25T22:03:55.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8995999999999999e-05 2024-04-25T22:03:55.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:55.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241123+0000", 2024-04-25T22:03:55.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013371699999999999 2024-04-25T22:03:55.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292866+0000", 2024-04-25T22:03:55.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051742332000000002 2024-04-25T22:03:55.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326849+0000", 2024-04-25T22:03:55.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033983140000000002 2024-04-25T22:03:55.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326908+0000", 2024-04-25T22:03:55.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8842999999999999e-05 2024-04-25T22:03:55.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326951+0000", 2024-04-25T22:03:55.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3761999999999999e-05 2024-04-25T22:03:55.531 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.532 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.532 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.532 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11198 4.4 4:22c4fea3:::10000003262.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:55.532 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:55.532 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.232913043000003, 2024-04-25T22:03:55.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12381273600000001, 2024-04-25T22:03:55.532 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.533 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.533 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.533 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.533 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.533 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.533 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11198 2024-04-25T22:03:55.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.533 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:55.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217466+0000", 2024-04-25T22:03:55.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.217467+0000", 2024-04-25T22:03:55.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4499999999999997e-07 2024-04-25T22:03:55.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225449+0000", 2024-04-25T22:03:55.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079819439999999995 2024-04-25T22:03:55.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225466+0000", 2024-04-25T22:03:55.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6602000000000001e-05 2024-04-25T22:03:55.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.225477+0000", 2024-04-25T22:03:55.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1603000000000001e-05 2024-04-25T22:03:55.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.240866+0000", 2024-04-25T22:03:55.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015388389000000001 2024-04-25T22:03:55.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241081+0000", 2024-04-25T22:03:55.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021577400000000001 2024-04-25T22:03:55.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:55.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.241212+0000", 2024-04-25T22:03:55.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013073499999999999 2024-04-25T22:03:55.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292876+0000", 2024-04-25T22:03:55.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051663584999999998 2024-04-25T22:03:55.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341159+0000", 2024-04-25T22:03:55.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048283421999999999 2024-04-25T22:03:55.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341222+0000", 2024-04-25T22:03:55.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:03:55.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341279+0000", 2024-04-25T22:03:55.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6780999999999997e-05 2024-04-25T22:03:55.540 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.540 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.540 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.540 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11207 4.4 4:233f6309:::10000003211.00000000:head [write 659836~128648] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:55.540 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:55.540 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.216295045999999, 2024-04-25T22:03:55.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10732727, 2024-04-25T22:03:55.540 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.540 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.541 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.541 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11207 2024-04-25T22:03:55.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.541 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:55.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234084+0000", 2024-04-25T22:03:55.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234085+0000", 2024-04-25T22:03:55.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0399999999999995e-07 2024-04-25T22:03:55.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234550+0000", 2024-04-25T22:03:55.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000464909 2024-04-25T22:03:55.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234561+0000", 2024-04-25T22:03:55.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0744000000000001e-05 2024-04-25T22:03:55.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.234569+0000", 2024-04-25T22:03:55.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6890000000000004e-06 2024-04-25T22:03:55.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267197+0000", 2024-04-25T22:03:55.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032628182999999998 2024-04-25T22:03:55.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267297+0000", 2024-04-25T22:03:55.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100222 2024-04-25T22:03:55.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:55.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.267393+0000", 2024-04-25T22:03:55.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6275999999999998e-05 2024-04-25T22:03:55.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.292880+0000", 2024-04-25T22:03:55.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025487058999999999 2024-04-25T22:03:55.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341326+0000", 2024-04-25T22:03:55.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048446031000000001 2024-04-25T22:03:55.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341374+0000", 2024-04-25T22:03:55.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7632000000000001e-05 2024-04-25T22:03:55.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.341412+0000", 2024-04-25T22:03:55.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7821000000000003e-05 2024-04-25T22:03:55.545 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.545 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.546 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.546 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11219 4.4 4:210cd53e:::100000031ff.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:03:55.546 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:55.546 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.197345835999997, 2024-04-25T22:03:55.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.13181403, 2024-04-25T22:03:55.546 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.546 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.546 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.546 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.547 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.547 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.547 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11219 2024-04-25T22:03:55.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.547 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:55.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253034+0000", 2024-04-25T22:03:55.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.253035+0000", 2024-04-25T22:03:55.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.322e-06 2024-04-25T22:03:55.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258145+0000", 2024-04-25T22:03:55.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051095669999999998 2024-04-25T22:03:55.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258163+0000", 2024-04-25T22:03:55.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8377999999999999e-05 2024-04-25T22:03:55.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.258174+0000", 2024-04-25T22:03:55.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0925e-05 2024-04-25T22:03:55.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270495+0000", 2024-04-25T22:03:55.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012321354 2024-04-25T22:03:55.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270581+0000", 2024-04-25T22:03:55.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5741999999999993e-05 2024-04-25T22:03:55.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:55.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.270717+0000", 2024-04-25T22:03:55.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013571500000000001 2024-04-25T22:03:55.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.326599+0000", 2024-04-25T22:03:55.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055882026000000001 2024-04-25T22:03:55.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384753+0000", 2024-04-25T22:03:55.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058154527999999997 2024-04-25T22:03:55.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384805+0000", 2024-04-25T22:03:55.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1592999999999999e-05 2024-04-25T22:03:55.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:18.384848+0000", 2024-04-25T22:03:55.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2880000000000003e-05 2024-04-25T22:03:55.551 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.551 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.551 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.551 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11868 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 0~4063232] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:55.551 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:55.552 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.238382012000002, 2024-04-25T22:03:55.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.12149908700000001, 2024-04-25T22:03:55.552 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.552 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.552 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.552 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.552 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.552 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.552 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11868 2024-04-25T22:03:55.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.552 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:55.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211998+0000", 2024-04-25T22:03:55.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.211999+0000", 2024-04-25T22:03:55.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1659999999999999e-06 2024-04-25T22:03:55.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219614+0000", 2024-04-25T22:03:55.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076153490000000004 2024-04-25T22:03:55.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219628+0000", 2024-04-25T22:03:55.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3597e-05 2024-04-25T22:03:55.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219635+0000", 2024-04-25T22:03:55.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7759999999999997e-06 2024-04-25T22:03:55.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229908+0000", 2024-04-25T22:03:55.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010272478 2024-04-25T22:03:55.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.229966+0000", 2024-04-25T22:03:55.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8495000000000002e-05 2024-04-25T22:03:55.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:55.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.230082+0000", 2024-04-25T22:03:55.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011560799999999999 2024-04-25T22:03:55.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257530+0000", 2024-04-25T22:03:55.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027448034999999999 2024-04-25T22:03:55.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333408+0000", 2024-04-25T22:03:55.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075878105000000001 2024-04-25T22:03:55.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333457+0000", 2024-04-25T22:03:55.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8757000000000001e-05 2024-04-25T22:03:55.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333497+0000", 2024-04-25T22:03:55.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9721000000000001e-05 2024-04-25T22:03:55.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.557 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.557 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11870 4.3f 4:ffca00d8:::1000000326a.00000001:head [write 4063232~131072] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:55.557 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:55.557 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.230727657999999, 2024-04-25T22:03:55.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.114017408, 2024-04-25T22:03:55.558 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.558 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.558 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.558 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.558 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.558 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.558 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11870 2024-04-25T22:03:55.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.558 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:55.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219652+0000", 2024-04-25T22:03:55.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219653+0000", 2024-04-25T22:03:55.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6139999999999999e-06 2024-04-25T22:03:55.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219722+0000", 2024-04-25T22:03:55.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8460000000000005e-05 2024-04-25T22:03:55.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219730+0000", 2024-04-25T22:03:55.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3420000000000008e-06 2024-04-25T22:03:55.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219736+0000", 2024-04-25T22:03:55.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9619999999999998e-06 2024-04-25T22:03:55.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247743+0000", 2024-04-25T22:03:55.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028006400000000001 2024-04-25T22:03:55.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247847+0000", 2024-04-25T22:03:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104017 2024-04-25T22:03:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247984+0000", 2024-04-25T22:03:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013701800000000001 2024-04-25T22:03:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257536+0000", 2024-04-25T22:03:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095520050000000006 2024-04-25T22:03:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333565+0000", 2024-04-25T22:03:55.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.076029154000000002 2024-04-25T22:03:55.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333628+0000", 2024-04-25T22:03:55.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2853000000000003e-05 2024-04-25T22:03:55.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333669+0000", 2024-04-25T22:03:55.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1582999999999998e-05 2024-04-25T22:03:55.562 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.562 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.563 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:11871 4.37 4:ee924968:::10000003393.00000000:head [write 2359296~1835008] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-25T22:03:55.563 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:55.563 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.230634725999998, 2024-04-25T22:03:55.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.113885236, 2024-04-25T22:03:55.563 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.563 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.563 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.563 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11871 2024-04-25T22:03:55.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.563 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:55.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:55.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.219745+0000", 2024-04-25T22:03:55.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6100000000000001e-07 2024-04-25T22:03:55.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222469+0000", 2024-04-25T22:03:55.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027240060000000002 2024-04-25T22:03:55.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222482+0000", 2024-04-25T22:03:55.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3049e-05 2024-04-25T22:03:55.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.222492+0000", 2024-04-25T22:03:55.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8020000000000003e-06 2024-04-25T22:03:55.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247903+0000", 2024-04-25T22:03:55.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.025410578999999999 2024-04-25T22:03:55.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.247962+0000", 2024-04-25T22:03:55.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9363000000000001e-05 2024-04-25T22:03:55.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:55.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.248049+0000", 2024-04-25T22:03:55.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6803000000000002e-05 2024-04-25T22:03:55.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.257915+0000", 2024-04-25T22:03:55.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0098655730000000007 2024-04-25T22:03:55.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333544+0000", 2024-04-25T22:03:55.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.075629030999999999 2024-04-25T22:03:55.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333594+0000", 2024-04-25T22:03:55.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0291999999999999e-05 2024-04-25T22:03:55.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:19.333630+0000", 2024-04-25T22:03:55.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6177000000000003e-05 2024-04-25T22:03:55.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.568 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.568 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4564.0:15375 4.4 4:211dd80e:::10000003351.00000000:head [write 0~4194304 [2@1354921]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-25T22:03:55.568 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:55.568 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.313305333999999, 2024-04-25T22:03:55.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.10953555500000001, 2024-04-25T22:03:55.568 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-04-25T22:03:55.568 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-04-25T22:03:55.568 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.569 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-04-25T22:03:55.569 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4564", 2024-04-25T22:03:55.569 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "192.168.0.1:0/1056895546", 2024-04-25T22:03:55.569 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-04-25T22:03:55.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.569 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-04-25T22:03:55.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-04-25T22:03:55.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:55.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-04-25T22:03:55.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137074+0000", 2024-04-25T22:03:55.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-04-25T22:03:55.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-04-25T22:03:55.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.137076+0000", 2024-04-25T22:03:55.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.683e-06 2024-04-25T22:03:55.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-04-25T22:03:55.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142168+0000", 2024-04-25T22:03:55.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050917280000000002 2024-04-25T22:03:55.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-04-25T22:03:55.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142192+0000", 2024-04-25T22:03:55.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:03:55.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142206+0000", 2024-04-25T22:03:55.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.396e-05 2024-04-25T22:03:55.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-04-25T22:03:55.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142280+0000", 2024-04-25T22:03:55.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4369000000000006e-05 2024-04-25T22:03:55.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-04-25T22:03:55.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142346+0000", 2024-04-25T22:03:55.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5957000000000006e-05 2024-04-25T22:03:55.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-04-25T22:03:55.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.142440+0000", 2024-04-25T22:03:55.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3888999999999995e-05 2024-04-25T22:03:55.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:55.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.208451+0000", 2024-04-25T22:03:55.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066011350999999996 2024-04-25T22:03:55.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-04-25T22:03:55.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246473+0000", 2024-04-25T22:03:55.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038021428000000003 2024-04-25T22:03:55.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-04-25T22:03:55.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246530+0000", 2024-04-25T22:03:55.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7466000000000002e-05 2024-04-25T22:03:55.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-04-25T22:03:55.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-04-25T22:03:55.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-04-25T22:03:55.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-04-25T22:03:24.246610+0000", 2024-04-25T22:03:55.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9484e-05 2024-04-25T22:03:55.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.573 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-04-25T22:03:55.573 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-04-25T22:03:55.573 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-04-25T22:03:55.575 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:03:55.704 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:55.705 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:55.705 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-04-25T22:03:55.705 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:55.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:03:55.839 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:55.839 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-04-25T22:03:55.839 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-04-25T22:03:55.839 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-04-25T22:03:55.839 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:55.853 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:03:55.969 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-25T22:03:55.969 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-04-25T22:03:55.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-04-25T22:03:55.970 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-04-25T22:03:55.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.970 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7039 4.8 4:1138358d:::100000013f3.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:55.970 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:55.970 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.134784988, 2024-04-25T22:03:55.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.034656746, 2024-04-25T22:03:55.970 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:55.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:55.970 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:55.970 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:55.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:55.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:55.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:55.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831788+0000", 2024-04-25T22:03:55.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:55.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831791+0000", 2024-04-25T22:03:55.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6359999999999998e-06 2024-04-25T22:03:55.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:55.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831801+0000", 2024-04-25T22:03:55.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0567000000000001e-05 2024-04-25T22:03:55.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:55.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831824+0000", 2024-04-25T22:03:55.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-04-25T22:03:55.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831839+0000", 2024-04-25T22:03:55.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5345999999999998e-05 2024-04-25T22:03:55.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832028+0000", 2024-04-25T22:03:55.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018899800000000001 2024-04-25T22:03:55.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:55.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832043+0000", 2024-04-25T22:03:55.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4805e-05 2024-04-25T22:03:55.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836259+0000", 2024-04-25T22:03:55.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042161819999999997 2024-04-25T22:03:55.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:55.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836422+0000", 2024-04-25T22:03:55.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000162404 2024-04-25T22:03:55.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.865428+0000", 2024-04-25T22:03:55.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0290065770000001 2024-04-25T22:03:55.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:55.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866445+0000", 2024-04-25T22:03:55.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001016561 2024-04-25T22:03:55.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.977 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:55.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.978 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7040 4.8 4:121f992c:::100000013f4.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:55.978 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:55.978 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.134696065, 2024-04-25T22:03:55.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0348302300000001, 2024-04-25T22:03:55.978 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:55.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:55.978 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:55.978 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:55.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:55.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:55.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:55.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831877+0000", 2024-04-25T22:03:55.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:55.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831878+0000", 2024-04-25T22:03:55.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3659999999999999e-06 2024-04-25T22:03:55.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:55.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831885+0000", 2024-04-25T22:03:55.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7139999999999996e-06 2024-04-25T22:03:55.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:55.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831901+0000", 2024-04-25T22:03:55.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5982999999999999e-05 2024-04-25T22:03:55.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831910+0000", 2024-04-25T22:03:55.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7530000000000007e-06 2024-04-25T22:03:55.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832133+0000", 2024-04-25T22:03:55.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022307199999999999 2024-04-25T22:03:55.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:55.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832141+0000", 2024-04-25T22:03:55.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0080000000000002e-06 2024-04-25T22:03:55.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836611+0000", 2024-04-25T22:03:55.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044698389999999998 2024-04-25T22:03:55.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:55.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836629+0000", 2024-04-25T22:03:55.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8397e-05 2024-04-25T22:03:55.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866532+0000", 2024-04-25T22:03:55.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0299026200000001 2024-04-25T22:03:55.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:55.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866707+0000", 2024-04-25T22:03:55.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017547799999999999 2024-04-25T22:03:55.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.983 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:55.983 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.983 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7051 4.36 4:6e19a085:::100000013ff.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:55.983 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:55.983 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.134643285999999, 2024-04-25T22:03:55.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.032211298, 2024-04-25T22:03:55.983 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:55.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:55.983 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:55.983 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:55.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:55.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:55.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:55.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831930+0000", 2024-04-25T22:03:55.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:55.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831931+0000", 2024-04-25T22:03:55.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.19e-06 2024-04-25T22:03:55.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:55.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831936+0000", 2024-04-25T22:03:55.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2059999999999998e-06 2024-04-25T22:03:55.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:55.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831950+0000", 2024-04-25T22:03:55.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3424000000000001e-05 2024-04-25T22:03:55.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831958+0000", 2024-04-25T22:03:55.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1659999999999994e-06 2024-04-25T22:03:55.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832033+0000", 2024-04-25T22:03:55.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4977999999999999e-05 2024-04-25T22:03:55.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:55.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832043+0000", 2024-04-25T22:03:55.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0268999999999999e-05 2024-04-25T22:03:55.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841105+0000", 2024-04-25T22:03:55.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090619829999999991 2024-04-25T22:03:55.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:55.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841118+0000", 2024-04-25T22:03:55.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2737e-05 2024-04-25T22:03:55.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.863240+0000", 2024-04-25T22:03:55.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0221224259999999 2024-04-25T22:03:55.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:55.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.864141+0000", 2024-04-25T22:03:55.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090091900000000003 2024-04-25T22:03:55.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.988 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:55.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.988 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7059 4.22 4:47c8979f:::10000001407.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:55.988 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:55.988 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.134592145999999, 2024-04-25T22:03:55.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0438401859999999, 2024-04-25T22:03:55.989 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:55.989 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:55.989 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-04-25T22:03:55.989 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:55.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:55.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:55.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:55.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831981+0000", 2024-04-25T22:03:55.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:55.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831982+0000", 2024-04-25T22:03:55.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1030000000000001e-06 2024-04-25T22:03:55.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:55.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.831987+0000", 2024-04-25T22:03:55.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-04-25T22:03:55.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:55.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832007+0000", 2024-04-25T22:03:55.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0126999999999999e-05 2024-04-25T22:03:55.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:55.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832022+0000", 2024-04-25T22:03:55.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4878999999999999e-05 2024-04-25T22:03:55.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832082+0000", 2024-04-25T22:03:55.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9552999999999997e-05 2024-04-25T22:03:55.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:55.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832088+0000", 2024-04-25T22:03:55.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9320000000000001e-06 2024-04-25T22:03:55.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836708+0000", 2024-04-25T22:03:55.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046199240000000001 2024-04-25T22:03:55.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:55.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836717+0000", 2024-04-25T22:03:55.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1840000000000005e-06 2024-04-25T22:03:55.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:55.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875475+0000", 2024-04-25T22:03:55.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0387584439999999 2024-04-25T22:03:55.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:55.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875821+0000", 2024-04-25T22:03:55.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00034578700000000001 2024-04-25T22:03:55.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.997 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:55.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:55.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.997 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7063 4.2 4:4331e060:::100000014df.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:55.997 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:55.997 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.134529357000002, 2024-04-25T22:03:55.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.047605189, 2024-04-25T22:03:55.998 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:55.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:55.998 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:55.998 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:55.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:55.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:55.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:55.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:55.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:55.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832044+0000", 2024-04-25T22:03:55.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:55.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832045+0000", 2024-04-25T22:03:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5400000000000001e-06 2024-04-25T22:03:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832088+0000", 2024-04-25T22:03:56.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2483e-05 2024-04-25T22:03:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832100+0000", 2024-04-25T22:03:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2713e-05 2024-04-25T22:03:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832111+0000", 2024-04-25T22:03:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0457e-05 2024-04-25T22:03:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832155+0000", 2024-04-25T22:03:56.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4468999999999997e-05 2024-04-25T22:03:56.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:56.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832161+0000", 2024-04-25T22:03:56.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3369999999999999e-06 2024-04-25T22:03:56.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836779+0000", 2024-04-25T22:03:56.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046185030000000004 2024-04-25T22:03:56.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:56.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836787+0000", 2024-04-25T22:03:56.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5820000000000004e-06 2024-04-25T22:03:56.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.868721+0000", 2024-04-25T22:03:56.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0319339300000001 2024-04-25T22:03:56.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:56.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869179+0000", 2024-04-25T22:03:56.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000457916 2024-04-25T22:03:56.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:56.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869486+0000", 2024-04-25T22:03:56.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030764099999999999 2024-04-25T22:03:56.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:56.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879230+0000", 2024-04-25T22:03:56.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097433620000000002 2024-04-25T22:03:56.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:56.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879288+0000", 2024-04-25T22:03:56.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8813000000000001e-05 2024-04-25T22:03:56.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:56.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879542+0000", 2024-04-25T22:03:56.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025326999999999999 2024-04-25T22:03:56.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:56.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879649+0000", 2024-04-25T22:03:56.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107173 2024-04-25T22:03:56.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.005 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:56.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.006 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7068 4.33 4:cf543130:::100000014e4.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:56.006 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:56.006 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.134443664999999, 2024-04-25T22:03:56.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.044127671, 2024-04-25T22:03:56.006 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:56.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:56.006 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:56.006 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:56.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:56.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:56.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:56.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832129+0000", 2024-04-25T22:03:56.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:56.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832131+0000", 2024-04-25T22:03:56.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:03:56.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:56.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832137+0000", 2024-04-25T22:03:56.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9859999999999999e-06 2024-04-25T22:03:56.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:56.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832155+0000", 2024-04-25T22:03:56.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8090000000000001e-05 2024-04-25T22:03:56.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:56.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832166+0000", 2024-04-25T22:03:56.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1776999999999999e-05 2024-04-25T22:03:56.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832235+0000", 2024-04-25T22:03:56.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8614000000000004e-05 2024-04-25T22:03:56.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:56.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832243+0000", 2024-04-25T22:03:56.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2719999999999997e-06 2024-04-25T22:03:56.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.834656+0000", 2024-04-25T22:03:56.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024123489999999998 2024-04-25T22:03:56.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:56.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.834666+0000", 2024-04-25T22:03:56.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8819999999999996e-06 2024-04-25T22:03:56.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.860770+0000", 2024-04-25T22:03:56.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.026104414 2024-04-25T22:03:56.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:56.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861849+0000", 2024-04-25T22:03:56.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010794559999999999 2024-04-25T22:03:56.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:56.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.865487+0000", 2024-04-25T22:03:56.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036373270000000001 2024-04-25T22:03:56.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:56.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869323+0000", 2024-04-25T22:03:56.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038362259999999999 2024-04-25T22:03:56.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876012+0000", 2024-04-25T22:03:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066894290000000002 2024-04-25T22:03:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876154+0000", 2024-04-25T22:03:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000141963 2024-04-25T22:03:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876257+0000", 2024-04-25T22:03:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102662 2024-04-25T22:03:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7069 4.36 4:6d2d0624:::100000014e5.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.134390908, 2024-04-25T22:03:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0457444709999999, 2024-04-25T22:03:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832182+0000", 2024-04-25T22:03:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832183+0000", 2024-04-25T22:03:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1459999999999999e-06 2024-04-25T22:03:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832189+0000", 2024-04-25T22:03:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.614e-06 2024-04-25T22:03:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832206+0000", 2024-04-25T22:03:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.683e-05 2024-04-25T22:03:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832218+0000", 2024-04-25T22:03:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2266000000000001e-05 2024-04-25T22:03:56.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832265+0000", 2024-04-25T22:03:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7138999999999997e-05 2024-04-25T22:03:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832271+0000", 2024-04-25T22:03:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4280000000000004e-06 2024-04-25T22:03:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841149+0000", 2024-04-25T22:03:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088781429999999998 2024-04-25T22:03:56.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841158+0000", 2024-04-25T22:03:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7359999999999996e-06 2024-04-25T22:03:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867956+0000", 2024-04-25T22:03:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0267976969999999 2024-04-25T22:03:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.868991+0000", 2024-04-25T22:03:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010344810000000001 2024-04-25T22:03:56.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869248+0000", 2024-04-25T22:03:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025746699999999999 2024-04-25T22:03:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872721+0000", 2024-04-25T22:03:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034729959999999999 2024-04-25T22:03:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877064+0000", 2024-04-25T22:03:56.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043432770000000004 2024-04-25T22:03:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877767+0000", 2024-04-25T22:03:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070237700000000001 2024-04-25T22:03:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877927+0000", 2024-04-25T22:03:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015987400000000001 2024-04-25T22:03:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:56.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7071 4.22 4:45120e82:::100000014e7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.134337468999998, 2024-04-25T22:03:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.050578969, 2024-04-25T22:03:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:56.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832236+0000", 2024-04-25T22:03:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832237+0000", 2024-04-25T22:03:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.003e-06 2024-04-25T22:03:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:56.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832243+0000", 2024-04-25T22:03:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-04-25T22:03:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832263+0000", 2024-04-25T22:03:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0066999999999999e-05 2024-04-25T22:03:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832293+0000", 2024-04-25T22:03:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9802999999999999e-05 2024-04-25T22:03:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832416+0000", 2024-04-25T22:03:56.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123566 2024-04-25T22:03:56.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:03:56.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832438+0000", 2024-04-25T22:03:56.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1433e-05 2024-04-25T22:03:56.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836745+0000", 2024-04-25T22:03:56.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043070260000000003 2024-04-25T22:03:56.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:56.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836752+0000", 2024-04-25T22:03:56.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2060000000000001e-06 2024-04-25T22:03:56.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875897+0000", 2024-04-25T22:03:56.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0391448489999999 2024-04-25T22:03:56.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:56.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876238+0000", 2024-04-25T22:03:56.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00034159400000000002 2024-04-25T22:03:56.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:56.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876491+0000", 2024-04-25T22:03:56.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025221500000000002 2024-04-25T22:03:56.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:56.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881289+0000", 2024-04-25T22:03:56.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047986510000000001 2024-04-25T22:03:56.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:56.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882627+0000", 2024-04-25T22:03:56.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013376340000000001 2024-04-25T22:03:56.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:56.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882707+0000", 2024-04-25T22:03:56.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0037000000000006e-05 2024-04-25T22:03:56.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:56.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882815+0000", 2024-04-25T22:03:56.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107645 2024-04-25T22:03:56.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.026 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:56.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.027 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7073 4.14 4:2af683fb:::100000014e9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:56.027 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:56.027 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.134256875999998, 2024-04-25T22:03:56.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.043944475, 2024-04-25T22:03:56.027 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:56.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:56.027 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:56.027 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:56.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:56.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:56.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:56.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832316+0000", 2024-04-25T22:03:56.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:56.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832318+0000", 2024-04-25T22:03:56.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:03:56.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:56.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832323+0000", 2024-04-25T22:03:56.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6099999999999997e-06 2024-04-25T22:03:56.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:56.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832345+0000", 2024-04-25T22:03:56.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1353e-05 2024-04-25T22:03:56.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:56.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832390+0000", 2024-04-25T22:03:56.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5543000000000001e-05 2024-04-25T22:03:56.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832469+0000", 2024-04-25T22:03:56.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8770999999999995e-05 2024-04-25T22:03:56.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:56.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832475+0000", 2024-04-25T22:03:56.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0970000000000002e-06 2024-04-25T22:03:56.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843177+0000", 2024-04-25T22:03:56.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010702237999999999 2024-04-25T22:03:56.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:56.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843185+0000", 2024-04-25T22:03:56.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8490000000000006e-06 2024-04-25T22:03:56.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861478+0000", 2024-04-25T22:03:56.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.018292915 2024-04-25T22:03:56.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:56.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.861880+0000", 2024-04-25T22:03:56.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00040182599999999998 2024-04-25T22:03:56.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:56.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862137+0000", 2024-04-25T22:03:56.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025741099999999998 2024-04-25T22:03:56.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:56.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866967+0000", 2024-04-25T22:03:56.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048298669999999998 2024-04-25T22:03:56.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:56.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875991+0000", 2024-04-25T22:03:56.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090235609999999994 2024-04-25T22:03:56.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:56.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876162+0000", 2024-04-25T22:03:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017075900000000001 2024-04-25T22:03:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876261+0000", 2024-04-25T22:03:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9072000000000003e-05 2024-04-25T22:03:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7077 4.27 4:e57158de:::100000014ed.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:56.035 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.134132601000001, 2024-04-25T22:03:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0562571009999999, 2024-04-25T22:03:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832440+0000", 2024-04-25T22:03:56.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:56.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832442+0000", 2024-04-25T22:03:56.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.274e-06 2024-04-25T22:03:56.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:56.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832448+0000", 2024-04-25T22:03:56.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2400000000000004e-06 2024-04-25T22:03:56.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832466+0000", 2024-04-25T22:03:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7549000000000001e-05 2024-04-25T22:03:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832474+0000", 2024-04-25T22:03:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.337e-06 2024-04-25T22:03:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832545+0000", 2024-04-25T22:03:56.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0986000000000001e-05 2024-04-25T22:03:56.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-04-25T22:03:56.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.832554+0000", 2024-04-25T22:03:56.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2269999999999999e-06 2024-04-25T22:03:56.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843167+0000", 2024-04-25T22:03:56.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010613058 2024-04-25T22:03:56.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:56.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.843176+0000", 2024-04-25T22:03:56.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8629999999999997e-06 2024-04-25T22:03:56.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878195+0000", 2024-04-25T22:03:56.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0350192650000001 2024-04-25T22:03:56.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:56.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878952+0000", 2024-04-25T22:03:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00075638400000000003 2024-04-25T22:03:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879100+0000", 2024-04-25T22:03:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014883600000000001 2024-04-25T22:03:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.883699+0000", 2024-04-25T22:03:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045986880000000001 2024-04-25T22:03:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:56.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888487+0000", 2024-04-25T22:03:56.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047874670000000001 2024-04-25T22:03:56.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:56.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888603+0000", 2024-04-25T22:03:56.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011671900000000001 2024-04-25T22:03:56.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:56.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.888698+0000", 2024-04-25T22:03:56.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4208000000000003e-05 2024-04-25T22:03:56.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.043 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:56.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.044 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7085 4.1f 4:f9b21afd:::10000001591.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:56.044 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:56.044 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.130068048999998, 2024-04-25T22:03:56.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0439952969999999, 2024-04-25T22:03:56.044 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:56.044 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:56.044 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:56.044 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:56.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836505+0000", 2024-04-25T22:03:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836507+0000", 2024-04-25T22:03:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.17e-06 2024-04-25T22:03:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:56.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836517+0000", 2024-04-25T22:03:56.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9019999999999994e-06 2024-04-25T22:03:56.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:56.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836603+0000", 2024-04-25T22:03:56.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6248999999999994e-05 2024-04-25T22:03:56.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:56.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836614+0000", 2024-04-25T22:03:56.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0322e-05 2024-04-25T22:03:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841790+0000", 2024-04-25T22:03:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051763929999999996 2024-04-25T22:03:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841803+0000", 2024-04-25T22:03:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3023999999999999e-05 2024-04-25T22:03:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.870557+0000", 2024-04-25T22:03:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.02875396 2024-04-25T22:03:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872184+0000", 2024-04-25T22:03:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016268019999999999 2024-04-25T22:03:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872435+0000", 2024-04-25T22:03:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025088399999999999 2024-04-25T22:03:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879983+0000", 2024-04-25T22:03:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0075479379999999997 2024-04-25T22:03:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880150+0000", 2024-04-25T22:03:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016698900000000001 2024-04-25T22:03:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880300+0000", 2024-04-25T22:03:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000150789 2024-04-25T22:03:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880500+0000", 2024-04-25T22:03:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019987499999999999 2024-04-25T22:03:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7086 4.9 4:91594555:::10000001592.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.129940350999998, 2024-04-25T22:03:56.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0331164559999999, 2024-04-25T22:03:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836633+0000", 2024-04-25T22:03:56.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836634+0000", 2024-04-25T22:03:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1510000000000001e-06 2024-04-25T22:03:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836638+0000", 2024-04-25T22:03:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9740000000000004e-06 2024-04-25T22:03:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:56.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836647+0000", 2024-04-25T22:03:56.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1269999999999992e-06 2024-04-25T22:03:56.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:56.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.836653+0000", 2024-04-25T22:03:56.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8900000000000004e-06 2024-04-25T22:03:56.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841540+0000", 2024-04-25T22:03:56.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048869719999999998 2024-04-25T22:03:56.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:56.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.841550+0000", 2024-04-25T22:03:56.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0644e-05 2024-04-25T22:03:56.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.857739+0000", 2024-04-25T22:03:56.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.016188589 2024-04-25T22:03:56.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.858099+0000", 2024-04-25T22:03:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036013100000000003 2024-04-25T22:03:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.858328+0000", 2024-04-25T22:03:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000228941 2024-04-25T22:03:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.864635+0000", 2024-04-25T22:03:56.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063073199999999999 2024-04-25T22:03:56.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:56.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869508+0000", 2024-04-25T22:03:56.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048727220000000003 2024-04-25T22:03:56.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:56.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869648+0000", 2024-04-25T22:03:56.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000140152 2024-04-25T22:03:56.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:56.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.869749+0000", 2024-04-25T22:03:56.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100843 2024-04-25T22:03:56.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.057 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:56.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.057 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7096 4.9 4:90f65572:::100000016d2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:56.057 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:56.057 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.120746303000001, 2024-04-25T22:03:56.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0364832260000001, 2024-04-25T22:03:56.057 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:56.057 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:56.057 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:56.057 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:56.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:56.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:56.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:56.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845827+0000", 2024-04-25T22:03:56.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:56.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845828+0000", 2024-04-25T22:03:56.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5199999999999995e-07 2024-04-25T22:03:56.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:56.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845834+0000", 2024-04-25T22:03:56.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4710000000000004e-06 2024-04-25T22:03:56.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:56.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845843+0000", 2024-04-25T22:03:56.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6119999999999999e-06 2024-04-25T22:03:56.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:56.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845848+0000", 2024-04-25T22:03:56.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8280000000000002e-06 2024-04-25T22:03:56.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845891+0000", 2024-04-25T22:03:56.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3234e-05 2024-04-25T22:03:56.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:56.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.845898+0000", 2024-04-25T22:03:56.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3839999999999999e-06 2024-04-25T22:03:56.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.873643+0000", 2024-04-25T22:03:56.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.027745162 2024-04-25T22:03:56.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:56.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.873907+0000", 2024-04-25T22:03:56.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026328000000000001 2024-04-25T22:03:56.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-04-25T22:03:56.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.874143+0000", 2024-04-25T22:03:56.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023613799999999999 2024-04-25T22:03:56.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:56.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.878861+0000", 2024-04-25T22:03:56.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047185710000000004 2024-04-25T22:03:56.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:56.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880222+0000", 2024-04-25T22:03:56.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001360984 2024-04-25T22:03:56.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:56.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880647+0000", 2024-04-25T22:03:56.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042470799999999999 2024-04-25T22:03:56.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:56.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882310+0000", 2024-04-25T22:03:56.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001662902 2024-04-25T22:03:56.063 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.063 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:56.063 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.063 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7098 3.9 3:9359a9e9:::100000016e0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:56.063 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:56.064 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.120143216999999, 2024-04-25T22:03:56.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.034065142, 2024-04-25T22:03:56.064 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:56.064 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:56.064 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-04-25T22:03:56.064 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:56.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:56.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:56.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:56.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846430+0000", 2024-04-25T22:03:56.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:56.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846432+0000", 2024-04-25T22:03:56.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.88e-06 2024-04-25T22:03:56.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:56.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846440+0000", 2024-04-25T22:03:56.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7120000000000006e-06 2024-04-25T22:03:56.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:56.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846463+0000", 2024-04-25T22:03:56.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2416e-05 2024-04-25T22:03:56.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:56.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846479+0000", 2024-04-25T22:03:56.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6484999999999999e-05 2024-04-25T22:03:56.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846718+0000", 2024-04-25T22:03:56.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023839299999999999 2024-04-25T22:03:56.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:56.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.846729+0000", 2024-04-25T22:03:56.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0896999999999999e-05 2024-04-25T22:03:56.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872537+0000", 2024-04-25T22:03:56.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0258087 2024-04-25T22:03:56.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:56.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.872831+0000", 2024-04-25T22:03:56.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029391399999999999 2024-04-25T22:03:56.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:56.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880495+0000", 2024-04-25T22:03:56.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0076637449999999996 2024-04-25T22:03:56.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.068 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:56.069 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.069 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7100 4.1 4:83bc2484:::100000016e2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:56.069 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:56.069 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.119090088, 2024-04-25T22:03:56.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.03260128, 2024-04-25T22:03:56.069 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:56.069 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:56.069 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:56.069 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:56.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:56.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:56.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:56.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847483+0000", 2024-04-25T22:03:56.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:56.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847484+0000", 2024-04-25T22:03:56.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.443e-06 2024-04-25T22:03:56.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:56.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847491+0000", 2024-04-25T22:03:56.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4300000000000003e-06 2024-04-25T22:03:56.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:56.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847505+0000", 2024-04-25T22:03:56.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4014e-05 2024-04-25T22:03:56.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:56.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847514+0000", 2024-04-25T22:03:56.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4350000000000003e-06 2024-04-25T22:03:56.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847571+0000", 2024-04-25T22:03:56.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6338999999999997e-05 2024-04-25T22:03:56.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:56.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.847580+0000", 2024-04-25T22:03:56.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0680000000000003e-06 2024-04-25T22:03:56.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862224+0000", 2024-04-25T22:03:56.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0146447279999999 2024-04-25T22:03:56.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:56.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862676+0000", 2024-04-25T22:03:56.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045117300000000003 2024-04-25T22:03:56.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:56.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.862992+0000", 2024-04-25T22:03:56.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000316607 2024-04-25T22:03:56.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:56.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879035+0000", 2024-04-25T22:03:56.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016043168999999999 2024-04-25T22:03:56.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:56.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879762+0000", 2024-04-25T22:03:56.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00072643100000000004 2024-04-25T22:03:56.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:56.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879993+0000", 2024-04-25T22:03:56.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023091799999999999 2024-04-25T22:03:56.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:56.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880084+0000", 2024-04-25T22:03:56.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1525000000000002e-05 2024-04-25T22:03:56.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.075 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:56.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.075 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7105 4.1d 4:b83d3758:::10000001718.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:56.076 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:56.076 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.118039799999998, 2024-04-25T22:03:56.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0317263169999999, 2024-04-25T22:03:56.076 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:56.076 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:56.076 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:56.076 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:56.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:56.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:56.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:56.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848533+0000", 2024-04-25T22:03:56.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:56.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848534+0000", 2024-04-25T22:03:56.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1200000000000001e-06 2024-04-25T22:03:56.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:56.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848541+0000", 2024-04-25T22:03:56.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4749999999999998e-06 2024-04-25T22:03:56.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:56.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848551+0000", 2024-04-25T22:03:56.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.039e-05 2024-04-25T22:03:56.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:56.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848558+0000", 2024-04-25T22:03:56.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2520000000000002e-06 2024-04-25T22:03:56.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848703+0000", 2024-04-25T22:03:56.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014466699999999999 2024-04-25T22:03:56.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:56.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.848709+0000", 2024-04-25T22:03:56.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-04-25T22:03:56.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.866810+0000", 2024-04-25T22:03:56.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.018101293 2024-04-25T22:03:56.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:56.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867282+0000", 2024-04-25T22:03:56.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00047148999999999997 2024-04-25T22:03:56.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:56.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.867555+0000", 2024-04-25T22:03:56.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027314100000000002 2024-04-25T22:03:56.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:56.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.877648+0000", 2024-04-25T22:03:56.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010093275000000001 2024-04-25T22:03:56.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:56.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880012+0000", 2024-04-25T22:03:56.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023639590000000001 2024-04-25T22:03:56.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:56.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880157+0000", 2024-04-25T22:03:56.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000144532 2024-04-25T22:03:56.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:56.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880260+0000", 2024-04-25T22:03:56.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103016 2024-04-25T22:03:56.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.081 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:56.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.082 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7116 4.27 4:e60ee3a4:::10000001a5f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:56.082 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:56.082 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.113885191000001, 2024-04-25T22:03:56.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0375457480000001, 2024-04-25T22:03:56.082 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:56.082 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:56.082 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:56.082 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:56.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:56.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:56.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:56.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:56.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:56.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852688+0000", 2024-04-25T22:03:56.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8100000000000003e-07 2024-04-25T22:03:56.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:56.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852694+0000", 2024-04-25T22:03:56.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0360000000000003e-06 2024-04-25T22:03:56.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:56.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852702+0000", 2024-04-25T22:03:56.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1470000000000004e-06 2024-04-25T22:03:56.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:56.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852708+0000", 2024-04-25T22:03:56.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1210000000000003e-06 2024-04-25T22:03:56.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852762+0000", 2024-04-25T22:03:56.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4166000000000003e-05 2024-04-25T22:03:56.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:56.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.852769+0000", 2024-04-25T22:03:56.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8000000000000001e-06 2024-04-25T22:03:56.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880804+0000", 2024-04-25T22:03:56.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.028035695 2024-04-25T22:03:56.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:56.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881105+0000", 2024-04-25T22:03:56.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030039999999999998 2024-04-25T22:03:56.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:56.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.881373+0000", 2024-04-25T22:03:56.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026843499999999997 2024-04-25T22:03:56.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:56.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884999+0000", 2024-04-25T22:03:56.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036262070000000002 2024-04-25T22:03:56.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:56.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.889903+0000", 2024-04-25T22:03:56.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049036260000000003 2024-04-25T22:03:56.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:56.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890114+0000", 2024-04-25T22:03:56.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021130500000000001 2024-04-25T22:03:56.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:56.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890234+0000", 2024-04-25T22:03:56.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011922900000000001 2024-04-25T22:03:56.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.088 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:56.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.088 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7121 4.1f 4:fab6744c:::10000001a64.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:56.088 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:56.088 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.113392520000001, 2024-04-25T22:03:56.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.031414587, 2024-04-25T22:03:56.089 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:56.089 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:56.089 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:56.089 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:56.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:56.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:56.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:56.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:56.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:56.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853181+0000", 2024-04-25T22:03:56.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1299999999999999e-07 2024-04-25T22:03:56.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:56.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853184+0000", 2024-04-25T22:03:56.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1779999999999999e-06 2024-04-25T22:03:56.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:56.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853192+0000", 2024-04-25T22:03:56.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.294e-06 2024-04-25T22:03:56.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:56.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853196+0000", 2024-04-25T22:03:56.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6330000000000004e-06 2024-04-25T22:03:56.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853249+0000", 2024-04-25T22:03:56.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2785999999999999e-05 2024-04-25T22:03:56.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:56.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.853260+0000", 2024-04-25T22:03:56.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1027e-05 2024-04-25T22:03:56.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.875944+0000", 2024-04-25T22:03:56.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0226834810000001 2024-04-25T22:03:56.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:56.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876230+0000", 2024-04-25T22:03:56.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000286357 2024-04-25T22:03:56.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:56.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.876512+0000", 2024-04-25T22:03:56.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028174500000000002 2024-04-25T22:03:56.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:56.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880727+0000", 2024-04-25T22:03:56.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042150520000000004 2024-04-25T22:03:56.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:56.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884386+0000", 2024-04-25T22:03:56.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036589069999999999 2024-04-25T22:03:56.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:56.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884502+0000", 2024-04-25T22:03:56.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000115862 2024-04-25T22:03:56.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:56.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.884595+0000", 2024-04-25T22:03:56.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3552000000000001e-05 2024-04-25T22:03:56.094 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.094 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:56.094 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.094 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7127 4.22 4:476940b8:::10000001b50.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:56.095 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:56.095 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.112284525, 2024-04-25T22:03:56.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.035873665, 2024-04-25T22:03:56.095 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:56.095 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:56.095 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:56.095 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:56.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:56.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:56.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:56.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854289+0000", 2024-04-25T22:03:56.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:56.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854290+0000", 2024-04-25T22:03:56.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.313e-06 2024-04-25T22:03:56.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:56.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854295+0000", 2024-04-25T22:03:56.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3580000000000002e-06 2024-04-25T22:03:56.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:56.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854310+0000", 2024-04-25T22:03:56.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4742e-05 2024-04-25T22:03:56.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:56.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854318+0000", 2024-04-25T22:03:56.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2570000000000007e-06 2024-04-25T22:03:56.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854383+0000", 2024-04-25T22:03:56.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4535999999999993e-05 2024-04-25T22:03:56.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:56.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.854390+0000", 2024-04-25T22:03:56.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3930000000000002e-06 2024-04-25T22:03:56.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879471+0000", 2024-04-25T22:03:56.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0250810260000001 2024-04-25T22:03:56.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:56.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.879790+0000", 2024-04-25T22:03:56.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031862699999999998 2024-04-25T22:03:56.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:56.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.880048+0000", 2024-04-25T22:03:56.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025776199999999998 2024-04-25T22:03:56.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:56.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882261+0000", 2024-04-25T22:03:56.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022130259999999999 2024-04-25T22:03:56.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:56.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.889734+0000", 2024-04-25T22:03:56.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0074735859999999999 2024-04-25T22:03:56.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:56.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890063+0000", 2024-04-25T22:03:56.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032892000000000002 2024-04-25T22:03:56.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:56.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890162+0000", 2024-04-25T22:03:56.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9118999999999997e-05 2024-04-25T22:03:56.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.104 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:56.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.104 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(mds.0.3:7135 4.27 4:e7bfb438:::10000001b58.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:03:56.104 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:56.104 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.109474994999999, 2024-04-25T22:03:56.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.033436429, 2024-04-25T22:03:56.104 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-04-25T22:03:56.104 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-04-25T22:03:56.104 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:03:56.104 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-04-25T22:03:56.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-04-25T22:03:56.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:56.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-04-25T22:03:56.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857098+0000", 2024-04-25T22:03:56.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-04-25T22:03:56.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-04-25T22:03:56.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857099+0000", 2024-04-25T22:03:56.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0270000000000001e-06 2024-04-25T22:03:56.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-04-25T22:03:56.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857104+0000", 2024-04-25T22:03:56.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6909999999999996e-06 2024-04-25T22:03:56.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-04-25T22:03:56.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857116+0000", 2024-04-25T22:03:56.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2384999999999999e-05 2024-04-25T22:03:56.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-04-25T22:03:56.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857124+0000", 2024-04-25T22:03:56.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3080000000000008e-06 2024-04-25T22:03:56.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857175+0000", 2024-04-25T22:03:56.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0107e-05 2024-04-25T22:03:56.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-04-25T22:03:56.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:32.857185+0000", 2024-04-25T22:03:56.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0244999999999999e-05 2024-04-25T22:03:56.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-04-25T22:03:56.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882135+0000", 2024-04-25T22:03:56.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.024950322 2024-04-25T22:03:56.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-04-25T22:03:56.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882426+0000", 2024-04-25T22:03:56.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029100699999999997 2024-04-25T22:03:56.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 0", 2024-04-25T22:03:56.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.882689+0000", 2024-04-25T22:03:56.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026236800000000002 2024-04-25T22:03:56.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-04-25T22:03:56.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.885017+0000", 2024-04-25T22:03:56.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023282020000000001 2024-04-25T22:03:56.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:03:56.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890320+0000", 2024-04-25T22:03:56.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0053037049999999997 2024-04-25T22:03:56.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-04-25T22:03:56.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890428+0000", 2024-04-25T22:03:56.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000107593 2024-04-25T22:03:56.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-25T22:03:56.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-04-25T22:03:56.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-04-25T22:03:56.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-04-25T22:03:33.890534+0000", 2024-04-25T22:03:56.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106469 2024-04-25T22:03:56.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.110 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:56.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-25T22:03:56.110 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-25T22:03:56.111 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-25T22:03:56.111 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:03:56.222 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-04-25T22:03:57.091 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:03:57.599 INFO:tasks.ceph.mgr.x.smithi044.stderr:2024-04-25T22:03:57.594+0000 7f4361dce640 -1 calc_pg_upmaps abort due to max <= 0 2024-04-25T22:03:58.098 INFO:teuthology.orchestra.run.smithi044.stderr:noscrub is unset 2024-04-25T22:03:58.124 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:03:58.225 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-25T22:03:59.100 INFO:teuthology.orchestra.run.smithi044.stderr:nodeep-scrub is unset 2024-04-25T22:04:00.224 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:04:00.335 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-04-25T22:04:04.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~6s 2024-04-25T22:04:04.336 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:04:04.447 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2024-04-25T22:04:04.548 INFO:teuthology.orchestra.console.smithi057:Power off completed 2024-04-25T22:04:09.650 INFO:tasks.thrashosds.thrasher:reviving osd 2024-04-25T22:04:09.650 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-04-25T22:04:09.651 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T22:04:09.651 INFO:teuthology.orchestra.console.smithi057:Power on 2024-04-25T22:04:09.651 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-25T22:04:09.675 DEBUG:teuthology.orchestra.console.smithi057:power on output: Chassis Power Control: Up/On 2024-04-25T22:04:09.675 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:04:09.698 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2024-04-25T22:04:09.840 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~12s 2024-04-25T22:04:13.699 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:04:13.811 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2024-04-25T22:04:15.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~17s 2024-04-25T22:04:17.812 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:04:17.923 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-04-25T22:04:18.025 INFO:teuthology.orchestra.console.smithi057:Power on completed 2024-04-25T22:04:18.126 DEBUG:teuthology.orchestra.console.smithi057:Waiting for login prompt 2024-04-25T22:04:18.126 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi057 2024-04-25T22:04:21.454 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~23s 2024-04-25T22:04:27.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~29s 2024-04-25T22:04:33.070 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2024-04-25T22:04:38.877 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~41s 2024-04-25T22:04:44.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~46s 2024-04-25T22:04:50.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~52s 2024-04-25T22:04:56.295 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~58s 2024-04-25T22:05:02.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~64s 2024-04-25T22:05:07.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~70s 2024-04-25T22:05:13.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~75s 2024-04-25T22:05:19.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~81s 2024-04-25T22:05:25.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~87s 2024-04-25T22:05:31.131 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~93s 2024-04-25T22:05:36.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~99s 2024-04-25T22:05:42.741 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~105s 2024-04-25T22:05:48.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~110s 2024-04-25T22:05:54.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~116s 2024-04-25T22:06:00.160 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~122s 2024-04-25T22:06:05.967 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~128s 2024-04-25T22:06:10.150 DEBUG:teuthology.orchestra.console.smithi057:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..    \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..    \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..    \x80 \x80 \x80  Intel(R) Boot Agent GE v1.5.13 Copyright (C) 1997-2013, Intel Corporation  Initializing and establishing link...                     PXE-E61: Media test failure, check cable PXE-M0F: Exiting Intel Boot Agent. Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation Initializing and establishing link... CLIENT MAC ADDR: 0C C4 7A BD 15 62 GUID: 00000000 0000 0000 0000 0CC47A6BFF86 DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.57 M 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 01:00.0, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.57 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 Intel(R) Boot Agent GE v1.5.13 Copyright (C) 1997-2013, Intel Corporation  PXE-E61: Media test failure, check cable PXE-M0F: Exiting Intel Boot Agent.   Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A BD 15 62 GUID: 00000000 0000 0000 0000 0CC47A6BFF86 CLIENT IP: 172.21.15.57 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 01:00.0, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices...ok   iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:bd:15:62).... Configuring (net0 0c:c4:7a:bd:15:62)..... Configuring (net0 0c:c4:7a:bd:15:62)...... Configuring (net0 0c:c4:7a:bd:15:62)....... Configuring (net0 0c:c4:7a:bd:15:62)........ PXE-E61: Media test failure, check cable   GNU GRUB version 2.04  ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************  Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.     The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                   [ 0.000000] microcode: microcode updated early to revision 0x49, date = 2021-08-11 [ 0.000000] Linux version 5.15.0-105-generic (buildd@lcy02-amd64-007) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #115-Ubuntu SMP Mon Apr 15 09:52:04 UTC 2024 (Ubuntu 5.15.0-105.115-generic 5.15.148) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000079230fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000079234000-0x0000000079849fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007984a000-0x000000007996afff] usable [ 0.000000] BIOS-e820: [mem 0x000000007996b000-0x0000000079e00fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079e01000-0x000000007bd4cfff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007bd4d000-0x000000007bd4dfff] usable [ 0.000000] BIOS-e820: [mem 0x000000007bd4e000-0x000000007bdd3fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007bdd4000-0x000000007bf50fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000080000000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 1.0c 09/07/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.157 MHz processor [ 0.000424] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000609] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001943] last_pfn = 0x7bf51 max_arch_pfn = 0x400000000 [ 0.008301] found SMP MP-table at [mem 0x000fd910-0x000fd91f] [ 0.008316] Using GB pages for direct mapping [ 0.008647] RAMDISK: [mem 0x300cf000-0x3405efff] [ 0.008652] ACPI: Early table checksum verification disabled [ 0.008656] ACPI: RSDP 0x00000000000F0530 000024 (v02 SUPERM) [ 0.008660] ACPI: XSDT 0x0000000079A7F0A0 0000C4 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008665] ACPI: FACP 0x0000000079AAC298 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008670] ACPI: DSDT 0x0000000079A7F200 02D091 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008673] ACPI: FACS 0x0000000079DFEF80 000040 [ 0.008676] ACPI: APIC 0x0000000079AAC3A8 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008678] ACPI: FPDT 0x0000000079AAC470 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008681] ACPI: FIDT 0x0000000079AAC4B8 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008684] ACPI: SPMI 0x0000000079AAC558 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008687] ACPI: MCFG 0x0000000079AAC598 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008690] ACPI: UEFI 0x0000000079AAC5D8 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008693] ACPI: BDAT 0x0000000079AAC620 000030 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008696] ACPI: HPET 0x0000000079AAC650 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008698] ACPI: PMCT 0x0000000079AAC688 000064 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008701] ACPI: WDDT 0x0000000079AAC6F0 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008704] ACPI: SSDT 0x0000000079AAC730 00EDE7 (v01 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008707] ACPI: SSDT 0x0000000079ABB518 002117 (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008710] ACPI: SSDT 0x0000000079ABD630 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008713] ACPI: PRAD 0x0000000079ABD698 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008716] ACPI: DMAR 0x0000000079ABD7A0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008719] ACPI: HEST 0x0000000079ABD860 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008722] ACPI: BERT 0x0000000079ABDAE0 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008724] ACPI: ERST 0x0000000079ABDB10 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008727] ACPI: EINJ 0x0000000079ABDD40 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008730] ACPI: Reserving FACP table memory at [mem 0x79aac298-0x79aac3a3] [ 0.008731] ACPI: Reserving DSDT table memory at [mem 0x79a7f200-0x79aac290] [ 0.008732] ACPI: Reserving FACS table memory at [mem 0x79dfef80-0x79dfefbf] [ 0.008733] ACPI: Reserving APIC table memory at [mem 0x79aac3a8-0x79aac46f] [ 0.008734] ACPI: Reserving FPDT table memory at [mem 0x79aac470-0x79aac4b3] [ 0.008735] ACPI: Reserving FIDT table memory at [mem 0x79aac4b8-0x79aac553] [ 0.008736] ACPI: Reserving SPMI table memory at [mem 0x79aac558-0x79aac597] [ 0.008737] ACPI: Reserving MCFG table memory at [mem 0x79aac598-0x79aac5d3] [ 0.008738] ACPI: Reserving UEFI table memory at [mem 0x79aac5d8-0x79aac619] [ 0.008739] ACPI: Reserving BDAT table memory at [mem 0x79aac620-0x79aac64f] [ 0.008740] ACPI: Reserving HPET table memory at [mem 0x79aac650-0x79aac687] [ 0.008741] ACPI: Reserving PMCT table memory at [mem 0x79aac688-0x79aac6eb] [ 0.008742] ACPI: Reserving WDDT table memory at [mem 0x79aac6f0-0x79aac72f] [ 0.008743] ACPI: Reserving SSDT table memory at [mem 0x79aac730-0x79abb516] [ 0.008744] ACPI: Reserving SSDT table memory at [mem 0x79abb518-0x79abd62e] [ 0.008745] ACPI: Reserving SSDT table memory at [mem 0x79abd630-0x79abd693] [ 0.008746] ACPI: Reserving PRAD table memory at [mem 0x79abd698-0x79abd799] [ 0.008747] ACPI: Reserving DMAR table memory at [mem 0x79abd7a0-0x79abd85b] [ 0.008749] ACPI: Reserving HEST table memory at [mem 0x79abd860-0x79abdadb] [ 0.008750] ACPI: Reserving BERT table memory at [mem 0x79abdae0-0x79abdb0f] [ 0.008751] ACPI: Reserving ERST table memory at [mem 0x79abdb10-0x79abdd3f] [ 0.008752] ACPI: Reserving EINJ table memory at [mem 0x79abdd40-0x79abde6f] [ 0.008849] No NUMA configuration found [ 0.008850] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008860] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.009158] Zone ranges: [ 0.009159] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.009161] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.009163] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.009165] Device empty [ 0.009166] Movable zone start for each node [ 0.009169] Early memory node ranges [ 0.009169] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.009171] node 0: [mem 0x0000000000100000-0x0000000079230fff] [ 0.009172] node 0: [mem 0x000000007984a000-0x000000007996afff] [ 0.009173] node 0: [mem 0x000000007bd4d000-0x000000007bd4dfff] [ 0.009174] node 0: [mem 0x000000007bdd4000-0x000000007bf50fff] [ 0.009175] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.009179] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.009184] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.009221] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.013644] On node 0, zone DMA32: 1561 pages in unavailable ranges [ 0.013737] On node 0, zone DMA32: 9186 pages in unavailable ranges [ 0.013744] On node 0, zone DMA32: 134 pages in unavailable ranges [ 0.085140] On node 0, zone Normal: 16559 pages in unavailable ranges [ 0.085261] ACPI: PM-Timer IO Port: 0x408 [ 0.085270] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.085271] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.085272] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.085273] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.085274] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.085275] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.085276] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.085277] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.085286] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23 [ 0.085291] IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-47 [ 0.085293] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.085295] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.085299] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.085301] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.085305] TSC deadline timer available [ 0.085306] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.085319] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.085321] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.085322] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.085324] PM: hibernation: Registered nosave memory: [mem 0x79231000-0x79233fff] [ 0.085325] PM: hibernation: Registered nosave memory: [mem 0x79234000-0x79849fff] [ 0.085326] PM: hibernation: Registered nosave memory: [mem 0x7996b000-0x79e00fff] [ 0.085327] PM: hibernation: Registered nosave memory: [mem 0x79e01000-0x7bd4cfff] [ 0.085329] PM: hibernation: Registered nosave memory: [mem 0x7bd4e000-0x7bdd3fff] [ 0.085330] PM: hibernation: Registered nosave memory: [mem 0x7bf51000-0x7fffffff] [ 0.085331] PM: hibernation: Registered nosave memory: [mem 0x80000000-0x8fffffff] [ 0.085332] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.085333] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff] [ 0.085334] PM: hibernation: Registered nosave memory: [mem 0xfed20000-0xfeffffff] [ 0.085334] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.085336] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.085337] Booting paravirtualized kernel on bare hardware [ 0.085340] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.085347] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.085590] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u262144 [ 0.085625] Built 1 zonelists, mobility grouping on. Total pages: 8230268 [ 0.085627] Policy zone: Normal [ 0.085628] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.085690] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic", will be passed to user space. [ 0.088259] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.089626] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.089719] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.174478] Memory: 32678904K/33444200K available (16393K kernel code, 4395K rwdata, 10948K rodata, 3352K init, 18716K bss, 765036K reserved, 0K cma-reserved) [ 0.174761] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.174777] Kernel/User page tables isolation: enabled [ 0.174810] ftrace: allocating 50694 entries in 199 pages [ 0.195010] ftrace: allocated 199 pages with 5 groups [ 0.195132] rcu: Hierarchical RCU implementation. [ 0.195134] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.195136] Rude variant of Tasks RCU enabled. [ 0.195136] Tracing variant of Tasks RCU enabled. [ 0.195137] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.195138] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.198603] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.198804] random: crng init done [ 0.203733] Console: colour VGA+ 80x25 [ 0.217521] printk: console [tty0] enabled [ 1.313868] printk: console [ttyS1] enabled [ 1.318126] ACPI: Core revision 20210730 [ 1.322266] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.331491] APIC: Switch to symmetric I/O mode setup [ 1.336528] DMAR: Host address width 46 [ 1.340437] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.345823] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap d2078c106f0466 ecap f020de [ 1.353828] DMAR: RMRR base: 0x0000007bac6000 end: 0x0000007bad4fff [ 1.360165] DMAR: ATSR flags: 0x0 [ 1.363549] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.369889] DMAR-IR: IOAPIC id 8 under DRHD base 0xfbffc000 IOMMU 0 [ 1.376312] DMAR-IR: IOAPIC id 9 under DRHD base 0xfbffc000 IOMMU 0 [ 1.382733] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.388199] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.388200] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.403383] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.408759] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.415079] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.439485] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3273e560663, max_idle_ns: 440795248670 ns [ 1.450097] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.31 BogoMIPS (lpj=14000628) [ 1.454112] CPU0: Thermal monitoring enabled (TM1) [ 1.458165] process: using mwait in idle threads [ 1.462096] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024 [ 1.466094] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4 [ 1.470096] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.474095] Spectre V2 : Mitigation: Retpolines [ 1.478094] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.482094] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.486094] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.490095] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.494094] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.498094] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.502098] MDS: Mitigation: Clear CPU buffers [ 1.506094] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.510099] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.514094] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.518094] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.522094] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.526094] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.549095] Freeing SMP alternatives memory: 44K [ 1.550095] pid_max: default: 32768 minimum: 301 [ 1.554116] LSM: Security Framework initializing [ 1.558102] landlock: Up and running. [ 1.562094] Yama: becoming mindful. [ 1.566113] AppArmor: AppArmor initialized [ 1.570163] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.574141] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.578468] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.582100] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz (family: 0x6, model: 0x3f, stepping: 0x2) [ 1.586210] Performance Events: PEBS fmt2+, Haswell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.590095] ... version: 3 [ 1.594094] ... bit width: 48 [ 1.598094] ... generic registers: 4 [ 1.602094] ... value mask: 0000ffffffffffff [ 1.606094] ... max period: 00007fffffffffff [ 1.610094] ... fixed-purpose events: 3 [ 1.614094] ... event mask: 000000070000000f [ 1.618168] signal: max sigframe size: 1776 [ 1.622111] rcu: Hierarchical SRCU implementation. [ 1.626848] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.630165] smp: Bringing up secondary CPUs ... [ 1.634183] x86: Booting SMP configuration: [ 1.638097] .... node #0, CPUs: #1 #2 #3 #4 [ 1.646842] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.654095] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.658205] #5 #6 #7 [ 1.658802] smp: Brought up 1 node, 8 CPUs [ 1.666097] smpboot: Max logical packages: 1 [ 1.670095] smpboot: Total of 8 processors activated (56002.51 BogoMIPS) [ 1.678890] devtmpfs: initialized [ 1.682138] x86/mm: Memory block size: 128MB [ 1.687686] ACPI: PM: Registering ACPI NVS region [mem 0x7996b000-0x79e00fff] (4808704 bytes) [ 1.690176] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.694106] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.698146] pinctrl core: initialized pinctrl subsystem [ 1.702191] PM: RTC time: 22:05:40, date: 2024-04-25 [ 1.706211] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.710477] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.714447] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.718488] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.722106] audit: initializing netlink subsys (disabled) [ 1.726117] audit: type=2000 audit(1714082738.352:1): state=initialized audit_enabled=0 res=1 [ 1.726216] thermal_sys: Registered thermal governor 'fair_share' [ 1.730096] thermal_sys: Registered thermal governor 'bang_bang' [ 1.734094] thermal_sys: Registered thermal governor 'step_wise' [ 1.738094] thermal_sys: Registered thermal governor 'user_space' [ 1.742094] thermal_sys: Registered thermal governor 'power_allocator' [ 1.746100] EISA bus registered [ 1.753309] cpuidle: using governor ladder [ 1.754097] cpuidle: using governor menu [ 1.758117] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.762096] ACPI: bus type PCI registered [ 1.766095] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.770153] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.774096] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.778108] PCI: Using configuration type 1 for base access [ 1.782121] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 1.787087] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.790113] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.794096] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.798175] ACPI: Added _OSI(Module Device) [ 1.802097] ACPI: Added _OSI(Processor Device) [ 1.806102] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.810094] ACPI: Added _OSI(Processor Aggregator Device) [ 1.814094] ACPI: Added _OSI(Linux-Dell-Video) [ 1.818094] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.822095] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.861236] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.864538] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.870269] ACPI: Dynamic OEM Table Load: [ 1.877835] ACPI: Interpreter enabled [ 1.878108] ACPI: PM: (supports S0 S4 S5) [ 1.882097] ACPI: Using IOAPIC for interrupt routing [ 1.886119] HEST: Enabling Firmware First mode for corrected errors. [ 1.890187] HEST: Table parsing has been initialized. [ 1.894248] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.898097] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.902094] PCI: Using E820 reservations for host bridge windows [ 1.906723] ACPI: Enabled 6 GPEs in block 00 to 3F [ 1.930158] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.934098] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.940283] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.943186] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.946095] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.950130] PCI host bridge to bus 0000:ff [ 1.954097] pci_bus 0000:ff: root bus resource [bus ff] [ 1.958106] pci 0000:ff:0b.0: [8086:2f81] type 00 class 0x088000 [ 1.962162] pci 0000:ff:0b.1: [8086:2f36] type 00 class 0x110100 [ 1.966151] pci 0000:ff:0b.2: [8086:2f37] type 00 class 0x110100 [ 1.970148] pci 0000:ff:0c.0: [8086:2fe0] type 00 class 0x088000 [ 1.974148] pci 0000:ff:0c.1: [8086:2fe1] type 00 class 0x088000 [ 1.978146] pci 0000:ff:0c.2: [8086:2fe2] type 00 class 0x088000 [ 1.982147] pci 0000:ff:0c.3: [8086:2fe3] type 00 class 0x088000 [ 1.986150] pci 0000:ff:0f.0: [8086:2ff8] type 00 class 0x088000 [ 1.990150] pci 0000:ff:0f.1: [8086:2ff9] type 00 class 0x088000 [ 1.994149] pci 0000:ff:0f.4: [8086:2ffc] type 00 class 0x088000 [ 1.998147] pci 0000:ff:0f.5: [8086:2ffd] type 00 class 0x088000 [ 2.002150] pci 0000:ff:0f.6: [8086:2ffe] type 00 class 0x088000 [ 2.006147] pci 0000:ff:10.0: [8086:2f1d] type 00 class 0x088000 [ 2.010147] pci 0000:ff:10.1: [8086:2f34] type 00 class 0x110100 [ 2.014147] pci 0000:ff:10.5: [8086:2f1e] type 00 class 0x088000 [ 2.018147] pci 0000:ff:10.6: [8086:2f7d] type 00 class 0x110100 [ 2.022150] pci 0000:ff:10.7: [8086:2f1f] type 00 class 0x088000 [ 2.026148] pci 0000:ff:12.0: [8086:2fa0] type 00 class 0x088000 [ 2.030149] pci 0000:ff:12.1: [8086:2f30] type 00 class 0x110100 [ 2.034152] pci 0000:ff:13.0: [8086:2fa8] type 00 class 0x088000 [ 2.038152] pci 0000:ff:13.1: [8086:2f71] type 00 class 0x088000 [ 2.042151] pci 0000:ff:13.2: [8086:2faa] type 00 class 0x088000 [ 2.046151] pci 0000:ff:13.3: [8086:2fab] type 00 class 0x088000 [ 2.050153] pci 0000:ff:13.4: [8086:2fac] type 00 class 0x088000 [ 2.054157] pci 0000:ff:13.5: [8086:2fad] type 00 class 0x088000 [ 2.058151] pci 0000:ff:13.6: [8086:2fae] type 00 class 0x088000 [ 2.062150] pci 0000:ff:13.7: [8086:2faf] type 00 class 0x088000 [ 2.066151] pci 0000:ff:14.0: [8086:2fb0] type 00 class 0x088000 [ 2.070152] pci 0000:ff:14.1: [8086:2fb1] type 00 class 0x088000 [ 2.074151] pci 0000:ff:14.2: [8086:2fb2] type 00 class 0x088000 [ 2.078151] pci 0000:ff:14.3: [8086:2fb3] type 00 class 0x088000 [ 2.082150] pci 0000:ff:14.4: [8086:2fbc] type 00 class 0x088000 [ 2.086156] pci 0000:ff:14.5: [8086:2fbd] type 00 class 0x088000 [ 2.090148] pci 0000:ff:14.6: [8086:2fbe] type 00 class 0x088000 [ 2.094150] pci 0000:ff:14.7: [8086:2fbf] type 00 class 0x088000 [ 2.098149] pci 0000:ff:15.0: [8086:2fb4] type 00 class 0x088000 [ 2.102152] pci 0000:ff:15.1: [8086:2fb5] type 00 class 0x088000 [ 2.106151] pci 0000:ff:15.2: [8086:2fb6] type 00 class 0x088000 [ 2.110152] pci 0000:ff:15.3: [8086:2fb7] type 00 class 0x088000 [ 2.114153] pci 0000:ff:16.0: [8086:2f68] type 00 class 0x088000 [ 2.118155] pci 0000:ff:16.6: [8086:2f6e] type 00 class 0x088000 [ 2.122150] pci 0000:ff:16.7: [8086:2f6f] type 00 class 0x088000 [ 2.126149] pci 0000:ff:17.0: [8086:2fd0] type 00 class 0x088000 [ 2.130151] pci 0000:ff:17.4: [8086:2fb8] type 00 class 0x088000 [ 2.134148] pci 0000:ff:17.5: [8086:2fb9] type 00 class 0x088000 [ 2.138149] pci 0000:ff:17.6: [8086:2fba] type 00 class 0x088000 [ 2.142148] pci 0000:ff:17.7: [8086:2fbb] type 00 class 0x088000 [ 2.146152] pci 0000:ff:1e.0: [8086:2f98] type 00 class 0x088000 [ 2.150151] pci 0000:ff:1e.1: [8086:2f99] type 00 class 0x088000 [ 2.154149] pci 0000:ff:1e.2: [8086:2f9a] type 00 class 0x088000 [ 2.158148] pci 0000:ff:1e.3: [8086:2fc0] type 00 class 0x088000 [ 2.162122] pci 0000:ff:1e.4: [8086:2f9c] type 00 class 0x088000 [ 2.166151] pci 0000:ff:1f.0: [8086:2f88] type 00 class 0x088000 [ 2.170149] pci 0000:ff:1f.2: [8086:2f8a] type 00 class 0x088000 [ 2.174235] acpi LNXCPU:08: Entry not well-defined, consider updating BIOS [ 2.179052] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.182099] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.186762] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.191216] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.194095] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.198746] PCI host bridge to bus 0000:00 [ 2.202097] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.206094] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.210094] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.214094] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.218094] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.222094] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.226094] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.230202] pci 0000:00:00.0: [8086:2f00] type 00 class 0x060000 [ 2.234310] pci 0000:00:01.0: [8086:2f02] type 01 class 0x060400 [ 2.238164] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.242274] pci 0000:00:02.0: [8086:2f04] type 01 class 0x060400 [ 2.246162] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.250263] pci 0000:00:03.0: [8086:2f08] type 01 class 0x060400 [ 2.254162] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.258258] pci 0000:00:04.0: [8086:2f20] type 00 class 0x088000 [ 2.262114] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.266293] pci 0000:00:04.1: [8086:2f21] type 00 class 0x088000 [ 2.270113] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.274291] pci 0000:00:04.2: [8086:2f22] type 00 class 0x088000 [ 2.278113] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.282290] pci 0000:00:04.3: [8086:2f23] type 00 class 0x088000 [ 2.286113] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.290296] pci 0000:00:04.4: [8086:2f24] type 00 class 0x088000 [ 2.294113] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.298290] pci 0000:00:04.5: [8086:2f25] type 00 class 0x088000 [ 2.302115] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.306294] pci 0000:00:04.6: [8086:2f26] type 00 class 0x088000 [ 2.310113] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.314290] pci 0000:00:04.7: [8086:2f27] type 00 class 0x088000 [ 2.318113] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.322246] pci 0000:00:05.0: [8086:2f28] type 00 class 0x088000 [ 2.326316] pci 0000:00:05.1: [8086:2f29] type 00 class 0x088000 [ 2.330248] pci 0000:00:05.2: [8086:2f2a] type 00 class 0x088000 [ 2.334266] pci 0000:00:05.4: [8086:2f2c] type 00 class 0x080020 [ 2.338109] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.342338] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.346391] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.350116] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.354106] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.358106] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.362106] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.366106] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.370106] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.374136] pci 0000:00:11.4: PME# supported from D3hot [ 2.378254] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.382120] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.386167] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.390246] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.394120] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.398172] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.402243] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.406120] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.410172] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.414256] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.418117] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.422200] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.426250] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.430185] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.434260] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.438187] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.442260] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.446188] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.450268] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.454117] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.458199] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.462257] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.466371] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.470114] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.474104] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.478104] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.482107] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.486105] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.490104] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.494130] pci 0000:00:1f.2: PME# supported from D3hot [ 2.498239] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.502120] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.506125] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.510262] pci 0000:00:1f.6: [8086:8d24] type 00 class 0x118000 [ 2.514121] pci 0000:00:1f.6: reg 0x10: [mem 0xfb430000-0xfb430fff 64bit] [ 2.518370] acpiphp: Slot [1] registered [ 2.522141] pci 0000:01:00.0: [8086:10fb] type 00 class 0x020000 [ 2.526116] pci 0000:01:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.530103] pci 0000:01:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.534117] pci 0000:01:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.538103] pci 0000:01:00.0: reg 0x30: [mem 0xfb380000-0xfb3fffff pref] [ 2.542139] pci 0000:01:00.0: PME# supported from D0 D3hot [ 2.546116] pci 0000:01:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.550094] pci 0000:01:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.554108] pci 0000:01:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.558094] pci 0000:01:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.562265] pci 0000:01:00.1: [8086:10fb] type 00 class 0x020000 [ 2.566116] pci 0000:01:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.570103] pci 0000:01:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.574116] pci 0000:01:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.578103] pci 0000:01:00.1: reg 0x30: [mem 0xfb300000-0xfb37ffff pref] [ 2.582137] pci 0000:01:00.1: PME# supported from D0 D3hot [ 2.586112] pci 0000:01:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.590094] pci 0000:01:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.594107] pci 0000:01:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.598094] pci 0000:01:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.602237] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.606096] pci 0000:00:01.0: bridge window [io 0xe000-0xefff] [ 2.610095] pci 0000:00:01.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.614096] pci 0000:00:01.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.618279] pci 0000:02:00.0: [8086:0a54] type 00 class 0x010802 [ 2.622115] pci 0000:02:00.0: reg 0x10: [mem 0xfb210000-0xfb213fff 64bit] [ 2.626136] pci 0000:02:00.0: reg 0x30: [mem 0xfb200000-0xfb20ffff pref] [ 2.630097] pci 0000:02:00.0: enabling Extended Tags [ 2.634218] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.638097] pci 0000:00:02.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.642250] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.646131] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.650160] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.654183] pci 0000:05:00.0: enabling Extended Tags [ 2.658168] pci 0000:05:00.0: supports D1 D2 [ 2.662095] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.666192] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.670096] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.674097] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.678143] pci_bus 0000:06: extended config space not accessible [ 2.682125] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.686127] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.690111] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.694111] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.698179] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.702137] pci 0000:06:00.0: supports D1 D2 [ 2.706094] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.710206] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.714101] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.718097] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.722195] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.726121] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.730122] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.734108] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.738232] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.742133] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.746094] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.750120] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.754094] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.758281] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.762121] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.766122] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.770108] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.774227] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.778133] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.782096] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.786120] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.790094] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.794256] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.798096] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.802096] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.806098] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.810991] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.814147] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.818143] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.822144] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.826145] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.830095] ACPI: PCI: Interrupt link LNKE disabled [ 2.834144] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.838094] ACPI: PCI: Interrupt link LNKF disabled [ 2.842146] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.846094] ACPI: PCI: Interrupt link LNKG disabled [ 2.850144] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.854094] ACPI: PCI: Interrupt link LNKH disabled [ 2.858286] iommu: Default domain type: Translated [ 2.862095] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.866226] SCSI subsystem initialized [ 2.870111] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.874094] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.874095] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.878094] vgaarb: loaded [ 2.880877] ACPI: bus type USB registered [ 2.882104] usbcore: registered new interface driver usbfs [ 2.886099] usbcore: registered new interface driver hub [ 2.890099] usbcore: registered new device driver usb [ 2.894112] pps_core: LinuxPPS API ver. 1 registered [ 2.898094] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.902097] PTP clock support registered [ 2.906112] EDAC MC: Ver: 3.0.0 [ 2.909415] NetLabel: Initializing [ 2.910096] NetLabel: domain hash size = 128 [ 2.914094] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.918105] NetLabel: unlabeled traffic allowed by default [ 2.922105] PCI: Using ACPI for IRQ routing [ 2.931575] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.934096] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.940138] clocksource: Switched to clocksource tsc-early [ 2.952679] VFS: Disk quotas dquot_6.6.0 [ 2.956680] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.963723] AppArmor: AppArmor Filesystem Enabled [ 2.968523] pnp: PnP ACPI init [ 2.972002] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.977993] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.983978] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.989968] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.995954] system 00:01: [io 0x0800-0x081f] has been reserved [ 3.001935] system 00:01: [mem 0xfed1c000-0xfed3ffff] could not be reserved [ 3.008967] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 3.015647] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 3.022329] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 3.029011] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 3.035690] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 3.042373] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 3.049267] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 3.055256] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 3.061239] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.067227] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.073216] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.080179] pnp: PnP ACPI: found 5 devices [ 3.089792] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.098786] NET: Registered PF_INET protocol family [ 3.103924] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.113247] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.122073] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.130095] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.138519] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.146059] TCP: Hash tables configured (established 262144 bind 65536) [ 3.152876] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.160672] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.167696] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.175160] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.180891] NET: Registered PF_XDP protocol family [ 3.185770] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.197357] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.205275] pci 0000:01:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.212933] pci 0000:01:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.220934] pci 0000:01:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.228676] pci 0000:01:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.236764] pci 0000:01:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.244416] pci 0000:01:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.252416] pci 0000:01:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.260153] pci 0000:01:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.268241] pci 0000:01:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.275890] pci 0000:01:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.283892] pci 0000:01:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.291630] pci 0000:01:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.299717] pci 0000:01:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.307368] pci 0000:01:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.315367] pci 0000:01:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.323106] pci 0000:01:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.331194] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.336222] pci 0000:00:01.0: bridge window [io 0xe000-0xefff] [ 3.342382] pci 0000:00:01.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.349235] pci 0000:00:01.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.357069] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.362104] pci 0000:00:02.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.368968] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.374013] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.386932] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.391964] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.398127] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.405001] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.410292] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.416454] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.423319] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.431153] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.439076] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.446910] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.454830] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.459855] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.466017] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.472870] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.480703] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.486950] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.493197] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.500141] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.507082] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.514025] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.520964] pci_bus 0000:01: resource 0 [io 0xe000-0xefff] [ 3.526604] pci_bus 0000:01: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.532933] pci_bus 0000:01: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.540242] pci_bus 0000:02: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.546575] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.552215] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.558549] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.564189] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.570519] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.576158] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.582489] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.590010] pci 0000:00:05.0: disabled boot interrupts on device [8086:2f28] [ 3.619448] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 21617 usecs [ 3.651448] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23921 usecs [ 3.658951] pci 0000:01:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.665511] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.665521] Trying to unpack rootfs image as initramfs... [ 3.672020] software IO TLB: mapped [mem 0x0000000075231000-0x0000000079231000] (64MB) [ 3.685994] Initialise system trusted keyrings [ 3.690517] Key type blacklist registered [ 3.694651] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.702116] zbud: loaded [ 3.704923] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.710971] fuse: init (API version 7.34) [ 3.715229] integrity: Platform Keyring initialized [ 3.728415] Key type asymmetric registered [ 3.732591] Asymmetric key parser 'x509' registered [ 3.737563] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.745111] io scheduler mq-deadline registered [ 3.750158] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.756195] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.762227] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.768214] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.774202] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.780169] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.786140] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.793040] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.798278] ACPI: \_SB_.SCK0.CP01: Found 2 idle states [ 3.803519] ACPI: \_SB_.SCK0.CP02: Found 2 idle states [ 3.808753] ACPI: \_SB_.SCK0.CP03: Found 2 idle states [ 3.813989] ACPI: \_SB_.SCK0.CP04: Found 2 idle states [ 3.819234] ACPI: \_SB_.SCK0.CP05: Found 2 idle states [ 3.824473] ACPI: \_SB_.SCK0.CP06: Found 2 idle states [ 3.829712] ACPI: \_SB_.SCK0.CP07: Found 2 idle states [ 3.835577] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.844052] ACPI: button: Power Button [PWRB] [ 3.848512] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.856031] ACPI: button: Power Button [PWRF] [ 3.861735] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.869312] pstore: Registered erst as persistent store backend [ 3.875437] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.902488] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.931255] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.940722] Linux agpgart interface v0.103 [ 3.946622] loop: module loaded [ 3.950062] tun: Universal TUN/TAP device driver, 1.6 [ 3.955215] PPP generic driver version 2.4.2 [ 3.959597] VFIO - User Level meta-driver version: 0.3 [ 3.964921] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.971523] ehci-pci: EHCI PCI platform driver [ 3.976195] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.981493] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.988985] ehci-pci 0000:00:1a.0: debug port 2 [ 3.997503] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 4.015329] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 4.021190] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.029214] Freeing initrd memory: 65088K [ 4.029550] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.040925] usb usb1: Product: EHCI Host Controller [ 4.045868] usb usb1: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 4.052369] usb usb1: SerialNumber: 0000:00:1a.0 [ 4.057201] hub 1-0:1.0: USB hub found [ 4.061019] hub 1-0:1.0: 2 ports detected [ 4.065358] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 4.070652] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 4.078142] ehci-pci 0000:00:1d.0: debug port 2 [ 4.086628] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.107382] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.113230] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.121576] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.128879] usb usb2: Product: EHCI Host Controller [ 4.133823] usb usb2: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 4.140324] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.145103] hub 2-0:1.0: USB hub found [ 4.148921] hub 2-0:1.0: 2 ports detected [ 4.153125] ehci-platform: EHCI generic platform driver [ 4.158436] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.164681] ohci-pci: OHCI PCI platform driver [ 4.169209] ohci-platform: OHCI generic platform driver [ 4.174511] uhci_hcd: USB Universal Host Controller Interface driver [ 4.180981] i8042: PNP: No PS/2 controller found. [ 4.185816] mousedev: PS/2 mouse device common for all mice [ 4.191536] rtc_cmos 00:00: RTC can wake from S4 [ 4.196442] rtc_cmos 00:00: registered as rtc0 [ 4.200983] rtc_cmos 00:00: setting system clock to 2024-04-25T22:05:43 UTC (1714082743) [ 4.209179] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.215955] i2c_dev: i2c /dev entries driver [ 4.220451] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.232730] device-mapper: uevent: version 1.0.3 [ 4.237478] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.246021] platform eisa.0: Probing EISA bus 0 [ 4.250621] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.257470] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.263978] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.270485] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.276996] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.283504] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.290010] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.296520] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.303028] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.309537] platform eisa.0: EISA: Detected 0 cards [ 4.314489] intel_pstate: Intel P-state driver initializing [ 4.321203] ledtrig-cpu: registered to indicate activity on CPUs [ 4.327440] drop_monitor: Initializing network drop monitor service [ 4.333899] NET: Registered PF_INET6 protocol family [ 4.346473] Segment Routing with IPv6 [ 4.350213] In-situ OAM (IOAM) with IPv6 [ 4.354214] NET: Registered PF_PACKET protocol family [ 4.359378] Key type dns_resolver registered [ 4.364398] microcode: sig=0x306f2, pf=0x1, revision=0x49 [ 4.369949] microcode: Microcode Update Driver: v2.2. [ 4.370025] resctrl: L3 monitoring detected [ 4.379388] IPI shorthand broadcast: enabled [ 4.383740] sched_clock: Marking stable (3208428155, 1175296329)->(5368970278, -985245794) [ 4.392334] registered taskstats version 1 [ 4.396660] Loading compiled-in X.509 certificates [ 4.399327] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.402127] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.418594] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.428896] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.438979] blacklist: Loading compiled-in revocation X.509 certificates [ 4.453631] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.463558] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.474086] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.484966] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.491351] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.495493] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.512879] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.523672] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.534463] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.546294] zswap: loaded using pool lzo/zbud [ 4.551023] Key type .fscrypt registered [ 4.555020] Key type fscrypt-provisioning registered [ 4.560116] pstore: Using crash dump compression: deflate [ 4.563757] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.568365] Key type encrypted registered [ 4.573862] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.577931] AppArmor: AppArmor sha1 policy hashing enabled [ 4.577938] ima: No TPM chip found, activating TPM-bypass! [ 4.585673] hub 1-1:1.0: USB hub found [ 4.590693] Loading compiled-in module X.509 certificates [ 4.591179] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.600285] hub 1-1:1.0: 6 ports detected [ 4.605526] ima: Allocated hash algorithm: sha1 [ 4.605532] ima: No architecture policies found [ 4.605540] evm: Initialising EVM extended attributes: [ 4.634001] evm: security.selinux [ 4.637380] evm: security.SMACK64 [ 4.640759] evm: security.SMACK64EXEC [ 4.644485] evm: security.SMACK64TRANSMUTE [ 4.648647] evm: security.SMACK64MMAP [ 4.652373] evm: security.apparmor [ 4.655840] evm: security.ima [ 4.658868] evm: security.capability [ 4.662511] evm: HMAC attrs: 0x1 [ 4.666124] PM: Magic number: 4:714:98 [ 4.670386] RAS: Correctable Errors collector initialized. [ 4.671748] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.684227] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.684548] hub 2-1:1.0: USB hub found [ 4.695374] hub 2-1:1.0: 8 ports detected [ 4.699765] Freeing unused decrypted memory: 2036K [ 4.704633] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.710884] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.721509] Freeing unused kernel image (initmem) memory: 3352K [ 4.727510] clocksource: Switched to clocksource tsc [ 4.739369] Write protecting the kernel read-only data: 30720k [ 4.745687] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.752617] Freeing unused kernel image (rodata/data gap) memory: 1340K [ 4.798199] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.804711] x86/mm: Checking user space page tables [ 4.847274] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.853789] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 5.012939] dca service started, version 1.12.1 [ 5.020568] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.026247] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 5.027455] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 5.034445] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.043162] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 5.059040] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.064351] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 5.071847] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 5.078220] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 5.086571] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.087644] scsi host0: ahci [ 5.093887] usb usb3: Product: xHCI Host Controller [ 5.096963] scsi host1: ahci [ 5.101771] usb usb3: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 5.101773] usb usb3: SerialNumber: 0000:00:14.0 [ 5.101874] hub 3-0:1.0: USB hub found [ 5.104804] scsi host2: ahci [ 5.111252] hub 3-0:1.0: 15 ports detected [ 5.116149] scsi host3: ahci [ 5.123426] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.126941] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 33 [ 5.129801] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.138160] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 5.145634] usb usb4: Product: xHCI Host Controller [ 5.145746] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.145748] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.152941] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 5.152944] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 5.160439] usb usb4: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 5.165685] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.170867] usb usb4: SerialNumber: 0000:00:14.0 [ 5.176512] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.184077] hub 4-0:1.0: USB hub found [ 5.202690] igb 0000:07:00.0: added PHC on eth0 [ 5.206279] hub 4-0:1.0: 6 ports detected [ 5.210977] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.227213] nvme nvme0: pci function 0000:02:00.0 [ 5.231102] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:6b:ff:86 [ 5.231180] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.240137] nvme nvme0: 8/0/0 default/read/poll queues [ 5.242820] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.250597] nvme nvme0: Ignoring bogus Namespace Identifiers [ 5.255859] scsi host4: ahci [ 5.274017] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.276914] scsi host5: ahci [ 5.282936] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.291836] scsi host6: ahci [ 5.294880] scsi host7: ahci [ 5.297923] scsi host8: ahci [ 5.300952] scsi host9: ahci [ 5.303925] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 43 [ 5.310659] igb 0000:07:00.1: added PHC on eth1 [ 5.311414] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 43 [ 5.311416] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 43 [ 5.311417] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 43 [ 5.311418] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 43 [ 5.311419] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 43 [ 5.353513] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.360454] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:6b:ff:87 [ 5.367739] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.372937] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.451650] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.462037] ixgbe 0000:01:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.467324] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.470647] ixgbe 0000:01:00.0: MAC: 2, PHY: 14, S, PBA No: 400900-000 [ 5.481943] ata4: SATA link down (SStatus 0 SControl 300) [ 5.484376] ixgbe 0000:01:00.0: 0c:c4:7a:bd:15:62 [ 5.485917] ixgbe 0000:01:00.0: Intel(R) 10 Gigabit Network Connection [ 5.489882] ata3: SATA link down (SStatus 0 SControl 300) [ 5.506710] ata2: SATA link down (SStatus 0 SControl 300) [ 5.512208] ata1: SATA link down (SStatus 0 SControl 300) [ 5.623590] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.626312] ata7: SATA link down (SStatus 0 SControl 300) [ 5.631970] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.637456] ata10: SATA link down (SStatus 0 SControl 300) [ 5.650344] ata6: SATA link down (SStatus 0 SControl 300) [ 5.650618] hub 3-12:1.0: USB hub found [ 5.655859] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.659843] hub 3-12:1.0: 4 ports detected [ 5.666056] ata9: SATA link down (SStatus 0 SControl 300) [ 5.675685] ata8: SATA link down (SStatus 0 SControl 300) [ 5.681184] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN04, max UDMA/133 [ 5.687687] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.695980] ata5.00: configured for UDMA/133 [ 5.700576] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN04 PQ: 0 ANSI: 5 [ 5.709087] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.709235] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.730346] sd 4:0:0:0: [sda] Write Protect is off [ 5.735223] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.753428] sda: sda1 [ 5.755992] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.763752] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 5.763971] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.770826] i2c i2c-2: 2/8 memory slots populated (from DMI) [ 5.780432] i2c i2c-2: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 5.799928] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.983344] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 6.115834] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 6.124376] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.141197] hid: raw HID events driver (C) Jiri Kosina [ 6.149349] usbcore: registered new interface driver usbhid [ 6.155007] usbhid: USB HID core driver [ 6.164341] i: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.235552] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.247617] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.259515] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.680197] ixgbe 0000:01:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.690600] ixgbe 0000:01:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.699219] ixgbe 0000:01:00.1: MAC: 2, PHY: 1, PBA No: 400900-000 [ 6.705476] ixgbe 0000:01:00.1: 0c:c4:7a:bd:15:63 [ 6.712053] ixgbe 0000:01:00.1: Intel(R) 10 Gigabit Network Connection [ 6.720467] ixgbe 0000:01:00.0 ens1f0: renamed from eth2 [ 6.740102] ixgbe 0000:01:00.1 ens1f1: renamed from eth0 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: clean, 198138/61054976 files, 6606707/244190336 blocks done. [ 6.963896] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 7.785314] systemd[1]: Inserted module 'autofs4' [ 7.910836] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 7.959502] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 8.010001] systemd[1]: Hostname set to . [ 9.309036] systemd[1]: Queued start job for default target Graphical Interface. [ 9.317798] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 9.339891] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 9.363708] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 9.383511] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 9.403566] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 9.427802] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 9.455502] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 9.483451] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 9.511455] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 9.539462] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 9.567444] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 9.595461] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 9.623559] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 9.647475] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 9.667437] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 9.691604] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 9.715714] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 9.741505] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 9.763736] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 9.783675] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 9.807558] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 9.831888] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 9.851682] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 9.871710] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 9.891835] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 9.915726] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 9.935653] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 9.957194] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 9.977065] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 10.000908] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 10.025136] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 10.044676] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 10.070120] systemd[1]: Starting Journal Service... Starting Journal Service... [ 10.085882] RPC: Registered named UNIX socket transport module. [ 10.091890] RPC: Registered udp transport module. [ 10.096687] RPC: Registered tcp transport module. [ 10.096722] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 10.101469] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 10.111977] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 10.140557] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 10.164307] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 10.192178] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 10.216216] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 10.236274] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 10.256097] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 10.280017] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 10.300006] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 10.324083] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 10.348322] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 10.367467] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 10.377234] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 10.388033] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 10.408175] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 10.432169] systemd[1]: Starting Coldplug All udev Devices... Starting Coldplug All udev Devices... [ 10.451247] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 10.458112] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. [ 10.459651] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted [0;[ 10.505850] lp: driver loaded but no devices found 1;39mPOSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ 10.538943] Loading iSCSI transport class v2.0-870. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE Control File System... [ 10.811206] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... [ 10.879354] systemd-journald[355]: Received client request to flush runtime journal. Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. Starting Network Configuration... [ OK ] Finished Load AppArmor profiles. Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Load Kernel Module ramoops. Starting Create Volatile Files and Directories... [ OK ] Started Network Configuration. Starting Wait for Network to be Configured... [ OK ] Finished Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting RPC bind portmap service... Starting Network Name Resolution... Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Wait for Network to be Configured. [ OK ] Mounted RPC Pipe File System. [ OK ] Found device /dev/ttyS1. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target rpc_pipefs.target. Starting LVM event activation on device 259:0... Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Reached target NFS client services. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. [ OK ] Listening on UUID daemon activation socket. Mounting /var/lib/ceph... [ OK ] Listening on Docker Socket for the API. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... [ OK ] Started ntp-systemd-netif.service. Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... [ OK ] Started RPC bind portmap service. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Reached target RPC Port Mapper. Starting RPC Remote Quota Server... [ OK ] Found device 82599ES 10-Gi…ork Connection (AOC-STGN-i2S). [ OK ] Started ifup for ens1f0. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. [ OK ] Started RPC Remote Quota Server. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Mounted /var/lib/ceph. [ OK ] Started System Logging Service. [ OK ] Finished GRUB failed boot detection. [ OK ] Started User Login Management. [ OK ] Finished Helper to synchronize boot up for ifupdown. Starting Raise network interfaces... [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [* ] A start job is running for Raise network interfaces (7s / 5min 3s) M [** ] A start job is running for Raise network interfaces (7s / 5min 3s) M [*** ] A start job is running for Raise network interfaces (8s / 5min 3s) M [ *** ] A start job is running for Raise network interfaces (9s / 5min 3s) M [ *** ] A start job is running for Raise network interfaces (9s / 5min 3s) M [ ***] A start job is running for Raise network interfaces (10s / 5min 3s) M [ **] A start job is running for Raise network interfaces (10s / 5min 3s) M [ *] A start job is running for Raise network interfaces (11s / 5min 3s) M [ **] A start job is running for Raise network interfaces (12s / 5min 3s) M [ ***] A start job is running for Raise network interfaces (12s / 5min 3s) M [ *** ] A start job is running for Raise network interfaces (13s / 5min 3s) M [ *** ] A start job is running for Raise network interfaces (13s / 5min 3s) M [*** ] A start job is running for Raise network interfaces (14s / 5min 3s) M [** ] A start job is running for Raise network interfaces (14s / 5min 3s) M [* ] A start job is running for Raise network interfaces (15s / 5min 3s) M [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting NFS status monitor for NFSv2/3 locking.... + myips=172.21.15.57 + attempts=1 + sleep 1 Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... [ OK ] Started OpenBSD Secure Shell server. [ OK ] Started Network Time Service. [ OK ] Finished Ubuntu FAN network setup. [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Finished NFS server and services. Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. + '[' 172.21.15.57 '!=' '' ']' + set -e + '[' -n 172.21.15.57 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.57 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.57 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' [ OK ] Started (i)SCSI target daemon. [ OK ] Started The Apache HTTP Server. + newhostname=smithi057.front.sepia.ceph.com + '[' -n smithi057.front.sepia.ceph.com ']' + hostname smithi057.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi057 + echo smithi057 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.57 smithi057.front.sepia.ceph.com smithi057/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started LSB: Collectl monitors system performance.. Ubuntu 22.04.1 LTS smithi057.front.sepia.ceph.com ttyS1 2024-04-25T22:06:10.151 DEBUG:teuthology.orchestra.console.smithi057:expect after: smithi057 login: 2024-04-25T22:06:10.204 DEBUG:teuthology.orchestra.console.smithi057:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..    \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..    \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..    \x80 \x80 \x80  Intel(R) Boot Agent GE v1.5.13 Copyright (C) 1997-2013, Intel Corporation  Initializing and establishing link...                     PXE-E61: Media test failure, check cable PXE-M0F: Exiting Intel Boot Agent. Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation Initializing and establishing link... CLIENT MAC ADDR: 0C C4 7A BD 15 62 GUID: 00000000 0000 0000 0000 0CC47A6BFF86 DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.57 M 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 01:00.0, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.57 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 Intel(R) Boot Agent GE v1.5.13 Copyright (C) 1997-2013, Intel Corporation  PXE-E61: Media test failure, check cable PXE-M0F: Exiting Intel Boot Agent.   Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A BD 15 62 GUID: 00000000 0000 0000 0000 0CC47A6BFF86 CLIENT IP: 172.21.15.57 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 01:00.0, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices...ok   iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:bd:15:62).... Configuring (net0 0c:c4:7a:bd:15:62)..... Configuring (net0 0c:c4:7a:bd:15:62)...... Configuring (net0 0c:c4:7a:bd:15:62)....... Configuring (net0 0c:c4:7a:bd:15:62)........ PXE-E61: Media test failure, check cable   GNU GRUB version 2.04  ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************  Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.     The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                   [ 0.000000] microcode: microcode updated early to revision 0x49, date = 2021-08-11 [ 0.000000] Linux version 5.15.0-105-generic (buildd@lcy02-amd64-007) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #115-Ubuntu SMP Mon Apr 15 09:52:04 UTC 2024 (Ubuntu 5.15.0-105.115-generic 5.15.148) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000079230fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000079234000-0x0000000079849fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007984a000-0x000000007996afff] usable [ 0.000000] BIOS-e820: [mem 0x000000007996b000-0x0000000079e00fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079e01000-0x000000007bd4cfff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007bd4d000-0x000000007bd4dfff] usable [ 0.000000] BIOS-e820: [mem 0x000000007bd4e000-0x000000007bdd3fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007bdd4000-0x000000007bf50fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000080000000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 1.0c 09/07/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.157 MHz processor [ 0.000424] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000609] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001943] last_pfn = 0x7bf51 max_arch_pfn = 0x400000000 [ 0.008301] found SMP MP-table at [mem 0x000fd910-0x000fd91f] [ 0.008316] Using GB pages for direct mapping [ 0.008647] RAMDISK: [mem 0x300cf000-0x3405efff] [ 0.008652] ACPI: Early table checksum verification disabled [ 0.008656] ACPI: RSDP 0x00000000000F0530 000024 (v02 SUPERM) [ 0.008660] ACPI: XSDT 0x0000000079A7F0A0 0000C4 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008665] ACPI: FACP 0x0000000079AAC298 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008670] ACPI: DSDT 0x0000000079A7F200 02D091 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008673] ACPI: FACS 0x0000000079DFEF80 000040 [ 0.008676] ACPI: APIC 0x0000000079AAC3A8 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008678] ACPI: FPDT 0x0000000079AAC470 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008681] ACPI: FIDT 0x0000000079AAC4B8 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008684] ACPI: SPMI 0x0000000079AAC558 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008687] ACPI: MCFG 0x0000000079AAC598 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008690] ACPI: UEFI 0x0000000079AAC5D8 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008693] ACPI: BDAT 0x0000000079AAC620 000030 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008696] ACPI: HPET 0x0000000079AAC650 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008698] ACPI: PMCT 0x0000000079AAC688 000064 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008701] ACPI: WDDT 0x0000000079AAC6F0 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008704] ACPI: SSDT 0x0000000079AAC730 00EDE7 (v01 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008707] ACPI: SSDT 0x0000000079ABB518 002117 (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008710] ACPI: SSDT 0x0000000079ABD630 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008713] ACPI: PRAD 0x0000000079ABD698 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008716] ACPI: DMAR 0x0000000079ABD7A0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008719] ACPI: HEST 0x0000000079ABD860 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008722] ACPI: BERT 0x0000000079ABDAE0 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008724] ACPI: ERST 0x0000000079ABDB10 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008727] ACPI: EINJ 0x0000000079ABDD40 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008730] ACPI: Reserving FACP table memory at [mem 0x79aac298-0x79aac3a3] [ 0.008731] ACPI: Reserving DSDT table memory at [mem 0x79a7f200-0x79aac290] [ 0.008732] ACPI: Reserving FACS table memory at [mem 0x79dfef80-0x79dfefbf] [ 0.008733] ACPI: Reserving APIC table memory at [mem 0x79aac3a8-0x79aac46f] [ 0.008734] ACPI: Reserving FPDT table memory at [mem 0x79aac470-0x79aac4b3] [ 0.008735] ACPI: Reserving FIDT table memory at [mem 0x79aac4b8-0x79aac553] [ 0.008736] ACPI: Reserving SPMI table memory at [mem 0x79aac558-0x79aac597] [ 0.008737] ACPI: Reserving MCFG table memory at [mem 0x79aac598-0x79aac5d3] [ 0.008738] ACPI: Reserving UEFI table memory at [mem 0x79aac5d8-0x79aac619] [ 0.008739] ACPI: Reserving BDAT table memory at [mem 0x79aac620-0x79aac64f] [ 0.008740] ACPI: Reserving HPET table memory at [mem 0x79aac650-0x79aac687] [ 0.008741] ACPI: Reserving PMCT table memory at [mem 0x79aac688-0x79aac6eb] [ 0.008742] ACPI: Reserving WDDT table memory at [mem 0x79aac6f0-0x79aac72f] [ 0.008743] ACPI: Reserving SSDT table memory at [mem 0x79aac730-0x79abb516] [ 0.008744] ACPI: Reserving SSDT table memory at [mem 0x79abb518-0x79abd62e] [ 0.008745] ACPI: Reserving SSDT table memory at [mem 0x79abd630-0x79abd693] [ 0.008746] ACPI: Reserving PRAD table memory at [mem 0x79abd698-0x79abd799] [ 0.008747] ACPI: Reserving DMAR table memory at [mem 0x79abd7a0-0x79abd85b] [ 0.008749] ACPI: Reserving HEST table memory at [mem 0x79abd860-0x79abdadb] [ 0.008750] ACPI: Reserving BERT table memory at [mem 0x79abdae0-0x79abdb0f] [ 0.008751] ACPI: Reserving ERST table memory at [mem 0x79abdb10-0x79abdd3f] [ 0.008752] ACPI: Reserving EINJ table memory at [mem 0x79abdd40-0x79abde6f] [ 0.008849] No NUMA configuration found [ 0.008850] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008860] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.009158] Zone ranges: [ 0.009159] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.009161] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.009163] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.009165] Device empty [ 0.009166] Movable zone start for each node [ 0.009169] Early memory node ranges [ 0.009169] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.009171] node 0: [mem 0x0000000000100000-0x0000000079230fff] [ 0.009172] node 0: [mem 0x000000007984a000-0x000000007996afff] [ 0.009173] node 0: [mem 0x000000007bd4d000-0x000000007bd4dfff] [ 0.009174] node 0: [mem 0x000000007bdd4000-0x000000007bf50fff] [ 0.009175] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.009179] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.009184] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.009221] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.013644] On node 0, zone DMA32: 1561 pages in unavailable ranges [ 0.013737] On node 0, zone DMA32: 9186 pages in unavailable ranges [ 0.013744] On node 0, zone DMA32: 134 pages in unavailable ranges [ 0.085140] On node 0, zone Normal: 16559 pages in unavailable ranges [ 0.085261] ACPI: PM-Timer IO Port: 0x408 [ 0.085270] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.085271] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.085272] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.085273] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.085274] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.085275] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.085276] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.085277] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.085286] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23 [ 0.085291] IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-47 [ 0.085293] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.085295] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.085299] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.085301] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.085305] TSC deadline timer available [ 0.085306] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.085319] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.085321] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.085322] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.085324] PM: hibernation: Registered nosave memory: [mem 0x79231000-0x79233fff] [ 0.085325] PM: hibernation: Registered nosave memory: [mem 0x79234000-0x79849fff] [ 0.085326] PM: hibernation: Registered nosave memory: [mem 0x7996b000-0x79e00fff] [ 0.085327] PM: hibernation: Registered nosave memory: [mem 0x79e01000-0x7bd4cfff] [ 0.085329] PM: hibernation: Registered nosave memory: [mem 0x7bd4e000-0x7bdd3fff] [ 0.085330] PM: hibernation: Registered nosave memory: [mem 0x7bf51000-0x7fffffff] [ 0.085331] PM: hibernation: Registered nosave memory: [mem 0x80000000-0x8fffffff] [ 0.085332] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.085333] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff] [ 0.085334] PM: hibernation: Registered nosave memory: [mem 0xfed20000-0xfeffffff] [ 0.085334] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.085336] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.085337] Booting paravirtualized kernel on bare hardware [ 0.085340] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.085347] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.085590] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u262144 [ 0.085625] Built 1 zonelists, mobility grouping on. Total pages: 8230268 [ 0.085627] Policy zone: Normal [ 0.085628] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.085690] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic", will be passed to user space. [ 0.088259] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.089626] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.089719] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.174478] Memory: 32678904K/33444200K available (16393K kernel code, 4395K rwdata, 10948K rodata, 3352K init, 18716K bss, 765036K reserved, 0K cma-reserved) [ 0.174761] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.174777] Kernel/User page tables isolation: enabled [ 0.174810] ftrace: allocating 50694 entries in 199 pages [ 0.195010] ftrace: allocated 199 pages with 5 groups [ 0.195132] rcu: Hierarchical RCU implementation. [ 0.195134] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.195136] Rude variant of Tasks RCU enabled. [ 0.195136] Tracing variant of Tasks RCU enabled. [ 0.195137] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.195138] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.198603] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.198804] random: crng init done [ 0.203733] Console: colour VGA+ 80x25 [ 0.217521] printk: console [tty0] enabled [ 1.313868] printk: console [ttyS1] enabled [ 1.318126] ACPI: Core revision 20210730 [ 1.322266] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.331491] APIC: Switch to symmetric I/O mode setup [ 1.336528] DMAR: Host address width 46 [ 1.340437] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.345823] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap d2078c106f0466 ecap f020de [ 1.353828] DMAR: RMRR base: 0x0000007bac6000 end: 0x0000007bad4fff [ 1.360165] DMAR: ATSR flags: 0x0 [ 1.363549] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.369889] DMAR-IR: IOAPIC id 8 under DRHD base 0xfbffc000 IOMMU 0 [ 1.376312] DMAR-IR: IOAPIC id 9 under DRHD base 0xfbffc000 IOMMU 0 [ 1.382733] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.388199] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.388200] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.403383] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.408759] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.415079] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.439485] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3273e560663, max_idle_ns: 440795248670 ns [ 1.450097] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.31 BogoMIPS (lpj=14000628) [ 1.454112] CPU0: Thermal monitoring enabled (TM1) [ 1.458165] process: using mwait in idle threads [ 1.462096] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024 [ 1.466094] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4 [ 1.470096] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.474095] Spectre V2 : Mitigation: Retpolines [ 1.478094] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.482094] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.486094] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.490095] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.494094] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.498094] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.502098] MDS: Mitigation: Clear CPU buffers [ 1.506094] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.510099] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.514094] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.518094] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.522094] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.526094] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.549095] Freeing SMP alternatives memory: 44K [ 1.550095] pid_max: default: 32768 minimum: 301 [ 1.554116] LSM: Security Framework initializing [ 1.558102] landlock: Up and running. [ 1.562094] Yama: becoming mindful. [ 1.566113] AppArmor: AppArmor initialized [ 1.570163] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.574141] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.578468] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.582100] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz (family: 0x6, model: 0x3f, stepping: 0x2) [ 1.586210] Performance Events: PEBS fmt2+, Haswell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.590095] ... version: 3 [ 1.594094] ... bit width: 48 [ 1.598094] ... generic registers: 4 [ 1.602094] ... value mask: 0000ffffffffffff [ 1.606094] ... max period: 00007fffffffffff [ 1.610094] ... fixed-purpose events: 3 [ 1.614094] ... event mask: 000000070000000f [ 1.618168] signal: max sigframe size: 1776 [ 1.622111] rcu: Hierarchical SRCU implementation. [ 1.626848] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.630165] smp: Bringing up secondary CPUs ... [ 1.634183] x86: Booting SMP configuration: [ 1.638097] .... node #0, CPUs: #1 #2 #3 #4 [ 1.646842] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.654095] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.658205] #5 #6 #7 [ 1.658802] smp: Brought up 1 node, 8 CPUs [ 1.666097] smpboot: Max logical packages: 1 [ 1.670095] smpboot: Total of 8 processors activated (56002.51 BogoMIPS) [ 1.678890] devtmpfs: initialized [ 1.682138] x86/mm: Memory block size: 128MB [ 1.687686] ACPI: PM: Registering ACPI NVS region [mem 0x7996b000-0x79e00fff] (4808704 bytes) [ 1.690176] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.694106] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.698146] pinctrl core: initialized pinctrl subsystem [ 1.702191] PM: RTC time: 22:05:40, date: 2024-04-25 [ 1.706211] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.710477] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.714447] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.718488] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.722106] audit: initializing netlink subsys (disabled) [ 1.726117] audit: type=2000 audit(1714082738.352:1): state=initialized audit_enabled=0 res=1 [ 1.726216] thermal_sys: Registered thermal governor 'fair_share' [ 1.730096] thermal_sys: Registered thermal governor 'bang_bang' [ 1.734094] thermal_sys: Registered thermal governor 'step_wise' [ 1.738094] thermal_sys: Registered thermal governor 'user_space' [ 1.742094] thermal_sys: Registered thermal governor 'power_allocator' [ 1.746100] EISA bus registered [ 1.753309] cpuidle: using governor ladder [ 1.754097] cpuidle: using governor menu [ 1.758117] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.762096] ACPI: bus type PCI registered [ 1.766095] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.770153] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.774096] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.778108] PCI: Using configuration type 1 for base access [ 1.782121] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 1.787087] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.790113] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.794096] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.798175] ACPI: Added _OSI(Module Device) [ 1.802097] ACPI: Added _OSI(Processor Device) [ 1.806102] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.810094] ACPI: Added _OSI(Processor Aggregator Device) [ 1.814094] ACPI: Added _OSI(Linux-Dell-Video) [ 1.818094] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.822095] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.861236] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.864538] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.870269] ACPI: Dynamic OEM Table Load: [ 1.877835] ACPI: Interpreter enabled [ 1.878108] ACPI: PM: (supports S0 S4 S5) [ 1.882097] ACPI: Using IOAPIC for interrupt routing [ 1.886119] HEST: Enabling Firmware First mode for corrected errors. [ 1.890187] HEST: Table parsing has been initialized. [ 1.894248] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.898097] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.902094] PCI: Using E820 reservations for host bridge windows [ 1.906723] ACPI: Enabled 6 GPEs in block 00 to 3F [ 1.930158] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.934098] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.940283] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.943186] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.946095] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.950130] PCI host bridge to bus 0000:ff [ 1.954097] pci_bus 0000:ff: root bus resource [bus ff] [ 1.958106] pci 0000:ff:0b.0: [8086:2f81] type 00 class 0x088000 [ 1.962162] pci 0000:ff:0b.1: [8086:2f36] type 00 class 0x110100 [ 1.966151] pci 0000:ff:0b.2: [8086:2f37] type 00 class 0x110100 [ 1.970148] pci 0000:ff:0c.0: [8086:2fe0] type 00 class 0x088000 [ 1.974148] pci 0000:ff:0c.1: [8086:2fe1] type 00 class 0x088000 [ 1.978146] pci 0000:ff:0c.2: [8086:2fe2] type 00 class 0x088000 [ 1.982147] pci 0000:ff:0c.3: [8086:2fe3] type 00 class 0x088000 [ 1.986150] pci 0000:ff:0f.0: [8086:2ff8] type 00 class 0x088000 [ 1.990150] pci 0000:ff:0f.1: [8086:2ff9] type 00 class 0x088000 [ 1.994149] pci 0000:ff:0f.4: [8086:2ffc] type 00 class 0x088000 [ 1.998147] pci 0000:ff:0f.5: [8086:2ffd] type 00 class 0x088000 [ 2.002150] pci 0000:ff:0f.6: [8086:2ffe] type 00 class 0x088000 [ 2.006147] pci 0000:ff:10.0: [8086:2f1d] type 00 class 0x088000 [ 2.010147] pci 0000:ff:10.1: [8086:2f34] type 00 class 0x110100 [ 2.014147] pci 0000:ff:10.5: [8086:2f1e] type 00 class 0x088000 [ 2.018147] pci 0000:ff:10.6: [8086:2f7d] type 00 class 0x110100 [ 2.022150] pci 0000:ff:10.7: [8086:2f1f] type 00 class 0x088000 [ 2.026148] pci 0000:ff:12.0: [8086:2fa0] type 00 class 0x088000 [ 2.030149] pci 0000:ff:12.1: [8086:2f30] type 00 class 0x110100 [ 2.034152] pci 0000:ff:13.0: [8086:2fa8] type 00 class 0x088000 [ 2.038152] pci 0000:ff:13.1: [8086:2f71] type 00 class 0x088000 [ 2.042151] pci 0000:ff:13.2: [8086:2faa] type 00 class 0x088000 [ 2.046151] pci 0000:ff:13.3: [8086:2fab] type 00 class 0x088000 [ 2.050153] pci 0000:ff:13.4: [8086:2fac] type 00 class 0x088000 [ 2.054157] pci 0000:ff:13.5: [8086:2fad] type 00 class 0x088000 [ 2.058151] pci 0000:ff:13.6: [8086:2fae] type 00 class 0x088000 [ 2.062150] pci 0000:ff:13.7: [8086:2faf] type 00 class 0x088000 [ 2.066151] pci 0000:ff:14.0: [8086:2fb0] type 00 class 0x088000 [ 2.070152] pci 0000:ff:14.1: [8086:2fb1] type 00 class 0x088000 [ 2.074151] pci 0000:ff:14.2: [8086:2fb2] type 00 class 0x088000 [ 2.078151] pci 0000:ff:14.3: [8086:2fb3] type 00 class 0x088000 [ 2.082150] pci 0000:ff:14.4: [8086:2fbc] type 00 class 0x088000 [ 2.086156] pci 0000:ff:14.5: [8086:2fbd] type 00 class 0x088000 [ 2.090148] pci 0000:ff:14.6: [8086:2fbe] type 00 class 0x088000 [ 2.094150] pci 0000:ff:14.7: [8086:2fbf] type 00 class 0x088000 [ 2.098149] pci 0000:ff:15.0: [8086:2fb4] type 00 class 0x088000 [ 2.102152] pci 0000:ff:15.1: [8086:2fb5] type 00 class 0x088000 [ 2.106151] pci 0000:ff:15.2: [8086:2fb6] type 00 class 0x088000 [ 2.110152] pci 0000:ff:15.3: [8086:2fb7] type 00 class 0x088000 [ 2.114153] pci 0000:ff:16.0: [8086:2f68] type 00 class 0x088000 [ 2.118155] pci 0000:ff:16.6: [8086:2f6e] type 00 class 0x088000 [ 2.122150] pci 0000:ff:16.7: [8086:2f6f] type 00 class 0x088000 [ 2.126149] pci 0000:ff:17.0: [8086:2fd0] type 00 class 0x088000 [ 2.130151] pci 0000:ff:17.4: [8086:2fb8] type 00 class 0x088000 [ 2.134148] pci 0000:ff:17.5: [8086:2fb9] type 00 class 0x088000 [ 2.138149] pci 0000:ff:17.6: [8086:2fba] type 00 class 0x088000 [ 2.142148] pci 0000:ff:17.7: [8086:2fbb] type 00 class 0x088000 [ 2.146152] pci 0000:ff:1e.0: [8086:2f98] type 00 class 0x088000 [ 2.150151] pci 0000:ff:1e.1: [8086:2f99] type 00 class 0x088000 [ 2.154149] pci 0000:ff:1e.2: [8086:2f9a] type 00 class 0x088000 [ 2.158148] pci 0000:ff:1e.3: [8086:2fc0] type 00 class 0x088000 [ 2.162122] pci 0000:ff:1e.4: [8086:2f9c] type 00 class 0x088000 [ 2.166151] pci 0000:ff:1f.0: [8086:2f88] type 00 class 0x088000 [ 2.170149] pci 0000:ff:1f.2: [8086:2f8a] type 00 class 0x088000 [ 2.174235] acpi LNXCPU:08: Entry not well-defined, consider updating BIOS [ 2.179052] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.182099] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.186762] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.191216] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.194095] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.198746] PCI host bridge to bus 0000:00 [ 2.202097] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.206094] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.210094] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.214094] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.218094] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.222094] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.226094] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.230202] pci 0000:00:00.0: [8086:2f00] type 00 class 0x060000 [ 2.234310] pci 0000:00:01.0: [8086:2f02] type 01 class 0x060400 [ 2.238164] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.242274] pci 0000:00:02.0: [8086:2f04] type 01 class 0x060400 [ 2.246162] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.250263] pci 0000:00:03.0: [8086:2f08] type 01 class 0x060400 [ 2.254162] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.258258] pci 0000:00:04.0: [8086:2f20] type 00 class 0x088000 [ 2.262114] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.266293] pci 0000:00:04.1: [8086:2f21] type 00 class 0x088000 [ 2.270113] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.274291] pci 0000:00:04.2: [8086:2f22] type 00 class 0x088000 [ 2.278113] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.282290] pci 0000:00:04.3: [8086:2f23] type 00 class 0x088000 [ 2.286113] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.290296] pci 0000:00:04.4: [8086:2f24] type 00 class 0x088000 [ 2.294113] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.298290] pci 0000:00:04.5: [8086:2f25] type 00 class 0x088000 [ 2.302115] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.306294] pci 0000:00:04.6: [8086:2f26] type 00 class 0x088000 [ 2.310113] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.314290] pci 0000:00:04.7: [8086:2f27] type 00 class 0x088000 [ 2.318113] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.322246] pci 0000:00:05.0: [8086:2f28] type 00 class 0x088000 [ 2.326316] pci 0000:00:05.1: [8086:2f29] type 00 class 0x088000 [ 2.330248] pci 0000:00:05.2: [8086:2f2a] type 00 class 0x088000 [ 2.334266] pci 0000:00:05.4: [8086:2f2c] type 00 class 0x080020 [ 2.338109] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.342338] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.346391] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.350116] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.354106] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.358106] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.362106] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.366106] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.370106] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.374136] pci 0000:00:11.4: PME# supported from D3hot [ 2.378254] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.382120] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.386167] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.390246] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.394120] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.398172] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.402243] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.406120] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.410172] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.414256] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.418117] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.422200] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.426250] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.430185] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.434260] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.438187] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.442260] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.446188] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.450268] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.454117] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.458199] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.462257] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.466371] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.470114] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.474104] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.478104] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.482107] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.486105] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.490104] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.494130] pci 0000:00:1f.2: PME# supported from D3hot [ 2.498239] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.502120] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.506125] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.510262] pci 0000:00:1f.6: [8086:8d24] type 00 class 0x118000 [ 2.514121] pci 0000:00:1f.6: reg 0x10: [mem 0xfb430000-0xfb430fff 64bit] [ 2.518370] acpiphp: Slot [1] registered [ 2.522141] pci 0000:01:00.0: [8086:10fb] type 00 class 0x020000 [ 2.526116] pci 0000:01:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.530103] pci 0000:01:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.534117] pci 0000:01:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.538103] pci 0000:01:00.0: reg 0x30: [mem 0xfb380000-0xfb3fffff pref] [ 2.542139] pci 0000:01:00.0: PME# supported from D0 D3hot [ 2.546116] pci 0000:01:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.550094] pci 0000:01:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.554108] pci 0000:01:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.558094] pci 0000:01:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.562265] pci 0000:01:00.1: [8086:10fb] type 00 class 0x020000 [ 2.566116] pci 0000:01:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.570103] pci 0000:01:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.574116] pci 0000:01:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.578103] pci 0000:01:00.1: reg 0x30: [mem 0xfb300000-0xfb37ffff pref] [ 2.582137] pci 0000:01:00.1: PME# supported from D0 D3hot [ 2.586112] pci 0000:01:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.590094] pci 0000:01:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.594107] pci 0000:01:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.598094] pci 0000:01:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.602237] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.606096] pci 0000:00:01.0: bridge window [io 0xe000-0xefff] [ 2.610095] pci 0000:00:01.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.614096] pci 0000:00:01.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.618279] pci 0000:02:00.0: [8086:0a54] type 00 class 0x010802 [ 2.622115] pci 0000:02:00.0: reg 0x10: [mem 0xfb210000-0xfb213fff 64bit] [ 2.626136] pci 0000:02:00.0: reg 0x30: [mem 0xfb200000-0xfb20ffff pref] [ 2.630097] pci 0000:02:00.0: enabling Extended Tags [ 2.634218] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.638097] pci 0000:00:02.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.642250] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.646131] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.650160] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.654183] pci 0000:05:00.0: enabling Extended Tags [ 2.658168] pci 0000:05:00.0: supports D1 D2 [ 2.662095] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.666192] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.670096] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.674097] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.678143] pci_bus 0000:06: extended config space not accessible [ 2.682125] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.686127] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.690111] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.694111] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.698179] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.702137] pci 0000:06:00.0: supports D1 D2 [ 2.706094] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.710206] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.714101] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.718097] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.722195] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.726121] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.730122] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.734108] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.738232] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.742133] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.746094] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.750120] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.754094] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.758281] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.762121] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.766122] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.770108] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.774227] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.778133] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.782096] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.786120] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.790094] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.794256] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.798096] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.802096] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.806098] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.810991] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.814147] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.818143] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.822144] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.826145] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.830095] ACPI: PCI: Interrupt link LNKE disabled [ 2.834144] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.838094] ACPI: PCI: Interrupt link LNKF disabled [ 2.842146] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.846094] ACPI: PCI: Interrupt link LNKG disabled [ 2.850144] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.854094] ACPI: PCI: Interrupt link LNKH disabled [ 2.858286] iommu: Default domain type: Translated [ 2.862095] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.866226] SCSI subsystem initialized [ 2.870111] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.874094] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.874095] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.878094] vgaarb: loaded [ 2.880877] ACPI: bus type USB registered [ 2.882104] usbcore: registered new interface driver usbfs [ 2.886099] usbcore: registered new interface driver hub [ 2.890099] usbcore: registered new device driver usb [ 2.894112] pps_core: LinuxPPS API ver. 1 registered [ 2.898094] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.902097] PTP clock support registered [ 2.906112] EDAC MC: Ver: 3.0.0 [ 2.909415] NetLabel: Initializing [ 2.910096] NetLabel: domain hash size = 128 [ 2.914094] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.918105] NetLabel: unlabeled traffic allowed by default [ 2.922105] PCI: Using ACPI for IRQ routing [ 2.931575] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.934096] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.940138] clocksource: Switched to clocksource tsc-early [ 2.952679] VFS: Disk quotas dquot_6.6.0 [ 2.956680] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.963723] AppArmor: AppArmor Filesystem Enabled [ 2.968523] pnp: PnP ACPI init [ 2.972002] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.977993] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.983978] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.989968] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.995954] system 00:01: [io 0x0800-0x081f] has been reserved [ 3.001935] system 00:01: [mem 0xfed1c000-0xfed3ffff] could not be reserved [ 3.008967] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 3.015647] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 3.022329] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 3.029011] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 3.035690] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 3.042373] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 3.049267] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 3.055256] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 3.061239] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.067227] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.073216] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.080179] pnp: PnP ACPI: found 5 devices [ 3.089792] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.098786] NET: Registered PF_INET protocol family [ 3.103924] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.113247] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.122073] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.130095] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.138519] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.146059] TCP: Hash tables configured (established 262144 bind 65536) [ 3.152876] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.160672] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.167696] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.175160] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.180891] NET: Registered PF_XDP protocol family [ 3.185770] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.197357] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.205275] pci 0000:01:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.212933] pci 0000:01:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.220934] pci 0000:01:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.228676] pci 0000:01:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.236764] pci 0000:01:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.244416] pci 0000:01:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.252416] pci 0000:01:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.260153] pci 0000:01:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.268241] pci 0000:01:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.275890] pci 0000:01:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.283892] pci 0000:01:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.291630] pci 0000:01:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.299717] pci 0000:01:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.307368] pci 0000:01:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.315367] pci 0000:01:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.323106] pci 0000:01:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.331194] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.336222] pci 0000:00:01.0: bridge window [io 0xe000-0xefff] [ 3.342382] pci 0000:00:01.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.349235] pci 0000:00:01.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.357069] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.362104] pci 0000:00:02.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.368968] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.374013] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.386932] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.391964] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.398127] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.405001] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.410292] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.416454] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.423319] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.431153] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.439076] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.446910] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.454830] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.459855] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.466017] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.472870] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.480703] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.486950] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.493197] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.500141] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.507082] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.514025] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.520964] pci_bus 0000:01: resource 0 [io 0xe000-0xefff] [ 3.526604] pci_bus 0000:01: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.532933] pci_bus 0000:01: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.540242] pci_bus 0000:02: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.546575] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.552215] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.558549] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.564189] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.570519] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.576158] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.582489] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.590010] pci 0000:00:05.0: disabled boot interrupts on device [8086:2f28] [ 3.619448] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 21617 usecs [ 3.651448] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23921 usecs [ 3.658951] pci 0000:01:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.665511] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.665521] Trying to unpack rootfs image as initramfs... [ 3.672020] software IO TLB: mapped [mem 0x0000000075231000-0x0000000079231000] (64MB) [ 3.685994] Initialise system trusted keyrings [ 3.690517] Key type blacklist registered [ 3.694651] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.702116] zbud: loaded [ 3.704923] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.710971] fuse: init (API version 7.34) [ 3.715229] integrity: Platform Keyring initialized [ 3.728415] Key type asymmetric registered [ 3.732591] Asymmetric key parser 'x509' registered [ 3.737563] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.745111] io scheduler mq-deadline registered [ 3.750158] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.756195] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.762227] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.768214] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.774202] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.780169] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.786140] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.793040] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.798278] ACPI: \_SB_.SCK0.CP01: Found 2 idle states [ 3.803519] ACPI: \_SB_.SCK0.CP02: Found 2 idle states [ 3.808753] ACPI: \_SB_.SCK0.CP03: Found 2 idle states [ 3.813989] ACPI: \_SB_.SCK0.CP04: Found 2 idle states [ 3.819234] ACPI: \_SB_.SCK0.CP05: Found 2 idle states [ 3.824473] ACPI: \_SB_.SCK0.CP06: Found 2 idle states [ 3.829712] ACPI: \_SB_.SCK0.CP07: Found 2 idle states [ 3.835577] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.844052] ACPI: button: Power Button [PWRB] [ 3.848512] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.856031] ACPI: button: Power Button [PWRF] [ 3.861735] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.869312] pstore: Registered erst as persistent store backend [ 3.875437] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.902488] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.931255] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.940722] Linux agpgart interface v0.103 [ 3.946622] loop: module loaded [ 3.950062] tun: Universal TUN/TAP device driver, 1.6 [ 3.955215] PPP generic driver version 2.4.2 [ 3.959597] VFIO - User Level meta-driver version: 0.3 [ 3.964921] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.971523] ehci-pci: EHCI PCI platform driver [ 3.976195] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.981493] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.988985] ehci-pci 0000:00:1a.0: debug port 2 [ 3.997503] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 4.015329] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 4.021190] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.029214] Freeing initrd memory: 65088K [ 4.029550] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.040925] usb usb1: Product: EHCI Host Controller [ 4.045868] usb usb1: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 4.052369] usb usb1: SerialNumber: 0000:00:1a.0 [ 4.057201] hub 1-0:1.0: USB hub found [ 4.061019] hub 1-0:1.0: 2 ports detected [ 4.065358] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 4.070652] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 4.078142] ehci-pci 0000:00:1d.0: debug port 2 [ 4.086628] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.107382] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.113230] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.121576] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.128879] usb usb2: Product: EHCI Host Controller [ 4.133823] usb usb2: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 4.140324] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.145103] hub 2-0:1.0: USB hub found [ 4.148921] hub 2-0:1.0: 2 ports detected [ 4.153125] ehci-platform: EHCI generic platform driver [ 4.158436] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.164681] ohci-pci: OHCI PCI platform driver [ 4.169209] ohci-platform: OHCI generic platform driver [ 4.174511] uhci_hcd: USB Universal Host Controller Interface driver [ 4.180981] i8042: PNP: No PS/2 controller found. [ 4.185816] mousedev: PS/2 mouse device common for all mice [ 4.191536] rtc_cmos 00:00: RTC can wake from S4 [ 4.196442] rtc_cmos 00:00: registered as rtc0 [ 4.200983] rtc_cmos 00:00: setting system clock to 2024-04-25T22:05:43 UTC (1714082743) [ 4.209179] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.215955] i2c_dev: i2c /dev entries driver [ 4.220451] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.232730] device-mapper: uevent: version 1.0.3 [ 4.237478] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.246021] platform eisa.0: Probing EISA bus 0 [ 4.250621] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.257470] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.263978] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.270485] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.276996] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.283504] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.290010] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.296520] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.303028] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.309537] platform eisa.0: EISA: Detected 0 cards [ 4.314489] intel_pstate: Intel P-state driver initializing [ 4.321203] ledtrig-cpu: registered to indicate activity on CPUs [ 4.327440] drop_monitor: Initializing network drop monitor service [ 4.333899] NET: Registered PF_INET6 protocol family [ 4.346473] Segment Routing with IPv6 [ 4.350213] In-situ OAM (IOAM) with IPv6 [ 4.354214] NET: Registered PF_PACKET protocol family [ 4.359378] Key type dns_resolver registered [ 4.364398] microcode: sig=0x306f2, pf=0x1, revision=0x49 [ 4.369949] microcode: Microcode Update Driver: v2.2. [ 4.370025] resctrl: L3 monitoring detected [ 4.379388] IPI shorthand broadcast: enabled [ 4.383740] sched_clock: Marking stable (3208428155, 1175296329)->(5368970278, -985245794) [ 4.392334] registered taskstats version 1 [ 4.396660] Loading compiled-in X.509 certificates [ 4.399327] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.402127] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.418594] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.428896] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.438979] blacklist: Loading compiled-in revocation X.509 certificates [ 4.453631] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.463558] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.474086] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.484966] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.491351] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.495493] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.512879] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.523672] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.534463] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.546294] zswap: loaded using pool lzo/zbud [ 4.551023] Key type .fscrypt registered [ 4.555020] Key type fscrypt-provisioning registered [ 4.560116] pstore: Using crash dump compression: deflate [ 4.563757] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.568365] Key type encrypted registered [ 4.573862] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.577931] AppArmor: AppArmor sha1 policy hashing enabled [ 4.577938] ima: No TPM chip found, activating TPM-bypass! [ 4.585673] hub 1-1:1.0: USB hub found [ 4.590693] Loading compiled-in module X.509 certificates [ 4.591179] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.600285] hub 1-1:1.0: 6 ports detected [ 4.605526] ima: Allocated hash algorithm: sha1 [ 4.605532] ima: No architecture policies found [ 4.605540] evm: Initialising EVM extended attributes: [ 4.634001] evm: security.selinux [ 4.637380] evm: security.SMACK64 [ 4.640759] evm: security.SMACK64EXEC [ 4.644485] evm: security.SMACK64TRANSMUTE [ 4.648647] evm: security.SMACK64MMAP [ 4.652373] evm: security.apparmor [ 4.655840] evm: security.ima [ 4.658868] evm: security.capability [ 4.662511] evm: HMAC attrs: 0x1 [ 4.666124] PM: Magic number: 4:714:98 [ 4.670386] RAS: Correctable Errors collector initialized. [ 4.671748] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.684227] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.684548] hub 2-1:1.0: USB hub found [ 4.695374] hub 2-1:1.0: 8 ports detected [ 4.699765] Freeing unused decrypted memory: 2036K [ 4.704633] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.710884] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.721509] Freeing unused kernel image (initmem) memory: 3352K [ 4.727510] clocksource: Switched to clocksource tsc [ 4.739369] Write protecting the kernel read-only data: 30720k [ 4.745687] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.752617] Freeing unused kernel image (rodata/data gap) memory: 1340K [ 4.798199] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.804711] x86/mm: Checking user space page tables [ 4.847274] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.853789] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 5.012939] dca service started, version 1.12.1 [ 5.020568] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.026247] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 5.027455] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 5.034445] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.043162] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 5.059040] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.064351] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 5.071847] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 5.078220] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 5.086571] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.087644] scsi host0: ahci [ 5.093887] usb usb3: Product: xHCI Host Controller [ 5.096963] scsi host1: ahci [ 5.101771] usb usb3: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 5.101773] usb usb3: SerialNumber: 0000:00:14.0 [ 5.101874] hub 3-0:1.0: USB hub found [ 5.104804] scsi host2: ahci [ 5.111252] hub 3-0:1.0: 15 ports detected [ 5.116149] scsi host3: ahci [ 5.123426] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.126941] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 33 [ 5.129801] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.138160] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 5.145634] usb usb4: Product: xHCI Host Controller [ 5.145746] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.145748] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.152941] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 5.152944] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 5.160439] usb usb4: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 5.165685] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.170867] usb usb4: SerialNumber: 0000:00:14.0 [ 5.176512] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.184077] hub 4-0:1.0: USB hub found [ 5.202690] igb 0000:07:00.0: added PHC on eth0 [ 5.206279] hub 4-0:1.0: 6 ports detected [ 5.210977] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.227213] nvme nvme0: pci function 0000:02:00.0 [ 5.231102] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:6b:ff:86 [ 5.231180] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.240137] nvme nvme0: 8/0/0 default/read/poll queues [ 5.242820] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.250597] nvme nvme0: Ignoring bogus Namespace Identifiers [ 5.255859] scsi host4: ahci [ 5.274017] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.276914] scsi host5: ahci [ 5.282936] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.291836] scsi host6: ahci [ 5.294880] scsi host7: ahci [ 5.297923] scsi host8: ahci [ 5.300952] scsi host9: ahci [ 5.303925] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 43 [ 5.310659] igb 0000:07:00.1: added PHC on eth1 [ 5.311414] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 43 [ 5.311416] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 43 [ 5.311417] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 43 [ 5.311418] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 43 [ 5.311419] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 43 [ 5.353513] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.360454] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:6b:ff:87 [ 5.367739] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.372937] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.451650] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.462037] ixgbe 0000:01:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.467324] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.470647] ixgbe 0000:01:00.0: MAC: 2, PHY: 14, S, PBA No: 400900-000 [ 5.481943] ata4: SATA link down (SStatus 0 SControl 300) [ 5.484376] ixgbe 0000:01:00.0: 0c:c4:7a:bd:15:62 [ 5.485917] ixgbe 0000:01:00.0: Intel(R) 10 Gigabit Network Connection [ 5.489882] ata3: SATA link down (SStatus 0 SControl 300) [ 5.506710] ata2: SATA link down (SStatus 0 SControl 300) [ 5.512208] ata1: SATA link down (SStatus 0 SControl 300) [ 5.623590] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.626312] ata7: SATA link down (SStatus 0 SControl 300) [ 5.631970] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.637456] ata10: SATA link down (SStatus 0 SControl 300) [ 5.650344] ata6: SATA link down (SStatus 0 SControl 300) [ 5.650618] hub 3-12:1.0: USB hub found [ 5.655859] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.659843] hub 3-12:1.0: 4 ports detected [ 5.666056] ata9: SATA link down (SStatus 0 SControl 300) [ 5.675685] ata8: SATA link down (SStatus 0 SControl 300) [ 5.681184] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN04, max UDMA/133 [ 5.687687] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.695980] ata5.00: configured for UDMA/133 [ 5.700576] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN04 PQ: 0 ANSI: 5 [ 5.709087] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.709235] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.730346] sd 4:0:0:0: [sda] Write Protect is off [ 5.735223] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.753428] sda: sda1 [ 5.755992] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.763752] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 5.763971] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.770826] i2c i2c-2: 2/8 memory slots populated (from DMI) [ 5.780432] i2c i2c-2: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 5.799928] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.983344] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 6.115834] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 6.124376] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.141197] hid: raw HID events driver (C) Jiri Kosina [ 6.149349] usbcore: registered new interface driver usbhid [ 6.155007] usbhid: USB HID core driver [ 6.164341] i: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.235552] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.247617] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.259515] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.680197] ixgbe 0000:01:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.690600] ixgbe 0000:01:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.699219] ixgbe 0000:01:00.1: MAC: 2, PHY: 1, PBA No: 400900-000 [ 6.705476] ixgbe 0000:01:00.1: 0c:c4:7a:bd:15:63 [ 6.712053] ixgbe 0000:01:00.1: Intel(R) 10 Gigabit Network Connection [ 6.720467] ixgbe 0000:01:00.0 ens1f0: renamed from eth2 [ 6.740102] ixgbe 0000:01:00.1 ens1f1: renamed from eth0 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: clean, 198138/61054976 files, 6606707/244190336 blocks done. [ 6.963896] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 7.785314] systemd[1]: Inserted module 'autofs4' [ 7.910836] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 7.959502] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 8.010001] systemd[1]: Hostname set to . [ 9.309036] systemd[1]: Queued start job for default target Graphical Interface. [ 9.317798] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 9.339891] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 9.363708] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 9.383511] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 9.403566] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 9.427802] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 9.455502] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 9.483451] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 9.511455] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 9.539462] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 9.567444] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 9.595461] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 9.623559] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 9.647475] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 9.667437] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 9.691604] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 9.715714] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 9.741505] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 9.763736] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 9.783675] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 9.807558] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 9.831888] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 9.851682] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 9.871710] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 9.891835] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 9.915726] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 9.935653] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 9.957194] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 9.977065] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 10.000908] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 10.025136] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 10.044676] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 10.070120] systemd[1]: Starting Journal Service... Starting Journal Service... [ 10.085882] RPC: Registered named UNIX socket transport module. [ 10.091890] RPC: Registered udp transport module. [ 10.096687] RPC: Registered tcp transport module. [ 10.096722] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 10.101469] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 10.111977] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 10.140557] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 10.164307] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 10.192178] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 10.216216] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 10.236274] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 10.256097] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 10.280017] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 10.300006] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 10.324083] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 10.348322] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 10.367467] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 10.377234] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 10.388033] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 10.408175] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 10.432169] systemd[1]: Starting Coldplug All udev Devices... Starting Coldplug All udev Devices... [ 10.451247] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 10.458112] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. [ 10.459651] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted [0;[ 10.505850] lp: driver loaded but no devices found 1;39mPOSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ 10.538943] Loading iSCSI transport class v2.0-870. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE Control File System... [ 10.811206] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... [ 10.879354] systemd-journald[355]: Received client request to flush runtime journal. Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. Starting Network Configuration... [ OK ] Finished Load AppArmor profiles. Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Load Kernel Module ramoops. Starting Create Volatile Files and Directories... [ OK ] Started Network Configuration. Starting Wait for Network to be Configured... [ OK ] Finished Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting RPC bind portmap service... Starting Network Name Resolution... Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Wait for Network to be Configured. [ OK ] Mounted RPC Pipe File System. [ OK ] Found device /dev/ttyS1. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target rpc_pipefs.target. Starting LVM event activation on device 259:0... Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Reached target NFS client services. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. [ OK ] Listening on UUID daemon activation socket. Mounting /var/lib/ceph... [ OK ] Listening on Docker Socket for the API. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... [ OK ] Started ntp-systemd-netif.service. Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... [ OK ] Started RPC bind portmap service. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Reached target RPC Port Mapper. Starting RPC Remote Quota Server... [ OK ] Found device 82599ES 10-Gi…ork Connection (AOC-STGN-i2S). [ OK ] Started ifup for ens1f0. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. [ OK ] Started RPC Remote Quota Server. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Mounted /var/lib/ceph. [ OK ] Started System Logging Service. [ OK ] Finished GRUB failed boot detection. [ OK ] Started User Login Management. [ OK ] Finished Helper to synchronize boot up for ifupdown. Starting Raise network interfaces... [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [* ] A start job is running for Raise network interfaces (7s / 5min 3s) M [** ] A start job is running for Raise network interfaces (7s / 5min 3s) M [*** ] A start job is running for Raise network interfaces (8s / 5min 3s) M [ *** ] A start job is running for Raise network interfaces (9s / 5min 3s) M [ *** ] A start job is running for Raise network interfaces (9s / 5min 3s) M [ ***] A start job is running for Raise network interfaces (10s / 5min 3s) M [ **] A start job is running for Raise network interfaces (10s / 5min 3s) M [ *] A start job is running for Raise network interfaces (11s / 5min 3s) M [ **] A start job is running for Raise network interfaces (12s / 5min 3s) M [ ***] A start job is running for Raise network interfaces (12s / 5min 3s) M [ *** ] A start job is running for Raise network interfaces (13s / 5min 3s) M [ *** ] A start job is running for Raise network interfaces (13s / 5min 3s) M [*** ] A start job is running for Raise network interfaces (14s / 5min 3s) M [** ] A start job is running for Raise network interfaces (14s / 5min 3s) M [* ] A start job is running for Raise network interfaces (15s / 5min 3s) M [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting NFS status monitor for NFSv2/3 locking.... + myips=172.21.15.57 + attempts=1 + sleep 1 Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... [ OK ] Started OpenBSD Secure Shell server. [ OK ] Started Network Time Service. [ OK ] Finished Ubuntu FAN network setup. [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Finished NFS server and services. Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. + '[' 172.21.15.57 '!=' '' ']' + set -e + '[' -n 172.21.15.57 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.57 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.57 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' [ OK ] Started (i)SCSI target daemon. [ OK ] Started The Apache HTTP Server. + newhostname=smithi057.front.sepia.ceph.com + '[' -n smithi057.front.sepia.ceph.com ']' + hostname smithi057.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi057 + echo smithi057 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.57 smithi057.front.sepia.ceph.com smithi057/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started LSB: Collectl monitors system performance.. Ubuntu 22.04.1 LTS smithi057.front.sepia.ceph.com ttyS1 smithi057 login: [disconnect] 2024-04-25T22:06:10.306 INFO:teuthology.misc:Re-opening connections... 2024-04-25T22:06:10.306 INFO:teuthology.misc:trying to connect to ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T22:06:10.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-25T22:06:10.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:06:10.751 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-04-25T22:06:11.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~134s 2024-04-25T22:06:12.150 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-25T22:06:12.150 DEBUG:teuthology.misc:waited 1.8441839218139648 2024-04-25T22:06:13.151 DEBUG:tasks.ceph_manager:Mounting data for osd.0 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T22:06:13.151 INFO:tasks.ceph_manager:Mounting osd.0: dev: ubuntu@smithi057.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-0, type: xfs, options: ['noatime'] 2024-04-25T22:06:13.152 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T22:06:13.313 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:06:13.352 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T22:06:13.352 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T22:06:13.397 INFO:tasks.ceph.osd.0:Started 2024-04-25T22:06:13.398 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:06:13.536 INFO:teuthology.orchestra.run.smithi057.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-25T22:06:13.539 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T22:06:13.540 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-04-25T22:06:15.078 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:06:15.370+0000 7fcd0aaab7c0 -1 Falling back to public interface 2024-04-25T22:06:17.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-25T22:06:18.541 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:06:18.653 INFO:teuthology.orchestra.run.smithi057.stderr:no valid command found; 10 closest matches: 2024-04-25T22:06:18.653 INFO:teuthology.orchestra.run.smithi057.stderr:0 2024-04-25T22:06:18.653 INFO:teuthology.orchestra.run.smithi057.stderr:1 2024-04-25T22:06:18.653 INFO:teuthology.orchestra.run.smithi057.stderr:2 2024-04-25T22:06:18.653 INFO:teuthology.orchestra.run.smithi057.stderr:abort 2024-04-25T22:06:18.653 INFO:teuthology.orchestra.run.smithi057.stderr:assert 2024-04-25T22:06:18.654 INFO:teuthology.orchestra.run.smithi057.stderr:bluestore allocator dump block 2024-04-25T22:06:18.654 INFO:teuthology.orchestra.run.smithi057.stderr:bluestore allocator fragmentation block 2024-04-25T22:06:18.654 INFO:teuthology.orchestra.run.smithi057.stderr:bluestore allocator fragmentation histogram block [] [] 2024-04-25T22:06:18.654 INFO:teuthology.orchestra.run.smithi057.stderr:bluestore allocator score block 2024-04-25T22:06:18.654 INFO:teuthology.orchestra.run.smithi057.stderr:config diff 2024-04-25T22:06:18.654 INFO:teuthology.orchestra.run.smithi057.stderr:admin_socket: invalid command 2024-04-25T22:06:18.655 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T22:06:18.656 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-04-25T22:06:20.159 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:06:20.450+0000 7fcd0aaab7c0 -1 osd.0 81 log_to_monitors true 2024-04-25T22:06:20.825 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-25T22:06:21.118+0000 7fccfe889640 -1 osd.0 89 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T22:06:23.657 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:06:23.793 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:06:23.793 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-25T22:06:23.794 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-25T22:06:23.794 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:06:23.813 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-25T22:06:23.964 INFO:teuthology.orchestra.run.smithi044.stdout:mon.a: {} 2024-04-25T22:06:23.964 INFO:teuthology.orchestra.run.smithi044.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:06:23.973 INFO:teuthology.orchestra.run.smithi044.stdout:mon.b: {} 2024-04-25T22:06:23.973 INFO:teuthology.orchestra.run.smithi044.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:06:23.983 INFO:teuthology.orchestra.run.smithi044.stdout:mon.c: {} 2024-04-25T22:06:23.983 INFO:teuthology.orchestra.run.smithi044.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:06:24.000 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T22:06:24.790 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T22:06:24.815 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-25T22:06:25.809 INFO:teuthology.orchestra.run.smithi044.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-25T22:06:25.837 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T22:06:26.806 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T22:06:26.833 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-25T22:06:27.815 INFO:teuthology.orchestra.run.smithi044.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-25T22:06:27.843 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T22:06:28.831 INFO:teuthology.orchestra.run.smithi044.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T22:06:28.859 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-25T22:06:29.833 INFO:teuthology.orchestra.run.smithi044.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-25T22:06:29.861 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-25T22:06:29.861 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-25T22:06:29.861 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-25T22:06:29.861 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-25T22:06:29.861 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T22:06:29.861 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:06:30.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:06:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":98,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:06:29.826045+0000","last_up_change":"2024-04-25T22:06:21.751537+0000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:01:03.632568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:01:07.995071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:01:12.514055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:01:12.963831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":81,"up_from":90,"up_thru":94,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2123863143},{"type":"v1","addr":"172.21.15.57:6801","nonce":2123863143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2123863143},{"type":"v1","addr":"172.21.15.57:6803","nonce":2123863143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2123863143},{"type":"v1","addr":"172.21.15.57:6807","nonce":2123863143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2123863143},{"type":"v1","addr":"172.21.15.57:6805","nonce":2123863143}]},"public_addr":"172.21.15.57:6801/2123863143","cluster_addr":"172.21.15.57:6803/2123863143","heartbeat_back_addr":"172.21.15.57:6807/2123863143","heartbeat_front_addr":"172.21.15.57:6805/2123863143","state":["exists","up"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6801","nonce":29975895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6803","nonce":29975895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6807","nonce":29975895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6805","nonce":29975895}]},"public_addr":"172.21.15.79:6801/29975895","cluster_addr":"172.21.15.79:6803/29975895","heartbeat_back_addr":"172.21.15.79:6807/29975895","heartbeat_front_addr":"172.21.15.79:6805/29975895","state":["exists","up"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6801","nonce":3918111900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6803","nonce":3918111900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6807","nonce":3918111900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6805","nonce":3918111900}]},"public_addr":"172.21.15.81:6801/3918111900","cluster_addr":"172.21.15.81:6803/3918111900","heartbeat_back_addr":"172.21.15.81:6807/3918111900","heartbeat_front_addr":"172.21.15.81:6805/3918111900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:59.025944+0000","dead_epoch":81},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.986080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.971238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":1,"to":0}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":0}]},{"pgid":"4.36","mappings":[{"from":2,"to":0}]},{"pgid":"4.3b","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:06:30.187 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T22:06:30.187 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:06:30.488 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:06:30.488 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":98,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:06:29.826045+0000","last_up_change":"2024-04-25T22:06:21.751537+0000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:01:03.632568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:01:07.995071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:01:12.514055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:01:12.963831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":81,"up_from":90,"up_thru":94,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2123863143},{"type":"v1","addr":"172.21.15.57:6801","nonce":2123863143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2123863143},{"type":"v1","addr":"172.21.15.57:6803","nonce":2123863143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2123863143},{"type":"v1","addr":"172.21.15.57:6807","nonce":2123863143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2123863143},{"type":"v1","addr":"172.21.15.57:6805","nonce":2123863143}]},"public_addr":"172.21.15.57:6801/2123863143","cluster_addr":"172.21.15.57:6803/2123863143","heartbeat_back_addr":"172.21.15.57:6807/2123863143","heartbeat_front_addr":"172.21.15.57:6805/2123863143","state":["exists","up"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6801","nonce":29975895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6803","nonce":29975895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6807","nonce":29975895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6805","nonce":29975895}]},"public_addr":"172.21.15.79:6801/29975895","cluster_addr":"172.21.15.79:6803/29975895","heartbeat_back_addr":"172.21.15.79:6807/29975895","heartbeat_front_addr":"172.21.15.79:6805/29975895","state":["exists","up"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6801","nonce":3918111900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6803","nonce":3918111900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6807","nonce":3918111900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6805","nonce":3918111900}]},"public_addr":"172.21.15.81:6801/3918111900","cluster_addr":"172.21.15.81:6803/3918111900","heartbeat_back_addr":"172.21.15.81:6807/3918111900","heartbeat_front_addr":"172.21.15.81:6805/3918111900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:59.025944+0000","dead_epoch":81},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.986080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.971238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":1,"to":0}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":0}]},{"pgid":"4.36","mappings":[{"from":2,"to":0}]},{"pgid":"4.3b","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:06:30.507 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T22:06:30.507 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T22:06:30.508 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T22:06:30.662 INFO:teuthology.orchestra.run.smithi044.stdout:34359738439 2024-04-25T22:06:30.662 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T22:06:30.668 INFO:teuthology.orchestra.run.smithi044.stdout:386547056643 2024-04-25T22:06:30.668 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T22:06:30.672 INFO:teuthology.orchestra.run.smithi044.stdout:34359738440 2024-04-25T22:06:30.672 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T22:06:30.946 INFO:teuthology.orchestra.run.smithi044.stdout:34359738438 2024-04-25T22:06:30.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738439 got 34359738438 for osd.1 2024-04-25T22:06:30.999 INFO:teuthology.orchestra.run.smithi044.stdout:386547056642 2024-04-25T22:06:31.001 INFO:teuthology.orchestra.run.smithi044.stdout:34359738439 2024-04-25T22:06:31.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 386547056643 got 386547056642 for osd.0 2024-04-25T22:06:31.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738440 got 34359738439 for osd.2 2024-04-25T22:06:31.967 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T22:06:32.019 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T22:06:32.021 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T22:06:32.276 INFO:teuthology.orchestra.run.smithi044.stdout:34359738439 2024-04-25T22:06:32.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738439 got 34359738439 for osd.1 2024-04-25T22:06:32.293 DEBUG:teuthology.parallel:result is None 2024-04-25T22:06:32.307 INFO:teuthology.orchestra.run.smithi044.stdout:386547056644 2024-04-25T22:06:32.317 INFO:teuthology.orchestra.run.smithi044.stdout:34359738440 2024-04-25T22:06:32.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 386547056643 got 386547056644 for osd.0 2024-04-25T22:06:32.325 DEBUG:teuthology.parallel:result is None 2024-04-25T22:06:32.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738440 got 34359738440 for osd.2 2024-04-25T22:06:32.335 DEBUG:teuthology.parallel:result is None 2024-04-25T22:06:32.335 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T22:06:32.336 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:06:32.681 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:06:32.683 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:06:32.699 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2024-04-25T22:06:31.687793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127966494,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2864,"num_read_kb":1340487,"num_write":29405,"num_write_kb":4408200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33161,"ondisk_log_size":33161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":257244,"kb_used_data":72492,"kb_used_omap":138,"kb_used_meta":184565,"kb_avail":282858276,"statfs":{"total":289910292480,"available":289646874624,"internally_reserved":0,"allocated":74231808,"data_stored":257136384,"data_compressed":21852604,"data_compressed_allocated":35381248,"data_compressed_original":219766784,"omap_allocated":141371,"internal_metadata":188995525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-36,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001240"},"pg_stats":[{"pgid":"4.3f","version":"76'446","reported_seq":602,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834874+0000","last_change":"2024-04-25T22:03:33.876369+0000","last_active":"2024-04-25T22:06:29.834874+0000","last_peered":"2024-04-25T22:06:29.834874+0000","last_clean":"2024-04-25T22:06:29.834874+0000","last_became_active":"2024-04-25T22:03:33.873739+0000","last_became_peered":"2024-04-25T22:03:33.873739+0000","last_unstale":"2024-04-25T22:06:29.834874+0000","last_undegraded":"2024-04-25T22:06:29.834874+0000","last_fullsized":"2024-04-25T22:06:29.834874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:32.529707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29432,"num_write":407,"num_write_kb":84235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"76'417","reported_seq":568,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834103+0000","last_change":"2024-04-25T22:03:33.861269+0000","last_active":"2024-04-25T22:06:29.834103+0000","last_peered":"2024-04-25T22:06:29.834103+0000","last_clean":"2024-04-25T22:06:29.834103+0000","last_became_active":"2024-04-25T22:03:33.859221+0000","last_became_peered":"2024-04-25T22:03:33.859221+0000","last_unstale":"2024-04-25T22:06:29.834103+0000","last_undegraded":"2024-04-25T22:06:29.834103+0000","last_fullsized":"2024-04-25T22:06:29.834103+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:23:44.690527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":23541,"num_write":389,"num_write_kb":87654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"76'389","reported_seq":550,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.136427+0000","last_change":"2024-04-25T22:06:30.136427+0000","last_active":"2024-04-25T22:06:30.136427+0000","last_peered":"2024-04-25T22:03:46.909574+0000","last_clean":"2024-04-25T22:03:46.909574+0000","last_became_active":"2024-04-25T22:03:33.863788+0000","last_became_peered":"2024-04-25T22:03:33.863788+0000","last_unstale":"2024-04-25T22:06:30.136427+0000","last_undegraded":"2024-04-25T22:06:30.136427+0000","last_fullsized":"2024-04-25T22:06:30.136427+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22311,"num_write":361,"num_write_kb":42975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"76'394","reported_seq":586,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.133476+0000","last_change":"2024-04-25T22:06:23.123256+0000","last_active":"2024-04-25T22:06:30.133476+0000","last_peered":"2024-04-25T22:06:30.133476+0000","last_clean":"2024-04-25T22:06:30.133476+0000","last_became_active":"2024-04-25T22:06:23.090780+0000","last_became_peered":"2024-04-25T22:06:23.090780+0000","last_unstale":"2024-04-25T22:06:30.133476+0000","last_undegraded":"2024-04-25T22:06:30.133476+0000","last_fullsized":"2024-04-25T22:06:30.133476+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:57.110628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":20785,"num_write":367,"num_write_kb":63746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"76'429","reported_seq":938,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834238+0000","last_change":"2024-04-25T22:06:28.839715+0000","last_active":"2024-04-25T22:06:29.834238+0000","last_peered":"2024-04-25T22:06:29.834238+0000","last_clean":"2024-04-25T22:06:29.834238+0000","last_became_active":"2024-04-25T22:06:28.836687+0000","last_became_peered":"2024-04-25T22:06:28.836687+0000","last_unstale":"2024-04-25T22:06:29.834238+0000","last_undegraded":"2024-04-25T22:06:29.834238+0000","last_fullsized":"2024-04-25T22:06:29.834238+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:10.175157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":20896,"num_write":403,"num_write_kb":100255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"76'368","reported_seq":540,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132775+0000","last_change":"2024-04-25T22:06:23.129617+0000","last_active":"2024-04-25T22:06:30.132775+0000","last_peered":"2024-04-25T22:06:30.132775+0000","last_clean":"2024-04-25T22:06:30.132775+0000","last_became_active":"2024-04-25T22:06:23.107939+0000","last_became_peered":"2024-04-25T22:06:23.107939+0000","last_unstale":"2024-04-25T22:06:30.132775+0000","last_undegraded":"2024-04-25T22:06:30.132775+0000","last_fullsized":"2024-04-25T22:06:30.132775+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:24.183902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9362,"num_write":344,"num_write_kb":20831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"76'438","reported_seq":636,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131211+0000","last_change":"2024-04-25T22:06:23.123861+0000","last_active":"2024-04-25T22:06:30.131211+0000","last_peered":"2024-04-25T22:06:30.131211+0000","last_clean":"2024-04-25T22:06:30.131211+0000","last_became_active":"2024-04-25T22:06:23.098436+0000","last_became_peered":"2024-04-25T22:06:23.098436+0000","last_unstale":"2024-04-25T22:06:30.131211+0000","last_undegraded":"2024-04-25T22:06:30.131211+0000","last_fullsized":"2024-04-25T22:06:30.131211+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:35.433423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25961,"num_write":415,"num_write_kb":72541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'392","reported_seq":600,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130666+0000","last_change":"2024-04-25T22:06:23.128274+0000","last_active":"2024-04-25T22:06:30.130666+0000","last_peered":"2024-04-25T22:06:30.130666+0000","last_clean":"2024-04-25T22:06:30.130666+0000","last_became_active":"2024-04-25T22:06:23.091431+0000","last_became_peered":"2024-04-25T22:06:23.091431+0000","last_unstale":"2024-04-25T22:06:30.130666+0000","last_undegraded":"2024-04-25T22:06:30.130666+0000","last_fullsized":"2024-04-25T22:06:30.130666+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:48.206131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":24749,"num_write":354,"num_write_kb":64232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"76'443","reported_seq":649,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842265+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:06:29.842265+0000","last_peered":"2024-04-25T22:06:29.842265+0000","last_clean":"2024-04-25T22:06:29.842265+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:06:29.842265+0000","last_undegraded":"2024-04-25T22:06:29.842265+0000","last_fullsized":"2024-04-25T22:06:29.842265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":10648,"num_write":411,"num_write_kb":92932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'392","reported_seq":509,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131757+0000","last_change":"2024-04-25T22:06:26.120464+0000","last_active":"2024-04-25T22:06:30.131757+0000","last_peered":"2024-04-25T22:06:30.131757+0000","last_clean":"2024-04-25T22:06:30.131757+0000","last_became_active":"2024-04-25T22:06:26.114463+0000","last_became_peered":"2024-04-25T22:06:26.114463+0000","last_unstale":"2024-04-25T22:06:30.131757+0000","last_undegraded":"2024-04-25T22:06:30.131757+0000","last_fullsized":"2024-04-25T22:06:30.131757+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:37:54.870762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10696,"num_write":359,"num_write_kb":63259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'391","reported_seq":567,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.135469+0000","last_change":"2024-04-25T22:06:23.135020+0000","last_active":"2024-04-25T22:06:30.135469+0000","last_peered":"2024-04-25T22:06:30.135469+0000","last_clean":"2024-04-25T22:06:30.135469+0000","last_became_active":"2024-04-25T22:06:23.123801+0000","last_became_peered":"2024-04-25T22:06:23.123801+0000","last_unstale":"2024-04-25T22:06:30.135469+0000","last_undegraded":"2024-04-25T22:06:30.135469+0000","last_fullsized":"2024-04-25T22:06:30.135469+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:11:44.607123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11259,"num_write":372,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"76'365","reported_seq":645,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835231+0000","last_change":"2024-04-25T22:06:22.802947+0000","last_active":"2024-04-25T22:06:29.835231+0000","last_peered":"2024-04-25T22:06:29.835231+0000","last_clean":"2024-04-25T22:06:29.835231+0000","last_became_active":"2024-04-25T22:06:22.792880+0000","last_became_peered":"2024-04-25T22:06:22.792880+0000","last_unstale":"2024-04-25T22:06:29.835231+0000","last_undegraded":"2024-04-25T22:06:29.835231+0000","last_fullsized":"2024-04-25T22:06:29.835231+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":51972,"num_write":340,"num_write_kb":51203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"76'420","reported_seq":572,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833638+0000","last_change":"2024-04-25T22:03:33.866815+0000","last_active":"2024-04-25T22:06:29.833638+0000","last_peered":"2024-04-25T22:06:29.833638+0000","last_clean":"2024-04-25T22:06:29.833638+0000","last_became_active":"2024-04-25T22:03:33.859376+0000","last_became_peered":"2024-04-25T22:03:33.859376+0000","last_unstale":"2024-04-25T22:06:29.833638+0000","last_undegraded":"2024-04-25T22:06:29.833638+0000","last_fullsized":"2024-04-25T22:06:29.833638+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:08.620311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17620,"num_write":386,"num_write_kb":100613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"76'432","reported_seq":629,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132417+0000","last_change":"2024-04-25T22:06:23.128788+0000","last_active":"2024-04-25T22:06:30.132417+0000","last_peered":"2024-04-25T22:06:30.132417+0000","last_clean":"2024-04-25T22:06:30.132417+0000","last_became_active":"2024-04-25T22:06:23.081466+0000","last_became_peered":"2024-04-25T22:06:23.081466+0000","last_unstale":"2024-04-25T22:06:30.132417+0000","last_undegraded":"2024-04-25T22:06:30.132417+0000","last_fullsized":"2024-04-25T22:06:30.132417+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:15.042731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27327,"num_write":398,"num_write_kb":76113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"76'385","reported_seq":582,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131043+0000","last_change":"2024-04-25T22:06:23.116284+0000","last_active":"2024-04-25T22:06:30.131043+0000","last_peered":"2024-04-25T22:06:30.131043+0000","last_clean":"2024-04-25T22:06:30.131043+0000","last_became_active":"2024-04-25T22:06:23.088046+0000","last_became_peered":"2024-04-25T22:06:23.088046+0000","last_unstale":"2024-04-25T22:06:30.131043+0000","last_undegraded":"2024-04-25T22:06:30.131043+0000","last_fullsized":"2024-04-25T22:06:30.131043+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:40:35.110567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23986,"num_write":352,"num_write_kb":50754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"76'434","reported_seq":613,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131878+0000","last_change":"2024-04-25T22:06:23.132996+0000","last_active":"2024-04-25T22:06:30.131878+0000","last_peered":"2024-04-25T22:06:30.131878+0000","last_clean":"2024-04-25T22:06:30.131878+0000","last_became_active":"2024-04-25T22:06:23.117497+0000","last_became_peered":"2024-04-25T22:06:23.117497+0000","last_unstale":"2024-04-25T22:06:30.131878+0000","last_undegraded":"2024-04-25T22:06:30.131878+0000","last_fullsized":"2024-04-25T22:06:30.131878+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:30.022312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":13806,"num_write":403,"num_write_kb":38995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"76'444","reported_seq":656,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.843387+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:06:29.843387+0000","last_peered":"2024-04-25T22:06:29.843387+0000","last_clean":"2024-04-25T22:06:29.843387+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:06:29.843387+0000","last_undegraded":"2024-04-25T22:06:29.843387+0000","last_fullsized":"2024-04-25T22:06:29.843387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":11085,"num_write":416,"num_write_kb":68377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'396","reported_seq":529,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834759+0000","last_change":"2024-04-25T22:03:33.862762+0000","last_active":"2024-04-25T22:06:29.834759+0000","last_peered":"2024-04-25T22:06:29.834759+0000","last_clean":"2024-04-25T22:06:29.834759+0000","last_became_active":"2024-04-25T22:03:33.861082+0000","last_became_peered":"2024-04-25T22:03:33.861082+0000","last_unstale":"2024-04-25T22:06:29.834759+0000","last_undegraded":"2024-04-25T22:06:29.834759+0000","last_fullsized":"2024-04-25T22:06:29.834759+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:15.823113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6581,"num_write":355,"num_write_kb":34159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"76'447","reported_seq":646,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.841872+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:06:29.841872+0000","last_peered":"2024-04-25T22:06:29.841872+0000","last_clean":"2024-04-25T22:06:29.841872+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:06:29.841872+0000","last_undegraded":"2024-04-25T22:06:29.841872+0000","last_fullsized":"2024-04-25T22:06:29.841872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22089,"num_write":411,"num_write_kb":104750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'426","reported_seq":602,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.135373+0000","last_change":"2024-04-25T22:06:23.122769+0000","last_active":"2024-04-25T22:06:30.135373+0000","last_peered":"2024-04-25T22:06:30.135373+0000","last_clean":"2024-04-25T22:06:30.135373+0000","last_became_active":"2024-04-25T22:06:23.093379+0000","last_became_peered":"2024-04-25T22:06:23.093379+0000","last_unstale":"2024-04-25T22:06:30.135373+0000","last_undegraded":"2024-04-25T22:06:30.135373+0000","last_fullsized":"2024-04-25T22:06:30.135373+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:48.070891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11886,"num_write":398,"num_write_kb":55010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"76'405","reported_seq":600,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.134314+0000","last_change":"2024-04-25T22:06:23.129396+0000","last_active":"2024-04-25T22:06:30.134314+0000","last_peered":"2024-04-25T22:06:30.134314+0000","last_clean":"2024-04-25T22:06:30.134314+0000","last_became_active":"2024-04-25T22:06:23.110101+0000","last_became_peered":"2024-04-25T22:06:23.110101+0000","last_unstale":"2024-04-25T22:06:30.134314+0000","last_undegraded":"2024-04-25T22:06:30.134314+0000","last_fullsized":"2024-04-25T22:06:30.134314+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:40.218610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23004,"num_write":370,"num_write_kb":75802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'436","reported_seq":557,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833470+0000","last_change":"2024-04-25T22:06:28.838562+0000","last_active":"2024-04-25T22:06:29.833470+0000","last_peered":"2024-04-25T22:06:29.833470+0000","last_clean":"2024-04-25T22:06:29.833470+0000","last_became_active":"2024-04-25T22:06:28.835081+0000","last_became_peered":"2024-04-25T22:06:28.835081+0000","last_unstale":"2024-04-25T22:06:29.833470+0000","last_undegraded":"2024-04-25T22:06:29.833470+0000","last_fullsized":"2024-04-25T22:06:29.833470+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:15:18.057041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11950,"num_write":408,"num_write_kb":67524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"76'403","reported_seq":605,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.839248+0000","last_change":"2024-04-25T22:06:22.810930+0000","last_active":"2024-04-25T22:06:29.839248+0000","last_peered":"2024-04-25T22:06:29.839248+0000","last_clean":"2024-04-25T22:06:29.839248+0000","last_became_active":"2024-04-25T22:06:22.802907+0000","last_became_peered":"2024-04-25T22:06:22.802907+0000","last_unstale":"2024-04-25T22:06:29.839248+0000","last_undegraded":"2024-04-25T22:06:29.839248+0000","last_fullsized":"2024-04-25T22:06:29.839248+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:00.334109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":6507,"num_write":370,"num_write_kb":51513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'449","reported_seq":572,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.832812+0000","last_change":"2024-04-25T22:06:28.846531+0000","last_active":"2024-04-25T22:06:29.832812+0000","last_peered":"2024-04-25T22:06:29.832812+0000","last_clean":"2024-04-25T22:06:29.832812+0000","last_became_active":"2024-04-25T22:06:28.841283+0000","last_became_peered":"2024-04-25T22:06:28.841283+0000","last_unstale":"2024-04-25T22:06:29.832812+0000","last_undegraded":"2024-04-25T22:06:29.832812+0000","last_fullsized":"2024-04-25T22:06:29.832812+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:02.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27047,"num_write":417,"num_write_kb":63386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"76'406","reported_seq":569,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835163+0000","last_change":"2024-04-25T22:06:22.801634+0000","last_active":"2024-04-25T22:06:29.835163+0000","last_peered":"2024-04-25T22:06:29.835163+0000","last_clean":"2024-04-25T22:06:29.835163+0000","last_became_active":"2024-04-25T22:06:22.791470+0000","last_became_peered":"2024-04-25T22:06:22.791470+0000","last_unstale":"2024-04-25T22:06:29.835163+0000","last_undegraded":"2024-04-25T22:06:29.835163+0000","last_fullsized":"2024-04-25T22:06:29.835163+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:25.424659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25550,"num_write":386,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"76'485","reported_seq":733,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842474+0000","last_change":"2024-04-25T22:06:22.814124+0000","last_active":"2024-04-25T22:06:29.842474+0000","last_peered":"2024-04-25T22:06:29.842474+0000","last_clean":"2024-04-25T22:06:29.842474+0000","last_became_active":"2024-04-25T22:06:22.804228+0000","last_became_peered":"2024-04-25T22:06:22.804228+0000","last_unstale":"2024-04-25T22:06:29.842474+0000","last_undegraded":"2024-04-25T22:06:29.842474+0000","last_fullsized":"2024-04-25T22:06:29.842474+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":30714,"num_write":444,"num_write_kb":92836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'387","reported_seq":590,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.135315+0000","last_change":"2024-04-25T22:06:23.134971+0000","last_active":"2024-04-25T22:06:30.135315+0000","last_peered":"2024-04-25T22:06:30.135315+0000","last_clean":"2024-04-25T22:06:30.135315+0000","last_became_active":"2024-04-25T22:06:23.121334+0000","last_became_peered":"2024-04-25T22:06:23.121334+0000","last_unstale":"2024-04-25T22:06:30.135315+0000","last_undegraded":"2024-04-25T22:06:30.135315+0000","last_fullsized":"2024-04-25T22:06:30.135315+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:03.991336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21644,"num_write":354,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"76'405","reported_seq":647,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835567+0000","last_change":"2024-04-25T22:06:22.829889+0000","last_active":"2024-04-25T22:06:29.835567+0000","last_peered":"2024-04-25T22:06:29.835567+0000","last_clean":"2024-04-25T22:06:29.835567+0000","last_became_active":"2024-04-25T22:06:22.827066+0000","last_became_peered":"2024-04-25T22:06:22.827066+0000","last_unstale":"2024-04-25T22:06:29.835567+0000","last_undegraded":"2024-04-25T22:06:29.835567+0000","last_fullsized":"2024-04-25T22:06:29.835567+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:01.822252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27522,"num_write":375,"num_write_kb":96416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"76'396","reported_seq":617,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.841153+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:06:29.841153+0000","last_peered":"2024-04-25T22:06:29.841153+0000","last_clean":"2024-04-25T22:06:29.841153+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:06:29.841153+0000","last_undegraded":"2024-04-25T22:06:29.841153+0000","last_fullsized":"2024-04-25T22:06:29.841153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28501,"num_write":367,"num_write_kb":63458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":652,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833778+0000","last_change":"2024-04-25T22:06:22.803787+0000","last_active":"2024-04-25T22:06:29.833778+0000","last_peered":"2024-04-25T22:06:29.833778+0000","last_clean":"2024-04-25T22:06:29.833778+0000","last_became_active":"2024-04-25T22:06:22.789907+0000","last_became_peered":"2024-04-25T22:06:22.789907+0000","last_unstale":"2024-04-25T22:06:29.833778+0000","last_undegraded":"2024-04-25T22:06:29.833778+0000","last_fullsized":"2024-04-25T22:06:29.833778+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":20717,"num_write":435,"num_write_kb":55985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"76'444","reported_seq":645,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.839540+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:06:29.839540+0000","last_peered":"2024-04-25T22:06:29.839540+0000","last_clean":"2024-04-25T22:06:29.839540+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:06:29.839540+0000","last_undegraded":"2024-04-25T22:06:29.839540+0000","last_fullsized":"2024-04-25T22:06:29.839540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":10758,"num_write":401,"num_write_kb":44705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'422","reported_seq":525,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.131754+0000","last_change":"2024-04-25T22:06:30.131754+0000","last_active":"2024-04-25T22:06:30.131754+0000","last_peered":"2024-04-25T22:03:46.918292+0000","last_clean":"2024-04-25T22:03:46.918292+0000","last_became_active":"2024-04-25T22:02:43.850651+0000","last_became_peered":"2024-04-25T22:02:43.850651+0000","last_unstale":"2024-04-25T22:06:30.131754+0000","last_undegraded":"2024-04-25T22:06:30.131754+0000","last_fullsized":"2024-04-25T22:06:30.131754+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":29059,"num_write":391,"num_write_kb":40233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"76'397","reported_seq":892,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835507+0000","last_change":"2024-04-25T22:06:26.819859+0000","last_active":"2024-04-25T22:06:29.835507+0000","last_peered":"2024-04-25T22:06:29.835507+0000","last_clean":"2024-04-25T22:06:29.835507+0000","last_became_active":"2024-04-25T22:06:26.816439+0000","last_became_peered":"2024-04-25T22:06:26.816439+0000","last_unstale":"2024-04-25T22:06:29.835507+0000","last_undegraded":"2024-04-25T22:06:29.835507+0000","last_fullsized":"2024-04-25T22:06:29.835507+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:44.452918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28857,"num_write":363,"num_write_kb":87969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"75'515","reported_seq":669,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132386+0000","last_change":"2024-04-25T22:06:23.117492+0000","last_active":"2024-04-25T22:06:30.132386+0000","last_peered":"2024-04-25T22:06:30.132386+0000","last_clean":"2024-04-25T22:06:30.132386+0000","last_became_active":"2024-04-25T22:06:23.109665+0000","last_became_peered":"2024-04-25T22:06:23.109665+0000","last_unstale":"2024-04-25T22:06:30.132386+0000","last_undegraded":"2024-04-25T22:06:30.132386+0000","last_fullsized":"2024-04-25T22:06:30.132386+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:01.482888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"76'375","reported_seq":479,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.836346+0000","last_change":"2024-04-25T22:06:28.846182+0000","last_active":"2024-04-25T22:06:29.836346+0000","last_peered":"2024-04-25T22:06:29.836346+0000","last_clean":"2024-04-25T22:06:29.836346+0000","last_became_active":"2024-04-25T22:06:28.841545+0000","last_became_peered":"2024-04-25T22:06:28.841545+0000","last_unstale":"2024-04-25T22:06:29.836346+0000","last_undegraded":"2024-04-25T22:06:29.836346+0000","last_fullsized":"2024-04-25T22:06:29.836346+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.018915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14983,"num_write":339,"num_write_kb":46748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'53","reported_seq":235,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840596+0000","last_change":"2024-04-25T22:06:22.839083+0000","last_active":"2024-04-25T22:06:29.840596+0000","last_peered":"2024-04-25T22:06:29.840596+0000","last_clean":"2024-04-25T22:06:29.840596+0000","last_became_active":"2024-04-25T22:06:22.833424+0000","last_became_peered":"2024-04-25T22:06:22.833424+0000","last_unstale":"2024-04-25T22:06:29.840596+0000","last_undegraded":"2024-04-25T22:06:29.840596+0000","last_fullsized":"2024-04-25T22:06:29.840596+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:00.819067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'426","reported_seq":637,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.843016+0000","last_change":"2024-04-25T22:06:26.822923+0000","last_active":"2024-04-25T22:06:29.843016+0000","last_peered":"2024-04-25T22:06:29.843016+0000","last_clean":"2024-04-25T22:06:29.843016+0000","last_became_active":"2024-04-25T22:06:26.819562+0000","last_became_peered":"2024-04-25T22:06:26.819562+0000","last_unstale":"2024-04-25T22:06:29.843016+0000","last_undegraded":"2024-04-25T22:06:29.843016+0000","last_fullsized":"2024-04-25T22:06:29.843016+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:42.832195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":17843,"num_write":388,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"75'71","reported_seq":186,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833579+0000","last_change":"2024-04-25T22:06:22.799710+0000","last_active":"2024-04-25T22:06:29.833579+0000","last_peered":"2024-04-25T22:06:29.833579+0000","last_clean":"2024-04-25T22:06:29.833579+0000","last_became_active":"2024-04-25T22:06:22.790902+0000","last_became_peered":"2024-04-25T22:06:22.790902+0000","last_unstale":"2024-04-25T22:06:29.833579+0000","last_undegraded":"2024-04-25T22:06:29.833579+0000","last_fullsized":"2024-04-25T22:06:29.833579+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:50:36.683583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'366","reported_seq":569,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842598+0000","last_change":"2024-04-25T22:06:22.809150+0000","last_active":"2024-04-25T22:06:29.842598+0000","last_peered":"2024-04-25T22:06:29.842598+0000","last_clean":"2024-04-25T22:06:29.842598+0000","last_became_active":"2024-04-25T22:06:22.803327+0000","last_became_peered":"2024-04-25T22:06:22.803327+0000","last_unstale":"2024-04-25T22:06:29.842598+0000","last_undegraded":"2024-04-25T22:06:29.842598+0000","last_fullsized":"2024-04-25T22:06:29.842598+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.731906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":16032,"num_write":334,"num_write_kb":25754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'63","reported_seq":219,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130229+0000","last_change":"2024-04-25T22:06:23.085892+0000","last_active":"2024-04-25T22:06:30.130229+0000","last_peered":"2024-04-25T22:06:30.130229+0000","last_clean":"2024-04-25T22:06:30.130229+0000","last_became_active":"2024-04-25T22:06:23.082351+0000","last_became_peered":"2024-04-25T22:06:23.082351+0000","last_unstale":"2024-04-25T22:06:30.130229+0000","last_undegraded":"2024-04-25T22:06:30.130229+0000","last_fullsized":"2024-04-25T22:06:30.130229+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:51.142517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"76'148","reported_seq":304,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132891+0000","last_change":"2024-04-25T22:06:23.089179+0000","last_active":"2024-04-25T22:06:30.132891+0000","last_peered":"2024-04-25T22:06:30.132891+0000","last_clean":"2024-04-25T22:06:30.132891+0000","last_became_active":"2024-04-25T22:06:23.085599+0000","last_became_peered":"2024-04-25T22:06:23.085599+0000","last_unstale":"2024-04-25T22:06:30.132891+0000","last_undegraded":"2024-04-25T22:06:30.132891+0000","last_fullsized":"2024-04-25T22:06:30.132891+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:53:14.055158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"76'402","reported_seq":566,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.832933+0000","last_change":"2024-04-25T22:06:22.802685+0000","last_active":"2024-04-25T22:06:29.832933+0000","last_peered":"2024-04-25T22:06:29.832933+0000","last_clean":"2024-04-25T22:06:29.832933+0000","last_became_active":"2024-04-25T22:06:22.789353+0000","last_became_peered":"2024-04-25T22:06:22.789353+0000","last_unstale":"2024-04-25T22:06:29.832933+0000","last_undegraded":"2024-04-25T22:06:29.832933+0000","last_fullsized":"2024-04-25T22:06:29.832933+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:14.949049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21114,"num_write":364,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"75'250","reported_seq":372,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835236+0000","last_change":"2024-04-25T22:06:22.791598+0000","last_active":"2024-04-25T22:06:29.835236+0000","last_peered":"2024-04-25T22:06:29.835236+0000","last_clean":"2024-04-25T22:06:29.835236+0000","last_became_active":"2024-04-25T22:06:22.790508+0000","last_became_peered":"2024-04-25T22:06:22.790508+0000","last_unstale":"2024-04-25T22:06:29.835236+0000","last_undegraded":"2024-04-25T22:06:29.835236+0000","last_fullsized":"2024-04-25T22:06:29.835236+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"76'460","reported_seq":632,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833171+0000","last_change":"2024-04-25T22:03:33.861055+0000","last_active":"2024-04-25T22:06:29.833171+0000","last_peered":"2024-04-25T22:06:29.833171+0000","last_clean":"2024-04-25T22:06:29.833171+0000","last_became_active":"2024-04-25T22:03:33.856638+0000","last_became_peered":"2024-04-25T22:03:33.856638+0000","last_unstale":"2024-04-25T22:06:29.833171+0000","last_undegraded":"2024-04-25T22:06:29.833171+0000","last_fullsized":"2024-04-25T22:06:29.833171+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":39774,"num_write":433,"num_write_kb":80294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'556","reported_seq":706,"reported_epoch":95,"state":"peering","last_fresh":"2024-04-25T22:06:27.110576+0000","last_change":"2024-04-25T22:06:30.134719+0000","last_active":"2024-04-25T22:06:30.134719+0000","last_peered":"2024-04-25T22:06:27.110576+0000","last_clean":"2024-04-25T22:06:27.110576+0000","last_became_active":"2024-04-25T22:06:23.113817+0000","last_became_peered":"2024-04-25T22:06:23.113817+0000","last_unstale":"2024-04-25T22:06:27.110576+0000","last_undegraded":"2024-04-25T22:06:27.110576+0000","last_fullsized":"2024-04-25T22:06:27.110576+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":509,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"76'413","reported_seq":575,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.133059+0000","last_change":"2024-04-25T22:06:23.129627+0000","last_active":"2024-04-25T22:06:30.133059+0000","last_peered":"2024-04-25T22:06:30.133059+0000","last_clean":"2024-04-25T22:06:30.133059+0000","last_became_active":"2024-04-25T22:06:23.108199+0000","last_became_peered":"2024-04-25T22:06:23.108199+0000","last_unstale":"2024-04-25T22:06:30.133059+0000","last_undegraded":"2024-04-25T22:06:30.133059+0000","last_fullsized":"2024-04-25T22:06:30.133059+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:23.828740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4858,"num_write":378,"num_write_kb":46741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"76'66","reported_seq":69,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.135417+0000","last_change":"2024-04-25T22:02:42.844584+0000","last_active":"2024-04-25T22:01:12.587237+0000","last_peered":"2024-04-25T22:01:12.587237+0000","last_clean":"2024-04-25T22:01:12.587237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:06:30.135417+0000","last_undegraded":"2024-04-25T22:06:30.135417+0000","last_fullsized":"2024-04-25T22:06:30.135417+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"76'489","reported_seq":727,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842038+0000","last_change":"2024-04-25T22:06:22.838952+0000","last_active":"2024-04-25T22:06:29.842038+0000","last_peered":"2024-04-25T22:06:29.842038+0000","last_clean":"2024-04-25T22:06:29.842038+0000","last_became_active":"2024-04-25T22:06:22.832394+0000","last_became_peered":"2024-04-25T22:06:22.832394+0000","last_unstale":"2024-04-25T22:06:29.842038+0000","last_undegraded":"2024-04-25T22:06:29.842038+0000","last_fullsized":"2024-04-25T22:06:29.842038+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:04:38.988916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":26829,"num_write":457,"num_write_kb":137840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"75'193","reported_seq":375,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842334+0000","last_change":"2024-04-25T22:06:22.838157+0000","last_active":"2024-04-25T22:06:29.842334+0000","last_peered":"2024-04-25T22:06:29.842334+0000","last_clean":"2024-04-25T22:06:29.842334+0000","last_became_active":"2024-04-25T22:06:22.832572+0000","last_became_peered":"2024-04-25T22:06:22.832572+0000","last_unstale":"2024-04-25T22:06:29.842334+0000","last_undegraded":"2024-04-25T22:06:29.842334+0000","last_fullsized":"2024-04-25T22:06:29.842334+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:34.994194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'437","reported_seq":520,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.136633+0000","last_change":"2024-04-25T22:06:30.136633+0000","last_active":"2024-04-25T22:06:30.136633+0000","last_peered":"2024-04-25T22:03:46.907516+0000","last_clean":"2024-04-25T22:03:46.907516+0000","last_became_active":"2024-04-25T22:02:43.852555+0000","last_became_peered":"2024-04-25T22:02:43.852555+0000","last_unstale":"2024-04-25T22:06:30.136633+0000","last_undegraded":"2024-04-25T22:06:30.136633+0000","last_fullsized":"2024-04-25T22:06:30.136633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3720,"num_write":406,"num_write_kb":30461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"76'106","reported_seq":262,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130809+0000","last_change":"2024-04-25T22:06:23.128769+0000","last_active":"2024-04-25T22:06:30.130809+0000","last_peered":"2024-04-25T22:06:30.130809+0000","last_clean":"2024-04-25T22:06:30.130809+0000","last_became_active":"2024-04-25T22:06:23.103402+0000","last_became_peered":"2024-04-25T22:06:23.103402+0000","last_unstale":"2024-04-25T22:06:30.130809+0000","last_undegraded":"2024-04-25T22:06:30.130809+0000","last_fullsized":"2024-04-25T22:06:30.130809+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:27.137773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"76'409","reported_seq":603,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132383+0000","last_change":"2024-04-25T22:06:23.133536+0000","last_active":"2024-04-25T22:06:30.132383+0000","last_peered":"2024-04-25T22:06:30.132383+0000","last_clean":"2024-04-25T22:06:30.132383+0000","last_became_active":"2024-04-25T22:06:23.086188+0000","last_became_peered":"2024-04-25T22:06:23.086188+0000","last_unstale":"2024-04-25T22:06:30.132383+0000","last_undegraded":"2024-04-25T22:06:30.132383+0000","last_fullsized":"2024-04-25T22:06:30.132383+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:13:59.140479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19178,"num_write":380,"num_write_kb":91945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"75'51","reported_seq":180,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833864+0000","last_change":"2024-04-25T22:06:22.800659+0000","last_active":"2024-04-25T22:06:29.833864+0000","last_peered":"2024-04-25T22:06:29.833864+0000","last_clean":"2024-04-25T22:06:29.833864+0000","last_became_active":"2024-04-25T22:06:22.798779+0000","last_became_peered":"2024-04-25T22:06:22.798779+0000","last_unstale":"2024-04-25T22:06:29.833864+0000","last_undegraded":"2024-04-25T22:06:29.833864+0000","last_fullsized":"2024-04-25T22:06:29.833864+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:35.728722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"76'377","reported_seq":559,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.134856+0000","last_change":"2024-04-25T22:06:23.114225+0000","last_active":"2024-04-25T22:06:30.134856+0000","last_peered":"2024-04-25T22:06:30.134856+0000","last_clean":"2024-04-25T22:06:30.134856+0000","last_became_active":"2024-04-25T22:06:23.085799+0000","last_became_peered":"2024-04-25T22:06:23.085799+0000","last_unstale":"2024-04-25T22:06:30.134856+0000","last_undegraded":"2024-04-25T22:06:30.134856+0000","last_fullsized":"2024-04-25T22:06:30.134856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:50.484372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21517,"num_write":342,"num_write_kb":66898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"75'449","reported_seq":544,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.832974+0000","last_change":"2024-04-25T22:03:33.860386+0000","last_active":"2024-04-25T22:06:29.832974+0000","last_peered":"2024-04-25T22:06:29.832974+0000","last_clean":"2024-04-25T22:06:29.832974+0000","last_became_active":"2024-04-25T22:03:33.859539+0000","last_became_peered":"2024-04-25T22:03:33.859539+0000","last_unstale":"2024-04-25T22:06:29.832974+0000","last_undegraded":"2024-04-25T22:06:29.832974+0000","last_fullsized":"2024-04-25T22:06:29.832974+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:20.247942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'399","reported_seq":611,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842608+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:06:29.842608+0000","last_peered":"2024-04-25T22:06:29.842608+0000","last_clean":"2024-04-25T22:06:29.842608+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:06:29.842608+0000","last_undegraded":"2024-04-25T22:06:29.842608+0000","last_fullsized":"2024-04-25T22:06:29.842608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17888,"num_write":373,"num_write_kb":67556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":316,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130098+0000","last_change":"2024-04-25T22:06:23.082707+0000","last_active":"2024-04-25T22:06:30.130098+0000","last_peered":"2024-04-25T22:06:30.130098+0000","last_clean":"2024-04-25T22:06:30.130098+0000","last_became_active":"2024-04-25T22:06:23.080701+0000","last_became_peered":"2024-04-25T22:06:23.080701+0000","last_unstale":"2024-04-25T22:06:30.130098+0000","last_undegraded":"2024-04-25T22:06:30.130098+0000","last_fullsized":"2024-04-25T22:06:30.130098+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:27.088849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130852+0000","last_change":"2024-04-25T22:06:23.116373+0000","last_active":"2024-04-25T22:06:30.130852+0000","last_peered":"2024-04-25T22:06:30.130852+0000","last_clean":"2024-04-25T22:06:30.130852+0000","last_became_active":"2024-04-25T22:06:23.108984+0000","last_became_peered":"2024-04-25T22:06:23.108984+0000","last_unstale":"2024-04-25T22:06:30.130852+0000","last_undegraded":"2024-04-25T22:06:30.130852+0000","last_fullsized":"2024-04-25T22:06:30.130852+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:08.884723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"75'393","reported_seq":568,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840908+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:06:29.840908+0000","last_peered":"2024-04-25T22:06:29.840908+0000","last_clean":"2024-04-25T22:06:29.840908+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:06:29.840908+0000","last_undegraded":"2024-04-25T22:06:29.840908+0000","last_fullsized":"2024-04-25T22:06:29.840908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'463","reported_seq":666,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.134571+0000","last_change":"2024-04-25T22:06:23.133028+0000","last_active":"2024-04-25T22:06:30.134571+0000","last_peered":"2024-04-25T22:06:30.134571+0000","last_clean":"2024-04-25T22:06:30.134571+0000","last_became_active":"2024-04-25T22:06:23.082756+0000","last_became_peered":"2024-04-25T22:06:23.082756+0000","last_unstale":"2024-04-25T22:06:30.134571+0000","last_undegraded":"2024-04-25T22:06:30.134571+0000","last_fullsized":"2024-04-25T22:06:30.134571+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:24:01.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29270,"num_write":426,"num_write_kb":129367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131290+0000","last_change":"2024-04-25T22:06:23.083451+0000","last_active":"2024-04-25T22:06:30.131290+0000","last_peered":"2024-04-25T22:06:30.131290+0000","last_clean":"2024-04-25T22:06:30.131290+0000","last_became_active":"2024-04-25T22:06:23.080841+0000","last_became_peered":"2024-04-25T22:06:23.080841+0000","last_unstale":"2024-04-25T22:06:30.131290+0000","last_undegraded":"2024-04-25T22:06:30.131290+0000","last_fullsized":"2024-04-25T22:06:30.131290+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:34.605367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"76'125","reported_seq":370,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840322+0000","last_change":"2024-04-25T22:06:22.804290+0000","last_active":"2024-04-25T22:06:29.840322+0000","last_peered":"2024-04-25T22:06:29.840322+0000","last_clean":"2024-04-25T22:06:29.840322+0000","last_became_active":"2024-04-25T22:06:22.801616+0000","last_became_peered":"2024-04-25T22:06:22.801616+0000","last_unstale":"2024-04-25T22:06:29.840322+0000","last_undegraded":"2024-04-25T22:06:29.840322+0000","last_fullsized":"2024-04-25T22:06:29.840322+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:13.402747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464197,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":63,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'457","reported_seq":644,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834440+0000","last_change":"2024-04-25T22:03:05.702224+0000","last_active":"2024-04-25T22:06:29.834440+0000","last_peered":"2024-04-25T22:06:29.834440+0000","last_clean":"2024-04-25T22:06:29.834440+0000","last_became_active":"2024-04-25T22:03:05.699581+0000","last_became_peered":"2024-04-25T22:03:05.699581+0000","last_unstale":"2024-04-25T22:06:29.834440+0000","last_undegraded":"2024-04-25T22:06:29.834440+0000","last_fullsized":"2024-04-25T22:06:29.834440+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":34759,"num_write":424,"num_write_kb":71902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840807+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:06:29.840807+0000","last_peered":"2024-04-25T22:06:29.840807+0000","last_clean":"2024-04-25T22:06:29.840807+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:06:29.840807+0000","last_undegraded":"2024-04-25T22:06:29.840807+0000","last_fullsized":"2024-04-25T22:06:29.840807+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"75'311","reported_seq":494,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833232+0000","last_change":"2024-04-25T22:06:22.801481+0000","last_active":"2024-04-25T22:06:29.833232+0000","last_peered":"2024-04-25T22:06:29.833232+0000","last_clean":"2024-04-25T22:06:29.833232+0000","last_became_active":"2024-04-25T22:06:22.794841+0000","last_became_peered":"2024-04-25T22:06:22.794841+0000","last_unstale":"2024-04-25T22:06:29.833232+0000","last_undegraded":"2024-04-25T22:06:29.833232+0000","last_fullsized":"2024-04-25T22:06:29.833232+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:06:59.330924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"76'373","reported_seq":590,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842957+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:06:29.842957+0000","last_peered":"2024-04-25T22:06:29.842957+0000","last_clean":"2024-04-25T22:06:29.842957+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:06:29.842957+0000","last_undegraded":"2024-04-25T22:06:29.842957+0000","last_fullsized":"2024-04-25T22:06:29.842957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28273,"num_write":350,"num_write_kb":87787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130568+0000","last_change":"2024-04-25T22:06:23.129162+0000","last_active":"2024-04-25T22:06:30.130568+0000","last_peered":"2024-04-25T22:06:30.130568+0000","last_clean":"2024-04-25T22:06:30.130568+0000","last_became_active":"2024-04-25T22:06:23.106155+0000","last_became_peered":"2024-04-25T22:06:23.106155+0000","last_unstale":"2024-04-25T22:06:30.130568+0000","last_undegraded":"2024-04-25T22:06:30.130568+0000","last_fullsized":"2024-04-25T22:06:30.130568+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:30.846068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"76'75","reported_seq":69,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.133335+0000","last_change":"2024-04-25T22:02:42.841987+0000","last_active":"2024-04-25T22:01:12.587237+0000","last_peered":"2024-04-25T22:01:12.587237+0000","last_clean":"2024-04-25T22:01:12.587237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:06:30.133335+0000","last_undegraded":"2024-04-25T22:06:30.133335+0000","last_fullsized":"2024-04-25T22:06:30.133335+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"76'461","reported_seq":751,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.841997+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:06:29.841997+0000","last_peered":"2024-04-25T22:06:29.841997+0000","last_clean":"2024-04-25T22:06:29.841997+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:06:29.841997+0000","last_undegraded":"2024-04-25T22:06:29.841997+0000","last_fullsized":"2024-04-25T22:06:29.841997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":67984,"num_write":425,"num_write_kb":154741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"76'268","reported_seq":423,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131579+0000","last_change":"2024-04-25T22:06:23.134306+0000","last_active":"2024-04-25T22:06:30.131579+0000","last_peered":"2024-04-25T22:06:30.131579+0000","last_clean":"2024-04-25T22:06:30.131579+0000","last_became_active":"2024-04-25T22:06:23.122629+0000","last_became_peered":"2024-04-25T22:06:23.122629+0000","last_unstale":"2024-04-25T22:06:30.131579+0000","last_undegraded":"2024-04-25T22:06:30.131579+0000","last_fullsized":"2024-04-25T22:06:30.131579+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:41.205934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842322+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:06:29.842322+0000","last_peered":"2024-04-25T22:06:29.842322+0000","last_clean":"2024-04-25T22:06:29.842322+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:06:29.842322+0000","last_undegraded":"2024-04-25T22:06:29.842322+0000","last_fullsized":"2024-04-25T22:06:29.842322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'398","reported_seq":576,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833710+0000","last_change":"2024-04-25T22:06:22.797468+0000","last_active":"2024-04-25T22:06:29.833710+0000","last_peered":"2024-04-25T22:06:29.833710+0000","last_clean":"2024-04-25T22:06:29.833710+0000","last_became_active":"2024-04-25T22:06:22.789384+0000","last_became_peered":"2024-04-25T22:06:22.789384+0000","last_unstale":"2024-04-25T22:06:29.833710+0000","last_undegraded":"2024-04-25T22:06:29.833710+0000","last_fullsized":"2024-04-25T22:06:29.833710+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:35.557386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":26599,"num_write":366,"num_write_kb":75612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"76'47","reported_seq":222,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842239+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:06:29.842239+0000","last_peered":"2024-04-25T22:06:29.842239+0000","last_clean":"2024-04-25T22:06:29.842239+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:06:29.842239+0000","last_undegraded":"2024-04-25T22:06:29.842239+0000","last_fullsized":"2024-04-25T22:06:29.842239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.837080+0000","last_change":"2024-04-25T22:03:05.701809+0000","last_active":"2024-04-25T22:06:29.837080+0000","last_peered":"2024-04-25T22:06:29.837080+0000","last_clean":"2024-04-25T22:06:29.837080+0000","last_became_active":"2024-04-25T22:03:05.701322+0000","last_became_peered":"2024-04-25T22:03:05.701322+0000","last_unstale":"2024-04-25T22:06:29.837080+0000","last_undegraded":"2024-04-25T22:06:29.837080+0000","last_fullsized":"2024-04-25T22:06:29.837080+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:45.907458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"76'406","reported_seq":640,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833959+0000","last_change":"2024-04-25T22:06:22.802683+0000","last_active":"2024-04-25T22:06:29.833959+0000","last_peered":"2024-04-25T22:06:29.833959+0000","last_clean":"2024-04-25T22:06:29.833959+0000","last_became_active":"2024-04-25T22:06:22.789807+0000","last_became_peered":"2024-04-25T22:06:22.789807+0000","last_unstale":"2024-04-25T22:06:29.833959+0000","last_undegraded":"2024-04-25T22:06:29.833959+0000","last_fullsized":"2024-04-25T22:06:29.833959+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:15.180532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25634,"num_write":377,"num_write_kb":103970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"76'64","reported_seq":239,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.843535+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:06:29.843535+0000","last_peered":"2024-04-25T22:06:29.843535+0000","last_clean":"2024-04-25T22:06:29.843535+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:06:29.843535+0000","last_undegraded":"2024-04-25T22:06:29.843535+0000","last_fullsized":"2024-04-25T22:06:29.843535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132057+0000","last_change":"2024-04-25T22:06:24.092672+0000","last_active":"2024-04-25T22:06:30.132057+0000","last_peered":"2024-04-25T22:06:30.132057+0000","last_clean":"2024-04-25T22:06:30.132057+0000","last_became_active":"2024-04-25T22:06:24.091909+0000","last_became_peered":"2024-04-25T22:06:24.091909+0000","last_unstale":"2024-04-25T22:06:30.132057+0000","last_undegraded":"2024-04-25T22:06:30.132057+0000","last_fullsized":"2024-04-25T22:06:30.132057+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:19:21.605435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"76'402","reported_seq":603,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840799+0000","last_change":"2024-04-25T22:06:22.809713+0000","last_active":"2024-04-25T22:06:29.840799+0000","last_peered":"2024-04-25T22:06:29.840799+0000","last_clean":"2024-04-25T22:06:29.840799+0000","last_became_active":"2024-04-25T22:06:22.802005+0000","last_became_peered":"2024-04-25T22:06:22.802005+0000","last_unstale":"2024-04-25T22:06:29.840799+0000","last_undegraded":"2024-04-25T22:06:29.840799+0000","last_fullsized":"2024-04-25T22:06:29.840799+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9572,"num_write":361,"num_write_kb":29911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"77'127","reported_seq":309,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.843126+0000","last_change":"2024-04-25T22:06:22.804851+0000","last_active":"2024-04-25T22:06:29.843126+0000","last_peered":"2024-04-25T22:06:29.843126+0000","last_clean":"2024-04-25T22:06:29.843126+0000","last_became_active":"2024-04-25T22:06:22.802083+0000","last_became_peered":"2024-04-25T22:06:22.802083+0000","last_unstale":"2024-04-25T22:06:29.843126+0000","last_undegraded":"2024-04-25T22:06:29.843126+0000","last_fullsized":"2024-04-25T22:06:29.843126+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131963+0000","last_change":"2024-04-25T22:06:23.081230+0000","last_active":"2024-04-25T22:06:30.131963+0000","last_peered":"2024-04-25T22:06:30.131963+0000","last_clean":"2024-04-25T22:06:30.131963+0000","last_became_active":"2024-04-25T22:06:23.080393+0000","last_became_peered":"2024-04-25T22:06:23.080393+0000","last_unstale":"2024-04-25T22:06:30.131963+0000","last_undegraded":"2024-04-25T22:06:30.131963+0000","last_fullsized":"2024-04-25T22:06:30.131963+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:55.157159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"76'415","reported_seq":594,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833189+0000","last_change":"2024-04-25T22:06:22.801327+0000","last_active":"2024-04-25T22:06:29.833189+0000","last_peered":"2024-04-25T22:06:29.833189+0000","last_clean":"2024-04-25T22:06:29.833189+0000","last_became_active":"2024-04-25T22:06:22.789624+0000","last_became_peered":"2024-04-25T22:06:22.789624+0000","last_unstale":"2024-04-25T22:06:29.833189+0000","last_undegraded":"2024-04-25T22:06:29.833189+0000","last_fullsized":"2024-04-25T22:06:29.833189+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27345,"num_write":384,"num_write_kb":92854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"76'407","reported_seq":621,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.133739+0000","last_change":"2024-04-25T22:06:23.114739+0000","last_active":"2024-04-25T22:06:30.133739+0000","last_peered":"2024-04-25T22:06:30.133739+0000","last_clean":"2024-04-25T22:06:30.133739+0000","last_became_active":"2024-04-25T22:06:23.087118+0000","last_became_peered":"2024-04-25T22:06:23.087118+0000","last_unstale":"2024-04-25T22:06:30.133739+0000","last_undegraded":"2024-04-25T22:06:30.133739+0000","last_fullsized":"2024-04-25T22:06:30.133739+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:51.191212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33923,"num_write":372,"num_write_kb":82083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"77'260","reported_seq":418,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131279+0000","last_change":"2024-04-25T22:06:23.083331+0000","last_active":"2024-04-25T22:06:30.131279+0000","last_peered":"2024-04-25T22:06:30.131279+0000","last_clean":"2024-04-25T22:06:30.131279+0000","last_became_active":"2024-04-25T22:06:23.080552+0000","last_became_peered":"2024-04-25T22:06:23.080552+0000","last_unstale":"2024-04-25T22:06:30.131279+0000","last_undegraded":"2024-04-25T22:06:30.131279+0000","last_fullsized":"2024-04-25T22:06:30.131279+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:55.928212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8470619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"76'408","reported_seq":608,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840444+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:06:29.840444+0000","last_peered":"2024-04-25T22:06:29.840444+0000","last_clean":"2024-04-25T22:06:29.840444+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:06:29.840444+0000","last_undegraded":"2024-04-25T22:06:29.840444+0000","last_fullsized":"2024-04-25T22:06:29.840444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14178,"num_write":370,"num_write_kb":58735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'104","reported_seq":287,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.836892+0000","last_change":"2024-04-25T22:06:22.805389+0000","last_active":"2024-04-25T22:06:29.836892+0000","last_peered":"2024-04-25T22:06:29.836892+0000","last_clean":"2024-04-25T22:06:29.836892+0000","last_became_active":"2024-04-25T22:06:22.802667+0000","last_became_peered":"2024-04-25T22:06:22.802667+0000","last_unstale":"2024-04-25T22:06:29.836892+0000","last_undegraded":"2024-04-25T22:06:29.836892+0000","last_fullsized":"2024-04-25T22:06:29.836892+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:38.785650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"75'232","reported_seq":278,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.134307+0000","last_change":"2024-04-25T22:06:30.134307+0000","last_active":"2024-04-25T22:06:30.134307+0000","last_peered":"2024-04-25T22:03:41.622809+0000","last_clean":"2024-04-25T22:03:41.622809+0000","last_became_active":"2024-04-25T22:02:43.852292+0000","last_became_peered":"2024-04-25T22:02:43.852292+0000","last_unstale":"2024-04-25T22:06:30.134307+0000","last_undegraded":"2024-04-25T22:06:30.134307+0000","last_fullsized":"2024-04-25T22:06:30.134307+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"76'483","reported_seq":711,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840024+0000","last_change":"2024-04-25T22:06:22.814119+0000","last_active":"2024-04-25T22:06:29.840024+0000","last_peered":"2024-04-25T22:06:29.840024+0000","last_clean":"2024-04-25T22:06:29.840024+0000","last_became_active":"2024-04-25T22:06:22.807584+0000","last_became_peered":"2024-04-25T22:06:22.807584+0000","last_unstale":"2024-04-25T22:06:29.840024+0000","last_undegraded":"2024-04-25T22:06:29.840024+0000","last_fullsized":"2024-04-25T22:06:29.840024+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:08.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24709,"num_write":463,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"75'60","reported_seq":242,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.843285+0000","last_change":"2024-04-25T22:06:22.802356+0000","last_active":"2024-04-25T22:06:29.843285+0000","last_peered":"2024-04-25T22:06:29.843285+0000","last_clean":"2024-04-25T22:06:29.843285+0000","last_became_active":"2024-04-25T22:06:22.801412+0000","last_became_peered":"2024-04-25T22:06:22.801412+0000","last_unstale":"2024-04-25T22:06:29.843285+0000","last_undegraded":"2024-04-25T22:06:29.843285+0000","last_fullsized":"2024-04-25T22:06:29.843285+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:04.421952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'444","reported_seq":646,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840735+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:06:29.840735+0000","last_peered":"2024-04-25T22:06:29.840735+0000","last_clean":"2024-04-25T22:06:29.840735+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:06:29.840735+0000","last_undegraded":"2024-04-25T22:06:29.840735+0000","last_fullsized":"2024-04-25T22:06:29.840735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14429,"num_write":416,"num_write_kb":59186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'355","reported_seq":497,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835185+0000","last_change":"2024-04-25T22:06:22.804579+0000","last_active":"2024-04-25T22:06:29.835185+0000","last_peered":"2024-04-25T22:06:29.835185+0000","last_clean":"2024-04-25T22:06:29.835185+0000","last_became_active":"2024-04-25T22:06:22.792886+0000","last_became_peered":"2024-04-25T22:06:22.792886+0000","last_unstale":"2024-04-25T22:06:29.835185+0000","last_undegraded":"2024-04-25T22:06:29.835185+0000","last_fullsized":"2024-04-25T22:06:29.835185+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:54:35.464321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18236,"num_write":332,"num_write_kb":42553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"76'742","reported_seq":917,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.841034+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:06:29.841034+0000","last_peered":"2024-04-25T22:06:29.841034+0000","last_clean":"2024-04-25T22:06:29.841034+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:06:29.841034+0000","last_undegraded":"2024-04-25T22:06:29.841034+0000","last_fullsized":"2024-04-25T22:06:29.841034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'378","reported_seq":577,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842615+0000","last_change":"2024-04-25T22:06:22.813642+0000","last_active":"2024-04-25T22:06:29.842615+0000","last_peered":"2024-04-25T22:06:29.842615+0000","last_clean":"2024-04-25T22:06:29.842615+0000","last_became_active":"2024-04-25T22:06:22.806240+0000","last_became_peered":"2024-04-25T22:06:22.806240+0000","last_unstale":"2024-04-25T22:06:29.842615+0000","last_undegraded":"2024-04-25T22:06:29.842615+0000","last_fullsized":"2024-04-25T22:06:29.842615+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6876,"num_write":354,"num_write_kb":46840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"76'204","reported_seq":386,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840254+0000","last_change":"2024-04-25T22:06:22.805022+0000","last_active":"2024-04-25T22:06:29.840254+0000","last_peered":"2024-04-25T22:06:29.840254+0000","last_clean":"2024-04-25T22:06:29.840254+0000","last_became_active":"2024-04-25T22:06:22.801630+0000","last_became_peered":"2024-04-25T22:06:22.801630+0000","last_unstale":"2024-04-25T22:06:29.840254+0000","last_undegraded":"2024-04-25T22:06:29.840254+0000","last_fullsized":"2024-04-25T22:06:29.840254+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:34.554201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'377","reported_seq":513,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.836047+0000","last_change":"2024-04-25T22:06:22.805011+0000","last_active":"2024-04-25T22:06:29.836047+0000","last_peered":"2024-04-25T22:06:29.836047+0000","last_clean":"2024-04-25T22:06:29.836047+0000","last_became_active":"2024-04-25T22:06:22.795334+0000","last_became_peered":"2024-04-25T22:06:22.795334+0000","last_unstale":"2024-04-25T22:06:29.836047+0000","last_undegraded":"2024-04-25T22:06:29.836047+0000","last_fullsized":"2024-04-25T22:06:29.836047+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:35.997378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6059,"num_write":332,"num_write_kb":37972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"76'217","reported_seq":330,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834033+0000","last_change":"2024-04-25T22:06:28.842258+0000","last_active":"2024-04-25T22:06:29.834033+0000","last_peered":"2024-04-25T22:06:29.834033+0000","last_clean":"2024-04-25T22:06:29.834033+0000","last_became_active":"2024-04-25T22:06:28.841447+0000","last_became_peered":"2024-04-25T22:06:28.841447+0000","last_unstale":"2024-04-25T22:06:29.834033+0000","last_undegraded":"2024-04-25T22:06:29.834033+0000","last_fullsized":"2024-04-25T22:06:29.834033+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:31.009167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"76'389","reported_seq":540,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835254+0000","last_change":"2024-04-25T22:03:33.862286+0000","last_active":"2024-04-25T22:06:29.835254+0000","last_peered":"2024-04-25T22:06:29.835254+0000","last_clean":"2024-04-25T22:06:29.835254+0000","last_became_active":"2024-04-25T22:03:33.860800+0000","last_became_peered":"2024-04-25T22:03:33.860800+0000","last_unstale":"2024-04-25T22:06:29.835254+0000","last_undegraded":"2024-04-25T22:06:29.835254+0000","last_fullsized":"2024-04-25T22:06:29.835254+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:04.528174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19110,"num_write":355,"num_write_kb":63152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'51","reported_seq":124,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834507+0000","last_change":"2024-04-25T22:06:22.804880+0000","last_active":"2024-04-25T22:06:29.834507+0000","last_peered":"2024-04-25T22:06:29.834507+0000","last_clean":"2024-04-25T22:06:29.834507+0000","last_became_active":"2024-04-25T22:06:22.803778+0000","last_became_peered":"2024-04-25T22:06:22.803778+0000","last_unstale":"2024-04-25T22:06:29.834507+0000","last_undegraded":"2024-04-25T22:06:29.834507+0000","last_fullsized":"2024-04-25T22:06:29.834507+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:47:58.480071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"76'386","reported_seq":475,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.134793+0000","last_change":"2024-04-25T22:06:30.134793+0000","last_active":"2024-04-25T22:06:30.134793+0000","last_peered":"2024-04-25T22:03:46.915198+0000","last_clean":"2024-04-25T22:03:46.915198+0000","last_became_active":"2024-04-25T22:02:43.850568+0000","last_became_peered":"2024-04-25T22:02:43.850568+0000","last_unstale":"2024-04-25T22:06:30.134793+0000","last_undegraded":"2024-04-25T22:06:30.134793+0000","last_fullsized":"2024-04-25T22:06:30.134793+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14050,"num_write":362,"num_write_kb":58957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"76'188","reported_seq":223,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.132995+0000","last_change":"2024-04-25T22:06:30.132995+0000","last_active":"2024-04-25T22:06:30.132995+0000","last_peered":"2024-04-25T22:03:31.361153+0000","last_clean":"2024-04-25T22:03:31.361153+0000","last_became_active":"2024-04-25T22:02:43.852769+0000","last_became_peered":"2024-04-25T22:02:43.852769+0000","last_unstale":"2024-04-25T22:06:30.132995+0000","last_undegraded":"2024-04-25T22:06:30.132995+0000","last_fullsized":"2024-04-25T22:06:30.132995+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"76'397","reported_seq":486,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.134133+0000","last_change":"2024-04-25T22:06:30.134133+0000","last_active":"2024-04-25T22:06:30.134133+0000","last_peered":"2024-04-25T22:03:46.861730+0000","last_clean":"2024-04-25T22:03:46.861730+0000","last_became_active":"2024-04-25T22:02:43.852263+0000","last_became_peered":"2024-04-25T22:02:43.852263+0000","last_unstale":"2024-04-25T22:06:30.134133+0000","last_undegraded":"2024-04-25T22:06:30.134133+0000","last_fullsized":"2024-04-25T22:06:30.134133+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13280,"num_write":364,"num_write_kb":46108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"75'284","reported_seq":412,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.836603+0000","last_change":"2024-04-25T22:06:22.804561+0000","last_active":"2024-04-25T22:06:29.836603+0000","last_peered":"2024-04-25T22:06:29.836603+0000","last_clean":"2024-04-25T22:06:29.836603+0000","last_became_active":"2024-04-25T22:06:22.794078+0000","last_became_peered":"2024-04-25T22:06:22.794078+0000","last_unstale":"2024-04-25T22:06:29.836603+0000","last_undegraded":"2024-04-25T22:06:29.836603+0000","last_fullsized":"2024-04-25T22:06:29.836603+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:07.939379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":12398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"76'412","reported_seq":536,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834267+0000","last_change":"2024-04-25T22:03:33.864136+0000","last_active":"2024-04-25T22:06:29.834267+0000","last_peered":"2024-04-25T22:06:29.834267+0000","last_clean":"2024-04-25T22:06:29.834267+0000","last_became_active":"2024-04-25T22:03:33.862435+0000","last_became_peered":"2024-04-25T22:03:33.862435+0000","last_unstale":"2024-04-25T22:06:29.834267+0000","last_undegraded":"2024-04-25T22:06:29.834267+0000","last_fullsized":"2024-04-25T22:06:29.834267+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:08.119964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":1478,"num_write":377,"num_write_kb":34422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"76'127","reported_seq":302,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842960+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:06:29.842960+0000","last_peered":"2024-04-25T22:06:29.842960+0000","last_clean":"2024-04-25T22:06:29.842960+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:06:29.842960+0000","last_undegraded":"2024-04-25T22:06:29.842960+0000","last_fullsized":"2024-04-25T22:06:29.842960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'444","reported_seq":644,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131585+0000","last_change":"2024-04-25T22:06:23.132900+0000","last_active":"2024-04-25T22:06:30.131585+0000","last_peered":"2024-04-25T22:06:30.131585+0000","last_clean":"2024-04-25T22:06:30.131585+0000","last_became_active":"2024-04-25T22:06:23.097535+0000","last_became_peered":"2024-04-25T22:06:23.097535+0000","last_unstale":"2024-04-25T22:06:30.131585+0000","last_undegraded":"2024-04-25T22:06:30.131585+0000","last_fullsized":"2024-04-25T22:06:30.131585+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:30:55.243414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31576,"num_write":414,"num_write_kb":70915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"75'46","reported_seq":228,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842998+0000","last_change":"2024-04-25T22:06:22.802843+0000","last_active":"2024-04-25T22:06:29.842998+0000","last_peered":"2024-04-25T22:06:29.842998+0000","last_clean":"2024-04-25T22:06:29.842998+0000","last_became_active":"2024-04-25T22:06:22.801910+0000","last_became_peered":"2024-04-25T22:06:22.801910+0000","last_unstale":"2024-04-25T22:06:29.842998+0000","last_undegraded":"2024-04-25T22:06:29.842998+0000","last_fullsized":"2024-04-25T22:06:29.842998+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:23.004530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2665,"num_read_kb":1338898,"num_write":24540,"num_write_kb":4276910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26558,"ondisk_log_size":26558,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127376126,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":4662,"num_write_kb":127830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":71499776,"data_stored":254752252,"data_compressed":21836190,"data_compressed_allocated":35307520,"data_compressed_original":218619904,"omap_allocated":136586,"internal_metadata":0},"log_size":6446,"ondisk_log_size":6446,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738440,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99728,"kb_used_data":24188,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272112,"statfs":{"total":96636764160,"available":96534642688,"internally_reserved":0,"allocated":24768512,"data_stored":84959773,"data_compressed":7036839,"data_compressed_allocated":11431936,"data_compressed_original":72118272,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738439,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99420,"kb_used_data":23884,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272420,"statfs":{"total":96636764160,"available":96534958080,"internally_reserved":0,"allocated":24457216,"data_stored":81557721,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":90,"seq":386547056644,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58096,"kb_used_data":24420,"kb_used_omap":134,"kb_used_meta":33529,"kb_avail":94313744,"statfs":{"total":96636764160,"available":96577273856,"internally_reserved":0,"allocated":25006080,"data_stored":90618890,"data_compressed":7819212,"data_compressed_allocated":12599296,"data_compressed_original":78716928,"omap_allocated":138181,"internal_metadata":34333755},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24076288,"data_stored":89627390,"data_compressed":7811005,"data_compressed_allocated":12562432,"data_compressed_original":78143488,"omap_allocated":136586,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23584768,"data_stored":81156589,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23838720,"data_stored":83968273,"data_compressed":7028632,"data_compressed_allocated":11395072,"data_compressed_original":71544832,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:06:32.704 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:06:33.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:06:33.059 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:06:33.077 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2024-04-25T22:06:31.687793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127966494,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2864,"num_read_kb":1340487,"num_write":29405,"num_write_kb":4408200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33161,"ondisk_log_size":33161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":257244,"kb_used_data":72492,"kb_used_omap":138,"kb_used_meta":184565,"kb_avail":282858276,"statfs":{"total":289910292480,"available":289646874624,"internally_reserved":0,"allocated":74231808,"data_stored":257136384,"data_compressed":21852604,"data_compressed_allocated":35381248,"data_compressed_original":219766784,"omap_allocated":141371,"internal_metadata":188995525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-36,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001240"},"pg_stats":[{"pgid":"4.3f","version":"76'446","reported_seq":602,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834874+0000","last_change":"2024-04-25T22:03:33.876369+0000","last_active":"2024-04-25T22:06:29.834874+0000","last_peered":"2024-04-25T22:06:29.834874+0000","last_clean":"2024-04-25T22:06:29.834874+0000","last_became_active":"2024-04-25T22:03:33.873739+0000","last_became_peered":"2024-04-25T22:03:33.873739+0000","last_unstale":"2024-04-25T22:06:29.834874+0000","last_undegraded":"2024-04-25T22:06:29.834874+0000","last_fullsized":"2024-04-25T22:06:29.834874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:32.529707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29432,"num_write":407,"num_write_kb":84235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"76'417","reported_seq":568,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834103+0000","last_change":"2024-04-25T22:03:33.861269+0000","last_active":"2024-04-25T22:06:29.834103+0000","last_peered":"2024-04-25T22:06:29.834103+0000","last_clean":"2024-04-25T22:06:29.834103+0000","last_became_active":"2024-04-25T22:03:33.859221+0000","last_became_peered":"2024-04-25T22:03:33.859221+0000","last_unstale":"2024-04-25T22:06:29.834103+0000","last_undegraded":"2024-04-25T22:06:29.834103+0000","last_fullsized":"2024-04-25T22:06:29.834103+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:23:44.690527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":23541,"num_write":389,"num_write_kb":87654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"76'389","reported_seq":550,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.136427+0000","last_change":"2024-04-25T22:06:30.136427+0000","last_active":"2024-04-25T22:06:30.136427+0000","last_peered":"2024-04-25T22:03:46.909574+0000","last_clean":"2024-04-25T22:03:46.909574+0000","last_became_active":"2024-04-25T22:03:33.863788+0000","last_became_peered":"2024-04-25T22:03:33.863788+0000","last_unstale":"2024-04-25T22:06:30.136427+0000","last_undegraded":"2024-04-25T22:06:30.136427+0000","last_fullsized":"2024-04-25T22:06:30.136427+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22311,"num_write":361,"num_write_kb":42975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"76'394","reported_seq":586,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.133476+0000","last_change":"2024-04-25T22:06:23.123256+0000","last_active":"2024-04-25T22:06:30.133476+0000","last_peered":"2024-04-25T22:06:30.133476+0000","last_clean":"2024-04-25T22:06:30.133476+0000","last_became_active":"2024-04-25T22:06:23.090780+0000","last_became_peered":"2024-04-25T22:06:23.090780+0000","last_unstale":"2024-04-25T22:06:30.133476+0000","last_undegraded":"2024-04-25T22:06:30.133476+0000","last_fullsized":"2024-04-25T22:06:30.133476+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:57.110628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":20785,"num_write":367,"num_write_kb":63746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"76'429","reported_seq":938,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834238+0000","last_change":"2024-04-25T22:06:28.839715+0000","last_active":"2024-04-25T22:06:29.834238+0000","last_peered":"2024-04-25T22:06:29.834238+0000","last_clean":"2024-04-25T22:06:29.834238+0000","last_became_active":"2024-04-25T22:06:28.836687+0000","last_became_peered":"2024-04-25T22:06:28.836687+0000","last_unstale":"2024-04-25T22:06:29.834238+0000","last_undegraded":"2024-04-25T22:06:29.834238+0000","last_fullsized":"2024-04-25T22:06:29.834238+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:10.175157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":20896,"num_write":403,"num_write_kb":100255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"76'368","reported_seq":540,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132775+0000","last_change":"2024-04-25T22:06:23.129617+0000","last_active":"2024-04-25T22:06:30.132775+0000","last_peered":"2024-04-25T22:06:30.132775+0000","last_clean":"2024-04-25T22:06:30.132775+0000","last_became_active":"2024-04-25T22:06:23.107939+0000","last_became_peered":"2024-04-25T22:06:23.107939+0000","last_unstale":"2024-04-25T22:06:30.132775+0000","last_undegraded":"2024-04-25T22:06:30.132775+0000","last_fullsized":"2024-04-25T22:06:30.132775+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:24.183902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9362,"num_write":344,"num_write_kb":20831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"76'438","reported_seq":636,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131211+0000","last_change":"2024-04-25T22:06:23.123861+0000","last_active":"2024-04-25T22:06:30.131211+0000","last_peered":"2024-04-25T22:06:30.131211+0000","last_clean":"2024-04-25T22:06:30.131211+0000","last_became_active":"2024-04-25T22:06:23.098436+0000","last_became_peered":"2024-04-25T22:06:23.098436+0000","last_unstale":"2024-04-25T22:06:30.131211+0000","last_undegraded":"2024-04-25T22:06:30.131211+0000","last_fullsized":"2024-04-25T22:06:30.131211+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:35.433423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25961,"num_write":415,"num_write_kb":72541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'392","reported_seq":600,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130666+0000","last_change":"2024-04-25T22:06:23.128274+0000","last_active":"2024-04-25T22:06:30.130666+0000","last_peered":"2024-04-25T22:06:30.130666+0000","last_clean":"2024-04-25T22:06:30.130666+0000","last_became_active":"2024-04-25T22:06:23.091431+0000","last_became_peered":"2024-04-25T22:06:23.091431+0000","last_unstale":"2024-04-25T22:06:30.130666+0000","last_undegraded":"2024-04-25T22:06:30.130666+0000","last_fullsized":"2024-04-25T22:06:30.130666+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:48.206131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":24749,"num_write":354,"num_write_kb":64232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"76'443","reported_seq":649,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842265+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:06:29.842265+0000","last_peered":"2024-04-25T22:06:29.842265+0000","last_clean":"2024-04-25T22:06:29.842265+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:06:29.842265+0000","last_undegraded":"2024-04-25T22:06:29.842265+0000","last_fullsized":"2024-04-25T22:06:29.842265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":10648,"num_write":411,"num_write_kb":92932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'392","reported_seq":509,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131757+0000","last_change":"2024-04-25T22:06:26.120464+0000","last_active":"2024-04-25T22:06:30.131757+0000","last_peered":"2024-04-25T22:06:30.131757+0000","last_clean":"2024-04-25T22:06:30.131757+0000","last_became_active":"2024-04-25T22:06:26.114463+0000","last_became_peered":"2024-04-25T22:06:26.114463+0000","last_unstale":"2024-04-25T22:06:30.131757+0000","last_undegraded":"2024-04-25T22:06:30.131757+0000","last_fullsized":"2024-04-25T22:06:30.131757+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:37:54.870762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10696,"num_write":359,"num_write_kb":63259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'391","reported_seq":567,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.135469+0000","last_change":"2024-04-25T22:06:23.135020+0000","last_active":"2024-04-25T22:06:30.135469+0000","last_peered":"2024-04-25T22:06:30.135469+0000","last_clean":"2024-04-25T22:06:30.135469+0000","last_became_active":"2024-04-25T22:06:23.123801+0000","last_became_peered":"2024-04-25T22:06:23.123801+0000","last_unstale":"2024-04-25T22:06:30.135469+0000","last_undegraded":"2024-04-25T22:06:30.135469+0000","last_fullsized":"2024-04-25T22:06:30.135469+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:11:44.607123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11259,"num_write":372,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"76'365","reported_seq":645,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835231+0000","last_change":"2024-04-25T22:06:22.802947+0000","last_active":"2024-04-25T22:06:29.835231+0000","last_peered":"2024-04-25T22:06:29.835231+0000","last_clean":"2024-04-25T22:06:29.835231+0000","last_became_active":"2024-04-25T22:06:22.792880+0000","last_became_peered":"2024-04-25T22:06:22.792880+0000","last_unstale":"2024-04-25T22:06:29.835231+0000","last_undegraded":"2024-04-25T22:06:29.835231+0000","last_fullsized":"2024-04-25T22:06:29.835231+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":51972,"num_write":340,"num_write_kb":51203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"76'420","reported_seq":572,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833638+0000","last_change":"2024-04-25T22:03:33.866815+0000","last_active":"2024-04-25T22:06:29.833638+0000","last_peered":"2024-04-25T22:06:29.833638+0000","last_clean":"2024-04-25T22:06:29.833638+0000","last_became_active":"2024-04-25T22:03:33.859376+0000","last_became_peered":"2024-04-25T22:03:33.859376+0000","last_unstale":"2024-04-25T22:06:29.833638+0000","last_undegraded":"2024-04-25T22:06:29.833638+0000","last_fullsized":"2024-04-25T22:06:29.833638+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:08.620311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17620,"num_write":386,"num_write_kb":100613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"76'432","reported_seq":629,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132417+0000","last_change":"2024-04-25T22:06:23.128788+0000","last_active":"2024-04-25T22:06:30.132417+0000","last_peered":"2024-04-25T22:06:30.132417+0000","last_clean":"2024-04-25T22:06:30.132417+0000","last_became_active":"2024-04-25T22:06:23.081466+0000","last_became_peered":"2024-04-25T22:06:23.081466+0000","last_unstale":"2024-04-25T22:06:30.132417+0000","last_undegraded":"2024-04-25T22:06:30.132417+0000","last_fullsized":"2024-04-25T22:06:30.132417+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:15.042731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27327,"num_write":398,"num_write_kb":76113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"76'385","reported_seq":582,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131043+0000","last_change":"2024-04-25T22:06:23.116284+0000","last_active":"2024-04-25T22:06:30.131043+0000","last_peered":"2024-04-25T22:06:30.131043+0000","last_clean":"2024-04-25T22:06:30.131043+0000","last_became_active":"2024-04-25T22:06:23.088046+0000","last_became_peered":"2024-04-25T22:06:23.088046+0000","last_unstale":"2024-04-25T22:06:30.131043+0000","last_undegraded":"2024-04-25T22:06:30.131043+0000","last_fullsized":"2024-04-25T22:06:30.131043+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:40:35.110567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23986,"num_write":352,"num_write_kb":50754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"76'434","reported_seq":613,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131878+0000","last_change":"2024-04-25T22:06:23.132996+0000","last_active":"2024-04-25T22:06:30.131878+0000","last_peered":"2024-04-25T22:06:30.131878+0000","last_clean":"2024-04-25T22:06:30.131878+0000","last_became_active":"2024-04-25T22:06:23.117497+0000","last_became_peered":"2024-04-25T22:06:23.117497+0000","last_unstale":"2024-04-25T22:06:30.131878+0000","last_undegraded":"2024-04-25T22:06:30.131878+0000","last_fullsized":"2024-04-25T22:06:30.131878+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:30.022312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":13806,"num_write":403,"num_write_kb":38995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"76'444","reported_seq":656,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.843387+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:06:29.843387+0000","last_peered":"2024-04-25T22:06:29.843387+0000","last_clean":"2024-04-25T22:06:29.843387+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:06:29.843387+0000","last_undegraded":"2024-04-25T22:06:29.843387+0000","last_fullsized":"2024-04-25T22:06:29.843387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":11085,"num_write":416,"num_write_kb":68377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'396","reported_seq":529,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834759+0000","last_change":"2024-04-25T22:03:33.862762+0000","last_active":"2024-04-25T22:06:29.834759+0000","last_peered":"2024-04-25T22:06:29.834759+0000","last_clean":"2024-04-25T22:06:29.834759+0000","last_became_active":"2024-04-25T22:03:33.861082+0000","last_became_peered":"2024-04-25T22:03:33.861082+0000","last_unstale":"2024-04-25T22:06:29.834759+0000","last_undegraded":"2024-04-25T22:06:29.834759+0000","last_fullsized":"2024-04-25T22:06:29.834759+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:15.823113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6581,"num_write":355,"num_write_kb":34159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"76'447","reported_seq":646,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.841872+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:06:29.841872+0000","last_peered":"2024-04-25T22:06:29.841872+0000","last_clean":"2024-04-25T22:06:29.841872+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:06:29.841872+0000","last_undegraded":"2024-04-25T22:06:29.841872+0000","last_fullsized":"2024-04-25T22:06:29.841872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22089,"num_write":411,"num_write_kb":104750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'426","reported_seq":602,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.135373+0000","last_change":"2024-04-25T22:06:23.122769+0000","last_active":"2024-04-25T22:06:30.135373+0000","last_peered":"2024-04-25T22:06:30.135373+0000","last_clean":"2024-04-25T22:06:30.135373+0000","last_became_active":"2024-04-25T22:06:23.093379+0000","last_became_peered":"2024-04-25T22:06:23.093379+0000","last_unstale":"2024-04-25T22:06:30.135373+0000","last_undegraded":"2024-04-25T22:06:30.135373+0000","last_fullsized":"2024-04-25T22:06:30.135373+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:48.070891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11886,"num_write":398,"num_write_kb":55010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"76'405","reported_seq":600,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.134314+0000","last_change":"2024-04-25T22:06:23.129396+0000","last_active":"2024-04-25T22:06:30.134314+0000","last_peered":"2024-04-25T22:06:30.134314+0000","last_clean":"2024-04-25T22:06:30.134314+0000","last_became_active":"2024-04-25T22:06:23.110101+0000","last_became_peered":"2024-04-25T22:06:23.110101+0000","last_unstale":"2024-04-25T22:06:30.134314+0000","last_undegraded":"2024-04-25T22:06:30.134314+0000","last_fullsized":"2024-04-25T22:06:30.134314+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:40.218610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23004,"num_write":370,"num_write_kb":75802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'436","reported_seq":557,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833470+0000","last_change":"2024-04-25T22:06:28.838562+0000","last_active":"2024-04-25T22:06:29.833470+0000","last_peered":"2024-04-25T22:06:29.833470+0000","last_clean":"2024-04-25T22:06:29.833470+0000","last_became_active":"2024-04-25T22:06:28.835081+0000","last_became_peered":"2024-04-25T22:06:28.835081+0000","last_unstale":"2024-04-25T22:06:29.833470+0000","last_undegraded":"2024-04-25T22:06:29.833470+0000","last_fullsized":"2024-04-25T22:06:29.833470+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:15:18.057041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11950,"num_write":408,"num_write_kb":67524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"76'403","reported_seq":605,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.839248+0000","last_change":"2024-04-25T22:06:22.810930+0000","last_active":"2024-04-25T22:06:29.839248+0000","last_peered":"2024-04-25T22:06:29.839248+0000","last_clean":"2024-04-25T22:06:29.839248+0000","last_became_active":"2024-04-25T22:06:22.802907+0000","last_became_peered":"2024-04-25T22:06:22.802907+0000","last_unstale":"2024-04-25T22:06:29.839248+0000","last_undegraded":"2024-04-25T22:06:29.839248+0000","last_fullsized":"2024-04-25T22:06:29.839248+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:00.334109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":6507,"num_write":370,"num_write_kb":51513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'449","reported_seq":572,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.832812+0000","last_change":"2024-04-25T22:06:28.846531+0000","last_active":"2024-04-25T22:06:29.832812+0000","last_peered":"2024-04-25T22:06:29.832812+0000","last_clean":"2024-04-25T22:06:29.832812+0000","last_became_active":"2024-04-25T22:06:28.841283+0000","last_became_peered":"2024-04-25T22:06:28.841283+0000","last_unstale":"2024-04-25T22:06:29.832812+0000","last_undegraded":"2024-04-25T22:06:29.832812+0000","last_fullsized":"2024-04-25T22:06:29.832812+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:02.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27047,"num_write":417,"num_write_kb":63386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"76'406","reported_seq":569,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835163+0000","last_change":"2024-04-25T22:06:22.801634+0000","last_active":"2024-04-25T22:06:29.835163+0000","last_peered":"2024-04-25T22:06:29.835163+0000","last_clean":"2024-04-25T22:06:29.835163+0000","last_became_active":"2024-04-25T22:06:22.791470+0000","last_became_peered":"2024-04-25T22:06:22.791470+0000","last_unstale":"2024-04-25T22:06:29.835163+0000","last_undegraded":"2024-04-25T22:06:29.835163+0000","last_fullsized":"2024-04-25T22:06:29.835163+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:25.424659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25550,"num_write":386,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"76'485","reported_seq":733,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842474+0000","last_change":"2024-04-25T22:06:22.814124+0000","last_active":"2024-04-25T22:06:29.842474+0000","last_peered":"2024-04-25T22:06:29.842474+0000","last_clean":"2024-04-25T22:06:29.842474+0000","last_became_active":"2024-04-25T22:06:22.804228+0000","last_became_peered":"2024-04-25T22:06:22.804228+0000","last_unstale":"2024-04-25T22:06:29.842474+0000","last_undegraded":"2024-04-25T22:06:29.842474+0000","last_fullsized":"2024-04-25T22:06:29.842474+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":30714,"num_write":444,"num_write_kb":92836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'387","reported_seq":590,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.135315+0000","last_change":"2024-04-25T22:06:23.134971+0000","last_active":"2024-04-25T22:06:30.135315+0000","last_peered":"2024-04-25T22:06:30.135315+0000","last_clean":"2024-04-25T22:06:30.135315+0000","last_became_active":"2024-04-25T22:06:23.121334+0000","last_became_peered":"2024-04-25T22:06:23.121334+0000","last_unstale":"2024-04-25T22:06:30.135315+0000","last_undegraded":"2024-04-25T22:06:30.135315+0000","last_fullsized":"2024-04-25T22:06:30.135315+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:03.991336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21644,"num_write":354,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"76'405","reported_seq":647,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835567+0000","last_change":"2024-04-25T22:06:22.829889+0000","last_active":"2024-04-25T22:06:29.835567+0000","last_peered":"2024-04-25T22:06:29.835567+0000","last_clean":"2024-04-25T22:06:29.835567+0000","last_became_active":"2024-04-25T22:06:22.827066+0000","last_became_peered":"2024-04-25T22:06:22.827066+0000","last_unstale":"2024-04-25T22:06:29.835567+0000","last_undegraded":"2024-04-25T22:06:29.835567+0000","last_fullsized":"2024-04-25T22:06:29.835567+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:01.822252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27522,"num_write":375,"num_write_kb":96416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"76'396","reported_seq":617,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.841153+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:06:29.841153+0000","last_peered":"2024-04-25T22:06:29.841153+0000","last_clean":"2024-04-25T22:06:29.841153+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:06:29.841153+0000","last_undegraded":"2024-04-25T22:06:29.841153+0000","last_fullsized":"2024-04-25T22:06:29.841153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28501,"num_write":367,"num_write_kb":63458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":652,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833778+0000","last_change":"2024-04-25T22:06:22.803787+0000","last_active":"2024-04-25T22:06:29.833778+0000","last_peered":"2024-04-25T22:06:29.833778+0000","last_clean":"2024-04-25T22:06:29.833778+0000","last_became_active":"2024-04-25T22:06:22.789907+0000","last_became_peered":"2024-04-25T22:06:22.789907+0000","last_unstale":"2024-04-25T22:06:29.833778+0000","last_undegraded":"2024-04-25T22:06:29.833778+0000","last_fullsized":"2024-04-25T22:06:29.833778+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":20717,"num_write":435,"num_write_kb":55985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"76'444","reported_seq":645,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.839540+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:06:29.839540+0000","last_peered":"2024-04-25T22:06:29.839540+0000","last_clean":"2024-04-25T22:06:29.839540+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:06:29.839540+0000","last_undegraded":"2024-04-25T22:06:29.839540+0000","last_fullsized":"2024-04-25T22:06:29.839540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":10758,"num_write":401,"num_write_kb":44705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'422","reported_seq":525,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.131754+0000","last_change":"2024-04-25T22:06:30.131754+0000","last_active":"2024-04-25T22:06:30.131754+0000","last_peered":"2024-04-25T22:03:46.918292+0000","last_clean":"2024-04-25T22:03:46.918292+0000","last_became_active":"2024-04-25T22:02:43.850651+0000","last_became_peered":"2024-04-25T22:02:43.850651+0000","last_unstale":"2024-04-25T22:06:30.131754+0000","last_undegraded":"2024-04-25T22:06:30.131754+0000","last_fullsized":"2024-04-25T22:06:30.131754+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":29059,"num_write":391,"num_write_kb":40233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"76'397","reported_seq":892,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835507+0000","last_change":"2024-04-25T22:06:26.819859+0000","last_active":"2024-04-25T22:06:29.835507+0000","last_peered":"2024-04-25T22:06:29.835507+0000","last_clean":"2024-04-25T22:06:29.835507+0000","last_became_active":"2024-04-25T22:06:26.816439+0000","last_became_peered":"2024-04-25T22:06:26.816439+0000","last_unstale":"2024-04-25T22:06:29.835507+0000","last_undegraded":"2024-04-25T22:06:29.835507+0000","last_fullsized":"2024-04-25T22:06:29.835507+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:44.452918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28857,"num_write":363,"num_write_kb":87969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"75'515","reported_seq":669,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132386+0000","last_change":"2024-04-25T22:06:23.117492+0000","last_active":"2024-04-25T22:06:30.132386+0000","last_peered":"2024-04-25T22:06:30.132386+0000","last_clean":"2024-04-25T22:06:30.132386+0000","last_became_active":"2024-04-25T22:06:23.109665+0000","last_became_peered":"2024-04-25T22:06:23.109665+0000","last_unstale":"2024-04-25T22:06:30.132386+0000","last_undegraded":"2024-04-25T22:06:30.132386+0000","last_fullsized":"2024-04-25T22:06:30.132386+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:01.482888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"76'375","reported_seq":479,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.836346+0000","last_change":"2024-04-25T22:06:28.846182+0000","last_active":"2024-04-25T22:06:29.836346+0000","last_peered":"2024-04-25T22:06:29.836346+0000","last_clean":"2024-04-25T22:06:29.836346+0000","last_became_active":"2024-04-25T22:06:28.841545+0000","last_became_peered":"2024-04-25T22:06:28.841545+0000","last_unstale":"2024-04-25T22:06:29.836346+0000","last_undegraded":"2024-04-25T22:06:29.836346+0000","last_fullsized":"2024-04-25T22:06:29.836346+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.018915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14983,"num_write":339,"num_write_kb":46748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'53","reported_seq":235,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840596+0000","last_change":"2024-04-25T22:06:22.839083+0000","last_active":"2024-04-25T22:06:29.840596+0000","last_peered":"2024-04-25T22:06:29.840596+0000","last_clean":"2024-04-25T22:06:29.840596+0000","last_became_active":"2024-04-25T22:06:22.833424+0000","last_became_peered":"2024-04-25T22:06:22.833424+0000","last_unstale":"2024-04-25T22:06:29.840596+0000","last_undegraded":"2024-04-25T22:06:29.840596+0000","last_fullsized":"2024-04-25T22:06:29.840596+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:00.819067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'426","reported_seq":637,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.843016+0000","last_change":"2024-04-25T22:06:26.822923+0000","last_active":"2024-04-25T22:06:29.843016+0000","last_peered":"2024-04-25T22:06:29.843016+0000","last_clean":"2024-04-25T22:06:29.843016+0000","last_became_active":"2024-04-25T22:06:26.819562+0000","last_became_peered":"2024-04-25T22:06:26.819562+0000","last_unstale":"2024-04-25T22:06:29.843016+0000","last_undegraded":"2024-04-25T22:06:29.843016+0000","last_fullsized":"2024-04-25T22:06:29.843016+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:42.832195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":17843,"num_write":388,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"75'71","reported_seq":186,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833579+0000","last_change":"2024-04-25T22:06:22.799710+0000","last_active":"2024-04-25T22:06:29.833579+0000","last_peered":"2024-04-25T22:06:29.833579+0000","last_clean":"2024-04-25T22:06:29.833579+0000","last_became_active":"2024-04-25T22:06:22.790902+0000","last_became_peered":"2024-04-25T22:06:22.790902+0000","last_unstale":"2024-04-25T22:06:29.833579+0000","last_undegraded":"2024-04-25T22:06:29.833579+0000","last_fullsized":"2024-04-25T22:06:29.833579+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:50:36.683583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'366","reported_seq":569,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842598+0000","last_change":"2024-04-25T22:06:22.809150+0000","last_active":"2024-04-25T22:06:29.842598+0000","last_peered":"2024-04-25T22:06:29.842598+0000","last_clean":"2024-04-25T22:06:29.842598+0000","last_became_active":"2024-04-25T22:06:22.803327+0000","last_became_peered":"2024-04-25T22:06:22.803327+0000","last_unstale":"2024-04-25T22:06:29.842598+0000","last_undegraded":"2024-04-25T22:06:29.842598+0000","last_fullsized":"2024-04-25T22:06:29.842598+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.731906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":16032,"num_write":334,"num_write_kb":25754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'63","reported_seq":219,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130229+0000","last_change":"2024-04-25T22:06:23.085892+0000","last_active":"2024-04-25T22:06:30.130229+0000","last_peered":"2024-04-25T22:06:30.130229+0000","last_clean":"2024-04-25T22:06:30.130229+0000","last_became_active":"2024-04-25T22:06:23.082351+0000","last_became_peered":"2024-04-25T22:06:23.082351+0000","last_unstale":"2024-04-25T22:06:30.130229+0000","last_undegraded":"2024-04-25T22:06:30.130229+0000","last_fullsized":"2024-04-25T22:06:30.130229+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:51.142517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"76'148","reported_seq":304,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132891+0000","last_change":"2024-04-25T22:06:23.089179+0000","last_active":"2024-04-25T22:06:30.132891+0000","last_peered":"2024-04-25T22:06:30.132891+0000","last_clean":"2024-04-25T22:06:30.132891+0000","last_became_active":"2024-04-25T22:06:23.085599+0000","last_became_peered":"2024-04-25T22:06:23.085599+0000","last_unstale":"2024-04-25T22:06:30.132891+0000","last_undegraded":"2024-04-25T22:06:30.132891+0000","last_fullsized":"2024-04-25T22:06:30.132891+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:53:14.055158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"76'402","reported_seq":566,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.832933+0000","last_change":"2024-04-25T22:06:22.802685+0000","last_active":"2024-04-25T22:06:29.832933+0000","last_peered":"2024-04-25T22:06:29.832933+0000","last_clean":"2024-04-25T22:06:29.832933+0000","last_became_active":"2024-04-25T22:06:22.789353+0000","last_became_peered":"2024-04-25T22:06:22.789353+0000","last_unstale":"2024-04-25T22:06:29.832933+0000","last_undegraded":"2024-04-25T22:06:29.832933+0000","last_fullsized":"2024-04-25T22:06:29.832933+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:14.949049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21114,"num_write":364,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"75'250","reported_seq":372,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835236+0000","last_change":"2024-04-25T22:06:22.791598+0000","last_active":"2024-04-25T22:06:29.835236+0000","last_peered":"2024-04-25T22:06:29.835236+0000","last_clean":"2024-04-25T22:06:29.835236+0000","last_became_active":"2024-04-25T22:06:22.790508+0000","last_became_peered":"2024-04-25T22:06:22.790508+0000","last_unstale":"2024-04-25T22:06:29.835236+0000","last_undegraded":"2024-04-25T22:06:29.835236+0000","last_fullsized":"2024-04-25T22:06:29.835236+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"76'460","reported_seq":632,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833171+0000","last_change":"2024-04-25T22:03:33.861055+0000","last_active":"2024-04-25T22:06:29.833171+0000","last_peered":"2024-04-25T22:06:29.833171+0000","last_clean":"2024-04-25T22:06:29.833171+0000","last_became_active":"2024-04-25T22:03:33.856638+0000","last_became_peered":"2024-04-25T22:03:33.856638+0000","last_unstale":"2024-04-25T22:06:29.833171+0000","last_undegraded":"2024-04-25T22:06:29.833171+0000","last_fullsized":"2024-04-25T22:06:29.833171+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":39774,"num_write":433,"num_write_kb":80294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'556","reported_seq":706,"reported_epoch":95,"state":"peering","last_fresh":"2024-04-25T22:06:27.110576+0000","last_change":"2024-04-25T22:06:30.134719+0000","last_active":"2024-04-25T22:06:30.134719+0000","last_peered":"2024-04-25T22:06:27.110576+0000","last_clean":"2024-04-25T22:06:27.110576+0000","last_became_active":"2024-04-25T22:06:23.113817+0000","last_became_peered":"2024-04-25T22:06:23.113817+0000","last_unstale":"2024-04-25T22:06:27.110576+0000","last_undegraded":"2024-04-25T22:06:27.110576+0000","last_fullsized":"2024-04-25T22:06:27.110576+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":509,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"76'413","reported_seq":575,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.133059+0000","last_change":"2024-04-25T22:06:23.129627+0000","last_active":"2024-04-25T22:06:30.133059+0000","last_peered":"2024-04-25T22:06:30.133059+0000","last_clean":"2024-04-25T22:06:30.133059+0000","last_became_active":"2024-04-25T22:06:23.108199+0000","last_became_peered":"2024-04-25T22:06:23.108199+0000","last_unstale":"2024-04-25T22:06:30.133059+0000","last_undegraded":"2024-04-25T22:06:30.133059+0000","last_fullsized":"2024-04-25T22:06:30.133059+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:23.828740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4858,"num_write":378,"num_write_kb":46741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"76'66","reported_seq":69,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.135417+0000","last_change":"2024-04-25T22:02:42.844584+0000","last_active":"2024-04-25T22:01:12.587237+0000","last_peered":"2024-04-25T22:01:12.587237+0000","last_clean":"2024-04-25T22:01:12.587237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:06:30.135417+0000","last_undegraded":"2024-04-25T22:06:30.135417+0000","last_fullsized":"2024-04-25T22:06:30.135417+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"76'489","reported_seq":727,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842038+0000","last_change":"2024-04-25T22:06:22.838952+0000","last_active":"2024-04-25T22:06:29.842038+0000","last_peered":"2024-04-25T22:06:29.842038+0000","last_clean":"2024-04-25T22:06:29.842038+0000","last_became_active":"2024-04-25T22:06:22.832394+0000","last_became_peered":"2024-04-25T22:06:22.832394+0000","last_unstale":"2024-04-25T22:06:29.842038+0000","last_undegraded":"2024-04-25T22:06:29.842038+0000","last_fullsized":"2024-04-25T22:06:29.842038+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:04:38.988916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":26829,"num_write":457,"num_write_kb":137840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"75'193","reported_seq":375,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842334+0000","last_change":"2024-04-25T22:06:22.838157+0000","last_active":"2024-04-25T22:06:29.842334+0000","last_peered":"2024-04-25T22:06:29.842334+0000","last_clean":"2024-04-25T22:06:29.842334+0000","last_became_active":"2024-04-25T22:06:22.832572+0000","last_became_peered":"2024-04-25T22:06:22.832572+0000","last_unstale":"2024-04-25T22:06:29.842334+0000","last_undegraded":"2024-04-25T22:06:29.842334+0000","last_fullsized":"2024-04-25T22:06:29.842334+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:34.994194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'437","reported_seq":520,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.136633+0000","last_change":"2024-04-25T22:06:30.136633+0000","last_active":"2024-04-25T22:06:30.136633+0000","last_peered":"2024-04-25T22:03:46.907516+0000","last_clean":"2024-04-25T22:03:46.907516+0000","last_became_active":"2024-04-25T22:02:43.852555+0000","last_became_peered":"2024-04-25T22:02:43.852555+0000","last_unstale":"2024-04-25T22:06:30.136633+0000","last_undegraded":"2024-04-25T22:06:30.136633+0000","last_fullsized":"2024-04-25T22:06:30.136633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3720,"num_write":406,"num_write_kb":30461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"76'106","reported_seq":262,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130809+0000","last_change":"2024-04-25T22:06:23.128769+0000","last_active":"2024-04-25T22:06:30.130809+0000","last_peered":"2024-04-25T22:06:30.130809+0000","last_clean":"2024-04-25T22:06:30.130809+0000","last_became_active":"2024-04-25T22:06:23.103402+0000","last_became_peered":"2024-04-25T22:06:23.103402+0000","last_unstale":"2024-04-25T22:06:30.130809+0000","last_undegraded":"2024-04-25T22:06:30.130809+0000","last_fullsized":"2024-04-25T22:06:30.130809+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:27.137773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"76'409","reported_seq":603,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132383+0000","last_change":"2024-04-25T22:06:23.133536+0000","last_active":"2024-04-25T22:06:30.132383+0000","last_peered":"2024-04-25T22:06:30.132383+0000","last_clean":"2024-04-25T22:06:30.132383+0000","last_became_active":"2024-04-25T22:06:23.086188+0000","last_became_peered":"2024-04-25T22:06:23.086188+0000","last_unstale":"2024-04-25T22:06:30.132383+0000","last_undegraded":"2024-04-25T22:06:30.132383+0000","last_fullsized":"2024-04-25T22:06:30.132383+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:13:59.140479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19178,"num_write":380,"num_write_kb":91945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"75'51","reported_seq":180,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833864+0000","last_change":"2024-04-25T22:06:22.800659+0000","last_active":"2024-04-25T22:06:29.833864+0000","last_peered":"2024-04-25T22:06:29.833864+0000","last_clean":"2024-04-25T22:06:29.833864+0000","last_became_active":"2024-04-25T22:06:22.798779+0000","last_became_peered":"2024-04-25T22:06:22.798779+0000","last_unstale":"2024-04-25T22:06:29.833864+0000","last_undegraded":"2024-04-25T22:06:29.833864+0000","last_fullsized":"2024-04-25T22:06:29.833864+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:35.728722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"76'377","reported_seq":559,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.134856+0000","last_change":"2024-04-25T22:06:23.114225+0000","last_active":"2024-04-25T22:06:30.134856+0000","last_peered":"2024-04-25T22:06:30.134856+0000","last_clean":"2024-04-25T22:06:30.134856+0000","last_became_active":"2024-04-25T22:06:23.085799+0000","last_became_peered":"2024-04-25T22:06:23.085799+0000","last_unstale":"2024-04-25T22:06:30.134856+0000","last_undegraded":"2024-04-25T22:06:30.134856+0000","last_fullsized":"2024-04-25T22:06:30.134856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:50.484372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21517,"num_write":342,"num_write_kb":66898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"75'449","reported_seq":544,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.832974+0000","last_change":"2024-04-25T22:03:33.860386+0000","last_active":"2024-04-25T22:06:29.832974+0000","last_peered":"2024-04-25T22:06:29.832974+0000","last_clean":"2024-04-25T22:06:29.832974+0000","last_became_active":"2024-04-25T22:03:33.859539+0000","last_became_peered":"2024-04-25T22:03:33.859539+0000","last_unstale":"2024-04-25T22:06:29.832974+0000","last_undegraded":"2024-04-25T22:06:29.832974+0000","last_fullsized":"2024-04-25T22:06:29.832974+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:20.247942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'399","reported_seq":611,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842608+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:06:29.842608+0000","last_peered":"2024-04-25T22:06:29.842608+0000","last_clean":"2024-04-25T22:06:29.842608+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:06:29.842608+0000","last_undegraded":"2024-04-25T22:06:29.842608+0000","last_fullsized":"2024-04-25T22:06:29.842608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17888,"num_write":373,"num_write_kb":67556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":316,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130098+0000","last_change":"2024-04-25T22:06:23.082707+0000","last_active":"2024-04-25T22:06:30.130098+0000","last_peered":"2024-04-25T22:06:30.130098+0000","last_clean":"2024-04-25T22:06:30.130098+0000","last_became_active":"2024-04-25T22:06:23.080701+0000","last_became_peered":"2024-04-25T22:06:23.080701+0000","last_unstale":"2024-04-25T22:06:30.130098+0000","last_undegraded":"2024-04-25T22:06:30.130098+0000","last_fullsized":"2024-04-25T22:06:30.130098+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:27.088849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130852+0000","last_change":"2024-04-25T22:06:23.116373+0000","last_active":"2024-04-25T22:06:30.130852+0000","last_peered":"2024-04-25T22:06:30.130852+0000","last_clean":"2024-04-25T22:06:30.130852+0000","last_became_active":"2024-04-25T22:06:23.108984+0000","last_became_peered":"2024-04-25T22:06:23.108984+0000","last_unstale":"2024-04-25T22:06:30.130852+0000","last_undegraded":"2024-04-25T22:06:30.130852+0000","last_fullsized":"2024-04-25T22:06:30.130852+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:08.884723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"75'393","reported_seq":568,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840908+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:06:29.840908+0000","last_peered":"2024-04-25T22:06:29.840908+0000","last_clean":"2024-04-25T22:06:29.840908+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:06:29.840908+0000","last_undegraded":"2024-04-25T22:06:29.840908+0000","last_fullsized":"2024-04-25T22:06:29.840908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'463","reported_seq":666,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.134571+0000","last_change":"2024-04-25T22:06:23.133028+0000","last_active":"2024-04-25T22:06:30.134571+0000","last_peered":"2024-04-25T22:06:30.134571+0000","last_clean":"2024-04-25T22:06:30.134571+0000","last_became_active":"2024-04-25T22:06:23.082756+0000","last_became_peered":"2024-04-25T22:06:23.082756+0000","last_unstale":"2024-04-25T22:06:30.134571+0000","last_undegraded":"2024-04-25T22:06:30.134571+0000","last_fullsized":"2024-04-25T22:06:30.134571+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:24:01.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29270,"num_write":426,"num_write_kb":129367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131290+0000","last_change":"2024-04-25T22:06:23.083451+0000","last_active":"2024-04-25T22:06:30.131290+0000","last_peered":"2024-04-25T22:06:30.131290+0000","last_clean":"2024-04-25T22:06:30.131290+0000","last_became_active":"2024-04-25T22:06:23.080841+0000","last_became_peered":"2024-04-25T22:06:23.080841+0000","last_unstale":"2024-04-25T22:06:30.131290+0000","last_undegraded":"2024-04-25T22:06:30.131290+0000","last_fullsized":"2024-04-25T22:06:30.131290+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:34.605367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"76'125","reported_seq":370,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840322+0000","last_change":"2024-04-25T22:06:22.804290+0000","last_active":"2024-04-25T22:06:29.840322+0000","last_peered":"2024-04-25T22:06:29.840322+0000","last_clean":"2024-04-25T22:06:29.840322+0000","last_became_active":"2024-04-25T22:06:22.801616+0000","last_became_peered":"2024-04-25T22:06:22.801616+0000","last_unstale":"2024-04-25T22:06:29.840322+0000","last_undegraded":"2024-04-25T22:06:29.840322+0000","last_fullsized":"2024-04-25T22:06:29.840322+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:13.402747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464197,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":63,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'457","reported_seq":644,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834440+0000","last_change":"2024-04-25T22:03:05.702224+0000","last_active":"2024-04-25T22:06:29.834440+0000","last_peered":"2024-04-25T22:06:29.834440+0000","last_clean":"2024-04-25T22:06:29.834440+0000","last_became_active":"2024-04-25T22:03:05.699581+0000","last_became_peered":"2024-04-25T22:03:05.699581+0000","last_unstale":"2024-04-25T22:06:29.834440+0000","last_undegraded":"2024-04-25T22:06:29.834440+0000","last_fullsized":"2024-04-25T22:06:29.834440+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":34759,"num_write":424,"num_write_kb":71902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840807+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:06:29.840807+0000","last_peered":"2024-04-25T22:06:29.840807+0000","last_clean":"2024-04-25T22:06:29.840807+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:06:29.840807+0000","last_undegraded":"2024-04-25T22:06:29.840807+0000","last_fullsized":"2024-04-25T22:06:29.840807+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"75'311","reported_seq":494,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833232+0000","last_change":"2024-04-25T22:06:22.801481+0000","last_active":"2024-04-25T22:06:29.833232+0000","last_peered":"2024-04-25T22:06:29.833232+0000","last_clean":"2024-04-25T22:06:29.833232+0000","last_became_active":"2024-04-25T22:06:22.794841+0000","last_became_peered":"2024-04-25T22:06:22.794841+0000","last_unstale":"2024-04-25T22:06:29.833232+0000","last_undegraded":"2024-04-25T22:06:29.833232+0000","last_fullsized":"2024-04-25T22:06:29.833232+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:06:59.330924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"76'373","reported_seq":590,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842957+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:06:29.842957+0000","last_peered":"2024-04-25T22:06:29.842957+0000","last_clean":"2024-04-25T22:06:29.842957+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:06:29.842957+0000","last_undegraded":"2024-04-25T22:06:29.842957+0000","last_fullsized":"2024-04-25T22:06:29.842957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28273,"num_write":350,"num_write_kb":87787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130568+0000","last_change":"2024-04-25T22:06:23.129162+0000","last_active":"2024-04-25T22:06:30.130568+0000","last_peered":"2024-04-25T22:06:30.130568+0000","last_clean":"2024-04-25T22:06:30.130568+0000","last_became_active":"2024-04-25T22:06:23.106155+0000","last_became_peered":"2024-04-25T22:06:23.106155+0000","last_unstale":"2024-04-25T22:06:30.130568+0000","last_undegraded":"2024-04-25T22:06:30.130568+0000","last_fullsized":"2024-04-25T22:06:30.130568+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:30.846068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"76'75","reported_seq":69,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.133335+0000","last_change":"2024-04-25T22:02:42.841987+0000","last_active":"2024-04-25T22:01:12.587237+0000","last_peered":"2024-04-25T22:01:12.587237+0000","last_clean":"2024-04-25T22:01:12.587237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:06:30.133335+0000","last_undegraded":"2024-04-25T22:06:30.133335+0000","last_fullsized":"2024-04-25T22:06:30.133335+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"76'461","reported_seq":751,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.841997+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:06:29.841997+0000","last_peered":"2024-04-25T22:06:29.841997+0000","last_clean":"2024-04-25T22:06:29.841997+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:06:29.841997+0000","last_undegraded":"2024-04-25T22:06:29.841997+0000","last_fullsized":"2024-04-25T22:06:29.841997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":67984,"num_write":425,"num_write_kb":154741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"76'268","reported_seq":423,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131579+0000","last_change":"2024-04-25T22:06:23.134306+0000","last_active":"2024-04-25T22:06:30.131579+0000","last_peered":"2024-04-25T22:06:30.131579+0000","last_clean":"2024-04-25T22:06:30.131579+0000","last_became_active":"2024-04-25T22:06:23.122629+0000","last_became_peered":"2024-04-25T22:06:23.122629+0000","last_unstale":"2024-04-25T22:06:30.131579+0000","last_undegraded":"2024-04-25T22:06:30.131579+0000","last_fullsized":"2024-04-25T22:06:30.131579+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:41.205934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842322+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:06:29.842322+0000","last_peered":"2024-04-25T22:06:29.842322+0000","last_clean":"2024-04-25T22:06:29.842322+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:06:29.842322+0000","last_undegraded":"2024-04-25T22:06:29.842322+0000","last_fullsized":"2024-04-25T22:06:29.842322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'398","reported_seq":576,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833710+0000","last_change":"2024-04-25T22:06:22.797468+0000","last_active":"2024-04-25T22:06:29.833710+0000","last_peered":"2024-04-25T22:06:29.833710+0000","last_clean":"2024-04-25T22:06:29.833710+0000","last_became_active":"2024-04-25T22:06:22.789384+0000","last_became_peered":"2024-04-25T22:06:22.789384+0000","last_unstale":"2024-04-25T22:06:29.833710+0000","last_undegraded":"2024-04-25T22:06:29.833710+0000","last_fullsized":"2024-04-25T22:06:29.833710+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:35.557386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":26599,"num_write":366,"num_write_kb":75612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"76'47","reported_seq":222,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842239+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:06:29.842239+0000","last_peered":"2024-04-25T22:06:29.842239+0000","last_clean":"2024-04-25T22:06:29.842239+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:06:29.842239+0000","last_undegraded":"2024-04-25T22:06:29.842239+0000","last_fullsized":"2024-04-25T22:06:29.842239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.837080+0000","last_change":"2024-04-25T22:03:05.701809+0000","last_active":"2024-04-25T22:06:29.837080+0000","last_peered":"2024-04-25T22:06:29.837080+0000","last_clean":"2024-04-25T22:06:29.837080+0000","last_became_active":"2024-04-25T22:03:05.701322+0000","last_became_peered":"2024-04-25T22:03:05.701322+0000","last_unstale":"2024-04-25T22:06:29.837080+0000","last_undegraded":"2024-04-25T22:06:29.837080+0000","last_fullsized":"2024-04-25T22:06:29.837080+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:45.907458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"76'406","reported_seq":640,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833959+0000","last_change":"2024-04-25T22:06:22.802683+0000","last_active":"2024-04-25T22:06:29.833959+0000","last_peered":"2024-04-25T22:06:29.833959+0000","last_clean":"2024-04-25T22:06:29.833959+0000","last_became_active":"2024-04-25T22:06:22.789807+0000","last_became_peered":"2024-04-25T22:06:22.789807+0000","last_unstale":"2024-04-25T22:06:29.833959+0000","last_undegraded":"2024-04-25T22:06:29.833959+0000","last_fullsized":"2024-04-25T22:06:29.833959+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:15.180532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25634,"num_write":377,"num_write_kb":103970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"76'64","reported_seq":239,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.843535+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:06:29.843535+0000","last_peered":"2024-04-25T22:06:29.843535+0000","last_clean":"2024-04-25T22:06:29.843535+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:06:29.843535+0000","last_undegraded":"2024-04-25T22:06:29.843535+0000","last_fullsized":"2024-04-25T22:06:29.843535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132057+0000","last_change":"2024-04-25T22:06:24.092672+0000","last_active":"2024-04-25T22:06:30.132057+0000","last_peered":"2024-04-25T22:06:30.132057+0000","last_clean":"2024-04-25T22:06:30.132057+0000","last_became_active":"2024-04-25T22:06:24.091909+0000","last_became_peered":"2024-04-25T22:06:24.091909+0000","last_unstale":"2024-04-25T22:06:30.132057+0000","last_undegraded":"2024-04-25T22:06:30.132057+0000","last_fullsized":"2024-04-25T22:06:30.132057+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:19:21.605435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"76'402","reported_seq":603,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840799+0000","last_change":"2024-04-25T22:06:22.809713+0000","last_active":"2024-04-25T22:06:29.840799+0000","last_peered":"2024-04-25T22:06:29.840799+0000","last_clean":"2024-04-25T22:06:29.840799+0000","last_became_active":"2024-04-25T22:06:22.802005+0000","last_became_peered":"2024-04-25T22:06:22.802005+0000","last_unstale":"2024-04-25T22:06:29.840799+0000","last_undegraded":"2024-04-25T22:06:29.840799+0000","last_fullsized":"2024-04-25T22:06:29.840799+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9572,"num_write":361,"num_write_kb":29911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"77'127","reported_seq":309,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.843126+0000","last_change":"2024-04-25T22:06:22.804851+0000","last_active":"2024-04-25T22:06:29.843126+0000","last_peered":"2024-04-25T22:06:29.843126+0000","last_clean":"2024-04-25T22:06:29.843126+0000","last_became_active":"2024-04-25T22:06:22.802083+0000","last_became_peered":"2024-04-25T22:06:22.802083+0000","last_unstale":"2024-04-25T22:06:29.843126+0000","last_undegraded":"2024-04-25T22:06:29.843126+0000","last_fullsized":"2024-04-25T22:06:29.843126+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131963+0000","last_change":"2024-04-25T22:06:23.081230+0000","last_active":"2024-04-25T22:06:30.131963+0000","last_peered":"2024-04-25T22:06:30.131963+0000","last_clean":"2024-04-25T22:06:30.131963+0000","last_became_active":"2024-04-25T22:06:23.080393+0000","last_became_peered":"2024-04-25T22:06:23.080393+0000","last_unstale":"2024-04-25T22:06:30.131963+0000","last_undegraded":"2024-04-25T22:06:30.131963+0000","last_fullsized":"2024-04-25T22:06:30.131963+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:55.157159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"76'415","reported_seq":594,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833189+0000","last_change":"2024-04-25T22:06:22.801327+0000","last_active":"2024-04-25T22:06:29.833189+0000","last_peered":"2024-04-25T22:06:29.833189+0000","last_clean":"2024-04-25T22:06:29.833189+0000","last_became_active":"2024-04-25T22:06:22.789624+0000","last_became_peered":"2024-04-25T22:06:22.789624+0000","last_unstale":"2024-04-25T22:06:29.833189+0000","last_undegraded":"2024-04-25T22:06:29.833189+0000","last_fullsized":"2024-04-25T22:06:29.833189+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27345,"num_write":384,"num_write_kb":92854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"76'407","reported_seq":621,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.133739+0000","last_change":"2024-04-25T22:06:23.114739+0000","last_active":"2024-04-25T22:06:30.133739+0000","last_peered":"2024-04-25T22:06:30.133739+0000","last_clean":"2024-04-25T22:06:30.133739+0000","last_became_active":"2024-04-25T22:06:23.087118+0000","last_became_peered":"2024-04-25T22:06:23.087118+0000","last_unstale":"2024-04-25T22:06:30.133739+0000","last_undegraded":"2024-04-25T22:06:30.133739+0000","last_fullsized":"2024-04-25T22:06:30.133739+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:51.191212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33923,"num_write":372,"num_write_kb":82083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"77'260","reported_seq":418,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131279+0000","last_change":"2024-04-25T22:06:23.083331+0000","last_active":"2024-04-25T22:06:30.131279+0000","last_peered":"2024-04-25T22:06:30.131279+0000","last_clean":"2024-04-25T22:06:30.131279+0000","last_became_active":"2024-04-25T22:06:23.080552+0000","last_became_peered":"2024-04-25T22:06:23.080552+0000","last_unstale":"2024-04-25T22:06:30.131279+0000","last_undegraded":"2024-04-25T22:06:30.131279+0000","last_fullsized":"2024-04-25T22:06:30.131279+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:55.928212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8470619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"76'408","reported_seq":608,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840444+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:06:29.840444+0000","last_peered":"2024-04-25T22:06:29.840444+0000","last_clean":"2024-04-25T22:06:29.840444+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:06:29.840444+0000","last_undegraded":"2024-04-25T22:06:29.840444+0000","last_fullsized":"2024-04-25T22:06:29.840444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14178,"num_write":370,"num_write_kb":58735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'104","reported_seq":287,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.836892+0000","last_change":"2024-04-25T22:06:22.805389+0000","last_active":"2024-04-25T22:06:29.836892+0000","last_peered":"2024-04-25T22:06:29.836892+0000","last_clean":"2024-04-25T22:06:29.836892+0000","last_became_active":"2024-04-25T22:06:22.802667+0000","last_became_peered":"2024-04-25T22:06:22.802667+0000","last_unstale":"2024-04-25T22:06:29.836892+0000","last_undegraded":"2024-04-25T22:06:29.836892+0000","last_fullsized":"2024-04-25T22:06:29.836892+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:38.785650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"75'232","reported_seq":278,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.134307+0000","last_change":"2024-04-25T22:06:30.134307+0000","last_active":"2024-04-25T22:06:30.134307+0000","last_peered":"2024-04-25T22:03:41.622809+0000","last_clean":"2024-04-25T22:03:41.622809+0000","last_became_active":"2024-04-25T22:02:43.852292+0000","last_became_peered":"2024-04-25T22:02:43.852292+0000","last_unstale":"2024-04-25T22:06:30.134307+0000","last_undegraded":"2024-04-25T22:06:30.134307+0000","last_fullsized":"2024-04-25T22:06:30.134307+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"76'483","reported_seq":711,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840024+0000","last_change":"2024-04-25T22:06:22.814119+0000","last_active":"2024-04-25T22:06:29.840024+0000","last_peered":"2024-04-25T22:06:29.840024+0000","last_clean":"2024-04-25T22:06:29.840024+0000","last_became_active":"2024-04-25T22:06:22.807584+0000","last_became_peered":"2024-04-25T22:06:22.807584+0000","last_unstale":"2024-04-25T22:06:29.840024+0000","last_undegraded":"2024-04-25T22:06:29.840024+0000","last_fullsized":"2024-04-25T22:06:29.840024+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:08.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24709,"num_write":463,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"75'60","reported_seq":242,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.843285+0000","last_change":"2024-04-25T22:06:22.802356+0000","last_active":"2024-04-25T22:06:29.843285+0000","last_peered":"2024-04-25T22:06:29.843285+0000","last_clean":"2024-04-25T22:06:29.843285+0000","last_became_active":"2024-04-25T22:06:22.801412+0000","last_became_peered":"2024-04-25T22:06:22.801412+0000","last_unstale":"2024-04-25T22:06:29.843285+0000","last_undegraded":"2024-04-25T22:06:29.843285+0000","last_fullsized":"2024-04-25T22:06:29.843285+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:04.421952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'444","reported_seq":646,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840735+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:06:29.840735+0000","last_peered":"2024-04-25T22:06:29.840735+0000","last_clean":"2024-04-25T22:06:29.840735+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:06:29.840735+0000","last_undegraded":"2024-04-25T22:06:29.840735+0000","last_fullsized":"2024-04-25T22:06:29.840735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14429,"num_write":416,"num_write_kb":59186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'355","reported_seq":497,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835185+0000","last_change":"2024-04-25T22:06:22.804579+0000","last_active":"2024-04-25T22:06:29.835185+0000","last_peered":"2024-04-25T22:06:29.835185+0000","last_clean":"2024-04-25T22:06:29.835185+0000","last_became_active":"2024-04-25T22:06:22.792886+0000","last_became_peered":"2024-04-25T22:06:22.792886+0000","last_unstale":"2024-04-25T22:06:29.835185+0000","last_undegraded":"2024-04-25T22:06:29.835185+0000","last_fullsized":"2024-04-25T22:06:29.835185+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:54:35.464321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18236,"num_write":332,"num_write_kb":42553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"76'742","reported_seq":917,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.841034+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:06:29.841034+0000","last_peered":"2024-04-25T22:06:29.841034+0000","last_clean":"2024-04-25T22:06:29.841034+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:06:29.841034+0000","last_undegraded":"2024-04-25T22:06:29.841034+0000","last_fullsized":"2024-04-25T22:06:29.841034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'378","reported_seq":577,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842615+0000","last_change":"2024-04-25T22:06:22.813642+0000","last_active":"2024-04-25T22:06:29.842615+0000","last_peered":"2024-04-25T22:06:29.842615+0000","last_clean":"2024-04-25T22:06:29.842615+0000","last_became_active":"2024-04-25T22:06:22.806240+0000","last_became_peered":"2024-04-25T22:06:22.806240+0000","last_unstale":"2024-04-25T22:06:29.842615+0000","last_undegraded":"2024-04-25T22:06:29.842615+0000","last_fullsized":"2024-04-25T22:06:29.842615+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6876,"num_write":354,"num_write_kb":46840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"76'204","reported_seq":386,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840254+0000","last_change":"2024-04-25T22:06:22.805022+0000","last_active":"2024-04-25T22:06:29.840254+0000","last_peered":"2024-04-25T22:06:29.840254+0000","last_clean":"2024-04-25T22:06:29.840254+0000","last_became_active":"2024-04-25T22:06:22.801630+0000","last_became_peered":"2024-04-25T22:06:22.801630+0000","last_unstale":"2024-04-25T22:06:29.840254+0000","last_undegraded":"2024-04-25T22:06:29.840254+0000","last_fullsized":"2024-04-25T22:06:29.840254+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:34.554201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'377","reported_seq":513,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.836047+0000","last_change":"2024-04-25T22:06:22.805011+0000","last_active":"2024-04-25T22:06:29.836047+0000","last_peered":"2024-04-25T22:06:29.836047+0000","last_clean":"2024-04-25T22:06:29.836047+0000","last_became_active":"2024-04-25T22:06:22.795334+0000","last_became_peered":"2024-04-25T22:06:22.795334+0000","last_unstale":"2024-04-25T22:06:29.836047+0000","last_undegraded":"2024-04-25T22:06:29.836047+0000","last_fullsized":"2024-04-25T22:06:29.836047+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:35.997378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6059,"num_write":332,"num_write_kb":37972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"76'217","reported_seq":330,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834033+0000","last_change":"2024-04-25T22:06:28.842258+0000","last_active":"2024-04-25T22:06:29.834033+0000","last_peered":"2024-04-25T22:06:29.834033+0000","last_clean":"2024-04-25T22:06:29.834033+0000","last_became_active":"2024-04-25T22:06:28.841447+0000","last_became_peered":"2024-04-25T22:06:28.841447+0000","last_unstale":"2024-04-25T22:06:29.834033+0000","last_undegraded":"2024-04-25T22:06:29.834033+0000","last_fullsized":"2024-04-25T22:06:29.834033+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:31.009167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"76'389","reported_seq":540,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835254+0000","last_change":"2024-04-25T22:03:33.862286+0000","last_active":"2024-04-25T22:06:29.835254+0000","last_peered":"2024-04-25T22:06:29.835254+0000","last_clean":"2024-04-25T22:06:29.835254+0000","last_became_active":"2024-04-25T22:03:33.860800+0000","last_became_peered":"2024-04-25T22:03:33.860800+0000","last_unstale":"2024-04-25T22:06:29.835254+0000","last_undegraded":"2024-04-25T22:06:29.835254+0000","last_fullsized":"2024-04-25T22:06:29.835254+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:04.528174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19110,"num_write":355,"num_write_kb":63152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'51","reported_seq":124,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834507+0000","last_change":"2024-04-25T22:06:22.804880+0000","last_active":"2024-04-25T22:06:29.834507+0000","last_peered":"2024-04-25T22:06:29.834507+0000","last_clean":"2024-04-25T22:06:29.834507+0000","last_became_active":"2024-04-25T22:06:22.803778+0000","last_became_peered":"2024-04-25T22:06:22.803778+0000","last_unstale":"2024-04-25T22:06:29.834507+0000","last_undegraded":"2024-04-25T22:06:29.834507+0000","last_fullsized":"2024-04-25T22:06:29.834507+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:47:58.480071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"76'386","reported_seq":475,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.134793+0000","last_change":"2024-04-25T22:06:30.134793+0000","last_active":"2024-04-25T22:06:30.134793+0000","last_peered":"2024-04-25T22:03:46.915198+0000","last_clean":"2024-04-25T22:03:46.915198+0000","last_became_active":"2024-04-25T22:02:43.850568+0000","last_became_peered":"2024-04-25T22:02:43.850568+0000","last_unstale":"2024-04-25T22:06:30.134793+0000","last_undegraded":"2024-04-25T22:06:30.134793+0000","last_fullsized":"2024-04-25T22:06:30.134793+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14050,"num_write":362,"num_write_kb":58957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"76'188","reported_seq":223,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.132995+0000","last_change":"2024-04-25T22:06:30.132995+0000","last_active":"2024-04-25T22:06:30.132995+0000","last_peered":"2024-04-25T22:03:31.361153+0000","last_clean":"2024-04-25T22:03:31.361153+0000","last_became_active":"2024-04-25T22:02:43.852769+0000","last_became_peered":"2024-04-25T22:02:43.852769+0000","last_unstale":"2024-04-25T22:06:30.132995+0000","last_undegraded":"2024-04-25T22:06:30.132995+0000","last_fullsized":"2024-04-25T22:06:30.132995+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"76'397","reported_seq":486,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.134133+0000","last_change":"2024-04-25T22:06:30.134133+0000","last_active":"2024-04-25T22:06:30.134133+0000","last_peered":"2024-04-25T22:03:46.861730+0000","last_clean":"2024-04-25T22:03:46.861730+0000","last_became_active":"2024-04-25T22:02:43.852263+0000","last_became_peered":"2024-04-25T22:02:43.852263+0000","last_unstale":"2024-04-25T22:06:30.134133+0000","last_undegraded":"2024-04-25T22:06:30.134133+0000","last_fullsized":"2024-04-25T22:06:30.134133+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13280,"num_write":364,"num_write_kb":46108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"75'284","reported_seq":412,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.836603+0000","last_change":"2024-04-25T22:06:22.804561+0000","last_active":"2024-04-25T22:06:29.836603+0000","last_peered":"2024-04-25T22:06:29.836603+0000","last_clean":"2024-04-25T22:06:29.836603+0000","last_became_active":"2024-04-25T22:06:22.794078+0000","last_became_peered":"2024-04-25T22:06:22.794078+0000","last_unstale":"2024-04-25T22:06:29.836603+0000","last_undegraded":"2024-04-25T22:06:29.836603+0000","last_fullsized":"2024-04-25T22:06:29.836603+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:07.939379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":12398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"76'412","reported_seq":536,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834267+0000","last_change":"2024-04-25T22:03:33.864136+0000","last_active":"2024-04-25T22:06:29.834267+0000","last_peered":"2024-04-25T22:06:29.834267+0000","last_clean":"2024-04-25T22:06:29.834267+0000","last_became_active":"2024-04-25T22:03:33.862435+0000","last_became_peered":"2024-04-25T22:03:33.862435+0000","last_unstale":"2024-04-25T22:06:29.834267+0000","last_undegraded":"2024-04-25T22:06:29.834267+0000","last_fullsized":"2024-04-25T22:06:29.834267+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:08.119964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":1478,"num_write":377,"num_write_kb":34422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"76'127","reported_seq":302,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842960+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:06:29.842960+0000","last_peered":"2024-04-25T22:06:29.842960+0000","last_clean":"2024-04-25T22:06:29.842960+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:06:29.842960+0000","last_undegraded":"2024-04-25T22:06:29.842960+0000","last_fullsized":"2024-04-25T22:06:29.842960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'444","reported_seq":644,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131585+0000","last_change":"2024-04-25T22:06:23.132900+0000","last_active":"2024-04-25T22:06:30.131585+0000","last_peered":"2024-04-25T22:06:30.131585+0000","last_clean":"2024-04-25T22:06:30.131585+0000","last_became_active":"2024-04-25T22:06:23.097535+0000","last_became_peered":"2024-04-25T22:06:23.097535+0000","last_unstale":"2024-04-25T22:06:30.131585+0000","last_undegraded":"2024-04-25T22:06:30.131585+0000","last_fullsized":"2024-04-25T22:06:30.131585+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:30:55.243414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31576,"num_write":414,"num_write_kb":70915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"75'46","reported_seq":228,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842998+0000","last_change":"2024-04-25T22:06:22.802843+0000","last_active":"2024-04-25T22:06:29.842998+0000","last_peered":"2024-04-25T22:06:29.842998+0000","last_clean":"2024-04-25T22:06:29.842998+0000","last_became_active":"2024-04-25T22:06:22.801910+0000","last_became_peered":"2024-04-25T22:06:22.801910+0000","last_unstale":"2024-04-25T22:06:29.842998+0000","last_undegraded":"2024-04-25T22:06:29.842998+0000","last_fullsized":"2024-04-25T22:06:29.842998+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:23.004530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2665,"num_read_kb":1338898,"num_write":24540,"num_write_kb":4276910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26558,"ondisk_log_size":26558,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127376126,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":4662,"num_write_kb":127830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":71499776,"data_stored":254752252,"data_compressed":21836190,"data_compressed_allocated":35307520,"data_compressed_original":218619904,"omap_allocated":136586,"internal_metadata":0},"log_size":6446,"ondisk_log_size":6446,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738440,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99728,"kb_used_data":24188,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272112,"statfs":{"total":96636764160,"available":96534642688,"internally_reserved":0,"allocated":24768512,"data_stored":84959773,"data_compressed":7036839,"data_compressed_allocated":11431936,"data_compressed_original":72118272,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738439,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99420,"kb_used_data":23884,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272420,"statfs":{"total":96636764160,"available":96534958080,"internally_reserved":0,"allocated":24457216,"data_stored":81557721,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":90,"seq":386547056644,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58096,"kb_used_data":24420,"kb_used_omap":134,"kb_used_meta":33529,"kb_avail":94313744,"statfs":{"total":96636764160,"available":96577273856,"internally_reserved":0,"allocated":25006080,"data_stored":90618890,"data_compressed":7819212,"data_compressed_allocated":12599296,"data_compressed_original":78716928,"omap_allocated":138181,"internal_metadata":34333755},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24076288,"data_stored":89627390,"data_compressed":7811005,"data_compressed_allocated":12562432,"data_compressed_original":78143488,"omap_allocated":136586,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23584768,"data_stored":81156589,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23838720,"data_stored":83968273,"data_compressed":7028632,"data_compressed_allocated":11395072,"data_compressed_original":71544832,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:06:33.081 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T22:06:33.472 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:06:33.473 INFO:teuthology.orchestra.run.smithi044.stdout:{"fsid":"1ced109c-704f-44b1-9811-a2da74898889","health":{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 2 pgs inactive, 9 pgs peering","count":11},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":341,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":99,"num_osds":3,"num_up_osds":3,"osd_up_since":1714082781,"num_in_osds":3,"osd_in_since":1714082453,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":95},{"state_name":"peering","count":10}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":127966494,"bytes_used":263417856,"bytes_avail":289646874624,"bytes_total":289910292480,"inactive_pgs_ratio":0.095238097012042999},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4205}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-25T22:02:21.582461+0000","services":{}},"progress_events":{}} 2024-04-25T22:06:33.489 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-04-25T22:06:33.490 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:06:33.802 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:06:33.804 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:06:33.820 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-04-25T22:06:33.688463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127966494,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2864,"num_read_kb":1340487,"num_write":29405,"num_write_kb":4408200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33161,"ondisk_log_size":33161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":257244,"kb_used_data":72492,"kb_used_omap":138,"kb_used_meta":184565,"kb_avail":282858276,"statfs":{"total":289910292480,"available":289646874624,"internally_reserved":0,"allocated":74231808,"data_stored":257136384,"data_compressed":21852604,"data_compressed_allocated":35381248,"data_compressed_original":219766784,"omap_allocated":141371,"internal_metadata":188995525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-36,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.877568"},"pg_stats":[{"pgid":"4.3f","version":"76'446","reported_seq":602,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834874+0000","last_change":"2024-04-25T22:03:33.876369+0000","last_active":"2024-04-25T22:06:29.834874+0000","last_peered":"2024-04-25T22:06:29.834874+0000","last_clean":"2024-04-25T22:06:29.834874+0000","last_became_active":"2024-04-25T22:03:33.873739+0000","last_became_peered":"2024-04-25T22:03:33.873739+0000","last_unstale":"2024-04-25T22:06:29.834874+0000","last_undegraded":"2024-04-25T22:06:29.834874+0000","last_fullsized":"2024-04-25T22:06:29.834874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:32.529707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29432,"num_write":407,"num_write_kb":84235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"76'417","reported_seq":568,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834103+0000","last_change":"2024-04-25T22:03:33.861269+0000","last_active":"2024-04-25T22:06:29.834103+0000","last_peered":"2024-04-25T22:06:29.834103+0000","last_clean":"2024-04-25T22:06:29.834103+0000","last_became_active":"2024-04-25T22:03:33.859221+0000","last_became_peered":"2024-04-25T22:03:33.859221+0000","last_unstale":"2024-04-25T22:06:29.834103+0000","last_undegraded":"2024-04-25T22:06:29.834103+0000","last_fullsized":"2024-04-25T22:06:29.834103+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:23:44.690527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":23541,"num_write":389,"num_write_kb":87654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"76'389","reported_seq":550,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.136427+0000","last_change":"2024-04-25T22:06:30.136427+0000","last_active":"2024-04-25T22:06:30.136427+0000","last_peered":"2024-04-25T22:03:46.909574+0000","last_clean":"2024-04-25T22:03:46.909574+0000","last_became_active":"2024-04-25T22:03:33.863788+0000","last_became_peered":"2024-04-25T22:03:33.863788+0000","last_unstale":"2024-04-25T22:06:30.136427+0000","last_undegraded":"2024-04-25T22:06:30.136427+0000","last_fullsized":"2024-04-25T22:06:30.136427+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22311,"num_write":361,"num_write_kb":42975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"76'394","reported_seq":586,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.133476+0000","last_change":"2024-04-25T22:06:23.123256+0000","last_active":"2024-04-25T22:06:30.133476+0000","last_peered":"2024-04-25T22:06:30.133476+0000","last_clean":"2024-04-25T22:06:30.133476+0000","last_became_active":"2024-04-25T22:06:23.090780+0000","last_became_peered":"2024-04-25T22:06:23.090780+0000","last_unstale":"2024-04-25T22:06:30.133476+0000","last_undegraded":"2024-04-25T22:06:30.133476+0000","last_fullsized":"2024-04-25T22:06:30.133476+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:57.110628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":20785,"num_write":367,"num_write_kb":63746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"76'429","reported_seq":938,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834238+0000","last_change":"2024-04-25T22:06:28.839715+0000","last_active":"2024-04-25T22:06:29.834238+0000","last_peered":"2024-04-25T22:06:29.834238+0000","last_clean":"2024-04-25T22:06:29.834238+0000","last_became_active":"2024-04-25T22:06:28.836687+0000","last_became_peered":"2024-04-25T22:06:28.836687+0000","last_unstale":"2024-04-25T22:06:29.834238+0000","last_undegraded":"2024-04-25T22:06:29.834238+0000","last_fullsized":"2024-04-25T22:06:29.834238+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:10.175157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":20896,"num_write":403,"num_write_kb":100255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"76'368","reported_seq":540,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132775+0000","last_change":"2024-04-25T22:06:23.129617+0000","last_active":"2024-04-25T22:06:30.132775+0000","last_peered":"2024-04-25T22:06:30.132775+0000","last_clean":"2024-04-25T22:06:30.132775+0000","last_became_active":"2024-04-25T22:06:23.107939+0000","last_became_peered":"2024-04-25T22:06:23.107939+0000","last_unstale":"2024-04-25T22:06:30.132775+0000","last_undegraded":"2024-04-25T22:06:30.132775+0000","last_fullsized":"2024-04-25T22:06:30.132775+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:24.183902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9362,"num_write":344,"num_write_kb":20831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"76'438","reported_seq":636,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131211+0000","last_change":"2024-04-25T22:06:23.123861+0000","last_active":"2024-04-25T22:06:30.131211+0000","last_peered":"2024-04-25T22:06:30.131211+0000","last_clean":"2024-04-25T22:06:30.131211+0000","last_became_active":"2024-04-25T22:06:23.098436+0000","last_became_peered":"2024-04-25T22:06:23.098436+0000","last_unstale":"2024-04-25T22:06:30.131211+0000","last_undegraded":"2024-04-25T22:06:30.131211+0000","last_fullsized":"2024-04-25T22:06:30.131211+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:35.433423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25961,"num_write":415,"num_write_kb":72541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'392","reported_seq":600,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130666+0000","last_change":"2024-04-25T22:06:23.128274+0000","last_active":"2024-04-25T22:06:30.130666+0000","last_peered":"2024-04-25T22:06:30.130666+0000","last_clean":"2024-04-25T22:06:30.130666+0000","last_became_active":"2024-04-25T22:06:23.091431+0000","last_became_peered":"2024-04-25T22:06:23.091431+0000","last_unstale":"2024-04-25T22:06:30.130666+0000","last_undegraded":"2024-04-25T22:06:30.130666+0000","last_fullsized":"2024-04-25T22:06:30.130666+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:48.206131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":24749,"num_write":354,"num_write_kb":64232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"76'443","reported_seq":649,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842265+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:06:29.842265+0000","last_peered":"2024-04-25T22:06:29.842265+0000","last_clean":"2024-04-25T22:06:29.842265+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:06:29.842265+0000","last_undegraded":"2024-04-25T22:06:29.842265+0000","last_fullsized":"2024-04-25T22:06:29.842265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":10648,"num_write":411,"num_write_kb":92932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'392","reported_seq":509,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131757+0000","last_change":"2024-04-25T22:06:26.120464+0000","last_active":"2024-04-25T22:06:30.131757+0000","last_peered":"2024-04-25T22:06:30.131757+0000","last_clean":"2024-04-25T22:06:30.131757+0000","last_became_active":"2024-04-25T22:06:26.114463+0000","last_became_peered":"2024-04-25T22:06:26.114463+0000","last_unstale":"2024-04-25T22:06:30.131757+0000","last_undegraded":"2024-04-25T22:06:30.131757+0000","last_fullsized":"2024-04-25T22:06:30.131757+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:37:54.870762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10696,"num_write":359,"num_write_kb":63259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'391","reported_seq":567,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.135469+0000","last_change":"2024-04-25T22:06:23.135020+0000","last_active":"2024-04-25T22:06:30.135469+0000","last_peered":"2024-04-25T22:06:30.135469+0000","last_clean":"2024-04-25T22:06:30.135469+0000","last_became_active":"2024-04-25T22:06:23.123801+0000","last_became_peered":"2024-04-25T22:06:23.123801+0000","last_unstale":"2024-04-25T22:06:30.135469+0000","last_undegraded":"2024-04-25T22:06:30.135469+0000","last_fullsized":"2024-04-25T22:06:30.135469+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:11:44.607123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11259,"num_write":372,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"76'365","reported_seq":645,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835231+0000","last_change":"2024-04-25T22:06:22.802947+0000","last_active":"2024-04-25T22:06:29.835231+0000","last_peered":"2024-04-25T22:06:29.835231+0000","last_clean":"2024-04-25T22:06:29.835231+0000","last_became_active":"2024-04-25T22:06:22.792880+0000","last_became_peered":"2024-04-25T22:06:22.792880+0000","last_unstale":"2024-04-25T22:06:29.835231+0000","last_undegraded":"2024-04-25T22:06:29.835231+0000","last_fullsized":"2024-04-25T22:06:29.835231+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":51972,"num_write":340,"num_write_kb":51203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"76'420","reported_seq":572,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833638+0000","last_change":"2024-04-25T22:03:33.866815+0000","last_active":"2024-04-25T22:06:29.833638+0000","last_peered":"2024-04-25T22:06:29.833638+0000","last_clean":"2024-04-25T22:06:29.833638+0000","last_became_active":"2024-04-25T22:03:33.859376+0000","last_became_peered":"2024-04-25T22:03:33.859376+0000","last_unstale":"2024-04-25T22:06:29.833638+0000","last_undegraded":"2024-04-25T22:06:29.833638+0000","last_fullsized":"2024-04-25T22:06:29.833638+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:08.620311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17620,"num_write":386,"num_write_kb":100613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"76'432","reported_seq":629,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132417+0000","last_change":"2024-04-25T22:06:23.128788+0000","last_active":"2024-04-25T22:06:30.132417+0000","last_peered":"2024-04-25T22:06:30.132417+0000","last_clean":"2024-04-25T22:06:30.132417+0000","last_became_active":"2024-04-25T22:06:23.081466+0000","last_became_peered":"2024-04-25T22:06:23.081466+0000","last_unstale":"2024-04-25T22:06:30.132417+0000","last_undegraded":"2024-04-25T22:06:30.132417+0000","last_fullsized":"2024-04-25T22:06:30.132417+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:15.042731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27327,"num_write":398,"num_write_kb":76113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"76'385","reported_seq":582,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131043+0000","last_change":"2024-04-25T22:06:23.116284+0000","last_active":"2024-04-25T22:06:30.131043+0000","last_peered":"2024-04-25T22:06:30.131043+0000","last_clean":"2024-04-25T22:06:30.131043+0000","last_became_active":"2024-04-25T22:06:23.088046+0000","last_became_peered":"2024-04-25T22:06:23.088046+0000","last_unstale":"2024-04-25T22:06:30.131043+0000","last_undegraded":"2024-04-25T22:06:30.131043+0000","last_fullsized":"2024-04-25T22:06:30.131043+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:40:35.110567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23986,"num_write":352,"num_write_kb":50754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"76'434","reported_seq":613,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131878+0000","last_change":"2024-04-25T22:06:23.132996+0000","last_active":"2024-04-25T22:06:30.131878+0000","last_peered":"2024-04-25T22:06:30.131878+0000","last_clean":"2024-04-25T22:06:30.131878+0000","last_became_active":"2024-04-25T22:06:23.117497+0000","last_became_peered":"2024-04-25T22:06:23.117497+0000","last_unstale":"2024-04-25T22:06:30.131878+0000","last_undegraded":"2024-04-25T22:06:30.131878+0000","last_fullsized":"2024-04-25T22:06:30.131878+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:30.022312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":13806,"num_write":403,"num_write_kb":38995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"76'444","reported_seq":656,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.843387+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:06:29.843387+0000","last_peered":"2024-04-25T22:06:29.843387+0000","last_clean":"2024-04-25T22:06:29.843387+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:06:29.843387+0000","last_undegraded":"2024-04-25T22:06:29.843387+0000","last_fullsized":"2024-04-25T22:06:29.843387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":11085,"num_write":416,"num_write_kb":68377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'396","reported_seq":529,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834759+0000","last_change":"2024-04-25T22:03:33.862762+0000","last_active":"2024-04-25T22:06:29.834759+0000","last_peered":"2024-04-25T22:06:29.834759+0000","last_clean":"2024-04-25T22:06:29.834759+0000","last_became_active":"2024-04-25T22:03:33.861082+0000","last_became_peered":"2024-04-25T22:03:33.861082+0000","last_unstale":"2024-04-25T22:06:29.834759+0000","last_undegraded":"2024-04-25T22:06:29.834759+0000","last_fullsized":"2024-04-25T22:06:29.834759+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:15.823113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6581,"num_write":355,"num_write_kb":34159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"76'447","reported_seq":646,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.841872+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:06:29.841872+0000","last_peered":"2024-04-25T22:06:29.841872+0000","last_clean":"2024-04-25T22:06:29.841872+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:06:29.841872+0000","last_undegraded":"2024-04-25T22:06:29.841872+0000","last_fullsized":"2024-04-25T22:06:29.841872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22089,"num_write":411,"num_write_kb":104750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'426","reported_seq":602,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.135373+0000","last_change":"2024-04-25T22:06:23.122769+0000","last_active":"2024-04-25T22:06:30.135373+0000","last_peered":"2024-04-25T22:06:30.135373+0000","last_clean":"2024-04-25T22:06:30.135373+0000","last_became_active":"2024-04-25T22:06:23.093379+0000","last_became_peered":"2024-04-25T22:06:23.093379+0000","last_unstale":"2024-04-25T22:06:30.135373+0000","last_undegraded":"2024-04-25T22:06:30.135373+0000","last_fullsized":"2024-04-25T22:06:30.135373+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:48.070891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11886,"num_write":398,"num_write_kb":55010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"76'405","reported_seq":600,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.134314+0000","last_change":"2024-04-25T22:06:23.129396+0000","last_active":"2024-04-25T22:06:30.134314+0000","last_peered":"2024-04-25T22:06:30.134314+0000","last_clean":"2024-04-25T22:06:30.134314+0000","last_became_active":"2024-04-25T22:06:23.110101+0000","last_became_peered":"2024-04-25T22:06:23.110101+0000","last_unstale":"2024-04-25T22:06:30.134314+0000","last_undegraded":"2024-04-25T22:06:30.134314+0000","last_fullsized":"2024-04-25T22:06:30.134314+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:40.218610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23004,"num_write":370,"num_write_kb":75802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'436","reported_seq":557,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833470+0000","last_change":"2024-04-25T22:06:28.838562+0000","last_active":"2024-04-25T22:06:29.833470+0000","last_peered":"2024-04-25T22:06:29.833470+0000","last_clean":"2024-04-25T22:06:29.833470+0000","last_became_active":"2024-04-25T22:06:28.835081+0000","last_became_peered":"2024-04-25T22:06:28.835081+0000","last_unstale":"2024-04-25T22:06:29.833470+0000","last_undegraded":"2024-04-25T22:06:29.833470+0000","last_fullsized":"2024-04-25T22:06:29.833470+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:15:18.057041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11950,"num_write":408,"num_write_kb":67524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"76'403","reported_seq":605,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.839248+0000","last_change":"2024-04-25T22:06:22.810930+0000","last_active":"2024-04-25T22:06:29.839248+0000","last_peered":"2024-04-25T22:06:29.839248+0000","last_clean":"2024-04-25T22:06:29.839248+0000","last_became_active":"2024-04-25T22:06:22.802907+0000","last_became_peered":"2024-04-25T22:06:22.802907+0000","last_unstale":"2024-04-25T22:06:29.839248+0000","last_undegraded":"2024-04-25T22:06:29.839248+0000","last_fullsized":"2024-04-25T22:06:29.839248+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:00.334109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":6507,"num_write":370,"num_write_kb":51513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'449","reported_seq":572,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.832812+0000","last_change":"2024-04-25T22:06:28.846531+0000","last_active":"2024-04-25T22:06:29.832812+0000","last_peered":"2024-04-25T22:06:29.832812+0000","last_clean":"2024-04-25T22:06:29.832812+0000","last_became_active":"2024-04-25T22:06:28.841283+0000","last_became_peered":"2024-04-25T22:06:28.841283+0000","last_unstale":"2024-04-25T22:06:29.832812+0000","last_undegraded":"2024-04-25T22:06:29.832812+0000","last_fullsized":"2024-04-25T22:06:29.832812+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:02.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27047,"num_write":417,"num_write_kb":63386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"76'406","reported_seq":569,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835163+0000","last_change":"2024-04-25T22:06:22.801634+0000","last_active":"2024-04-25T22:06:29.835163+0000","last_peered":"2024-04-25T22:06:29.835163+0000","last_clean":"2024-04-25T22:06:29.835163+0000","last_became_active":"2024-04-25T22:06:22.791470+0000","last_became_peered":"2024-04-25T22:06:22.791470+0000","last_unstale":"2024-04-25T22:06:29.835163+0000","last_undegraded":"2024-04-25T22:06:29.835163+0000","last_fullsized":"2024-04-25T22:06:29.835163+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:25.424659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25550,"num_write":386,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"76'485","reported_seq":733,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842474+0000","last_change":"2024-04-25T22:06:22.814124+0000","last_active":"2024-04-25T22:06:29.842474+0000","last_peered":"2024-04-25T22:06:29.842474+0000","last_clean":"2024-04-25T22:06:29.842474+0000","last_became_active":"2024-04-25T22:06:22.804228+0000","last_became_peered":"2024-04-25T22:06:22.804228+0000","last_unstale":"2024-04-25T22:06:29.842474+0000","last_undegraded":"2024-04-25T22:06:29.842474+0000","last_fullsized":"2024-04-25T22:06:29.842474+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":30714,"num_write":444,"num_write_kb":92836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'387","reported_seq":590,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.135315+0000","last_change":"2024-04-25T22:06:23.134971+0000","last_active":"2024-04-25T22:06:30.135315+0000","last_peered":"2024-04-25T22:06:30.135315+0000","last_clean":"2024-04-25T22:06:30.135315+0000","last_became_active":"2024-04-25T22:06:23.121334+0000","last_became_peered":"2024-04-25T22:06:23.121334+0000","last_unstale":"2024-04-25T22:06:30.135315+0000","last_undegraded":"2024-04-25T22:06:30.135315+0000","last_fullsized":"2024-04-25T22:06:30.135315+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:03.991336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21644,"num_write":354,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"76'405","reported_seq":647,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835567+0000","last_change":"2024-04-25T22:06:22.829889+0000","last_active":"2024-04-25T22:06:29.835567+0000","last_peered":"2024-04-25T22:06:29.835567+0000","last_clean":"2024-04-25T22:06:29.835567+0000","last_became_active":"2024-04-25T22:06:22.827066+0000","last_became_peered":"2024-04-25T22:06:22.827066+0000","last_unstale":"2024-04-25T22:06:29.835567+0000","last_undegraded":"2024-04-25T22:06:29.835567+0000","last_fullsized":"2024-04-25T22:06:29.835567+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:01.822252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27522,"num_write":375,"num_write_kb":96416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"76'396","reported_seq":617,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.841153+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:06:29.841153+0000","last_peered":"2024-04-25T22:06:29.841153+0000","last_clean":"2024-04-25T22:06:29.841153+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:06:29.841153+0000","last_undegraded":"2024-04-25T22:06:29.841153+0000","last_fullsized":"2024-04-25T22:06:29.841153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28501,"num_write":367,"num_write_kb":63458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":652,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833778+0000","last_change":"2024-04-25T22:06:22.803787+0000","last_active":"2024-04-25T22:06:29.833778+0000","last_peered":"2024-04-25T22:06:29.833778+0000","last_clean":"2024-04-25T22:06:29.833778+0000","last_became_active":"2024-04-25T22:06:22.789907+0000","last_became_peered":"2024-04-25T22:06:22.789907+0000","last_unstale":"2024-04-25T22:06:29.833778+0000","last_undegraded":"2024-04-25T22:06:29.833778+0000","last_fullsized":"2024-04-25T22:06:29.833778+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":20717,"num_write":435,"num_write_kb":55985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"76'444","reported_seq":645,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.839540+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:06:29.839540+0000","last_peered":"2024-04-25T22:06:29.839540+0000","last_clean":"2024-04-25T22:06:29.839540+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:06:29.839540+0000","last_undegraded":"2024-04-25T22:06:29.839540+0000","last_fullsized":"2024-04-25T22:06:29.839540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":10758,"num_write":401,"num_write_kb":44705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'422","reported_seq":525,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.131754+0000","last_change":"2024-04-25T22:06:30.131754+0000","last_active":"2024-04-25T22:06:30.131754+0000","last_peered":"2024-04-25T22:03:46.918292+0000","last_clean":"2024-04-25T22:03:46.918292+0000","last_became_active":"2024-04-25T22:02:43.850651+0000","last_became_peered":"2024-04-25T22:02:43.850651+0000","last_unstale":"2024-04-25T22:06:30.131754+0000","last_undegraded":"2024-04-25T22:06:30.131754+0000","last_fullsized":"2024-04-25T22:06:30.131754+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":29059,"num_write":391,"num_write_kb":40233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"76'397","reported_seq":892,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835507+0000","last_change":"2024-04-25T22:06:26.819859+0000","last_active":"2024-04-25T22:06:29.835507+0000","last_peered":"2024-04-25T22:06:29.835507+0000","last_clean":"2024-04-25T22:06:29.835507+0000","last_became_active":"2024-04-25T22:06:26.816439+0000","last_became_peered":"2024-04-25T22:06:26.816439+0000","last_unstale":"2024-04-25T22:06:29.835507+0000","last_undegraded":"2024-04-25T22:06:29.835507+0000","last_fullsized":"2024-04-25T22:06:29.835507+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:44.452918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28857,"num_write":363,"num_write_kb":87969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"75'515","reported_seq":669,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132386+0000","last_change":"2024-04-25T22:06:23.117492+0000","last_active":"2024-04-25T22:06:30.132386+0000","last_peered":"2024-04-25T22:06:30.132386+0000","last_clean":"2024-04-25T22:06:30.132386+0000","last_became_active":"2024-04-25T22:06:23.109665+0000","last_became_peered":"2024-04-25T22:06:23.109665+0000","last_unstale":"2024-04-25T22:06:30.132386+0000","last_undegraded":"2024-04-25T22:06:30.132386+0000","last_fullsized":"2024-04-25T22:06:30.132386+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:01.482888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"76'375","reported_seq":479,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.836346+0000","last_change":"2024-04-25T22:06:28.846182+0000","last_active":"2024-04-25T22:06:29.836346+0000","last_peered":"2024-04-25T22:06:29.836346+0000","last_clean":"2024-04-25T22:06:29.836346+0000","last_became_active":"2024-04-25T22:06:28.841545+0000","last_became_peered":"2024-04-25T22:06:28.841545+0000","last_unstale":"2024-04-25T22:06:29.836346+0000","last_undegraded":"2024-04-25T22:06:29.836346+0000","last_fullsized":"2024-04-25T22:06:29.836346+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.018915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14983,"num_write":339,"num_write_kb":46748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'53","reported_seq":235,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840596+0000","last_change":"2024-04-25T22:06:22.839083+0000","last_active":"2024-04-25T22:06:29.840596+0000","last_peered":"2024-04-25T22:06:29.840596+0000","last_clean":"2024-04-25T22:06:29.840596+0000","last_became_active":"2024-04-25T22:06:22.833424+0000","last_became_peered":"2024-04-25T22:06:22.833424+0000","last_unstale":"2024-04-25T22:06:29.840596+0000","last_undegraded":"2024-04-25T22:06:29.840596+0000","last_fullsized":"2024-04-25T22:06:29.840596+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:00.819067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'426","reported_seq":637,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.843016+0000","last_change":"2024-04-25T22:06:26.822923+0000","last_active":"2024-04-25T22:06:29.843016+0000","last_peered":"2024-04-25T22:06:29.843016+0000","last_clean":"2024-04-25T22:06:29.843016+0000","last_became_active":"2024-04-25T22:06:26.819562+0000","last_became_peered":"2024-04-25T22:06:26.819562+0000","last_unstale":"2024-04-25T22:06:29.843016+0000","last_undegraded":"2024-04-25T22:06:29.843016+0000","last_fullsized":"2024-04-25T22:06:29.843016+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:42.832195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":17843,"num_write":388,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"75'71","reported_seq":186,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833579+0000","last_change":"2024-04-25T22:06:22.799710+0000","last_active":"2024-04-25T22:06:29.833579+0000","last_peered":"2024-04-25T22:06:29.833579+0000","last_clean":"2024-04-25T22:06:29.833579+0000","last_became_active":"2024-04-25T22:06:22.790902+0000","last_became_peered":"2024-04-25T22:06:22.790902+0000","last_unstale":"2024-04-25T22:06:29.833579+0000","last_undegraded":"2024-04-25T22:06:29.833579+0000","last_fullsized":"2024-04-25T22:06:29.833579+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:50:36.683583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'366","reported_seq":569,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842598+0000","last_change":"2024-04-25T22:06:22.809150+0000","last_active":"2024-04-25T22:06:29.842598+0000","last_peered":"2024-04-25T22:06:29.842598+0000","last_clean":"2024-04-25T22:06:29.842598+0000","last_became_active":"2024-04-25T22:06:22.803327+0000","last_became_peered":"2024-04-25T22:06:22.803327+0000","last_unstale":"2024-04-25T22:06:29.842598+0000","last_undegraded":"2024-04-25T22:06:29.842598+0000","last_fullsized":"2024-04-25T22:06:29.842598+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.731906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":16032,"num_write":334,"num_write_kb":25754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'63","reported_seq":219,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130229+0000","last_change":"2024-04-25T22:06:23.085892+0000","last_active":"2024-04-25T22:06:30.130229+0000","last_peered":"2024-04-25T22:06:30.130229+0000","last_clean":"2024-04-25T22:06:30.130229+0000","last_became_active":"2024-04-25T22:06:23.082351+0000","last_became_peered":"2024-04-25T22:06:23.082351+0000","last_unstale":"2024-04-25T22:06:30.130229+0000","last_undegraded":"2024-04-25T22:06:30.130229+0000","last_fullsized":"2024-04-25T22:06:30.130229+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:51.142517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"76'148","reported_seq":304,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132891+0000","last_change":"2024-04-25T22:06:23.089179+0000","last_active":"2024-04-25T22:06:30.132891+0000","last_peered":"2024-04-25T22:06:30.132891+0000","last_clean":"2024-04-25T22:06:30.132891+0000","last_became_active":"2024-04-25T22:06:23.085599+0000","last_became_peered":"2024-04-25T22:06:23.085599+0000","last_unstale":"2024-04-25T22:06:30.132891+0000","last_undegraded":"2024-04-25T22:06:30.132891+0000","last_fullsized":"2024-04-25T22:06:30.132891+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:53:14.055158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"76'402","reported_seq":566,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.832933+0000","last_change":"2024-04-25T22:06:22.802685+0000","last_active":"2024-04-25T22:06:29.832933+0000","last_peered":"2024-04-25T22:06:29.832933+0000","last_clean":"2024-04-25T22:06:29.832933+0000","last_became_active":"2024-04-25T22:06:22.789353+0000","last_became_peered":"2024-04-25T22:06:22.789353+0000","last_unstale":"2024-04-25T22:06:29.832933+0000","last_undegraded":"2024-04-25T22:06:29.832933+0000","last_fullsized":"2024-04-25T22:06:29.832933+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:14.949049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21114,"num_write":364,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"75'250","reported_seq":372,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835236+0000","last_change":"2024-04-25T22:06:22.791598+0000","last_active":"2024-04-25T22:06:29.835236+0000","last_peered":"2024-04-25T22:06:29.835236+0000","last_clean":"2024-04-25T22:06:29.835236+0000","last_became_active":"2024-04-25T22:06:22.790508+0000","last_became_peered":"2024-04-25T22:06:22.790508+0000","last_unstale":"2024-04-25T22:06:29.835236+0000","last_undegraded":"2024-04-25T22:06:29.835236+0000","last_fullsized":"2024-04-25T22:06:29.835236+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"76'460","reported_seq":632,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833171+0000","last_change":"2024-04-25T22:03:33.861055+0000","last_active":"2024-04-25T22:06:29.833171+0000","last_peered":"2024-04-25T22:06:29.833171+0000","last_clean":"2024-04-25T22:06:29.833171+0000","last_became_active":"2024-04-25T22:03:33.856638+0000","last_became_peered":"2024-04-25T22:03:33.856638+0000","last_unstale":"2024-04-25T22:06:29.833171+0000","last_undegraded":"2024-04-25T22:06:29.833171+0000","last_fullsized":"2024-04-25T22:06:29.833171+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":39774,"num_write":433,"num_write_kb":80294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'556","reported_seq":706,"reported_epoch":95,"state":"peering","last_fresh":"2024-04-25T22:06:27.110576+0000","last_change":"2024-04-25T22:06:30.134719+0000","last_active":"2024-04-25T22:06:30.134719+0000","last_peered":"2024-04-25T22:06:27.110576+0000","last_clean":"2024-04-25T22:06:27.110576+0000","last_became_active":"2024-04-25T22:06:23.113817+0000","last_became_peered":"2024-04-25T22:06:23.113817+0000","last_unstale":"2024-04-25T22:06:27.110576+0000","last_undegraded":"2024-04-25T22:06:27.110576+0000","last_fullsized":"2024-04-25T22:06:27.110576+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":509,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"76'413","reported_seq":575,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.133059+0000","last_change":"2024-04-25T22:06:23.129627+0000","last_active":"2024-04-25T22:06:30.133059+0000","last_peered":"2024-04-25T22:06:30.133059+0000","last_clean":"2024-04-25T22:06:30.133059+0000","last_became_active":"2024-04-25T22:06:23.108199+0000","last_became_peered":"2024-04-25T22:06:23.108199+0000","last_unstale":"2024-04-25T22:06:30.133059+0000","last_undegraded":"2024-04-25T22:06:30.133059+0000","last_fullsized":"2024-04-25T22:06:30.133059+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:23.828740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4858,"num_write":378,"num_write_kb":46741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"76'66","reported_seq":69,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.135417+0000","last_change":"2024-04-25T22:02:42.844584+0000","last_active":"2024-04-25T22:01:12.587237+0000","last_peered":"2024-04-25T22:01:12.587237+0000","last_clean":"2024-04-25T22:01:12.587237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:06:30.135417+0000","last_undegraded":"2024-04-25T22:06:30.135417+0000","last_fullsized":"2024-04-25T22:06:30.135417+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"76'489","reported_seq":727,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842038+0000","last_change":"2024-04-25T22:06:22.838952+0000","last_active":"2024-04-25T22:06:29.842038+0000","last_peered":"2024-04-25T22:06:29.842038+0000","last_clean":"2024-04-25T22:06:29.842038+0000","last_became_active":"2024-04-25T22:06:22.832394+0000","last_became_peered":"2024-04-25T22:06:22.832394+0000","last_unstale":"2024-04-25T22:06:29.842038+0000","last_undegraded":"2024-04-25T22:06:29.842038+0000","last_fullsized":"2024-04-25T22:06:29.842038+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:04:38.988916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":26829,"num_write":457,"num_write_kb":137840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"75'193","reported_seq":375,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842334+0000","last_change":"2024-04-25T22:06:22.838157+0000","last_active":"2024-04-25T22:06:29.842334+0000","last_peered":"2024-04-25T22:06:29.842334+0000","last_clean":"2024-04-25T22:06:29.842334+0000","last_became_active":"2024-04-25T22:06:22.832572+0000","last_became_peered":"2024-04-25T22:06:22.832572+0000","last_unstale":"2024-04-25T22:06:29.842334+0000","last_undegraded":"2024-04-25T22:06:29.842334+0000","last_fullsized":"2024-04-25T22:06:29.842334+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:34.994194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'437","reported_seq":520,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.136633+0000","last_change":"2024-04-25T22:06:30.136633+0000","last_active":"2024-04-25T22:06:30.136633+0000","last_peered":"2024-04-25T22:03:46.907516+0000","last_clean":"2024-04-25T22:03:46.907516+0000","last_became_active":"2024-04-25T22:02:43.852555+0000","last_became_peered":"2024-04-25T22:02:43.852555+0000","last_unstale":"2024-04-25T22:06:30.136633+0000","last_undegraded":"2024-04-25T22:06:30.136633+0000","last_fullsized":"2024-04-25T22:06:30.136633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3720,"num_write":406,"num_write_kb":30461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"76'106","reported_seq":262,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130809+0000","last_change":"2024-04-25T22:06:23.128769+0000","last_active":"2024-04-25T22:06:30.130809+0000","last_peered":"2024-04-25T22:06:30.130809+0000","last_clean":"2024-04-25T22:06:30.130809+0000","last_became_active":"2024-04-25T22:06:23.103402+0000","last_became_peered":"2024-04-25T22:06:23.103402+0000","last_unstale":"2024-04-25T22:06:30.130809+0000","last_undegraded":"2024-04-25T22:06:30.130809+0000","last_fullsized":"2024-04-25T22:06:30.130809+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:27.137773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"76'409","reported_seq":603,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132383+0000","last_change":"2024-04-25T22:06:23.133536+0000","last_active":"2024-04-25T22:06:30.132383+0000","last_peered":"2024-04-25T22:06:30.132383+0000","last_clean":"2024-04-25T22:06:30.132383+0000","last_became_active":"2024-04-25T22:06:23.086188+0000","last_became_peered":"2024-04-25T22:06:23.086188+0000","last_unstale":"2024-04-25T22:06:30.132383+0000","last_undegraded":"2024-04-25T22:06:30.132383+0000","last_fullsized":"2024-04-25T22:06:30.132383+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:13:59.140479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19178,"num_write":380,"num_write_kb":91945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"75'51","reported_seq":180,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833864+0000","last_change":"2024-04-25T22:06:22.800659+0000","last_active":"2024-04-25T22:06:29.833864+0000","last_peered":"2024-04-25T22:06:29.833864+0000","last_clean":"2024-04-25T22:06:29.833864+0000","last_became_active":"2024-04-25T22:06:22.798779+0000","last_became_peered":"2024-04-25T22:06:22.798779+0000","last_unstale":"2024-04-25T22:06:29.833864+0000","last_undegraded":"2024-04-25T22:06:29.833864+0000","last_fullsized":"2024-04-25T22:06:29.833864+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:35.728722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"76'377","reported_seq":559,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.134856+0000","last_change":"2024-04-25T22:06:23.114225+0000","last_active":"2024-04-25T22:06:30.134856+0000","last_peered":"2024-04-25T22:06:30.134856+0000","last_clean":"2024-04-25T22:06:30.134856+0000","last_became_active":"2024-04-25T22:06:23.085799+0000","last_became_peered":"2024-04-25T22:06:23.085799+0000","last_unstale":"2024-04-25T22:06:30.134856+0000","last_undegraded":"2024-04-25T22:06:30.134856+0000","last_fullsized":"2024-04-25T22:06:30.134856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:50.484372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21517,"num_write":342,"num_write_kb":66898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"75'449","reported_seq":544,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.832974+0000","last_change":"2024-04-25T22:03:33.860386+0000","last_active":"2024-04-25T22:06:29.832974+0000","last_peered":"2024-04-25T22:06:29.832974+0000","last_clean":"2024-04-25T22:06:29.832974+0000","last_became_active":"2024-04-25T22:03:33.859539+0000","last_became_peered":"2024-04-25T22:03:33.859539+0000","last_unstale":"2024-04-25T22:06:29.832974+0000","last_undegraded":"2024-04-25T22:06:29.832974+0000","last_fullsized":"2024-04-25T22:06:29.832974+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:20.247942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'399","reported_seq":611,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842608+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:06:29.842608+0000","last_peered":"2024-04-25T22:06:29.842608+0000","last_clean":"2024-04-25T22:06:29.842608+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:06:29.842608+0000","last_undegraded":"2024-04-25T22:06:29.842608+0000","last_fullsized":"2024-04-25T22:06:29.842608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17888,"num_write":373,"num_write_kb":67556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":316,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130098+0000","last_change":"2024-04-25T22:06:23.082707+0000","last_active":"2024-04-25T22:06:30.130098+0000","last_peered":"2024-04-25T22:06:30.130098+0000","last_clean":"2024-04-25T22:06:30.130098+0000","last_became_active":"2024-04-25T22:06:23.080701+0000","last_became_peered":"2024-04-25T22:06:23.080701+0000","last_unstale":"2024-04-25T22:06:30.130098+0000","last_undegraded":"2024-04-25T22:06:30.130098+0000","last_fullsized":"2024-04-25T22:06:30.130098+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:27.088849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130852+0000","last_change":"2024-04-25T22:06:23.116373+0000","last_active":"2024-04-25T22:06:30.130852+0000","last_peered":"2024-04-25T22:06:30.130852+0000","last_clean":"2024-04-25T22:06:30.130852+0000","last_became_active":"2024-04-25T22:06:23.108984+0000","last_became_peered":"2024-04-25T22:06:23.108984+0000","last_unstale":"2024-04-25T22:06:30.130852+0000","last_undegraded":"2024-04-25T22:06:30.130852+0000","last_fullsized":"2024-04-25T22:06:30.130852+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:08.884723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"75'393","reported_seq":568,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840908+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:06:29.840908+0000","last_peered":"2024-04-25T22:06:29.840908+0000","last_clean":"2024-04-25T22:06:29.840908+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:06:29.840908+0000","last_undegraded":"2024-04-25T22:06:29.840908+0000","last_fullsized":"2024-04-25T22:06:29.840908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'463","reported_seq":666,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.134571+0000","last_change":"2024-04-25T22:06:23.133028+0000","last_active":"2024-04-25T22:06:30.134571+0000","last_peered":"2024-04-25T22:06:30.134571+0000","last_clean":"2024-04-25T22:06:30.134571+0000","last_became_active":"2024-04-25T22:06:23.082756+0000","last_became_peered":"2024-04-25T22:06:23.082756+0000","last_unstale":"2024-04-25T22:06:30.134571+0000","last_undegraded":"2024-04-25T22:06:30.134571+0000","last_fullsized":"2024-04-25T22:06:30.134571+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:24:01.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29270,"num_write":426,"num_write_kb":129367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131290+0000","last_change":"2024-04-25T22:06:23.083451+0000","last_active":"2024-04-25T22:06:30.131290+0000","last_peered":"2024-04-25T22:06:30.131290+0000","last_clean":"2024-04-25T22:06:30.131290+0000","last_became_active":"2024-04-25T22:06:23.080841+0000","last_became_peered":"2024-04-25T22:06:23.080841+0000","last_unstale":"2024-04-25T22:06:30.131290+0000","last_undegraded":"2024-04-25T22:06:30.131290+0000","last_fullsized":"2024-04-25T22:06:30.131290+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:34.605367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"76'125","reported_seq":370,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840322+0000","last_change":"2024-04-25T22:06:22.804290+0000","last_active":"2024-04-25T22:06:29.840322+0000","last_peered":"2024-04-25T22:06:29.840322+0000","last_clean":"2024-04-25T22:06:29.840322+0000","last_became_active":"2024-04-25T22:06:22.801616+0000","last_became_peered":"2024-04-25T22:06:22.801616+0000","last_unstale":"2024-04-25T22:06:29.840322+0000","last_undegraded":"2024-04-25T22:06:29.840322+0000","last_fullsized":"2024-04-25T22:06:29.840322+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:13.402747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464197,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":63,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'457","reported_seq":644,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834440+0000","last_change":"2024-04-25T22:03:05.702224+0000","last_active":"2024-04-25T22:06:29.834440+0000","last_peered":"2024-04-25T22:06:29.834440+0000","last_clean":"2024-04-25T22:06:29.834440+0000","last_became_active":"2024-04-25T22:03:05.699581+0000","last_became_peered":"2024-04-25T22:03:05.699581+0000","last_unstale":"2024-04-25T22:06:29.834440+0000","last_undegraded":"2024-04-25T22:06:29.834440+0000","last_fullsized":"2024-04-25T22:06:29.834440+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":34759,"num_write":424,"num_write_kb":71902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840807+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:06:29.840807+0000","last_peered":"2024-04-25T22:06:29.840807+0000","last_clean":"2024-04-25T22:06:29.840807+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:06:29.840807+0000","last_undegraded":"2024-04-25T22:06:29.840807+0000","last_fullsized":"2024-04-25T22:06:29.840807+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"75'311","reported_seq":494,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833232+0000","last_change":"2024-04-25T22:06:22.801481+0000","last_active":"2024-04-25T22:06:29.833232+0000","last_peered":"2024-04-25T22:06:29.833232+0000","last_clean":"2024-04-25T22:06:29.833232+0000","last_became_active":"2024-04-25T22:06:22.794841+0000","last_became_peered":"2024-04-25T22:06:22.794841+0000","last_unstale":"2024-04-25T22:06:29.833232+0000","last_undegraded":"2024-04-25T22:06:29.833232+0000","last_fullsized":"2024-04-25T22:06:29.833232+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:06:59.330924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"76'373","reported_seq":590,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842957+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:06:29.842957+0000","last_peered":"2024-04-25T22:06:29.842957+0000","last_clean":"2024-04-25T22:06:29.842957+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:06:29.842957+0000","last_undegraded":"2024-04-25T22:06:29.842957+0000","last_fullsized":"2024-04-25T22:06:29.842957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28273,"num_write":350,"num_write_kb":87787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130568+0000","last_change":"2024-04-25T22:06:23.129162+0000","last_active":"2024-04-25T22:06:30.130568+0000","last_peered":"2024-04-25T22:06:30.130568+0000","last_clean":"2024-04-25T22:06:30.130568+0000","last_became_active":"2024-04-25T22:06:23.106155+0000","last_became_peered":"2024-04-25T22:06:23.106155+0000","last_unstale":"2024-04-25T22:06:30.130568+0000","last_undegraded":"2024-04-25T22:06:30.130568+0000","last_fullsized":"2024-04-25T22:06:30.130568+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:30.846068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"76'75","reported_seq":69,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.133335+0000","last_change":"2024-04-25T22:02:42.841987+0000","last_active":"2024-04-25T22:01:12.587237+0000","last_peered":"2024-04-25T22:01:12.587237+0000","last_clean":"2024-04-25T22:01:12.587237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:06:30.133335+0000","last_undegraded":"2024-04-25T22:06:30.133335+0000","last_fullsized":"2024-04-25T22:06:30.133335+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"76'461","reported_seq":751,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.841997+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:06:29.841997+0000","last_peered":"2024-04-25T22:06:29.841997+0000","last_clean":"2024-04-25T22:06:29.841997+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:06:29.841997+0000","last_undegraded":"2024-04-25T22:06:29.841997+0000","last_fullsized":"2024-04-25T22:06:29.841997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":67984,"num_write":425,"num_write_kb":154741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"76'268","reported_seq":423,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131579+0000","last_change":"2024-04-25T22:06:23.134306+0000","last_active":"2024-04-25T22:06:30.131579+0000","last_peered":"2024-04-25T22:06:30.131579+0000","last_clean":"2024-04-25T22:06:30.131579+0000","last_became_active":"2024-04-25T22:06:23.122629+0000","last_became_peered":"2024-04-25T22:06:23.122629+0000","last_unstale":"2024-04-25T22:06:30.131579+0000","last_undegraded":"2024-04-25T22:06:30.131579+0000","last_fullsized":"2024-04-25T22:06:30.131579+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:41.205934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842322+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:06:29.842322+0000","last_peered":"2024-04-25T22:06:29.842322+0000","last_clean":"2024-04-25T22:06:29.842322+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:06:29.842322+0000","last_undegraded":"2024-04-25T22:06:29.842322+0000","last_fullsized":"2024-04-25T22:06:29.842322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'398","reported_seq":576,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833710+0000","last_change":"2024-04-25T22:06:22.797468+0000","last_active":"2024-04-25T22:06:29.833710+0000","last_peered":"2024-04-25T22:06:29.833710+0000","last_clean":"2024-04-25T22:06:29.833710+0000","last_became_active":"2024-04-25T22:06:22.789384+0000","last_became_peered":"2024-04-25T22:06:22.789384+0000","last_unstale":"2024-04-25T22:06:29.833710+0000","last_undegraded":"2024-04-25T22:06:29.833710+0000","last_fullsized":"2024-04-25T22:06:29.833710+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:35.557386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":26599,"num_write":366,"num_write_kb":75612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"76'47","reported_seq":222,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842239+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:06:29.842239+0000","last_peered":"2024-04-25T22:06:29.842239+0000","last_clean":"2024-04-25T22:06:29.842239+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:06:29.842239+0000","last_undegraded":"2024-04-25T22:06:29.842239+0000","last_fullsized":"2024-04-25T22:06:29.842239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.837080+0000","last_change":"2024-04-25T22:03:05.701809+0000","last_active":"2024-04-25T22:06:29.837080+0000","last_peered":"2024-04-25T22:06:29.837080+0000","last_clean":"2024-04-25T22:06:29.837080+0000","last_became_active":"2024-04-25T22:03:05.701322+0000","last_became_peered":"2024-04-25T22:03:05.701322+0000","last_unstale":"2024-04-25T22:06:29.837080+0000","last_undegraded":"2024-04-25T22:06:29.837080+0000","last_fullsized":"2024-04-25T22:06:29.837080+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:45.907458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"76'406","reported_seq":640,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833959+0000","last_change":"2024-04-25T22:06:22.802683+0000","last_active":"2024-04-25T22:06:29.833959+0000","last_peered":"2024-04-25T22:06:29.833959+0000","last_clean":"2024-04-25T22:06:29.833959+0000","last_became_active":"2024-04-25T22:06:22.789807+0000","last_became_peered":"2024-04-25T22:06:22.789807+0000","last_unstale":"2024-04-25T22:06:29.833959+0000","last_undegraded":"2024-04-25T22:06:29.833959+0000","last_fullsized":"2024-04-25T22:06:29.833959+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:15.180532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25634,"num_write":377,"num_write_kb":103970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"76'64","reported_seq":239,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.843535+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:06:29.843535+0000","last_peered":"2024-04-25T22:06:29.843535+0000","last_clean":"2024-04-25T22:06:29.843535+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:06:29.843535+0000","last_undegraded":"2024-04-25T22:06:29.843535+0000","last_fullsized":"2024-04-25T22:06:29.843535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132057+0000","last_change":"2024-04-25T22:06:24.092672+0000","last_active":"2024-04-25T22:06:30.132057+0000","last_peered":"2024-04-25T22:06:30.132057+0000","last_clean":"2024-04-25T22:06:30.132057+0000","last_became_active":"2024-04-25T22:06:24.091909+0000","last_became_peered":"2024-04-25T22:06:24.091909+0000","last_unstale":"2024-04-25T22:06:30.132057+0000","last_undegraded":"2024-04-25T22:06:30.132057+0000","last_fullsized":"2024-04-25T22:06:30.132057+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:19:21.605435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"76'402","reported_seq":603,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840799+0000","last_change":"2024-04-25T22:06:22.809713+0000","last_active":"2024-04-25T22:06:29.840799+0000","last_peered":"2024-04-25T22:06:29.840799+0000","last_clean":"2024-04-25T22:06:29.840799+0000","last_became_active":"2024-04-25T22:06:22.802005+0000","last_became_peered":"2024-04-25T22:06:22.802005+0000","last_unstale":"2024-04-25T22:06:29.840799+0000","last_undegraded":"2024-04-25T22:06:29.840799+0000","last_fullsized":"2024-04-25T22:06:29.840799+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9572,"num_write":361,"num_write_kb":29911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"77'127","reported_seq":309,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.843126+0000","last_change":"2024-04-25T22:06:22.804851+0000","last_active":"2024-04-25T22:06:29.843126+0000","last_peered":"2024-04-25T22:06:29.843126+0000","last_clean":"2024-04-25T22:06:29.843126+0000","last_became_active":"2024-04-25T22:06:22.802083+0000","last_became_peered":"2024-04-25T22:06:22.802083+0000","last_unstale":"2024-04-25T22:06:29.843126+0000","last_undegraded":"2024-04-25T22:06:29.843126+0000","last_fullsized":"2024-04-25T22:06:29.843126+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131963+0000","last_change":"2024-04-25T22:06:23.081230+0000","last_active":"2024-04-25T22:06:30.131963+0000","last_peered":"2024-04-25T22:06:30.131963+0000","last_clean":"2024-04-25T22:06:30.131963+0000","last_became_active":"2024-04-25T22:06:23.080393+0000","last_became_peered":"2024-04-25T22:06:23.080393+0000","last_unstale":"2024-04-25T22:06:30.131963+0000","last_undegraded":"2024-04-25T22:06:30.131963+0000","last_fullsized":"2024-04-25T22:06:30.131963+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:55.157159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"76'415","reported_seq":594,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.833189+0000","last_change":"2024-04-25T22:06:22.801327+0000","last_active":"2024-04-25T22:06:29.833189+0000","last_peered":"2024-04-25T22:06:29.833189+0000","last_clean":"2024-04-25T22:06:29.833189+0000","last_became_active":"2024-04-25T22:06:22.789624+0000","last_became_peered":"2024-04-25T22:06:22.789624+0000","last_unstale":"2024-04-25T22:06:29.833189+0000","last_undegraded":"2024-04-25T22:06:29.833189+0000","last_fullsized":"2024-04-25T22:06:29.833189+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27345,"num_write":384,"num_write_kb":92854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"76'407","reported_seq":621,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.133739+0000","last_change":"2024-04-25T22:06:23.114739+0000","last_active":"2024-04-25T22:06:30.133739+0000","last_peered":"2024-04-25T22:06:30.133739+0000","last_clean":"2024-04-25T22:06:30.133739+0000","last_became_active":"2024-04-25T22:06:23.087118+0000","last_became_peered":"2024-04-25T22:06:23.087118+0000","last_unstale":"2024-04-25T22:06:30.133739+0000","last_undegraded":"2024-04-25T22:06:30.133739+0000","last_fullsized":"2024-04-25T22:06:30.133739+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:51.191212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33923,"num_write":372,"num_write_kb":82083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"77'260","reported_seq":418,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131279+0000","last_change":"2024-04-25T22:06:23.083331+0000","last_active":"2024-04-25T22:06:30.131279+0000","last_peered":"2024-04-25T22:06:30.131279+0000","last_clean":"2024-04-25T22:06:30.131279+0000","last_became_active":"2024-04-25T22:06:23.080552+0000","last_became_peered":"2024-04-25T22:06:23.080552+0000","last_unstale":"2024-04-25T22:06:30.131279+0000","last_undegraded":"2024-04-25T22:06:30.131279+0000","last_fullsized":"2024-04-25T22:06:30.131279+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:55.928212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8470619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"76'408","reported_seq":608,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840444+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:06:29.840444+0000","last_peered":"2024-04-25T22:06:29.840444+0000","last_clean":"2024-04-25T22:06:29.840444+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:06:29.840444+0000","last_undegraded":"2024-04-25T22:06:29.840444+0000","last_fullsized":"2024-04-25T22:06:29.840444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14178,"num_write":370,"num_write_kb":58735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'104","reported_seq":287,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.836892+0000","last_change":"2024-04-25T22:06:22.805389+0000","last_active":"2024-04-25T22:06:29.836892+0000","last_peered":"2024-04-25T22:06:29.836892+0000","last_clean":"2024-04-25T22:06:29.836892+0000","last_became_active":"2024-04-25T22:06:22.802667+0000","last_became_peered":"2024-04-25T22:06:22.802667+0000","last_unstale":"2024-04-25T22:06:29.836892+0000","last_undegraded":"2024-04-25T22:06:29.836892+0000","last_fullsized":"2024-04-25T22:06:29.836892+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:38.785650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"75'232","reported_seq":278,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.134307+0000","last_change":"2024-04-25T22:06:30.134307+0000","last_active":"2024-04-25T22:06:30.134307+0000","last_peered":"2024-04-25T22:03:41.622809+0000","last_clean":"2024-04-25T22:03:41.622809+0000","last_became_active":"2024-04-25T22:02:43.852292+0000","last_became_peered":"2024-04-25T22:02:43.852292+0000","last_unstale":"2024-04-25T22:06:30.134307+0000","last_undegraded":"2024-04-25T22:06:30.134307+0000","last_fullsized":"2024-04-25T22:06:30.134307+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"76'483","reported_seq":711,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840024+0000","last_change":"2024-04-25T22:06:22.814119+0000","last_active":"2024-04-25T22:06:29.840024+0000","last_peered":"2024-04-25T22:06:29.840024+0000","last_clean":"2024-04-25T22:06:29.840024+0000","last_became_active":"2024-04-25T22:06:22.807584+0000","last_became_peered":"2024-04-25T22:06:22.807584+0000","last_unstale":"2024-04-25T22:06:29.840024+0000","last_undegraded":"2024-04-25T22:06:29.840024+0000","last_fullsized":"2024-04-25T22:06:29.840024+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:08.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24709,"num_write":463,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"75'60","reported_seq":242,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.843285+0000","last_change":"2024-04-25T22:06:22.802356+0000","last_active":"2024-04-25T22:06:29.843285+0000","last_peered":"2024-04-25T22:06:29.843285+0000","last_clean":"2024-04-25T22:06:29.843285+0000","last_became_active":"2024-04-25T22:06:22.801412+0000","last_became_peered":"2024-04-25T22:06:22.801412+0000","last_unstale":"2024-04-25T22:06:29.843285+0000","last_undegraded":"2024-04-25T22:06:29.843285+0000","last_fullsized":"2024-04-25T22:06:29.843285+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:04.421952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'444","reported_seq":646,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840735+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:06:29.840735+0000","last_peered":"2024-04-25T22:06:29.840735+0000","last_clean":"2024-04-25T22:06:29.840735+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:06:29.840735+0000","last_undegraded":"2024-04-25T22:06:29.840735+0000","last_fullsized":"2024-04-25T22:06:29.840735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14429,"num_write":416,"num_write_kb":59186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'355","reported_seq":497,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835185+0000","last_change":"2024-04-25T22:06:22.804579+0000","last_active":"2024-04-25T22:06:29.835185+0000","last_peered":"2024-04-25T22:06:29.835185+0000","last_clean":"2024-04-25T22:06:29.835185+0000","last_became_active":"2024-04-25T22:06:22.792886+0000","last_became_peered":"2024-04-25T22:06:22.792886+0000","last_unstale":"2024-04-25T22:06:29.835185+0000","last_undegraded":"2024-04-25T22:06:29.835185+0000","last_fullsized":"2024-04-25T22:06:29.835185+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:54:35.464321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18236,"num_write":332,"num_write_kb":42553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"76'742","reported_seq":917,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.841034+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:06:29.841034+0000","last_peered":"2024-04-25T22:06:29.841034+0000","last_clean":"2024-04-25T22:06:29.841034+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:06:29.841034+0000","last_undegraded":"2024-04-25T22:06:29.841034+0000","last_fullsized":"2024-04-25T22:06:29.841034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'378","reported_seq":577,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842615+0000","last_change":"2024-04-25T22:06:22.813642+0000","last_active":"2024-04-25T22:06:29.842615+0000","last_peered":"2024-04-25T22:06:29.842615+0000","last_clean":"2024-04-25T22:06:29.842615+0000","last_became_active":"2024-04-25T22:06:22.806240+0000","last_became_peered":"2024-04-25T22:06:22.806240+0000","last_unstale":"2024-04-25T22:06:29.842615+0000","last_undegraded":"2024-04-25T22:06:29.842615+0000","last_fullsized":"2024-04-25T22:06:29.842615+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6876,"num_write":354,"num_write_kb":46840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"76'204","reported_seq":386,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.840254+0000","last_change":"2024-04-25T22:06:22.805022+0000","last_active":"2024-04-25T22:06:29.840254+0000","last_peered":"2024-04-25T22:06:29.840254+0000","last_clean":"2024-04-25T22:06:29.840254+0000","last_became_active":"2024-04-25T22:06:22.801630+0000","last_became_peered":"2024-04-25T22:06:22.801630+0000","last_unstale":"2024-04-25T22:06:29.840254+0000","last_undegraded":"2024-04-25T22:06:29.840254+0000","last_fullsized":"2024-04-25T22:06:29.840254+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:34.554201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'377","reported_seq":513,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.836047+0000","last_change":"2024-04-25T22:06:22.805011+0000","last_active":"2024-04-25T22:06:29.836047+0000","last_peered":"2024-04-25T22:06:29.836047+0000","last_clean":"2024-04-25T22:06:29.836047+0000","last_became_active":"2024-04-25T22:06:22.795334+0000","last_became_peered":"2024-04-25T22:06:22.795334+0000","last_unstale":"2024-04-25T22:06:29.836047+0000","last_undegraded":"2024-04-25T22:06:29.836047+0000","last_fullsized":"2024-04-25T22:06:29.836047+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:35.997378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6059,"num_write":332,"num_write_kb":37972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"76'217","reported_seq":330,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834033+0000","last_change":"2024-04-25T22:06:28.842258+0000","last_active":"2024-04-25T22:06:29.834033+0000","last_peered":"2024-04-25T22:06:29.834033+0000","last_clean":"2024-04-25T22:06:29.834033+0000","last_became_active":"2024-04-25T22:06:28.841447+0000","last_became_peered":"2024-04-25T22:06:28.841447+0000","last_unstale":"2024-04-25T22:06:29.834033+0000","last_undegraded":"2024-04-25T22:06:29.834033+0000","last_fullsized":"2024-04-25T22:06:29.834033+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:31.009167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"76'389","reported_seq":540,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.835254+0000","last_change":"2024-04-25T22:03:33.862286+0000","last_active":"2024-04-25T22:06:29.835254+0000","last_peered":"2024-04-25T22:06:29.835254+0000","last_clean":"2024-04-25T22:06:29.835254+0000","last_became_active":"2024-04-25T22:03:33.860800+0000","last_became_peered":"2024-04-25T22:03:33.860800+0000","last_unstale":"2024-04-25T22:06:29.835254+0000","last_undegraded":"2024-04-25T22:06:29.835254+0000","last_fullsized":"2024-04-25T22:06:29.835254+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:04.528174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19110,"num_write":355,"num_write_kb":63152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'51","reported_seq":124,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834507+0000","last_change":"2024-04-25T22:06:22.804880+0000","last_active":"2024-04-25T22:06:29.834507+0000","last_peered":"2024-04-25T22:06:29.834507+0000","last_clean":"2024-04-25T22:06:29.834507+0000","last_became_active":"2024-04-25T22:06:22.803778+0000","last_became_peered":"2024-04-25T22:06:22.803778+0000","last_unstale":"2024-04-25T22:06:29.834507+0000","last_undegraded":"2024-04-25T22:06:29.834507+0000","last_fullsized":"2024-04-25T22:06:29.834507+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:47:58.480071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"76'386","reported_seq":475,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.134793+0000","last_change":"2024-04-25T22:06:30.134793+0000","last_active":"2024-04-25T22:06:30.134793+0000","last_peered":"2024-04-25T22:03:46.915198+0000","last_clean":"2024-04-25T22:03:46.915198+0000","last_became_active":"2024-04-25T22:02:43.850568+0000","last_became_peered":"2024-04-25T22:02:43.850568+0000","last_unstale":"2024-04-25T22:06:30.134793+0000","last_undegraded":"2024-04-25T22:06:30.134793+0000","last_fullsized":"2024-04-25T22:06:30.134793+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14050,"num_write":362,"num_write_kb":58957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"76'188","reported_seq":223,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.132995+0000","last_change":"2024-04-25T22:06:30.132995+0000","last_active":"2024-04-25T22:06:30.132995+0000","last_peered":"2024-04-25T22:03:31.361153+0000","last_clean":"2024-04-25T22:03:31.361153+0000","last_became_active":"2024-04-25T22:02:43.852769+0000","last_became_peered":"2024-04-25T22:02:43.852769+0000","last_unstale":"2024-04-25T22:06:30.132995+0000","last_undegraded":"2024-04-25T22:06:30.132995+0000","last_fullsized":"2024-04-25T22:06:30.132995+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"76'397","reported_seq":486,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.134133+0000","last_change":"2024-04-25T22:06:30.134133+0000","last_active":"2024-04-25T22:06:30.134133+0000","last_peered":"2024-04-25T22:03:46.861730+0000","last_clean":"2024-04-25T22:03:46.861730+0000","last_became_active":"2024-04-25T22:02:43.852263+0000","last_became_peered":"2024-04-25T22:02:43.852263+0000","last_unstale":"2024-04-25T22:06:30.134133+0000","last_undegraded":"2024-04-25T22:06:30.134133+0000","last_fullsized":"2024-04-25T22:06:30.134133+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13280,"num_write":364,"num_write_kb":46108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"75'284","reported_seq":412,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.836603+0000","last_change":"2024-04-25T22:06:22.804561+0000","last_active":"2024-04-25T22:06:29.836603+0000","last_peered":"2024-04-25T22:06:29.836603+0000","last_clean":"2024-04-25T22:06:29.836603+0000","last_became_active":"2024-04-25T22:06:22.794078+0000","last_became_peered":"2024-04-25T22:06:22.794078+0000","last_unstale":"2024-04-25T22:06:29.836603+0000","last_undegraded":"2024-04-25T22:06:29.836603+0000","last_fullsized":"2024-04-25T22:06:29.836603+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:07.939379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":12398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"76'412","reported_seq":536,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.834267+0000","last_change":"2024-04-25T22:03:33.864136+0000","last_active":"2024-04-25T22:06:29.834267+0000","last_peered":"2024-04-25T22:06:29.834267+0000","last_clean":"2024-04-25T22:06:29.834267+0000","last_became_active":"2024-04-25T22:03:33.862435+0000","last_became_peered":"2024-04-25T22:03:33.862435+0000","last_unstale":"2024-04-25T22:06:29.834267+0000","last_undegraded":"2024-04-25T22:06:29.834267+0000","last_fullsized":"2024-04-25T22:06:29.834267+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:08.119964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":1478,"num_write":377,"num_write_kb":34422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"76'127","reported_seq":302,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842960+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:06:29.842960+0000","last_peered":"2024-04-25T22:06:29.842960+0000","last_clean":"2024-04-25T22:06:29.842960+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:06:29.842960+0000","last_undegraded":"2024-04-25T22:06:29.842960+0000","last_fullsized":"2024-04-25T22:06:29.842960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'444","reported_seq":644,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131585+0000","last_change":"2024-04-25T22:06:23.132900+0000","last_active":"2024-04-25T22:06:30.131585+0000","last_peered":"2024-04-25T22:06:30.131585+0000","last_clean":"2024-04-25T22:06:30.131585+0000","last_became_active":"2024-04-25T22:06:23.097535+0000","last_became_peered":"2024-04-25T22:06:23.097535+0000","last_unstale":"2024-04-25T22:06:30.131585+0000","last_undegraded":"2024-04-25T22:06:30.131585+0000","last_fullsized":"2024-04-25T22:06:30.131585+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:30:55.243414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31576,"num_write":414,"num_write_kb":70915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"75'46","reported_seq":228,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:29.842998+0000","last_change":"2024-04-25T22:06:22.802843+0000","last_active":"2024-04-25T22:06:29.842998+0000","last_peered":"2024-04-25T22:06:29.842998+0000","last_clean":"2024-04-25T22:06:29.842998+0000","last_became_active":"2024-04-25T22:06:22.801910+0000","last_became_peered":"2024-04-25T22:06:22.801910+0000","last_unstale":"2024-04-25T22:06:29.842998+0000","last_undegraded":"2024-04-25T22:06:29.842998+0000","last_fullsized":"2024-04-25T22:06:29.842998+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:23.004530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2665,"num_read_kb":1338898,"num_write":24540,"num_write_kb":4276910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26558,"ondisk_log_size":26558,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127376126,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":4662,"num_write_kb":127830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":71499776,"data_stored":254752252,"data_compressed":21836190,"data_compressed_allocated":35307520,"data_compressed_original":218619904,"omap_allocated":136586,"internal_metadata":0},"log_size":6446,"ondisk_log_size":6446,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738440,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99728,"kb_used_data":24188,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272112,"statfs":{"total":96636764160,"available":96534642688,"internally_reserved":0,"allocated":24768512,"data_stored":84959773,"data_compressed":7036839,"data_compressed_allocated":11431936,"data_compressed_original":72118272,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738439,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99420,"kb_used_data":23884,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272420,"statfs":{"total":96636764160,"available":96534958080,"internally_reserved":0,"allocated":24457216,"data_stored":81557721,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":90,"seq":386547056644,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58096,"kb_used_data":24420,"kb_used_omap":134,"kb_used_meta":33529,"kb_avail":94313744,"statfs":{"total":96636764160,"available":96577273856,"internally_reserved":0,"allocated":25006080,"data_stored":90618890,"data_compressed":7819212,"data_compressed_allocated":12599296,"data_compressed_original":78716928,"omap_allocated":138181,"internal_metadata":34333755},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24076288,"data_stored":89627390,"data_compressed":7811005,"data_compressed_allocated":12562432,"data_compressed_original":78143488,"omap_allocated":136586,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23584768,"data_stored":81156589,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23838720,"data_stored":83968273,"data_compressed":7028632,"data_compressed_allocated":11395072,"data_compressed_original":71544832,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:06:36.824 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:06:37.148 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:06:37.150 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:06:37.168 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":263,"stamp":"2024-04-25T22:06:35.689127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127966494,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2864,"num_read_kb":1340487,"num_write":29405,"num_write_kb":4408200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33161,"ondisk_log_size":33161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":257264,"kb_used_data":72516,"kb_used_omap":138,"kb_used_meta":184565,"kb_avail":282858256,"statfs":{"total":289910292480,"available":289646854144,"internally_reserved":0,"allocated":74256384,"data_stored":257145138,"data_compressed":21852604,"data_compressed_allocated":35381248,"data_compressed_original":219766784,"omap_allocated":141371,"internal_metadata":188995525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.861126"},"pg_stats":[{"pgid":"4.3f","version":"76'446","reported_seq":604,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845124+0000","last_change":"2024-04-25T22:03:33.876369+0000","last_active":"2024-04-25T22:06:30.845124+0000","last_peered":"2024-04-25T22:06:30.845124+0000","last_clean":"2024-04-25T22:06:30.845124+0000","last_became_active":"2024-04-25T22:03:33.873739+0000","last_became_peered":"2024-04-25T22:03:33.873739+0000","last_unstale":"2024-04-25T22:06:30.845124+0000","last_undegraded":"2024-04-25T22:06:30.845124+0000","last_fullsized":"2024-04-25T22:06:30.845124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:32.529707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29432,"num_write":407,"num_write_kb":84235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"76'417","reported_seq":570,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844117+0000","last_change":"2024-04-25T22:03:33.861269+0000","last_active":"2024-04-25T22:06:30.844117+0000","last_peered":"2024-04-25T22:06:30.844117+0000","last_clean":"2024-04-25T22:06:30.844117+0000","last_became_active":"2024-04-25T22:03:33.859221+0000","last_became_peered":"2024-04-25T22:03:33.859221+0000","last_unstale":"2024-04-25T22:06:30.844117+0000","last_undegraded":"2024-04-25T22:06:30.844117+0000","last_fullsized":"2024-04-25T22:06:30.844117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:23:44.690527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":23541,"num_write":389,"num_write_kb":87654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"76'389","reported_seq":550,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.136427+0000","last_change":"2024-04-25T22:06:30.136427+0000","last_active":"2024-04-25T22:06:30.136427+0000","last_peered":"2024-04-25T22:03:46.909574+0000","last_clean":"2024-04-25T22:03:46.909574+0000","last_became_active":"2024-04-25T22:03:33.863788+0000","last_became_peered":"2024-04-25T22:03:33.863788+0000","last_unstale":"2024-04-25T22:06:30.136427+0000","last_undegraded":"2024-04-25T22:06:30.136427+0000","last_fullsized":"2024-04-25T22:06:30.136427+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22311,"num_write":361,"num_write_kb":42975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"76'394","reported_seq":586,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.133476+0000","last_change":"2024-04-25T22:06:23.123256+0000","last_active":"2024-04-25T22:06:30.133476+0000","last_peered":"2024-04-25T22:06:30.133476+0000","last_clean":"2024-04-25T22:06:30.133476+0000","last_became_active":"2024-04-25T22:06:23.090780+0000","last_became_peered":"2024-04-25T22:06:23.090780+0000","last_unstale":"2024-04-25T22:06:30.133476+0000","last_undegraded":"2024-04-25T22:06:30.133476+0000","last_fullsized":"2024-04-25T22:06:30.133476+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:57.110628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":20785,"num_write":367,"num_write_kb":63746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"76'429","reported_seq":940,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844371+0000","last_change":"2024-04-25T22:06:28.839715+0000","last_active":"2024-04-25T22:06:30.844371+0000","last_peered":"2024-04-25T22:06:30.844371+0000","last_clean":"2024-04-25T22:06:30.844371+0000","last_became_active":"2024-04-25T22:06:28.836687+0000","last_became_peered":"2024-04-25T22:06:28.836687+0000","last_unstale":"2024-04-25T22:06:30.844371+0000","last_undegraded":"2024-04-25T22:06:30.844371+0000","last_fullsized":"2024-04-25T22:06:30.844371+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:10.175157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":20896,"num_write":403,"num_write_kb":100255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"76'368","reported_seq":540,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132775+0000","last_change":"2024-04-25T22:06:23.129617+0000","last_active":"2024-04-25T22:06:30.132775+0000","last_peered":"2024-04-25T22:06:30.132775+0000","last_clean":"2024-04-25T22:06:30.132775+0000","last_became_active":"2024-04-25T22:06:23.107939+0000","last_became_peered":"2024-04-25T22:06:23.107939+0000","last_unstale":"2024-04-25T22:06:30.132775+0000","last_undegraded":"2024-04-25T22:06:30.132775+0000","last_fullsized":"2024-04-25T22:06:30.132775+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:24.183902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9362,"num_write":344,"num_write_kb":20831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"76'438","reported_seq":636,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131211+0000","last_change":"2024-04-25T22:06:23.123861+0000","last_active":"2024-04-25T22:06:30.131211+0000","last_peered":"2024-04-25T22:06:30.131211+0000","last_clean":"2024-04-25T22:06:30.131211+0000","last_became_active":"2024-04-25T22:06:23.098436+0000","last_became_peered":"2024-04-25T22:06:23.098436+0000","last_unstale":"2024-04-25T22:06:30.131211+0000","last_undegraded":"2024-04-25T22:06:30.131211+0000","last_fullsized":"2024-04-25T22:06:30.131211+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:35.433423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25961,"num_write":415,"num_write_kb":72541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'392","reported_seq":600,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130666+0000","last_change":"2024-04-25T22:06:23.128274+0000","last_active":"2024-04-25T22:06:30.130666+0000","last_peered":"2024-04-25T22:06:30.130666+0000","last_clean":"2024-04-25T22:06:30.130666+0000","last_became_active":"2024-04-25T22:06:23.091431+0000","last_became_peered":"2024-04-25T22:06:23.091431+0000","last_unstale":"2024-04-25T22:06:30.130666+0000","last_undegraded":"2024-04-25T22:06:30.130666+0000","last_fullsized":"2024-04-25T22:06:30.130666+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:48.206131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":24749,"num_write":354,"num_write_kb":64232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"76'443","reported_seq":651,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850489+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:06:30.850489+0000","last_peered":"2024-04-25T22:06:30.850489+0000","last_clean":"2024-04-25T22:06:30.850489+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:06:30.850489+0000","last_undegraded":"2024-04-25T22:06:30.850489+0000","last_fullsized":"2024-04-25T22:06:30.850489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":10648,"num_write":411,"num_write_kb":92932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'392","reported_seq":509,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131757+0000","last_change":"2024-04-25T22:06:26.120464+0000","last_active":"2024-04-25T22:06:30.131757+0000","last_peered":"2024-04-25T22:06:30.131757+0000","last_clean":"2024-04-25T22:06:30.131757+0000","last_became_active":"2024-04-25T22:06:26.114463+0000","last_became_peered":"2024-04-25T22:06:26.114463+0000","last_unstale":"2024-04-25T22:06:30.131757+0000","last_undegraded":"2024-04-25T22:06:30.131757+0000","last_fullsized":"2024-04-25T22:06:30.131757+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:37:54.870762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10696,"num_write":359,"num_write_kb":63259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'391","reported_seq":567,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.135469+0000","last_change":"2024-04-25T22:06:23.135020+0000","last_active":"2024-04-25T22:06:30.135469+0000","last_peered":"2024-04-25T22:06:30.135469+0000","last_clean":"2024-04-25T22:06:30.135469+0000","last_became_active":"2024-04-25T22:06:23.123801+0000","last_became_peered":"2024-04-25T22:06:23.123801+0000","last_unstale":"2024-04-25T22:06:30.135469+0000","last_undegraded":"2024-04-25T22:06:30.135469+0000","last_fullsized":"2024-04-25T22:06:30.135469+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:11:44.607123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11259,"num_write":372,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"76'365","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843898+0000","last_change":"2024-04-25T22:06:22.802947+0000","last_active":"2024-04-25T22:06:30.843898+0000","last_peered":"2024-04-25T22:06:30.843898+0000","last_clean":"2024-04-25T22:06:30.843898+0000","last_became_active":"2024-04-25T22:06:22.792880+0000","last_became_peered":"2024-04-25T22:06:22.792880+0000","last_unstale":"2024-04-25T22:06:30.843898+0000","last_undegraded":"2024-04-25T22:06:30.843898+0000","last_fullsized":"2024-04-25T22:06:30.843898+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":51972,"num_write":340,"num_write_kb":51203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"76'420","reported_seq":574,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843505+0000","last_change":"2024-04-25T22:03:33.866815+0000","last_active":"2024-04-25T22:06:30.843505+0000","last_peered":"2024-04-25T22:06:30.843505+0000","last_clean":"2024-04-25T22:06:30.843505+0000","last_became_active":"2024-04-25T22:03:33.859376+0000","last_became_peered":"2024-04-25T22:03:33.859376+0000","last_unstale":"2024-04-25T22:06:30.843505+0000","last_undegraded":"2024-04-25T22:06:30.843505+0000","last_fullsized":"2024-04-25T22:06:30.843505+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:08.620311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17620,"num_write":386,"num_write_kb":100613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"76'432","reported_seq":629,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132417+0000","last_change":"2024-04-25T22:06:23.128788+0000","last_active":"2024-04-25T22:06:30.132417+0000","last_peered":"2024-04-25T22:06:30.132417+0000","last_clean":"2024-04-25T22:06:30.132417+0000","last_became_active":"2024-04-25T22:06:23.081466+0000","last_became_peered":"2024-04-25T22:06:23.081466+0000","last_unstale":"2024-04-25T22:06:30.132417+0000","last_undegraded":"2024-04-25T22:06:30.132417+0000","last_fullsized":"2024-04-25T22:06:30.132417+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:15.042731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27327,"num_write":398,"num_write_kb":76113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"76'385","reported_seq":582,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131043+0000","last_change":"2024-04-25T22:06:23.116284+0000","last_active":"2024-04-25T22:06:30.131043+0000","last_peered":"2024-04-25T22:06:30.131043+0000","last_clean":"2024-04-25T22:06:30.131043+0000","last_became_active":"2024-04-25T22:06:23.088046+0000","last_became_peered":"2024-04-25T22:06:23.088046+0000","last_unstale":"2024-04-25T22:06:30.131043+0000","last_undegraded":"2024-04-25T22:06:30.131043+0000","last_fullsized":"2024-04-25T22:06:30.131043+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:40:35.110567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23986,"num_write":352,"num_write_kb":50754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"76'434","reported_seq":613,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131878+0000","last_change":"2024-04-25T22:06:23.132996+0000","last_active":"2024-04-25T22:06:30.131878+0000","last_peered":"2024-04-25T22:06:30.131878+0000","last_clean":"2024-04-25T22:06:30.131878+0000","last_became_active":"2024-04-25T22:06:23.117497+0000","last_became_peered":"2024-04-25T22:06:23.117497+0000","last_unstale":"2024-04-25T22:06:30.131878+0000","last_undegraded":"2024-04-25T22:06:30.131878+0000","last_fullsized":"2024-04-25T22:06:30.131878+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:30.022312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":13806,"num_write":403,"num_write_kb":38995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"76'444","reported_seq":658,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851797+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:06:30.851797+0000","last_peered":"2024-04-25T22:06:30.851797+0000","last_clean":"2024-04-25T22:06:30.851797+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:06:30.851797+0000","last_undegraded":"2024-04-25T22:06:30.851797+0000","last_fullsized":"2024-04-25T22:06:30.851797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":11085,"num_write":416,"num_write_kb":68377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'396","reported_seq":531,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844593+0000","last_change":"2024-04-25T22:03:33.862762+0000","last_active":"2024-04-25T22:06:30.844593+0000","last_peered":"2024-04-25T22:06:30.844593+0000","last_clean":"2024-04-25T22:06:30.844593+0000","last_became_active":"2024-04-25T22:03:33.861082+0000","last_became_peered":"2024-04-25T22:03:33.861082+0000","last_unstale":"2024-04-25T22:06:30.844593+0000","last_undegraded":"2024-04-25T22:06:30.844593+0000","last_fullsized":"2024-04-25T22:06:30.844593+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:15.823113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6581,"num_write":355,"num_write_kb":34159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"76'447","reported_seq":648,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850341+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:06:30.850341+0000","last_peered":"2024-04-25T22:06:30.850341+0000","last_clean":"2024-04-25T22:06:30.850341+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:06:30.850341+0000","last_undegraded":"2024-04-25T22:06:30.850341+0000","last_fullsized":"2024-04-25T22:06:30.850341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22089,"num_write":411,"num_write_kb":104750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'426","reported_seq":602,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.135373+0000","last_change":"2024-04-25T22:06:23.122769+0000","last_active":"2024-04-25T22:06:30.135373+0000","last_peered":"2024-04-25T22:06:30.135373+0000","last_clean":"2024-04-25T22:06:30.135373+0000","last_became_active":"2024-04-25T22:06:23.093379+0000","last_became_peered":"2024-04-25T22:06:23.093379+0000","last_unstale":"2024-04-25T22:06:30.135373+0000","last_undegraded":"2024-04-25T22:06:30.135373+0000","last_fullsized":"2024-04-25T22:06:30.135373+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:48.070891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11886,"num_write":398,"num_write_kb":55010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"76'405","reported_seq":600,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.134314+0000","last_change":"2024-04-25T22:06:23.129396+0000","last_active":"2024-04-25T22:06:30.134314+0000","last_peered":"2024-04-25T22:06:30.134314+0000","last_clean":"2024-04-25T22:06:30.134314+0000","last_became_active":"2024-04-25T22:06:23.110101+0000","last_became_peered":"2024-04-25T22:06:23.110101+0000","last_unstale":"2024-04-25T22:06:30.134314+0000","last_undegraded":"2024-04-25T22:06:30.134314+0000","last_fullsized":"2024-04-25T22:06:30.134314+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:40.218610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23004,"num_write":370,"num_write_kb":75802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'436","reported_seq":559,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843341+0000","last_change":"2024-04-25T22:06:28.838562+0000","last_active":"2024-04-25T22:06:30.843341+0000","last_peered":"2024-04-25T22:06:30.843341+0000","last_clean":"2024-04-25T22:06:30.843341+0000","last_became_active":"2024-04-25T22:06:28.835081+0000","last_became_peered":"2024-04-25T22:06:28.835081+0000","last_unstale":"2024-04-25T22:06:30.843341+0000","last_undegraded":"2024-04-25T22:06:30.843341+0000","last_fullsized":"2024-04-25T22:06:30.843341+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:15:18.057041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11950,"num_write":408,"num_write_kb":67524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"76'403","reported_seq":607,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.847686+0000","last_change":"2024-04-25T22:06:22.810930+0000","last_active":"2024-04-25T22:06:30.847686+0000","last_peered":"2024-04-25T22:06:30.847686+0000","last_clean":"2024-04-25T22:06:30.847686+0000","last_became_active":"2024-04-25T22:06:22.802907+0000","last_became_peered":"2024-04-25T22:06:22.802907+0000","last_unstale":"2024-04-25T22:06:30.847686+0000","last_undegraded":"2024-04-25T22:06:30.847686+0000","last_fullsized":"2024-04-25T22:06:30.847686+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:00.334109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":6507,"num_write":370,"num_write_kb":51513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'449","reported_seq":574,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842684+0000","last_change":"2024-04-25T22:06:28.846531+0000","last_active":"2024-04-25T22:06:30.842684+0000","last_peered":"2024-04-25T22:06:30.842684+0000","last_clean":"2024-04-25T22:06:30.842684+0000","last_became_active":"2024-04-25T22:06:28.841283+0000","last_became_peered":"2024-04-25T22:06:28.841283+0000","last_unstale":"2024-04-25T22:06:30.842684+0000","last_undegraded":"2024-04-25T22:06:30.842684+0000","last_fullsized":"2024-04-25T22:06:30.842684+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:02.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27047,"num_write":417,"num_write_kb":63386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"76'406","reported_seq":571,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845286+0000","last_change":"2024-04-25T22:06:22.801634+0000","last_active":"2024-04-25T22:06:30.845286+0000","last_peered":"2024-04-25T22:06:30.845286+0000","last_clean":"2024-04-25T22:06:30.845286+0000","last_became_active":"2024-04-25T22:06:22.791470+0000","last_became_peered":"2024-04-25T22:06:22.791470+0000","last_unstale":"2024-04-25T22:06:30.845286+0000","last_undegraded":"2024-04-25T22:06:30.845286+0000","last_fullsized":"2024-04-25T22:06:30.845286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:25.424659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25550,"num_write":386,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"76'485","reported_seq":735,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850945+0000","last_change":"2024-04-25T22:06:22.814124+0000","last_active":"2024-04-25T22:06:30.850945+0000","last_peered":"2024-04-25T22:06:30.850945+0000","last_clean":"2024-04-25T22:06:30.850945+0000","last_became_active":"2024-04-25T22:06:22.804228+0000","last_became_peered":"2024-04-25T22:06:22.804228+0000","last_unstale":"2024-04-25T22:06:30.850945+0000","last_undegraded":"2024-04-25T22:06:30.850945+0000","last_fullsized":"2024-04-25T22:06:30.850945+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":30714,"num_write":444,"num_write_kb":92836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'387","reported_seq":590,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.135315+0000","last_change":"2024-04-25T22:06:23.134971+0000","last_active":"2024-04-25T22:06:30.135315+0000","last_peered":"2024-04-25T22:06:30.135315+0000","last_clean":"2024-04-25T22:06:30.135315+0000","last_became_active":"2024-04-25T22:06:23.121334+0000","last_became_peered":"2024-04-25T22:06:23.121334+0000","last_unstale":"2024-04-25T22:06:30.135315+0000","last_undegraded":"2024-04-25T22:06:30.135315+0000","last_fullsized":"2024-04-25T22:06:30.135315+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:03.991336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21644,"num_write":354,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"76'405","reported_seq":649,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844816+0000","last_change":"2024-04-25T22:06:22.829889+0000","last_active":"2024-04-25T22:06:30.844816+0000","last_peered":"2024-04-25T22:06:30.844816+0000","last_clean":"2024-04-25T22:06:30.844816+0000","last_became_active":"2024-04-25T22:06:22.827066+0000","last_became_peered":"2024-04-25T22:06:22.827066+0000","last_unstale":"2024-04-25T22:06:30.844816+0000","last_undegraded":"2024-04-25T22:06:30.844816+0000","last_fullsized":"2024-04-25T22:06:30.844816+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:01.822252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27522,"num_write":375,"num_write_kb":96416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"76'396","reported_seq":619,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850059+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:06:30.850059+0000","last_peered":"2024-04-25T22:06:30.850059+0000","last_clean":"2024-04-25T22:06:30.850059+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:06:30.850059+0000","last_undegraded":"2024-04-25T22:06:30.850059+0000","last_fullsized":"2024-04-25T22:06:30.850059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28501,"num_write":367,"num_write_kb":63458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":654,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843955+0000","last_change":"2024-04-25T22:06:22.803787+0000","last_active":"2024-04-25T22:06:30.843955+0000","last_peered":"2024-04-25T22:06:30.843955+0000","last_clean":"2024-04-25T22:06:30.843955+0000","last_became_active":"2024-04-25T22:06:22.789907+0000","last_became_peered":"2024-04-25T22:06:22.789907+0000","last_unstale":"2024-04-25T22:06:30.843955+0000","last_undegraded":"2024-04-25T22:06:30.843955+0000","last_fullsized":"2024-04-25T22:06:30.843955+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":20717,"num_write":435,"num_write_kb":55985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"76'444","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848333+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:06:30.848333+0000","last_peered":"2024-04-25T22:06:30.848333+0000","last_clean":"2024-04-25T22:06:30.848333+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:06:30.848333+0000","last_undegraded":"2024-04-25T22:06:30.848333+0000","last_fullsized":"2024-04-25T22:06:30.848333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":10758,"num_write":401,"num_write_kb":44705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'422","reported_seq":525,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.131754+0000","last_change":"2024-04-25T22:06:30.131754+0000","last_active":"2024-04-25T22:06:30.131754+0000","last_peered":"2024-04-25T22:03:46.918292+0000","last_clean":"2024-04-25T22:03:46.918292+0000","last_became_active":"2024-04-25T22:02:43.850651+0000","last_became_peered":"2024-04-25T22:02:43.850651+0000","last_unstale":"2024-04-25T22:06:30.131754+0000","last_undegraded":"2024-04-25T22:06:30.131754+0000","last_fullsized":"2024-04-25T22:06:30.131754+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":29059,"num_write":391,"num_write_kb":40233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"76'397","reported_seq":894,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844568+0000","last_change":"2024-04-25T22:06:26.819859+0000","last_active":"2024-04-25T22:06:30.844568+0000","last_peered":"2024-04-25T22:06:30.844568+0000","last_clean":"2024-04-25T22:06:30.844568+0000","last_became_active":"2024-04-25T22:06:26.816439+0000","last_became_peered":"2024-04-25T22:06:26.816439+0000","last_unstale":"2024-04-25T22:06:30.844568+0000","last_undegraded":"2024-04-25T22:06:30.844568+0000","last_fullsized":"2024-04-25T22:06:30.844568+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:44.452918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28857,"num_write":363,"num_write_kb":87969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"75'515","reported_seq":669,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132386+0000","last_change":"2024-04-25T22:06:23.117492+0000","last_active":"2024-04-25T22:06:30.132386+0000","last_peered":"2024-04-25T22:06:30.132386+0000","last_clean":"2024-04-25T22:06:30.132386+0000","last_became_active":"2024-04-25T22:06:23.109665+0000","last_became_peered":"2024-04-25T22:06:23.109665+0000","last_unstale":"2024-04-25T22:06:30.132386+0000","last_undegraded":"2024-04-25T22:06:30.132386+0000","last_fullsized":"2024-04-25T22:06:30.132386+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:01.482888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"76'375","reported_seq":481,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845202+0000","last_change":"2024-04-25T22:06:28.846182+0000","last_active":"2024-04-25T22:06:30.845202+0000","last_peered":"2024-04-25T22:06:30.845202+0000","last_clean":"2024-04-25T22:06:30.845202+0000","last_became_active":"2024-04-25T22:06:28.841545+0000","last_became_peered":"2024-04-25T22:06:28.841545+0000","last_unstale":"2024-04-25T22:06:30.845202+0000","last_undegraded":"2024-04-25T22:06:30.845202+0000","last_fullsized":"2024-04-25T22:06:30.845202+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.018915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14983,"num_write":339,"num_write_kb":46748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'53","reported_seq":237,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849016+0000","last_change":"2024-04-25T22:06:22.839083+0000","last_active":"2024-04-25T22:06:30.849016+0000","last_peered":"2024-04-25T22:06:30.849016+0000","last_clean":"2024-04-25T22:06:30.849016+0000","last_became_active":"2024-04-25T22:06:22.833424+0000","last_became_peered":"2024-04-25T22:06:22.833424+0000","last_unstale":"2024-04-25T22:06:30.849016+0000","last_undegraded":"2024-04-25T22:06:30.849016+0000","last_fullsized":"2024-04-25T22:06:30.849016+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:00.819067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'426","reported_seq":639,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851784+0000","last_change":"2024-04-25T22:06:26.822923+0000","last_active":"2024-04-25T22:06:30.851784+0000","last_peered":"2024-04-25T22:06:30.851784+0000","last_clean":"2024-04-25T22:06:30.851784+0000","last_became_active":"2024-04-25T22:06:26.819562+0000","last_became_peered":"2024-04-25T22:06:26.819562+0000","last_unstale":"2024-04-25T22:06:30.851784+0000","last_undegraded":"2024-04-25T22:06:30.851784+0000","last_fullsized":"2024-04-25T22:06:30.851784+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:42.832195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":17843,"num_write":388,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"75'71","reported_seq":188,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843496+0000","last_change":"2024-04-25T22:06:22.799710+0000","last_active":"2024-04-25T22:06:30.843496+0000","last_peered":"2024-04-25T22:06:30.843496+0000","last_clean":"2024-04-25T22:06:30.843496+0000","last_became_active":"2024-04-25T22:06:22.790902+0000","last_became_peered":"2024-04-25T22:06:22.790902+0000","last_unstale":"2024-04-25T22:06:30.843496+0000","last_undegraded":"2024-04-25T22:06:30.843496+0000","last_fullsized":"2024-04-25T22:06:30.843496+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:50:36.683583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'366","reported_seq":571,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850882+0000","last_change":"2024-04-25T22:06:22.809150+0000","last_active":"2024-04-25T22:06:30.850882+0000","last_peered":"2024-04-25T22:06:30.850882+0000","last_clean":"2024-04-25T22:06:30.850882+0000","last_became_active":"2024-04-25T22:06:22.803327+0000","last_became_peered":"2024-04-25T22:06:22.803327+0000","last_unstale":"2024-04-25T22:06:30.850882+0000","last_undegraded":"2024-04-25T22:06:30.850882+0000","last_fullsized":"2024-04-25T22:06:30.850882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.731906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":16032,"num_write":334,"num_write_kb":25754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'63","reported_seq":219,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130229+0000","last_change":"2024-04-25T22:06:23.085892+0000","last_active":"2024-04-25T22:06:30.130229+0000","last_peered":"2024-04-25T22:06:30.130229+0000","last_clean":"2024-04-25T22:06:30.130229+0000","last_became_active":"2024-04-25T22:06:23.082351+0000","last_became_peered":"2024-04-25T22:06:23.082351+0000","last_unstale":"2024-04-25T22:06:30.130229+0000","last_undegraded":"2024-04-25T22:06:30.130229+0000","last_fullsized":"2024-04-25T22:06:30.130229+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:51.142517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"76'148","reported_seq":304,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132891+0000","last_change":"2024-04-25T22:06:23.089179+0000","last_active":"2024-04-25T22:06:30.132891+0000","last_peered":"2024-04-25T22:06:30.132891+0000","last_clean":"2024-04-25T22:06:30.132891+0000","last_became_active":"2024-04-25T22:06:23.085599+0000","last_became_peered":"2024-04-25T22:06:23.085599+0000","last_unstale":"2024-04-25T22:06:30.132891+0000","last_undegraded":"2024-04-25T22:06:30.132891+0000","last_fullsized":"2024-04-25T22:06:30.132891+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:53:14.055158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"76'402","reported_seq":568,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842703+0000","last_change":"2024-04-25T22:06:22.802685+0000","last_active":"2024-04-25T22:06:30.842703+0000","last_peered":"2024-04-25T22:06:30.842703+0000","last_clean":"2024-04-25T22:06:30.842703+0000","last_became_active":"2024-04-25T22:06:22.789353+0000","last_became_peered":"2024-04-25T22:06:22.789353+0000","last_unstale":"2024-04-25T22:06:30.842703+0000","last_undegraded":"2024-04-25T22:06:30.842703+0000","last_fullsized":"2024-04-25T22:06:30.842703+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:14.949049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21114,"num_write":364,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"75'250","reported_seq":374,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844891+0000","last_change":"2024-04-25T22:06:22.791598+0000","last_active":"2024-04-25T22:06:30.844891+0000","last_peered":"2024-04-25T22:06:30.844891+0000","last_clean":"2024-04-25T22:06:30.844891+0000","last_became_active":"2024-04-25T22:06:22.790508+0000","last_became_peered":"2024-04-25T22:06:22.790508+0000","last_unstale":"2024-04-25T22:06:30.844891+0000","last_undegraded":"2024-04-25T22:06:30.844891+0000","last_fullsized":"2024-04-25T22:06:30.844891+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"76'460","reported_seq":634,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842903+0000","last_change":"2024-04-25T22:03:33.861055+0000","last_active":"2024-04-25T22:06:30.842903+0000","last_peered":"2024-04-25T22:06:30.842903+0000","last_clean":"2024-04-25T22:06:30.842903+0000","last_became_active":"2024-04-25T22:03:33.856638+0000","last_became_peered":"2024-04-25T22:03:33.856638+0000","last_unstale":"2024-04-25T22:06:30.842903+0000","last_undegraded":"2024-04-25T22:06:30.842903+0000","last_fullsized":"2024-04-25T22:06:30.842903+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":39774,"num_write":433,"num_write_kb":80294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'556","reported_seq":706,"reported_epoch":95,"state":"peering","last_fresh":"2024-04-25T22:06:27.110576+0000","last_change":"2024-04-25T22:06:30.134719+0000","last_active":"2024-04-25T22:06:30.134719+0000","last_peered":"2024-04-25T22:06:27.110576+0000","last_clean":"2024-04-25T22:06:27.110576+0000","last_became_active":"2024-04-25T22:06:23.113817+0000","last_became_peered":"2024-04-25T22:06:23.113817+0000","last_unstale":"2024-04-25T22:06:27.110576+0000","last_undegraded":"2024-04-25T22:06:27.110576+0000","last_fullsized":"2024-04-25T22:06:27.110576+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":509,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"76'413","reported_seq":575,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.133059+0000","last_change":"2024-04-25T22:06:23.129627+0000","last_active":"2024-04-25T22:06:30.133059+0000","last_peered":"2024-04-25T22:06:30.133059+0000","last_clean":"2024-04-25T22:06:30.133059+0000","last_became_active":"2024-04-25T22:06:23.108199+0000","last_became_peered":"2024-04-25T22:06:23.108199+0000","last_unstale":"2024-04-25T22:06:30.133059+0000","last_undegraded":"2024-04-25T22:06:30.133059+0000","last_fullsized":"2024-04-25T22:06:30.133059+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:23.828740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4858,"num_write":378,"num_write_kb":46741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"76'66","reported_seq":69,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.135417+0000","last_change":"2024-04-25T22:02:42.844584+0000","last_active":"2024-04-25T22:01:12.587237+0000","last_peered":"2024-04-25T22:01:12.587237+0000","last_clean":"2024-04-25T22:01:12.587237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:06:30.135417+0000","last_undegraded":"2024-04-25T22:06:30.135417+0000","last_fullsized":"2024-04-25T22:06:30.135417+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"76'489","reported_seq":729,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850154+0000","last_change":"2024-04-25T22:06:22.838952+0000","last_active":"2024-04-25T22:06:30.850154+0000","last_peered":"2024-04-25T22:06:30.850154+0000","last_clean":"2024-04-25T22:06:30.850154+0000","last_became_active":"2024-04-25T22:06:22.832394+0000","last_became_peered":"2024-04-25T22:06:22.832394+0000","last_unstale":"2024-04-25T22:06:30.850154+0000","last_undegraded":"2024-04-25T22:06:30.850154+0000","last_fullsized":"2024-04-25T22:06:30.850154+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:04:38.988916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":26829,"num_write":457,"num_write_kb":137840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"75'193","reported_seq":377,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850501+0000","last_change":"2024-04-25T22:06:22.838157+0000","last_active":"2024-04-25T22:06:30.850501+0000","last_peered":"2024-04-25T22:06:30.850501+0000","last_clean":"2024-04-25T22:06:30.850501+0000","last_became_active":"2024-04-25T22:06:22.832572+0000","last_became_peered":"2024-04-25T22:06:22.832572+0000","last_unstale":"2024-04-25T22:06:30.850501+0000","last_undegraded":"2024-04-25T22:06:30.850501+0000","last_fullsized":"2024-04-25T22:06:30.850501+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:34.994194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'437","reported_seq":520,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.136633+0000","last_change":"2024-04-25T22:06:30.136633+0000","last_active":"2024-04-25T22:06:30.136633+0000","last_peered":"2024-04-25T22:03:46.907516+0000","last_clean":"2024-04-25T22:03:46.907516+0000","last_became_active":"2024-04-25T22:02:43.852555+0000","last_became_peered":"2024-04-25T22:02:43.852555+0000","last_unstale":"2024-04-25T22:06:30.136633+0000","last_undegraded":"2024-04-25T22:06:30.136633+0000","last_fullsized":"2024-04-25T22:06:30.136633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3720,"num_write":406,"num_write_kb":30461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"76'106","reported_seq":262,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130809+0000","last_change":"2024-04-25T22:06:23.128769+0000","last_active":"2024-04-25T22:06:30.130809+0000","last_peered":"2024-04-25T22:06:30.130809+0000","last_clean":"2024-04-25T22:06:30.130809+0000","last_became_active":"2024-04-25T22:06:23.103402+0000","last_became_peered":"2024-04-25T22:06:23.103402+0000","last_unstale":"2024-04-25T22:06:30.130809+0000","last_undegraded":"2024-04-25T22:06:30.130809+0000","last_fullsized":"2024-04-25T22:06:30.130809+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:27.137773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"76'409","reported_seq":603,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132383+0000","last_change":"2024-04-25T22:06:23.133536+0000","last_active":"2024-04-25T22:06:30.132383+0000","last_peered":"2024-04-25T22:06:30.132383+0000","last_clean":"2024-04-25T22:06:30.132383+0000","last_became_active":"2024-04-25T22:06:23.086188+0000","last_became_peered":"2024-04-25T22:06:23.086188+0000","last_unstale":"2024-04-25T22:06:30.132383+0000","last_undegraded":"2024-04-25T22:06:30.132383+0000","last_fullsized":"2024-04-25T22:06:30.132383+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:13:59.140479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19178,"num_write":380,"num_write_kb":91945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"75'51","reported_seq":182,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843314+0000","last_change":"2024-04-25T22:06:22.800659+0000","last_active":"2024-04-25T22:06:30.843314+0000","last_peered":"2024-04-25T22:06:30.843314+0000","last_clean":"2024-04-25T22:06:30.843314+0000","last_became_active":"2024-04-25T22:06:22.798779+0000","last_became_peered":"2024-04-25T22:06:22.798779+0000","last_unstale":"2024-04-25T22:06:30.843314+0000","last_undegraded":"2024-04-25T22:06:30.843314+0000","last_fullsized":"2024-04-25T22:06:30.843314+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:35.728722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"76'377","reported_seq":559,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.134856+0000","last_change":"2024-04-25T22:06:23.114225+0000","last_active":"2024-04-25T22:06:30.134856+0000","last_peered":"2024-04-25T22:06:30.134856+0000","last_clean":"2024-04-25T22:06:30.134856+0000","last_became_active":"2024-04-25T22:06:23.085799+0000","last_became_peered":"2024-04-25T22:06:23.085799+0000","last_unstale":"2024-04-25T22:06:30.134856+0000","last_undegraded":"2024-04-25T22:06:30.134856+0000","last_fullsized":"2024-04-25T22:06:30.134856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:50.484372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21517,"num_write":342,"num_write_kb":66898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"75'449","reported_seq":546,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843127+0000","last_change":"2024-04-25T22:03:33.860386+0000","last_active":"2024-04-25T22:06:30.843127+0000","last_peered":"2024-04-25T22:06:30.843127+0000","last_clean":"2024-04-25T22:06:30.843127+0000","last_became_active":"2024-04-25T22:03:33.859539+0000","last_became_peered":"2024-04-25T22:03:33.859539+0000","last_unstale":"2024-04-25T22:06:30.843127+0000","last_undegraded":"2024-04-25T22:06:30.843127+0000","last_fullsized":"2024-04-25T22:06:30.843127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:20.247942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'399","reported_seq":613,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850961+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:06:30.850961+0000","last_peered":"2024-04-25T22:06:30.850961+0000","last_clean":"2024-04-25T22:06:30.850961+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:06:30.850961+0000","last_undegraded":"2024-04-25T22:06:30.850961+0000","last_fullsized":"2024-04-25T22:06:30.850961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17888,"num_write":373,"num_write_kb":67556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":316,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130098+0000","last_change":"2024-04-25T22:06:23.082707+0000","last_active":"2024-04-25T22:06:30.130098+0000","last_peered":"2024-04-25T22:06:30.130098+0000","last_clean":"2024-04-25T22:06:30.130098+0000","last_became_active":"2024-04-25T22:06:23.080701+0000","last_became_peered":"2024-04-25T22:06:23.080701+0000","last_unstale":"2024-04-25T22:06:30.130098+0000","last_undegraded":"2024-04-25T22:06:30.130098+0000","last_fullsized":"2024-04-25T22:06:30.130098+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:27.088849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130852+0000","last_change":"2024-04-25T22:06:23.116373+0000","last_active":"2024-04-25T22:06:30.130852+0000","last_peered":"2024-04-25T22:06:30.130852+0000","last_clean":"2024-04-25T22:06:30.130852+0000","last_became_active":"2024-04-25T22:06:23.108984+0000","last_became_peered":"2024-04-25T22:06:23.108984+0000","last_unstale":"2024-04-25T22:06:30.130852+0000","last_undegraded":"2024-04-25T22:06:30.130852+0000","last_fullsized":"2024-04-25T22:06:30.130852+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:08.884723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"75'393","reported_seq":570,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849474+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:06:30.849474+0000","last_peered":"2024-04-25T22:06:30.849474+0000","last_clean":"2024-04-25T22:06:30.849474+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:06:30.849474+0000","last_undegraded":"2024-04-25T22:06:30.849474+0000","last_fullsized":"2024-04-25T22:06:30.849474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'463","reported_seq":666,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.134571+0000","last_change":"2024-04-25T22:06:23.133028+0000","last_active":"2024-04-25T22:06:30.134571+0000","last_peered":"2024-04-25T22:06:30.134571+0000","last_clean":"2024-04-25T22:06:30.134571+0000","last_became_active":"2024-04-25T22:06:23.082756+0000","last_became_peered":"2024-04-25T22:06:23.082756+0000","last_unstale":"2024-04-25T22:06:30.134571+0000","last_undegraded":"2024-04-25T22:06:30.134571+0000","last_fullsized":"2024-04-25T22:06:30.134571+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:24:01.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29270,"num_write":426,"num_write_kb":129367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131290+0000","last_change":"2024-04-25T22:06:23.083451+0000","last_active":"2024-04-25T22:06:30.131290+0000","last_peered":"2024-04-25T22:06:30.131290+0000","last_clean":"2024-04-25T22:06:30.131290+0000","last_became_active":"2024-04-25T22:06:23.080841+0000","last_became_peered":"2024-04-25T22:06:23.080841+0000","last_unstale":"2024-04-25T22:06:30.131290+0000","last_undegraded":"2024-04-25T22:06:30.131290+0000","last_fullsized":"2024-04-25T22:06:30.131290+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:34.605367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"76'125","reported_seq":372,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849223+0000","last_change":"2024-04-25T22:06:22.804290+0000","last_active":"2024-04-25T22:06:30.849223+0000","last_peered":"2024-04-25T22:06:30.849223+0000","last_clean":"2024-04-25T22:06:30.849223+0000","last_became_active":"2024-04-25T22:06:22.801616+0000","last_became_peered":"2024-04-25T22:06:22.801616+0000","last_unstale":"2024-04-25T22:06:30.849223+0000","last_undegraded":"2024-04-25T22:06:30.849223+0000","last_fullsized":"2024-04-25T22:06:30.849223+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:13.402747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464197,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":63,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'457","reported_seq":646,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844136+0000","last_change":"2024-04-25T22:03:05.702224+0000","last_active":"2024-04-25T22:06:30.844136+0000","last_peered":"2024-04-25T22:06:30.844136+0000","last_clean":"2024-04-25T22:06:30.844136+0000","last_became_active":"2024-04-25T22:03:05.699581+0000","last_became_peered":"2024-04-25T22:03:05.699581+0000","last_unstale":"2024-04-25T22:06:30.844136+0000","last_undegraded":"2024-04-25T22:06:30.844136+0000","last_fullsized":"2024-04-25T22:06:30.844136+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":34759,"num_write":424,"num_write_kb":71902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849418+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:06:30.849418+0000","last_peered":"2024-04-25T22:06:30.849418+0000","last_clean":"2024-04-25T22:06:30.849418+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:06:30.849418+0000","last_undegraded":"2024-04-25T22:06:30.849418+0000","last_fullsized":"2024-04-25T22:06:30.849418+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"75'311","reported_seq":496,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843037+0000","last_change":"2024-04-25T22:06:22.801481+0000","last_active":"2024-04-25T22:06:30.843037+0000","last_peered":"2024-04-25T22:06:30.843037+0000","last_clean":"2024-04-25T22:06:30.843037+0000","last_became_active":"2024-04-25T22:06:22.794841+0000","last_became_peered":"2024-04-25T22:06:22.794841+0000","last_unstale":"2024-04-25T22:06:30.843037+0000","last_undegraded":"2024-04-25T22:06:30.843037+0000","last_fullsized":"2024-04-25T22:06:30.843037+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:06:59.330924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"76'373","reported_seq":592,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851291+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:06:30.851291+0000","last_peered":"2024-04-25T22:06:30.851291+0000","last_clean":"2024-04-25T22:06:30.851291+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:06:30.851291+0000","last_undegraded":"2024-04-25T22:06:30.851291+0000","last_fullsized":"2024-04-25T22:06:30.851291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28273,"num_write":350,"num_write_kb":87787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.130568+0000","last_change":"2024-04-25T22:06:23.129162+0000","last_active":"2024-04-25T22:06:30.130568+0000","last_peered":"2024-04-25T22:06:30.130568+0000","last_clean":"2024-04-25T22:06:30.130568+0000","last_became_active":"2024-04-25T22:06:23.106155+0000","last_became_peered":"2024-04-25T22:06:23.106155+0000","last_unstale":"2024-04-25T22:06:30.130568+0000","last_undegraded":"2024-04-25T22:06:30.130568+0000","last_fullsized":"2024-04-25T22:06:30.130568+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:30.846068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"76'75","reported_seq":69,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.133335+0000","last_change":"2024-04-25T22:02:42.841987+0000","last_active":"2024-04-25T22:01:12.587237+0000","last_peered":"2024-04-25T22:01:12.587237+0000","last_clean":"2024-04-25T22:01:12.587237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:06:30.133335+0000","last_undegraded":"2024-04-25T22:06:30.133335+0000","last_fullsized":"2024-04-25T22:06:30.133335+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"76'461","reported_seq":753,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850519+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:06:30.850519+0000","last_peered":"2024-04-25T22:06:30.850519+0000","last_clean":"2024-04-25T22:06:30.850519+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:06:30.850519+0000","last_undegraded":"2024-04-25T22:06:30.850519+0000","last_fullsized":"2024-04-25T22:06:30.850519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":67984,"num_write":425,"num_write_kb":154741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"76'268","reported_seq":423,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131579+0000","last_change":"2024-04-25T22:06:23.134306+0000","last_active":"2024-04-25T22:06:30.131579+0000","last_peered":"2024-04-25T22:06:30.131579+0000","last_clean":"2024-04-25T22:06:30.131579+0000","last_became_active":"2024-04-25T22:06:23.122629+0000","last_became_peered":"2024-04-25T22:06:23.122629+0000","last_unstale":"2024-04-25T22:06:30.131579+0000","last_undegraded":"2024-04-25T22:06:30.131579+0000","last_fullsized":"2024-04-25T22:06:30.131579+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:41.205934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850998+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:06:30.850998+0000","last_peered":"2024-04-25T22:06:30.850998+0000","last_clean":"2024-04-25T22:06:30.850998+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:06:30.850998+0000","last_undegraded":"2024-04-25T22:06:30.850998+0000","last_fullsized":"2024-04-25T22:06:30.850998+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'398","reported_seq":578,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843743+0000","last_change":"2024-04-25T22:06:22.797468+0000","last_active":"2024-04-25T22:06:30.843743+0000","last_peered":"2024-04-25T22:06:30.843743+0000","last_clean":"2024-04-25T22:06:30.843743+0000","last_became_active":"2024-04-25T22:06:22.789384+0000","last_became_peered":"2024-04-25T22:06:22.789384+0000","last_unstale":"2024-04-25T22:06:30.843743+0000","last_undegraded":"2024-04-25T22:06:30.843743+0000","last_fullsized":"2024-04-25T22:06:30.843743+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:35.557386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":26599,"num_write":366,"num_write_kb":75612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"76'47","reported_seq":224,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850762+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:06:30.850762+0000","last_peered":"2024-04-25T22:06:30.850762+0000","last_clean":"2024-04-25T22:06:30.850762+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:06:30.850762+0000","last_undegraded":"2024-04-25T22:06:30.850762+0000","last_fullsized":"2024-04-25T22:06:30.850762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":171,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845730+0000","last_change":"2024-04-25T22:03:05.701809+0000","last_active":"2024-04-25T22:06:30.845730+0000","last_peered":"2024-04-25T22:06:30.845730+0000","last_clean":"2024-04-25T22:06:30.845730+0000","last_became_active":"2024-04-25T22:03:05.701322+0000","last_became_peered":"2024-04-25T22:03:05.701322+0000","last_unstale":"2024-04-25T22:06:30.845730+0000","last_undegraded":"2024-04-25T22:06:30.845730+0000","last_fullsized":"2024-04-25T22:06:30.845730+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:45.907458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"76'406","reported_seq":642,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844251+0000","last_change":"2024-04-25T22:06:22.802683+0000","last_active":"2024-04-25T22:06:30.844251+0000","last_peered":"2024-04-25T22:06:30.844251+0000","last_clean":"2024-04-25T22:06:30.844251+0000","last_became_active":"2024-04-25T22:06:22.789807+0000","last_became_peered":"2024-04-25T22:06:22.789807+0000","last_unstale":"2024-04-25T22:06:30.844251+0000","last_undegraded":"2024-04-25T22:06:30.844251+0000","last_fullsized":"2024-04-25T22:06:30.844251+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:15.180532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25634,"num_write":377,"num_write_kb":103970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"76'64","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.852026+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:06:30.852026+0000","last_peered":"2024-04-25T22:06:30.852026+0000","last_clean":"2024-04-25T22:06:30.852026+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:06:30.852026+0000","last_undegraded":"2024-04-25T22:06:30.852026+0000","last_fullsized":"2024-04-25T22:06:30.852026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.132057+0000","last_change":"2024-04-25T22:06:24.092672+0000","last_active":"2024-04-25T22:06:30.132057+0000","last_peered":"2024-04-25T22:06:30.132057+0000","last_clean":"2024-04-25T22:06:30.132057+0000","last_became_active":"2024-04-25T22:06:24.091909+0000","last_became_peered":"2024-04-25T22:06:24.091909+0000","last_unstale":"2024-04-25T22:06:30.132057+0000","last_undegraded":"2024-04-25T22:06:30.132057+0000","last_fullsized":"2024-04-25T22:06:30.132057+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:19:21.605435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"76'402","reported_seq":605,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848860+0000","last_change":"2024-04-25T22:06:22.809713+0000","last_active":"2024-04-25T22:06:30.848860+0000","last_peered":"2024-04-25T22:06:30.848860+0000","last_clean":"2024-04-25T22:06:30.848860+0000","last_became_active":"2024-04-25T22:06:22.802005+0000","last_became_peered":"2024-04-25T22:06:22.802005+0000","last_unstale":"2024-04-25T22:06:30.848860+0000","last_undegraded":"2024-04-25T22:06:30.848860+0000","last_fullsized":"2024-04-25T22:06:30.848860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9572,"num_write":361,"num_write_kb":29911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"77'127","reported_seq":311,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851852+0000","last_change":"2024-04-25T22:06:22.804851+0000","last_active":"2024-04-25T22:06:30.851852+0000","last_peered":"2024-04-25T22:06:30.851852+0000","last_clean":"2024-04-25T22:06:30.851852+0000","last_became_active":"2024-04-25T22:06:22.802083+0000","last_became_peered":"2024-04-25T22:06:22.802083+0000","last_unstale":"2024-04-25T22:06:30.851852+0000","last_undegraded":"2024-04-25T22:06:30.851852+0000","last_fullsized":"2024-04-25T22:06:30.851852+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131963+0000","last_change":"2024-04-25T22:06:23.081230+0000","last_active":"2024-04-25T22:06:30.131963+0000","last_peered":"2024-04-25T22:06:30.131963+0000","last_clean":"2024-04-25T22:06:30.131963+0000","last_became_active":"2024-04-25T22:06:23.080393+0000","last_became_peered":"2024-04-25T22:06:23.080393+0000","last_unstale":"2024-04-25T22:06:30.131963+0000","last_undegraded":"2024-04-25T22:06:30.131963+0000","last_fullsized":"2024-04-25T22:06:30.131963+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:55.157159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"76'415","reported_seq":596,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842908+0000","last_change":"2024-04-25T22:06:22.801327+0000","last_active":"2024-04-25T22:06:30.842908+0000","last_peered":"2024-04-25T22:06:30.842908+0000","last_clean":"2024-04-25T22:06:30.842908+0000","last_became_active":"2024-04-25T22:06:22.789624+0000","last_became_peered":"2024-04-25T22:06:22.789624+0000","last_unstale":"2024-04-25T22:06:30.842908+0000","last_undegraded":"2024-04-25T22:06:30.842908+0000","last_fullsized":"2024-04-25T22:06:30.842908+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27345,"num_write":384,"num_write_kb":92854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"76'407","reported_seq":621,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.133739+0000","last_change":"2024-04-25T22:06:23.114739+0000","last_active":"2024-04-25T22:06:30.133739+0000","last_peered":"2024-04-25T22:06:30.133739+0000","last_clean":"2024-04-25T22:06:30.133739+0000","last_became_active":"2024-04-25T22:06:23.087118+0000","last_became_peered":"2024-04-25T22:06:23.087118+0000","last_unstale":"2024-04-25T22:06:30.133739+0000","last_undegraded":"2024-04-25T22:06:30.133739+0000","last_fullsized":"2024-04-25T22:06:30.133739+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:51.191212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33923,"num_write":372,"num_write_kb":82083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"77'260","reported_seq":418,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131279+0000","last_change":"2024-04-25T22:06:23.083331+0000","last_active":"2024-04-25T22:06:30.131279+0000","last_peered":"2024-04-25T22:06:30.131279+0000","last_clean":"2024-04-25T22:06:30.131279+0000","last_became_active":"2024-04-25T22:06:23.080552+0000","last_became_peered":"2024-04-25T22:06:23.080552+0000","last_unstale":"2024-04-25T22:06:30.131279+0000","last_undegraded":"2024-04-25T22:06:30.131279+0000","last_fullsized":"2024-04-25T22:06:30.131279+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:55.928212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8470619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"76'408","reported_seq":610,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848693+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:06:30.848693+0000","last_peered":"2024-04-25T22:06:30.848693+0000","last_clean":"2024-04-25T22:06:30.848693+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:06:30.848693+0000","last_undegraded":"2024-04-25T22:06:30.848693+0000","last_fullsized":"2024-04-25T22:06:30.848693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14178,"num_write":370,"num_write_kb":58735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'104","reported_seq":289,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845584+0000","last_change":"2024-04-25T22:06:22.805389+0000","last_active":"2024-04-25T22:06:30.845584+0000","last_peered":"2024-04-25T22:06:30.845584+0000","last_clean":"2024-04-25T22:06:30.845584+0000","last_became_active":"2024-04-25T22:06:22.802667+0000","last_became_peered":"2024-04-25T22:06:22.802667+0000","last_unstale":"2024-04-25T22:06:30.845584+0000","last_undegraded":"2024-04-25T22:06:30.845584+0000","last_fullsized":"2024-04-25T22:06:30.845584+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:38.785650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"75'232","reported_seq":278,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.134307+0000","last_change":"2024-04-25T22:06:30.134307+0000","last_active":"2024-04-25T22:06:30.134307+0000","last_peered":"2024-04-25T22:03:41.622809+0000","last_clean":"2024-04-25T22:03:41.622809+0000","last_became_active":"2024-04-25T22:02:43.852292+0000","last_became_peered":"2024-04-25T22:02:43.852292+0000","last_unstale":"2024-04-25T22:06:30.134307+0000","last_undegraded":"2024-04-25T22:06:30.134307+0000","last_fullsized":"2024-04-25T22:06:30.134307+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"76'483","reported_seq":713,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848496+0000","last_change":"2024-04-25T22:06:22.814119+0000","last_active":"2024-04-25T22:06:30.848496+0000","last_peered":"2024-04-25T22:06:30.848496+0000","last_clean":"2024-04-25T22:06:30.848496+0000","last_became_active":"2024-04-25T22:06:22.807584+0000","last_became_peered":"2024-04-25T22:06:22.807584+0000","last_unstale":"2024-04-25T22:06:30.848496+0000","last_undegraded":"2024-04-25T22:06:30.848496+0000","last_fullsized":"2024-04-25T22:06:30.848496+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:08.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24709,"num_write":463,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"75'60","reported_seq":244,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851719+0000","last_change":"2024-04-25T22:06:22.802356+0000","last_active":"2024-04-25T22:06:30.851719+0000","last_peered":"2024-04-25T22:06:30.851719+0000","last_clean":"2024-04-25T22:06:30.851719+0000","last_became_active":"2024-04-25T22:06:22.801412+0000","last_became_peered":"2024-04-25T22:06:22.801412+0000","last_unstale":"2024-04-25T22:06:30.851719+0000","last_undegraded":"2024-04-25T22:06:30.851719+0000","last_fullsized":"2024-04-25T22:06:30.851719+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:04.421952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'444","reported_seq":648,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848562+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:06:30.848562+0000","last_peered":"2024-04-25T22:06:30.848562+0000","last_clean":"2024-04-25T22:06:30.848562+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:06:30.848562+0000","last_undegraded":"2024-04-25T22:06:30.848562+0000","last_fullsized":"2024-04-25T22:06:30.848562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14429,"num_write":416,"num_write_kb":59186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'355","reported_seq":499,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845399+0000","last_change":"2024-04-25T22:06:22.804579+0000","last_active":"2024-04-25T22:06:30.845399+0000","last_peered":"2024-04-25T22:06:30.845399+0000","last_clean":"2024-04-25T22:06:30.845399+0000","last_became_active":"2024-04-25T22:06:22.792886+0000","last_became_peered":"2024-04-25T22:06:22.792886+0000","last_unstale":"2024-04-25T22:06:30.845399+0000","last_undegraded":"2024-04-25T22:06:30.845399+0000","last_fullsized":"2024-04-25T22:06:30.845399+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:54:35.464321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18236,"num_write":332,"num_write_kb":42553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"76'742","reported_seq":919,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849150+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:06:30.849150+0000","last_peered":"2024-04-25T22:06:30.849150+0000","last_clean":"2024-04-25T22:06:30.849150+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:06:30.849150+0000","last_undegraded":"2024-04-25T22:06:30.849150+0000","last_fullsized":"2024-04-25T22:06:30.849150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'378","reported_seq":579,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851532+0000","last_change":"2024-04-25T22:06:22.813642+0000","last_active":"2024-04-25T22:06:30.851532+0000","last_peered":"2024-04-25T22:06:30.851532+0000","last_clean":"2024-04-25T22:06:30.851532+0000","last_became_active":"2024-04-25T22:06:22.806240+0000","last_became_peered":"2024-04-25T22:06:22.806240+0000","last_unstale":"2024-04-25T22:06:30.851532+0000","last_undegraded":"2024-04-25T22:06:30.851532+0000","last_fullsized":"2024-04-25T22:06:30.851532+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6876,"num_write":354,"num_write_kb":46840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"76'204","reported_seq":388,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848941+0000","last_change":"2024-04-25T22:06:22.805022+0000","last_active":"2024-04-25T22:06:30.848941+0000","last_peered":"2024-04-25T22:06:30.848941+0000","last_clean":"2024-04-25T22:06:30.848941+0000","last_became_active":"2024-04-25T22:06:22.801630+0000","last_became_peered":"2024-04-25T22:06:22.801630+0000","last_unstale":"2024-04-25T22:06:30.848941+0000","last_undegraded":"2024-04-25T22:06:30.848941+0000","last_fullsized":"2024-04-25T22:06:30.848941+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:34.554201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'377","reported_seq":515,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845146+0000","last_change":"2024-04-25T22:06:22.805011+0000","last_active":"2024-04-25T22:06:30.845146+0000","last_peered":"2024-04-25T22:06:30.845146+0000","last_clean":"2024-04-25T22:06:30.845146+0000","last_became_active":"2024-04-25T22:06:22.795334+0000","last_became_peered":"2024-04-25T22:06:22.795334+0000","last_unstale":"2024-04-25T22:06:30.845146+0000","last_undegraded":"2024-04-25T22:06:30.845146+0000","last_fullsized":"2024-04-25T22:06:30.845146+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:35.997378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6059,"num_write":332,"num_write_kb":37972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"76'217","reported_seq":332,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844027+0000","last_change":"2024-04-25T22:06:28.842258+0000","last_active":"2024-04-25T22:06:30.844027+0000","last_peered":"2024-04-25T22:06:30.844027+0000","last_clean":"2024-04-25T22:06:30.844027+0000","last_became_active":"2024-04-25T22:06:28.841447+0000","last_became_peered":"2024-04-25T22:06:28.841447+0000","last_unstale":"2024-04-25T22:06:30.844027+0000","last_undegraded":"2024-04-25T22:06:30.844027+0000","last_fullsized":"2024-04-25T22:06:30.844027+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:31.009167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"76'389","reported_seq":542,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844243+0000","last_change":"2024-04-25T22:03:33.862286+0000","last_active":"2024-04-25T22:06:30.844243+0000","last_peered":"2024-04-25T22:06:30.844243+0000","last_clean":"2024-04-25T22:06:30.844243+0000","last_became_active":"2024-04-25T22:03:33.860800+0000","last_became_peered":"2024-04-25T22:03:33.860800+0000","last_unstale":"2024-04-25T22:06:30.844243+0000","last_undegraded":"2024-04-25T22:06:30.844243+0000","last_fullsized":"2024-04-25T22:06:30.844243+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:04.528174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19110,"num_write":355,"num_write_kb":63152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'51","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844734+0000","last_change":"2024-04-25T22:06:22.804880+0000","last_active":"2024-04-25T22:06:30.844734+0000","last_peered":"2024-04-25T22:06:30.844734+0000","last_clean":"2024-04-25T22:06:30.844734+0000","last_became_active":"2024-04-25T22:06:22.803778+0000","last_became_peered":"2024-04-25T22:06:22.803778+0000","last_unstale":"2024-04-25T22:06:30.844734+0000","last_undegraded":"2024-04-25T22:06:30.844734+0000","last_fullsized":"2024-04-25T22:06:30.844734+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:47:58.480071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"76'386","reported_seq":475,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.134793+0000","last_change":"2024-04-25T22:06:30.134793+0000","last_active":"2024-04-25T22:06:30.134793+0000","last_peered":"2024-04-25T22:03:46.915198+0000","last_clean":"2024-04-25T22:03:46.915198+0000","last_became_active":"2024-04-25T22:02:43.850568+0000","last_became_peered":"2024-04-25T22:02:43.850568+0000","last_unstale":"2024-04-25T22:06:30.134793+0000","last_undegraded":"2024-04-25T22:06:30.134793+0000","last_fullsized":"2024-04-25T22:06:30.134793+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14050,"num_write":362,"num_write_kb":58957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"76'188","reported_seq":223,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.132995+0000","last_change":"2024-04-25T22:06:30.132995+0000","last_active":"2024-04-25T22:06:30.132995+0000","last_peered":"2024-04-25T22:03:31.361153+0000","last_clean":"2024-04-25T22:03:31.361153+0000","last_became_active":"2024-04-25T22:02:43.852769+0000","last_became_peered":"2024-04-25T22:02:43.852769+0000","last_unstale":"2024-04-25T22:06:30.132995+0000","last_undegraded":"2024-04-25T22:06:30.132995+0000","last_fullsized":"2024-04-25T22:06:30.132995+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"76'397","reported_seq":486,"reported_epoch":98,"state":"peering","last_fresh":"2024-04-25T22:06:30.134133+0000","last_change":"2024-04-25T22:06:30.134133+0000","last_active":"2024-04-25T22:06:30.134133+0000","last_peered":"2024-04-25T22:03:46.861730+0000","last_clean":"2024-04-25T22:03:46.861730+0000","last_became_active":"2024-04-25T22:02:43.852263+0000","last_became_peered":"2024-04-25T22:02:43.852263+0000","last_unstale":"2024-04-25T22:06:30.134133+0000","last_undegraded":"2024-04-25T22:06:30.134133+0000","last_fullsized":"2024-04-25T22:06:30.134133+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13280,"num_write":364,"num_write_kb":46108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"75'284","reported_seq":414,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845419+0000","last_change":"2024-04-25T22:06:22.804561+0000","last_active":"2024-04-25T22:06:30.845419+0000","last_peered":"2024-04-25T22:06:30.845419+0000","last_clean":"2024-04-25T22:06:30.845419+0000","last_became_active":"2024-04-25T22:06:22.794078+0000","last_became_peered":"2024-04-25T22:06:22.794078+0000","last_unstale":"2024-04-25T22:06:30.845419+0000","last_undegraded":"2024-04-25T22:06:30.845419+0000","last_fullsized":"2024-04-25T22:06:30.845419+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:07.939379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":12398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"76'412","reported_seq":538,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843652+0000","last_change":"2024-04-25T22:03:33.864136+0000","last_active":"2024-04-25T22:06:30.843652+0000","last_peered":"2024-04-25T22:06:30.843652+0000","last_clean":"2024-04-25T22:06:30.843652+0000","last_became_active":"2024-04-25T22:03:33.862435+0000","last_became_peered":"2024-04-25T22:03:33.862435+0000","last_unstale":"2024-04-25T22:06:30.843652+0000","last_undegraded":"2024-04-25T22:06:30.843652+0000","last_fullsized":"2024-04-25T22:06:30.843652+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:08.119964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":1478,"num_write":377,"num_write_kb":34422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"76'127","reported_seq":304,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851488+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:06:30.851488+0000","last_peered":"2024-04-25T22:06:30.851488+0000","last_clean":"2024-04-25T22:06:30.851488+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:06:30.851488+0000","last_undegraded":"2024-04-25T22:06:30.851488+0000","last_fullsized":"2024-04-25T22:06:30.851488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'444","reported_seq":644,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.131585+0000","last_change":"2024-04-25T22:06:23.132900+0000","last_active":"2024-04-25T22:06:30.131585+0000","last_peered":"2024-04-25T22:06:30.131585+0000","last_clean":"2024-04-25T22:06:30.131585+0000","last_became_active":"2024-04-25T22:06:23.097535+0000","last_became_peered":"2024-04-25T22:06:23.097535+0000","last_unstale":"2024-04-25T22:06:30.131585+0000","last_undegraded":"2024-04-25T22:06:30.131585+0000","last_fullsized":"2024-04-25T22:06:30.131585+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:30:55.243414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31576,"num_write":414,"num_write_kb":70915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"75'46","reported_seq":230,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851416+0000","last_change":"2024-04-25T22:06:22.802843+0000","last_active":"2024-04-25T22:06:30.851416+0000","last_peered":"2024-04-25T22:06:30.851416+0000","last_clean":"2024-04-25T22:06:30.851416+0000","last_became_active":"2024-04-25T22:06:22.801910+0000","last_became_peered":"2024-04-25T22:06:22.801910+0000","last_unstale":"2024-04-25T22:06:30.851416+0000","last_undegraded":"2024-04-25T22:06:30.851416+0000","last_fullsized":"2024-04-25T22:06:30.851416+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:23.004530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2665,"num_read_kb":1338898,"num_write":24540,"num_write_kb":4276910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26558,"ondisk_log_size":26558,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127376126,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":4662,"num_write_kb":127830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":71499776,"data_stored":254752252,"data_compressed":21836190,"data_compressed_allocated":35307520,"data_compressed_original":218619904,"omap_allocated":136586,"internal_metadata":0},"log_size":6446,"ondisk_log_size":6446,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738441,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99732,"kb_used_data":24200,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272108,"statfs":{"total":96636764160,"available":96534638592,"internally_reserved":0,"allocated":24780800,"data_stored":84964150,"data_compressed":7036839,"data_compressed_allocated":11431936,"data_compressed_original":72118272,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738440,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99436,"kb_used_data":23896,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272404,"statfs":{"total":96636764160,"available":96534941696,"internally_reserved":0,"allocated":24469504,"data_stored":81562098,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":90,"seq":386547056644,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58096,"kb_used_data":24420,"kb_used_omap":134,"kb_used_meta":33529,"kb_avail":94313744,"statfs":{"total":96636764160,"available":96577273856,"internally_reserved":0,"allocated":25006080,"data_stored":90618890,"data_compressed":7819212,"data_compressed_allocated":12599296,"data_compressed_original":78716928,"omap_allocated":138181,"internal_metadata":34333755},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24076288,"data_stored":89627390,"data_compressed":7811005,"data_compressed_allocated":12562432,"data_compressed_original":78143488,"omap_allocated":136586,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23584768,"data_stored":81156589,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23838720,"data_stored":83968273,"data_compressed":7028632,"data_compressed_allocated":11395072,"data_compressed_original":71544832,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:06:37.172 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T22:06:37.572 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:06:37.572 INFO:teuthology.orchestra.run.smithi044.stdout:{"fsid":"1ced109c-704f-44b1-9811-a2da74898889","health":{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 2 pgs inactive, 9 pgs peering","count":11},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":345,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":99,"num_osds":3,"num_up_osds":3,"osd_up_since":1714082781,"num_in_osds":3,"osd_in_since":1714082453,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":95},{"state_name":"peering","count":10}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":127966494,"bytes_used":263438336,"bytes_avail":289646854144,"bytes_total":289910292480,"inactive_pgs_ratio":0.095238097012042999},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4205}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-25T22:02:21.582461+0000","services":{}},"progress_events":{}} 2024-04-25T22:06:37.590 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-04-25T22:06:37.590 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:06:37.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:06:37.883 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:06:37.899 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-04-25T22:06:37.690051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127966494,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2864,"num_read_kb":1340487,"num_write":29405,"num_write_kb":4408200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33161,"ondisk_log_size":33161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":257280,"kb_used_data":72528,"kb_used_omap":138,"kb_used_meta":184565,"kb_avail":282858240,"statfs":{"total":289910292480,"available":289646837760,"internally_reserved":0,"allocated":74268672,"data_stored":257149515,"data_compressed":21852604,"data_compressed_allocated":35381248,"data_compressed_original":219766784,"omap_allocated":141371,"internal_metadata":188995525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002877"},"pg_stats":[{"pgid":"4.3f","version":"76'446","reported_seq":604,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845124+0000","last_change":"2024-04-25T22:03:33.876369+0000","last_active":"2024-04-25T22:06:30.845124+0000","last_peered":"2024-04-25T22:06:30.845124+0000","last_clean":"2024-04-25T22:06:30.845124+0000","last_became_active":"2024-04-25T22:03:33.873739+0000","last_became_peered":"2024-04-25T22:03:33.873739+0000","last_unstale":"2024-04-25T22:06:30.845124+0000","last_undegraded":"2024-04-25T22:06:30.845124+0000","last_fullsized":"2024-04-25T22:06:30.845124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:32.529707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29432,"num_write":407,"num_write_kb":84235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"76'417","reported_seq":570,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844117+0000","last_change":"2024-04-25T22:03:33.861269+0000","last_active":"2024-04-25T22:06:30.844117+0000","last_peered":"2024-04-25T22:06:30.844117+0000","last_clean":"2024-04-25T22:06:30.844117+0000","last_became_active":"2024-04-25T22:03:33.859221+0000","last_became_peered":"2024-04-25T22:03:33.859221+0000","last_unstale":"2024-04-25T22:06:30.844117+0000","last_undegraded":"2024-04-25T22:06:30.844117+0000","last_fullsized":"2024-04-25T22:06:30.844117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:23:44.690527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":23541,"num_write":389,"num_write_kb":87654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"76'389","reported_seq":558,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.162002+0000","last_change":"2024-04-25T22:06:31.162002+0000","last_active":"2024-04-25T22:06:31.162002+0000","last_peered":"2024-04-25T22:06:31.162002+0000","last_clean":"2024-04-25T22:06:31.162002+0000","last_became_active":"2024-04-25T22:06:31.149675+0000","last_became_peered":"2024-04-25T22:06:31.149675+0000","last_unstale":"2024-04-25T22:06:31.162002+0000","last_undegraded":"2024-04-25T22:06:31.162002+0000","last_fullsized":"2024-04-25T22:06:31.162002+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:08:49.833041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22311,"num_write":361,"num_write_kb":42975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"76'394","reported_seq":588,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142488+0000","last_change":"2024-04-25T22:06:23.123256+0000","last_active":"2024-04-25T22:06:31.142488+0000","last_peered":"2024-04-25T22:06:31.142488+0000","last_clean":"2024-04-25T22:06:31.142488+0000","last_became_active":"2024-04-25T22:06:23.090780+0000","last_became_peered":"2024-04-25T22:06:23.090780+0000","last_unstale":"2024-04-25T22:06:31.142488+0000","last_undegraded":"2024-04-25T22:06:31.142488+0000","last_fullsized":"2024-04-25T22:06:31.142488+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:57.110628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":20785,"num_write":367,"num_write_kb":63746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"76'429","reported_seq":940,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844371+0000","last_change":"2024-04-25T22:06:28.839715+0000","last_active":"2024-04-25T22:06:30.844371+0000","last_peered":"2024-04-25T22:06:30.844371+0000","last_clean":"2024-04-25T22:06:30.844371+0000","last_became_active":"2024-04-25T22:06:28.836687+0000","last_became_peered":"2024-04-25T22:06:28.836687+0000","last_unstale":"2024-04-25T22:06:30.844371+0000","last_undegraded":"2024-04-25T22:06:30.844371+0000","last_fullsized":"2024-04-25T22:06:30.844371+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:10.175157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":20896,"num_write":403,"num_write_kb":100255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"76'368","reported_seq":542,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141851+0000","last_change":"2024-04-25T22:06:23.129617+0000","last_active":"2024-04-25T22:06:31.141851+0000","last_peered":"2024-04-25T22:06:31.141851+0000","last_clean":"2024-04-25T22:06:31.141851+0000","last_became_active":"2024-04-25T22:06:23.107939+0000","last_became_peered":"2024-04-25T22:06:23.107939+0000","last_unstale":"2024-04-25T22:06:31.141851+0000","last_undegraded":"2024-04-25T22:06:31.141851+0000","last_fullsized":"2024-04-25T22:06:31.141851+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:24.183902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9362,"num_write":344,"num_write_kb":20831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"76'438","reported_seq":638,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140968+0000","last_change":"2024-04-25T22:06:23.123861+0000","last_active":"2024-04-25T22:06:31.140968+0000","last_peered":"2024-04-25T22:06:31.140968+0000","last_clean":"2024-04-25T22:06:31.140968+0000","last_became_active":"2024-04-25T22:06:23.098436+0000","last_became_peered":"2024-04-25T22:06:23.098436+0000","last_unstale":"2024-04-25T22:06:31.140968+0000","last_undegraded":"2024-04-25T22:06:31.140968+0000","last_fullsized":"2024-04-25T22:06:31.140968+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:35.433423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25961,"num_write":415,"num_write_kb":72541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'392","reported_seq":602,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140791+0000","last_change":"2024-04-25T22:06:23.128274+0000","last_active":"2024-04-25T22:06:31.140791+0000","last_peered":"2024-04-25T22:06:31.140791+0000","last_clean":"2024-04-25T22:06:31.140791+0000","last_became_active":"2024-04-25T22:06:23.091431+0000","last_became_peered":"2024-04-25T22:06:23.091431+0000","last_unstale":"2024-04-25T22:06:31.140791+0000","last_undegraded":"2024-04-25T22:06:31.140791+0000","last_fullsized":"2024-04-25T22:06:31.140791+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:48.206131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":24749,"num_write":354,"num_write_kb":64232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"76'443","reported_seq":651,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850489+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:06:30.850489+0000","last_peered":"2024-04-25T22:06:30.850489+0000","last_clean":"2024-04-25T22:06:30.850489+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:06:30.850489+0000","last_undegraded":"2024-04-25T22:06:30.850489+0000","last_fullsized":"2024-04-25T22:06:30.850489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":10648,"num_write":411,"num_write_kb":92932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'392","reported_seq":511,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142550+0000","last_change":"2024-04-25T22:06:26.120464+0000","last_active":"2024-04-25T22:06:31.142550+0000","last_peered":"2024-04-25T22:06:31.142550+0000","last_clean":"2024-04-25T22:06:31.142550+0000","last_became_active":"2024-04-25T22:06:26.114463+0000","last_became_peered":"2024-04-25T22:06:26.114463+0000","last_unstale":"2024-04-25T22:06:31.142550+0000","last_undegraded":"2024-04-25T22:06:31.142550+0000","last_fullsized":"2024-04-25T22:06:31.142550+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:37:54.870762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10696,"num_write":359,"num_write_kb":63259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'391","reported_seq":569,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144957+0000","last_change":"2024-04-25T22:06:23.135020+0000","last_active":"2024-04-25T22:06:31.144957+0000","last_peered":"2024-04-25T22:06:31.144957+0000","last_clean":"2024-04-25T22:06:31.144957+0000","last_became_active":"2024-04-25T22:06:23.123801+0000","last_became_peered":"2024-04-25T22:06:23.123801+0000","last_unstale":"2024-04-25T22:06:31.144957+0000","last_undegraded":"2024-04-25T22:06:31.144957+0000","last_fullsized":"2024-04-25T22:06:31.144957+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:11:44.607123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11259,"num_write":372,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"76'365","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843898+0000","last_change":"2024-04-25T22:06:22.802947+0000","last_active":"2024-04-25T22:06:30.843898+0000","last_peered":"2024-04-25T22:06:30.843898+0000","last_clean":"2024-04-25T22:06:30.843898+0000","last_became_active":"2024-04-25T22:06:22.792880+0000","last_became_peered":"2024-04-25T22:06:22.792880+0000","last_unstale":"2024-04-25T22:06:30.843898+0000","last_undegraded":"2024-04-25T22:06:30.843898+0000","last_fullsized":"2024-04-25T22:06:30.843898+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":51972,"num_write":340,"num_write_kb":51203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"76'420","reported_seq":574,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843505+0000","last_change":"2024-04-25T22:03:33.866815+0000","last_active":"2024-04-25T22:06:30.843505+0000","last_peered":"2024-04-25T22:06:30.843505+0000","last_clean":"2024-04-25T22:06:30.843505+0000","last_became_active":"2024-04-25T22:03:33.859376+0000","last_became_peered":"2024-04-25T22:03:33.859376+0000","last_unstale":"2024-04-25T22:06:30.843505+0000","last_undegraded":"2024-04-25T22:06:30.843505+0000","last_fullsized":"2024-04-25T22:06:30.843505+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:08.620311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17620,"num_write":386,"num_write_kb":100613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"76'432","reported_seq":631,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141520+0000","last_change":"2024-04-25T22:06:23.128788+0000","last_active":"2024-04-25T22:06:31.141520+0000","last_peered":"2024-04-25T22:06:31.141520+0000","last_clean":"2024-04-25T22:06:31.141520+0000","last_became_active":"2024-04-25T22:06:23.081466+0000","last_became_peered":"2024-04-25T22:06:23.081466+0000","last_unstale":"2024-04-25T22:06:31.141520+0000","last_undegraded":"2024-04-25T22:06:31.141520+0000","last_fullsized":"2024-04-25T22:06:31.141520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:15.042731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27327,"num_write":398,"num_write_kb":76113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"76'385","reported_seq":584,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140840+0000","last_change":"2024-04-25T22:06:23.116284+0000","last_active":"2024-04-25T22:06:31.140840+0000","last_peered":"2024-04-25T22:06:31.140840+0000","last_clean":"2024-04-25T22:06:31.140840+0000","last_became_active":"2024-04-25T22:06:23.088046+0000","last_became_peered":"2024-04-25T22:06:23.088046+0000","last_unstale":"2024-04-25T22:06:31.140840+0000","last_undegraded":"2024-04-25T22:06:31.140840+0000","last_fullsized":"2024-04-25T22:06:31.140840+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:40:35.110567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23986,"num_write":352,"num_write_kb":50754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"76'434","reported_seq":615,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141488+0000","last_change":"2024-04-25T22:06:23.132996+0000","last_active":"2024-04-25T22:06:31.141488+0000","last_peered":"2024-04-25T22:06:31.141488+0000","last_clean":"2024-04-25T22:06:31.141488+0000","last_became_active":"2024-04-25T22:06:23.117497+0000","last_became_peered":"2024-04-25T22:06:23.117497+0000","last_unstale":"2024-04-25T22:06:31.141488+0000","last_undegraded":"2024-04-25T22:06:31.141488+0000","last_fullsized":"2024-04-25T22:06:31.141488+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:30.022312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":13806,"num_write":403,"num_write_kb":38995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"76'444","reported_seq":658,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851797+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:06:30.851797+0000","last_peered":"2024-04-25T22:06:30.851797+0000","last_clean":"2024-04-25T22:06:30.851797+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:06:30.851797+0000","last_undegraded":"2024-04-25T22:06:30.851797+0000","last_fullsized":"2024-04-25T22:06:30.851797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":11085,"num_write":416,"num_write_kb":68377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'396","reported_seq":531,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844593+0000","last_change":"2024-04-25T22:03:33.862762+0000","last_active":"2024-04-25T22:06:30.844593+0000","last_peered":"2024-04-25T22:06:30.844593+0000","last_clean":"2024-04-25T22:06:30.844593+0000","last_became_active":"2024-04-25T22:03:33.861082+0000","last_became_peered":"2024-04-25T22:03:33.861082+0000","last_unstale":"2024-04-25T22:06:30.844593+0000","last_undegraded":"2024-04-25T22:06:30.844593+0000","last_fullsized":"2024-04-25T22:06:30.844593+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:15.823113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6581,"num_write":355,"num_write_kb":34159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"76'447","reported_seq":648,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850341+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:06:30.850341+0000","last_peered":"2024-04-25T22:06:30.850341+0000","last_clean":"2024-04-25T22:06:30.850341+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:06:30.850341+0000","last_undegraded":"2024-04-25T22:06:30.850341+0000","last_fullsized":"2024-04-25T22:06:30.850341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22089,"num_write":411,"num_write_kb":104750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'426","reported_seq":604,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144109+0000","last_change":"2024-04-25T22:06:23.122769+0000","last_active":"2024-04-25T22:06:31.144109+0000","last_peered":"2024-04-25T22:06:31.144109+0000","last_clean":"2024-04-25T22:06:31.144109+0000","last_became_active":"2024-04-25T22:06:23.093379+0000","last_became_peered":"2024-04-25T22:06:23.093379+0000","last_unstale":"2024-04-25T22:06:31.144109+0000","last_undegraded":"2024-04-25T22:06:31.144109+0000","last_fullsized":"2024-04-25T22:06:31.144109+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:48.070891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11886,"num_write":398,"num_write_kb":55010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"76'405","reported_seq":602,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143776+0000","last_change":"2024-04-25T22:06:23.129396+0000","last_active":"2024-04-25T22:06:31.143776+0000","last_peered":"2024-04-25T22:06:31.143776+0000","last_clean":"2024-04-25T22:06:31.143776+0000","last_became_active":"2024-04-25T22:06:23.110101+0000","last_became_peered":"2024-04-25T22:06:23.110101+0000","last_unstale":"2024-04-25T22:06:31.143776+0000","last_undegraded":"2024-04-25T22:06:31.143776+0000","last_fullsized":"2024-04-25T22:06:31.143776+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:40.218610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23004,"num_write":370,"num_write_kb":75802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'436","reported_seq":559,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843341+0000","last_change":"2024-04-25T22:06:28.838562+0000","last_active":"2024-04-25T22:06:30.843341+0000","last_peered":"2024-04-25T22:06:30.843341+0000","last_clean":"2024-04-25T22:06:30.843341+0000","last_became_active":"2024-04-25T22:06:28.835081+0000","last_became_peered":"2024-04-25T22:06:28.835081+0000","last_unstale":"2024-04-25T22:06:30.843341+0000","last_undegraded":"2024-04-25T22:06:30.843341+0000","last_fullsized":"2024-04-25T22:06:30.843341+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:15:18.057041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11950,"num_write":408,"num_write_kb":67524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"76'403","reported_seq":607,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.847686+0000","last_change":"2024-04-25T22:06:22.810930+0000","last_active":"2024-04-25T22:06:30.847686+0000","last_peered":"2024-04-25T22:06:30.847686+0000","last_clean":"2024-04-25T22:06:30.847686+0000","last_became_active":"2024-04-25T22:06:22.802907+0000","last_became_peered":"2024-04-25T22:06:22.802907+0000","last_unstale":"2024-04-25T22:06:30.847686+0000","last_undegraded":"2024-04-25T22:06:30.847686+0000","last_fullsized":"2024-04-25T22:06:30.847686+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:00.334109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":6507,"num_write":370,"num_write_kb":51513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'449","reported_seq":574,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842684+0000","last_change":"2024-04-25T22:06:28.846531+0000","last_active":"2024-04-25T22:06:30.842684+0000","last_peered":"2024-04-25T22:06:30.842684+0000","last_clean":"2024-04-25T22:06:30.842684+0000","last_became_active":"2024-04-25T22:06:28.841283+0000","last_became_peered":"2024-04-25T22:06:28.841283+0000","last_unstale":"2024-04-25T22:06:30.842684+0000","last_undegraded":"2024-04-25T22:06:30.842684+0000","last_fullsized":"2024-04-25T22:06:30.842684+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:02.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27047,"num_write":417,"num_write_kb":63386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"76'406","reported_seq":571,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845286+0000","last_change":"2024-04-25T22:06:22.801634+0000","last_active":"2024-04-25T22:06:30.845286+0000","last_peered":"2024-04-25T22:06:30.845286+0000","last_clean":"2024-04-25T22:06:30.845286+0000","last_became_active":"2024-04-25T22:06:22.791470+0000","last_became_peered":"2024-04-25T22:06:22.791470+0000","last_unstale":"2024-04-25T22:06:30.845286+0000","last_undegraded":"2024-04-25T22:06:30.845286+0000","last_fullsized":"2024-04-25T22:06:30.845286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:25.424659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25550,"num_write":386,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"76'485","reported_seq":735,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850945+0000","last_change":"2024-04-25T22:06:22.814124+0000","last_active":"2024-04-25T22:06:30.850945+0000","last_peered":"2024-04-25T22:06:30.850945+0000","last_clean":"2024-04-25T22:06:30.850945+0000","last_became_active":"2024-04-25T22:06:22.804228+0000","last_became_peered":"2024-04-25T22:06:22.804228+0000","last_unstale":"2024-04-25T22:06:30.850945+0000","last_undegraded":"2024-04-25T22:06:30.850945+0000","last_fullsized":"2024-04-25T22:06:30.850945+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":30714,"num_write":444,"num_write_kb":92836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'387","reported_seq":592,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144694+0000","last_change":"2024-04-25T22:06:23.134971+0000","last_active":"2024-04-25T22:06:31.144694+0000","last_peered":"2024-04-25T22:06:31.144694+0000","last_clean":"2024-04-25T22:06:31.144694+0000","last_became_active":"2024-04-25T22:06:23.121334+0000","last_became_peered":"2024-04-25T22:06:23.121334+0000","last_unstale":"2024-04-25T22:06:31.144694+0000","last_undegraded":"2024-04-25T22:06:31.144694+0000","last_fullsized":"2024-04-25T22:06:31.144694+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:03.991336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21644,"num_write":354,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"76'405","reported_seq":649,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844816+0000","last_change":"2024-04-25T22:06:22.829889+0000","last_active":"2024-04-25T22:06:30.844816+0000","last_peered":"2024-04-25T22:06:30.844816+0000","last_clean":"2024-04-25T22:06:30.844816+0000","last_became_active":"2024-04-25T22:06:22.827066+0000","last_became_peered":"2024-04-25T22:06:22.827066+0000","last_unstale":"2024-04-25T22:06:30.844816+0000","last_undegraded":"2024-04-25T22:06:30.844816+0000","last_fullsized":"2024-04-25T22:06:30.844816+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:01.822252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27522,"num_write":375,"num_write_kb":96416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"76'396","reported_seq":619,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850059+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:06:30.850059+0000","last_peered":"2024-04-25T22:06:30.850059+0000","last_clean":"2024-04-25T22:06:30.850059+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:06:30.850059+0000","last_undegraded":"2024-04-25T22:06:30.850059+0000","last_fullsized":"2024-04-25T22:06:30.850059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28501,"num_write":367,"num_write_kb":63458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":654,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843955+0000","last_change":"2024-04-25T22:06:22.803787+0000","last_active":"2024-04-25T22:06:30.843955+0000","last_peered":"2024-04-25T22:06:30.843955+0000","last_clean":"2024-04-25T22:06:30.843955+0000","last_became_active":"2024-04-25T22:06:22.789907+0000","last_became_peered":"2024-04-25T22:06:22.789907+0000","last_unstale":"2024-04-25T22:06:30.843955+0000","last_undegraded":"2024-04-25T22:06:30.843955+0000","last_fullsized":"2024-04-25T22:06:30.843955+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":20717,"num_write":435,"num_write_kb":55985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"76'444","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848333+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:06:30.848333+0000","last_peered":"2024-04-25T22:06:30.848333+0000","last_clean":"2024-04-25T22:06:30.848333+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:06:30.848333+0000","last_undegraded":"2024-04-25T22:06:30.848333+0000","last_fullsized":"2024-04-25T22:06:30.848333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":10758,"num_write":401,"num_write_kb":44705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'422","reported_seq":533,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.160927+0000","last_change":"2024-04-25T22:06:31.160927+0000","last_active":"2024-04-25T22:06:31.160927+0000","last_peered":"2024-04-25T22:06:31.160927+0000","last_clean":"2024-04-25T22:06:31.160927+0000","last_became_active":"2024-04-25T22:06:31.148129+0000","last_became_peered":"2024-04-25T22:06:31.148129+0000","last_unstale":"2024-04-25T22:06:31.160927+0000","last_undegraded":"2024-04-25T22:06:31.160927+0000","last_fullsized":"2024-04-25T22:06:31.160927+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:26:06.579471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":29059,"num_write":391,"num_write_kb":40233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"76'397","reported_seq":894,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844568+0000","last_change":"2024-04-25T22:06:26.819859+0000","last_active":"2024-04-25T22:06:30.844568+0000","last_peered":"2024-04-25T22:06:30.844568+0000","last_clean":"2024-04-25T22:06:30.844568+0000","last_became_active":"2024-04-25T22:06:26.816439+0000","last_became_peered":"2024-04-25T22:06:26.816439+0000","last_unstale":"2024-04-25T22:06:30.844568+0000","last_undegraded":"2024-04-25T22:06:30.844568+0000","last_fullsized":"2024-04-25T22:06:30.844568+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:44.452918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28857,"num_write":363,"num_write_kb":87969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"75'515","reported_seq":671,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142622+0000","last_change":"2024-04-25T22:06:23.117492+0000","last_active":"2024-04-25T22:06:31.142622+0000","last_peered":"2024-04-25T22:06:31.142622+0000","last_clean":"2024-04-25T22:06:31.142622+0000","last_became_active":"2024-04-25T22:06:23.109665+0000","last_became_peered":"2024-04-25T22:06:23.109665+0000","last_unstale":"2024-04-25T22:06:31.142622+0000","last_undegraded":"2024-04-25T22:06:31.142622+0000","last_fullsized":"2024-04-25T22:06:31.142622+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:01.482888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"76'375","reported_seq":481,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845202+0000","last_change":"2024-04-25T22:06:28.846182+0000","last_active":"2024-04-25T22:06:30.845202+0000","last_peered":"2024-04-25T22:06:30.845202+0000","last_clean":"2024-04-25T22:06:30.845202+0000","last_became_active":"2024-04-25T22:06:28.841545+0000","last_became_peered":"2024-04-25T22:06:28.841545+0000","last_unstale":"2024-04-25T22:06:30.845202+0000","last_undegraded":"2024-04-25T22:06:30.845202+0000","last_fullsized":"2024-04-25T22:06:30.845202+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.018915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14983,"num_write":339,"num_write_kb":46748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'53","reported_seq":237,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849016+0000","last_change":"2024-04-25T22:06:22.839083+0000","last_active":"2024-04-25T22:06:30.849016+0000","last_peered":"2024-04-25T22:06:30.849016+0000","last_clean":"2024-04-25T22:06:30.849016+0000","last_became_active":"2024-04-25T22:06:22.833424+0000","last_became_peered":"2024-04-25T22:06:22.833424+0000","last_unstale":"2024-04-25T22:06:30.849016+0000","last_undegraded":"2024-04-25T22:06:30.849016+0000","last_fullsized":"2024-04-25T22:06:30.849016+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:00.819067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'426","reported_seq":639,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851784+0000","last_change":"2024-04-25T22:06:26.822923+0000","last_active":"2024-04-25T22:06:30.851784+0000","last_peered":"2024-04-25T22:06:30.851784+0000","last_clean":"2024-04-25T22:06:30.851784+0000","last_became_active":"2024-04-25T22:06:26.819562+0000","last_became_peered":"2024-04-25T22:06:26.819562+0000","last_unstale":"2024-04-25T22:06:30.851784+0000","last_undegraded":"2024-04-25T22:06:30.851784+0000","last_fullsized":"2024-04-25T22:06:30.851784+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:42.832195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":17843,"num_write":388,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"75'71","reported_seq":188,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843496+0000","last_change":"2024-04-25T22:06:22.799710+0000","last_active":"2024-04-25T22:06:30.843496+0000","last_peered":"2024-04-25T22:06:30.843496+0000","last_clean":"2024-04-25T22:06:30.843496+0000","last_became_active":"2024-04-25T22:06:22.790902+0000","last_became_peered":"2024-04-25T22:06:22.790902+0000","last_unstale":"2024-04-25T22:06:30.843496+0000","last_undegraded":"2024-04-25T22:06:30.843496+0000","last_fullsized":"2024-04-25T22:06:30.843496+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:50:36.683583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'366","reported_seq":571,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850882+0000","last_change":"2024-04-25T22:06:22.809150+0000","last_active":"2024-04-25T22:06:30.850882+0000","last_peered":"2024-04-25T22:06:30.850882+0000","last_clean":"2024-04-25T22:06:30.850882+0000","last_became_active":"2024-04-25T22:06:22.803327+0000","last_became_peered":"2024-04-25T22:06:22.803327+0000","last_unstale":"2024-04-25T22:06:30.850882+0000","last_undegraded":"2024-04-25T22:06:30.850882+0000","last_fullsized":"2024-04-25T22:06:30.850882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.731906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":16032,"num_write":334,"num_write_kb":25754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'63","reported_seq":221,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140280+0000","last_change":"2024-04-25T22:06:23.085892+0000","last_active":"2024-04-25T22:06:31.140280+0000","last_peered":"2024-04-25T22:06:31.140280+0000","last_clean":"2024-04-25T22:06:31.140280+0000","last_became_active":"2024-04-25T22:06:23.082351+0000","last_became_peered":"2024-04-25T22:06:23.082351+0000","last_unstale":"2024-04-25T22:06:31.140280+0000","last_undegraded":"2024-04-25T22:06:31.140280+0000","last_fullsized":"2024-04-25T22:06:31.140280+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:51.142517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"76'148","reported_seq":306,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143742+0000","last_change":"2024-04-25T22:06:23.089179+0000","last_active":"2024-04-25T22:06:31.143742+0000","last_peered":"2024-04-25T22:06:31.143742+0000","last_clean":"2024-04-25T22:06:31.143742+0000","last_became_active":"2024-04-25T22:06:23.085599+0000","last_became_peered":"2024-04-25T22:06:23.085599+0000","last_unstale":"2024-04-25T22:06:31.143742+0000","last_undegraded":"2024-04-25T22:06:31.143742+0000","last_fullsized":"2024-04-25T22:06:31.143742+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:53:14.055158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"76'402","reported_seq":568,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842703+0000","last_change":"2024-04-25T22:06:22.802685+0000","last_active":"2024-04-25T22:06:30.842703+0000","last_peered":"2024-04-25T22:06:30.842703+0000","last_clean":"2024-04-25T22:06:30.842703+0000","last_became_active":"2024-04-25T22:06:22.789353+0000","last_became_peered":"2024-04-25T22:06:22.789353+0000","last_unstale":"2024-04-25T22:06:30.842703+0000","last_undegraded":"2024-04-25T22:06:30.842703+0000","last_fullsized":"2024-04-25T22:06:30.842703+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:14.949049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21114,"num_write":364,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"75'250","reported_seq":374,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844891+0000","last_change":"2024-04-25T22:06:22.791598+0000","last_active":"2024-04-25T22:06:30.844891+0000","last_peered":"2024-04-25T22:06:30.844891+0000","last_clean":"2024-04-25T22:06:30.844891+0000","last_became_active":"2024-04-25T22:06:22.790508+0000","last_became_peered":"2024-04-25T22:06:22.790508+0000","last_unstale":"2024-04-25T22:06:30.844891+0000","last_undegraded":"2024-04-25T22:06:30.844891+0000","last_fullsized":"2024-04-25T22:06:30.844891+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"76'460","reported_seq":634,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842903+0000","last_change":"2024-04-25T22:03:33.861055+0000","last_active":"2024-04-25T22:06:30.842903+0000","last_peered":"2024-04-25T22:06:30.842903+0000","last_clean":"2024-04-25T22:06:30.842903+0000","last_became_active":"2024-04-25T22:03:33.856638+0000","last_became_peered":"2024-04-25T22:03:33.856638+0000","last_unstale":"2024-04-25T22:06:30.842903+0000","last_undegraded":"2024-04-25T22:06:30.842903+0000","last_fullsized":"2024-04-25T22:06:30.842903+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":39774,"num_write":433,"num_write_kb":80294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'556","reported_seq":714,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.148664+0000","last_change":"2024-04-25T22:06:31.148664+0000","last_active":"2024-04-25T22:06:31.148664+0000","last_peered":"2024-04-25T22:06:31.148664+0000","last_clean":"2024-04-25T22:06:31.148664+0000","last_became_active":"2024-04-25T22:06:31.147569+0000","last_became_peered":"2024-04-25T22:06:31.147569+0000","last_unstale":"2024-04-25T22:06:31.148664+0000","last_undegraded":"2024-04-25T22:06:31.148664+0000","last_fullsized":"2024-04-25T22:06:31.148664+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:41.798311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":509,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"76'413","reported_seq":577,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142062+0000","last_change":"2024-04-25T22:06:23.129627+0000","last_active":"2024-04-25T22:06:31.142062+0000","last_peered":"2024-04-25T22:06:31.142062+0000","last_clean":"2024-04-25T22:06:31.142062+0000","last_became_active":"2024-04-25T22:06:23.108199+0000","last_became_peered":"2024-04-25T22:06:23.108199+0000","last_unstale":"2024-04-25T22:06:31.142062+0000","last_undegraded":"2024-04-25T22:06:31.142062+0000","last_fullsized":"2024-04-25T22:06:31.142062+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:23.828740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4858,"num_write":378,"num_write_kb":46741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"76'66","reported_seq":77,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161275+0000","last_change":"2024-04-25T22:06:31.161275+0000","last_active":"2024-04-25T22:06:31.161275+0000","last_peered":"2024-04-25T22:06:31.161275+0000","last_clean":"2024-04-25T22:06:31.161275+0000","last_became_active":"2024-04-25T22:06:31.160267+0000","last_became_peered":"2024-04-25T22:06:31.160267+0000","last_unstale":"2024-04-25T22:06:31.161275+0000","last_undegraded":"2024-04-25T22:06:31.161275+0000","last_fullsized":"2024-04-25T22:06:31.161275+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:14.214127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"76'489","reported_seq":729,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850154+0000","last_change":"2024-04-25T22:06:22.838952+0000","last_active":"2024-04-25T22:06:30.850154+0000","last_peered":"2024-04-25T22:06:30.850154+0000","last_clean":"2024-04-25T22:06:30.850154+0000","last_became_active":"2024-04-25T22:06:22.832394+0000","last_became_peered":"2024-04-25T22:06:22.832394+0000","last_unstale":"2024-04-25T22:06:30.850154+0000","last_undegraded":"2024-04-25T22:06:30.850154+0000","last_fullsized":"2024-04-25T22:06:30.850154+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:04:38.988916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":26829,"num_write":457,"num_write_kb":137840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"75'193","reported_seq":377,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850501+0000","last_change":"2024-04-25T22:06:22.838157+0000","last_active":"2024-04-25T22:06:30.850501+0000","last_peered":"2024-04-25T22:06:30.850501+0000","last_clean":"2024-04-25T22:06:30.850501+0000","last_became_active":"2024-04-25T22:06:22.832572+0000","last_became_peered":"2024-04-25T22:06:22.832572+0000","last_unstale":"2024-04-25T22:06:30.850501+0000","last_undegraded":"2024-04-25T22:06:30.850501+0000","last_fullsized":"2024-04-25T22:06:30.850501+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:34.994194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'437","reported_seq":528,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.160788+0000","last_change":"2024-04-25T22:06:31.160788+0000","last_active":"2024-04-25T22:06:31.160788+0000","last_peered":"2024-04-25T22:06:31.160788+0000","last_clean":"2024-04-25T22:06:31.160788+0000","last_became_active":"2024-04-25T22:06:31.147501+0000","last_became_peered":"2024-04-25T22:06:31.147501+0000","last_unstale":"2024-04-25T22:06:31.160788+0000","last_undegraded":"2024-04-25T22:06:31.160788+0000","last_fullsized":"2024-04-25T22:06:31.160788+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:30:29.866840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3720,"num_write":406,"num_write_kb":30461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"76'106","reported_seq":264,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140763+0000","last_change":"2024-04-25T22:06:23.128769+0000","last_active":"2024-04-25T22:06:31.140763+0000","last_peered":"2024-04-25T22:06:31.140763+0000","last_clean":"2024-04-25T22:06:31.140763+0000","last_became_active":"2024-04-25T22:06:23.103402+0000","last_became_peered":"2024-04-25T22:06:23.103402+0000","last_unstale":"2024-04-25T22:06:31.140763+0000","last_undegraded":"2024-04-25T22:06:31.140763+0000","last_fullsized":"2024-04-25T22:06:31.140763+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:27.137773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"76'409","reported_seq":605,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143850+0000","last_change":"2024-04-25T22:06:23.133536+0000","last_active":"2024-04-25T22:06:31.143850+0000","last_peered":"2024-04-25T22:06:31.143850+0000","last_clean":"2024-04-25T22:06:31.143850+0000","last_became_active":"2024-04-25T22:06:23.086188+0000","last_became_peered":"2024-04-25T22:06:23.086188+0000","last_unstale":"2024-04-25T22:06:31.143850+0000","last_undegraded":"2024-04-25T22:06:31.143850+0000","last_fullsized":"2024-04-25T22:06:31.143850+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:13:59.140479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19178,"num_write":380,"num_write_kb":91945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"75'51","reported_seq":182,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843314+0000","last_change":"2024-04-25T22:06:22.800659+0000","last_active":"2024-04-25T22:06:30.843314+0000","last_peered":"2024-04-25T22:06:30.843314+0000","last_clean":"2024-04-25T22:06:30.843314+0000","last_became_active":"2024-04-25T22:06:22.798779+0000","last_became_peered":"2024-04-25T22:06:22.798779+0000","last_unstale":"2024-04-25T22:06:30.843314+0000","last_undegraded":"2024-04-25T22:06:30.843314+0000","last_fullsized":"2024-04-25T22:06:30.843314+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:35.728722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"76'377","reported_seq":561,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143491+0000","last_change":"2024-04-25T22:06:23.114225+0000","last_active":"2024-04-25T22:06:31.143491+0000","last_peered":"2024-04-25T22:06:31.143491+0000","last_clean":"2024-04-25T22:06:31.143491+0000","last_became_active":"2024-04-25T22:06:23.085799+0000","last_became_peered":"2024-04-25T22:06:23.085799+0000","last_unstale":"2024-04-25T22:06:31.143491+0000","last_undegraded":"2024-04-25T22:06:31.143491+0000","last_fullsized":"2024-04-25T22:06:31.143491+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:50.484372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21517,"num_write":342,"num_write_kb":66898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"75'449","reported_seq":546,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843127+0000","last_change":"2024-04-25T22:03:33.860386+0000","last_active":"2024-04-25T22:06:30.843127+0000","last_peered":"2024-04-25T22:06:30.843127+0000","last_clean":"2024-04-25T22:06:30.843127+0000","last_became_active":"2024-04-25T22:03:33.859539+0000","last_became_peered":"2024-04-25T22:03:33.859539+0000","last_unstale":"2024-04-25T22:06:30.843127+0000","last_undegraded":"2024-04-25T22:06:30.843127+0000","last_fullsized":"2024-04-25T22:06:30.843127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:20.247942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'399","reported_seq":613,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850961+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:06:30.850961+0000","last_peered":"2024-04-25T22:06:30.850961+0000","last_clean":"2024-04-25T22:06:30.850961+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:06:30.850961+0000","last_undegraded":"2024-04-25T22:06:30.850961+0000","last_fullsized":"2024-04-25T22:06:30.850961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17888,"num_write":373,"num_write_kb":67556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":318,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140066+0000","last_change":"2024-04-25T22:06:23.082707+0000","last_active":"2024-04-25T22:06:31.140066+0000","last_peered":"2024-04-25T22:06:31.140066+0000","last_clean":"2024-04-25T22:06:31.140066+0000","last_became_active":"2024-04-25T22:06:23.080701+0000","last_became_peered":"2024-04-25T22:06:23.080701+0000","last_unstale":"2024-04-25T22:06:31.140066+0000","last_undegraded":"2024-04-25T22:06:31.140066+0000","last_fullsized":"2024-04-25T22:06:31.140066+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:27.088849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141705+0000","last_change":"2024-04-25T22:06:23.116373+0000","last_active":"2024-04-25T22:06:31.141705+0000","last_peered":"2024-04-25T22:06:31.141705+0000","last_clean":"2024-04-25T22:06:31.141705+0000","last_became_active":"2024-04-25T22:06:23.108984+0000","last_became_peered":"2024-04-25T22:06:23.108984+0000","last_unstale":"2024-04-25T22:06:31.141705+0000","last_undegraded":"2024-04-25T22:06:31.141705+0000","last_fullsized":"2024-04-25T22:06:31.141705+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:08.884723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"75'393","reported_seq":570,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849474+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:06:30.849474+0000","last_peered":"2024-04-25T22:06:30.849474+0000","last_clean":"2024-04-25T22:06:30.849474+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:06:30.849474+0000","last_undegraded":"2024-04-25T22:06:30.849474+0000","last_fullsized":"2024-04-25T22:06:30.849474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'463","reported_seq":668,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144389+0000","last_change":"2024-04-25T22:06:23.133028+0000","last_active":"2024-04-25T22:06:31.144389+0000","last_peered":"2024-04-25T22:06:31.144389+0000","last_clean":"2024-04-25T22:06:31.144389+0000","last_became_active":"2024-04-25T22:06:23.082756+0000","last_became_peered":"2024-04-25T22:06:23.082756+0000","last_unstale":"2024-04-25T22:06:31.144389+0000","last_undegraded":"2024-04-25T22:06:31.144389+0000","last_fullsized":"2024-04-25T22:06:31.144389+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:24:01.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29270,"num_write":426,"num_write_kb":129367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141100+0000","last_change":"2024-04-25T22:06:23.083451+0000","last_active":"2024-04-25T22:06:31.141100+0000","last_peered":"2024-04-25T22:06:31.141100+0000","last_clean":"2024-04-25T22:06:31.141100+0000","last_became_active":"2024-04-25T22:06:23.080841+0000","last_became_peered":"2024-04-25T22:06:23.080841+0000","last_unstale":"2024-04-25T22:06:31.141100+0000","last_undegraded":"2024-04-25T22:06:31.141100+0000","last_fullsized":"2024-04-25T22:06:31.141100+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:34.605367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"76'125","reported_seq":372,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849223+0000","last_change":"2024-04-25T22:06:22.804290+0000","last_active":"2024-04-25T22:06:30.849223+0000","last_peered":"2024-04-25T22:06:30.849223+0000","last_clean":"2024-04-25T22:06:30.849223+0000","last_became_active":"2024-04-25T22:06:22.801616+0000","last_became_peered":"2024-04-25T22:06:22.801616+0000","last_unstale":"2024-04-25T22:06:30.849223+0000","last_undegraded":"2024-04-25T22:06:30.849223+0000","last_fullsized":"2024-04-25T22:06:30.849223+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:13.402747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464197,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":63,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'457","reported_seq":646,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844136+0000","last_change":"2024-04-25T22:03:05.702224+0000","last_active":"2024-04-25T22:06:30.844136+0000","last_peered":"2024-04-25T22:06:30.844136+0000","last_clean":"2024-04-25T22:06:30.844136+0000","last_became_active":"2024-04-25T22:03:05.699581+0000","last_became_peered":"2024-04-25T22:03:05.699581+0000","last_unstale":"2024-04-25T22:06:30.844136+0000","last_undegraded":"2024-04-25T22:06:30.844136+0000","last_fullsized":"2024-04-25T22:06:30.844136+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":34759,"num_write":424,"num_write_kb":71902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849418+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:06:30.849418+0000","last_peered":"2024-04-25T22:06:30.849418+0000","last_clean":"2024-04-25T22:06:30.849418+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:06:30.849418+0000","last_undegraded":"2024-04-25T22:06:30.849418+0000","last_fullsized":"2024-04-25T22:06:30.849418+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"75'311","reported_seq":496,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843037+0000","last_change":"2024-04-25T22:06:22.801481+0000","last_active":"2024-04-25T22:06:30.843037+0000","last_peered":"2024-04-25T22:06:30.843037+0000","last_clean":"2024-04-25T22:06:30.843037+0000","last_became_active":"2024-04-25T22:06:22.794841+0000","last_became_peered":"2024-04-25T22:06:22.794841+0000","last_unstale":"2024-04-25T22:06:30.843037+0000","last_undegraded":"2024-04-25T22:06:30.843037+0000","last_fullsized":"2024-04-25T22:06:30.843037+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:06:59.330924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"76'373","reported_seq":592,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851291+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:06:30.851291+0000","last_peered":"2024-04-25T22:06:30.851291+0000","last_clean":"2024-04-25T22:06:30.851291+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:06:30.851291+0000","last_undegraded":"2024-04-25T22:06:30.851291+0000","last_fullsized":"2024-04-25T22:06:30.851291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28273,"num_write":350,"num_write_kb":87787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140545+0000","last_change":"2024-04-25T22:06:23.129162+0000","last_active":"2024-04-25T22:06:31.140545+0000","last_peered":"2024-04-25T22:06:31.140545+0000","last_clean":"2024-04-25T22:06:31.140545+0000","last_became_active":"2024-04-25T22:06:23.106155+0000","last_became_peered":"2024-04-25T22:06:23.106155+0000","last_unstale":"2024-04-25T22:06:31.140545+0000","last_undegraded":"2024-04-25T22:06:31.140545+0000","last_fullsized":"2024-04-25T22:06:31.140545+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:30.846068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"76'75","reported_seq":77,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161388+0000","last_change":"2024-04-25T22:06:31.161388+0000","last_active":"2024-04-25T22:06:31.161388+0000","last_peered":"2024-04-25T22:06:31.161388+0000","last_clean":"2024-04-25T22:06:31.161388+0000","last_became_active":"2024-04-25T22:06:31.150555+0000","last_became_peered":"2024-04-25T22:06:31.150555+0000","last_unstale":"2024-04-25T22:06:31.161388+0000","last_undegraded":"2024-04-25T22:06:31.161388+0000","last_fullsized":"2024-04-25T22:06:31.161388+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:56:50.706657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"76'461","reported_seq":753,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850519+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:06:30.850519+0000","last_peered":"2024-04-25T22:06:30.850519+0000","last_clean":"2024-04-25T22:06:30.850519+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:06:30.850519+0000","last_undegraded":"2024-04-25T22:06:30.850519+0000","last_fullsized":"2024-04-25T22:06:30.850519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":67984,"num_write":425,"num_write_kb":154741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"76'268","reported_seq":425,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143156+0000","last_change":"2024-04-25T22:06:23.134306+0000","last_active":"2024-04-25T22:06:31.143156+0000","last_peered":"2024-04-25T22:06:31.143156+0000","last_clean":"2024-04-25T22:06:31.143156+0000","last_became_active":"2024-04-25T22:06:23.122629+0000","last_became_peered":"2024-04-25T22:06:23.122629+0000","last_unstale":"2024-04-25T22:06:31.143156+0000","last_undegraded":"2024-04-25T22:06:31.143156+0000","last_fullsized":"2024-04-25T22:06:31.143156+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:41.205934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850998+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:06:30.850998+0000","last_peered":"2024-04-25T22:06:30.850998+0000","last_clean":"2024-04-25T22:06:30.850998+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:06:30.850998+0000","last_undegraded":"2024-04-25T22:06:30.850998+0000","last_fullsized":"2024-04-25T22:06:30.850998+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'398","reported_seq":578,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843743+0000","last_change":"2024-04-25T22:06:22.797468+0000","last_active":"2024-04-25T22:06:30.843743+0000","last_peered":"2024-04-25T22:06:30.843743+0000","last_clean":"2024-04-25T22:06:30.843743+0000","last_became_active":"2024-04-25T22:06:22.789384+0000","last_became_peered":"2024-04-25T22:06:22.789384+0000","last_unstale":"2024-04-25T22:06:30.843743+0000","last_undegraded":"2024-04-25T22:06:30.843743+0000","last_fullsized":"2024-04-25T22:06:30.843743+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:35.557386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":26599,"num_write":366,"num_write_kb":75612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"76'47","reported_seq":224,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850762+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:06:30.850762+0000","last_peered":"2024-04-25T22:06:30.850762+0000","last_clean":"2024-04-25T22:06:30.850762+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:06:30.850762+0000","last_undegraded":"2024-04-25T22:06:30.850762+0000","last_fullsized":"2024-04-25T22:06:30.850762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":171,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845730+0000","last_change":"2024-04-25T22:03:05.701809+0000","last_active":"2024-04-25T22:06:30.845730+0000","last_peered":"2024-04-25T22:06:30.845730+0000","last_clean":"2024-04-25T22:06:30.845730+0000","last_became_active":"2024-04-25T22:03:05.701322+0000","last_became_peered":"2024-04-25T22:03:05.701322+0000","last_unstale":"2024-04-25T22:06:30.845730+0000","last_undegraded":"2024-04-25T22:06:30.845730+0000","last_fullsized":"2024-04-25T22:06:30.845730+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:45.907458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"76'406","reported_seq":642,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844251+0000","last_change":"2024-04-25T22:06:22.802683+0000","last_active":"2024-04-25T22:06:30.844251+0000","last_peered":"2024-04-25T22:06:30.844251+0000","last_clean":"2024-04-25T22:06:30.844251+0000","last_became_active":"2024-04-25T22:06:22.789807+0000","last_became_peered":"2024-04-25T22:06:22.789807+0000","last_unstale":"2024-04-25T22:06:30.844251+0000","last_undegraded":"2024-04-25T22:06:30.844251+0000","last_fullsized":"2024-04-25T22:06:30.844251+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:15.180532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25634,"num_write":377,"num_write_kb":103970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"76'64","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.852026+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:06:30.852026+0000","last_peered":"2024-04-25T22:06:30.852026+0000","last_clean":"2024-04-25T22:06:30.852026+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:06:30.852026+0000","last_undegraded":"2024-04-25T22:06:30.852026+0000","last_fullsized":"2024-04-25T22:06:30.852026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142483+0000","last_change":"2024-04-25T22:06:24.092672+0000","last_active":"2024-04-25T22:06:31.142483+0000","last_peered":"2024-04-25T22:06:31.142483+0000","last_clean":"2024-04-25T22:06:31.142483+0000","last_became_active":"2024-04-25T22:06:24.091909+0000","last_became_peered":"2024-04-25T22:06:24.091909+0000","last_unstale":"2024-04-25T22:06:31.142483+0000","last_undegraded":"2024-04-25T22:06:31.142483+0000","last_fullsized":"2024-04-25T22:06:31.142483+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:19:21.605435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"76'402","reported_seq":605,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848860+0000","last_change":"2024-04-25T22:06:22.809713+0000","last_active":"2024-04-25T22:06:30.848860+0000","last_peered":"2024-04-25T22:06:30.848860+0000","last_clean":"2024-04-25T22:06:30.848860+0000","last_became_active":"2024-04-25T22:06:22.802005+0000","last_became_peered":"2024-04-25T22:06:22.802005+0000","last_unstale":"2024-04-25T22:06:30.848860+0000","last_undegraded":"2024-04-25T22:06:30.848860+0000","last_fullsized":"2024-04-25T22:06:30.848860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9572,"num_write":361,"num_write_kb":29911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"77'127","reported_seq":311,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851852+0000","last_change":"2024-04-25T22:06:22.804851+0000","last_active":"2024-04-25T22:06:30.851852+0000","last_peered":"2024-04-25T22:06:30.851852+0000","last_clean":"2024-04-25T22:06:30.851852+0000","last_became_active":"2024-04-25T22:06:22.802083+0000","last_became_peered":"2024-04-25T22:06:22.802083+0000","last_unstale":"2024-04-25T22:06:30.851852+0000","last_undegraded":"2024-04-25T22:06:30.851852+0000","last_fullsized":"2024-04-25T22:06:30.851852+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142866+0000","last_change":"2024-04-25T22:06:23.081230+0000","last_active":"2024-04-25T22:06:31.142866+0000","last_peered":"2024-04-25T22:06:31.142866+0000","last_clean":"2024-04-25T22:06:31.142866+0000","last_became_active":"2024-04-25T22:06:23.080393+0000","last_became_peered":"2024-04-25T22:06:23.080393+0000","last_unstale":"2024-04-25T22:06:31.142866+0000","last_undegraded":"2024-04-25T22:06:31.142866+0000","last_fullsized":"2024-04-25T22:06:31.142866+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:55.157159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"76'415","reported_seq":596,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842908+0000","last_change":"2024-04-25T22:06:22.801327+0000","last_active":"2024-04-25T22:06:30.842908+0000","last_peered":"2024-04-25T22:06:30.842908+0000","last_clean":"2024-04-25T22:06:30.842908+0000","last_became_active":"2024-04-25T22:06:22.789624+0000","last_became_peered":"2024-04-25T22:06:22.789624+0000","last_unstale":"2024-04-25T22:06:30.842908+0000","last_undegraded":"2024-04-25T22:06:30.842908+0000","last_fullsized":"2024-04-25T22:06:30.842908+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27345,"num_write":384,"num_write_kb":92854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"76'407","reported_seq":623,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143259+0000","last_change":"2024-04-25T22:06:23.114739+0000","last_active":"2024-04-25T22:06:31.143259+0000","last_peered":"2024-04-25T22:06:31.143259+0000","last_clean":"2024-04-25T22:06:31.143259+0000","last_became_active":"2024-04-25T22:06:23.087118+0000","last_became_peered":"2024-04-25T22:06:23.087118+0000","last_unstale":"2024-04-25T22:06:31.143259+0000","last_undegraded":"2024-04-25T22:06:31.143259+0000","last_fullsized":"2024-04-25T22:06:31.143259+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:51.191212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33923,"num_write":372,"num_write_kb":82083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"77'260","reported_seq":420,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142062+0000","last_change":"2024-04-25T22:06:23.083331+0000","last_active":"2024-04-25T22:06:31.142062+0000","last_peered":"2024-04-25T22:06:31.142062+0000","last_clean":"2024-04-25T22:06:31.142062+0000","last_became_active":"2024-04-25T22:06:23.080552+0000","last_became_peered":"2024-04-25T22:06:23.080552+0000","last_unstale":"2024-04-25T22:06:31.142062+0000","last_undegraded":"2024-04-25T22:06:31.142062+0000","last_fullsized":"2024-04-25T22:06:31.142062+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:55.928212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8470619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"76'408","reported_seq":610,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848693+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:06:30.848693+0000","last_peered":"2024-04-25T22:06:30.848693+0000","last_clean":"2024-04-25T22:06:30.848693+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:06:30.848693+0000","last_undegraded":"2024-04-25T22:06:30.848693+0000","last_fullsized":"2024-04-25T22:06:30.848693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14178,"num_write":370,"num_write_kb":58735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'104","reported_seq":289,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845584+0000","last_change":"2024-04-25T22:06:22.805389+0000","last_active":"2024-04-25T22:06:30.845584+0000","last_peered":"2024-04-25T22:06:30.845584+0000","last_clean":"2024-04-25T22:06:30.845584+0000","last_became_active":"2024-04-25T22:06:22.802667+0000","last_became_peered":"2024-04-25T22:06:22.802667+0000","last_unstale":"2024-04-25T22:06:30.845584+0000","last_undegraded":"2024-04-25T22:06:30.845584+0000","last_fullsized":"2024-04-25T22:06:30.845584+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:38.785650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"75'232","reported_seq":286,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.151793+0000","last_change":"2024-04-25T22:06:31.151793+0000","last_active":"2024-04-25T22:06:31.151793+0000","last_peered":"2024-04-25T22:06:31.151793+0000","last_clean":"2024-04-25T22:06:31.151793+0000","last_became_active":"2024-04-25T22:06:31.150582+0000","last_became_peered":"2024-04-25T22:06:31.150582+0000","last_unstale":"2024-04-25T22:06:31.151793+0000","last_undegraded":"2024-04-25T22:06:31.151793+0000","last_fullsized":"2024-04-25T22:06:31.151793+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:49.932959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"76'483","reported_seq":713,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848496+0000","last_change":"2024-04-25T22:06:22.814119+0000","last_active":"2024-04-25T22:06:30.848496+0000","last_peered":"2024-04-25T22:06:30.848496+0000","last_clean":"2024-04-25T22:06:30.848496+0000","last_became_active":"2024-04-25T22:06:22.807584+0000","last_became_peered":"2024-04-25T22:06:22.807584+0000","last_unstale":"2024-04-25T22:06:30.848496+0000","last_undegraded":"2024-04-25T22:06:30.848496+0000","last_fullsized":"2024-04-25T22:06:30.848496+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:08.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24709,"num_write":463,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"75'60","reported_seq":244,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851719+0000","last_change":"2024-04-25T22:06:22.802356+0000","last_active":"2024-04-25T22:06:30.851719+0000","last_peered":"2024-04-25T22:06:30.851719+0000","last_clean":"2024-04-25T22:06:30.851719+0000","last_became_active":"2024-04-25T22:06:22.801412+0000","last_became_peered":"2024-04-25T22:06:22.801412+0000","last_unstale":"2024-04-25T22:06:30.851719+0000","last_undegraded":"2024-04-25T22:06:30.851719+0000","last_fullsized":"2024-04-25T22:06:30.851719+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:04.421952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'444","reported_seq":648,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848562+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:06:30.848562+0000","last_peered":"2024-04-25T22:06:30.848562+0000","last_clean":"2024-04-25T22:06:30.848562+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:06:30.848562+0000","last_undegraded":"2024-04-25T22:06:30.848562+0000","last_fullsized":"2024-04-25T22:06:30.848562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14429,"num_write":416,"num_write_kb":59186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'355","reported_seq":499,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845399+0000","last_change":"2024-04-25T22:06:22.804579+0000","last_active":"2024-04-25T22:06:30.845399+0000","last_peered":"2024-04-25T22:06:30.845399+0000","last_clean":"2024-04-25T22:06:30.845399+0000","last_became_active":"2024-04-25T22:06:22.792886+0000","last_became_peered":"2024-04-25T22:06:22.792886+0000","last_unstale":"2024-04-25T22:06:30.845399+0000","last_undegraded":"2024-04-25T22:06:30.845399+0000","last_fullsized":"2024-04-25T22:06:30.845399+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:54:35.464321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18236,"num_write":332,"num_write_kb":42553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"76'742","reported_seq":919,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849150+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:06:30.849150+0000","last_peered":"2024-04-25T22:06:30.849150+0000","last_clean":"2024-04-25T22:06:30.849150+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:06:30.849150+0000","last_undegraded":"2024-04-25T22:06:30.849150+0000","last_fullsized":"2024-04-25T22:06:30.849150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'378","reported_seq":579,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851532+0000","last_change":"2024-04-25T22:06:22.813642+0000","last_active":"2024-04-25T22:06:30.851532+0000","last_peered":"2024-04-25T22:06:30.851532+0000","last_clean":"2024-04-25T22:06:30.851532+0000","last_became_active":"2024-04-25T22:06:22.806240+0000","last_became_peered":"2024-04-25T22:06:22.806240+0000","last_unstale":"2024-04-25T22:06:30.851532+0000","last_undegraded":"2024-04-25T22:06:30.851532+0000","last_fullsized":"2024-04-25T22:06:30.851532+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6876,"num_write":354,"num_write_kb":46840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"76'204","reported_seq":388,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848941+0000","last_change":"2024-04-25T22:06:22.805022+0000","last_active":"2024-04-25T22:06:30.848941+0000","last_peered":"2024-04-25T22:06:30.848941+0000","last_clean":"2024-04-25T22:06:30.848941+0000","last_became_active":"2024-04-25T22:06:22.801630+0000","last_became_peered":"2024-04-25T22:06:22.801630+0000","last_unstale":"2024-04-25T22:06:30.848941+0000","last_undegraded":"2024-04-25T22:06:30.848941+0000","last_fullsized":"2024-04-25T22:06:30.848941+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:34.554201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'377","reported_seq":515,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845146+0000","last_change":"2024-04-25T22:06:22.805011+0000","last_active":"2024-04-25T22:06:30.845146+0000","last_peered":"2024-04-25T22:06:30.845146+0000","last_clean":"2024-04-25T22:06:30.845146+0000","last_became_active":"2024-04-25T22:06:22.795334+0000","last_became_peered":"2024-04-25T22:06:22.795334+0000","last_unstale":"2024-04-25T22:06:30.845146+0000","last_undegraded":"2024-04-25T22:06:30.845146+0000","last_fullsized":"2024-04-25T22:06:30.845146+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:35.997378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6059,"num_write":332,"num_write_kb":37972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"76'217","reported_seq":332,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844027+0000","last_change":"2024-04-25T22:06:28.842258+0000","last_active":"2024-04-25T22:06:30.844027+0000","last_peered":"2024-04-25T22:06:30.844027+0000","last_clean":"2024-04-25T22:06:30.844027+0000","last_became_active":"2024-04-25T22:06:28.841447+0000","last_became_peered":"2024-04-25T22:06:28.841447+0000","last_unstale":"2024-04-25T22:06:30.844027+0000","last_undegraded":"2024-04-25T22:06:30.844027+0000","last_fullsized":"2024-04-25T22:06:30.844027+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:31.009167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"76'389","reported_seq":542,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844243+0000","last_change":"2024-04-25T22:03:33.862286+0000","last_active":"2024-04-25T22:06:30.844243+0000","last_peered":"2024-04-25T22:06:30.844243+0000","last_clean":"2024-04-25T22:06:30.844243+0000","last_became_active":"2024-04-25T22:03:33.860800+0000","last_became_peered":"2024-04-25T22:03:33.860800+0000","last_unstale":"2024-04-25T22:06:30.844243+0000","last_undegraded":"2024-04-25T22:06:30.844243+0000","last_fullsized":"2024-04-25T22:06:30.844243+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:04.528174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19110,"num_write":355,"num_write_kb":63152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'51","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844734+0000","last_change":"2024-04-25T22:06:22.804880+0000","last_active":"2024-04-25T22:06:30.844734+0000","last_peered":"2024-04-25T22:06:30.844734+0000","last_clean":"2024-04-25T22:06:30.844734+0000","last_became_active":"2024-04-25T22:06:22.803778+0000","last_became_peered":"2024-04-25T22:06:22.803778+0000","last_unstale":"2024-04-25T22:06:30.844734+0000","last_undegraded":"2024-04-25T22:06:30.844734+0000","last_fullsized":"2024-04-25T22:06:30.844734+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:47:58.480071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"76'386","reported_seq":483,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161983+0000","last_change":"2024-04-25T22:06:31.161983+0000","last_active":"2024-04-25T22:06:31.161983+0000","last_peered":"2024-04-25T22:06:31.161983+0000","last_clean":"2024-04-25T22:06:31.161983+0000","last_became_active":"2024-04-25T22:06:31.149995+0000","last_became_peered":"2024-04-25T22:06:31.149995+0000","last_unstale":"2024-04-25T22:06:31.161983+0000","last_undegraded":"2024-04-25T22:06:31.161983+0000","last_fullsized":"2024-04-25T22:06:31.161983+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:07:32.261028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14050,"num_write":362,"num_write_kb":58957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"76'188","reported_seq":231,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.159971+0000","last_change":"2024-04-25T22:06:31.159971+0000","last_active":"2024-04-25T22:06:31.159971+0000","last_peered":"2024-04-25T22:06:31.159971+0000","last_clean":"2024-04-25T22:06:31.159971+0000","last_became_active":"2024-04-25T22:06:31.148291+0000","last_became_peered":"2024-04-25T22:06:31.148291+0000","last_unstale":"2024-04-25T22:06:31.159971+0000","last_undegraded":"2024-04-25T22:06:31.159971+0000","last_fullsized":"2024-04-25T22:06:31.159971+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:31.095798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"76'397","reported_seq":494,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.160300+0000","last_change":"2024-04-25T22:06:31.160300+0000","last_active":"2024-04-25T22:06:31.160300+0000","last_peered":"2024-04-25T22:06:31.160300+0000","last_clean":"2024-04-25T22:06:31.160300+0000","last_became_active":"2024-04-25T22:06:31.148445+0000","last_became_peered":"2024-04-25T22:06:31.148445+0000","last_unstale":"2024-04-25T22:06:31.160300+0000","last_undegraded":"2024-04-25T22:06:31.160300+0000","last_fullsized":"2024-04-25T22:06:31.160300+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:31.697126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13280,"num_write":364,"num_write_kb":46108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"75'284","reported_seq":414,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845419+0000","last_change":"2024-04-25T22:06:22.804561+0000","last_active":"2024-04-25T22:06:30.845419+0000","last_peered":"2024-04-25T22:06:30.845419+0000","last_clean":"2024-04-25T22:06:30.845419+0000","last_became_active":"2024-04-25T22:06:22.794078+0000","last_became_peered":"2024-04-25T22:06:22.794078+0000","last_unstale":"2024-04-25T22:06:30.845419+0000","last_undegraded":"2024-04-25T22:06:30.845419+0000","last_fullsized":"2024-04-25T22:06:30.845419+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:07.939379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":12398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"76'412","reported_seq":538,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843652+0000","last_change":"2024-04-25T22:03:33.864136+0000","last_active":"2024-04-25T22:06:30.843652+0000","last_peered":"2024-04-25T22:06:30.843652+0000","last_clean":"2024-04-25T22:06:30.843652+0000","last_became_active":"2024-04-25T22:03:33.862435+0000","last_became_peered":"2024-04-25T22:03:33.862435+0000","last_unstale":"2024-04-25T22:06:30.843652+0000","last_undegraded":"2024-04-25T22:06:30.843652+0000","last_fullsized":"2024-04-25T22:06:30.843652+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:08.119964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":1478,"num_write":377,"num_write_kb":34422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"76'127","reported_seq":304,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851488+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:06:30.851488+0000","last_peered":"2024-04-25T22:06:30.851488+0000","last_clean":"2024-04-25T22:06:30.851488+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:06:30.851488+0000","last_undegraded":"2024-04-25T22:06:30.851488+0000","last_fullsized":"2024-04-25T22:06:30.851488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'444","reported_seq":646,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141302+0000","last_change":"2024-04-25T22:06:23.132900+0000","last_active":"2024-04-25T22:06:31.141302+0000","last_peered":"2024-04-25T22:06:31.141302+0000","last_clean":"2024-04-25T22:06:31.141302+0000","last_became_active":"2024-04-25T22:06:23.097535+0000","last_became_peered":"2024-04-25T22:06:23.097535+0000","last_unstale":"2024-04-25T22:06:31.141302+0000","last_undegraded":"2024-04-25T22:06:31.141302+0000","last_fullsized":"2024-04-25T22:06:31.141302+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:30:55.243414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31576,"num_write":414,"num_write_kb":70915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"75'46","reported_seq":230,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851416+0000","last_change":"2024-04-25T22:06:22.802843+0000","last_active":"2024-04-25T22:06:30.851416+0000","last_peered":"2024-04-25T22:06:30.851416+0000","last_clean":"2024-04-25T22:06:30.851416+0000","last_became_active":"2024-04-25T22:06:22.801910+0000","last_became_peered":"2024-04-25T22:06:22.801910+0000","last_unstale":"2024-04-25T22:06:30.851416+0000","last_undegraded":"2024-04-25T22:06:30.851416+0000","last_fullsized":"2024-04-25T22:06:30.851416+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:23.004530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2665,"num_read_kb":1338898,"num_write":24540,"num_write_kb":4276910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26558,"ondisk_log_size":26558,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127376126,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":4662,"num_write_kb":127830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":71499776,"data_stored":254752252,"data_compressed":21836190,"data_compressed_allocated":35307520,"data_compressed_original":218619904,"omap_allocated":136586,"internal_metadata":0},"log_size":6446,"ondisk_log_size":6446,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738441,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99732,"kb_used_data":24200,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272108,"statfs":{"total":96636764160,"available":96534638592,"internally_reserved":0,"allocated":24780800,"data_stored":84964150,"data_compressed":7036839,"data_compressed_allocated":11431936,"data_compressed_original":72118272,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738440,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99436,"kb_used_data":23896,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272404,"statfs":{"total":96636764160,"available":96534941696,"internally_reserved":0,"allocated":24469504,"data_stored":81562098,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":90,"seq":386547056645,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58112,"kb_used_data":24432,"kb_used_omap":134,"kb_used_meta":33529,"kb_avail":94313728,"statfs":{"total":96636764160,"available":96577257472,"internally_reserved":0,"allocated":25018368,"data_stored":90623267,"data_compressed":7819212,"data_compressed_allocated":12599296,"data_compressed_original":78716928,"omap_allocated":138181,"internal_metadata":34333755},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24076288,"data_stored":89627390,"data_compressed":7811005,"data_compressed_allocated":12562432,"data_compressed_original":78143488,"omap_allocated":136586,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23584768,"data_stored":81156589,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23838720,"data_stored":83968273,"data_compressed":7028632,"data_compressed_allocated":11395072,"data_compressed_original":71544832,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:06:40.904 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:06:41.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:06:41.231 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:06:41.248 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2024-04-25T22:06:39.690769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127966494,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2864,"num_read_kb":1340487,"num_write":29405,"num_write_kb":4408200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33161,"ondisk_log_size":33161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":257280,"kb_used_data":72528,"kb_used_omap":138,"kb_used_meta":184565,"kb_avail":282858240,"statfs":{"total":289910292480,"available":289646837760,"internally_reserved":0,"allocated":74268672,"data_stored":257149515,"data_compressed":21852604,"data_compressed_allocated":35381248,"data_compressed_original":219766784,"omap_allocated":141371,"internal_metadata":188995525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.860610"},"pg_stats":[{"pgid":"4.3f","version":"76'446","reported_seq":604,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845124+0000","last_change":"2024-04-25T22:03:33.876369+0000","last_active":"2024-04-25T22:06:30.845124+0000","last_peered":"2024-04-25T22:06:30.845124+0000","last_clean":"2024-04-25T22:06:30.845124+0000","last_became_active":"2024-04-25T22:03:33.873739+0000","last_became_peered":"2024-04-25T22:03:33.873739+0000","last_unstale":"2024-04-25T22:06:30.845124+0000","last_undegraded":"2024-04-25T22:06:30.845124+0000","last_fullsized":"2024-04-25T22:06:30.845124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:32.529707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29432,"num_write":407,"num_write_kb":84235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"76'417","reported_seq":570,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844117+0000","last_change":"2024-04-25T22:03:33.861269+0000","last_active":"2024-04-25T22:06:30.844117+0000","last_peered":"2024-04-25T22:06:30.844117+0000","last_clean":"2024-04-25T22:06:30.844117+0000","last_became_active":"2024-04-25T22:03:33.859221+0000","last_became_peered":"2024-04-25T22:03:33.859221+0000","last_unstale":"2024-04-25T22:06:30.844117+0000","last_undegraded":"2024-04-25T22:06:30.844117+0000","last_fullsized":"2024-04-25T22:06:30.844117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:23:44.690527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":23541,"num_write":389,"num_write_kb":87654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"76'389","reported_seq":558,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.162002+0000","last_change":"2024-04-25T22:06:31.162002+0000","last_active":"2024-04-25T22:06:31.162002+0000","last_peered":"2024-04-25T22:06:31.162002+0000","last_clean":"2024-04-25T22:06:31.162002+0000","last_became_active":"2024-04-25T22:06:31.149675+0000","last_became_peered":"2024-04-25T22:06:31.149675+0000","last_unstale":"2024-04-25T22:06:31.162002+0000","last_undegraded":"2024-04-25T22:06:31.162002+0000","last_fullsized":"2024-04-25T22:06:31.162002+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:08:49.833041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22311,"num_write":361,"num_write_kb":42975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"76'394","reported_seq":588,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142488+0000","last_change":"2024-04-25T22:06:23.123256+0000","last_active":"2024-04-25T22:06:31.142488+0000","last_peered":"2024-04-25T22:06:31.142488+0000","last_clean":"2024-04-25T22:06:31.142488+0000","last_became_active":"2024-04-25T22:06:23.090780+0000","last_became_peered":"2024-04-25T22:06:23.090780+0000","last_unstale":"2024-04-25T22:06:31.142488+0000","last_undegraded":"2024-04-25T22:06:31.142488+0000","last_fullsized":"2024-04-25T22:06:31.142488+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:57.110628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":20785,"num_write":367,"num_write_kb":63746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"76'429","reported_seq":940,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844371+0000","last_change":"2024-04-25T22:06:28.839715+0000","last_active":"2024-04-25T22:06:30.844371+0000","last_peered":"2024-04-25T22:06:30.844371+0000","last_clean":"2024-04-25T22:06:30.844371+0000","last_became_active":"2024-04-25T22:06:28.836687+0000","last_became_peered":"2024-04-25T22:06:28.836687+0000","last_unstale":"2024-04-25T22:06:30.844371+0000","last_undegraded":"2024-04-25T22:06:30.844371+0000","last_fullsized":"2024-04-25T22:06:30.844371+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:10.175157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":20896,"num_write":403,"num_write_kb":100255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"76'368","reported_seq":542,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141851+0000","last_change":"2024-04-25T22:06:23.129617+0000","last_active":"2024-04-25T22:06:31.141851+0000","last_peered":"2024-04-25T22:06:31.141851+0000","last_clean":"2024-04-25T22:06:31.141851+0000","last_became_active":"2024-04-25T22:06:23.107939+0000","last_became_peered":"2024-04-25T22:06:23.107939+0000","last_unstale":"2024-04-25T22:06:31.141851+0000","last_undegraded":"2024-04-25T22:06:31.141851+0000","last_fullsized":"2024-04-25T22:06:31.141851+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:24.183902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9362,"num_write":344,"num_write_kb":20831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"76'438","reported_seq":638,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140968+0000","last_change":"2024-04-25T22:06:23.123861+0000","last_active":"2024-04-25T22:06:31.140968+0000","last_peered":"2024-04-25T22:06:31.140968+0000","last_clean":"2024-04-25T22:06:31.140968+0000","last_became_active":"2024-04-25T22:06:23.098436+0000","last_became_peered":"2024-04-25T22:06:23.098436+0000","last_unstale":"2024-04-25T22:06:31.140968+0000","last_undegraded":"2024-04-25T22:06:31.140968+0000","last_fullsized":"2024-04-25T22:06:31.140968+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:35.433423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25961,"num_write":415,"num_write_kb":72541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'392","reported_seq":602,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140791+0000","last_change":"2024-04-25T22:06:23.128274+0000","last_active":"2024-04-25T22:06:31.140791+0000","last_peered":"2024-04-25T22:06:31.140791+0000","last_clean":"2024-04-25T22:06:31.140791+0000","last_became_active":"2024-04-25T22:06:23.091431+0000","last_became_peered":"2024-04-25T22:06:23.091431+0000","last_unstale":"2024-04-25T22:06:31.140791+0000","last_undegraded":"2024-04-25T22:06:31.140791+0000","last_fullsized":"2024-04-25T22:06:31.140791+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:48.206131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":24749,"num_write":354,"num_write_kb":64232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"76'443","reported_seq":651,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850489+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:06:30.850489+0000","last_peered":"2024-04-25T22:06:30.850489+0000","last_clean":"2024-04-25T22:06:30.850489+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:06:30.850489+0000","last_undegraded":"2024-04-25T22:06:30.850489+0000","last_fullsized":"2024-04-25T22:06:30.850489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":10648,"num_write":411,"num_write_kb":92932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'392","reported_seq":511,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142550+0000","last_change":"2024-04-25T22:06:26.120464+0000","last_active":"2024-04-25T22:06:31.142550+0000","last_peered":"2024-04-25T22:06:31.142550+0000","last_clean":"2024-04-25T22:06:31.142550+0000","last_became_active":"2024-04-25T22:06:26.114463+0000","last_became_peered":"2024-04-25T22:06:26.114463+0000","last_unstale":"2024-04-25T22:06:31.142550+0000","last_undegraded":"2024-04-25T22:06:31.142550+0000","last_fullsized":"2024-04-25T22:06:31.142550+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:37:54.870762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10696,"num_write":359,"num_write_kb":63259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'391","reported_seq":569,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144957+0000","last_change":"2024-04-25T22:06:23.135020+0000","last_active":"2024-04-25T22:06:31.144957+0000","last_peered":"2024-04-25T22:06:31.144957+0000","last_clean":"2024-04-25T22:06:31.144957+0000","last_became_active":"2024-04-25T22:06:23.123801+0000","last_became_peered":"2024-04-25T22:06:23.123801+0000","last_unstale":"2024-04-25T22:06:31.144957+0000","last_undegraded":"2024-04-25T22:06:31.144957+0000","last_fullsized":"2024-04-25T22:06:31.144957+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:11:44.607123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11259,"num_write":372,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"76'365","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843898+0000","last_change":"2024-04-25T22:06:22.802947+0000","last_active":"2024-04-25T22:06:30.843898+0000","last_peered":"2024-04-25T22:06:30.843898+0000","last_clean":"2024-04-25T22:06:30.843898+0000","last_became_active":"2024-04-25T22:06:22.792880+0000","last_became_peered":"2024-04-25T22:06:22.792880+0000","last_unstale":"2024-04-25T22:06:30.843898+0000","last_undegraded":"2024-04-25T22:06:30.843898+0000","last_fullsized":"2024-04-25T22:06:30.843898+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":51972,"num_write":340,"num_write_kb":51203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"76'420","reported_seq":574,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843505+0000","last_change":"2024-04-25T22:03:33.866815+0000","last_active":"2024-04-25T22:06:30.843505+0000","last_peered":"2024-04-25T22:06:30.843505+0000","last_clean":"2024-04-25T22:06:30.843505+0000","last_became_active":"2024-04-25T22:03:33.859376+0000","last_became_peered":"2024-04-25T22:03:33.859376+0000","last_unstale":"2024-04-25T22:06:30.843505+0000","last_undegraded":"2024-04-25T22:06:30.843505+0000","last_fullsized":"2024-04-25T22:06:30.843505+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:08.620311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17620,"num_write":386,"num_write_kb":100613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"76'432","reported_seq":631,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141520+0000","last_change":"2024-04-25T22:06:23.128788+0000","last_active":"2024-04-25T22:06:31.141520+0000","last_peered":"2024-04-25T22:06:31.141520+0000","last_clean":"2024-04-25T22:06:31.141520+0000","last_became_active":"2024-04-25T22:06:23.081466+0000","last_became_peered":"2024-04-25T22:06:23.081466+0000","last_unstale":"2024-04-25T22:06:31.141520+0000","last_undegraded":"2024-04-25T22:06:31.141520+0000","last_fullsized":"2024-04-25T22:06:31.141520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:15.042731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27327,"num_write":398,"num_write_kb":76113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"76'385","reported_seq":584,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140840+0000","last_change":"2024-04-25T22:06:23.116284+0000","last_active":"2024-04-25T22:06:31.140840+0000","last_peered":"2024-04-25T22:06:31.140840+0000","last_clean":"2024-04-25T22:06:31.140840+0000","last_became_active":"2024-04-25T22:06:23.088046+0000","last_became_peered":"2024-04-25T22:06:23.088046+0000","last_unstale":"2024-04-25T22:06:31.140840+0000","last_undegraded":"2024-04-25T22:06:31.140840+0000","last_fullsized":"2024-04-25T22:06:31.140840+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:40:35.110567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23986,"num_write":352,"num_write_kb":50754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"76'434","reported_seq":615,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141488+0000","last_change":"2024-04-25T22:06:23.132996+0000","last_active":"2024-04-25T22:06:31.141488+0000","last_peered":"2024-04-25T22:06:31.141488+0000","last_clean":"2024-04-25T22:06:31.141488+0000","last_became_active":"2024-04-25T22:06:23.117497+0000","last_became_peered":"2024-04-25T22:06:23.117497+0000","last_unstale":"2024-04-25T22:06:31.141488+0000","last_undegraded":"2024-04-25T22:06:31.141488+0000","last_fullsized":"2024-04-25T22:06:31.141488+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:30.022312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":13806,"num_write":403,"num_write_kb":38995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"76'444","reported_seq":658,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851797+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:06:30.851797+0000","last_peered":"2024-04-25T22:06:30.851797+0000","last_clean":"2024-04-25T22:06:30.851797+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:06:30.851797+0000","last_undegraded":"2024-04-25T22:06:30.851797+0000","last_fullsized":"2024-04-25T22:06:30.851797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":11085,"num_write":416,"num_write_kb":68377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'396","reported_seq":531,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844593+0000","last_change":"2024-04-25T22:03:33.862762+0000","last_active":"2024-04-25T22:06:30.844593+0000","last_peered":"2024-04-25T22:06:30.844593+0000","last_clean":"2024-04-25T22:06:30.844593+0000","last_became_active":"2024-04-25T22:03:33.861082+0000","last_became_peered":"2024-04-25T22:03:33.861082+0000","last_unstale":"2024-04-25T22:06:30.844593+0000","last_undegraded":"2024-04-25T22:06:30.844593+0000","last_fullsized":"2024-04-25T22:06:30.844593+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:15.823113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6581,"num_write":355,"num_write_kb":34159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"76'447","reported_seq":648,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850341+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:06:30.850341+0000","last_peered":"2024-04-25T22:06:30.850341+0000","last_clean":"2024-04-25T22:06:30.850341+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:06:30.850341+0000","last_undegraded":"2024-04-25T22:06:30.850341+0000","last_fullsized":"2024-04-25T22:06:30.850341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22089,"num_write":411,"num_write_kb":104750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'426","reported_seq":604,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144109+0000","last_change":"2024-04-25T22:06:23.122769+0000","last_active":"2024-04-25T22:06:31.144109+0000","last_peered":"2024-04-25T22:06:31.144109+0000","last_clean":"2024-04-25T22:06:31.144109+0000","last_became_active":"2024-04-25T22:06:23.093379+0000","last_became_peered":"2024-04-25T22:06:23.093379+0000","last_unstale":"2024-04-25T22:06:31.144109+0000","last_undegraded":"2024-04-25T22:06:31.144109+0000","last_fullsized":"2024-04-25T22:06:31.144109+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:48.070891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11886,"num_write":398,"num_write_kb":55010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"76'405","reported_seq":602,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143776+0000","last_change":"2024-04-25T22:06:23.129396+0000","last_active":"2024-04-25T22:06:31.143776+0000","last_peered":"2024-04-25T22:06:31.143776+0000","last_clean":"2024-04-25T22:06:31.143776+0000","last_became_active":"2024-04-25T22:06:23.110101+0000","last_became_peered":"2024-04-25T22:06:23.110101+0000","last_unstale":"2024-04-25T22:06:31.143776+0000","last_undegraded":"2024-04-25T22:06:31.143776+0000","last_fullsized":"2024-04-25T22:06:31.143776+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:40.218610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23004,"num_write":370,"num_write_kb":75802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'436","reported_seq":559,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843341+0000","last_change":"2024-04-25T22:06:28.838562+0000","last_active":"2024-04-25T22:06:30.843341+0000","last_peered":"2024-04-25T22:06:30.843341+0000","last_clean":"2024-04-25T22:06:30.843341+0000","last_became_active":"2024-04-25T22:06:28.835081+0000","last_became_peered":"2024-04-25T22:06:28.835081+0000","last_unstale":"2024-04-25T22:06:30.843341+0000","last_undegraded":"2024-04-25T22:06:30.843341+0000","last_fullsized":"2024-04-25T22:06:30.843341+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:15:18.057041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11950,"num_write":408,"num_write_kb":67524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"76'403","reported_seq":607,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.847686+0000","last_change":"2024-04-25T22:06:22.810930+0000","last_active":"2024-04-25T22:06:30.847686+0000","last_peered":"2024-04-25T22:06:30.847686+0000","last_clean":"2024-04-25T22:06:30.847686+0000","last_became_active":"2024-04-25T22:06:22.802907+0000","last_became_peered":"2024-04-25T22:06:22.802907+0000","last_unstale":"2024-04-25T22:06:30.847686+0000","last_undegraded":"2024-04-25T22:06:30.847686+0000","last_fullsized":"2024-04-25T22:06:30.847686+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:00.334109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":6507,"num_write":370,"num_write_kb":51513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'449","reported_seq":574,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842684+0000","last_change":"2024-04-25T22:06:28.846531+0000","last_active":"2024-04-25T22:06:30.842684+0000","last_peered":"2024-04-25T22:06:30.842684+0000","last_clean":"2024-04-25T22:06:30.842684+0000","last_became_active":"2024-04-25T22:06:28.841283+0000","last_became_peered":"2024-04-25T22:06:28.841283+0000","last_unstale":"2024-04-25T22:06:30.842684+0000","last_undegraded":"2024-04-25T22:06:30.842684+0000","last_fullsized":"2024-04-25T22:06:30.842684+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:02.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27047,"num_write":417,"num_write_kb":63386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"76'406","reported_seq":571,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845286+0000","last_change":"2024-04-25T22:06:22.801634+0000","last_active":"2024-04-25T22:06:30.845286+0000","last_peered":"2024-04-25T22:06:30.845286+0000","last_clean":"2024-04-25T22:06:30.845286+0000","last_became_active":"2024-04-25T22:06:22.791470+0000","last_became_peered":"2024-04-25T22:06:22.791470+0000","last_unstale":"2024-04-25T22:06:30.845286+0000","last_undegraded":"2024-04-25T22:06:30.845286+0000","last_fullsized":"2024-04-25T22:06:30.845286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:25.424659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25550,"num_write":386,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"76'485","reported_seq":735,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850945+0000","last_change":"2024-04-25T22:06:22.814124+0000","last_active":"2024-04-25T22:06:30.850945+0000","last_peered":"2024-04-25T22:06:30.850945+0000","last_clean":"2024-04-25T22:06:30.850945+0000","last_became_active":"2024-04-25T22:06:22.804228+0000","last_became_peered":"2024-04-25T22:06:22.804228+0000","last_unstale":"2024-04-25T22:06:30.850945+0000","last_undegraded":"2024-04-25T22:06:30.850945+0000","last_fullsized":"2024-04-25T22:06:30.850945+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":30714,"num_write":444,"num_write_kb":92836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'387","reported_seq":592,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144694+0000","last_change":"2024-04-25T22:06:23.134971+0000","last_active":"2024-04-25T22:06:31.144694+0000","last_peered":"2024-04-25T22:06:31.144694+0000","last_clean":"2024-04-25T22:06:31.144694+0000","last_became_active":"2024-04-25T22:06:23.121334+0000","last_became_peered":"2024-04-25T22:06:23.121334+0000","last_unstale":"2024-04-25T22:06:31.144694+0000","last_undegraded":"2024-04-25T22:06:31.144694+0000","last_fullsized":"2024-04-25T22:06:31.144694+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:03.991336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21644,"num_write":354,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"76'405","reported_seq":649,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844816+0000","last_change":"2024-04-25T22:06:22.829889+0000","last_active":"2024-04-25T22:06:30.844816+0000","last_peered":"2024-04-25T22:06:30.844816+0000","last_clean":"2024-04-25T22:06:30.844816+0000","last_became_active":"2024-04-25T22:06:22.827066+0000","last_became_peered":"2024-04-25T22:06:22.827066+0000","last_unstale":"2024-04-25T22:06:30.844816+0000","last_undegraded":"2024-04-25T22:06:30.844816+0000","last_fullsized":"2024-04-25T22:06:30.844816+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:01.822252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27522,"num_write":375,"num_write_kb":96416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"76'396","reported_seq":619,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850059+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:06:30.850059+0000","last_peered":"2024-04-25T22:06:30.850059+0000","last_clean":"2024-04-25T22:06:30.850059+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:06:30.850059+0000","last_undegraded":"2024-04-25T22:06:30.850059+0000","last_fullsized":"2024-04-25T22:06:30.850059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28501,"num_write":367,"num_write_kb":63458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":654,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843955+0000","last_change":"2024-04-25T22:06:22.803787+0000","last_active":"2024-04-25T22:06:30.843955+0000","last_peered":"2024-04-25T22:06:30.843955+0000","last_clean":"2024-04-25T22:06:30.843955+0000","last_became_active":"2024-04-25T22:06:22.789907+0000","last_became_peered":"2024-04-25T22:06:22.789907+0000","last_unstale":"2024-04-25T22:06:30.843955+0000","last_undegraded":"2024-04-25T22:06:30.843955+0000","last_fullsized":"2024-04-25T22:06:30.843955+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":20717,"num_write":435,"num_write_kb":55985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"76'444","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848333+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:06:30.848333+0000","last_peered":"2024-04-25T22:06:30.848333+0000","last_clean":"2024-04-25T22:06:30.848333+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:06:30.848333+0000","last_undegraded":"2024-04-25T22:06:30.848333+0000","last_fullsized":"2024-04-25T22:06:30.848333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":10758,"num_write":401,"num_write_kb":44705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'422","reported_seq":533,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.160927+0000","last_change":"2024-04-25T22:06:31.160927+0000","last_active":"2024-04-25T22:06:31.160927+0000","last_peered":"2024-04-25T22:06:31.160927+0000","last_clean":"2024-04-25T22:06:31.160927+0000","last_became_active":"2024-04-25T22:06:31.148129+0000","last_became_peered":"2024-04-25T22:06:31.148129+0000","last_unstale":"2024-04-25T22:06:31.160927+0000","last_undegraded":"2024-04-25T22:06:31.160927+0000","last_fullsized":"2024-04-25T22:06:31.160927+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:26:06.579471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":29059,"num_write":391,"num_write_kb":40233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"76'397","reported_seq":894,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844568+0000","last_change":"2024-04-25T22:06:26.819859+0000","last_active":"2024-04-25T22:06:30.844568+0000","last_peered":"2024-04-25T22:06:30.844568+0000","last_clean":"2024-04-25T22:06:30.844568+0000","last_became_active":"2024-04-25T22:06:26.816439+0000","last_became_peered":"2024-04-25T22:06:26.816439+0000","last_unstale":"2024-04-25T22:06:30.844568+0000","last_undegraded":"2024-04-25T22:06:30.844568+0000","last_fullsized":"2024-04-25T22:06:30.844568+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:44.452918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28857,"num_write":363,"num_write_kb":87969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"75'515","reported_seq":671,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142622+0000","last_change":"2024-04-25T22:06:23.117492+0000","last_active":"2024-04-25T22:06:31.142622+0000","last_peered":"2024-04-25T22:06:31.142622+0000","last_clean":"2024-04-25T22:06:31.142622+0000","last_became_active":"2024-04-25T22:06:23.109665+0000","last_became_peered":"2024-04-25T22:06:23.109665+0000","last_unstale":"2024-04-25T22:06:31.142622+0000","last_undegraded":"2024-04-25T22:06:31.142622+0000","last_fullsized":"2024-04-25T22:06:31.142622+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:01.482888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"76'375","reported_seq":481,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845202+0000","last_change":"2024-04-25T22:06:28.846182+0000","last_active":"2024-04-25T22:06:30.845202+0000","last_peered":"2024-04-25T22:06:30.845202+0000","last_clean":"2024-04-25T22:06:30.845202+0000","last_became_active":"2024-04-25T22:06:28.841545+0000","last_became_peered":"2024-04-25T22:06:28.841545+0000","last_unstale":"2024-04-25T22:06:30.845202+0000","last_undegraded":"2024-04-25T22:06:30.845202+0000","last_fullsized":"2024-04-25T22:06:30.845202+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.018915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14983,"num_write":339,"num_write_kb":46748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'53","reported_seq":237,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849016+0000","last_change":"2024-04-25T22:06:22.839083+0000","last_active":"2024-04-25T22:06:30.849016+0000","last_peered":"2024-04-25T22:06:30.849016+0000","last_clean":"2024-04-25T22:06:30.849016+0000","last_became_active":"2024-04-25T22:06:22.833424+0000","last_became_peered":"2024-04-25T22:06:22.833424+0000","last_unstale":"2024-04-25T22:06:30.849016+0000","last_undegraded":"2024-04-25T22:06:30.849016+0000","last_fullsized":"2024-04-25T22:06:30.849016+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:00.819067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'426","reported_seq":639,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851784+0000","last_change":"2024-04-25T22:06:26.822923+0000","last_active":"2024-04-25T22:06:30.851784+0000","last_peered":"2024-04-25T22:06:30.851784+0000","last_clean":"2024-04-25T22:06:30.851784+0000","last_became_active":"2024-04-25T22:06:26.819562+0000","last_became_peered":"2024-04-25T22:06:26.819562+0000","last_unstale":"2024-04-25T22:06:30.851784+0000","last_undegraded":"2024-04-25T22:06:30.851784+0000","last_fullsized":"2024-04-25T22:06:30.851784+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:42.832195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":17843,"num_write":388,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"75'71","reported_seq":188,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843496+0000","last_change":"2024-04-25T22:06:22.799710+0000","last_active":"2024-04-25T22:06:30.843496+0000","last_peered":"2024-04-25T22:06:30.843496+0000","last_clean":"2024-04-25T22:06:30.843496+0000","last_became_active":"2024-04-25T22:06:22.790902+0000","last_became_peered":"2024-04-25T22:06:22.790902+0000","last_unstale":"2024-04-25T22:06:30.843496+0000","last_undegraded":"2024-04-25T22:06:30.843496+0000","last_fullsized":"2024-04-25T22:06:30.843496+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:50:36.683583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'366","reported_seq":571,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850882+0000","last_change":"2024-04-25T22:06:22.809150+0000","last_active":"2024-04-25T22:06:30.850882+0000","last_peered":"2024-04-25T22:06:30.850882+0000","last_clean":"2024-04-25T22:06:30.850882+0000","last_became_active":"2024-04-25T22:06:22.803327+0000","last_became_peered":"2024-04-25T22:06:22.803327+0000","last_unstale":"2024-04-25T22:06:30.850882+0000","last_undegraded":"2024-04-25T22:06:30.850882+0000","last_fullsized":"2024-04-25T22:06:30.850882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.731906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":16032,"num_write":334,"num_write_kb":25754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'63","reported_seq":221,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140280+0000","last_change":"2024-04-25T22:06:23.085892+0000","last_active":"2024-04-25T22:06:31.140280+0000","last_peered":"2024-04-25T22:06:31.140280+0000","last_clean":"2024-04-25T22:06:31.140280+0000","last_became_active":"2024-04-25T22:06:23.082351+0000","last_became_peered":"2024-04-25T22:06:23.082351+0000","last_unstale":"2024-04-25T22:06:31.140280+0000","last_undegraded":"2024-04-25T22:06:31.140280+0000","last_fullsized":"2024-04-25T22:06:31.140280+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:51.142517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"76'148","reported_seq":306,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143742+0000","last_change":"2024-04-25T22:06:23.089179+0000","last_active":"2024-04-25T22:06:31.143742+0000","last_peered":"2024-04-25T22:06:31.143742+0000","last_clean":"2024-04-25T22:06:31.143742+0000","last_became_active":"2024-04-25T22:06:23.085599+0000","last_became_peered":"2024-04-25T22:06:23.085599+0000","last_unstale":"2024-04-25T22:06:31.143742+0000","last_undegraded":"2024-04-25T22:06:31.143742+0000","last_fullsized":"2024-04-25T22:06:31.143742+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:53:14.055158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"76'402","reported_seq":568,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842703+0000","last_change":"2024-04-25T22:06:22.802685+0000","last_active":"2024-04-25T22:06:30.842703+0000","last_peered":"2024-04-25T22:06:30.842703+0000","last_clean":"2024-04-25T22:06:30.842703+0000","last_became_active":"2024-04-25T22:06:22.789353+0000","last_became_peered":"2024-04-25T22:06:22.789353+0000","last_unstale":"2024-04-25T22:06:30.842703+0000","last_undegraded":"2024-04-25T22:06:30.842703+0000","last_fullsized":"2024-04-25T22:06:30.842703+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:14.949049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21114,"num_write":364,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"75'250","reported_seq":374,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844891+0000","last_change":"2024-04-25T22:06:22.791598+0000","last_active":"2024-04-25T22:06:30.844891+0000","last_peered":"2024-04-25T22:06:30.844891+0000","last_clean":"2024-04-25T22:06:30.844891+0000","last_became_active":"2024-04-25T22:06:22.790508+0000","last_became_peered":"2024-04-25T22:06:22.790508+0000","last_unstale":"2024-04-25T22:06:30.844891+0000","last_undegraded":"2024-04-25T22:06:30.844891+0000","last_fullsized":"2024-04-25T22:06:30.844891+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"76'460","reported_seq":634,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842903+0000","last_change":"2024-04-25T22:03:33.861055+0000","last_active":"2024-04-25T22:06:30.842903+0000","last_peered":"2024-04-25T22:06:30.842903+0000","last_clean":"2024-04-25T22:06:30.842903+0000","last_became_active":"2024-04-25T22:03:33.856638+0000","last_became_peered":"2024-04-25T22:03:33.856638+0000","last_unstale":"2024-04-25T22:06:30.842903+0000","last_undegraded":"2024-04-25T22:06:30.842903+0000","last_fullsized":"2024-04-25T22:06:30.842903+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":39774,"num_write":433,"num_write_kb":80294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'556","reported_seq":714,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.148664+0000","last_change":"2024-04-25T22:06:31.148664+0000","last_active":"2024-04-25T22:06:31.148664+0000","last_peered":"2024-04-25T22:06:31.148664+0000","last_clean":"2024-04-25T22:06:31.148664+0000","last_became_active":"2024-04-25T22:06:31.147569+0000","last_became_peered":"2024-04-25T22:06:31.147569+0000","last_unstale":"2024-04-25T22:06:31.148664+0000","last_undegraded":"2024-04-25T22:06:31.148664+0000","last_fullsized":"2024-04-25T22:06:31.148664+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:41.798311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":509,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"76'413","reported_seq":577,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142062+0000","last_change":"2024-04-25T22:06:23.129627+0000","last_active":"2024-04-25T22:06:31.142062+0000","last_peered":"2024-04-25T22:06:31.142062+0000","last_clean":"2024-04-25T22:06:31.142062+0000","last_became_active":"2024-04-25T22:06:23.108199+0000","last_became_peered":"2024-04-25T22:06:23.108199+0000","last_unstale":"2024-04-25T22:06:31.142062+0000","last_undegraded":"2024-04-25T22:06:31.142062+0000","last_fullsized":"2024-04-25T22:06:31.142062+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:23.828740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4858,"num_write":378,"num_write_kb":46741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"76'66","reported_seq":77,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161275+0000","last_change":"2024-04-25T22:06:31.161275+0000","last_active":"2024-04-25T22:06:31.161275+0000","last_peered":"2024-04-25T22:06:31.161275+0000","last_clean":"2024-04-25T22:06:31.161275+0000","last_became_active":"2024-04-25T22:06:31.160267+0000","last_became_peered":"2024-04-25T22:06:31.160267+0000","last_unstale":"2024-04-25T22:06:31.161275+0000","last_undegraded":"2024-04-25T22:06:31.161275+0000","last_fullsized":"2024-04-25T22:06:31.161275+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:14.214127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"76'489","reported_seq":729,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850154+0000","last_change":"2024-04-25T22:06:22.838952+0000","last_active":"2024-04-25T22:06:30.850154+0000","last_peered":"2024-04-25T22:06:30.850154+0000","last_clean":"2024-04-25T22:06:30.850154+0000","last_became_active":"2024-04-25T22:06:22.832394+0000","last_became_peered":"2024-04-25T22:06:22.832394+0000","last_unstale":"2024-04-25T22:06:30.850154+0000","last_undegraded":"2024-04-25T22:06:30.850154+0000","last_fullsized":"2024-04-25T22:06:30.850154+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:04:38.988916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":26829,"num_write":457,"num_write_kb":137840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"75'193","reported_seq":377,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850501+0000","last_change":"2024-04-25T22:06:22.838157+0000","last_active":"2024-04-25T22:06:30.850501+0000","last_peered":"2024-04-25T22:06:30.850501+0000","last_clean":"2024-04-25T22:06:30.850501+0000","last_became_active":"2024-04-25T22:06:22.832572+0000","last_became_peered":"2024-04-25T22:06:22.832572+0000","last_unstale":"2024-04-25T22:06:30.850501+0000","last_undegraded":"2024-04-25T22:06:30.850501+0000","last_fullsized":"2024-04-25T22:06:30.850501+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:34.994194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'437","reported_seq":528,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.160788+0000","last_change":"2024-04-25T22:06:31.160788+0000","last_active":"2024-04-25T22:06:31.160788+0000","last_peered":"2024-04-25T22:06:31.160788+0000","last_clean":"2024-04-25T22:06:31.160788+0000","last_became_active":"2024-04-25T22:06:31.147501+0000","last_became_peered":"2024-04-25T22:06:31.147501+0000","last_unstale":"2024-04-25T22:06:31.160788+0000","last_undegraded":"2024-04-25T22:06:31.160788+0000","last_fullsized":"2024-04-25T22:06:31.160788+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:30:29.866840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3720,"num_write":406,"num_write_kb":30461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"76'106","reported_seq":264,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140763+0000","last_change":"2024-04-25T22:06:23.128769+0000","last_active":"2024-04-25T22:06:31.140763+0000","last_peered":"2024-04-25T22:06:31.140763+0000","last_clean":"2024-04-25T22:06:31.140763+0000","last_became_active":"2024-04-25T22:06:23.103402+0000","last_became_peered":"2024-04-25T22:06:23.103402+0000","last_unstale":"2024-04-25T22:06:31.140763+0000","last_undegraded":"2024-04-25T22:06:31.140763+0000","last_fullsized":"2024-04-25T22:06:31.140763+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:27.137773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"76'409","reported_seq":605,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143850+0000","last_change":"2024-04-25T22:06:23.133536+0000","last_active":"2024-04-25T22:06:31.143850+0000","last_peered":"2024-04-25T22:06:31.143850+0000","last_clean":"2024-04-25T22:06:31.143850+0000","last_became_active":"2024-04-25T22:06:23.086188+0000","last_became_peered":"2024-04-25T22:06:23.086188+0000","last_unstale":"2024-04-25T22:06:31.143850+0000","last_undegraded":"2024-04-25T22:06:31.143850+0000","last_fullsized":"2024-04-25T22:06:31.143850+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:13:59.140479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19178,"num_write":380,"num_write_kb":91945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"75'51","reported_seq":182,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843314+0000","last_change":"2024-04-25T22:06:22.800659+0000","last_active":"2024-04-25T22:06:30.843314+0000","last_peered":"2024-04-25T22:06:30.843314+0000","last_clean":"2024-04-25T22:06:30.843314+0000","last_became_active":"2024-04-25T22:06:22.798779+0000","last_became_peered":"2024-04-25T22:06:22.798779+0000","last_unstale":"2024-04-25T22:06:30.843314+0000","last_undegraded":"2024-04-25T22:06:30.843314+0000","last_fullsized":"2024-04-25T22:06:30.843314+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:35.728722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"76'377","reported_seq":561,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143491+0000","last_change":"2024-04-25T22:06:23.114225+0000","last_active":"2024-04-25T22:06:31.143491+0000","last_peered":"2024-04-25T22:06:31.143491+0000","last_clean":"2024-04-25T22:06:31.143491+0000","last_became_active":"2024-04-25T22:06:23.085799+0000","last_became_peered":"2024-04-25T22:06:23.085799+0000","last_unstale":"2024-04-25T22:06:31.143491+0000","last_undegraded":"2024-04-25T22:06:31.143491+0000","last_fullsized":"2024-04-25T22:06:31.143491+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:50.484372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21517,"num_write":342,"num_write_kb":66898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"75'449","reported_seq":546,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843127+0000","last_change":"2024-04-25T22:03:33.860386+0000","last_active":"2024-04-25T22:06:30.843127+0000","last_peered":"2024-04-25T22:06:30.843127+0000","last_clean":"2024-04-25T22:06:30.843127+0000","last_became_active":"2024-04-25T22:03:33.859539+0000","last_became_peered":"2024-04-25T22:03:33.859539+0000","last_unstale":"2024-04-25T22:06:30.843127+0000","last_undegraded":"2024-04-25T22:06:30.843127+0000","last_fullsized":"2024-04-25T22:06:30.843127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:20.247942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'399","reported_seq":613,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850961+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:06:30.850961+0000","last_peered":"2024-04-25T22:06:30.850961+0000","last_clean":"2024-04-25T22:06:30.850961+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:06:30.850961+0000","last_undegraded":"2024-04-25T22:06:30.850961+0000","last_fullsized":"2024-04-25T22:06:30.850961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17888,"num_write":373,"num_write_kb":67556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":318,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140066+0000","last_change":"2024-04-25T22:06:23.082707+0000","last_active":"2024-04-25T22:06:31.140066+0000","last_peered":"2024-04-25T22:06:31.140066+0000","last_clean":"2024-04-25T22:06:31.140066+0000","last_became_active":"2024-04-25T22:06:23.080701+0000","last_became_peered":"2024-04-25T22:06:23.080701+0000","last_unstale":"2024-04-25T22:06:31.140066+0000","last_undegraded":"2024-04-25T22:06:31.140066+0000","last_fullsized":"2024-04-25T22:06:31.140066+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:27.088849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141705+0000","last_change":"2024-04-25T22:06:23.116373+0000","last_active":"2024-04-25T22:06:31.141705+0000","last_peered":"2024-04-25T22:06:31.141705+0000","last_clean":"2024-04-25T22:06:31.141705+0000","last_became_active":"2024-04-25T22:06:23.108984+0000","last_became_peered":"2024-04-25T22:06:23.108984+0000","last_unstale":"2024-04-25T22:06:31.141705+0000","last_undegraded":"2024-04-25T22:06:31.141705+0000","last_fullsized":"2024-04-25T22:06:31.141705+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:08.884723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"75'393","reported_seq":570,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849474+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:06:30.849474+0000","last_peered":"2024-04-25T22:06:30.849474+0000","last_clean":"2024-04-25T22:06:30.849474+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:06:30.849474+0000","last_undegraded":"2024-04-25T22:06:30.849474+0000","last_fullsized":"2024-04-25T22:06:30.849474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'463","reported_seq":668,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144389+0000","last_change":"2024-04-25T22:06:23.133028+0000","last_active":"2024-04-25T22:06:31.144389+0000","last_peered":"2024-04-25T22:06:31.144389+0000","last_clean":"2024-04-25T22:06:31.144389+0000","last_became_active":"2024-04-25T22:06:23.082756+0000","last_became_peered":"2024-04-25T22:06:23.082756+0000","last_unstale":"2024-04-25T22:06:31.144389+0000","last_undegraded":"2024-04-25T22:06:31.144389+0000","last_fullsized":"2024-04-25T22:06:31.144389+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:24:01.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29270,"num_write":426,"num_write_kb":129367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141100+0000","last_change":"2024-04-25T22:06:23.083451+0000","last_active":"2024-04-25T22:06:31.141100+0000","last_peered":"2024-04-25T22:06:31.141100+0000","last_clean":"2024-04-25T22:06:31.141100+0000","last_became_active":"2024-04-25T22:06:23.080841+0000","last_became_peered":"2024-04-25T22:06:23.080841+0000","last_unstale":"2024-04-25T22:06:31.141100+0000","last_undegraded":"2024-04-25T22:06:31.141100+0000","last_fullsized":"2024-04-25T22:06:31.141100+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:34.605367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"76'125","reported_seq":372,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849223+0000","last_change":"2024-04-25T22:06:22.804290+0000","last_active":"2024-04-25T22:06:30.849223+0000","last_peered":"2024-04-25T22:06:30.849223+0000","last_clean":"2024-04-25T22:06:30.849223+0000","last_became_active":"2024-04-25T22:06:22.801616+0000","last_became_peered":"2024-04-25T22:06:22.801616+0000","last_unstale":"2024-04-25T22:06:30.849223+0000","last_undegraded":"2024-04-25T22:06:30.849223+0000","last_fullsized":"2024-04-25T22:06:30.849223+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:13.402747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464197,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":63,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'457","reported_seq":646,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844136+0000","last_change":"2024-04-25T22:03:05.702224+0000","last_active":"2024-04-25T22:06:30.844136+0000","last_peered":"2024-04-25T22:06:30.844136+0000","last_clean":"2024-04-25T22:06:30.844136+0000","last_became_active":"2024-04-25T22:03:05.699581+0000","last_became_peered":"2024-04-25T22:03:05.699581+0000","last_unstale":"2024-04-25T22:06:30.844136+0000","last_undegraded":"2024-04-25T22:06:30.844136+0000","last_fullsized":"2024-04-25T22:06:30.844136+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":34759,"num_write":424,"num_write_kb":71902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849418+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:06:30.849418+0000","last_peered":"2024-04-25T22:06:30.849418+0000","last_clean":"2024-04-25T22:06:30.849418+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:06:30.849418+0000","last_undegraded":"2024-04-25T22:06:30.849418+0000","last_fullsized":"2024-04-25T22:06:30.849418+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"75'311","reported_seq":496,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843037+0000","last_change":"2024-04-25T22:06:22.801481+0000","last_active":"2024-04-25T22:06:30.843037+0000","last_peered":"2024-04-25T22:06:30.843037+0000","last_clean":"2024-04-25T22:06:30.843037+0000","last_became_active":"2024-04-25T22:06:22.794841+0000","last_became_peered":"2024-04-25T22:06:22.794841+0000","last_unstale":"2024-04-25T22:06:30.843037+0000","last_undegraded":"2024-04-25T22:06:30.843037+0000","last_fullsized":"2024-04-25T22:06:30.843037+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:06:59.330924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"76'373","reported_seq":592,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851291+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:06:30.851291+0000","last_peered":"2024-04-25T22:06:30.851291+0000","last_clean":"2024-04-25T22:06:30.851291+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:06:30.851291+0000","last_undegraded":"2024-04-25T22:06:30.851291+0000","last_fullsized":"2024-04-25T22:06:30.851291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28273,"num_write":350,"num_write_kb":87787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140545+0000","last_change":"2024-04-25T22:06:23.129162+0000","last_active":"2024-04-25T22:06:31.140545+0000","last_peered":"2024-04-25T22:06:31.140545+0000","last_clean":"2024-04-25T22:06:31.140545+0000","last_became_active":"2024-04-25T22:06:23.106155+0000","last_became_peered":"2024-04-25T22:06:23.106155+0000","last_unstale":"2024-04-25T22:06:31.140545+0000","last_undegraded":"2024-04-25T22:06:31.140545+0000","last_fullsized":"2024-04-25T22:06:31.140545+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:30.846068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"76'75","reported_seq":77,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161388+0000","last_change":"2024-04-25T22:06:31.161388+0000","last_active":"2024-04-25T22:06:31.161388+0000","last_peered":"2024-04-25T22:06:31.161388+0000","last_clean":"2024-04-25T22:06:31.161388+0000","last_became_active":"2024-04-25T22:06:31.150555+0000","last_became_peered":"2024-04-25T22:06:31.150555+0000","last_unstale":"2024-04-25T22:06:31.161388+0000","last_undegraded":"2024-04-25T22:06:31.161388+0000","last_fullsized":"2024-04-25T22:06:31.161388+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:56:50.706657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"76'461","reported_seq":753,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850519+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:06:30.850519+0000","last_peered":"2024-04-25T22:06:30.850519+0000","last_clean":"2024-04-25T22:06:30.850519+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:06:30.850519+0000","last_undegraded":"2024-04-25T22:06:30.850519+0000","last_fullsized":"2024-04-25T22:06:30.850519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":67984,"num_write":425,"num_write_kb":154741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"76'268","reported_seq":425,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143156+0000","last_change":"2024-04-25T22:06:23.134306+0000","last_active":"2024-04-25T22:06:31.143156+0000","last_peered":"2024-04-25T22:06:31.143156+0000","last_clean":"2024-04-25T22:06:31.143156+0000","last_became_active":"2024-04-25T22:06:23.122629+0000","last_became_peered":"2024-04-25T22:06:23.122629+0000","last_unstale":"2024-04-25T22:06:31.143156+0000","last_undegraded":"2024-04-25T22:06:31.143156+0000","last_fullsized":"2024-04-25T22:06:31.143156+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:41.205934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850998+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:06:30.850998+0000","last_peered":"2024-04-25T22:06:30.850998+0000","last_clean":"2024-04-25T22:06:30.850998+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:06:30.850998+0000","last_undegraded":"2024-04-25T22:06:30.850998+0000","last_fullsized":"2024-04-25T22:06:30.850998+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'398","reported_seq":578,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843743+0000","last_change":"2024-04-25T22:06:22.797468+0000","last_active":"2024-04-25T22:06:30.843743+0000","last_peered":"2024-04-25T22:06:30.843743+0000","last_clean":"2024-04-25T22:06:30.843743+0000","last_became_active":"2024-04-25T22:06:22.789384+0000","last_became_peered":"2024-04-25T22:06:22.789384+0000","last_unstale":"2024-04-25T22:06:30.843743+0000","last_undegraded":"2024-04-25T22:06:30.843743+0000","last_fullsized":"2024-04-25T22:06:30.843743+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:35.557386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":26599,"num_write":366,"num_write_kb":75612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"76'47","reported_seq":224,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850762+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:06:30.850762+0000","last_peered":"2024-04-25T22:06:30.850762+0000","last_clean":"2024-04-25T22:06:30.850762+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:06:30.850762+0000","last_undegraded":"2024-04-25T22:06:30.850762+0000","last_fullsized":"2024-04-25T22:06:30.850762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":171,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845730+0000","last_change":"2024-04-25T22:03:05.701809+0000","last_active":"2024-04-25T22:06:30.845730+0000","last_peered":"2024-04-25T22:06:30.845730+0000","last_clean":"2024-04-25T22:06:30.845730+0000","last_became_active":"2024-04-25T22:03:05.701322+0000","last_became_peered":"2024-04-25T22:03:05.701322+0000","last_unstale":"2024-04-25T22:06:30.845730+0000","last_undegraded":"2024-04-25T22:06:30.845730+0000","last_fullsized":"2024-04-25T22:06:30.845730+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:45.907458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"76'406","reported_seq":642,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844251+0000","last_change":"2024-04-25T22:06:22.802683+0000","last_active":"2024-04-25T22:06:30.844251+0000","last_peered":"2024-04-25T22:06:30.844251+0000","last_clean":"2024-04-25T22:06:30.844251+0000","last_became_active":"2024-04-25T22:06:22.789807+0000","last_became_peered":"2024-04-25T22:06:22.789807+0000","last_unstale":"2024-04-25T22:06:30.844251+0000","last_undegraded":"2024-04-25T22:06:30.844251+0000","last_fullsized":"2024-04-25T22:06:30.844251+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:15.180532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25634,"num_write":377,"num_write_kb":103970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"76'64","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.852026+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:06:30.852026+0000","last_peered":"2024-04-25T22:06:30.852026+0000","last_clean":"2024-04-25T22:06:30.852026+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:06:30.852026+0000","last_undegraded":"2024-04-25T22:06:30.852026+0000","last_fullsized":"2024-04-25T22:06:30.852026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142483+0000","last_change":"2024-04-25T22:06:24.092672+0000","last_active":"2024-04-25T22:06:31.142483+0000","last_peered":"2024-04-25T22:06:31.142483+0000","last_clean":"2024-04-25T22:06:31.142483+0000","last_became_active":"2024-04-25T22:06:24.091909+0000","last_became_peered":"2024-04-25T22:06:24.091909+0000","last_unstale":"2024-04-25T22:06:31.142483+0000","last_undegraded":"2024-04-25T22:06:31.142483+0000","last_fullsized":"2024-04-25T22:06:31.142483+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:19:21.605435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"76'402","reported_seq":605,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848860+0000","last_change":"2024-04-25T22:06:22.809713+0000","last_active":"2024-04-25T22:06:30.848860+0000","last_peered":"2024-04-25T22:06:30.848860+0000","last_clean":"2024-04-25T22:06:30.848860+0000","last_became_active":"2024-04-25T22:06:22.802005+0000","last_became_peered":"2024-04-25T22:06:22.802005+0000","last_unstale":"2024-04-25T22:06:30.848860+0000","last_undegraded":"2024-04-25T22:06:30.848860+0000","last_fullsized":"2024-04-25T22:06:30.848860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9572,"num_write":361,"num_write_kb":29911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"77'127","reported_seq":311,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851852+0000","last_change":"2024-04-25T22:06:22.804851+0000","last_active":"2024-04-25T22:06:30.851852+0000","last_peered":"2024-04-25T22:06:30.851852+0000","last_clean":"2024-04-25T22:06:30.851852+0000","last_became_active":"2024-04-25T22:06:22.802083+0000","last_became_peered":"2024-04-25T22:06:22.802083+0000","last_unstale":"2024-04-25T22:06:30.851852+0000","last_undegraded":"2024-04-25T22:06:30.851852+0000","last_fullsized":"2024-04-25T22:06:30.851852+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142866+0000","last_change":"2024-04-25T22:06:23.081230+0000","last_active":"2024-04-25T22:06:31.142866+0000","last_peered":"2024-04-25T22:06:31.142866+0000","last_clean":"2024-04-25T22:06:31.142866+0000","last_became_active":"2024-04-25T22:06:23.080393+0000","last_became_peered":"2024-04-25T22:06:23.080393+0000","last_unstale":"2024-04-25T22:06:31.142866+0000","last_undegraded":"2024-04-25T22:06:31.142866+0000","last_fullsized":"2024-04-25T22:06:31.142866+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:55.157159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"76'415","reported_seq":596,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842908+0000","last_change":"2024-04-25T22:06:22.801327+0000","last_active":"2024-04-25T22:06:30.842908+0000","last_peered":"2024-04-25T22:06:30.842908+0000","last_clean":"2024-04-25T22:06:30.842908+0000","last_became_active":"2024-04-25T22:06:22.789624+0000","last_became_peered":"2024-04-25T22:06:22.789624+0000","last_unstale":"2024-04-25T22:06:30.842908+0000","last_undegraded":"2024-04-25T22:06:30.842908+0000","last_fullsized":"2024-04-25T22:06:30.842908+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27345,"num_write":384,"num_write_kb":92854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"76'407","reported_seq":623,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143259+0000","last_change":"2024-04-25T22:06:23.114739+0000","last_active":"2024-04-25T22:06:31.143259+0000","last_peered":"2024-04-25T22:06:31.143259+0000","last_clean":"2024-04-25T22:06:31.143259+0000","last_became_active":"2024-04-25T22:06:23.087118+0000","last_became_peered":"2024-04-25T22:06:23.087118+0000","last_unstale":"2024-04-25T22:06:31.143259+0000","last_undegraded":"2024-04-25T22:06:31.143259+0000","last_fullsized":"2024-04-25T22:06:31.143259+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:51.191212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33923,"num_write":372,"num_write_kb":82083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"77'260","reported_seq":420,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142062+0000","last_change":"2024-04-25T22:06:23.083331+0000","last_active":"2024-04-25T22:06:31.142062+0000","last_peered":"2024-04-25T22:06:31.142062+0000","last_clean":"2024-04-25T22:06:31.142062+0000","last_became_active":"2024-04-25T22:06:23.080552+0000","last_became_peered":"2024-04-25T22:06:23.080552+0000","last_unstale":"2024-04-25T22:06:31.142062+0000","last_undegraded":"2024-04-25T22:06:31.142062+0000","last_fullsized":"2024-04-25T22:06:31.142062+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:55.928212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8470619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"76'408","reported_seq":610,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848693+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:06:30.848693+0000","last_peered":"2024-04-25T22:06:30.848693+0000","last_clean":"2024-04-25T22:06:30.848693+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:06:30.848693+0000","last_undegraded":"2024-04-25T22:06:30.848693+0000","last_fullsized":"2024-04-25T22:06:30.848693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14178,"num_write":370,"num_write_kb":58735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'104","reported_seq":289,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845584+0000","last_change":"2024-04-25T22:06:22.805389+0000","last_active":"2024-04-25T22:06:30.845584+0000","last_peered":"2024-04-25T22:06:30.845584+0000","last_clean":"2024-04-25T22:06:30.845584+0000","last_became_active":"2024-04-25T22:06:22.802667+0000","last_became_peered":"2024-04-25T22:06:22.802667+0000","last_unstale":"2024-04-25T22:06:30.845584+0000","last_undegraded":"2024-04-25T22:06:30.845584+0000","last_fullsized":"2024-04-25T22:06:30.845584+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:38.785650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"75'232","reported_seq":286,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.151793+0000","last_change":"2024-04-25T22:06:31.151793+0000","last_active":"2024-04-25T22:06:31.151793+0000","last_peered":"2024-04-25T22:06:31.151793+0000","last_clean":"2024-04-25T22:06:31.151793+0000","last_became_active":"2024-04-25T22:06:31.150582+0000","last_became_peered":"2024-04-25T22:06:31.150582+0000","last_unstale":"2024-04-25T22:06:31.151793+0000","last_undegraded":"2024-04-25T22:06:31.151793+0000","last_fullsized":"2024-04-25T22:06:31.151793+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:49.932959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"76'483","reported_seq":713,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848496+0000","last_change":"2024-04-25T22:06:22.814119+0000","last_active":"2024-04-25T22:06:30.848496+0000","last_peered":"2024-04-25T22:06:30.848496+0000","last_clean":"2024-04-25T22:06:30.848496+0000","last_became_active":"2024-04-25T22:06:22.807584+0000","last_became_peered":"2024-04-25T22:06:22.807584+0000","last_unstale":"2024-04-25T22:06:30.848496+0000","last_undegraded":"2024-04-25T22:06:30.848496+0000","last_fullsized":"2024-04-25T22:06:30.848496+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:08.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24709,"num_write":463,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"75'60","reported_seq":244,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851719+0000","last_change":"2024-04-25T22:06:22.802356+0000","last_active":"2024-04-25T22:06:30.851719+0000","last_peered":"2024-04-25T22:06:30.851719+0000","last_clean":"2024-04-25T22:06:30.851719+0000","last_became_active":"2024-04-25T22:06:22.801412+0000","last_became_peered":"2024-04-25T22:06:22.801412+0000","last_unstale":"2024-04-25T22:06:30.851719+0000","last_undegraded":"2024-04-25T22:06:30.851719+0000","last_fullsized":"2024-04-25T22:06:30.851719+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:04.421952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'444","reported_seq":648,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848562+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:06:30.848562+0000","last_peered":"2024-04-25T22:06:30.848562+0000","last_clean":"2024-04-25T22:06:30.848562+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:06:30.848562+0000","last_undegraded":"2024-04-25T22:06:30.848562+0000","last_fullsized":"2024-04-25T22:06:30.848562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14429,"num_write":416,"num_write_kb":59186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'355","reported_seq":499,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845399+0000","last_change":"2024-04-25T22:06:22.804579+0000","last_active":"2024-04-25T22:06:30.845399+0000","last_peered":"2024-04-25T22:06:30.845399+0000","last_clean":"2024-04-25T22:06:30.845399+0000","last_became_active":"2024-04-25T22:06:22.792886+0000","last_became_peered":"2024-04-25T22:06:22.792886+0000","last_unstale":"2024-04-25T22:06:30.845399+0000","last_undegraded":"2024-04-25T22:06:30.845399+0000","last_fullsized":"2024-04-25T22:06:30.845399+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:54:35.464321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18236,"num_write":332,"num_write_kb":42553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"76'742","reported_seq":919,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849150+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:06:30.849150+0000","last_peered":"2024-04-25T22:06:30.849150+0000","last_clean":"2024-04-25T22:06:30.849150+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:06:30.849150+0000","last_undegraded":"2024-04-25T22:06:30.849150+0000","last_fullsized":"2024-04-25T22:06:30.849150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'378","reported_seq":579,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851532+0000","last_change":"2024-04-25T22:06:22.813642+0000","last_active":"2024-04-25T22:06:30.851532+0000","last_peered":"2024-04-25T22:06:30.851532+0000","last_clean":"2024-04-25T22:06:30.851532+0000","last_became_active":"2024-04-25T22:06:22.806240+0000","last_became_peered":"2024-04-25T22:06:22.806240+0000","last_unstale":"2024-04-25T22:06:30.851532+0000","last_undegraded":"2024-04-25T22:06:30.851532+0000","last_fullsized":"2024-04-25T22:06:30.851532+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6876,"num_write":354,"num_write_kb":46840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"76'204","reported_seq":388,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848941+0000","last_change":"2024-04-25T22:06:22.805022+0000","last_active":"2024-04-25T22:06:30.848941+0000","last_peered":"2024-04-25T22:06:30.848941+0000","last_clean":"2024-04-25T22:06:30.848941+0000","last_became_active":"2024-04-25T22:06:22.801630+0000","last_became_peered":"2024-04-25T22:06:22.801630+0000","last_unstale":"2024-04-25T22:06:30.848941+0000","last_undegraded":"2024-04-25T22:06:30.848941+0000","last_fullsized":"2024-04-25T22:06:30.848941+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:34.554201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'377","reported_seq":515,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845146+0000","last_change":"2024-04-25T22:06:22.805011+0000","last_active":"2024-04-25T22:06:30.845146+0000","last_peered":"2024-04-25T22:06:30.845146+0000","last_clean":"2024-04-25T22:06:30.845146+0000","last_became_active":"2024-04-25T22:06:22.795334+0000","last_became_peered":"2024-04-25T22:06:22.795334+0000","last_unstale":"2024-04-25T22:06:30.845146+0000","last_undegraded":"2024-04-25T22:06:30.845146+0000","last_fullsized":"2024-04-25T22:06:30.845146+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:35.997378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6059,"num_write":332,"num_write_kb":37972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"76'217","reported_seq":332,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844027+0000","last_change":"2024-04-25T22:06:28.842258+0000","last_active":"2024-04-25T22:06:30.844027+0000","last_peered":"2024-04-25T22:06:30.844027+0000","last_clean":"2024-04-25T22:06:30.844027+0000","last_became_active":"2024-04-25T22:06:28.841447+0000","last_became_peered":"2024-04-25T22:06:28.841447+0000","last_unstale":"2024-04-25T22:06:30.844027+0000","last_undegraded":"2024-04-25T22:06:30.844027+0000","last_fullsized":"2024-04-25T22:06:30.844027+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:31.009167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"76'389","reported_seq":542,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844243+0000","last_change":"2024-04-25T22:03:33.862286+0000","last_active":"2024-04-25T22:06:30.844243+0000","last_peered":"2024-04-25T22:06:30.844243+0000","last_clean":"2024-04-25T22:06:30.844243+0000","last_became_active":"2024-04-25T22:03:33.860800+0000","last_became_peered":"2024-04-25T22:03:33.860800+0000","last_unstale":"2024-04-25T22:06:30.844243+0000","last_undegraded":"2024-04-25T22:06:30.844243+0000","last_fullsized":"2024-04-25T22:06:30.844243+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:04.528174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19110,"num_write":355,"num_write_kb":63152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'51","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844734+0000","last_change":"2024-04-25T22:06:22.804880+0000","last_active":"2024-04-25T22:06:30.844734+0000","last_peered":"2024-04-25T22:06:30.844734+0000","last_clean":"2024-04-25T22:06:30.844734+0000","last_became_active":"2024-04-25T22:06:22.803778+0000","last_became_peered":"2024-04-25T22:06:22.803778+0000","last_unstale":"2024-04-25T22:06:30.844734+0000","last_undegraded":"2024-04-25T22:06:30.844734+0000","last_fullsized":"2024-04-25T22:06:30.844734+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:47:58.480071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"76'386","reported_seq":483,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161983+0000","last_change":"2024-04-25T22:06:31.161983+0000","last_active":"2024-04-25T22:06:31.161983+0000","last_peered":"2024-04-25T22:06:31.161983+0000","last_clean":"2024-04-25T22:06:31.161983+0000","last_became_active":"2024-04-25T22:06:31.149995+0000","last_became_peered":"2024-04-25T22:06:31.149995+0000","last_unstale":"2024-04-25T22:06:31.161983+0000","last_undegraded":"2024-04-25T22:06:31.161983+0000","last_fullsized":"2024-04-25T22:06:31.161983+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:07:32.261028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14050,"num_write":362,"num_write_kb":58957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"76'188","reported_seq":231,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.159971+0000","last_change":"2024-04-25T22:06:31.159971+0000","last_active":"2024-04-25T22:06:31.159971+0000","last_peered":"2024-04-25T22:06:31.159971+0000","last_clean":"2024-04-25T22:06:31.159971+0000","last_became_active":"2024-04-25T22:06:31.148291+0000","last_became_peered":"2024-04-25T22:06:31.148291+0000","last_unstale":"2024-04-25T22:06:31.159971+0000","last_undegraded":"2024-04-25T22:06:31.159971+0000","last_fullsized":"2024-04-25T22:06:31.159971+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:31.095798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"76'397","reported_seq":494,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.160300+0000","last_change":"2024-04-25T22:06:31.160300+0000","last_active":"2024-04-25T22:06:31.160300+0000","last_peered":"2024-04-25T22:06:31.160300+0000","last_clean":"2024-04-25T22:06:31.160300+0000","last_became_active":"2024-04-25T22:06:31.148445+0000","last_became_peered":"2024-04-25T22:06:31.148445+0000","last_unstale":"2024-04-25T22:06:31.160300+0000","last_undegraded":"2024-04-25T22:06:31.160300+0000","last_fullsized":"2024-04-25T22:06:31.160300+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:31.697126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13280,"num_write":364,"num_write_kb":46108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"75'284","reported_seq":414,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845419+0000","last_change":"2024-04-25T22:06:22.804561+0000","last_active":"2024-04-25T22:06:30.845419+0000","last_peered":"2024-04-25T22:06:30.845419+0000","last_clean":"2024-04-25T22:06:30.845419+0000","last_became_active":"2024-04-25T22:06:22.794078+0000","last_became_peered":"2024-04-25T22:06:22.794078+0000","last_unstale":"2024-04-25T22:06:30.845419+0000","last_undegraded":"2024-04-25T22:06:30.845419+0000","last_fullsized":"2024-04-25T22:06:30.845419+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:07.939379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":12398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"76'412","reported_seq":538,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843652+0000","last_change":"2024-04-25T22:03:33.864136+0000","last_active":"2024-04-25T22:06:30.843652+0000","last_peered":"2024-04-25T22:06:30.843652+0000","last_clean":"2024-04-25T22:06:30.843652+0000","last_became_active":"2024-04-25T22:03:33.862435+0000","last_became_peered":"2024-04-25T22:03:33.862435+0000","last_unstale":"2024-04-25T22:06:30.843652+0000","last_undegraded":"2024-04-25T22:06:30.843652+0000","last_fullsized":"2024-04-25T22:06:30.843652+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:08.119964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":1478,"num_write":377,"num_write_kb":34422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"76'127","reported_seq":304,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851488+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:06:30.851488+0000","last_peered":"2024-04-25T22:06:30.851488+0000","last_clean":"2024-04-25T22:06:30.851488+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:06:30.851488+0000","last_undegraded":"2024-04-25T22:06:30.851488+0000","last_fullsized":"2024-04-25T22:06:30.851488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'444","reported_seq":646,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141302+0000","last_change":"2024-04-25T22:06:23.132900+0000","last_active":"2024-04-25T22:06:31.141302+0000","last_peered":"2024-04-25T22:06:31.141302+0000","last_clean":"2024-04-25T22:06:31.141302+0000","last_became_active":"2024-04-25T22:06:23.097535+0000","last_became_peered":"2024-04-25T22:06:23.097535+0000","last_unstale":"2024-04-25T22:06:31.141302+0000","last_undegraded":"2024-04-25T22:06:31.141302+0000","last_fullsized":"2024-04-25T22:06:31.141302+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:30:55.243414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31576,"num_write":414,"num_write_kb":70915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"75'46","reported_seq":230,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851416+0000","last_change":"2024-04-25T22:06:22.802843+0000","last_active":"2024-04-25T22:06:30.851416+0000","last_peered":"2024-04-25T22:06:30.851416+0000","last_clean":"2024-04-25T22:06:30.851416+0000","last_became_active":"2024-04-25T22:06:22.801910+0000","last_became_peered":"2024-04-25T22:06:22.801910+0000","last_unstale":"2024-04-25T22:06:30.851416+0000","last_undegraded":"2024-04-25T22:06:30.851416+0000","last_fullsized":"2024-04-25T22:06:30.851416+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:23.004530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2665,"num_read_kb":1338898,"num_write":24540,"num_write_kb":4276910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26558,"ondisk_log_size":26558,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127376126,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":4662,"num_write_kb":127830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":71499776,"data_stored":254752252,"data_compressed":21836190,"data_compressed_allocated":35307520,"data_compressed_original":218619904,"omap_allocated":136586,"internal_metadata":0},"log_size":6446,"ondisk_log_size":6446,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738442,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99732,"kb_used_data":24200,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272108,"statfs":{"total":96636764160,"available":96534638592,"internally_reserved":0,"allocated":24780800,"data_stored":84964150,"data_compressed":7036839,"data_compressed_allocated":11431936,"data_compressed_original":72118272,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738441,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99436,"kb_used_data":23896,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272404,"statfs":{"total":96636764160,"available":96534941696,"internally_reserved":0,"allocated":24469504,"data_stored":81562098,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":90,"seq":386547056645,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58112,"kb_used_data":24432,"kb_used_omap":134,"kb_used_meta":33529,"kb_avail":94313728,"statfs":{"total":96636764160,"available":96577257472,"internally_reserved":0,"allocated":25018368,"data_stored":90623267,"data_compressed":7819212,"data_compressed_allocated":12599296,"data_compressed_original":78716928,"omap_allocated":138181,"internal_metadata":34333755},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24076288,"data_stored":89627390,"data_compressed":7811005,"data_compressed_allocated":12562432,"data_compressed_original":78143488,"omap_allocated":136586,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23584768,"data_stored":81156589,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23838720,"data_stored":83968273,"data_compressed":7028632,"data_compressed_allocated":11395072,"data_compressed_original":71544832,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:06:41.253 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T22:06:41.253 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-25T22:06:41.619 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T22:06:41.631 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T22:06:41.632 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:06:41.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:06:41.938 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:06:41.956 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2024-04-25T22:06:41.691519+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127966494,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2864,"num_read_kb":1340487,"num_write":29405,"num_write_kb":4408200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33161,"ondisk_log_size":33161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":257280,"kb_used_data":72528,"kb_used_omap":138,"kb_used_meta":184565,"kb_avail":282858240,"statfs":{"total":289910292480,"available":289646837760,"internally_reserved":0,"allocated":74268672,"data_stored":257149515,"data_compressed":21852604,"data_compressed_allocated":35381248,"data_compressed_original":219766784,"omap_allocated":141371,"internal_metadata":188995525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.851162"},"pg_stats":[{"pgid":"4.3f","version":"76'446","reported_seq":604,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845124+0000","last_change":"2024-04-25T22:03:33.876369+0000","last_active":"2024-04-25T22:06:30.845124+0000","last_peered":"2024-04-25T22:06:30.845124+0000","last_clean":"2024-04-25T22:06:30.845124+0000","last_became_active":"2024-04-25T22:03:33.873739+0000","last_became_peered":"2024-04-25T22:03:33.873739+0000","last_unstale":"2024-04-25T22:06:30.845124+0000","last_undegraded":"2024-04-25T22:06:30.845124+0000","last_fullsized":"2024-04-25T22:06:30.845124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:32.529707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29432,"num_write":407,"num_write_kb":84235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"76'417","reported_seq":570,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844117+0000","last_change":"2024-04-25T22:03:33.861269+0000","last_active":"2024-04-25T22:06:30.844117+0000","last_peered":"2024-04-25T22:06:30.844117+0000","last_clean":"2024-04-25T22:06:30.844117+0000","last_became_active":"2024-04-25T22:03:33.859221+0000","last_became_peered":"2024-04-25T22:03:33.859221+0000","last_unstale":"2024-04-25T22:06:30.844117+0000","last_undegraded":"2024-04-25T22:06:30.844117+0000","last_fullsized":"2024-04-25T22:06:30.844117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:23:44.690527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":23541,"num_write":389,"num_write_kb":87654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"76'389","reported_seq":558,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.162002+0000","last_change":"2024-04-25T22:06:31.162002+0000","last_active":"2024-04-25T22:06:31.162002+0000","last_peered":"2024-04-25T22:06:31.162002+0000","last_clean":"2024-04-25T22:06:31.162002+0000","last_became_active":"2024-04-25T22:06:31.149675+0000","last_became_peered":"2024-04-25T22:06:31.149675+0000","last_unstale":"2024-04-25T22:06:31.162002+0000","last_undegraded":"2024-04-25T22:06:31.162002+0000","last_fullsized":"2024-04-25T22:06:31.162002+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:08:49.833041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22311,"num_write":361,"num_write_kb":42975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"76'394","reported_seq":588,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142488+0000","last_change":"2024-04-25T22:06:23.123256+0000","last_active":"2024-04-25T22:06:31.142488+0000","last_peered":"2024-04-25T22:06:31.142488+0000","last_clean":"2024-04-25T22:06:31.142488+0000","last_became_active":"2024-04-25T22:06:23.090780+0000","last_became_peered":"2024-04-25T22:06:23.090780+0000","last_unstale":"2024-04-25T22:06:31.142488+0000","last_undegraded":"2024-04-25T22:06:31.142488+0000","last_fullsized":"2024-04-25T22:06:31.142488+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:57.110628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":20785,"num_write":367,"num_write_kb":63746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"76'429","reported_seq":940,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844371+0000","last_change":"2024-04-25T22:06:28.839715+0000","last_active":"2024-04-25T22:06:30.844371+0000","last_peered":"2024-04-25T22:06:30.844371+0000","last_clean":"2024-04-25T22:06:30.844371+0000","last_became_active":"2024-04-25T22:06:28.836687+0000","last_became_peered":"2024-04-25T22:06:28.836687+0000","last_unstale":"2024-04-25T22:06:30.844371+0000","last_undegraded":"2024-04-25T22:06:30.844371+0000","last_fullsized":"2024-04-25T22:06:30.844371+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:10.175157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":20896,"num_write":403,"num_write_kb":100255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"76'368","reported_seq":542,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141851+0000","last_change":"2024-04-25T22:06:23.129617+0000","last_active":"2024-04-25T22:06:31.141851+0000","last_peered":"2024-04-25T22:06:31.141851+0000","last_clean":"2024-04-25T22:06:31.141851+0000","last_became_active":"2024-04-25T22:06:23.107939+0000","last_became_peered":"2024-04-25T22:06:23.107939+0000","last_unstale":"2024-04-25T22:06:31.141851+0000","last_undegraded":"2024-04-25T22:06:31.141851+0000","last_fullsized":"2024-04-25T22:06:31.141851+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:24.183902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9362,"num_write":344,"num_write_kb":20831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"76'438","reported_seq":638,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140968+0000","last_change":"2024-04-25T22:06:23.123861+0000","last_active":"2024-04-25T22:06:31.140968+0000","last_peered":"2024-04-25T22:06:31.140968+0000","last_clean":"2024-04-25T22:06:31.140968+0000","last_became_active":"2024-04-25T22:06:23.098436+0000","last_became_peered":"2024-04-25T22:06:23.098436+0000","last_unstale":"2024-04-25T22:06:31.140968+0000","last_undegraded":"2024-04-25T22:06:31.140968+0000","last_fullsized":"2024-04-25T22:06:31.140968+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:35.433423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25961,"num_write":415,"num_write_kb":72541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'392","reported_seq":602,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140791+0000","last_change":"2024-04-25T22:06:23.128274+0000","last_active":"2024-04-25T22:06:31.140791+0000","last_peered":"2024-04-25T22:06:31.140791+0000","last_clean":"2024-04-25T22:06:31.140791+0000","last_became_active":"2024-04-25T22:06:23.091431+0000","last_became_peered":"2024-04-25T22:06:23.091431+0000","last_unstale":"2024-04-25T22:06:31.140791+0000","last_undegraded":"2024-04-25T22:06:31.140791+0000","last_fullsized":"2024-04-25T22:06:31.140791+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:48.206131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":24749,"num_write":354,"num_write_kb":64232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"76'443","reported_seq":651,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850489+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:06:30.850489+0000","last_peered":"2024-04-25T22:06:30.850489+0000","last_clean":"2024-04-25T22:06:30.850489+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:06:30.850489+0000","last_undegraded":"2024-04-25T22:06:30.850489+0000","last_fullsized":"2024-04-25T22:06:30.850489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":10648,"num_write":411,"num_write_kb":92932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'392","reported_seq":511,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142550+0000","last_change":"2024-04-25T22:06:26.120464+0000","last_active":"2024-04-25T22:06:31.142550+0000","last_peered":"2024-04-25T22:06:31.142550+0000","last_clean":"2024-04-25T22:06:31.142550+0000","last_became_active":"2024-04-25T22:06:26.114463+0000","last_became_peered":"2024-04-25T22:06:26.114463+0000","last_unstale":"2024-04-25T22:06:31.142550+0000","last_undegraded":"2024-04-25T22:06:31.142550+0000","last_fullsized":"2024-04-25T22:06:31.142550+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:37:54.870762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10696,"num_write":359,"num_write_kb":63259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'391","reported_seq":569,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144957+0000","last_change":"2024-04-25T22:06:23.135020+0000","last_active":"2024-04-25T22:06:31.144957+0000","last_peered":"2024-04-25T22:06:31.144957+0000","last_clean":"2024-04-25T22:06:31.144957+0000","last_became_active":"2024-04-25T22:06:23.123801+0000","last_became_peered":"2024-04-25T22:06:23.123801+0000","last_unstale":"2024-04-25T22:06:31.144957+0000","last_undegraded":"2024-04-25T22:06:31.144957+0000","last_fullsized":"2024-04-25T22:06:31.144957+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:11:44.607123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11259,"num_write":372,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"76'365","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843898+0000","last_change":"2024-04-25T22:06:22.802947+0000","last_active":"2024-04-25T22:06:30.843898+0000","last_peered":"2024-04-25T22:06:30.843898+0000","last_clean":"2024-04-25T22:06:30.843898+0000","last_became_active":"2024-04-25T22:06:22.792880+0000","last_became_peered":"2024-04-25T22:06:22.792880+0000","last_unstale":"2024-04-25T22:06:30.843898+0000","last_undegraded":"2024-04-25T22:06:30.843898+0000","last_fullsized":"2024-04-25T22:06:30.843898+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":51972,"num_write":340,"num_write_kb":51203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"76'420","reported_seq":574,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843505+0000","last_change":"2024-04-25T22:03:33.866815+0000","last_active":"2024-04-25T22:06:30.843505+0000","last_peered":"2024-04-25T22:06:30.843505+0000","last_clean":"2024-04-25T22:06:30.843505+0000","last_became_active":"2024-04-25T22:03:33.859376+0000","last_became_peered":"2024-04-25T22:03:33.859376+0000","last_unstale":"2024-04-25T22:06:30.843505+0000","last_undegraded":"2024-04-25T22:06:30.843505+0000","last_fullsized":"2024-04-25T22:06:30.843505+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:08.620311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17620,"num_write":386,"num_write_kb":100613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"76'432","reported_seq":631,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141520+0000","last_change":"2024-04-25T22:06:23.128788+0000","last_active":"2024-04-25T22:06:31.141520+0000","last_peered":"2024-04-25T22:06:31.141520+0000","last_clean":"2024-04-25T22:06:31.141520+0000","last_became_active":"2024-04-25T22:06:23.081466+0000","last_became_peered":"2024-04-25T22:06:23.081466+0000","last_unstale":"2024-04-25T22:06:31.141520+0000","last_undegraded":"2024-04-25T22:06:31.141520+0000","last_fullsized":"2024-04-25T22:06:31.141520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:15.042731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27327,"num_write":398,"num_write_kb":76113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"76'385","reported_seq":584,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140840+0000","last_change":"2024-04-25T22:06:23.116284+0000","last_active":"2024-04-25T22:06:31.140840+0000","last_peered":"2024-04-25T22:06:31.140840+0000","last_clean":"2024-04-25T22:06:31.140840+0000","last_became_active":"2024-04-25T22:06:23.088046+0000","last_became_peered":"2024-04-25T22:06:23.088046+0000","last_unstale":"2024-04-25T22:06:31.140840+0000","last_undegraded":"2024-04-25T22:06:31.140840+0000","last_fullsized":"2024-04-25T22:06:31.140840+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:40:35.110567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23986,"num_write":352,"num_write_kb":50754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"76'434","reported_seq":615,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141488+0000","last_change":"2024-04-25T22:06:23.132996+0000","last_active":"2024-04-25T22:06:31.141488+0000","last_peered":"2024-04-25T22:06:31.141488+0000","last_clean":"2024-04-25T22:06:31.141488+0000","last_became_active":"2024-04-25T22:06:23.117497+0000","last_became_peered":"2024-04-25T22:06:23.117497+0000","last_unstale":"2024-04-25T22:06:31.141488+0000","last_undegraded":"2024-04-25T22:06:31.141488+0000","last_fullsized":"2024-04-25T22:06:31.141488+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:30.022312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":13806,"num_write":403,"num_write_kb":38995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"76'444","reported_seq":658,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851797+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:06:30.851797+0000","last_peered":"2024-04-25T22:06:30.851797+0000","last_clean":"2024-04-25T22:06:30.851797+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:06:30.851797+0000","last_undegraded":"2024-04-25T22:06:30.851797+0000","last_fullsized":"2024-04-25T22:06:30.851797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":11085,"num_write":416,"num_write_kb":68377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'396","reported_seq":531,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844593+0000","last_change":"2024-04-25T22:03:33.862762+0000","last_active":"2024-04-25T22:06:30.844593+0000","last_peered":"2024-04-25T22:06:30.844593+0000","last_clean":"2024-04-25T22:06:30.844593+0000","last_became_active":"2024-04-25T22:03:33.861082+0000","last_became_peered":"2024-04-25T22:03:33.861082+0000","last_unstale":"2024-04-25T22:06:30.844593+0000","last_undegraded":"2024-04-25T22:06:30.844593+0000","last_fullsized":"2024-04-25T22:06:30.844593+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:15.823113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6581,"num_write":355,"num_write_kb":34159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"76'447","reported_seq":648,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850341+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:06:30.850341+0000","last_peered":"2024-04-25T22:06:30.850341+0000","last_clean":"2024-04-25T22:06:30.850341+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:06:30.850341+0000","last_undegraded":"2024-04-25T22:06:30.850341+0000","last_fullsized":"2024-04-25T22:06:30.850341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22089,"num_write":411,"num_write_kb":104750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'426","reported_seq":604,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144109+0000","last_change":"2024-04-25T22:06:23.122769+0000","last_active":"2024-04-25T22:06:31.144109+0000","last_peered":"2024-04-25T22:06:31.144109+0000","last_clean":"2024-04-25T22:06:31.144109+0000","last_became_active":"2024-04-25T22:06:23.093379+0000","last_became_peered":"2024-04-25T22:06:23.093379+0000","last_unstale":"2024-04-25T22:06:31.144109+0000","last_undegraded":"2024-04-25T22:06:31.144109+0000","last_fullsized":"2024-04-25T22:06:31.144109+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:48.070891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11886,"num_write":398,"num_write_kb":55010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"76'405","reported_seq":602,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143776+0000","last_change":"2024-04-25T22:06:23.129396+0000","last_active":"2024-04-25T22:06:31.143776+0000","last_peered":"2024-04-25T22:06:31.143776+0000","last_clean":"2024-04-25T22:06:31.143776+0000","last_became_active":"2024-04-25T22:06:23.110101+0000","last_became_peered":"2024-04-25T22:06:23.110101+0000","last_unstale":"2024-04-25T22:06:31.143776+0000","last_undegraded":"2024-04-25T22:06:31.143776+0000","last_fullsized":"2024-04-25T22:06:31.143776+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:40.218610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23004,"num_write":370,"num_write_kb":75802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'436","reported_seq":559,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843341+0000","last_change":"2024-04-25T22:06:28.838562+0000","last_active":"2024-04-25T22:06:30.843341+0000","last_peered":"2024-04-25T22:06:30.843341+0000","last_clean":"2024-04-25T22:06:30.843341+0000","last_became_active":"2024-04-25T22:06:28.835081+0000","last_became_peered":"2024-04-25T22:06:28.835081+0000","last_unstale":"2024-04-25T22:06:30.843341+0000","last_undegraded":"2024-04-25T22:06:30.843341+0000","last_fullsized":"2024-04-25T22:06:30.843341+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:15:18.057041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11950,"num_write":408,"num_write_kb":67524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"76'403","reported_seq":607,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.847686+0000","last_change":"2024-04-25T22:06:22.810930+0000","last_active":"2024-04-25T22:06:30.847686+0000","last_peered":"2024-04-25T22:06:30.847686+0000","last_clean":"2024-04-25T22:06:30.847686+0000","last_became_active":"2024-04-25T22:06:22.802907+0000","last_became_peered":"2024-04-25T22:06:22.802907+0000","last_unstale":"2024-04-25T22:06:30.847686+0000","last_undegraded":"2024-04-25T22:06:30.847686+0000","last_fullsized":"2024-04-25T22:06:30.847686+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:00.334109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":6507,"num_write":370,"num_write_kb":51513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'449","reported_seq":574,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842684+0000","last_change":"2024-04-25T22:06:28.846531+0000","last_active":"2024-04-25T22:06:30.842684+0000","last_peered":"2024-04-25T22:06:30.842684+0000","last_clean":"2024-04-25T22:06:30.842684+0000","last_became_active":"2024-04-25T22:06:28.841283+0000","last_became_peered":"2024-04-25T22:06:28.841283+0000","last_unstale":"2024-04-25T22:06:30.842684+0000","last_undegraded":"2024-04-25T22:06:30.842684+0000","last_fullsized":"2024-04-25T22:06:30.842684+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:02.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27047,"num_write":417,"num_write_kb":63386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"76'406","reported_seq":571,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845286+0000","last_change":"2024-04-25T22:06:22.801634+0000","last_active":"2024-04-25T22:06:30.845286+0000","last_peered":"2024-04-25T22:06:30.845286+0000","last_clean":"2024-04-25T22:06:30.845286+0000","last_became_active":"2024-04-25T22:06:22.791470+0000","last_became_peered":"2024-04-25T22:06:22.791470+0000","last_unstale":"2024-04-25T22:06:30.845286+0000","last_undegraded":"2024-04-25T22:06:30.845286+0000","last_fullsized":"2024-04-25T22:06:30.845286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:25.424659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25550,"num_write":386,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"76'485","reported_seq":735,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850945+0000","last_change":"2024-04-25T22:06:22.814124+0000","last_active":"2024-04-25T22:06:30.850945+0000","last_peered":"2024-04-25T22:06:30.850945+0000","last_clean":"2024-04-25T22:06:30.850945+0000","last_became_active":"2024-04-25T22:06:22.804228+0000","last_became_peered":"2024-04-25T22:06:22.804228+0000","last_unstale":"2024-04-25T22:06:30.850945+0000","last_undegraded":"2024-04-25T22:06:30.850945+0000","last_fullsized":"2024-04-25T22:06:30.850945+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":30714,"num_write":444,"num_write_kb":92836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'387","reported_seq":592,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144694+0000","last_change":"2024-04-25T22:06:23.134971+0000","last_active":"2024-04-25T22:06:31.144694+0000","last_peered":"2024-04-25T22:06:31.144694+0000","last_clean":"2024-04-25T22:06:31.144694+0000","last_became_active":"2024-04-25T22:06:23.121334+0000","last_became_peered":"2024-04-25T22:06:23.121334+0000","last_unstale":"2024-04-25T22:06:31.144694+0000","last_undegraded":"2024-04-25T22:06:31.144694+0000","last_fullsized":"2024-04-25T22:06:31.144694+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:03.991336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21644,"num_write":354,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"76'405","reported_seq":649,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844816+0000","last_change":"2024-04-25T22:06:22.829889+0000","last_active":"2024-04-25T22:06:30.844816+0000","last_peered":"2024-04-25T22:06:30.844816+0000","last_clean":"2024-04-25T22:06:30.844816+0000","last_became_active":"2024-04-25T22:06:22.827066+0000","last_became_peered":"2024-04-25T22:06:22.827066+0000","last_unstale":"2024-04-25T22:06:30.844816+0000","last_undegraded":"2024-04-25T22:06:30.844816+0000","last_fullsized":"2024-04-25T22:06:30.844816+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:01.822252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27522,"num_write":375,"num_write_kb":96416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"76'396","reported_seq":619,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850059+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:06:30.850059+0000","last_peered":"2024-04-25T22:06:30.850059+0000","last_clean":"2024-04-25T22:06:30.850059+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:06:30.850059+0000","last_undegraded":"2024-04-25T22:06:30.850059+0000","last_fullsized":"2024-04-25T22:06:30.850059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28501,"num_write":367,"num_write_kb":63458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":654,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843955+0000","last_change":"2024-04-25T22:06:22.803787+0000","last_active":"2024-04-25T22:06:30.843955+0000","last_peered":"2024-04-25T22:06:30.843955+0000","last_clean":"2024-04-25T22:06:30.843955+0000","last_became_active":"2024-04-25T22:06:22.789907+0000","last_became_peered":"2024-04-25T22:06:22.789907+0000","last_unstale":"2024-04-25T22:06:30.843955+0000","last_undegraded":"2024-04-25T22:06:30.843955+0000","last_fullsized":"2024-04-25T22:06:30.843955+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":20717,"num_write":435,"num_write_kb":55985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"76'444","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848333+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:06:30.848333+0000","last_peered":"2024-04-25T22:06:30.848333+0000","last_clean":"2024-04-25T22:06:30.848333+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:06:30.848333+0000","last_undegraded":"2024-04-25T22:06:30.848333+0000","last_fullsized":"2024-04-25T22:06:30.848333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":10758,"num_write":401,"num_write_kb":44705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'422","reported_seq":533,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.160927+0000","last_change":"2024-04-25T22:06:31.160927+0000","last_active":"2024-04-25T22:06:31.160927+0000","last_peered":"2024-04-25T22:06:31.160927+0000","last_clean":"2024-04-25T22:06:31.160927+0000","last_became_active":"2024-04-25T22:06:31.148129+0000","last_became_peered":"2024-04-25T22:06:31.148129+0000","last_unstale":"2024-04-25T22:06:31.160927+0000","last_undegraded":"2024-04-25T22:06:31.160927+0000","last_fullsized":"2024-04-25T22:06:31.160927+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:26:06.579471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":29059,"num_write":391,"num_write_kb":40233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"76'397","reported_seq":894,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844568+0000","last_change":"2024-04-25T22:06:26.819859+0000","last_active":"2024-04-25T22:06:30.844568+0000","last_peered":"2024-04-25T22:06:30.844568+0000","last_clean":"2024-04-25T22:06:30.844568+0000","last_became_active":"2024-04-25T22:06:26.816439+0000","last_became_peered":"2024-04-25T22:06:26.816439+0000","last_unstale":"2024-04-25T22:06:30.844568+0000","last_undegraded":"2024-04-25T22:06:30.844568+0000","last_fullsized":"2024-04-25T22:06:30.844568+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:44.452918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28857,"num_write":363,"num_write_kb":87969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"75'515","reported_seq":671,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142622+0000","last_change":"2024-04-25T22:06:23.117492+0000","last_active":"2024-04-25T22:06:31.142622+0000","last_peered":"2024-04-25T22:06:31.142622+0000","last_clean":"2024-04-25T22:06:31.142622+0000","last_became_active":"2024-04-25T22:06:23.109665+0000","last_became_peered":"2024-04-25T22:06:23.109665+0000","last_unstale":"2024-04-25T22:06:31.142622+0000","last_undegraded":"2024-04-25T22:06:31.142622+0000","last_fullsized":"2024-04-25T22:06:31.142622+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:01.482888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"76'375","reported_seq":481,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845202+0000","last_change":"2024-04-25T22:06:28.846182+0000","last_active":"2024-04-25T22:06:30.845202+0000","last_peered":"2024-04-25T22:06:30.845202+0000","last_clean":"2024-04-25T22:06:30.845202+0000","last_became_active":"2024-04-25T22:06:28.841545+0000","last_became_peered":"2024-04-25T22:06:28.841545+0000","last_unstale":"2024-04-25T22:06:30.845202+0000","last_undegraded":"2024-04-25T22:06:30.845202+0000","last_fullsized":"2024-04-25T22:06:30.845202+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.018915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14983,"num_write":339,"num_write_kb":46748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'53","reported_seq":237,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849016+0000","last_change":"2024-04-25T22:06:22.839083+0000","last_active":"2024-04-25T22:06:30.849016+0000","last_peered":"2024-04-25T22:06:30.849016+0000","last_clean":"2024-04-25T22:06:30.849016+0000","last_became_active":"2024-04-25T22:06:22.833424+0000","last_became_peered":"2024-04-25T22:06:22.833424+0000","last_unstale":"2024-04-25T22:06:30.849016+0000","last_undegraded":"2024-04-25T22:06:30.849016+0000","last_fullsized":"2024-04-25T22:06:30.849016+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:00.819067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'426","reported_seq":639,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851784+0000","last_change":"2024-04-25T22:06:26.822923+0000","last_active":"2024-04-25T22:06:30.851784+0000","last_peered":"2024-04-25T22:06:30.851784+0000","last_clean":"2024-04-25T22:06:30.851784+0000","last_became_active":"2024-04-25T22:06:26.819562+0000","last_became_peered":"2024-04-25T22:06:26.819562+0000","last_unstale":"2024-04-25T22:06:30.851784+0000","last_undegraded":"2024-04-25T22:06:30.851784+0000","last_fullsized":"2024-04-25T22:06:30.851784+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:42.832195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":17843,"num_write":388,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"75'71","reported_seq":188,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843496+0000","last_change":"2024-04-25T22:06:22.799710+0000","last_active":"2024-04-25T22:06:30.843496+0000","last_peered":"2024-04-25T22:06:30.843496+0000","last_clean":"2024-04-25T22:06:30.843496+0000","last_became_active":"2024-04-25T22:06:22.790902+0000","last_became_peered":"2024-04-25T22:06:22.790902+0000","last_unstale":"2024-04-25T22:06:30.843496+0000","last_undegraded":"2024-04-25T22:06:30.843496+0000","last_fullsized":"2024-04-25T22:06:30.843496+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:50:36.683583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'366","reported_seq":571,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850882+0000","last_change":"2024-04-25T22:06:22.809150+0000","last_active":"2024-04-25T22:06:30.850882+0000","last_peered":"2024-04-25T22:06:30.850882+0000","last_clean":"2024-04-25T22:06:30.850882+0000","last_became_active":"2024-04-25T22:06:22.803327+0000","last_became_peered":"2024-04-25T22:06:22.803327+0000","last_unstale":"2024-04-25T22:06:30.850882+0000","last_undegraded":"2024-04-25T22:06:30.850882+0000","last_fullsized":"2024-04-25T22:06:30.850882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.731906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":16032,"num_write":334,"num_write_kb":25754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'63","reported_seq":221,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140280+0000","last_change":"2024-04-25T22:06:23.085892+0000","last_active":"2024-04-25T22:06:31.140280+0000","last_peered":"2024-04-25T22:06:31.140280+0000","last_clean":"2024-04-25T22:06:31.140280+0000","last_became_active":"2024-04-25T22:06:23.082351+0000","last_became_peered":"2024-04-25T22:06:23.082351+0000","last_unstale":"2024-04-25T22:06:31.140280+0000","last_undegraded":"2024-04-25T22:06:31.140280+0000","last_fullsized":"2024-04-25T22:06:31.140280+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:51.142517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"76'148","reported_seq":306,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143742+0000","last_change":"2024-04-25T22:06:23.089179+0000","last_active":"2024-04-25T22:06:31.143742+0000","last_peered":"2024-04-25T22:06:31.143742+0000","last_clean":"2024-04-25T22:06:31.143742+0000","last_became_active":"2024-04-25T22:06:23.085599+0000","last_became_peered":"2024-04-25T22:06:23.085599+0000","last_unstale":"2024-04-25T22:06:31.143742+0000","last_undegraded":"2024-04-25T22:06:31.143742+0000","last_fullsized":"2024-04-25T22:06:31.143742+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:53:14.055158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"76'402","reported_seq":568,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842703+0000","last_change":"2024-04-25T22:06:22.802685+0000","last_active":"2024-04-25T22:06:30.842703+0000","last_peered":"2024-04-25T22:06:30.842703+0000","last_clean":"2024-04-25T22:06:30.842703+0000","last_became_active":"2024-04-25T22:06:22.789353+0000","last_became_peered":"2024-04-25T22:06:22.789353+0000","last_unstale":"2024-04-25T22:06:30.842703+0000","last_undegraded":"2024-04-25T22:06:30.842703+0000","last_fullsized":"2024-04-25T22:06:30.842703+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:14.949049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21114,"num_write":364,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"75'250","reported_seq":374,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844891+0000","last_change":"2024-04-25T22:06:22.791598+0000","last_active":"2024-04-25T22:06:30.844891+0000","last_peered":"2024-04-25T22:06:30.844891+0000","last_clean":"2024-04-25T22:06:30.844891+0000","last_became_active":"2024-04-25T22:06:22.790508+0000","last_became_peered":"2024-04-25T22:06:22.790508+0000","last_unstale":"2024-04-25T22:06:30.844891+0000","last_undegraded":"2024-04-25T22:06:30.844891+0000","last_fullsized":"2024-04-25T22:06:30.844891+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"76'460","reported_seq":634,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842903+0000","last_change":"2024-04-25T22:03:33.861055+0000","last_active":"2024-04-25T22:06:30.842903+0000","last_peered":"2024-04-25T22:06:30.842903+0000","last_clean":"2024-04-25T22:06:30.842903+0000","last_became_active":"2024-04-25T22:03:33.856638+0000","last_became_peered":"2024-04-25T22:03:33.856638+0000","last_unstale":"2024-04-25T22:06:30.842903+0000","last_undegraded":"2024-04-25T22:06:30.842903+0000","last_fullsized":"2024-04-25T22:06:30.842903+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":39774,"num_write":433,"num_write_kb":80294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'556","reported_seq":714,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.148664+0000","last_change":"2024-04-25T22:06:31.148664+0000","last_active":"2024-04-25T22:06:31.148664+0000","last_peered":"2024-04-25T22:06:31.148664+0000","last_clean":"2024-04-25T22:06:31.148664+0000","last_became_active":"2024-04-25T22:06:31.147569+0000","last_became_peered":"2024-04-25T22:06:31.147569+0000","last_unstale":"2024-04-25T22:06:31.148664+0000","last_undegraded":"2024-04-25T22:06:31.148664+0000","last_fullsized":"2024-04-25T22:06:31.148664+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:41.798311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":509,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"76'413","reported_seq":577,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142062+0000","last_change":"2024-04-25T22:06:23.129627+0000","last_active":"2024-04-25T22:06:31.142062+0000","last_peered":"2024-04-25T22:06:31.142062+0000","last_clean":"2024-04-25T22:06:31.142062+0000","last_became_active":"2024-04-25T22:06:23.108199+0000","last_became_peered":"2024-04-25T22:06:23.108199+0000","last_unstale":"2024-04-25T22:06:31.142062+0000","last_undegraded":"2024-04-25T22:06:31.142062+0000","last_fullsized":"2024-04-25T22:06:31.142062+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:23.828740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4858,"num_write":378,"num_write_kb":46741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"76'66","reported_seq":77,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161275+0000","last_change":"2024-04-25T22:06:31.161275+0000","last_active":"2024-04-25T22:06:31.161275+0000","last_peered":"2024-04-25T22:06:31.161275+0000","last_clean":"2024-04-25T22:06:31.161275+0000","last_became_active":"2024-04-25T22:06:31.160267+0000","last_became_peered":"2024-04-25T22:06:31.160267+0000","last_unstale":"2024-04-25T22:06:31.161275+0000","last_undegraded":"2024-04-25T22:06:31.161275+0000","last_fullsized":"2024-04-25T22:06:31.161275+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:14.214127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"76'489","reported_seq":729,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850154+0000","last_change":"2024-04-25T22:06:22.838952+0000","last_active":"2024-04-25T22:06:30.850154+0000","last_peered":"2024-04-25T22:06:30.850154+0000","last_clean":"2024-04-25T22:06:30.850154+0000","last_became_active":"2024-04-25T22:06:22.832394+0000","last_became_peered":"2024-04-25T22:06:22.832394+0000","last_unstale":"2024-04-25T22:06:30.850154+0000","last_undegraded":"2024-04-25T22:06:30.850154+0000","last_fullsized":"2024-04-25T22:06:30.850154+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:04:38.988916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":26829,"num_write":457,"num_write_kb":137840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"75'193","reported_seq":377,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850501+0000","last_change":"2024-04-25T22:06:22.838157+0000","last_active":"2024-04-25T22:06:30.850501+0000","last_peered":"2024-04-25T22:06:30.850501+0000","last_clean":"2024-04-25T22:06:30.850501+0000","last_became_active":"2024-04-25T22:06:22.832572+0000","last_became_peered":"2024-04-25T22:06:22.832572+0000","last_unstale":"2024-04-25T22:06:30.850501+0000","last_undegraded":"2024-04-25T22:06:30.850501+0000","last_fullsized":"2024-04-25T22:06:30.850501+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:34.994194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'437","reported_seq":528,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.160788+0000","last_change":"2024-04-25T22:06:31.160788+0000","last_active":"2024-04-25T22:06:31.160788+0000","last_peered":"2024-04-25T22:06:31.160788+0000","last_clean":"2024-04-25T22:06:31.160788+0000","last_became_active":"2024-04-25T22:06:31.147501+0000","last_became_peered":"2024-04-25T22:06:31.147501+0000","last_unstale":"2024-04-25T22:06:31.160788+0000","last_undegraded":"2024-04-25T22:06:31.160788+0000","last_fullsized":"2024-04-25T22:06:31.160788+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:30:29.866840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3720,"num_write":406,"num_write_kb":30461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"76'106","reported_seq":264,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140763+0000","last_change":"2024-04-25T22:06:23.128769+0000","last_active":"2024-04-25T22:06:31.140763+0000","last_peered":"2024-04-25T22:06:31.140763+0000","last_clean":"2024-04-25T22:06:31.140763+0000","last_became_active":"2024-04-25T22:06:23.103402+0000","last_became_peered":"2024-04-25T22:06:23.103402+0000","last_unstale":"2024-04-25T22:06:31.140763+0000","last_undegraded":"2024-04-25T22:06:31.140763+0000","last_fullsized":"2024-04-25T22:06:31.140763+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:27.137773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"76'409","reported_seq":605,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143850+0000","last_change":"2024-04-25T22:06:23.133536+0000","last_active":"2024-04-25T22:06:31.143850+0000","last_peered":"2024-04-25T22:06:31.143850+0000","last_clean":"2024-04-25T22:06:31.143850+0000","last_became_active":"2024-04-25T22:06:23.086188+0000","last_became_peered":"2024-04-25T22:06:23.086188+0000","last_unstale":"2024-04-25T22:06:31.143850+0000","last_undegraded":"2024-04-25T22:06:31.143850+0000","last_fullsized":"2024-04-25T22:06:31.143850+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:13:59.140479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19178,"num_write":380,"num_write_kb":91945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"75'51","reported_seq":182,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843314+0000","last_change":"2024-04-25T22:06:22.800659+0000","last_active":"2024-04-25T22:06:30.843314+0000","last_peered":"2024-04-25T22:06:30.843314+0000","last_clean":"2024-04-25T22:06:30.843314+0000","last_became_active":"2024-04-25T22:06:22.798779+0000","last_became_peered":"2024-04-25T22:06:22.798779+0000","last_unstale":"2024-04-25T22:06:30.843314+0000","last_undegraded":"2024-04-25T22:06:30.843314+0000","last_fullsized":"2024-04-25T22:06:30.843314+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:35.728722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"76'377","reported_seq":561,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143491+0000","last_change":"2024-04-25T22:06:23.114225+0000","last_active":"2024-04-25T22:06:31.143491+0000","last_peered":"2024-04-25T22:06:31.143491+0000","last_clean":"2024-04-25T22:06:31.143491+0000","last_became_active":"2024-04-25T22:06:23.085799+0000","last_became_peered":"2024-04-25T22:06:23.085799+0000","last_unstale":"2024-04-25T22:06:31.143491+0000","last_undegraded":"2024-04-25T22:06:31.143491+0000","last_fullsized":"2024-04-25T22:06:31.143491+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:50.484372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21517,"num_write":342,"num_write_kb":66898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"75'449","reported_seq":546,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843127+0000","last_change":"2024-04-25T22:03:33.860386+0000","last_active":"2024-04-25T22:06:30.843127+0000","last_peered":"2024-04-25T22:06:30.843127+0000","last_clean":"2024-04-25T22:06:30.843127+0000","last_became_active":"2024-04-25T22:03:33.859539+0000","last_became_peered":"2024-04-25T22:03:33.859539+0000","last_unstale":"2024-04-25T22:06:30.843127+0000","last_undegraded":"2024-04-25T22:06:30.843127+0000","last_fullsized":"2024-04-25T22:06:30.843127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:20.247942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'399","reported_seq":613,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850961+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:06:30.850961+0000","last_peered":"2024-04-25T22:06:30.850961+0000","last_clean":"2024-04-25T22:06:30.850961+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:06:30.850961+0000","last_undegraded":"2024-04-25T22:06:30.850961+0000","last_fullsized":"2024-04-25T22:06:30.850961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17888,"num_write":373,"num_write_kb":67556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":318,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140066+0000","last_change":"2024-04-25T22:06:23.082707+0000","last_active":"2024-04-25T22:06:31.140066+0000","last_peered":"2024-04-25T22:06:31.140066+0000","last_clean":"2024-04-25T22:06:31.140066+0000","last_became_active":"2024-04-25T22:06:23.080701+0000","last_became_peered":"2024-04-25T22:06:23.080701+0000","last_unstale":"2024-04-25T22:06:31.140066+0000","last_undegraded":"2024-04-25T22:06:31.140066+0000","last_fullsized":"2024-04-25T22:06:31.140066+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:27.088849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141705+0000","last_change":"2024-04-25T22:06:23.116373+0000","last_active":"2024-04-25T22:06:31.141705+0000","last_peered":"2024-04-25T22:06:31.141705+0000","last_clean":"2024-04-25T22:06:31.141705+0000","last_became_active":"2024-04-25T22:06:23.108984+0000","last_became_peered":"2024-04-25T22:06:23.108984+0000","last_unstale":"2024-04-25T22:06:31.141705+0000","last_undegraded":"2024-04-25T22:06:31.141705+0000","last_fullsized":"2024-04-25T22:06:31.141705+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:08.884723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"75'393","reported_seq":570,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849474+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:06:30.849474+0000","last_peered":"2024-04-25T22:06:30.849474+0000","last_clean":"2024-04-25T22:06:30.849474+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:06:30.849474+0000","last_undegraded":"2024-04-25T22:06:30.849474+0000","last_fullsized":"2024-04-25T22:06:30.849474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'463","reported_seq":668,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144389+0000","last_change":"2024-04-25T22:06:23.133028+0000","last_active":"2024-04-25T22:06:31.144389+0000","last_peered":"2024-04-25T22:06:31.144389+0000","last_clean":"2024-04-25T22:06:31.144389+0000","last_became_active":"2024-04-25T22:06:23.082756+0000","last_became_peered":"2024-04-25T22:06:23.082756+0000","last_unstale":"2024-04-25T22:06:31.144389+0000","last_undegraded":"2024-04-25T22:06:31.144389+0000","last_fullsized":"2024-04-25T22:06:31.144389+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:24:01.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29270,"num_write":426,"num_write_kb":129367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141100+0000","last_change":"2024-04-25T22:06:23.083451+0000","last_active":"2024-04-25T22:06:31.141100+0000","last_peered":"2024-04-25T22:06:31.141100+0000","last_clean":"2024-04-25T22:06:31.141100+0000","last_became_active":"2024-04-25T22:06:23.080841+0000","last_became_peered":"2024-04-25T22:06:23.080841+0000","last_unstale":"2024-04-25T22:06:31.141100+0000","last_undegraded":"2024-04-25T22:06:31.141100+0000","last_fullsized":"2024-04-25T22:06:31.141100+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:34.605367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"76'125","reported_seq":372,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849223+0000","last_change":"2024-04-25T22:06:22.804290+0000","last_active":"2024-04-25T22:06:30.849223+0000","last_peered":"2024-04-25T22:06:30.849223+0000","last_clean":"2024-04-25T22:06:30.849223+0000","last_became_active":"2024-04-25T22:06:22.801616+0000","last_became_peered":"2024-04-25T22:06:22.801616+0000","last_unstale":"2024-04-25T22:06:30.849223+0000","last_undegraded":"2024-04-25T22:06:30.849223+0000","last_fullsized":"2024-04-25T22:06:30.849223+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:13.402747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464197,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":63,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'457","reported_seq":646,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844136+0000","last_change":"2024-04-25T22:03:05.702224+0000","last_active":"2024-04-25T22:06:30.844136+0000","last_peered":"2024-04-25T22:06:30.844136+0000","last_clean":"2024-04-25T22:06:30.844136+0000","last_became_active":"2024-04-25T22:03:05.699581+0000","last_became_peered":"2024-04-25T22:03:05.699581+0000","last_unstale":"2024-04-25T22:06:30.844136+0000","last_undegraded":"2024-04-25T22:06:30.844136+0000","last_fullsized":"2024-04-25T22:06:30.844136+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":34759,"num_write":424,"num_write_kb":71902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849418+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:06:30.849418+0000","last_peered":"2024-04-25T22:06:30.849418+0000","last_clean":"2024-04-25T22:06:30.849418+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:06:30.849418+0000","last_undegraded":"2024-04-25T22:06:30.849418+0000","last_fullsized":"2024-04-25T22:06:30.849418+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"75'311","reported_seq":496,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843037+0000","last_change":"2024-04-25T22:06:22.801481+0000","last_active":"2024-04-25T22:06:30.843037+0000","last_peered":"2024-04-25T22:06:30.843037+0000","last_clean":"2024-04-25T22:06:30.843037+0000","last_became_active":"2024-04-25T22:06:22.794841+0000","last_became_peered":"2024-04-25T22:06:22.794841+0000","last_unstale":"2024-04-25T22:06:30.843037+0000","last_undegraded":"2024-04-25T22:06:30.843037+0000","last_fullsized":"2024-04-25T22:06:30.843037+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:06:59.330924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"76'373","reported_seq":592,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851291+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:06:30.851291+0000","last_peered":"2024-04-25T22:06:30.851291+0000","last_clean":"2024-04-25T22:06:30.851291+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:06:30.851291+0000","last_undegraded":"2024-04-25T22:06:30.851291+0000","last_fullsized":"2024-04-25T22:06:30.851291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28273,"num_write":350,"num_write_kb":87787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140545+0000","last_change":"2024-04-25T22:06:23.129162+0000","last_active":"2024-04-25T22:06:31.140545+0000","last_peered":"2024-04-25T22:06:31.140545+0000","last_clean":"2024-04-25T22:06:31.140545+0000","last_became_active":"2024-04-25T22:06:23.106155+0000","last_became_peered":"2024-04-25T22:06:23.106155+0000","last_unstale":"2024-04-25T22:06:31.140545+0000","last_undegraded":"2024-04-25T22:06:31.140545+0000","last_fullsized":"2024-04-25T22:06:31.140545+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:30.846068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"76'75","reported_seq":77,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161388+0000","last_change":"2024-04-25T22:06:31.161388+0000","last_active":"2024-04-25T22:06:31.161388+0000","last_peered":"2024-04-25T22:06:31.161388+0000","last_clean":"2024-04-25T22:06:31.161388+0000","last_became_active":"2024-04-25T22:06:31.150555+0000","last_became_peered":"2024-04-25T22:06:31.150555+0000","last_unstale":"2024-04-25T22:06:31.161388+0000","last_undegraded":"2024-04-25T22:06:31.161388+0000","last_fullsized":"2024-04-25T22:06:31.161388+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:56:50.706657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"76'461","reported_seq":753,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850519+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:06:30.850519+0000","last_peered":"2024-04-25T22:06:30.850519+0000","last_clean":"2024-04-25T22:06:30.850519+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:06:30.850519+0000","last_undegraded":"2024-04-25T22:06:30.850519+0000","last_fullsized":"2024-04-25T22:06:30.850519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":67984,"num_write":425,"num_write_kb":154741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"76'268","reported_seq":425,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143156+0000","last_change":"2024-04-25T22:06:23.134306+0000","last_active":"2024-04-25T22:06:31.143156+0000","last_peered":"2024-04-25T22:06:31.143156+0000","last_clean":"2024-04-25T22:06:31.143156+0000","last_became_active":"2024-04-25T22:06:23.122629+0000","last_became_peered":"2024-04-25T22:06:23.122629+0000","last_unstale":"2024-04-25T22:06:31.143156+0000","last_undegraded":"2024-04-25T22:06:31.143156+0000","last_fullsized":"2024-04-25T22:06:31.143156+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:41.205934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850998+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:06:30.850998+0000","last_peered":"2024-04-25T22:06:30.850998+0000","last_clean":"2024-04-25T22:06:30.850998+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:06:30.850998+0000","last_undegraded":"2024-04-25T22:06:30.850998+0000","last_fullsized":"2024-04-25T22:06:30.850998+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'398","reported_seq":578,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843743+0000","last_change":"2024-04-25T22:06:22.797468+0000","last_active":"2024-04-25T22:06:30.843743+0000","last_peered":"2024-04-25T22:06:30.843743+0000","last_clean":"2024-04-25T22:06:30.843743+0000","last_became_active":"2024-04-25T22:06:22.789384+0000","last_became_peered":"2024-04-25T22:06:22.789384+0000","last_unstale":"2024-04-25T22:06:30.843743+0000","last_undegraded":"2024-04-25T22:06:30.843743+0000","last_fullsized":"2024-04-25T22:06:30.843743+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:35.557386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":26599,"num_write":366,"num_write_kb":75612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"76'47","reported_seq":224,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850762+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:06:30.850762+0000","last_peered":"2024-04-25T22:06:30.850762+0000","last_clean":"2024-04-25T22:06:30.850762+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:06:30.850762+0000","last_undegraded":"2024-04-25T22:06:30.850762+0000","last_fullsized":"2024-04-25T22:06:30.850762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":171,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845730+0000","last_change":"2024-04-25T22:03:05.701809+0000","last_active":"2024-04-25T22:06:30.845730+0000","last_peered":"2024-04-25T22:06:30.845730+0000","last_clean":"2024-04-25T22:06:30.845730+0000","last_became_active":"2024-04-25T22:03:05.701322+0000","last_became_peered":"2024-04-25T22:03:05.701322+0000","last_unstale":"2024-04-25T22:06:30.845730+0000","last_undegraded":"2024-04-25T22:06:30.845730+0000","last_fullsized":"2024-04-25T22:06:30.845730+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:45.907458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"76'406","reported_seq":642,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844251+0000","last_change":"2024-04-25T22:06:22.802683+0000","last_active":"2024-04-25T22:06:30.844251+0000","last_peered":"2024-04-25T22:06:30.844251+0000","last_clean":"2024-04-25T22:06:30.844251+0000","last_became_active":"2024-04-25T22:06:22.789807+0000","last_became_peered":"2024-04-25T22:06:22.789807+0000","last_unstale":"2024-04-25T22:06:30.844251+0000","last_undegraded":"2024-04-25T22:06:30.844251+0000","last_fullsized":"2024-04-25T22:06:30.844251+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:15.180532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25634,"num_write":377,"num_write_kb":103970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"76'64","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.852026+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:06:30.852026+0000","last_peered":"2024-04-25T22:06:30.852026+0000","last_clean":"2024-04-25T22:06:30.852026+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:06:30.852026+0000","last_undegraded":"2024-04-25T22:06:30.852026+0000","last_fullsized":"2024-04-25T22:06:30.852026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142483+0000","last_change":"2024-04-25T22:06:24.092672+0000","last_active":"2024-04-25T22:06:31.142483+0000","last_peered":"2024-04-25T22:06:31.142483+0000","last_clean":"2024-04-25T22:06:31.142483+0000","last_became_active":"2024-04-25T22:06:24.091909+0000","last_became_peered":"2024-04-25T22:06:24.091909+0000","last_unstale":"2024-04-25T22:06:31.142483+0000","last_undegraded":"2024-04-25T22:06:31.142483+0000","last_fullsized":"2024-04-25T22:06:31.142483+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:19:21.605435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"76'402","reported_seq":605,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848860+0000","last_change":"2024-04-25T22:06:22.809713+0000","last_active":"2024-04-25T22:06:30.848860+0000","last_peered":"2024-04-25T22:06:30.848860+0000","last_clean":"2024-04-25T22:06:30.848860+0000","last_became_active":"2024-04-25T22:06:22.802005+0000","last_became_peered":"2024-04-25T22:06:22.802005+0000","last_unstale":"2024-04-25T22:06:30.848860+0000","last_undegraded":"2024-04-25T22:06:30.848860+0000","last_fullsized":"2024-04-25T22:06:30.848860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9572,"num_write":361,"num_write_kb":29911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"77'127","reported_seq":311,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851852+0000","last_change":"2024-04-25T22:06:22.804851+0000","last_active":"2024-04-25T22:06:30.851852+0000","last_peered":"2024-04-25T22:06:30.851852+0000","last_clean":"2024-04-25T22:06:30.851852+0000","last_became_active":"2024-04-25T22:06:22.802083+0000","last_became_peered":"2024-04-25T22:06:22.802083+0000","last_unstale":"2024-04-25T22:06:30.851852+0000","last_undegraded":"2024-04-25T22:06:30.851852+0000","last_fullsized":"2024-04-25T22:06:30.851852+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142866+0000","last_change":"2024-04-25T22:06:23.081230+0000","last_active":"2024-04-25T22:06:31.142866+0000","last_peered":"2024-04-25T22:06:31.142866+0000","last_clean":"2024-04-25T22:06:31.142866+0000","last_became_active":"2024-04-25T22:06:23.080393+0000","last_became_peered":"2024-04-25T22:06:23.080393+0000","last_unstale":"2024-04-25T22:06:31.142866+0000","last_undegraded":"2024-04-25T22:06:31.142866+0000","last_fullsized":"2024-04-25T22:06:31.142866+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:55.157159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"76'415","reported_seq":596,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842908+0000","last_change":"2024-04-25T22:06:22.801327+0000","last_active":"2024-04-25T22:06:30.842908+0000","last_peered":"2024-04-25T22:06:30.842908+0000","last_clean":"2024-04-25T22:06:30.842908+0000","last_became_active":"2024-04-25T22:06:22.789624+0000","last_became_peered":"2024-04-25T22:06:22.789624+0000","last_unstale":"2024-04-25T22:06:30.842908+0000","last_undegraded":"2024-04-25T22:06:30.842908+0000","last_fullsized":"2024-04-25T22:06:30.842908+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27345,"num_write":384,"num_write_kb":92854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"76'407","reported_seq":623,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143259+0000","last_change":"2024-04-25T22:06:23.114739+0000","last_active":"2024-04-25T22:06:31.143259+0000","last_peered":"2024-04-25T22:06:31.143259+0000","last_clean":"2024-04-25T22:06:31.143259+0000","last_became_active":"2024-04-25T22:06:23.087118+0000","last_became_peered":"2024-04-25T22:06:23.087118+0000","last_unstale":"2024-04-25T22:06:31.143259+0000","last_undegraded":"2024-04-25T22:06:31.143259+0000","last_fullsized":"2024-04-25T22:06:31.143259+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:51.191212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33923,"num_write":372,"num_write_kb":82083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"77'260","reported_seq":420,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142062+0000","last_change":"2024-04-25T22:06:23.083331+0000","last_active":"2024-04-25T22:06:31.142062+0000","last_peered":"2024-04-25T22:06:31.142062+0000","last_clean":"2024-04-25T22:06:31.142062+0000","last_became_active":"2024-04-25T22:06:23.080552+0000","last_became_peered":"2024-04-25T22:06:23.080552+0000","last_unstale":"2024-04-25T22:06:31.142062+0000","last_undegraded":"2024-04-25T22:06:31.142062+0000","last_fullsized":"2024-04-25T22:06:31.142062+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:55.928212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8470619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"76'408","reported_seq":610,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848693+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:06:30.848693+0000","last_peered":"2024-04-25T22:06:30.848693+0000","last_clean":"2024-04-25T22:06:30.848693+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:06:30.848693+0000","last_undegraded":"2024-04-25T22:06:30.848693+0000","last_fullsized":"2024-04-25T22:06:30.848693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14178,"num_write":370,"num_write_kb":58735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'104","reported_seq":289,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845584+0000","last_change":"2024-04-25T22:06:22.805389+0000","last_active":"2024-04-25T22:06:30.845584+0000","last_peered":"2024-04-25T22:06:30.845584+0000","last_clean":"2024-04-25T22:06:30.845584+0000","last_became_active":"2024-04-25T22:06:22.802667+0000","last_became_peered":"2024-04-25T22:06:22.802667+0000","last_unstale":"2024-04-25T22:06:30.845584+0000","last_undegraded":"2024-04-25T22:06:30.845584+0000","last_fullsized":"2024-04-25T22:06:30.845584+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:38.785650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"75'232","reported_seq":286,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.151793+0000","last_change":"2024-04-25T22:06:31.151793+0000","last_active":"2024-04-25T22:06:31.151793+0000","last_peered":"2024-04-25T22:06:31.151793+0000","last_clean":"2024-04-25T22:06:31.151793+0000","last_became_active":"2024-04-25T22:06:31.150582+0000","last_became_peered":"2024-04-25T22:06:31.150582+0000","last_unstale":"2024-04-25T22:06:31.151793+0000","last_undegraded":"2024-04-25T22:06:31.151793+0000","last_fullsized":"2024-04-25T22:06:31.151793+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:49.932959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"76'483","reported_seq":713,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848496+0000","last_change":"2024-04-25T22:06:22.814119+0000","last_active":"2024-04-25T22:06:30.848496+0000","last_peered":"2024-04-25T22:06:30.848496+0000","last_clean":"2024-04-25T22:06:30.848496+0000","last_became_active":"2024-04-25T22:06:22.807584+0000","last_became_peered":"2024-04-25T22:06:22.807584+0000","last_unstale":"2024-04-25T22:06:30.848496+0000","last_undegraded":"2024-04-25T22:06:30.848496+0000","last_fullsized":"2024-04-25T22:06:30.848496+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:08.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24709,"num_write":463,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"75'60","reported_seq":244,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851719+0000","last_change":"2024-04-25T22:06:22.802356+0000","last_active":"2024-04-25T22:06:30.851719+0000","last_peered":"2024-04-25T22:06:30.851719+0000","last_clean":"2024-04-25T22:06:30.851719+0000","last_became_active":"2024-04-25T22:06:22.801412+0000","last_became_peered":"2024-04-25T22:06:22.801412+0000","last_unstale":"2024-04-25T22:06:30.851719+0000","last_undegraded":"2024-04-25T22:06:30.851719+0000","last_fullsized":"2024-04-25T22:06:30.851719+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:04.421952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'444","reported_seq":648,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848562+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:06:30.848562+0000","last_peered":"2024-04-25T22:06:30.848562+0000","last_clean":"2024-04-25T22:06:30.848562+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:06:30.848562+0000","last_undegraded":"2024-04-25T22:06:30.848562+0000","last_fullsized":"2024-04-25T22:06:30.848562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14429,"num_write":416,"num_write_kb":59186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'355","reported_seq":499,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845399+0000","last_change":"2024-04-25T22:06:22.804579+0000","last_active":"2024-04-25T22:06:30.845399+0000","last_peered":"2024-04-25T22:06:30.845399+0000","last_clean":"2024-04-25T22:06:30.845399+0000","last_became_active":"2024-04-25T22:06:22.792886+0000","last_became_peered":"2024-04-25T22:06:22.792886+0000","last_unstale":"2024-04-25T22:06:30.845399+0000","last_undegraded":"2024-04-25T22:06:30.845399+0000","last_fullsized":"2024-04-25T22:06:30.845399+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:54:35.464321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18236,"num_write":332,"num_write_kb":42553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"76'742","reported_seq":919,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849150+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:06:30.849150+0000","last_peered":"2024-04-25T22:06:30.849150+0000","last_clean":"2024-04-25T22:06:30.849150+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:06:30.849150+0000","last_undegraded":"2024-04-25T22:06:30.849150+0000","last_fullsized":"2024-04-25T22:06:30.849150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'378","reported_seq":579,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851532+0000","last_change":"2024-04-25T22:06:22.813642+0000","last_active":"2024-04-25T22:06:30.851532+0000","last_peered":"2024-04-25T22:06:30.851532+0000","last_clean":"2024-04-25T22:06:30.851532+0000","last_became_active":"2024-04-25T22:06:22.806240+0000","last_became_peered":"2024-04-25T22:06:22.806240+0000","last_unstale":"2024-04-25T22:06:30.851532+0000","last_undegraded":"2024-04-25T22:06:30.851532+0000","last_fullsized":"2024-04-25T22:06:30.851532+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6876,"num_write":354,"num_write_kb":46840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"76'204","reported_seq":388,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848941+0000","last_change":"2024-04-25T22:06:22.805022+0000","last_active":"2024-04-25T22:06:30.848941+0000","last_peered":"2024-04-25T22:06:30.848941+0000","last_clean":"2024-04-25T22:06:30.848941+0000","last_became_active":"2024-04-25T22:06:22.801630+0000","last_became_peered":"2024-04-25T22:06:22.801630+0000","last_unstale":"2024-04-25T22:06:30.848941+0000","last_undegraded":"2024-04-25T22:06:30.848941+0000","last_fullsized":"2024-04-25T22:06:30.848941+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:34.554201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'377","reported_seq":515,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845146+0000","last_change":"2024-04-25T22:06:22.805011+0000","last_active":"2024-04-25T22:06:30.845146+0000","last_peered":"2024-04-25T22:06:30.845146+0000","last_clean":"2024-04-25T22:06:30.845146+0000","last_became_active":"2024-04-25T22:06:22.795334+0000","last_became_peered":"2024-04-25T22:06:22.795334+0000","last_unstale":"2024-04-25T22:06:30.845146+0000","last_undegraded":"2024-04-25T22:06:30.845146+0000","last_fullsized":"2024-04-25T22:06:30.845146+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:35.997378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6059,"num_write":332,"num_write_kb":37972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"76'217","reported_seq":332,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844027+0000","last_change":"2024-04-25T22:06:28.842258+0000","last_active":"2024-04-25T22:06:30.844027+0000","last_peered":"2024-04-25T22:06:30.844027+0000","last_clean":"2024-04-25T22:06:30.844027+0000","last_became_active":"2024-04-25T22:06:28.841447+0000","last_became_peered":"2024-04-25T22:06:28.841447+0000","last_unstale":"2024-04-25T22:06:30.844027+0000","last_undegraded":"2024-04-25T22:06:30.844027+0000","last_fullsized":"2024-04-25T22:06:30.844027+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:31.009167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"76'389","reported_seq":542,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844243+0000","last_change":"2024-04-25T22:03:33.862286+0000","last_active":"2024-04-25T22:06:30.844243+0000","last_peered":"2024-04-25T22:06:30.844243+0000","last_clean":"2024-04-25T22:06:30.844243+0000","last_became_active":"2024-04-25T22:03:33.860800+0000","last_became_peered":"2024-04-25T22:03:33.860800+0000","last_unstale":"2024-04-25T22:06:30.844243+0000","last_undegraded":"2024-04-25T22:06:30.844243+0000","last_fullsized":"2024-04-25T22:06:30.844243+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:04.528174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19110,"num_write":355,"num_write_kb":63152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'51","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844734+0000","last_change":"2024-04-25T22:06:22.804880+0000","last_active":"2024-04-25T22:06:30.844734+0000","last_peered":"2024-04-25T22:06:30.844734+0000","last_clean":"2024-04-25T22:06:30.844734+0000","last_became_active":"2024-04-25T22:06:22.803778+0000","last_became_peered":"2024-04-25T22:06:22.803778+0000","last_unstale":"2024-04-25T22:06:30.844734+0000","last_undegraded":"2024-04-25T22:06:30.844734+0000","last_fullsized":"2024-04-25T22:06:30.844734+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:47:58.480071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"76'386","reported_seq":483,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161983+0000","last_change":"2024-04-25T22:06:31.161983+0000","last_active":"2024-04-25T22:06:31.161983+0000","last_peered":"2024-04-25T22:06:31.161983+0000","last_clean":"2024-04-25T22:06:31.161983+0000","last_became_active":"2024-04-25T22:06:31.149995+0000","last_became_peered":"2024-04-25T22:06:31.149995+0000","last_unstale":"2024-04-25T22:06:31.161983+0000","last_undegraded":"2024-04-25T22:06:31.161983+0000","last_fullsized":"2024-04-25T22:06:31.161983+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:07:32.261028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14050,"num_write":362,"num_write_kb":58957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"76'188","reported_seq":231,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.159971+0000","last_change":"2024-04-25T22:06:31.159971+0000","last_active":"2024-04-25T22:06:31.159971+0000","last_peered":"2024-04-25T22:06:31.159971+0000","last_clean":"2024-04-25T22:06:31.159971+0000","last_became_active":"2024-04-25T22:06:31.148291+0000","last_became_peered":"2024-04-25T22:06:31.148291+0000","last_unstale":"2024-04-25T22:06:31.159971+0000","last_undegraded":"2024-04-25T22:06:31.159971+0000","last_fullsized":"2024-04-25T22:06:31.159971+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:31.095798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"76'397","reported_seq":494,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.160300+0000","last_change":"2024-04-25T22:06:31.160300+0000","last_active":"2024-04-25T22:06:31.160300+0000","last_peered":"2024-04-25T22:06:31.160300+0000","last_clean":"2024-04-25T22:06:31.160300+0000","last_became_active":"2024-04-25T22:06:31.148445+0000","last_became_peered":"2024-04-25T22:06:31.148445+0000","last_unstale":"2024-04-25T22:06:31.160300+0000","last_undegraded":"2024-04-25T22:06:31.160300+0000","last_fullsized":"2024-04-25T22:06:31.160300+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:31.697126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13280,"num_write":364,"num_write_kb":46108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"75'284","reported_seq":414,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845419+0000","last_change":"2024-04-25T22:06:22.804561+0000","last_active":"2024-04-25T22:06:30.845419+0000","last_peered":"2024-04-25T22:06:30.845419+0000","last_clean":"2024-04-25T22:06:30.845419+0000","last_became_active":"2024-04-25T22:06:22.794078+0000","last_became_peered":"2024-04-25T22:06:22.794078+0000","last_unstale":"2024-04-25T22:06:30.845419+0000","last_undegraded":"2024-04-25T22:06:30.845419+0000","last_fullsized":"2024-04-25T22:06:30.845419+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:07.939379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":12398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"76'412","reported_seq":538,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843652+0000","last_change":"2024-04-25T22:03:33.864136+0000","last_active":"2024-04-25T22:06:30.843652+0000","last_peered":"2024-04-25T22:06:30.843652+0000","last_clean":"2024-04-25T22:06:30.843652+0000","last_became_active":"2024-04-25T22:03:33.862435+0000","last_became_peered":"2024-04-25T22:03:33.862435+0000","last_unstale":"2024-04-25T22:06:30.843652+0000","last_undegraded":"2024-04-25T22:06:30.843652+0000","last_fullsized":"2024-04-25T22:06:30.843652+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:08.119964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":1478,"num_write":377,"num_write_kb":34422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"76'127","reported_seq":304,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851488+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:06:30.851488+0000","last_peered":"2024-04-25T22:06:30.851488+0000","last_clean":"2024-04-25T22:06:30.851488+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:06:30.851488+0000","last_undegraded":"2024-04-25T22:06:30.851488+0000","last_fullsized":"2024-04-25T22:06:30.851488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'444","reported_seq":646,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141302+0000","last_change":"2024-04-25T22:06:23.132900+0000","last_active":"2024-04-25T22:06:31.141302+0000","last_peered":"2024-04-25T22:06:31.141302+0000","last_clean":"2024-04-25T22:06:31.141302+0000","last_became_active":"2024-04-25T22:06:23.097535+0000","last_became_peered":"2024-04-25T22:06:23.097535+0000","last_unstale":"2024-04-25T22:06:31.141302+0000","last_undegraded":"2024-04-25T22:06:31.141302+0000","last_fullsized":"2024-04-25T22:06:31.141302+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:30:55.243414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31576,"num_write":414,"num_write_kb":70915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"75'46","reported_seq":230,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851416+0000","last_change":"2024-04-25T22:06:22.802843+0000","last_active":"2024-04-25T22:06:30.851416+0000","last_peered":"2024-04-25T22:06:30.851416+0000","last_clean":"2024-04-25T22:06:30.851416+0000","last_became_active":"2024-04-25T22:06:22.801910+0000","last_became_peered":"2024-04-25T22:06:22.801910+0000","last_unstale":"2024-04-25T22:06:30.851416+0000","last_undegraded":"2024-04-25T22:06:30.851416+0000","last_fullsized":"2024-04-25T22:06:30.851416+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:23.004530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2665,"num_read_kb":1338898,"num_write":24540,"num_write_kb":4276910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26558,"ondisk_log_size":26558,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127376126,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":4662,"num_write_kb":127830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":71499776,"data_stored":254752252,"data_compressed":21836190,"data_compressed_allocated":35307520,"data_compressed_original":218619904,"omap_allocated":136586,"internal_metadata":0},"log_size":6446,"ondisk_log_size":6446,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738442,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99732,"kb_used_data":24200,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272108,"statfs":{"total":96636764160,"available":96534638592,"internally_reserved":0,"allocated":24780800,"data_stored":84964150,"data_compressed":7036839,"data_compressed_allocated":11431936,"data_compressed_original":72118272,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738441,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99436,"kb_used_data":23896,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272404,"statfs":{"total":96636764160,"available":96534941696,"internally_reserved":0,"allocated":24469504,"data_stored":81562098,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":90,"seq":386547056646,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58112,"kb_used_data":24432,"kb_used_omap":134,"kb_used_meta":33529,"kb_avail":94313728,"statfs":{"total":96636764160,"available":96577257472,"internally_reserved":0,"allocated":25018368,"data_stored":90623267,"data_compressed":7819212,"data_compressed_allocated":12599296,"data_compressed_original":78716928,"omap_allocated":138181,"internal_metadata":34333755},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24076288,"data_stored":89627390,"data_compressed":7811005,"data_compressed_allocated":12562432,"data_compressed_original":78143488,"omap_allocated":136586,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23584768,"data_stored":81156589,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23838720,"data_stored":83968273,"data_compressed":7028632,"data_compressed_allocated":11395072,"data_compressed_original":71544832,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:06:41.992 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:06:42.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:06:42.324 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:06:42.342 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2024-04-25T22:06:41.691519+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127966494,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2864,"num_read_kb":1340487,"num_write":29405,"num_write_kb":4408200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33161,"ondisk_log_size":33161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":257280,"kb_used_data":72528,"kb_used_omap":138,"kb_used_meta":184565,"kb_avail":282858240,"statfs":{"total":289910292480,"available":289646837760,"internally_reserved":0,"allocated":74268672,"data_stored":257149515,"data_compressed":21852604,"data_compressed_allocated":35381248,"data_compressed_original":219766784,"omap_allocated":141371,"internal_metadata":188995525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.851162"},"pg_stats":[{"pgid":"4.3f","version":"76'446","reported_seq":604,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845124+0000","last_change":"2024-04-25T22:03:33.876369+0000","last_active":"2024-04-25T22:06:30.845124+0000","last_peered":"2024-04-25T22:06:30.845124+0000","last_clean":"2024-04-25T22:06:30.845124+0000","last_became_active":"2024-04-25T22:03:33.873739+0000","last_became_peered":"2024-04-25T22:03:33.873739+0000","last_unstale":"2024-04-25T22:06:30.845124+0000","last_undegraded":"2024-04-25T22:06:30.845124+0000","last_fullsized":"2024-04-25T22:06:30.845124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:32.529707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29432,"num_write":407,"num_write_kb":84235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"76'417","reported_seq":570,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844117+0000","last_change":"2024-04-25T22:03:33.861269+0000","last_active":"2024-04-25T22:06:30.844117+0000","last_peered":"2024-04-25T22:06:30.844117+0000","last_clean":"2024-04-25T22:06:30.844117+0000","last_became_active":"2024-04-25T22:03:33.859221+0000","last_became_peered":"2024-04-25T22:03:33.859221+0000","last_unstale":"2024-04-25T22:06:30.844117+0000","last_undegraded":"2024-04-25T22:06:30.844117+0000","last_fullsized":"2024-04-25T22:06:30.844117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:23:44.690527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":23541,"num_write":389,"num_write_kb":87654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"76'389","reported_seq":558,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.162002+0000","last_change":"2024-04-25T22:06:31.162002+0000","last_active":"2024-04-25T22:06:31.162002+0000","last_peered":"2024-04-25T22:06:31.162002+0000","last_clean":"2024-04-25T22:06:31.162002+0000","last_became_active":"2024-04-25T22:06:31.149675+0000","last_became_peered":"2024-04-25T22:06:31.149675+0000","last_unstale":"2024-04-25T22:06:31.162002+0000","last_undegraded":"2024-04-25T22:06:31.162002+0000","last_fullsized":"2024-04-25T22:06:31.162002+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:08:49.833041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22311,"num_write":361,"num_write_kb":42975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"76'394","reported_seq":588,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142488+0000","last_change":"2024-04-25T22:06:23.123256+0000","last_active":"2024-04-25T22:06:31.142488+0000","last_peered":"2024-04-25T22:06:31.142488+0000","last_clean":"2024-04-25T22:06:31.142488+0000","last_became_active":"2024-04-25T22:06:23.090780+0000","last_became_peered":"2024-04-25T22:06:23.090780+0000","last_unstale":"2024-04-25T22:06:31.142488+0000","last_undegraded":"2024-04-25T22:06:31.142488+0000","last_fullsized":"2024-04-25T22:06:31.142488+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:57.110628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":20785,"num_write":367,"num_write_kb":63746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"76'429","reported_seq":940,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844371+0000","last_change":"2024-04-25T22:06:28.839715+0000","last_active":"2024-04-25T22:06:30.844371+0000","last_peered":"2024-04-25T22:06:30.844371+0000","last_clean":"2024-04-25T22:06:30.844371+0000","last_became_active":"2024-04-25T22:06:28.836687+0000","last_became_peered":"2024-04-25T22:06:28.836687+0000","last_unstale":"2024-04-25T22:06:30.844371+0000","last_undegraded":"2024-04-25T22:06:30.844371+0000","last_fullsized":"2024-04-25T22:06:30.844371+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:10.175157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":20896,"num_write":403,"num_write_kb":100255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"76'368","reported_seq":542,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141851+0000","last_change":"2024-04-25T22:06:23.129617+0000","last_active":"2024-04-25T22:06:31.141851+0000","last_peered":"2024-04-25T22:06:31.141851+0000","last_clean":"2024-04-25T22:06:31.141851+0000","last_became_active":"2024-04-25T22:06:23.107939+0000","last_became_peered":"2024-04-25T22:06:23.107939+0000","last_unstale":"2024-04-25T22:06:31.141851+0000","last_undegraded":"2024-04-25T22:06:31.141851+0000","last_fullsized":"2024-04-25T22:06:31.141851+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:24.183902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9362,"num_write":344,"num_write_kb":20831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"76'438","reported_seq":638,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140968+0000","last_change":"2024-04-25T22:06:23.123861+0000","last_active":"2024-04-25T22:06:31.140968+0000","last_peered":"2024-04-25T22:06:31.140968+0000","last_clean":"2024-04-25T22:06:31.140968+0000","last_became_active":"2024-04-25T22:06:23.098436+0000","last_became_peered":"2024-04-25T22:06:23.098436+0000","last_unstale":"2024-04-25T22:06:31.140968+0000","last_undegraded":"2024-04-25T22:06:31.140968+0000","last_fullsized":"2024-04-25T22:06:31.140968+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:35.433423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25961,"num_write":415,"num_write_kb":72541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'392","reported_seq":602,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140791+0000","last_change":"2024-04-25T22:06:23.128274+0000","last_active":"2024-04-25T22:06:31.140791+0000","last_peered":"2024-04-25T22:06:31.140791+0000","last_clean":"2024-04-25T22:06:31.140791+0000","last_became_active":"2024-04-25T22:06:23.091431+0000","last_became_peered":"2024-04-25T22:06:23.091431+0000","last_unstale":"2024-04-25T22:06:31.140791+0000","last_undegraded":"2024-04-25T22:06:31.140791+0000","last_fullsized":"2024-04-25T22:06:31.140791+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:48.206131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":24749,"num_write":354,"num_write_kb":64232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"76'443","reported_seq":651,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850489+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:06:30.850489+0000","last_peered":"2024-04-25T22:06:30.850489+0000","last_clean":"2024-04-25T22:06:30.850489+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:06:30.850489+0000","last_undegraded":"2024-04-25T22:06:30.850489+0000","last_fullsized":"2024-04-25T22:06:30.850489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":10648,"num_write":411,"num_write_kb":92932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'392","reported_seq":511,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142550+0000","last_change":"2024-04-25T22:06:26.120464+0000","last_active":"2024-04-25T22:06:31.142550+0000","last_peered":"2024-04-25T22:06:31.142550+0000","last_clean":"2024-04-25T22:06:31.142550+0000","last_became_active":"2024-04-25T22:06:26.114463+0000","last_became_peered":"2024-04-25T22:06:26.114463+0000","last_unstale":"2024-04-25T22:06:31.142550+0000","last_undegraded":"2024-04-25T22:06:31.142550+0000","last_fullsized":"2024-04-25T22:06:31.142550+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:37:54.870762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10696,"num_write":359,"num_write_kb":63259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'391","reported_seq":569,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144957+0000","last_change":"2024-04-25T22:06:23.135020+0000","last_active":"2024-04-25T22:06:31.144957+0000","last_peered":"2024-04-25T22:06:31.144957+0000","last_clean":"2024-04-25T22:06:31.144957+0000","last_became_active":"2024-04-25T22:06:23.123801+0000","last_became_peered":"2024-04-25T22:06:23.123801+0000","last_unstale":"2024-04-25T22:06:31.144957+0000","last_undegraded":"2024-04-25T22:06:31.144957+0000","last_fullsized":"2024-04-25T22:06:31.144957+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:11:44.607123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11259,"num_write":372,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"76'365","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843898+0000","last_change":"2024-04-25T22:06:22.802947+0000","last_active":"2024-04-25T22:06:30.843898+0000","last_peered":"2024-04-25T22:06:30.843898+0000","last_clean":"2024-04-25T22:06:30.843898+0000","last_became_active":"2024-04-25T22:06:22.792880+0000","last_became_peered":"2024-04-25T22:06:22.792880+0000","last_unstale":"2024-04-25T22:06:30.843898+0000","last_undegraded":"2024-04-25T22:06:30.843898+0000","last_fullsized":"2024-04-25T22:06:30.843898+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":51972,"num_write":340,"num_write_kb":51203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"76'420","reported_seq":574,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843505+0000","last_change":"2024-04-25T22:03:33.866815+0000","last_active":"2024-04-25T22:06:30.843505+0000","last_peered":"2024-04-25T22:06:30.843505+0000","last_clean":"2024-04-25T22:06:30.843505+0000","last_became_active":"2024-04-25T22:03:33.859376+0000","last_became_peered":"2024-04-25T22:03:33.859376+0000","last_unstale":"2024-04-25T22:06:30.843505+0000","last_undegraded":"2024-04-25T22:06:30.843505+0000","last_fullsized":"2024-04-25T22:06:30.843505+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:08.620311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17620,"num_write":386,"num_write_kb":100613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"76'432","reported_seq":631,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141520+0000","last_change":"2024-04-25T22:06:23.128788+0000","last_active":"2024-04-25T22:06:31.141520+0000","last_peered":"2024-04-25T22:06:31.141520+0000","last_clean":"2024-04-25T22:06:31.141520+0000","last_became_active":"2024-04-25T22:06:23.081466+0000","last_became_peered":"2024-04-25T22:06:23.081466+0000","last_unstale":"2024-04-25T22:06:31.141520+0000","last_undegraded":"2024-04-25T22:06:31.141520+0000","last_fullsized":"2024-04-25T22:06:31.141520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:15.042731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27327,"num_write":398,"num_write_kb":76113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"76'385","reported_seq":584,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140840+0000","last_change":"2024-04-25T22:06:23.116284+0000","last_active":"2024-04-25T22:06:31.140840+0000","last_peered":"2024-04-25T22:06:31.140840+0000","last_clean":"2024-04-25T22:06:31.140840+0000","last_became_active":"2024-04-25T22:06:23.088046+0000","last_became_peered":"2024-04-25T22:06:23.088046+0000","last_unstale":"2024-04-25T22:06:31.140840+0000","last_undegraded":"2024-04-25T22:06:31.140840+0000","last_fullsized":"2024-04-25T22:06:31.140840+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:40:35.110567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23986,"num_write":352,"num_write_kb":50754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"76'434","reported_seq":615,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141488+0000","last_change":"2024-04-25T22:06:23.132996+0000","last_active":"2024-04-25T22:06:31.141488+0000","last_peered":"2024-04-25T22:06:31.141488+0000","last_clean":"2024-04-25T22:06:31.141488+0000","last_became_active":"2024-04-25T22:06:23.117497+0000","last_became_peered":"2024-04-25T22:06:23.117497+0000","last_unstale":"2024-04-25T22:06:31.141488+0000","last_undegraded":"2024-04-25T22:06:31.141488+0000","last_fullsized":"2024-04-25T22:06:31.141488+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:30.022312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":13806,"num_write":403,"num_write_kb":38995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"76'444","reported_seq":658,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851797+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:06:30.851797+0000","last_peered":"2024-04-25T22:06:30.851797+0000","last_clean":"2024-04-25T22:06:30.851797+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:06:30.851797+0000","last_undegraded":"2024-04-25T22:06:30.851797+0000","last_fullsized":"2024-04-25T22:06:30.851797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":11085,"num_write":416,"num_write_kb":68377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'396","reported_seq":531,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844593+0000","last_change":"2024-04-25T22:03:33.862762+0000","last_active":"2024-04-25T22:06:30.844593+0000","last_peered":"2024-04-25T22:06:30.844593+0000","last_clean":"2024-04-25T22:06:30.844593+0000","last_became_active":"2024-04-25T22:03:33.861082+0000","last_became_peered":"2024-04-25T22:03:33.861082+0000","last_unstale":"2024-04-25T22:06:30.844593+0000","last_undegraded":"2024-04-25T22:06:30.844593+0000","last_fullsized":"2024-04-25T22:06:30.844593+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:15.823113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6581,"num_write":355,"num_write_kb":34159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"76'447","reported_seq":648,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850341+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:06:30.850341+0000","last_peered":"2024-04-25T22:06:30.850341+0000","last_clean":"2024-04-25T22:06:30.850341+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:06:30.850341+0000","last_undegraded":"2024-04-25T22:06:30.850341+0000","last_fullsized":"2024-04-25T22:06:30.850341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22089,"num_write":411,"num_write_kb":104750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'426","reported_seq":604,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144109+0000","last_change":"2024-04-25T22:06:23.122769+0000","last_active":"2024-04-25T22:06:31.144109+0000","last_peered":"2024-04-25T22:06:31.144109+0000","last_clean":"2024-04-25T22:06:31.144109+0000","last_became_active":"2024-04-25T22:06:23.093379+0000","last_became_peered":"2024-04-25T22:06:23.093379+0000","last_unstale":"2024-04-25T22:06:31.144109+0000","last_undegraded":"2024-04-25T22:06:31.144109+0000","last_fullsized":"2024-04-25T22:06:31.144109+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:48.070891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11886,"num_write":398,"num_write_kb":55010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"76'405","reported_seq":602,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143776+0000","last_change":"2024-04-25T22:06:23.129396+0000","last_active":"2024-04-25T22:06:31.143776+0000","last_peered":"2024-04-25T22:06:31.143776+0000","last_clean":"2024-04-25T22:06:31.143776+0000","last_became_active":"2024-04-25T22:06:23.110101+0000","last_became_peered":"2024-04-25T22:06:23.110101+0000","last_unstale":"2024-04-25T22:06:31.143776+0000","last_undegraded":"2024-04-25T22:06:31.143776+0000","last_fullsized":"2024-04-25T22:06:31.143776+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:40.218610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23004,"num_write":370,"num_write_kb":75802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'436","reported_seq":559,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843341+0000","last_change":"2024-04-25T22:06:28.838562+0000","last_active":"2024-04-25T22:06:30.843341+0000","last_peered":"2024-04-25T22:06:30.843341+0000","last_clean":"2024-04-25T22:06:30.843341+0000","last_became_active":"2024-04-25T22:06:28.835081+0000","last_became_peered":"2024-04-25T22:06:28.835081+0000","last_unstale":"2024-04-25T22:06:30.843341+0000","last_undegraded":"2024-04-25T22:06:30.843341+0000","last_fullsized":"2024-04-25T22:06:30.843341+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:15:18.057041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11950,"num_write":408,"num_write_kb":67524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"76'403","reported_seq":607,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.847686+0000","last_change":"2024-04-25T22:06:22.810930+0000","last_active":"2024-04-25T22:06:30.847686+0000","last_peered":"2024-04-25T22:06:30.847686+0000","last_clean":"2024-04-25T22:06:30.847686+0000","last_became_active":"2024-04-25T22:06:22.802907+0000","last_became_peered":"2024-04-25T22:06:22.802907+0000","last_unstale":"2024-04-25T22:06:30.847686+0000","last_undegraded":"2024-04-25T22:06:30.847686+0000","last_fullsized":"2024-04-25T22:06:30.847686+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:00.334109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":6507,"num_write":370,"num_write_kb":51513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'449","reported_seq":574,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842684+0000","last_change":"2024-04-25T22:06:28.846531+0000","last_active":"2024-04-25T22:06:30.842684+0000","last_peered":"2024-04-25T22:06:30.842684+0000","last_clean":"2024-04-25T22:06:30.842684+0000","last_became_active":"2024-04-25T22:06:28.841283+0000","last_became_peered":"2024-04-25T22:06:28.841283+0000","last_unstale":"2024-04-25T22:06:30.842684+0000","last_undegraded":"2024-04-25T22:06:30.842684+0000","last_fullsized":"2024-04-25T22:06:30.842684+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:02.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27047,"num_write":417,"num_write_kb":63386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"76'406","reported_seq":571,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845286+0000","last_change":"2024-04-25T22:06:22.801634+0000","last_active":"2024-04-25T22:06:30.845286+0000","last_peered":"2024-04-25T22:06:30.845286+0000","last_clean":"2024-04-25T22:06:30.845286+0000","last_became_active":"2024-04-25T22:06:22.791470+0000","last_became_peered":"2024-04-25T22:06:22.791470+0000","last_unstale":"2024-04-25T22:06:30.845286+0000","last_undegraded":"2024-04-25T22:06:30.845286+0000","last_fullsized":"2024-04-25T22:06:30.845286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:25.424659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25550,"num_write":386,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"76'485","reported_seq":735,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850945+0000","last_change":"2024-04-25T22:06:22.814124+0000","last_active":"2024-04-25T22:06:30.850945+0000","last_peered":"2024-04-25T22:06:30.850945+0000","last_clean":"2024-04-25T22:06:30.850945+0000","last_became_active":"2024-04-25T22:06:22.804228+0000","last_became_peered":"2024-04-25T22:06:22.804228+0000","last_unstale":"2024-04-25T22:06:30.850945+0000","last_undegraded":"2024-04-25T22:06:30.850945+0000","last_fullsized":"2024-04-25T22:06:30.850945+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":30714,"num_write":444,"num_write_kb":92836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'387","reported_seq":592,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144694+0000","last_change":"2024-04-25T22:06:23.134971+0000","last_active":"2024-04-25T22:06:31.144694+0000","last_peered":"2024-04-25T22:06:31.144694+0000","last_clean":"2024-04-25T22:06:31.144694+0000","last_became_active":"2024-04-25T22:06:23.121334+0000","last_became_peered":"2024-04-25T22:06:23.121334+0000","last_unstale":"2024-04-25T22:06:31.144694+0000","last_undegraded":"2024-04-25T22:06:31.144694+0000","last_fullsized":"2024-04-25T22:06:31.144694+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:03.991336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21644,"num_write":354,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"76'405","reported_seq":649,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844816+0000","last_change":"2024-04-25T22:06:22.829889+0000","last_active":"2024-04-25T22:06:30.844816+0000","last_peered":"2024-04-25T22:06:30.844816+0000","last_clean":"2024-04-25T22:06:30.844816+0000","last_became_active":"2024-04-25T22:06:22.827066+0000","last_became_peered":"2024-04-25T22:06:22.827066+0000","last_unstale":"2024-04-25T22:06:30.844816+0000","last_undegraded":"2024-04-25T22:06:30.844816+0000","last_fullsized":"2024-04-25T22:06:30.844816+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:01.822252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27522,"num_write":375,"num_write_kb":96416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"76'396","reported_seq":619,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850059+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:06:30.850059+0000","last_peered":"2024-04-25T22:06:30.850059+0000","last_clean":"2024-04-25T22:06:30.850059+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:06:30.850059+0000","last_undegraded":"2024-04-25T22:06:30.850059+0000","last_fullsized":"2024-04-25T22:06:30.850059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28501,"num_write":367,"num_write_kb":63458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":654,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843955+0000","last_change":"2024-04-25T22:06:22.803787+0000","last_active":"2024-04-25T22:06:30.843955+0000","last_peered":"2024-04-25T22:06:30.843955+0000","last_clean":"2024-04-25T22:06:30.843955+0000","last_became_active":"2024-04-25T22:06:22.789907+0000","last_became_peered":"2024-04-25T22:06:22.789907+0000","last_unstale":"2024-04-25T22:06:30.843955+0000","last_undegraded":"2024-04-25T22:06:30.843955+0000","last_fullsized":"2024-04-25T22:06:30.843955+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":20717,"num_write":435,"num_write_kb":55985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"76'444","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848333+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:06:30.848333+0000","last_peered":"2024-04-25T22:06:30.848333+0000","last_clean":"2024-04-25T22:06:30.848333+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:06:30.848333+0000","last_undegraded":"2024-04-25T22:06:30.848333+0000","last_fullsized":"2024-04-25T22:06:30.848333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":10758,"num_write":401,"num_write_kb":44705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'422","reported_seq":533,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.160927+0000","last_change":"2024-04-25T22:06:31.160927+0000","last_active":"2024-04-25T22:06:31.160927+0000","last_peered":"2024-04-25T22:06:31.160927+0000","last_clean":"2024-04-25T22:06:31.160927+0000","last_became_active":"2024-04-25T22:06:31.148129+0000","last_became_peered":"2024-04-25T22:06:31.148129+0000","last_unstale":"2024-04-25T22:06:31.160927+0000","last_undegraded":"2024-04-25T22:06:31.160927+0000","last_fullsized":"2024-04-25T22:06:31.160927+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:26:06.579471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":29059,"num_write":391,"num_write_kb":40233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"76'397","reported_seq":894,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844568+0000","last_change":"2024-04-25T22:06:26.819859+0000","last_active":"2024-04-25T22:06:30.844568+0000","last_peered":"2024-04-25T22:06:30.844568+0000","last_clean":"2024-04-25T22:06:30.844568+0000","last_became_active":"2024-04-25T22:06:26.816439+0000","last_became_peered":"2024-04-25T22:06:26.816439+0000","last_unstale":"2024-04-25T22:06:30.844568+0000","last_undegraded":"2024-04-25T22:06:30.844568+0000","last_fullsized":"2024-04-25T22:06:30.844568+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:44.452918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28857,"num_write":363,"num_write_kb":87969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"75'515","reported_seq":671,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142622+0000","last_change":"2024-04-25T22:06:23.117492+0000","last_active":"2024-04-25T22:06:31.142622+0000","last_peered":"2024-04-25T22:06:31.142622+0000","last_clean":"2024-04-25T22:06:31.142622+0000","last_became_active":"2024-04-25T22:06:23.109665+0000","last_became_peered":"2024-04-25T22:06:23.109665+0000","last_unstale":"2024-04-25T22:06:31.142622+0000","last_undegraded":"2024-04-25T22:06:31.142622+0000","last_fullsized":"2024-04-25T22:06:31.142622+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:01.482888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"76'375","reported_seq":481,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845202+0000","last_change":"2024-04-25T22:06:28.846182+0000","last_active":"2024-04-25T22:06:30.845202+0000","last_peered":"2024-04-25T22:06:30.845202+0000","last_clean":"2024-04-25T22:06:30.845202+0000","last_became_active":"2024-04-25T22:06:28.841545+0000","last_became_peered":"2024-04-25T22:06:28.841545+0000","last_unstale":"2024-04-25T22:06:30.845202+0000","last_undegraded":"2024-04-25T22:06:30.845202+0000","last_fullsized":"2024-04-25T22:06:30.845202+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.018915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14983,"num_write":339,"num_write_kb":46748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'53","reported_seq":237,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849016+0000","last_change":"2024-04-25T22:06:22.839083+0000","last_active":"2024-04-25T22:06:30.849016+0000","last_peered":"2024-04-25T22:06:30.849016+0000","last_clean":"2024-04-25T22:06:30.849016+0000","last_became_active":"2024-04-25T22:06:22.833424+0000","last_became_peered":"2024-04-25T22:06:22.833424+0000","last_unstale":"2024-04-25T22:06:30.849016+0000","last_undegraded":"2024-04-25T22:06:30.849016+0000","last_fullsized":"2024-04-25T22:06:30.849016+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:00.819067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'426","reported_seq":639,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851784+0000","last_change":"2024-04-25T22:06:26.822923+0000","last_active":"2024-04-25T22:06:30.851784+0000","last_peered":"2024-04-25T22:06:30.851784+0000","last_clean":"2024-04-25T22:06:30.851784+0000","last_became_active":"2024-04-25T22:06:26.819562+0000","last_became_peered":"2024-04-25T22:06:26.819562+0000","last_unstale":"2024-04-25T22:06:30.851784+0000","last_undegraded":"2024-04-25T22:06:30.851784+0000","last_fullsized":"2024-04-25T22:06:30.851784+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:42.832195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":17843,"num_write":388,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"75'71","reported_seq":188,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843496+0000","last_change":"2024-04-25T22:06:22.799710+0000","last_active":"2024-04-25T22:06:30.843496+0000","last_peered":"2024-04-25T22:06:30.843496+0000","last_clean":"2024-04-25T22:06:30.843496+0000","last_became_active":"2024-04-25T22:06:22.790902+0000","last_became_peered":"2024-04-25T22:06:22.790902+0000","last_unstale":"2024-04-25T22:06:30.843496+0000","last_undegraded":"2024-04-25T22:06:30.843496+0000","last_fullsized":"2024-04-25T22:06:30.843496+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:50:36.683583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'366","reported_seq":571,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850882+0000","last_change":"2024-04-25T22:06:22.809150+0000","last_active":"2024-04-25T22:06:30.850882+0000","last_peered":"2024-04-25T22:06:30.850882+0000","last_clean":"2024-04-25T22:06:30.850882+0000","last_became_active":"2024-04-25T22:06:22.803327+0000","last_became_peered":"2024-04-25T22:06:22.803327+0000","last_unstale":"2024-04-25T22:06:30.850882+0000","last_undegraded":"2024-04-25T22:06:30.850882+0000","last_fullsized":"2024-04-25T22:06:30.850882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.731906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":16032,"num_write":334,"num_write_kb":25754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'63","reported_seq":221,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140280+0000","last_change":"2024-04-25T22:06:23.085892+0000","last_active":"2024-04-25T22:06:31.140280+0000","last_peered":"2024-04-25T22:06:31.140280+0000","last_clean":"2024-04-25T22:06:31.140280+0000","last_became_active":"2024-04-25T22:06:23.082351+0000","last_became_peered":"2024-04-25T22:06:23.082351+0000","last_unstale":"2024-04-25T22:06:31.140280+0000","last_undegraded":"2024-04-25T22:06:31.140280+0000","last_fullsized":"2024-04-25T22:06:31.140280+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:51.142517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"76'148","reported_seq":306,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143742+0000","last_change":"2024-04-25T22:06:23.089179+0000","last_active":"2024-04-25T22:06:31.143742+0000","last_peered":"2024-04-25T22:06:31.143742+0000","last_clean":"2024-04-25T22:06:31.143742+0000","last_became_active":"2024-04-25T22:06:23.085599+0000","last_became_peered":"2024-04-25T22:06:23.085599+0000","last_unstale":"2024-04-25T22:06:31.143742+0000","last_undegraded":"2024-04-25T22:06:31.143742+0000","last_fullsized":"2024-04-25T22:06:31.143742+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:53:14.055158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"76'402","reported_seq":568,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842703+0000","last_change":"2024-04-25T22:06:22.802685+0000","last_active":"2024-04-25T22:06:30.842703+0000","last_peered":"2024-04-25T22:06:30.842703+0000","last_clean":"2024-04-25T22:06:30.842703+0000","last_became_active":"2024-04-25T22:06:22.789353+0000","last_became_peered":"2024-04-25T22:06:22.789353+0000","last_unstale":"2024-04-25T22:06:30.842703+0000","last_undegraded":"2024-04-25T22:06:30.842703+0000","last_fullsized":"2024-04-25T22:06:30.842703+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:14.949049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21114,"num_write":364,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"75'250","reported_seq":374,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844891+0000","last_change":"2024-04-25T22:06:22.791598+0000","last_active":"2024-04-25T22:06:30.844891+0000","last_peered":"2024-04-25T22:06:30.844891+0000","last_clean":"2024-04-25T22:06:30.844891+0000","last_became_active":"2024-04-25T22:06:22.790508+0000","last_became_peered":"2024-04-25T22:06:22.790508+0000","last_unstale":"2024-04-25T22:06:30.844891+0000","last_undegraded":"2024-04-25T22:06:30.844891+0000","last_fullsized":"2024-04-25T22:06:30.844891+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"76'460","reported_seq":634,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842903+0000","last_change":"2024-04-25T22:03:33.861055+0000","last_active":"2024-04-25T22:06:30.842903+0000","last_peered":"2024-04-25T22:06:30.842903+0000","last_clean":"2024-04-25T22:06:30.842903+0000","last_became_active":"2024-04-25T22:03:33.856638+0000","last_became_peered":"2024-04-25T22:03:33.856638+0000","last_unstale":"2024-04-25T22:06:30.842903+0000","last_undegraded":"2024-04-25T22:06:30.842903+0000","last_fullsized":"2024-04-25T22:06:30.842903+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":39774,"num_write":433,"num_write_kb":80294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'556","reported_seq":714,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.148664+0000","last_change":"2024-04-25T22:06:31.148664+0000","last_active":"2024-04-25T22:06:31.148664+0000","last_peered":"2024-04-25T22:06:31.148664+0000","last_clean":"2024-04-25T22:06:31.148664+0000","last_became_active":"2024-04-25T22:06:31.147569+0000","last_became_peered":"2024-04-25T22:06:31.147569+0000","last_unstale":"2024-04-25T22:06:31.148664+0000","last_undegraded":"2024-04-25T22:06:31.148664+0000","last_fullsized":"2024-04-25T22:06:31.148664+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:41.798311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":509,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"76'413","reported_seq":577,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142062+0000","last_change":"2024-04-25T22:06:23.129627+0000","last_active":"2024-04-25T22:06:31.142062+0000","last_peered":"2024-04-25T22:06:31.142062+0000","last_clean":"2024-04-25T22:06:31.142062+0000","last_became_active":"2024-04-25T22:06:23.108199+0000","last_became_peered":"2024-04-25T22:06:23.108199+0000","last_unstale":"2024-04-25T22:06:31.142062+0000","last_undegraded":"2024-04-25T22:06:31.142062+0000","last_fullsized":"2024-04-25T22:06:31.142062+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:23.828740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4858,"num_write":378,"num_write_kb":46741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"76'66","reported_seq":77,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161275+0000","last_change":"2024-04-25T22:06:31.161275+0000","last_active":"2024-04-25T22:06:31.161275+0000","last_peered":"2024-04-25T22:06:31.161275+0000","last_clean":"2024-04-25T22:06:31.161275+0000","last_became_active":"2024-04-25T22:06:31.160267+0000","last_became_peered":"2024-04-25T22:06:31.160267+0000","last_unstale":"2024-04-25T22:06:31.161275+0000","last_undegraded":"2024-04-25T22:06:31.161275+0000","last_fullsized":"2024-04-25T22:06:31.161275+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:14.214127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"76'489","reported_seq":729,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850154+0000","last_change":"2024-04-25T22:06:22.838952+0000","last_active":"2024-04-25T22:06:30.850154+0000","last_peered":"2024-04-25T22:06:30.850154+0000","last_clean":"2024-04-25T22:06:30.850154+0000","last_became_active":"2024-04-25T22:06:22.832394+0000","last_became_peered":"2024-04-25T22:06:22.832394+0000","last_unstale":"2024-04-25T22:06:30.850154+0000","last_undegraded":"2024-04-25T22:06:30.850154+0000","last_fullsized":"2024-04-25T22:06:30.850154+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:04:38.988916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":26829,"num_write":457,"num_write_kb":137840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"75'193","reported_seq":377,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850501+0000","last_change":"2024-04-25T22:06:22.838157+0000","last_active":"2024-04-25T22:06:30.850501+0000","last_peered":"2024-04-25T22:06:30.850501+0000","last_clean":"2024-04-25T22:06:30.850501+0000","last_became_active":"2024-04-25T22:06:22.832572+0000","last_became_peered":"2024-04-25T22:06:22.832572+0000","last_unstale":"2024-04-25T22:06:30.850501+0000","last_undegraded":"2024-04-25T22:06:30.850501+0000","last_fullsized":"2024-04-25T22:06:30.850501+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:34.994194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'437","reported_seq":528,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.160788+0000","last_change":"2024-04-25T22:06:31.160788+0000","last_active":"2024-04-25T22:06:31.160788+0000","last_peered":"2024-04-25T22:06:31.160788+0000","last_clean":"2024-04-25T22:06:31.160788+0000","last_became_active":"2024-04-25T22:06:31.147501+0000","last_became_peered":"2024-04-25T22:06:31.147501+0000","last_unstale":"2024-04-25T22:06:31.160788+0000","last_undegraded":"2024-04-25T22:06:31.160788+0000","last_fullsized":"2024-04-25T22:06:31.160788+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:30:29.866840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3720,"num_write":406,"num_write_kb":30461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"76'106","reported_seq":264,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140763+0000","last_change":"2024-04-25T22:06:23.128769+0000","last_active":"2024-04-25T22:06:31.140763+0000","last_peered":"2024-04-25T22:06:31.140763+0000","last_clean":"2024-04-25T22:06:31.140763+0000","last_became_active":"2024-04-25T22:06:23.103402+0000","last_became_peered":"2024-04-25T22:06:23.103402+0000","last_unstale":"2024-04-25T22:06:31.140763+0000","last_undegraded":"2024-04-25T22:06:31.140763+0000","last_fullsized":"2024-04-25T22:06:31.140763+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:27.137773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"76'409","reported_seq":605,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143850+0000","last_change":"2024-04-25T22:06:23.133536+0000","last_active":"2024-04-25T22:06:31.143850+0000","last_peered":"2024-04-25T22:06:31.143850+0000","last_clean":"2024-04-25T22:06:31.143850+0000","last_became_active":"2024-04-25T22:06:23.086188+0000","last_became_peered":"2024-04-25T22:06:23.086188+0000","last_unstale":"2024-04-25T22:06:31.143850+0000","last_undegraded":"2024-04-25T22:06:31.143850+0000","last_fullsized":"2024-04-25T22:06:31.143850+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:13:59.140479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19178,"num_write":380,"num_write_kb":91945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"75'51","reported_seq":182,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843314+0000","last_change":"2024-04-25T22:06:22.800659+0000","last_active":"2024-04-25T22:06:30.843314+0000","last_peered":"2024-04-25T22:06:30.843314+0000","last_clean":"2024-04-25T22:06:30.843314+0000","last_became_active":"2024-04-25T22:06:22.798779+0000","last_became_peered":"2024-04-25T22:06:22.798779+0000","last_unstale":"2024-04-25T22:06:30.843314+0000","last_undegraded":"2024-04-25T22:06:30.843314+0000","last_fullsized":"2024-04-25T22:06:30.843314+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:35.728722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"76'377","reported_seq":561,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143491+0000","last_change":"2024-04-25T22:06:23.114225+0000","last_active":"2024-04-25T22:06:31.143491+0000","last_peered":"2024-04-25T22:06:31.143491+0000","last_clean":"2024-04-25T22:06:31.143491+0000","last_became_active":"2024-04-25T22:06:23.085799+0000","last_became_peered":"2024-04-25T22:06:23.085799+0000","last_unstale":"2024-04-25T22:06:31.143491+0000","last_undegraded":"2024-04-25T22:06:31.143491+0000","last_fullsized":"2024-04-25T22:06:31.143491+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:50.484372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21517,"num_write":342,"num_write_kb":66898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"75'449","reported_seq":546,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843127+0000","last_change":"2024-04-25T22:03:33.860386+0000","last_active":"2024-04-25T22:06:30.843127+0000","last_peered":"2024-04-25T22:06:30.843127+0000","last_clean":"2024-04-25T22:06:30.843127+0000","last_became_active":"2024-04-25T22:03:33.859539+0000","last_became_peered":"2024-04-25T22:03:33.859539+0000","last_unstale":"2024-04-25T22:06:30.843127+0000","last_undegraded":"2024-04-25T22:06:30.843127+0000","last_fullsized":"2024-04-25T22:06:30.843127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:20.247942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'399","reported_seq":613,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850961+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:06:30.850961+0000","last_peered":"2024-04-25T22:06:30.850961+0000","last_clean":"2024-04-25T22:06:30.850961+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:06:30.850961+0000","last_undegraded":"2024-04-25T22:06:30.850961+0000","last_fullsized":"2024-04-25T22:06:30.850961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17888,"num_write":373,"num_write_kb":67556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":318,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140066+0000","last_change":"2024-04-25T22:06:23.082707+0000","last_active":"2024-04-25T22:06:31.140066+0000","last_peered":"2024-04-25T22:06:31.140066+0000","last_clean":"2024-04-25T22:06:31.140066+0000","last_became_active":"2024-04-25T22:06:23.080701+0000","last_became_peered":"2024-04-25T22:06:23.080701+0000","last_unstale":"2024-04-25T22:06:31.140066+0000","last_undegraded":"2024-04-25T22:06:31.140066+0000","last_fullsized":"2024-04-25T22:06:31.140066+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:27.088849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141705+0000","last_change":"2024-04-25T22:06:23.116373+0000","last_active":"2024-04-25T22:06:31.141705+0000","last_peered":"2024-04-25T22:06:31.141705+0000","last_clean":"2024-04-25T22:06:31.141705+0000","last_became_active":"2024-04-25T22:06:23.108984+0000","last_became_peered":"2024-04-25T22:06:23.108984+0000","last_unstale":"2024-04-25T22:06:31.141705+0000","last_undegraded":"2024-04-25T22:06:31.141705+0000","last_fullsized":"2024-04-25T22:06:31.141705+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:08.884723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"75'393","reported_seq":570,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849474+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:06:30.849474+0000","last_peered":"2024-04-25T22:06:30.849474+0000","last_clean":"2024-04-25T22:06:30.849474+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:06:30.849474+0000","last_undegraded":"2024-04-25T22:06:30.849474+0000","last_fullsized":"2024-04-25T22:06:30.849474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'463","reported_seq":668,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144389+0000","last_change":"2024-04-25T22:06:23.133028+0000","last_active":"2024-04-25T22:06:31.144389+0000","last_peered":"2024-04-25T22:06:31.144389+0000","last_clean":"2024-04-25T22:06:31.144389+0000","last_became_active":"2024-04-25T22:06:23.082756+0000","last_became_peered":"2024-04-25T22:06:23.082756+0000","last_unstale":"2024-04-25T22:06:31.144389+0000","last_undegraded":"2024-04-25T22:06:31.144389+0000","last_fullsized":"2024-04-25T22:06:31.144389+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:24:01.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29270,"num_write":426,"num_write_kb":129367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141100+0000","last_change":"2024-04-25T22:06:23.083451+0000","last_active":"2024-04-25T22:06:31.141100+0000","last_peered":"2024-04-25T22:06:31.141100+0000","last_clean":"2024-04-25T22:06:31.141100+0000","last_became_active":"2024-04-25T22:06:23.080841+0000","last_became_peered":"2024-04-25T22:06:23.080841+0000","last_unstale":"2024-04-25T22:06:31.141100+0000","last_undegraded":"2024-04-25T22:06:31.141100+0000","last_fullsized":"2024-04-25T22:06:31.141100+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:34.605367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"76'125","reported_seq":372,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849223+0000","last_change":"2024-04-25T22:06:22.804290+0000","last_active":"2024-04-25T22:06:30.849223+0000","last_peered":"2024-04-25T22:06:30.849223+0000","last_clean":"2024-04-25T22:06:30.849223+0000","last_became_active":"2024-04-25T22:06:22.801616+0000","last_became_peered":"2024-04-25T22:06:22.801616+0000","last_unstale":"2024-04-25T22:06:30.849223+0000","last_undegraded":"2024-04-25T22:06:30.849223+0000","last_fullsized":"2024-04-25T22:06:30.849223+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:13.402747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464197,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":63,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'457","reported_seq":646,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844136+0000","last_change":"2024-04-25T22:03:05.702224+0000","last_active":"2024-04-25T22:06:30.844136+0000","last_peered":"2024-04-25T22:06:30.844136+0000","last_clean":"2024-04-25T22:06:30.844136+0000","last_became_active":"2024-04-25T22:03:05.699581+0000","last_became_peered":"2024-04-25T22:03:05.699581+0000","last_unstale":"2024-04-25T22:06:30.844136+0000","last_undegraded":"2024-04-25T22:06:30.844136+0000","last_fullsized":"2024-04-25T22:06:30.844136+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":34759,"num_write":424,"num_write_kb":71902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849418+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:06:30.849418+0000","last_peered":"2024-04-25T22:06:30.849418+0000","last_clean":"2024-04-25T22:06:30.849418+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:06:30.849418+0000","last_undegraded":"2024-04-25T22:06:30.849418+0000","last_fullsized":"2024-04-25T22:06:30.849418+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"75'311","reported_seq":496,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843037+0000","last_change":"2024-04-25T22:06:22.801481+0000","last_active":"2024-04-25T22:06:30.843037+0000","last_peered":"2024-04-25T22:06:30.843037+0000","last_clean":"2024-04-25T22:06:30.843037+0000","last_became_active":"2024-04-25T22:06:22.794841+0000","last_became_peered":"2024-04-25T22:06:22.794841+0000","last_unstale":"2024-04-25T22:06:30.843037+0000","last_undegraded":"2024-04-25T22:06:30.843037+0000","last_fullsized":"2024-04-25T22:06:30.843037+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:06:59.330924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"76'373","reported_seq":592,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851291+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:06:30.851291+0000","last_peered":"2024-04-25T22:06:30.851291+0000","last_clean":"2024-04-25T22:06:30.851291+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:06:30.851291+0000","last_undegraded":"2024-04-25T22:06:30.851291+0000","last_fullsized":"2024-04-25T22:06:30.851291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28273,"num_write":350,"num_write_kb":87787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140545+0000","last_change":"2024-04-25T22:06:23.129162+0000","last_active":"2024-04-25T22:06:31.140545+0000","last_peered":"2024-04-25T22:06:31.140545+0000","last_clean":"2024-04-25T22:06:31.140545+0000","last_became_active":"2024-04-25T22:06:23.106155+0000","last_became_peered":"2024-04-25T22:06:23.106155+0000","last_unstale":"2024-04-25T22:06:31.140545+0000","last_undegraded":"2024-04-25T22:06:31.140545+0000","last_fullsized":"2024-04-25T22:06:31.140545+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:30.846068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"76'75","reported_seq":77,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161388+0000","last_change":"2024-04-25T22:06:31.161388+0000","last_active":"2024-04-25T22:06:31.161388+0000","last_peered":"2024-04-25T22:06:31.161388+0000","last_clean":"2024-04-25T22:06:31.161388+0000","last_became_active":"2024-04-25T22:06:31.150555+0000","last_became_peered":"2024-04-25T22:06:31.150555+0000","last_unstale":"2024-04-25T22:06:31.161388+0000","last_undegraded":"2024-04-25T22:06:31.161388+0000","last_fullsized":"2024-04-25T22:06:31.161388+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:56:50.706657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"76'461","reported_seq":753,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850519+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:06:30.850519+0000","last_peered":"2024-04-25T22:06:30.850519+0000","last_clean":"2024-04-25T22:06:30.850519+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:06:30.850519+0000","last_undegraded":"2024-04-25T22:06:30.850519+0000","last_fullsized":"2024-04-25T22:06:30.850519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":67984,"num_write":425,"num_write_kb":154741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"76'268","reported_seq":425,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143156+0000","last_change":"2024-04-25T22:06:23.134306+0000","last_active":"2024-04-25T22:06:31.143156+0000","last_peered":"2024-04-25T22:06:31.143156+0000","last_clean":"2024-04-25T22:06:31.143156+0000","last_became_active":"2024-04-25T22:06:23.122629+0000","last_became_peered":"2024-04-25T22:06:23.122629+0000","last_unstale":"2024-04-25T22:06:31.143156+0000","last_undegraded":"2024-04-25T22:06:31.143156+0000","last_fullsized":"2024-04-25T22:06:31.143156+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:41.205934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850998+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:06:30.850998+0000","last_peered":"2024-04-25T22:06:30.850998+0000","last_clean":"2024-04-25T22:06:30.850998+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:06:30.850998+0000","last_undegraded":"2024-04-25T22:06:30.850998+0000","last_fullsized":"2024-04-25T22:06:30.850998+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'398","reported_seq":578,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843743+0000","last_change":"2024-04-25T22:06:22.797468+0000","last_active":"2024-04-25T22:06:30.843743+0000","last_peered":"2024-04-25T22:06:30.843743+0000","last_clean":"2024-04-25T22:06:30.843743+0000","last_became_active":"2024-04-25T22:06:22.789384+0000","last_became_peered":"2024-04-25T22:06:22.789384+0000","last_unstale":"2024-04-25T22:06:30.843743+0000","last_undegraded":"2024-04-25T22:06:30.843743+0000","last_fullsized":"2024-04-25T22:06:30.843743+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:35.557386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":26599,"num_write":366,"num_write_kb":75612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"76'47","reported_seq":224,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850762+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:06:30.850762+0000","last_peered":"2024-04-25T22:06:30.850762+0000","last_clean":"2024-04-25T22:06:30.850762+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:06:30.850762+0000","last_undegraded":"2024-04-25T22:06:30.850762+0000","last_fullsized":"2024-04-25T22:06:30.850762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":171,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845730+0000","last_change":"2024-04-25T22:03:05.701809+0000","last_active":"2024-04-25T22:06:30.845730+0000","last_peered":"2024-04-25T22:06:30.845730+0000","last_clean":"2024-04-25T22:06:30.845730+0000","last_became_active":"2024-04-25T22:03:05.701322+0000","last_became_peered":"2024-04-25T22:03:05.701322+0000","last_unstale":"2024-04-25T22:06:30.845730+0000","last_undegraded":"2024-04-25T22:06:30.845730+0000","last_fullsized":"2024-04-25T22:06:30.845730+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:45.907458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"76'406","reported_seq":642,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844251+0000","last_change":"2024-04-25T22:06:22.802683+0000","last_active":"2024-04-25T22:06:30.844251+0000","last_peered":"2024-04-25T22:06:30.844251+0000","last_clean":"2024-04-25T22:06:30.844251+0000","last_became_active":"2024-04-25T22:06:22.789807+0000","last_became_peered":"2024-04-25T22:06:22.789807+0000","last_unstale":"2024-04-25T22:06:30.844251+0000","last_undegraded":"2024-04-25T22:06:30.844251+0000","last_fullsized":"2024-04-25T22:06:30.844251+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:15.180532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25634,"num_write":377,"num_write_kb":103970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"76'64","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.852026+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:06:30.852026+0000","last_peered":"2024-04-25T22:06:30.852026+0000","last_clean":"2024-04-25T22:06:30.852026+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:06:30.852026+0000","last_undegraded":"2024-04-25T22:06:30.852026+0000","last_fullsized":"2024-04-25T22:06:30.852026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142483+0000","last_change":"2024-04-25T22:06:24.092672+0000","last_active":"2024-04-25T22:06:31.142483+0000","last_peered":"2024-04-25T22:06:31.142483+0000","last_clean":"2024-04-25T22:06:31.142483+0000","last_became_active":"2024-04-25T22:06:24.091909+0000","last_became_peered":"2024-04-25T22:06:24.091909+0000","last_unstale":"2024-04-25T22:06:31.142483+0000","last_undegraded":"2024-04-25T22:06:31.142483+0000","last_fullsized":"2024-04-25T22:06:31.142483+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:19:21.605435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"76'402","reported_seq":605,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848860+0000","last_change":"2024-04-25T22:06:22.809713+0000","last_active":"2024-04-25T22:06:30.848860+0000","last_peered":"2024-04-25T22:06:30.848860+0000","last_clean":"2024-04-25T22:06:30.848860+0000","last_became_active":"2024-04-25T22:06:22.802005+0000","last_became_peered":"2024-04-25T22:06:22.802005+0000","last_unstale":"2024-04-25T22:06:30.848860+0000","last_undegraded":"2024-04-25T22:06:30.848860+0000","last_fullsized":"2024-04-25T22:06:30.848860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9572,"num_write":361,"num_write_kb":29911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"77'127","reported_seq":311,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851852+0000","last_change":"2024-04-25T22:06:22.804851+0000","last_active":"2024-04-25T22:06:30.851852+0000","last_peered":"2024-04-25T22:06:30.851852+0000","last_clean":"2024-04-25T22:06:30.851852+0000","last_became_active":"2024-04-25T22:06:22.802083+0000","last_became_peered":"2024-04-25T22:06:22.802083+0000","last_unstale":"2024-04-25T22:06:30.851852+0000","last_undegraded":"2024-04-25T22:06:30.851852+0000","last_fullsized":"2024-04-25T22:06:30.851852+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142866+0000","last_change":"2024-04-25T22:06:23.081230+0000","last_active":"2024-04-25T22:06:31.142866+0000","last_peered":"2024-04-25T22:06:31.142866+0000","last_clean":"2024-04-25T22:06:31.142866+0000","last_became_active":"2024-04-25T22:06:23.080393+0000","last_became_peered":"2024-04-25T22:06:23.080393+0000","last_unstale":"2024-04-25T22:06:31.142866+0000","last_undegraded":"2024-04-25T22:06:31.142866+0000","last_fullsized":"2024-04-25T22:06:31.142866+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:55.157159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"76'415","reported_seq":596,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842908+0000","last_change":"2024-04-25T22:06:22.801327+0000","last_active":"2024-04-25T22:06:30.842908+0000","last_peered":"2024-04-25T22:06:30.842908+0000","last_clean":"2024-04-25T22:06:30.842908+0000","last_became_active":"2024-04-25T22:06:22.789624+0000","last_became_peered":"2024-04-25T22:06:22.789624+0000","last_unstale":"2024-04-25T22:06:30.842908+0000","last_undegraded":"2024-04-25T22:06:30.842908+0000","last_fullsized":"2024-04-25T22:06:30.842908+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27345,"num_write":384,"num_write_kb":92854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"76'407","reported_seq":623,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143259+0000","last_change":"2024-04-25T22:06:23.114739+0000","last_active":"2024-04-25T22:06:31.143259+0000","last_peered":"2024-04-25T22:06:31.143259+0000","last_clean":"2024-04-25T22:06:31.143259+0000","last_became_active":"2024-04-25T22:06:23.087118+0000","last_became_peered":"2024-04-25T22:06:23.087118+0000","last_unstale":"2024-04-25T22:06:31.143259+0000","last_undegraded":"2024-04-25T22:06:31.143259+0000","last_fullsized":"2024-04-25T22:06:31.143259+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:51.191212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33923,"num_write":372,"num_write_kb":82083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"77'260","reported_seq":420,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142062+0000","last_change":"2024-04-25T22:06:23.083331+0000","last_active":"2024-04-25T22:06:31.142062+0000","last_peered":"2024-04-25T22:06:31.142062+0000","last_clean":"2024-04-25T22:06:31.142062+0000","last_became_active":"2024-04-25T22:06:23.080552+0000","last_became_peered":"2024-04-25T22:06:23.080552+0000","last_unstale":"2024-04-25T22:06:31.142062+0000","last_undegraded":"2024-04-25T22:06:31.142062+0000","last_fullsized":"2024-04-25T22:06:31.142062+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:55.928212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8470619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"76'408","reported_seq":610,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848693+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:06:30.848693+0000","last_peered":"2024-04-25T22:06:30.848693+0000","last_clean":"2024-04-25T22:06:30.848693+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:06:30.848693+0000","last_undegraded":"2024-04-25T22:06:30.848693+0000","last_fullsized":"2024-04-25T22:06:30.848693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14178,"num_write":370,"num_write_kb":58735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'104","reported_seq":289,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845584+0000","last_change":"2024-04-25T22:06:22.805389+0000","last_active":"2024-04-25T22:06:30.845584+0000","last_peered":"2024-04-25T22:06:30.845584+0000","last_clean":"2024-04-25T22:06:30.845584+0000","last_became_active":"2024-04-25T22:06:22.802667+0000","last_became_peered":"2024-04-25T22:06:22.802667+0000","last_unstale":"2024-04-25T22:06:30.845584+0000","last_undegraded":"2024-04-25T22:06:30.845584+0000","last_fullsized":"2024-04-25T22:06:30.845584+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:38.785650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"75'232","reported_seq":286,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.151793+0000","last_change":"2024-04-25T22:06:31.151793+0000","last_active":"2024-04-25T22:06:31.151793+0000","last_peered":"2024-04-25T22:06:31.151793+0000","last_clean":"2024-04-25T22:06:31.151793+0000","last_became_active":"2024-04-25T22:06:31.150582+0000","last_became_peered":"2024-04-25T22:06:31.150582+0000","last_unstale":"2024-04-25T22:06:31.151793+0000","last_undegraded":"2024-04-25T22:06:31.151793+0000","last_fullsized":"2024-04-25T22:06:31.151793+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:49.932959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"76'483","reported_seq":713,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848496+0000","last_change":"2024-04-25T22:06:22.814119+0000","last_active":"2024-04-25T22:06:30.848496+0000","last_peered":"2024-04-25T22:06:30.848496+0000","last_clean":"2024-04-25T22:06:30.848496+0000","last_became_active":"2024-04-25T22:06:22.807584+0000","last_became_peered":"2024-04-25T22:06:22.807584+0000","last_unstale":"2024-04-25T22:06:30.848496+0000","last_undegraded":"2024-04-25T22:06:30.848496+0000","last_fullsized":"2024-04-25T22:06:30.848496+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:08.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24709,"num_write":463,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"75'60","reported_seq":244,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851719+0000","last_change":"2024-04-25T22:06:22.802356+0000","last_active":"2024-04-25T22:06:30.851719+0000","last_peered":"2024-04-25T22:06:30.851719+0000","last_clean":"2024-04-25T22:06:30.851719+0000","last_became_active":"2024-04-25T22:06:22.801412+0000","last_became_peered":"2024-04-25T22:06:22.801412+0000","last_unstale":"2024-04-25T22:06:30.851719+0000","last_undegraded":"2024-04-25T22:06:30.851719+0000","last_fullsized":"2024-04-25T22:06:30.851719+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:04.421952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'444","reported_seq":648,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848562+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:06:30.848562+0000","last_peered":"2024-04-25T22:06:30.848562+0000","last_clean":"2024-04-25T22:06:30.848562+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:06:30.848562+0000","last_undegraded":"2024-04-25T22:06:30.848562+0000","last_fullsized":"2024-04-25T22:06:30.848562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14429,"num_write":416,"num_write_kb":59186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'355","reported_seq":499,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845399+0000","last_change":"2024-04-25T22:06:22.804579+0000","last_active":"2024-04-25T22:06:30.845399+0000","last_peered":"2024-04-25T22:06:30.845399+0000","last_clean":"2024-04-25T22:06:30.845399+0000","last_became_active":"2024-04-25T22:06:22.792886+0000","last_became_peered":"2024-04-25T22:06:22.792886+0000","last_unstale":"2024-04-25T22:06:30.845399+0000","last_undegraded":"2024-04-25T22:06:30.845399+0000","last_fullsized":"2024-04-25T22:06:30.845399+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:54:35.464321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18236,"num_write":332,"num_write_kb":42553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"76'742","reported_seq":919,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849150+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:06:30.849150+0000","last_peered":"2024-04-25T22:06:30.849150+0000","last_clean":"2024-04-25T22:06:30.849150+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:06:30.849150+0000","last_undegraded":"2024-04-25T22:06:30.849150+0000","last_fullsized":"2024-04-25T22:06:30.849150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'378","reported_seq":579,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851532+0000","last_change":"2024-04-25T22:06:22.813642+0000","last_active":"2024-04-25T22:06:30.851532+0000","last_peered":"2024-04-25T22:06:30.851532+0000","last_clean":"2024-04-25T22:06:30.851532+0000","last_became_active":"2024-04-25T22:06:22.806240+0000","last_became_peered":"2024-04-25T22:06:22.806240+0000","last_unstale":"2024-04-25T22:06:30.851532+0000","last_undegraded":"2024-04-25T22:06:30.851532+0000","last_fullsized":"2024-04-25T22:06:30.851532+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6876,"num_write":354,"num_write_kb":46840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"76'204","reported_seq":388,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848941+0000","last_change":"2024-04-25T22:06:22.805022+0000","last_active":"2024-04-25T22:06:30.848941+0000","last_peered":"2024-04-25T22:06:30.848941+0000","last_clean":"2024-04-25T22:06:30.848941+0000","last_became_active":"2024-04-25T22:06:22.801630+0000","last_became_peered":"2024-04-25T22:06:22.801630+0000","last_unstale":"2024-04-25T22:06:30.848941+0000","last_undegraded":"2024-04-25T22:06:30.848941+0000","last_fullsized":"2024-04-25T22:06:30.848941+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:34.554201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'377","reported_seq":515,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845146+0000","last_change":"2024-04-25T22:06:22.805011+0000","last_active":"2024-04-25T22:06:30.845146+0000","last_peered":"2024-04-25T22:06:30.845146+0000","last_clean":"2024-04-25T22:06:30.845146+0000","last_became_active":"2024-04-25T22:06:22.795334+0000","last_became_peered":"2024-04-25T22:06:22.795334+0000","last_unstale":"2024-04-25T22:06:30.845146+0000","last_undegraded":"2024-04-25T22:06:30.845146+0000","last_fullsized":"2024-04-25T22:06:30.845146+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:35.997378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6059,"num_write":332,"num_write_kb":37972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"76'217","reported_seq":332,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844027+0000","last_change":"2024-04-25T22:06:28.842258+0000","last_active":"2024-04-25T22:06:30.844027+0000","last_peered":"2024-04-25T22:06:30.844027+0000","last_clean":"2024-04-25T22:06:30.844027+0000","last_became_active":"2024-04-25T22:06:28.841447+0000","last_became_peered":"2024-04-25T22:06:28.841447+0000","last_unstale":"2024-04-25T22:06:30.844027+0000","last_undegraded":"2024-04-25T22:06:30.844027+0000","last_fullsized":"2024-04-25T22:06:30.844027+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:31.009167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"76'389","reported_seq":542,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844243+0000","last_change":"2024-04-25T22:03:33.862286+0000","last_active":"2024-04-25T22:06:30.844243+0000","last_peered":"2024-04-25T22:06:30.844243+0000","last_clean":"2024-04-25T22:06:30.844243+0000","last_became_active":"2024-04-25T22:03:33.860800+0000","last_became_peered":"2024-04-25T22:03:33.860800+0000","last_unstale":"2024-04-25T22:06:30.844243+0000","last_undegraded":"2024-04-25T22:06:30.844243+0000","last_fullsized":"2024-04-25T22:06:30.844243+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:04.528174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19110,"num_write":355,"num_write_kb":63152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'51","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844734+0000","last_change":"2024-04-25T22:06:22.804880+0000","last_active":"2024-04-25T22:06:30.844734+0000","last_peered":"2024-04-25T22:06:30.844734+0000","last_clean":"2024-04-25T22:06:30.844734+0000","last_became_active":"2024-04-25T22:06:22.803778+0000","last_became_peered":"2024-04-25T22:06:22.803778+0000","last_unstale":"2024-04-25T22:06:30.844734+0000","last_undegraded":"2024-04-25T22:06:30.844734+0000","last_fullsized":"2024-04-25T22:06:30.844734+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:47:58.480071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"76'386","reported_seq":483,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161983+0000","last_change":"2024-04-25T22:06:31.161983+0000","last_active":"2024-04-25T22:06:31.161983+0000","last_peered":"2024-04-25T22:06:31.161983+0000","last_clean":"2024-04-25T22:06:31.161983+0000","last_became_active":"2024-04-25T22:06:31.149995+0000","last_became_peered":"2024-04-25T22:06:31.149995+0000","last_unstale":"2024-04-25T22:06:31.161983+0000","last_undegraded":"2024-04-25T22:06:31.161983+0000","last_fullsized":"2024-04-25T22:06:31.161983+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:07:32.261028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14050,"num_write":362,"num_write_kb":58957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"76'188","reported_seq":231,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.159971+0000","last_change":"2024-04-25T22:06:31.159971+0000","last_active":"2024-04-25T22:06:31.159971+0000","last_peered":"2024-04-25T22:06:31.159971+0000","last_clean":"2024-04-25T22:06:31.159971+0000","last_became_active":"2024-04-25T22:06:31.148291+0000","last_became_peered":"2024-04-25T22:06:31.148291+0000","last_unstale":"2024-04-25T22:06:31.159971+0000","last_undegraded":"2024-04-25T22:06:31.159971+0000","last_fullsized":"2024-04-25T22:06:31.159971+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:31.095798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"76'397","reported_seq":494,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.160300+0000","last_change":"2024-04-25T22:06:31.160300+0000","last_active":"2024-04-25T22:06:31.160300+0000","last_peered":"2024-04-25T22:06:31.160300+0000","last_clean":"2024-04-25T22:06:31.160300+0000","last_became_active":"2024-04-25T22:06:31.148445+0000","last_became_peered":"2024-04-25T22:06:31.148445+0000","last_unstale":"2024-04-25T22:06:31.160300+0000","last_undegraded":"2024-04-25T22:06:31.160300+0000","last_fullsized":"2024-04-25T22:06:31.160300+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:31.697126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13280,"num_write":364,"num_write_kb":46108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"75'284","reported_seq":414,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845419+0000","last_change":"2024-04-25T22:06:22.804561+0000","last_active":"2024-04-25T22:06:30.845419+0000","last_peered":"2024-04-25T22:06:30.845419+0000","last_clean":"2024-04-25T22:06:30.845419+0000","last_became_active":"2024-04-25T22:06:22.794078+0000","last_became_peered":"2024-04-25T22:06:22.794078+0000","last_unstale":"2024-04-25T22:06:30.845419+0000","last_undegraded":"2024-04-25T22:06:30.845419+0000","last_fullsized":"2024-04-25T22:06:30.845419+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:07.939379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":12398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"76'412","reported_seq":538,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843652+0000","last_change":"2024-04-25T22:03:33.864136+0000","last_active":"2024-04-25T22:06:30.843652+0000","last_peered":"2024-04-25T22:06:30.843652+0000","last_clean":"2024-04-25T22:06:30.843652+0000","last_became_active":"2024-04-25T22:03:33.862435+0000","last_became_peered":"2024-04-25T22:03:33.862435+0000","last_unstale":"2024-04-25T22:06:30.843652+0000","last_undegraded":"2024-04-25T22:06:30.843652+0000","last_fullsized":"2024-04-25T22:06:30.843652+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:08.119964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":1478,"num_write":377,"num_write_kb":34422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"76'127","reported_seq":304,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851488+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:06:30.851488+0000","last_peered":"2024-04-25T22:06:30.851488+0000","last_clean":"2024-04-25T22:06:30.851488+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:06:30.851488+0000","last_undegraded":"2024-04-25T22:06:30.851488+0000","last_fullsized":"2024-04-25T22:06:30.851488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'444","reported_seq":646,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141302+0000","last_change":"2024-04-25T22:06:23.132900+0000","last_active":"2024-04-25T22:06:31.141302+0000","last_peered":"2024-04-25T22:06:31.141302+0000","last_clean":"2024-04-25T22:06:31.141302+0000","last_became_active":"2024-04-25T22:06:23.097535+0000","last_became_peered":"2024-04-25T22:06:23.097535+0000","last_unstale":"2024-04-25T22:06:31.141302+0000","last_undegraded":"2024-04-25T22:06:31.141302+0000","last_fullsized":"2024-04-25T22:06:31.141302+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:30:55.243414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31576,"num_write":414,"num_write_kb":70915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"75'46","reported_seq":230,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851416+0000","last_change":"2024-04-25T22:06:22.802843+0000","last_active":"2024-04-25T22:06:30.851416+0000","last_peered":"2024-04-25T22:06:30.851416+0000","last_clean":"2024-04-25T22:06:30.851416+0000","last_became_active":"2024-04-25T22:06:22.801910+0000","last_became_peered":"2024-04-25T22:06:22.801910+0000","last_unstale":"2024-04-25T22:06:30.851416+0000","last_undegraded":"2024-04-25T22:06:30.851416+0000","last_fullsized":"2024-04-25T22:06:30.851416+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:23.004530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2665,"num_read_kb":1338898,"num_write":24540,"num_write_kb":4276910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26558,"ondisk_log_size":26558,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127376126,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":4662,"num_write_kb":127830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":71499776,"data_stored":254752252,"data_compressed":21836190,"data_compressed_allocated":35307520,"data_compressed_original":218619904,"omap_allocated":136586,"internal_metadata":0},"log_size":6446,"ondisk_log_size":6446,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738442,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99732,"kb_used_data":24200,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272108,"statfs":{"total":96636764160,"available":96534638592,"internally_reserved":0,"allocated":24780800,"data_stored":84964150,"data_compressed":7036839,"data_compressed_allocated":11431936,"data_compressed_original":72118272,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738441,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99436,"kb_used_data":23896,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272404,"statfs":{"total":96636764160,"available":96534941696,"internally_reserved":0,"allocated":24469504,"data_stored":81562098,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":90,"seq":386547056646,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58112,"kb_used_data":24432,"kb_used_omap":134,"kb_used_meta":33529,"kb_avail":94313728,"statfs":{"total":96636764160,"available":96577257472,"internally_reserved":0,"allocated":25018368,"data_stored":90623267,"data_compressed":7819212,"data_compressed_allocated":12599296,"data_compressed_original":78716928,"omap_allocated":138181,"internal_metadata":34333755},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24076288,"data_stored":89627390,"data_compressed":7811005,"data_compressed_allocated":12562432,"data_compressed_original":78143488,"omap_allocated":136586,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23584768,"data_stored":81156589,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23838720,"data_stored":83968273,"data_compressed":7028632,"data_compressed_allocated":11395072,"data_compressed_original":71544832,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:06:42.346 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T22:06:42.346 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:06:42.701 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:06:42.702 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:06:42.719 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2024-04-25T22:06:41.691519+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127966494,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2864,"num_read_kb":1340487,"num_write":29405,"num_write_kb":4408200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33161,"ondisk_log_size":33161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":257280,"kb_used_data":72528,"kb_used_omap":138,"kb_used_meta":184565,"kb_avail":282858240,"statfs":{"total":289910292480,"available":289646837760,"internally_reserved":0,"allocated":74268672,"data_stored":257149515,"data_compressed":21852604,"data_compressed_allocated":35381248,"data_compressed_original":219766784,"omap_allocated":141371,"internal_metadata":188995525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.851162"},"pg_stats":[{"pgid":"4.3f","version":"76'446","reported_seq":604,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845124+0000","last_change":"2024-04-25T22:03:33.876369+0000","last_active":"2024-04-25T22:06:30.845124+0000","last_peered":"2024-04-25T22:06:30.845124+0000","last_clean":"2024-04-25T22:06:30.845124+0000","last_became_active":"2024-04-25T22:03:33.873739+0000","last_became_peered":"2024-04-25T22:03:33.873739+0000","last_unstale":"2024-04-25T22:06:30.845124+0000","last_undegraded":"2024-04-25T22:06:30.845124+0000","last_fullsized":"2024-04-25T22:06:30.845124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:32.529707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29432,"num_write":407,"num_write_kb":84235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"76'417","reported_seq":570,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844117+0000","last_change":"2024-04-25T22:03:33.861269+0000","last_active":"2024-04-25T22:06:30.844117+0000","last_peered":"2024-04-25T22:06:30.844117+0000","last_clean":"2024-04-25T22:06:30.844117+0000","last_became_active":"2024-04-25T22:03:33.859221+0000","last_became_peered":"2024-04-25T22:03:33.859221+0000","last_unstale":"2024-04-25T22:06:30.844117+0000","last_undegraded":"2024-04-25T22:06:30.844117+0000","last_fullsized":"2024-04-25T22:06:30.844117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:23:44.690527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":23541,"num_write":389,"num_write_kb":87654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"76'389","reported_seq":558,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.162002+0000","last_change":"2024-04-25T22:06:31.162002+0000","last_active":"2024-04-25T22:06:31.162002+0000","last_peered":"2024-04-25T22:06:31.162002+0000","last_clean":"2024-04-25T22:06:31.162002+0000","last_became_active":"2024-04-25T22:06:31.149675+0000","last_became_peered":"2024-04-25T22:06:31.149675+0000","last_unstale":"2024-04-25T22:06:31.162002+0000","last_undegraded":"2024-04-25T22:06:31.162002+0000","last_fullsized":"2024-04-25T22:06:31.162002+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:08:49.833041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22311,"num_write":361,"num_write_kb":42975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"76'394","reported_seq":588,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142488+0000","last_change":"2024-04-25T22:06:23.123256+0000","last_active":"2024-04-25T22:06:31.142488+0000","last_peered":"2024-04-25T22:06:31.142488+0000","last_clean":"2024-04-25T22:06:31.142488+0000","last_became_active":"2024-04-25T22:06:23.090780+0000","last_became_peered":"2024-04-25T22:06:23.090780+0000","last_unstale":"2024-04-25T22:06:31.142488+0000","last_undegraded":"2024-04-25T22:06:31.142488+0000","last_fullsized":"2024-04-25T22:06:31.142488+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:57.110628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":20785,"num_write":367,"num_write_kb":63746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"76'429","reported_seq":940,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844371+0000","last_change":"2024-04-25T22:06:28.839715+0000","last_active":"2024-04-25T22:06:30.844371+0000","last_peered":"2024-04-25T22:06:30.844371+0000","last_clean":"2024-04-25T22:06:30.844371+0000","last_became_active":"2024-04-25T22:06:28.836687+0000","last_became_peered":"2024-04-25T22:06:28.836687+0000","last_unstale":"2024-04-25T22:06:30.844371+0000","last_undegraded":"2024-04-25T22:06:30.844371+0000","last_fullsized":"2024-04-25T22:06:30.844371+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:10.175157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":20896,"num_write":403,"num_write_kb":100255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"76'368","reported_seq":542,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141851+0000","last_change":"2024-04-25T22:06:23.129617+0000","last_active":"2024-04-25T22:06:31.141851+0000","last_peered":"2024-04-25T22:06:31.141851+0000","last_clean":"2024-04-25T22:06:31.141851+0000","last_became_active":"2024-04-25T22:06:23.107939+0000","last_became_peered":"2024-04-25T22:06:23.107939+0000","last_unstale":"2024-04-25T22:06:31.141851+0000","last_undegraded":"2024-04-25T22:06:31.141851+0000","last_fullsized":"2024-04-25T22:06:31.141851+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:24.183902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9362,"num_write":344,"num_write_kb":20831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"76'438","reported_seq":638,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140968+0000","last_change":"2024-04-25T22:06:23.123861+0000","last_active":"2024-04-25T22:06:31.140968+0000","last_peered":"2024-04-25T22:06:31.140968+0000","last_clean":"2024-04-25T22:06:31.140968+0000","last_became_active":"2024-04-25T22:06:23.098436+0000","last_became_peered":"2024-04-25T22:06:23.098436+0000","last_unstale":"2024-04-25T22:06:31.140968+0000","last_undegraded":"2024-04-25T22:06:31.140968+0000","last_fullsized":"2024-04-25T22:06:31.140968+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:35.433423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25961,"num_write":415,"num_write_kb":72541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'392","reported_seq":602,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140791+0000","last_change":"2024-04-25T22:06:23.128274+0000","last_active":"2024-04-25T22:06:31.140791+0000","last_peered":"2024-04-25T22:06:31.140791+0000","last_clean":"2024-04-25T22:06:31.140791+0000","last_became_active":"2024-04-25T22:06:23.091431+0000","last_became_peered":"2024-04-25T22:06:23.091431+0000","last_unstale":"2024-04-25T22:06:31.140791+0000","last_undegraded":"2024-04-25T22:06:31.140791+0000","last_fullsized":"2024-04-25T22:06:31.140791+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:48.206131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":24749,"num_write":354,"num_write_kb":64232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"76'443","reported_seq":651,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850489+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:06:30.850489+0000","last_peered":"2024-04-25T22:06:30.850489+0000","last_clean":"2024-04-25T22:06:30.850489+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:06:30.850489+0000","last_undegraded":"2024-04-25T22:06:30.850489+0000","last_fullsized":"2024-04-25T22:06:30.850489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":10648,"num_write":411,"num_write_kb":92932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'392","reported_seq":511,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142550+0000","last_change":"2024-04-25T22:06:26.120464+0000","last_active":"2024-04-25T22:06:31.142550+0000","last_peered":"2024-04-25T22:06:31.142550+0000","last_clean":"2024-04-25T22:06:31.142550+0000","last_became_active":"2024-04-25T22:06:26.114463+0000","last_became_peered":"2024-04-25T22:06:26.114463+0000","last_unstale":"2024-04-25T22:06:31.142550+0000","last_undegraded":"2024-04-25T22:06:31.142550+0000","last_fullsized":"2024-04-25T22:06:31.142550+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:37:54.870762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10696,"num_write":359,"num_write_kb":63259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'391","reported_seq":569,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144957+0000","last_change":"2024-04-25T22:06:23.135020+0000","last_active":"2024-04-25T22:06:31.144957+0000","last_peered":"2024-04-25T22:06:31.144957+0000","last_clean":"2024-04-25T22:06:31.144957+0000","last_became_active":"2024-04-25T22:06:23.123801+0000","last_became_peered":"2024-04-25T22:06:23.123801+0000","last_unstale":"2024-04-25T22:06:31.144957+0000","last_undegraded":"2024-04-25T22:06:31.144957+0000","last_fullsized":"2024-04-25T22:06:31.144957+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:11:44.607123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11259,"num_write":372,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"76'365","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843898+0000","last_change":"2024-04-25T22:06:22.802947+0000","last_active":"2024-04-25T22:06:30.843898+0000","last_peered":"2024-04-25T22:06:30.843898+0000","last_clean":"2024-04-25T22:06:30.843898+0000","last_became_active":"2024-04-25T22:06:22.792880+0000","last_became_peered":"2024-04-25T22:06:22.792880+0000","last_unstale":"2024-04-25T22:06:30.843898+0000","last_undegraded":"2024-04-25T22:06:30.843898+0000","last_fullsized":"2024-04-25T22:06:30.843898+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":51972,"num_write":340,"num_write_kb":51203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"76'420","reported_seq":574,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843505+0000","last_change":"2024-04-25T22:03:33.866815+0000","last_active":"2024-04-25T22:06:30.843505+0000","last_peered":"2024-04-25T22:06:30.843505+0000","last_clean":"2024-04-25T22:06:30.843505+0000","last_became_active":"2024-04-25T22:03:33.859376+0000","last_became_peered":"2024-04-25T22:03:33.859376+0000","last_unstale":"2024-04-25T22:06:30.843505+0000","last_undegraded":"2024-04-25T22:06:30.843505+0000","last_fullsized":"2024-04-25T22:06:30.843505+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:08.620311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17620,"num_write":386,"num_write_kb":100613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"76'432","reported_seq":631,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141520+0000","last_change":"2024-04-25T22:06:23.128788+0000","last_active":"2024-04-25T22:06:31.141520+0000","last_peered":"2024-04-25T22:06:31.141520+0000","last_clean":"2024-04-25T22:06:31.141520+0000","last_became_active":"2024-04-25T22:06:23.081466+0000","last_became_peered":"2024-04-25T22:06:23.081466+0000","last_unstale":"2024-04-25T22:06:31.141520+0000","last_undegraded":"2024-04-25T22:06:31.141520+0000","last_fullsized":"2024-04-25T22:06:31.141520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:15.042731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27327,"num_write":398,"num_write_kb":76113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"76'385","reported_seq":584,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140840+0000","last_change":"2024-04-25T22:06:23.116284+0000","last_active":"2024-04-25T22:06:31.140840+0000","last_peered":"2024-04-25T22:06:31.140840+0000","last_clean":"2024-04-25T22:06:31.140840+0000","last_became_active":"2024-04-25T22:06:23.088046+0000","last_became_peered":"2024-04-25T22:06:23.088046+0000","last_unstale":"2024-04-25T22:06:31.140840+0000","last_undegraded":"2024-04-25T22:06:31.140840+0000","last_fullsized":"2024-04-25T22:06:31.140840+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:40:35.110567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23986,"num_write":352,"num_write_kb":50754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"76'434","reported_seq":615,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141488+0000","last_change":"2024-04-25T22:06:23.132996+0000","last_active":"2024-04-25T22:06:31.141488+0000","last_peered":"2024-04-25T22:06:31.141488+0000","last_clean":"2024-04-25T22:06:31.141488+0000","last_became_active":"2024-04-25T22:06:23.117497+0000","last_became_peered":"2024-04-25T22:06:23.117497+0000","last_unstale":"2024-04-25T22:06:31.141488+0000","last_undegraded":"2024-04-25T22:06:31.141488+0000","last_fullsized":"2024-04-25T22:06:31.141488+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:30.022312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":13806,"num_write":403,"num_write_kb":38995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"76'444","reported_seq":658,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851797+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:06:30.851797+0000","last_peered":"2024-04-25T22:06:30.851797+0000","last_clean":"2024-04-25T22:06:30.851797+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:06:30.851797+0000","last_undegraded":"2024-04-25T22:06:30.851797+0000","last_fullsized":"2024-04-25T22:06:30.851797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":11085,"num_write":416,"num_write_kb":68377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'396","reported_seq":531,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844593+0000","last_change":"2024-04-25T22:03:33.862762+0000","last_active":"2024-04-25T22:06:30.844593+0000","last_peered":"2024-04-25T22:06:30.844593+0000","last_clean":"2024-04-25T22:06:30.844593+0000","last_became_active":"2024-04-25T22:03:33.861082+0000","last_became_peered":"2024-04-25T22:03:33.861082+0000","last_unstale":"2024-04-25T22:06:30.844593+0000","last_undegraded":"2024-04-25T22:06:30.844593+0000","last_fullsized":"2024-04-25T22:06:30.844593+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:15.823113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6581,"num_write":355,"num_write_kb":34159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"76'447","reported_seq":648,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850341+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:06:30.850341+0000","last_peered":"2024-04-25T22:06:30.850341+0000","last_clean":"2024-04-25T22:06:30.850341+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:06:30.850341+0000","last_undegraded":"2024-04-25T22:06:30.850341+0000","last_fullsized":"2024-04-25T22:06:30.850341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22089,"num_write":411,"num_write_kb":104750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'426","reported_seq":604,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144109+0000","last_change":"2024-04-25T22:06:23.122769+0000","last_active":"2024-04-25T22:06:31.144109+0000","last_peered":"2024-04-25T22:06:31.144109+0000","last_clean":"2024-04-25T22:06:31.144109+0000","last_became_active":"2024-04-25T22:06:23.093379+0000","last_became_peered":"2024-04-25T22:06:23.093379+0000","last_unstale":"2024-04-25T22:06:31.144109+0000","last_undegraded":"2024-04-25T22:06:31.144109+0000","last_fullsized":"2024-04-25T22:06:31.144109+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:48.070891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11886,"num_write":398,"num_write_kb":55010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"76'405","reported_seq":602,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143776+0000","last_change":"2024-04-25T22:06:23.129396+0000","last_active":"2024-04-25T22:06:31.143776+0000","last_peered":"2024-04-25T22:06:31.143776+0000","last_clean":"2024-04-25T22:06:31.143776+0000","last_became_active":"2024-04-25T22:06:23.110101+0000","last_became_peered":"2024-04-25T22:06:23.110101+0000","last_unstale":"2024-04-25T22:06:31.143776+0000","last_undegraded":"2024-04-25T22:06:31.143776+0000","last_fullsized":"2024-04-25T22:06:31.143776+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:40.218610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23004,"num_write":370,"num_write_kb":75802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'436","reported_seq":559,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843341+0000","last_change":"2024-04-25T22:06:28.838562+0000","last_active":"2024-04-25T22:06:30.843341+0000","last_peered":"2024-04-25T22:06:30.843341+0000","last_clean":"2024-04-25T22:06:30.843341+0000","last_became_active":"2024-04-25T22:06:28.835081+0000","last_became_peered":"2024-04-25T22:06:28.835081+0000","last_unstale":"2024-04-25T22:06:30.843341+0000","last_undegraded":"2024-04-25T22:06:30.843341+0000","last_fullsized":"2024-04-25T22:06:30.843341+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:15:18.057041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11950,"num_write":408,"num_write_kb":67524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"76'403","reported_seq":607,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.847686+0000","last_change":"2024-04-25T22:06:22.810930+0000","last_active":"2024-04-25T22:06:30.847686+0000","last_peered":"2024-04-25T22:06:30.847686+0000","last_clean":"2024-04-25T22:06:30.847686+0000","last_became_active":"2024-04-25T22:06:22.802907+0000","last_became_peered":"2024-04-25T22:06:22.802907+0000","last_unstale":"2024-04-25T22:06:30.847686+0000","last_undegraded":"2024-04-25T22:06:30.847686+0000","last_fullsized":"2024-04-25T22:06:30.847686+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:00.334109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":6507,"num_write":370,"num_write_kb":51513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'449","reported_seq":574,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842684+0000","last_change":"2024-04-25T22:06:28.846531+0000","last_active":"2024-04-25T22:06:30.842684+0000","last_peered":"2024-04-25T22:06:30.842684+0000","last_clean":"2024-04-25T22:06:30.842684+0000","last_became_active":"2024-04-25T22:06:28.841283+0000","last_became_peered":"2024-04-25T22:06:28.841283+0000","last_unstale":"2024-04-25T22:06:30.842684+0000","last_undegraded":"2024-04-25T22:06:30.842684+0000","last_fullsized":"2024-04-25T22:06:30.842684+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:02.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27047,"num_write":417,"num_write_kb":63386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"76'406","reported_seq":571,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845286+0000","last_change":"2024-04-25T22:06:22.801634+0000","last_active":"2024-04-25T22:06:30.845286+0000","last_peered":"2024-04-25T22:06:30.845286+0000","last_clean":"2024-04-25T22:06:30.845286+0000","last_became_active":"2024-04-25T22:06:22.791470+0000","last_became_peered":"2024-04-25T22:06:22.791470+0000","last_unstale":"2024-04-25T22:06:30.845286+0000","last_undegraded":"2024-04-25T22:06:30.845286+0000","last_fullsized":"2024-04-25T22:06:30.845286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:25.424659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25550,"num_write":386,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"76'485","reported_seq":735,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850945+0000","last_change":"2024-04-25T22:06:22.814124+0000","last_active":"2024-04-25T22:06:30.850945+0000","last_peered":"2024-04-25T22:06:30.850945+0000","last_clean":"2024-04-25T22:06:30.850945+0000","last_became_active":"2024-04-25T22:06:22.804228+0000","last_became_peered":"2024-04-25T22:06:22.804228+0000","last_unstale":"2024-04-25T22:06:30.850945+0000","last_undegraded":"2024-04-25T22:06:30.850945+0000","last_fullsized":"2024-04-25T22:06:30.850945+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":30714,"num_write":444,"num_write_kb":92836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'387","reported_seq":592,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144694+0000","last_change":"2024-04-25T22:06:23.134971+0000","last_active":"2024-04-25T22:06:31.144694+0000","last_peered":"2024-04-25T22:06:31.144694+0000","last_clean":"2024-04-25T22:06:31.144694+0000","last_became_active":"2024-04-25T22:06:23.121334+0000","last_became_peered":"2024-04-25T22:06:23.121334+0000","last_unstale":"2024-04-25T22:06:31.144694+0000","last_undegraded":"2024-04-25T22:06:31.144694+0000","last_fullsized":"2024-04-25T22:06:31.144694+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:03.991336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21644,"num_write":354,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"76'405","reported_seq":649,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844816+0000","last_change":"2024-04-25T22:06:22.829889+0000","last_active":"2024-04-25T22:06:30.844816+0000","last_peered":"2024-04-25T22:06:30.844816+0000","last_clean":"2024-04-25T22:06:30.844816+0000","last_became_active":"2024-04-25T22:06:22.827066+0000","last_became_peered":"2024-04-25T22:06:22.827066+0000","last_unstale":"2024-04-25T22:06:30.844816+0000","last_undegraded":"2024-04-25T22:06:30.844816+0000","last_fullsized":"2024-04-25T22:06:30.844816+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:01.822252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27522,"num_write":375,"num_write_kb":96416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"76'396","reported_seq":619,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850059+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:06:30.850059+0000","last_peered":"2024-04-25T22:06:30.850059+0000","last_clean":"2024-04-25T22:06:30.850059+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:06:30.850059+0000","last_undegraded":"2024-04-25T22:06:30.850059+0000","last_fullsized":"2024-04-25T22:06:30.850059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28501,"num_write":367,"num_write_kb":63458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":654,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843955+0000","last_change":"2024-04-25T22:06:22.803787+0000","last_active":"2024-04-25T22:06:30.843955+0000","last_peered":"2024-04-25T22:06:30.843955+0000","last_clean":"2024-04-25T22:06:30.843955+0000","last_became_active":"2024-04-25T22:06:22.789907+0000","last_became_peered":"2024-04-25T22:06:22.789907+0000","last_unstale":"2024-04-25T22:06:30.843955+0000","last_undegraded":"2024-04-25T22:06:30.843955+0000","last_fullsized":"2024-04-25T22:06:30.843955+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":20717,"num_write":435,"num_write_kb":55985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"76'444","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848333+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:06:30.848333+0000","last_peered":"2024-04-25T22:06:30.848333+0000","last_clean":"2024-04-25T22:06:30.848333+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:06:30.848333+0000","last_undegraded":"2024-04-25T22:06:30.848333+0000","last_fullsized":"2024-04-25T22:06:30.848333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":10758,"num_write":401,"num_write_kb":44705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'422","reported_seq":533,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.160927+0000","last_change":"2024-04-25T22:06:31.160927+0000","last_active":"2024-04-25T22:06:31.160927+0000","last_peered":"2024-04-25T22:06:31.160927+0000","last_clean":"2024-04-25T22:06:31.160927+0000","last_became_active":"2024-04-25T22:06:31.148129+0000","last_became_peered":"2024-04-25T22:06:31.148129+0000","last_unstale":"2024-04-25T22:06:31.160927+0000","last_undegraded":"2024-04-25T22:06:31.160927+0000","last_fullsized":"2024-04-25T22:06:31.160927+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:26:06.579471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":29059,"num_write":391,"num_write_kb":40233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"76'397","reported_seq":894,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844568+0000","last_change":"2024-04-25T22:06:26.819859+0000","last_active":"2024-04-25T22:06:30.844568+0000","last_peered":"2024-04-25T22:06:30.844568+0000","last_clean":"2024-04-25T22:06:30.844568+0000","last_became_active":"2024-04-25T22:06:26.816439+0000","last_became_peered":"2024-04-25T22:06:26.816439+0000","last_unstale":"2024-04-25T22:06:30.844568+0000","last_undegraded":"2024-04-25T22:06:30.844568+0000","last_fullsized":"2024-04-25T22:06:30.844568+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:44.452918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28857,"num_write":363,"num_write_kb":87969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"75'515","reported_seq":671,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142622+0000","last_change":"2024-04-25T22:06:23.117492+0000","last_active":"2024-04-25T22:06:31.142622+0000","last_peered":"2024-04-25T22:06:31.142622+0000","last_clean":"2024-04-25T22:06:31.142622+0000","last_became_active":"2024-04-25T22:06:23.109665+0000","last_became_peered":"2024-04-25T22:06:23.109665+0000","last_unstale":"2024-04-25T22:06:31.142622+0000","last_undegraded":"2024-04-25T22:06:31.142622+0000","last_fullsized":"2024-04-25T22:06:31.142622+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:01.482888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"76'375","reported_seq":481,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845202+0000","last_change":"2024-04-25T22:06:28.846182+0000","last_active":"2024-04-25T22:06:30.845202+0000","last_peered":"2024-04-25T22:06:30.845202+0000","last_clean":"2024-04-25T22:06:30.845202+0000","last_became_active":"2024-04-25T22:06:28.841545+0000","last_became_peered":"2024-04-25T22:06:28.841545+0000","last_unstale":"2024-04-25T22:06:30.845202+0000","last_undegraded":"2024-04-25T22:06:30.845202+0000","last_fullsized":"2024-04-25T22:06:30.845202+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.018915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14983,"num_write":339,"num_write_kb":46748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'53","reported_seq":237,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849016+0000","last_change":"2024-04-25T22:06:22.839083+0000","last_active":"2024-04-25T22:06:30.849016+0000","last_peered":"2024-04-25T22:06:30.849016+0000","last_clean":"2024-04-25T22:06:30.849016+0000","last_became_active":"2024-04-25T22:06:22.833424+0000","last_became_peered":"2024-04-25T22:06:22.833424+0000","last_unstale":"2024-04-25T22:06:30.849016+0000","last_undegraded":"2024-04-25T22:06:30.849016+0000","last_fullsized":"2024-04-25T22:06:30.849016+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:00.819067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'426","reported_seq":639,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851784+0000","last_change":"2024-04-25T22:06:26.822923+0000","last_active":"2024-04-25T22:06:30.851784+0000","last_peered":"2024-04-25T22:06:30.851784+0000","last_clean":"2024-04-25T22:06:30.851784+0000","last_became_active":"2024-04-25T22:06:26.819562+0000","last_became_peered":"2024-04-25T22:06:26.819562+0000","last_unstale":"2024-04-25T22:06:30.851784+0000","last_undegraded":"2024-04-25T22:06:30.851784+0000","last_fullsized":"2024-04-25T22:06:30.851784+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:42.832195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":17843,"num_write":388,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"75'71","reported_seq":188,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843496+0000","last_change":"2024-04-25T22:06:22.799710+0000","last_active":"2024-04-25T22:06:30.843496+0000","last_peered":"2024-04-25T22:06:30.843496+0000","last_clean":"2024-04-25T22:06:30.843496+0000","last_became_active":"2024-04-25T22:06:22.790902+0000","last_became_peered":"2024-04-25T22:06:22.790902+0000","last_unstale":"2024-04-25T22:06:30.843496+0000","last_undegraded":"2024-04-25T22:06:30.843496+0000","last_fullsized":"2024-04-25T22:06:30.843496+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:50:36.683583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'366","reported_seq":571,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850882+0000","last_change":"2024-04-25T22:06:22.809150+0000","last_active":"2024-04-25T22:06:30.850882+0000","last_peered":"2024-04-25T22:06:30.850882+0000","last_clean":"2024-04-25T22:06:30.850882+0000","last_became_active":"2024-04-25T22:06:22.803327+0000","last_became_peered":"2024-04-25T22:06:22.803327+0000","last_unstale":"2024-04-25T22:06:30.850882+0000","last_undegraded":"2024-04-25T22:06:30.850882+0000","last_fullsized":"2024-04-25T22:06:30.850882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.731906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":16032,"num_write":334,"num_write_kb":25754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'63","reported_seq":221,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140280+0000","last_change":"2024-04-25T22:06:23.085892+0000","last_active":"2024-04-25T22:06:31.140280+0000","last_peered":"2024-04-25T22:06:31.140280+0000","last_clean":"2024-04-25T22:06:31.140280+0000","last_became_active":"2024-04-25T22:06:23.082351+0000","last_became_peered":"2024-04-25T22:06:23.082351+0000","last_unstale":"2024-04-25T22:06:31.140280+0000","last_undegraded":"2024-04-25T22:06:31.140280+0000","last_fullsized":"2024-04-25T22:06:31.140280+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:51.142517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"76'148","reported_seq":306,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143742+0000","last_change":"2024-04-25T22:06:23.089179+0000","last_active":"2024-04-25T22:06:31.143742+0000","last_peered":"2024-04-25T22:06:31.143742+0000","last_clean":"2024-04-25T22:06:31.143742+0000","last_became_active":"2024-04-25T22:06:23.085599+0000","last_became_peered":"2024-04-25T22:06:23.085599+0000","last_unstale":"2024-04-25T22:06:31.143742+0000","last_undegraded":"2024-04-25T22:06:31.143742+0000","last_fullsized":"2024-04-25T22:06:31.143742+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:53:14.055158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"76'402","reported_seq":568,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842703+0000","last_change":"2024-04-25T22:06:22.802685+0000","last_active":"2024-04-25T22:06:30.842703+0000","last_peered":"2024-04-25T22:06:30.842703+0000","last_clean":"2024-04-25T22:06:30.842703+0000","last_became_active":"2024-04-25T22:06:22.789353+0000","last_became_peered":"2024-04-25T22:06:22.789353+0000","last_unstale":"2024-04-25T22:06:30.842703+0000","last_undegraded":"2024-04-25T22:06:30.842703+0000","last_fullsized":"2024-04-25T22:06:30.842703+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:14.949049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21114,"num_write":364,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"75'250","reported_seq":374,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844891+0000","last_change":"2024-04-25T22:06:22.791598+0000","last_active":"2024-04-25T22:06:30.844891+0000","last_peered":"2024-04-25T22:06:30.844891+0000","last_clean":"2024-04-25T22:06:30.844891+0000","last_became_active":"2024-04-25T22:06:22.790508+0000","last_became_peered":"2024-04-25T22:06:22.790508+0000","last_unstale":"2024-04-25T22:06:30.844891+0000","last_undegraded":"2024-04-25T22:06:30.844891+0000","last_fullsized":"2024-04-25T22:06:30.844891+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"76'460","reported_seq":634,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842903+0000","last_change":"2024-04-25T22:03:33.861055+0000","last_active":"2024-04-25T22:06:30.842903+0000","last_peered":"2024-04-25T22:06:30.842903+0000","last_clean":"2024-04-25T22:06:30.842903+0000","last_became_active":"2024-04-25T22:03:33.856638+0000","last_became_peered":"2024-04-25T22:03:33.856638+0000","last_unstale":"2024-04-25T22:06:30.842903+0000","last_undegraded":"2024-04-25T22:06:30.842903+0000","last_fullsized":"2024-04-25T22:06:30.842903+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":39774,"num_write":433,"num_write_kb":80294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'556","reported_seq":714,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.148664+0000","last_change":"2024-04-25T22:06:31.148664+0000","last_active":"2024-04-25T22:06:31.148664+0000","last_peered":"2024-04-25T22:06:31.148664+0000","last_clean":"2024-04-25T22:06:31.148664+0000","last_became_active":"2024-04-25T22:06:31.147569+0000","last_became_peered":"2024-04-25T22:06:31.147569+0000","last_unstale":"2024-04-25T22:06:31.148664+0000","last_undegraded":"2024-04-25T22:06:31.148664+0000","last_fullsized":"2024-04-25T22:06:31.148664+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:41.798311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":509,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"76'413","reported_seq":577,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142062+0000","last_change":"2024-04-25T22:06:23.129627+0000","last_active":"2024-04-25T22:06:31.142062+0000","last_peered":"2024-04-25T22:06:31.142062+0000","last_clean":"2024-04-25T22:06:31.142062+0000","last_became_active":"2024-04-25T22:06:23.108199+0000","last_became_peered":"2024-04-25T22:06:23.108199+0000","last_unstale":"2024-04-25T22:06:31.142062+0000","last_undegraded":"2024-04-25T22:06:31.142062+0000","last_fullsized":"2024-04-25T22:06:31.142062+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:23.828740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4858,"num_write":378,"num_write_kb":46741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"76'66","reported_seq":77,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161275+0000","last_change":"2024-04-25T22:06:31.161275+0000","last_active":"2024-04-25T22:06:31.161275+0000","last_peered":"2024-04-25T22:06:31.161275+0000","last_clean":"2024-04-25T22:06:31.161275+0000","last_became_active":"2024-04-25T22:06:31.160267+0000","last_became_peered":"2024-04-25T22:06:31.160267+0000","last_unstale":"2024-04-25T22:06:31.161275+0000","last_undegraded":"2024-04-25T22:06:31.161275+0000","last_fullsized":"2024-04-25T22:06:31.161275+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:14.214127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"76'489","reported_seq":729,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850154+0000","last_change":"2024-04-25T22:06:22.838952+0000","last_active":"2024-04-25T22:06:30.850154+0000","last_peered":"2024-04-25T22:06:30.850154+0000","last_clean":"2024-04-25T22:06:30.850154+0000","last_became_active":"2024-04-25T22:06:22.832394+0000","last_became_peered":"2024-04-25T22:06:22.832394+0000","last_unstale":"2024-04-25T22:06:30.850154+0000","last_undegraded":"2024-04-25T22:06:30.850154+0000","last_fullsized":"2024-04-25T22:06:30.850154+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:04:38.988916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":26829,"num_write":457,"num_write_kb":137840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"75'193","reported_seq":377,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850501+0000","last_change":"2024-04-25T22:06:22.838157+0000","last_active":"2024-04-25T22:06:30.850501+0000","last_peered":"2024-04-25T22:06:30.850501+0000","last_clean":"2024-04-25T22:06:30.850501+0000","last_became_active":"2024-04-25T22:06:22.832572+0000","last_became_peered":"2024-04-25T22:06:22.832572+0000","last_unstale":"2024-04-25T22:06:30.850501+0000","last_undegraded":"2024-04-25T22:06:30.850501+0000","last_fullsized":"2024-04-25T22:06:30.850501+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:34.994194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'437","reported_seq":528,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.160788+0000","last_change":"2024-04-25T22:06:31.160788+0000","last_active":"2024-04-25T22:06:31.160788+0000","last_peered":"2024-04-25T22:06:31.160788+0000","last_clean":"2024-04-25T22:06:31.160788+0000","last_became_active":"2024-04-25T22:06:31.147501+0000","last_became_peered":"2024-04-25T22:06:31.147501+0000","last_unstale":"2024-04-25T22:06:31.160788+0000","last_undegraded":"2024-04-25T22:06:31.160788+0000","last_fullsized":"2024-04-25T22:06:31.160788+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:30:29.866840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3720,"num_write":406,"num_write_kb":30461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"76'106","reported_seq":264,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140763+0000","last_change":"2024-04-25T22:06:23.128769+0000","last_active":"2024-04-25T22:06:31.140763+0000","last_peered":"2024-04-25T22:06:31.140763+0000","last_clean":"2024-04-25T22:06:31.140763+0000","last_became_active":"2024-04-25T22:06:23.103402+0000","last_became_peered":"2024-04-25T22:06:23.103402+0000","last_unstale":"2024-04-25T22:06:31.140763+0000","last_undegraded":"2024-04-25T22:06:31.140763+0000","last_fullsized":"2024-04-25T22:06:31.140763+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:27.137773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"76'409","reported_seq":605,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143850+0000","last_change":"2024-04-25T22:06:23.133536+0000","last_active":"2024-04-25T22:06:31.143850+0000","last_peered":"2024-04-25T22:06:31.143850+0000","last_clean":"2024-04-25T22:06:31.143850+0000","last_became_active":"2024-04-25T22:06:23.086188+0000","last_became_peered":"2024-04-25T22:06:23.086188+0000","last_unstale":"2024-04-25T22:06:31.143850+0000","last_undegraded":"2024-04-25T22:06:31.143850+0000","last_fullsized":"2024-04-25T22:06:31.143850+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:13:59.140479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19178,"num_write":380,"num_write_kb":91945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"75'51","reported_seq":182,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843314+0000","last_change":"2024-04-25T22:06:22.800659+0000","last_active":"2024-04-25T22:06:30.843314+0000","last_peered":"2024-04-25T22:06:30.843314+0000","last_clean":"2024-04-25T22:06:30.843314+0000","last_became_active":"2024-04-25T22:06:22.798779+0000","last_became_peered":"2024-04-25T22:06:22.798779+0000","last_unstale":"2024-04-25T22:06:30.843314+0000","last_undegraded":"2024-04-25T22:06:30.843314+0000","last_fullsized":"2024-04-25T22:06:30.843314+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:35.728722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"76'377","reported_seq":561,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143491+0000","last_change":"2024-04-25T22:06:23.114225+0000","last_active":"2024-04-25T22:06:31.143491+0000","last_peered":"2024-04-25T22:06:31.143491+0000","last_clean":"2024-04-25T22:06:31.143491+0000","last_became_active":"2024-04-25T22:06:23.085799+0000","last_became_peered":"2024-04-25T22:06:23.085799+0000","last_unstale":"2024-04-25T22:06:31.143491+0000","last_undegraded":"2024-04-25T22:06:31.143491+0000","last_fullsized":"2024-04-25T22:06:31.143491+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:50.484372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21517,"num_write":342,"num_write_kb":66898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"75'449","reported_seq":546,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843127+0000","last_change":"2024-04-25T22:03:33.860386+0000","last_active":"2024-04-25T22:06:30.843127+0000","last_peered":"2024-04-25T22:06:30.843127+0000","last_clean":"2024-04-25T22:06:30.843127+0000","last_became_active":"2024-04-25T22:03:33.859539+0000","last_became_peered":"2024-04-25T22:03:33.859539+0000","last_unstale":"2024-04-25T22:06:30.843127+0000","last_undegraded":"2024-04-25T22:06:30.843127+0000","last_fullsized":"2024-04-25T22:06:30.843127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:20.247942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'399","reported_seq":613,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850961+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:06:30.850961+0000","last_peered":"2024-04-25T22:06:30.850961+0000","last_clean":"2024-04-25T22:06:30.850961+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:06:30.850961+0000","last_undegraded":"2024-04-25T22:06:30.850961+0000","last_fullsized":"2024-04-25T22:06:30.850961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17888,"num_write":373,"num_write_kb":67556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":318,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140066+0000","last_change":"2024-04-25T22:06:23.082707+0000","last_active":"2024-04-25T22:06:31.140066+0000","last_peered":"2024-04-25T22:06:31.140066+0000","last_clean":"2024-04-25T22:06:31.140066+0000","last_became_active":"2024-04-25T22:06:23.080701+0000","last_became_peered":"2024-04-25T22:06:23.080701+0000","last_unstale":"2024-04-25T22:06:31.140066+0000","last_undegraded":"2024-04-25T22:06:31.140066+0000","last_fullsized":"2024-04-25T22:06:31.140066+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:27.088849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141705+0000","last_change":"2024-04-25T22:06:23.116373+0000","last_active":"2024-04-25T22:06:31.141705+0000","last_peered":"2024-04-25T22:06:31.141705+0000","last_clean":"2024-04-25T22:06:31.141705+0000","last_became_active":"2024-04-25T22:06:23.108984+0000","last_became_peered":"2024-04-25T22:06:23.108984+0000","last_unstale":"2024-04-25T22:06:31.141705+0000","last_undegraded":"2024-04-25T22:06:31.141705+0000","last_fullsized":"2024-04-25T22:06:31.141705+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:08.884723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"75'393","reported_seq":570,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849474+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:06:30.849474+0000","last_peered":"2024-04-25T22:06:30.849474+0000","last_clean":"2024-04-25T22:06:30.849474+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:06:30.849474+0000","last_undegraded":"2024-04-25T22:06:30.849474+0000","last_fullsized":"2024-04-25T22:06:30.849474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'463","reported_seq":668,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144389+0000","last_change":"2024-04-25T22:06:23.133028+0000","last_active":"2024-04-25T22:06:31.144389+0000","last_peered":"2024-04-25T22:06:31.144389+0000","last_clean":"2024-04-25T22:06:31.144389+0000","last_became_active":"2024-04-25T22:06:23.082756+0000","last_became_peered":"2024-04-25T22:06:23.082756+0000","last_unstale":"2024-04-25T22:06:31.144389+0000","last_undegraded":"2024-04-25T22:06:31.144389+0000","last_fullsized":"2024-04-25T22:06:31.144389+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:24:01.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29270,"num_write":426,"num_write_kb":129367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141100+0000","last_change":"2024-04-25T22:06:23.083451+0000","last_active":"2024-04-25T22:06:31.141100+0000","last_peered":"2024-04-25T22:06:31.141100+0000","last_clean":"2024-04-25T22:06:31.141100+0000","last_became_active":"2024-04-25T22:06:23.080841+0000","last_became_peered":"2024-04-25T22:06:23.080841+0000","last_unstale":"2024-04-25T22:06:31.141100+0000","last_undegraded":"2024-04-25T22:06:31.141100+0000","last_fullsized":"2024-04-25T22:06:31.141100+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:34.605367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"76'125","reported_seq":372,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849223+0000","last_change":"2024-04-25T22:06:22.804290+0000","last_active":"2024-04-25T22:06:30.849223+0000","last_peered":"2024-04-25T22:06:30.849223+0000","last_clean":"2024-04-25T22:06:30.849223+0000","last_became_active":"2024-04-25T22:06:22.801616+0000","last_became_peered":"2024-04-25T22:06:22.801616+0000","last_unstale":"2024-04-25T22:06:30.849223+0000","last_undegraded":"2024-04-25T22:06:30.849223+0000","last_fullsized":"2024-04-25T22:06:30.849223+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:13.402747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464197,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":63,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'457","reported_seq":646,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844136+0000","last_change":"2024-04-25T22:03:05.702224+0000","last_active":"2024-04-25T22:06:30.844136+0000","last_peered":"2024-04-25T22:06:30.844136+0000","last_clean":"2024-04-25T22:06:30.844136+0000","last_became_active":"2024-04-25T22:03:05.699581+0000","last_became_peered":"2024-04-25T22:03:05.699581+0000","last_unstale":"2024-04-25T22:06:30.844136+0000","last_undegraded":"2024-04-25T22:06:30.844136+0000","last_fullsized":"2024-04-25T22:06:30.844136+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":34759,"num_write":424,"num_write_kb":71902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849418+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:06:30.849418+0000","last_peered":"2024-04-25T22:06:30.849418+0000","last_clean":"2024-04-25T22:06:30.849418+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:06:30.849418+0000","last_undegraded":"2024-04-25T22:06:30.849418+0000","last_fullsized":"2024-04-25T22:06:30.849418+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"75'311","reported_seq":496,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843037+0000","last_change":"2024-04-25T22:06:22.801481+0000","last_active":"2024-04-25T22:06:30.843037+0000","last_peered":"2024-04-25T22:06:30.843037+0000","last_clean":"2024-04-25T22:06:30.843037+0000","last_became_active":"2024-04-25T22:06:22.794841+0000","last_became_peered":"2024-04-25T22:06:22.794841+0000","last_unstale":"2024-04-25T22:06:30.843037+0000","last_undegraded":"2024-04-25T22:06:30.843037+0000","last_fullsized":"2024-04-25T22:06:30.843037+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:06:59.330924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"76'373","reported_seq":592,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851291+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:06:30.851291+0000","last_peered":"2024-04-25T22:06:30.851291+0000","last_clean":"2024-04-25T22:06:30.851291+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:06:30.851291+0000","last_undegraded":"2024-04-25T22:06:30.851291+0000","last_fullsized":"2024-04-25T22:06:30.851291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28273,"num_write":350,"num_write_kb":87787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140545+0000","last_change":"2024-04-25T22:06:23.129162+0000","last_active":"2024-04-25T22:06:31.140545+0000","last_peered":"2024-04-25T22:06:31.140545+0000","last_clean":"2024-04-25T22:06:31.140545+0000","last_became_active":"2024-04-25T22:06:23.106155+0000","last_became_peered":"2024-04-25T22:06:23.106155+0000","last_unstale":"2024-04-25T22:06:31.140545+0000","last_undegraded":"2024-04-25T22:06:31.140545+0000","last_fullsized":"2024-04-25T22:06:31.140545+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:30.846068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"76'75","reported_seq":77,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161388+0000","last_change":"2024-04-25T22:06:31.161388+0000","last_active":"2024-04-25T22:06:31.161388+0000","last_peered":"2024-04-25T22:06:31.161388+0000","last_clean":"2024-04-25T22:06:31.161388+0000","last_became_active":"2024-04-25T22:06:31.150555+0000","last_became_peered":"2024-04-25T22:06:31.150555+0000","last_unstale":"2024-04-25T22:06:31.161388+0000","last_undegraded":"2024-04-25T22:06:31.161388+0000","last_fullsized":"2024-04-25T22:06:31.161388+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:56:50.706657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"76'461","reported_seq":753,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850519+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:06:30.850519+0000","last_peered":"2024-04-25T22:06:30.850519+0000","last_clean":"2024-04-25T22:06:30.850519+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:06:30.850519+0000","last_undegraded":"2024-04-25T22:06:30.850519+0000","last_fullsized":"2024-04-25T22:06:30.850519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":67984,"num_write":425,"num_write_kb":154741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"76'268","reported_seq":425,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143156+0000","last_change":"2024-04-25T22:06:23.134306+0000","last_active":"2024-04-25T22:06:31.143156+0000","last_peered":"2024-04-25T22:06:31.143156+0000","last_clean":"2024-04-25T22:06:31.143156+0000","last_became_active":"2024-04-25T22:06:23.122629+0000","last_became_peered":"2024-04-25T22:06:23.122629+0000","last_unstale":"2024-04-25T22:06:31.143156+0000","last_undegraded":"2024-04-25T22:06:31.143156+0000","last_fullsized":"2024-04-25T22:06:31.143156+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:41.205934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850998+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:06:30.850998+0000","last_peered":"2024-04-25T22:06:30.850998+0000","last_clean":"2024-04-25T22:06:30.850998+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:06:30.850998+0000","last_undegraded":"2024-04-25T22:06:30.850998+0000","last_fullsized":"2024-04-25T22:06:30.850998+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'398","reported_seq":578,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843743+0000","last_change":"2024-04-25T22:06:22.797468+0000","last_active":"2024-04-25T22:06:30.843743+0000","last_peered":"2024-04-25T22:06:30.843743+0000","last_clean":"2024-04-25T22:06:30.843743+0000","last_became_active":"2024-04-25T22:06:22.789384+0000","last_became_peered":"2024-04-25T22:06:22.789384+0000","last_unstale":"2024-04-25T22:06:30.843743+0000","last_undegraded":"2024-04-25T22:06:30.843743+0000","last_fullsized":"2024-04-25T22:06:30.843743+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:35.557386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":26599,"num_write":366,"num_write_kb":75612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"76'47","reported_seq":224,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850762+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:06:30.850762+0000","last_peered":"2024-04-25T22:06:30.850762+0000","last_clean":"2024-04-25T22:06:30.850762+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:06:30.850762+0000","last_undegraded":"2024-04-25T22:06:30.850762+0000","last_fullsized":"2024-04-25T22:06:30.850762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":171,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845730+0000","last_change":"2024-04-25T22:03:05.701809+0000","last_active":"2024-04-25T22:06:30.845730+0000","last_peered":"2024-04-25T22:06:30.845730+0000","last_clean":"2024-04-25T22:06:30.845730+0000","last_became_active":"2024-04-25T22:03:05.701322+0000","last_became_peered":"2024-04-25T22:03:05.701322+0000","last_unstale":"2024-04-25T22:06:30.845730+0000","last_undegraded":"2024-04-25T22:06:30.845730+0000","last_fullsized":"2024-04-25T22:06:30.845730+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:45.907458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"76'406","reported_seq":642,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844251+0000","last_change":"2024-04-25T22:06:22.802683+0000","last_active":"2024-04-25T22:06:30.844251+0000","last_peered":"2024-04-25T22:06:30.844251+0000","last_clean":"2024-04-25T22:06:30.844251+0000","last_became_active":"2024-04-25T22:06:22.789807+0000","last_became_peered":"2024-04-25T22:06:22.789807+0000","last_unstale":"2024-04-25T22:06:30.844251+0000","last_undegraded":"2024-04-25T22:06:30.844251+0000","last_fullsized":"2024-04-25T22:06:30.844251+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:15.180532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25634,"num_write":377,"num_write_kb":103970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"76'64","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.852026+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:06:30.852026+0000","last_peered":"2024-04-25T22:06:30.852026+0000","last_clean":"2024-04-25T22:06:30.852026+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:06:30.852026+0000","last_undegraded":"2024-04-25T22:06:30.852026+0000","last_fullsized":"2024-04-25T22:06:30.852026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142483+0000","last_change":"2024-04-25T22:06:24.092672+0000","last_active":"2024-04-25T22:06:31.142483+0000","last_peered":"2024-04-25T22:06:31.142483+0000","last_clean":"2024-04-25T22:06:31.142483+0000","last_became_active":"2024-04-25T22:06:24.091909+0000","last_became_peered":"2024-04-25T22:06:24.091909+0000","last_unstale":"2024-04-25T22:06:31.142483+0000","last_undegraded":"2024-04-25T22:06:31.142483+0000","last_fullsized":"2024-04-25T22:06:31.142483+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:19:21.605435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"76'402","reported_seq":605,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848860+0000","last_change":"2024-04-25T22:06:22.809713+0000","last_active":"2024-04-25T22:06:30.848860+0000","last_peered":"2024-04-25T22:06:30.848860+0000","last_clean":"2024-04-25T22:06:30.848860+0000","last_became_active":"2024-04-25T22:06:22.802005+0000","last_became_peered":"2024-04-25T22:06:22.802005+0000","last_unstale":"2024-04-25T22:06:30.848860+0000","last_undegraded":"2024-04-25T22:06:30.848860+0000","last_fullsized":"2024-04-25T22:06:30.848860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9572,"num_write":361,"num_write_kb":29911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"77'127","reported_seq":311,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851852+0000","last_change":"2024-04-25T22:06:22.804851+0000","last_active":"2024-04-25T22:06:30.851852+0000","last_peered":"2024-04-25T22:06:30.851852+0000","last_clean":"2024-04-25T22:06:30.851852+0000","last_became_active":"2024-04-25T22:06:22.802083+0000","last_became_peered":"2024-04-25T22:06:22.802083+0000","last_unstale":"2024-04-25T22:06:30.851852+0000","last_undegraded":"2024-04-25T22:06:30.851852+0000","last_fullsized":"2024-04-25T22:06:30.851852+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142866+0000","last_change":"2024-04-25T22:06:23.081230+0000","last_active":"2024-04-25T22:06:31.142866+0000","last_peered":"2024-04-25T22:06:31.142866+0000","last_clean":"2024-04-25T22:06:31.142866+0000","last_became_active":"2024-04-25T22:06:23.080393+0000","last_became_peered":"2024-04-25T22:06:23.080393+0000","last_unstale":"2024-04-25T22:06:31.142866+0000","last_undegraded":"2024-04-25T22:06:31.142866+0000","last_fullsized":"2024-04-25T22:06:31.142866+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:55.157159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"76'415","reported_seq":596,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842908+0000","last_change":"2024-04-25T22:06:22.801327+0000","last_active":"2024-04-25T22:06:30.842908+0000","last_peered":"2024-04-25T22:06:30.842908+0000","last_clean":"2024-04-25T22:06:30.842908+0000","last_became_active":"2024-04-25T22:06:22.789624+0000","last_became_peered":"2024-04-25T22:06:22.789624+0000","last_unstale":"2024-04-25T22:06:30.842908+0000","last_undegraded":"2024-04-25T22:06:30.842908+0000","last_fullsized":"2024-04-25T22:06:30.842908+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27345,"num_write":384,"num_write_kb":92854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"76'407","reported_seq":623,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143259+0000","last_change":"2024-04-25T22:06:23.114739+0000","last_active":"2024-04-25T22:06:31.143259+0000","last_peered":"2024-04-25T22:06:31.143259+0000","last_clean":"2024-04-25T22:06:31.143259+0000","last_became_active":"2024-04-25T22:06:23.087118+0000","last_became_peered":"2024-04-25T22:06:23.087118+0000","last_unstale":"2024-04-25T22:06:31.143259+0000","last_undegraded":"2024-04-25T22:06:31.143259+0000","last_fullsized":"2024-04-25T22:06:31.143259+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:51.191212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33923,"num_write":372,"num_write_kb":82083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"77'260","reported_seq":420,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142062+0000","last_change":"2024-04-25T22:06:23.083331+0000","last_active":"2024-04-25T22:06:31.142062+0000","last_peered":"2024-04-25T22:06:31.142062+0000","last_clean":"2024-04-25T22:06:31.142062+0000","last_became_active":"2024-04-25T22:06:23.080552+0000","last_became_peered":"2024-04-25T22:06:23.080552+0000","last_unstale":"2024-04-25T22:06:31.142062+0000","last_undegraded":"2024-04-25T22:06:31.142062+0000","last_fullsized":"2024-04-25T22:06:31.142062+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:55.928212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8470619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"76'408","reported_seq":610,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848693+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:06:30.848693+0000","last_peered":"2024-04-25T22:06:30.848693+0000","last_clean":"2024-04-25T22:06:30.848693+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:06:30.848693+0000","last_undegraded":"2024-04-25T22:06:30.848693+0000","last_fullsized":"2024-04-25T22:06:30.848693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14178,"num_write":370,"num_write_kb":58735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'104","reported_seq":289,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845584+0000","last_change":"2024-04-25T22:06:22.805389+0000","last_active":"2024-04-25T22:06:30.845584+0000","last_peered":"2024-04-25T22:06:30.845584+0000","last_clean":"2024-04-25T22:06:30.845584+0000","last_became_active":"2024-04-25T22:06:22.802667+0000","last_became_peered":"2024-04-25T22:06:22.802667+0000","last_unstale":"2024-04-25T22:06:30.845584+0000","last_undegraded":"2024-04-25T22:06:30.845584+0000","last_fullsized":"2024-04-25T22:06:30.845584+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:38.785650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"75'232","reported_seq":286,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.151793+0000","last_change":"2024-04-25T22:06:31.151793+0000","last_active":"2024-04-25T22:06:31.151793+0000","last_peered":"2024-04-25T22:06:31.151793+0000","last_clean":"2024-04-25T22:06:31.151793+0000","last_became_active":"2024-04-25T22:06:31.150582+0000","last_became_peered":"2024-04-25T22:06:31.150582+0000","last_unstale":"2024-04-25T22:06:31.151793+0000","last_undegraded":"2024-04-25T22:06:31.151793+0000","last_fullsized":"2024-04-25T22:06:31.151793+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:49.932959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"76'483","reported_seq":713,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848496+0000","last_change":"2024-04-25T22:06:22.814119+0000","last_active":"2024-04-25T22:06:30.848496+0000","last_peered":"2024-04-25T22:06:30.848496+0000","last_clean":"2024-04-25T22:06:30.848496+0000","last_became_active":"2024-04-25T22:06:22.807584+0000","last_became_peered":"2024-04-25T22:06:22.807584+0000","last_unstale":"2024-04-25T22:06:30.848496+0000","last_undegraded":"2024-04-25T22:06:30.848496+0000","last_fullsized":"2024-04-25T22:06:30.848496+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:08.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24709,"num_write":463,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"75'60","reported_seq":244,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851719+0000","last_change":"2024-04-25T22:06:22.802356+0000","last_active":"2024-04-25T22:06:30.851719+0000","last_peered":"2024-04-25T22:06:30.851719+0000","last_clean":"2024-04-25T22:06:30.851719+0000","last_became_active":"2024-04-25T22:06:22.801412+0000","last_became_peered":"2024-04-25T22:06:22.801412+0000","last_unstale":"2024-04-25T22:06:30.851719+0000","last_undegraded":"2024-04-25T22:06:30.851719+0000","last_fullsized":"2024-04-25T22:06:30.851719+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:04.421952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'444","reported_seq":648,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848562+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:06:30.848562+0000","last_peered":"2024-04-25T22:06:30.848562+0000","last_clean":"2024-04-25T22:06:30.848562+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:06:30.848562+0000","last_undegraded":"2024-04-25T22:06:30.848562+0000","last_fullsized":"2024-04-25T22:06:30.848562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14429,"num_write":416,"num_write_kb":59186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'355","reported_seq":499,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845399+0000","last_change":"2024-04-25T22:06:22.804579+0000","last_active":"2024-04-25T22:06:30.845399+0000","last_peered":"2024-04-25T22:06:30.845399+0000","last_clean":"2024-04-25T22:06:30.845399+0000","last_became_active":"2024-04-25T22:06:22.792886+0000","last_became_peered":"2024-04-25T22:06:22.792886+0000","last_unstale":"2024-04-25T22:06:30.845399+0000","last_undegraded":"2024-04-25T22:06:30.845399+0000","last_fullsized":"2024-04-25T22:06:30.845399+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:54:35.464321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18236,"num_write":332,"num_write_kb":42553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"76'742","reported_seq":919,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849150+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:06:30.849150+0000","last_peered":"2024-04-25T22:06:30.849150+0000","last_clean":"2024-04-25T22:06:30.849150+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:06:30.849150+0000","last_undegraded":"2024-04-25T22:06:30.849150+0000","last_fullsized":"2024-04-25T22:06:30.849150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'378","reported_seq":579,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851532+0000","last_change":"2024-04-25T22:06:22.813642+0000","last_active":"2024-04-25T22:06:30.851532+0000","last_peered":"2024-04-25T22:06:30.851532+0000","last_clean":"2024-04-25T22:06:30.851532+0000","last_became_active":"2024-04-25T22:06:22.806240+0000","last_became_peered":"2024-04-25T22:06:22.806240+0000","last_unstale":"2024-04-25T22:06:30.851532+0000","last_undegraded":"2024-04-25T22:06:30.851532+0000","last_fullsized":"2024-04-25T22:06:30.851532+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6876,"num_write":354,"num_write_kb":46840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"76'204","reported_seq":388,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848941+0000","last_change":"2024-04-25T22:06:22.805022+0000","last_active":"2024-04-25T22:06:30.848941+0000","last_peered":"2024-04-25T22:06:30.848941+0000","last_clean":"2024-04-25T22:06:30.848941+0000","last_became_active":"2024-04-25T22:06:22.801630+0000","last_became_peered":"2024-04-25T22:06:22.801630+0000","last_unstale":"2024-04-25T22:06:30.848941+0000","last_undegraded":"2024-04-25T22:06:30.848941+0000","last_fullsized":"2024-04-25T22:06:30.848941+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:34.554201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'377","reported_seq":515,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845146+0000","last_change":"2024-04-25T22:06:22.805011+0000","last_active":"2024-04-25T22:06:30.845146+0000","last_peered":"2024-04-25T22:06:30.845146+0000","last_clean":"2024-04-25T22:06:30.845146+0000","last_became_active":"2024-04-25T22:06:22.795334+0000","last_became_peered":"2024-04-25T22:06:22.795334+0000","last_unstale":"2024-04-25T22:06:30.845146+0000","last_undegraded":"2024-04-25T22:06:30.845146+0000","last_fullsized":"2024-04-25T22:06:30.845146+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:35.997378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6059,"num_write":332,"num_write_kb":37972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"76'217","reported_seq":332,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844027+0000","last_change":"2024-04-25T22:06:28.842258+0000","last_active":"2024-04-25T22:06:30.844027+0000","last_peered":"2024-04-25T22:06:30.844027+0000","last_clean":"2024-04-25T22:06:30.844027+0000","last_became_active":"2024-04-25T22:06:28.841447+0000","last_became_peered":"2024-04-25T22:06:28.841447+0000","last_unstale":"2024-04-25T22:06:30.844027+0000","last_undegraded":"2024-04-25T22:06:30.844027+0000","last_fullsized":"2024-04-25T22:06:30.844027+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:31.009167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"76'389","reported_seq":542,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844243+0000","last_change":"2024-04-25T22:03:33.862286+0000","last_active":"2024-04-25T22:06:30.844243+0000","last_peered":"2024-04-25T22:06:30.844243+0000","last_clean":"2024-04-25T22:06:30.844243+0000","last_became_active":"2024-04-25T22:03:33.860800+0000","last_became_peered":"2024-04-25T22:03:33.860800+0000","last_unstale":"2024-04-25T22:06:30.844243+0000","last_undegraded":"2024-04-25T22:06:30.844243+0000","last_fullsized":"2024-04-25T22:06:30.844243+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:04.528174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19110,"num_write":355,"num_write_kb":63152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'51","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844734+0000","last_change":"2024-04-25T22:06:22.804880+0000","last_active":"2024-04-25T22:06:30.844734+0000","last_peered":"2024-04-25T22:06:30.844734+0000","last_clean":"2024-04-25T22:06:30.844734+0000","last_became_active":"2024-04-25T22:06:22.803778+0000","last_became_peered":"2024-04-25T22:06:22.803778+0000","last_unstale":"2024-04-25T22:06:30.844734+0000","last_undegraded":"2024-04-25T22:06:30.844734+0000","last_fullsized":"2024-04-25T22:06:30.844734+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:47:58.480071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"76'386","reported_seq":483,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161983+0000","last_change":"2024-04-25T22:06:31.161983+0000","last_active":"2024-04-25T22:06:31.161983+0000","last_peered":"2024-04-25T22:06:31.161983+0000","last_clean":"2024-04-25T22:06:31.161983+0000","last_became_active":"2024-04-25T22:06:31.149995+0000","last_became_peered":"2024-04-25T22:06:31.149995+0000","last_unstale":"2024-04-25T22:06:31.161983+0000","last_undegraded":"2024-04-25T22:06:31.161983+0000","last_fullsized":"2024-04-25T22:06:31.161983+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:07:32.261028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14050,"num_write":362,"num_write_kb":58957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"76'188","reported_seq":231,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.159971+0000","last_change":"2024-04-25T22:06:31.159971+0000","last_active":"2024-04-25T22:06:31.159971+0000","last_peered":"2024-04-25T22:06:31.159971+0000","last_clean":"2024-04-25T22:06:31.159971+0000","last_became_active":"2024-04-25T22:06:31.148291+0000","last_became_peered":"2024-04-25T22:06:31.148291+0000","last_unstale":"2024-04-25T22:06:31.159971+0000","last_undegraded":"2024-04-25T22:06:31.159971+0000","last_fullsized":"2024-04-25T22:06:31.159971+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:31.095798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"76'397","reported_seq":494,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.160300+0000","last_change":"2024-04-25T22:06:31.160300+0000","last_active":"2024-04-25T22:06:31.160300+0000","last_peered":"2024-04-25T22:06:31.160300+0000","last_clean":"2024-04-25T22:06:31.160300+0000","last_became_active":"2024-04-25T22:06:31.148445+0000","last_became_peered":"2024-04-25T22:06:31.148445+0000","last_unstale":"2024-04-25T22:06:31.160300+0000","last_undegraded":"2024-04-25T22:06:31.160300+0000","last_fullsized":"2024-04-25T22:06:31.160300+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:31.697126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13280,"num_write":364,"num_write_kb":46108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"75'284","reported_seq":414,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845419+0000","last_change":"2024-04-25T22:06:22.804561+0000","last_active":"2024-04-25T22:06:30.845419+0000","last_peered":"2024-04-25T22:06:30.845419+0000","last_clean":"2024-04-25T22:06:30.845419+0000","last_became_active":"2024-04-25T22:06:22.794078+0000","last_became_peered":"2024-04-25T22:06:22.794078+0000","last_unstale":"2024-04-25T22:06:30.845419+0000","last_undegraded":"2024-04-25T22:06:30.845419+0000","last_fullsized":"2024-04-25T22:06:30.845419+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:07.939379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":12398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"76'412","reported_seq":538,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843652+0000","last_change":"2024-04-25T22:03:33.864136+0000","last_active":"2024-04-25T22:06:30.843652+0000","last_peered":"2024-04-25T22:06:30.843652+0000","last_clean":"2024-04-25T22:06:30.843652+0000","last_became_active":"2024-04-25T22:03:33.862435+0000","last_became_peered":"2024-04-25T22:03:33.862435+0000","last_unstale":"2024-04-25T22:06:30.843652+0000","last_undegraded":"2024-04-25T22:06:30.843652+0000","last_fullsized":"2024-04-25T22:06:30.843652+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:08.119964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":1478,"num_write":377,"num_write_kb":34422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"76'127","reported_seq":304,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851488+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:06:30.851488+0000","last_peered":"2024-04-25T22:06:30.851488+0000","last_clean":"2024-04-25T22:06:30.851488+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:06:30.851488+0000","last_undegraded":"2024-04-25T22:06:30.851488+0000","last_fullsized":"2024-04-25T22:06:30.851488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'444","reported_seq":646,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141302+0000","last_change":"2024-04-25T22:06:23.132900+0000","last_active":"2024-04-25T22:06:31.141302+0000","last_peered":"2024-04-25T22:06:31.141302+0000","last_clean":"2024-04-25T22:06:31.141302+0000","last_became_active":"2024-04-25T22:06:23.097535+0000","last_became_peered":"2024-04-25T22:06:23.097535+0000","last_unstale":"2024-04-25T22:06:31.141302+0000","last_undegraded":"2024-04-25T22:06:31.141302+0000","last_fullsized":"2024-04-25T22:06:31.141302+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:30:55.243414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31576,"num_write":414,"num_write_kb":70915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"75'46","reported_seq":230,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851416+0000","last_change":"2024-04-25T22:06:22.802843+0000","last_active":"2024-04-25T22:06:30.851416+0000","last_peered":"2024-04-25T22:06:30.851416+0000","last_clean":"2024-04-25T22:06:30.851416+0000","last_became_active":"2024-04-25T22:06:22.801910+0000","last_became_peered":"2024-04-25T22:06:22.801910+0000","last_unstale":"2024-04-25T22:06:30.851416+0000","last_undegraded":"2024-04-25T22:06:30.851416+0000","last_fullsized":"2024-04-25T22:06:30.851416+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:23.004530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2665,"num_read_kb":1338898,"num_write":24540,"num_write_kb":4276910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26558,"ondisk_log_size":26558,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127376126,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":4662,"num_write_kb":127830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":71499776,"data_stored":254752252,"data_compressed":21836190,"data_compressed_allocated":35307520,"data_compressed_original":218619904,"omap_allocated":136586,"internal_metadata":0},"log_size":6446,"ondisk_log_size":6446,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738442,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99732,"kb_used_data":24200,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272108,"statfs":{"total":96636764160,"available":96534638592,"internally_reserved":0,"allocated":24780800,"data_stored":84964150,"data_compressed":7036839,"data_compressed_allocated":11431936,"data_compressed_original":72118272,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738441,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99436,"kb_used_data":23896,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272404,"statfs":{"total":96636764160,"available":96534941696,"internally_reserved":0,"allocated":24469504,"data_stored":81562098,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":90,"seq":386547056646,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58112,"kb_used_data":24432,"kb_used_omap":134,"kb_used_meta":33529,"kb_avail":94313728,"statfs":{"total":96636764160,"available":96577257472,"internally_reserved":0,"allocated":25018368,"data_stored":90623267,"data_compressed":7819212,"data_compressed_allocated":12599296,"data_compressed_original":78716928,"omap_allocated":138181,"internal_metadata":34333755},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24076288,"data_stored":89627390,"data_compressed":7811005,"data_compressed_allocated":12562432,"data_compressed_original":78143488,"omap_allocated":136586,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23584768,"data_stored":81156589,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23838720,"data_stored":83968273,"data_compressed":7028632,"data_compressed_allocated":11395072,"data_compressed_original":71544832,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:06:42.724 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:06:43.062 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:06:43.063 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":99,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:06:30.837237+0000","last_up_change":"2024-04-25T22:06:21.751537+0000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:01:03.632568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:01:07.995071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:01:12.514055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:01:12.963831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":81,"up_from":90,"up_thru":98,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2123863143},{"type":"v1","addr":"172.21.15.57:6801","nonce":2123863143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2123863143},{"type":"v1","addr":"172.21.15.57:6803","nonce":2123863143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2123863143},{"type":"v1","addr":"172.21.15.57:6807","nonce":2123863143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2123863143},{"type":"v1","addr":"172.21.15.57:6805","nonce":2123863143}]},"public_addr":"172.21.15.57:6801/2123863143","cluster_addr":"172.21.15.57:6803/2123863143","heartbeat_back_addr":"172.21.15.57:6807/2123863143","heartbeat_front_addr":"172.21.15.57:6805/2123863143","state":["exists","up"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6801","nonce":29975895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6803","nonce":29975895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6807","nonce":29975895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6805","nonce":29975895}]},"public_addr":"172.21.15.79:6801/29975895","cluster_addr":"172.21.15.79:6803/29975895","heartbeat_back_addr":"172.21.15.79:6807/29975895","heartbeat_front_addr":"172.21.15.79:6805/29975895","state":["exists","up"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6801","nonce":3918111900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6803","nonce":3918111900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6807","nonce":3918111900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6805","nonce":3918111900}]},"public_addr":"172.21.15.81:6801/3918111900","cluster_addr":"172.21.15.81:6803/3918111900","heartbeat_back_addr":"172.21.15.81:6807/3918111900","heartbeat_front_addr":"172.21.15.81:6805/3918111900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:59.025944+0000","dead_epoch":81},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.986080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.971238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":1,"to":0}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":0}]},{"pgid":"4.36","mappings":[{"from":2,"to":0}]},{"pgid":"4.3b","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:06:44.082 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T22:06:44.082 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T22:06:44.249 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-25T22:06:44.249 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-25T22:06:44.249 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-25T22:06:44.265 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T22:06:44.560 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T22:06:44.580 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T22:06:44.580 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T22:06:44.723 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-25T22:06:44.724 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T22:06:44.725 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-25T22:06:44.738 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T22:06:45.026 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T22:06:45.046 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T22:06:45.046 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T22:06:45.187 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-04-25T22:06:45.187 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T22:06:45.188 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-04-25T22:06:45.202 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T22:06:45.481 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T22:06:45.499 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:06:45.791 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:06:45.793 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:06:45.809 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":268,"stamp":"2024-04-25T22:06:45.692483+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127966494,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2864,"num_read_kb":1340487,"num_write":29405,"num_write_kb":4408200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33161,"ondisk_log_size":33161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":257280,"kb_used_data":72528,"kb_used_omap":138,"kb_used_meta":184565,"kb_avail":282858240,"statfs":{"total":289910292480,"available":289646837760,"internally_reserved":0,"allocated":74268672,"data_stored":257149515,"data_compressed":21852604,"data_compressed_allocated":35381248,"data_compressed_original":219766784,"omap_allocated":141371,"internal_metadata":188995525},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004019"},"pg_stats":[{"pgid":"4.3f","version":"76'446","reported_seq":604,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845124+0000","last_change":"2024-04-25T22:03:33.876369+0000","last_active":"2024-04-25T22:06:30.845124+0000","last_peered":"2024-04-25T22:06:30.845124+0000","last_clean":"2024-04-25T22:06:30.845124+0000","last_became_active":"2024-04-25T22:03:33.873739+0000","last_became_peered":"2024-04-25T22:03:33.873739+0000","last_unstale":"2024-04-25T22:06:30.845124+0000","last_undegraded":"2024-04-25T22:06:30.845124+0000","last_fullsized":"2024-04-25T22:06:30.845124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:32.529707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29432,"num_write":407,"num_write_kb":84235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"76'417","reported_seq":570,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844117+0000","last_change":"2024-04-25T22:03:33.861269+0000","last_active":"2024-04-25T22:06:30.844117+0000","last_peered":"2024-04-25T22:06:30.844117+0000","last_clean":"2024-04-25T22:06:30.844117+0000","last_became_active":"2024-04-25T22:03:33.859221+0000","last_became_peered":"2024-04-25T22:03:33.859221+0000","last_unstale":"2024-04-25T22:06:30.844117+0000","last_undegraded":"2024-04-25T22:06:30.844117+0000","last_fullsized":"2024-04-25T22:06:30.844117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:23:44.690527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":23541,"num_write":389,"num_write_kb":87654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"76'389","reported_seq":558,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.162002+0000","last_change":"2024-04-25T22:06:31.162002+0000","last_active":"2024-04-25T22:06:31.162002+0000","last_peered":"2024-04-25T22:06:31.162002+0000","last_clean":"2024-04-25T22:06:31.162002+0000","last_became_active":"2024-04-25T22:06:31.149675+0000","last_became_peered":"2024-04-25T22:06:31.149675+0000","last_unstale":"2024-04-25T22:06:31.162002+0000","last_undegraded":"2024-04-25T22:06:31.162002+0000","last_fullsized":"2024-04-25T22:06:31.162002+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:08:49.833041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22311,"num_write":361,"num_write_kb":42975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"76'394","reported_seq":588,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142488+0000","last_change":"2024-04-25T22:06:23.123256+0000","last_active":"2024-04-25T22:06:31.142488+0000","last_peered":"2024-04-25T22:06:31.142488+0000","last_clean":"2024-04-25T22:06:31.142488+0000","last_became_active":"2024-04-25T22:06:23.090780+0000","last_became_peered":"2024-04-25T22:06:23.090780+0000","last_unstale":"2024-04-25T22:06:31.142488+0000","last_undegraded":"2024-04-25T22:06:31.142488+0000","last_fullsized":"2024-04-25T22:06:31.142488+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:57.110628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":20785,"num_write":367,"num_write_kb":63746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"76'429","reported_seq":940,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844371+0000","last_change":"2024-04-25T22:06:28.839715+0000","last_active":"2024-04-25T22:06:30.844371+0000","last_peered":"2024-04-25T22:06:30.844371+0000","last_clean":"2024-04-25T22:06:30.844371+0000","last_became_active":"2024-04-25T22:06:28.836687+0000","last_became_peered":"2024-04-25T22:06:28.836687+0000","last_unstale":"2024-04-25T22:06:30.844371+0000","last_undegraded":"2024-04-25T22:06:30.844371+0000","last_fullsized":"2024-04-25T22:06:30.844371+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:10.175157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":20896,"num_write":403,"num_write_kb":100255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"76'368","reported_seq":542,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141851+0000","last_change":"2024-04-25T22:06:23.129617+0000","last_active":"2024-04-25T22:06:31.141851+0000","last_peered":"2024-04-25T22:06:31.141851+0000","last_clean":"2024-04-25T22:06:31.141851+0000","last_became_active":"2024-04-25T22:06:23.107939+0000","last_became_peered":"2024-04-25T22:06:23.107939+0000","last_unstale":"2024-04-25T22:06:31.141851+0000","last_undegraded":"2024-04-25T22:06:31.141851+0000","last_fullsized":"2024-04-25T22:06:31.141851+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:24.183902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9362,"num_write":344,"num_write_kb":20831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"76'438","reported_seq":638,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140968+0000","last_change":"2024-04-25T22:06:23.123861+0000","last_active":"2024-04-25T22:06:31.140968+0000","last_peered":"2024-04-25T22:06:31.140968+0000","last_clean":"2024-04-25T22:06:31.140968+0000","last_became_active":"2024-04-25T22:06:23.098436+0000","last_became_peered":"2024-04-25T22:06:23.098436+0000","last_unstale":"2024-04-25T22:06:31.140968+0000","last_undegraded":"2024-04-25T22:06:31.140968+0000","last_fullsized":"2024-04-25T22:06:31.140968+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:35.433423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25961,"num_write":415,"num_write_kb":72541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'392","reported_seq":602,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140791+0000","last_change":"2024-04-25T22:06:23.128274+0000","last_active":"2024-04-25T22:06:31.140791+0000","last_peered":"2024-04-25T22:06:31.140791+0000","last_clean":"2024-04-25T22:06:31.140791+0000","last_became_active":"2024-04-25T22:06:23.091431+0000","last_became_peered":"2024-04-25T22:06:23.091431+0000","last_unstale":"2024-04-25T22:06:31.140791+0000","last_undegraded":"2024-04-25T22:06:31.140791+0000","last_fullsized":"2024-04-25T22:06:31.140791+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:48.206131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":24749,"num_write":354,"num_write_kb":64232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"76'443","reported_seq":651,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850489+0000","last_change":"2024-04-25T22:01:14.644282+0000","last_active":"2024-04-25T22:06:30.850489+0000","last_peered":"2024-04-25T22:06:30.850489+0000","last_clean":"2024-04-25T22:06:30.850489+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:06:30.850489+0000","last_undegraded":"2024-04-25T22:06:30.850489+0000","last_fullsized":"2024-04-25T22:06:30.850489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:50.227155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":10648,"num_write":411,"num_write_kb":92932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'392","reported_seq":511,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142550+0000","last_change":"2024-04-25T22:06:26.120464+0000","last_active":"2024-04-25T22:06:31.142550+0000","last_peered":"2024-04-25T22:06:31.142550+0000","last_clean":"2024-04-25T22:06:31.142550+0000","last_became_active":"2024-04-25T22:06:26.114463+0000","last_became_peered":"2024-04-25T22:06:26.114463+0000","last_unstale":"2024-04-25T22:06:31.142550+0000","last_undegraded":"2024-04-25T22:06:31.142550+0000","last_fullsized":"2024-04-25T22:06:31.142550+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:37:54.870762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10696,"num_write":359,"num_write_kb":63259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'391","reported_seq":569,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144957+0000","last_change":"2024-04-25T22:06:23.135020+0000","last_active":"2024-04-25T22:06:31.144957+0000","last_peered":"2024-04-25T22:06:31.144957+0000","last_clean":"2024-04-25T22:06:31.144957+0000","last_became_active":"2024-04-25T22:06:23.123801+0000","last_became_peered":"2024-04-25T22:06:23.123801+0000","last_unstale":"2024-04-25T22:06:31.144957+0000","last_undegraded":"2024-04-25T22:06:31.144957+0000","last_fullsized":"2024-04-25T22:06:31.144957+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:11:44.607123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11259,"num_write":372,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"76'365","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843898+0000","last_change":"2024-04-25T22:06:22.802947+0000","last_active":"2024-04-25T22:06:30.843898+0000","last_peered":"2024-04-25T22:06:30.843898+0000","last_clean":"2024-04-25T22:06:30.843898+0000","last_became_active":"2024-04-25T22:06:22.792880+0000","last_became_peered":"2024-04-25T22:06:22.792880+0000","last_unstale":"2024-04-25T22:06:30.843898+0000","last_undegraded":"2024-04-25T22:06:30.843898+0000","last_fullsized":"2024-04-25T22:06:30.843898+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":51972,"num_write":340,"num_write_kb":51203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"76'420","reported_seq":574,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843505+0000","last_change":"2024-04-25T22:03:33.866815+0000","last_active":"2024-04-25T22:06:30.843505+0000","last_peered":"2024-04-25T22:06:30.843505+0000","last_clean":"2024-04-25T22:06:30.843505+0000","last_became_active":"2024-04-25T22:03:33.859376+0000","last_became_peered":"2024-04-25T22:03:33.859376+0000","last_unstale":"2024-04-25T22:06:30.843505+0000","last_undegraded":"2024-04-25T22:06:30.843505+0000","last_fullsized":"2024-04-25T22:06:30.843505+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:08.620311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17620,"num_write":386,"num_write_kb":100613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"76'432","reported_seq":631,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141520+0000","last_change":"2024-04-25T22:06:23.128788+0000","last_active":"2024-04-25T22:06:31.141520+0000","last_peered":"2024-04-25T22:06:31.141520+0000","last_clean":"2024-04-25T22:06:31.141520+0000","last_became_active":"2024-04-25T22:06:23.081466+0000","last_became_peered":"2024-04-25T22:06:23.081466+0000","last_unstale":"2024-04-25T22:06:31.141520+0000","last_undegraded":"2024-04-25T22:06:31.141520+0000","last_fullsized":"2024-04-25T22:06:31.141520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:15.042731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27327,"num_write":398,"num_write_kb":76113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"76'385","reported_seq":584,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140840+0000","last_change":"2024-04-25T22:06:23.116284+0000","last_active":"2024-04-25T22:06:31.140840+0000","last_peered":"2024-04-25T22:06:31.140840+0000","last_clean":"2024-04-25T22:06:31.140840+0000","last_became_active":"2024-04-25T22:06:23.088046+0000","last_became_peered":"2024-04-25T22:06:23.088046+0000","last_unstale":"2024-04-25T22:06:31.140840+0000","last_undegraded":"2024-04-25T22:06:31.140840+0000","last_fullsized":"2024-04-25T22:06:31.140840+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:40:35.110567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23986,"num_write":352,"num_write_kb":50754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"76'434","reported_seq":615,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141488+0000","last_change":"2024-04-25T22:06:23.132996+0000","last_active":"2024-04-25T22:06:31.141488+0000","last_peered":"2024-04-25T22:06:31.141488+0000","last_clean":"2024-04-25T22:06:31.141488+0000","last_became_active":"2024-04-25T22:06:23.117497+0000","last_became_peered":"2024-04-25T22:06:23.117497+0000","last_unstale":"2024-04-25T22:06:31.141488+0000","last_undegraded":"2024-04-25T22:06:31.141488+0000","last_fullsized":"2024-04-25T22:06:31.141488+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:30.022312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":13806,"num_write":403,"num_write_kb":38995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"76'444","reported_seq":658,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851797+0000","last_change":"2024-04-25T22:01:14.642133+0000","last_active":"2024-04-25T22:06:30.851797+0000","last_peered":"2024-04-25T22:06:30.851797+0000","last_clean":"2024-04-25T22:06:30.851797+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:06:30.851797+0000","last_undegraded":"2024-04-25T22:06:30.851797+0000","last_fullsized":"2024-04-25T22:06:30.851797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:13.697356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":11085,"num_write":416,"num_write_kb":68377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'396","reported_seq":531,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844593+0000","last_change":"2024-04-25T22:03:33.862762+0000","last_active":"2024-04-25T22:06:30.844593+0000","last_peered":"2024-04-25T22:06:30.844593+0000","last_clean":"2024-04-25T22:06:30.844593+0000","last_became_active":"2024-04-25T22:03:33.861082+0000","last_became_peered":"2024-04-25T22:03:33.861082+0000","last_unstale":"2024-04-25T22:06:30.844593+0000","last_undegraded":"2024-04-25T22:06:30.844593+0000","last_fullsized":"2024-04-25T22:06:30.844593+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:15.823113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6581,"num_write":355,"num_write_kb":34159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"76'447","reported_seq":648,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850341+0000","last_change":"2024-04-25T22:01:14.642251+0000","last_active":"2024-04-25T22:06:30.850341+0000","last_peered":"2024-04-25T22:06:30.850341+0000","last_clean":"2024-04-25T22:06:30.850341+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:06:30.850341+0000","last_undegraded":"2024-04-25T22:06:30.850341+0000","last_fullsized":"2024-04-25T22:06:30.850341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:23.252947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22089,"num_write":411,"num_write_kb":104750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'426","reported_seq":604,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144109+0000","last_change":"2024-04-25T22:06:23.122769+0000","last_active":"2024-04-25T22:06:31.144109+0000","last_peered":"2024-04-25T22:06:31.144109+0000","last_clean":"2024-04-25T22:06:31.144109+0000","last_became_active":"2024-04-25T22:06:23.093379+0000","last_became_peered":"2024-04-25T22:06:23.093379+0000","last_unstale":"2024-04-25T22:06:31.144109+0000","last_undegraded":"2024-04-25T22:06:31.144109+0000","last_fullsized":"2024-04-25T22:06:31.144109+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:48.070891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11886,"num_write":398,"num_write_kb":55010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"76'405","reported_seq":602,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143776+0000","last_change":"2024-04-25T22:06:23.129396+0000","last_active":"2024-04-25T22:06:31.143776+0000","last_peered":"2024-04-25T22:06:31.143776+0000","last_clean":"2024-04-25T22:06:31.143776+0000","last_became_active":"2024-04-25T22:06:23.110101+0000","last_became_peered":"2024-04-25T22:06:23.110101+0000","last_unstale":"2024-04-25T22:06:31.143776+0000","last_undegraded":"2024-04-25T22:06:31.143776+0000","last_fullsized":"2024-04-25T22:06:31.143776+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:40.218610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23004,"num_write":370,"num_write_kb":75802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'436","reported_seq":559,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843341+0000","last_change":"2024-04-25T22:06:28.838562+0000","last_active":"2024-04-25T22:06:30.843341+0000","last_peered":"2024-04-25T22:06:30.843341+0000","last_clean":"2024-04-25T22:06:30.843341+0000","last_became_active":"2024-04-25T22:06:28.835081+0000","last_became_peered":"2024-04-25T22:06:28.835081+0000","last_unstale":"2024-04-25T22:06:30.843341+0000","last_undegraded":"2024-04-25T22:06:30.843341+0000","last_fullsized":"2024-04-25T22:06:30.843341+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:15:18.057041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11950,"num_write":408,"num_write_kb":67524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"76'403","reported_seq":607,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.847686+0000","last_change":"2024-04-25T22:06:22.810930+0000","last_active":"2024-04-25T22:06:30.847686+0000","last_peered":"2024-04-25T22:06:30.847686+0000","last_clean":"2024-04-25T22:06:30.847686+0000","last_became_active":"2024-04-25T22:06:22.802907+0000","last_became_peered":"2024-04-25T22:06:22.802907+0000","last_unstale":"2024-04-25T22:06:30.847686+0000","last_undegraded":"2024-04-25T22:06:30.847686+0000","last_fullsized":"2024-04-25T22:06:30.847686+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:00.334109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":6507,"num_write":370,"num_write_kb":51513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'449","reported_seq":574,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842684+0000","last_change":"2024-04-25T22:06:28.846531+0000","last_active":"2024-04-25T22:06:30.842684+0000","last_peered":"2024-04-25T22:06:30.842684+0000","last_clean":"2024-04-25T22:06:30.842684+0000","last_became_active":"2024-04-25T22:06:28.841283+0000","last_became_peered":"2024-04-25T22:06:28.841283+0000","last_unstale":"2024-04-25T22:06:30.842684+0000","last_undegraded":"2024-04-25T22:06:30.842684+0000","last_fullsized":"2024-04-25T22:06:30.842684+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:02.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27047,"num_write":417,"num_write_kb":63386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"76'406","reported_seq":571,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845286+0000","last_change":"2024-04-25T22:06:22.801634+0000","last_active":"2024-04-25T22:06:30.845286+0000","last_peered":"2024-04-25T22:06:30.845286+0000","last_clean":"2024-04-25T22:06:30.845286+0000","last_became_active":"2024-04-25T22:06:22.791470+0000","last_became_peered":"2024-04-25T22:06:22.791470+0000","last_unstale":"2024-04-25T22:06:30.845286+0000","last_undegraded":"2024-04-25T22:06:30.845286+0000","last_fullsized":"2024-04-25T22:06:30.845286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:25.424659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25550,"num_write":386,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"76'485","reported_seq":735,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850945+0000","last_change":"2024-04-25T22:06:22.814124+0000","last_active":"2024-04-25T22:06:30.850945+0000","last_peered":"2024-04-25T22:06:30.850945+0000","last_clean":"2024-04-25T22:06:30.850945+0000","last_became_active":"2024-04-25T22:06:22.804228+0000","last_became_peered":"2024-04-25T22:06:22.804228+0000","last_unstale":"2024-04-25T22:06:30.850945+0000","last_undegraded":"2024-04-25T22:06:30.850945+0000","last_fullsized":"2024-04-25T22:06:30.850945+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:22.423279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":30714,"num_write":444,"num_write_kb":92836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'387","reported_seq":592,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144694+0000","last_change":"2024-04-25T22:06:23.134971+0000","last_active":"2024-04-25T22:06:31.144694+0000","last_peered":"2024-04-25T22:06:31.144694+0000","last_clean":"2024-04-25T22:06:31.144694+0000","last_became_active":"2024-04-25T22:06:23.121334+0000","last_became_peered":"2024-04-25T22:06:23.121334+0000","last_unstale":"2024-04-25T22:06:31.144694+0000","last_undegraded":"2024-04-25T22:06:31.144694+0000","last_fullsized":"2024-04-25T22:06:31.144694+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:09:03.991336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21644,"num_write":354,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"76'405","reported_seq":649,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844816+0000","last_change":"2024-04-25T22:06:22.829889+0000","last_active":"2024-04-25T22:06:30.844816+0000","last_peered":"2024-04-25T22:06:30.844816+0000","last_clean":"2024-04-25T22:06:30.844816+0000","last_became_active":"2024-04-25T22:06:22.827066+0000","last_became_peered":"2024-04-25T22:06:22.827066+0000","last_unstale":"2024-04-25T22:06:30.844816+0000","last_undegraded":"2024-04-25T22:06:30.844816+0000","last_fullsized":"2024-04-25T22:06:30.844816+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:01.822252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27522,"num_write":375,"num_write_kb":96416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"76'396","reported_seq":619,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850059+0000","last_change":"2024-04-25T22:01:14.639851+0000","last_active":"2024-04-25T22:06:30.850059+0000","last_peered":"2024-04-25T22:06:30.850059+0000","last_clean":"2024-04-25T22:06:30.850059+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:06:30.850059+0000","last_undegraded":"2024-04-25T22:06:30.850059+0000","last_fullsized":"2024-04-25T22:06:30.850059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.376799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28501,"num_write":367,"num_write_kb":63458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":654,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843955+0000","last_change":"2024-04-25T22:06:22.803787+0000","last_active":"2024-04-25T22:06:30.843955+0000","last_peered":"2024-04-25T22:06:30.843955+0000","last_clean":"2024-04-25T22:06:30.843955+0000","last_became_active":"2024-04-25T22:06:22.789907+0000","last_became_peered":"2024-04-25T22:06:22.789907+0000","last_unstale":"2024-04-25T22:06:30.843955+0000","last_undegraded":"2024-04-25T22:06:30.843955+0000","last_fullsized":"2024-04-25T22:06:30.843955+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":20717,"num_write":435,"num_write_kb":55985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"76'444","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848333+0000","last_change":"2024-04-25T22:01:14.639832+0000","last_active":"2024-04-25T22:06:30.848333+0000","last_peered":"2024-04-25T22:06:30.848333+0000","last_clean":"2024-04-25T22:06:30.848333+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:06:30.848333+0000","last_undegraded":"2024-04-25T22:06:30.848333+0000","last_fullsized":"2024-04-25T22:06:30.848333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:40.682345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":10758,"num_write":401,"num_write_kb":44705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'422","reported_seq":533,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.160927+0000","last_change":"2024-04-25T22:06:31.160927+0000","last_active":"2024-04-25T22:06:31.160927+0000","last_peered":"2024-04-25T22:06:31.160927+0000","last_clean":"2024-04-25T22:06:31.160927+0000","last_became_active":"2024-04-25T22:06:31.148129+0000","last_became_peered":"2024-04-25T22:06:31.148129+0000","last_unstale":"2024-04-25T22:06:31.160927+0000","last_undegraded":"2024-04-25T22:06:31.160927+0000","last_fullsized":"2024-04-25T22:06:31.160927+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:26:06.579471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":29059,"num_write":391,"num_write_kb":40233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"76'397","reported_seq":894,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844568+0000","last_change":"2024-04-25T22:06:26.819859+0000","last_active":"2024-04-25T22:06:30.844568+0000","last_peered":"2024-04-25T22:06:30.844568+0000","last_clean":"2024-04-25T22:06:30.844568+0000","last_became_active":"2024-04-25T22:06:26.816439+0000","last_became_peered":"2024-04-25T22:06:26.816439+0000","last_unstale":"2024-04-25T22:06:30.844568+0000","last_undegraded":"2024-04-25T22:06:30.844568+0000","last_fullsized":"2024-04-25T22:06:30.844568+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:44.452918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28857,"num_write":363,"num_write_kb":87969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"75'515","reported_seq":671,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142622+0000","last_change":"2024-04-25T22:06:23.117492+0000","last_active":"2024-04-25T22:06:31.142622+0000","last_peered":"2024-04-25T22:06:31.142622+0000","last_clean":"2024-04-25T22:06:31.142622+0000","last_became_active":"2024-04-25T22:06:23.109665+0000","last_became_peered":"2024-04-25T22:06:23.109665+0000","last_unstale":"2024-04-25T22:06:31.142622+0000","last_undegraded":"2024-04-25T22:06:31.142622+0000","last_fullsized":"2024-04-25T22:06:31.142622+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:39:01.482888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"76'375","reported_seq":481,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845202+0000","last_change":"2024-04-25T22:06:28.846182+0000","last_active":"2024-04-25T22:06:30.845202+0000","last_peered":"2024-04-25T22:06:30.845202+0000","last_clean":"2024-04-25T22:06:30.845202+0000","last_became_active":"2024-04-25T22:06:28.841545+0000","last_became_peered":"2024-04-25T22:06:28.841545+0000","last_unstale":"2024-04-25T22:06:30.845202+0000","last_undegraded":"2024-04-25T22:06:30.845202+0000","last_fullsized":"2024-04-25T22:06:30.845202+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.018915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14983,"num_write":339,"num_write_kb":46748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'53","reported_seq":237,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849016+0000","last_change":"2024-04-25T22:06:22.839083+0000","last_active":"2024-04-25T22:06:30.849016+0000","last_peered":"2024-04-25T22:06:30.849016+0000","last_clean":"2024-04-25T22:06:30.849016+0000","last_became_active":"2024-04-25T22:06:22.833424+0000","last_became_peered":"2024-04-25T22:06:22.833424+0000","last_unstale":"2024-04-25T22:06:30.849016+0000","last_undegraded":"2024-04-25T22:06:30.849016+0000","last_fullsized":"2024-04-25T22:06:30.849016+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:00.819067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'426","reported_seq":639,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851784+0000","last_change":"2024-04-25T22:06:26.822923+0000","last_active":"2024-04-25T22:06:30.851784+0000","last_peered":"2024-04-25T22:06:30.851784+0000","last_clean":"2024-04-25T22:06:30.851784+0000","last_became_active":"2024-04-25T22:06:26.819562+0000","last_became_peered":"2024-04-25T22:06:26.819562+0000","last_unstale":"2024-04-25T22:06:30.851784+0000","last_undegraded":"2024-04-25T22:06:30.851784+0000","last_fullsized":"2024-04-25T22:06:30.851784+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:42.832195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":17843,"num_write":388,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"75'71","reported_seq":188,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843496+0000","last_change":"2024-04-25T22:06:22.799710+0000","last_active":"2024-04-25T22:06:30.843496+0000","last_peered":"2024-04-25T22:06:30.843496+0000","last_clean":"2024-04-25T22:06:30.843496+0000","last_became_active":"2024-04-25T22:06:22.790902+0000","last_became_peered":"2024-04-25T22:06:22.790902+0000","last_unstale":"2024-04-25T22:06:30.843496+0000","last_undegraded":"2024-04-25T22:06:30.843496+0000","last_fullsized":"2024-04-25T22:06:30.843496+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:50:36.683583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'366","reported_seq":571,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850882+0000","last_change":"2024-04-25T22:06:22.809150+0000","last_active":"2024-04-25T22:06:30.850882+0000","last_peered":"2024-04-25T22:06:30.850882+0000","last_clean":"2024-04-25T22:06:30.850882+0000","last_became_active":"2024-04-25T22:06:22.803327+0000","last_became_peered":"2024-04-25T22:06:22.803327+0000","last_unstale":"2024-04-25T22:06:30.850882+0000","last_undegraded":"2024-04-25T22:06:30.850882+0000","last_fullsized":"2024-04-25T22:06:30.850882+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:36.731906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":16032,"num_write":334,"num_write_kb":25754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'63","reported_seq":221,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140280+0000","last_change":"2024-04-25T22:06:23.085892+0000","last_active":"2024-04-25T22:06:31.140280+0000","last_peered":"2024-04-25T22:06:31.140280+0000","last_clean":"2024-04-25T22:06:31.140280+0000","last_became_active":"2024-04-25T22:06:23.082351+0000","last_became_peered":"2024-04-25T22:06:23.082351+0000","last_unstale":"2024-04-25T22:06:31.140280+0000","last_undegraded":"2024-04-25T22:06:31.140280+0000","last_fullsized":"2024-04-25T22:06:31.140280+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:26:51.142517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"76'148","reported_seq":306,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143742+0000","last_change":"2024-04-25T22:06:23.089179+0000","last_active":"2024-04-25T22:06:31.143742+0000","last_peered":"2024-04-25T22:06:31.143742+0000","last_clean":"2024-04-25T22:06:31.143742+0000","last_became_active":"2024-04-25T22:06:23.085599+0000","last_became_peered":"2024-04-25T22:06:23.085599+0000","last_unstale":"2024-04-25T22:06:31.143742+0000","last_undegraded":"2024-04-25T22:06:31.143742+0000","last_fullsized":"2024-04-25T22:06:31.143742+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:53:14.055158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"76'402","reported_seq":568,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842703+0000","last_change":"2024-04-25T22:06:22.802685+0000","last_active":"2024-04-25T22:06:30.842703+0000","last_peered":"2024-04-25T22:06:30.842703+0000","last_clean":"2024-04-25T22:06:30.842703+0000","last_became_active":"2024-04-25T22:06:22.789353+0000","last_became_peered":"2024-04-25T22:06:22.789353+0000","last_unstale":"2024-04-25T22:06:30.842703+0000","last_undegraded":"2024-04-25T22:06:30.842703+0000","last_fullsized":"2024-04-25T22:06:30.842703+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:15:14.949049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21114,"num_write":364,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"75'250","reported_seq":374,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844891+0000","last_change":"2024-04-25T22:06:22.791598+0000","last_active":"2024-04-25T22:06:30.844891+0000","last_peered":"2024-04-25T22:06:30.844891+0000","last_clean":"2024-04-25T22:06:30.844891+0000","last_became_active":"2024-04-25T22:06:22.790508+0000","last_became_peered":"2024-04-25T22:06:22.790508+0000","last_unstale":"2024-04-25T22:06:30.844891+0000","last_undegraded":"2024-04-25T22:06:30.844891+0000","last_fullsized":"2024-04-25T22:06:30.844891+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"76'460","reported_seq":634,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842903+0000","last_change":"2024-04-25T22:03:33.861055+0000","last_active":"2024-04-25T22:06:30.842903+0000","last_peered":"2024-04-25T22:06:30.842903+0000","last_clean":"2024-04-25T22:06:30.842903+0000","last_became_active":"2024-04-25T22:03:33.856638+0000","last_became_peered":"2024-04-25T22:03:33.856638+0000","last_unstale":"2024-04-25T22:06:30.842903+0000","last_undegraded":"2024-04-25T22:06:30.842903+0000","last_fullsized":"2024-04-25T22:06:30.842903+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:48.227996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":39774,"num_write":433,"num_write_kb":80294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'556","reported_seq":714,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.148664+0000","last_change":"2024-04-25T22:06:31.148664+0000","last_active":"2024-04-25T22:06:31.148664+0000","last_peered":"2024-04-25T22:06:31.148664+0000","last_clean":"2024-04-25T22:06:31.148664+0000","last_became_active":"2024-04-25T22:06:31.147569+0000","last_became_peered":"2024-04-25T22:06:31.147569+0000","last_unstale":"2024-04-25T22:06:31.148664+0000","last_undegraded":"2024-04-25T22:06:31.148664+0000","last_fullsized":"2024-04-25T22:06:31.148664+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:41.798311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":509,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"76'413","reported_seq":577,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142062+0000","last_change":"2024-04-25T22:06:23.129627+0000","last_active":"2024-04-25T22:06:31.142062+0000","last_peered":"2024-04-25T22:06:31.142062+0000","last_clean":"2024-04-25T22:06:31.142062+0000","last_became_active":"2024-04-25T22:06:23.108199+0000","last_became_peered":"2024-04-25T22:06:23.108199+0000","last_unstale":"2024-04-25T22:06:31.142062+0000","last_undegraded":"2024-04-25T22:06:31.142062+0000","last_fullsized":"2024-04-25T22:06:31.142062+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:23.828740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4858,"num_write":378,"num_write_kb":46741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"76'66","reported_seq":77,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161275+0000","last_change":"2024-04-25T22:06:31.161275+0000","last_active":"2024-04-25T22:06:31.161275+0000","last_peered":"2024-04-25T22:06:31.161275+0000","last_clean":"2024-04-25T22:06:31.161275+0000","last_became_active":"2024-04-25T22:06:31.160267+0000","last_became_peered":"2024-04-25T22:06:31.160267+0000","last_unstale":"2024-04-25T22:06:31.161275+0000","last_undegraded":"2024-04-25T22:06:31.161275+0000","last_fullsized":"2024-04-25T22:06:31.161275+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:14.214127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"76'489","reported_seq":729,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850154+0000","last_change":"2024-04-25T22:06:22.838952+0000","last_active":"2024-04-25T22:06:30.850154+0000","last_peered":"2024-04-25T22:06:30.850154+0000","last_clean":"2024-04-25T22:06:30.850154+0000","last_became_active":"2024-04-25T22:06:22.832394+0000","last_became_peered":"2024-04-25T22:06:22.832394+0000","last_unstale":"2024-04-25T22:06:30.850154+0000","last_undegraded":"2024-04-25T22:06:30.850154+0000","last_fullsized":"2024-04-25T22:06:30.850154+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:04:38.988916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":26829,"num_write":457,"num_write_kb":137840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"75'193","reported_seq":377,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850501+0000","last_change":"2024-04-25T22:06:22.838157+0000","last_active":"2024-04-25T22:06:30.850501+0000","last_peered":"2024-04-25T22:06:30.850501+0000","last_clean":"2024-04-25T22:06:30.850501+0000","last_became_active":"2024-04-25T22:06:22.832572+0000","last_became_peered":"2024-04-25T22:06:22.832572+0000","last_unstale":"2024-04-25T22:06:30.850501+0000","last_undegraded":"2024-04-25T22:06:30.850501+0000","last_fullsized":"2024-04-25T22:06:30.850501+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:34.994194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'437","reported_seq":528,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.160788+0000","last_change":"2024-04-25T22:06:31.160788+0000","last_active":"2024-04-25T22:06:31.160788+0000","last_peered":"2024-04-25T22:06:31.160788+0000","last_clean":"2024-04-25T22:06:31.160788+0000","last_became_active":"2024-04-25T22:06:31.147501+0000","last_became_peered":"2024-04-25T22:06:31.147501+0000","last_unstale":"2024-04-25T22:06:31.160788+0000","last_undegraded":"2024-04-25T22:06:31.160788+0000","last_fullsized":"2024-04-25T22:06:31.160788+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:30:29.866840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3720,"num_write":406,"num_write_kb":30461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"76'106","reported_seq":264,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140763+0000","last_change":"2024-04-25T22:06:23.128769+0000","last_active":"2024-04-25T22:06:31.140763+0000","last_peered":"2024-04-25T22:06:31.140763+0000","last_clean":"2024-04-25T22:06:31.140763+0000","last_became_active":"2024-04-25T22:06:23.103402+0000","last_became_peered":"2024-04-25T22:06:23.103402+0000","last_unstale":"2024-04-25T22:06:31.140763+0000","last_undegraded":"2024-04-25T22:06:31.140763+0000","last_fullsized":"2024-04-25T22:06:31.140763+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:27.137773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"76'409","reported_seq":605,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143850+0000","last_change":"2024-04-25T22:06:23.133536+0000","last_active":"2024-04-25T22:06:31.143850+0000","last_peered":"2024-04-25T22:06:31.143850+0000","last_clean":"2024-04-25T22:06:31.143850+0000","last_became_active":"2024-04-25T22:06:23.086188+0000","last_became_peered":"2024-04-25T22:06:23.086188+0000","last_unstale":"2024-04-25T22:06:31.143850+0000","last_undegraded":"2024-04-25T22:06:31.143850+0000","last_fullsized":"2024-04-25T22:06:31.143850+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:13:59.140479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19178,"num_write":380,"num_write_kb":91945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"75'51","reported_seq":182,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843314+0000","last_change":"2024-04-25T22:06:22.800659+0000","last_active":"2024-04-25T22:06:30.843314+0000","last_peered":"2024-04-25T22:06:30.843314+0000","last_clean":"2024-04-25T22:06:30.843314+0000","last_became_active":"2024-04-25T22:06:22.798779+0000","last_became_peered":"2024-04-25T22:06:22.798779+0000","last_unstale":"2024-04-25T22:06:30.843314+0000","last_undegraded":"2024-04-25T22:06:30.843314+0000","last_fullsized":"2024-04-25T22:06:30.843314+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:35.728722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"76'377","reported_seq":561,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143491+0000","last_change":"2024-04-25T22:06:23.114225+0000","last_active":"2024-04-25T22:06:31.143491+0000","last_peered":"2024-04-25T22:06:31.143491+0000","last_clean":"2024-04-25T22:06:31.143491+0000","last_became_active":"2024-04-25T22:06:23.085799+0000","last_became_peered":"2024-04-25T22:06:23.085799+0000","last_unstale":"2024-04-25T22:06:31.143491+0000","last_undegraded":"2024-04-25T22:06:31.143491+0000","last_fullsized":"2024-04-25T22:06:31.143491+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:50.484372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21517,"num_write":342,"num_write_kb":66898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"75'449","reported_seq":546,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843127+0000","last_change":"2024-04-25T22:03:33.860386+0000","last_active":"2024-04-25T22:06:30.843127+0000","last_peered":"2024-04-25T22:06:30.843127+0000","last_clean":"2024-04-25T22:06:30.843127+0000","last_became_active":"2024-04-25T22:03:33.859539+0000","last_became_peered":"2024-04-25T22:03:33.859539+0000","last_unstale":"2024-04-25T22:06:30.843127+0000","last_undegraded":"2024-04-25T22:06:30.843127+0000","last_fullsized":"2024-04-25T22:06:30.843127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:20.247942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'399","reported_seq":613,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850961+0000","last_change":"2024-04-25T22:01:14.642718+0000","last_active":"2024-04-25T22:06:30.850961+0000","last_peered":"2024-04-25T22:06:30.850961+0000","last_clean":"2024-04-25T22:06:30.850961+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:06:30.850961+0000","last_undegraded":"2024-04-25T22:06:30.850961+0000","last_fullsized":"2024-04-25T22:06:30.850961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:09.988709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17888,"num_write":373,"num_write_kb":67556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":318,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140066+0000","last_change":"2024-04-25T22:06:23.082707+0000","last_active":"2024-04-25T22:06:31.140066+0000","last_peered":"2024-04-25T22:06:31.140066+0000","last_clean":"2024-04-25T22:06:31.140066+0000","last_became_active":"2024-04-25T22:06:23.080701+0000","last_became_peered":"2024-04-25T22:06:23.080701+0000","last_unstale":"2024-04-25T22:06:31.140066+0000","last_undegraded":"2024-04-25T22:06:31.140066+0000","last_fullsized":"2024-04-25T22:06:31.140066+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:27.088849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141705+0000","last_change":"2024-04-25T22:06:23.116373+0000","last_active":"2024-04-25T22:06:31.141705+0000","last_peered":"2024-04-25T22:06:31.141705+0000","last_clean":"2024-04-25T22:06:31.141705+0000","last_became_active":"2024-04-25T22:06:23.108984+0000","last_became_peered":"2024-04-25T22:06:23.108984+0000","last_unstale":"2024-04-25T22:06:31.141705+0000","last_undegraded":"2024-04-25T22:06:31.141705+0000","last_fullsized":"2024-04-25T22:06:31.141705+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:08.884723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"75'393","reported_seq":570,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849474+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:06:30.849474+0000","last_peered":"2024-04-25T22:06:30.849474+0000","last_clean":"2024-04-25T22:06:30.849474+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:06:30.849474+0000","last_undegraded":"2024-04-25T22:06:30.849474+0000","last_fullsized":"2024-04-25T22:06:30.849474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:17.528666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'463","reported_seq":668,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144389+0000","last_change":"2024-04-25T22:06:23.133028+0000","last_active":"2024-04-25T22:06:31.144389+0000","last_peered":"2024-04-25T22:06:31.144389+0000","last_clean":"2024-04-25T22:06:31.144389+0000","last_became_active":"2024-04-25T22:06:23.082756+0000","last_became_peered":"2024-04-25T22:06:23.082756+0000","last_unstale":"2024-04-25T22:06:31.144389+0000","last_undegraded":"2024-04-25T22:06:31.144389+0000","last_fullsized":"2024-04-25T22:06:31.144389+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:24:01.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29270,"num_write":426,"num_write_kb":129367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141100+0000","last_change":"2024-04-25T22:06:23.083451+0000","last_active":"2024-04-25T22:06:31.141100+0000","last_peered":"2024-04-25T22:06:31.141100+0000","last_clean":"2024-04-25T22:06:31.141100+0000","last_became_active":"2024-04-25T22:06:23.080841+0000","last_became_peered":"2024-04-25T22:06:23.080841+0000","last_unstale":"2024-04-25T22:06:31.141100+0000","last_undegraded":"2024-04-25T22:06:31.141100+0000","last_fullsized":"2024-04-25T22:06:31.141100+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:24:34.605367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"76'125","reported_seq":372,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849223+0000","last_change":"2024-04-25T22:06:22.804290+0000","last_active":"2024-04-25T22:06:30.849223+0000","last_peered":"2024-04-25T22:06:30.849223+0000","last_clean":"2024-04-25T22:06:30.849223+0000","last_became_active":"2024-04-25T22:06:22.801616+0000","last_became_peered":"2024-04-25T22:06:22.801616+0000","last_unstale":"2024-04-25T22:06:30.849223+0000","last_undegraded":"2024-04-25T22:06:30.849223+0000","last_fullsized":"2024-04-25T22:06:30.849223+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:13.402747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464197,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":63,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'457","reported_seq":646,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844136+0000","last_change":"2024-04-25T22:03:05.702224+0000","last_active":"2024-04-25T22:06:30.844136+0000","last_peered":"2024-04-25T22:06:30.844136+0000","last_clean":"2024-04-25T22:06:30.844136+0000","last_became_active":"2024-04-25T22:03:05.699581+0000","last_became_peered":"2024-04-25T22:03:05.699581+0000","last_unstale":"2024-04-25T22:06:30.844136+0000","last_undegraded":"2024-04-25T22:06:30.844136+0000","last_fullsized":"2024-04-25T22:06:30.844136+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:50.598395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":34759,"num_write":424,"num_write_kb":71902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849418+0000","last_change":"2024-04-25T22:01:09.581402+0000","last_active":"2024-04-25T22:06:30.849418+0000","last_peered":"2024-04-25T22:06:30.849418+0000","last_clean":"2024-04-25T22:06:30.849418+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:06:30.849418+0000","last_undegraded":"2024-04-25T22:06:30.849418+0000","last_fullsized":"2024-04-25T22:06:30.849418+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:04.699803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"75'311","reported_seq":496,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843037+0000","last_change":"2024-04-25T22:06:22.801481+0000","last_active":"2024-04-25T22:06:30.843037+0000","last_peered":"2024-04-25T22:06:30.843037+0000","last_clean":"2024-04-25T22:06:30.843037+0000","last_became_active":"2024-04-25T22:06:22.794841+0000","last_became_peered":"2024-04-25T22:06:22.794841+0000","last_unstale":"2024-04-25T22:06:30.843037+0000","last_undegraded":"2024-04-25T22:06:30.843037+0000","last_fullsized":"2024-04-25T22:06:30.843037+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:06:59.330924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"76'373","reported_seq":592,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851291+0000","last_change":"2024-04-25T22:01:14.639925+0000","last_active":"2024-04-25T22:06:30.851291+0000","last_peered":"2024-04-25T22:06:30.851291+0000","last_clean":"2024-04-25T22:06:30.851291+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:06:30.851291+0000","last_undegraded":"2024-04-25T22:06:30.851291+0000","last_fullsized":"2024-04-25T22:06:30.851291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:24.510525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28273,"num_write":350,"num_write_kb":87787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140545+0000","last_change":"2024-04-25T22:06:23.129162+0000","last_active":"2024-04-25T22:06:31.140545+0000","last_peered":"2024-04-25T22:06:31.140545+0000","last_clean":"2024-04-25T22:06:31.140545+0000","last_became_active":"2024-04-25T22:06:23.106155+0000","last_became_peered":"2024-04-25T22:06:23.106155+0000","last_unstale":"2024-04-25T22:06:31.140545+0000","last_undegraded":"2024-04-25T22:06:31.140545+0000","last_fullsized":"2024-04-25T22:06:31.140545+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:30.846068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"76'75","reported_seq":77,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161388+0000","last_change":"2024-04-25T22:06:31.161388+0000","last_active":"2024-04-25T22:06:31.161388+0000","last_peered":"2024-04-25T22:06:31.161388+0000","last_clean":"2024-04-25T22:06:31.161388+0000","last_became_active":"2024-04-25T22:06:31.150555+0000","last_became_peered":"2024-04-25T22:06:31.150555+0000","last_unstale":"2024-04-25T22:06:31.161388+0000","last_undegraded":"2024-04-25T22:06:31.161388+0000","last_fullsized":"2024-04-25T22:06:31.161388+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:56:50.706657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"76'461","reported_seq":753,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850519+0000","last_change":"2024-04-25T22:01:14.641712+0000","last_active":"2024-04-25T22:06:30.850519+0000","last_peered":"2024-04-25T22:06:30.850519+0000","last_clean":"2024-04-25T22:06:30.850519+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:06:30.850519+0000","last_undegraded":"2024-04-25T22:06:30.850519+0000","last_fullsized":"2024-04-25T22:06:30.850519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:13.128007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":67984,"num_write":425,"num_write_kb":154741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"76'268","reported_seq":425,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143156+0000","last_change":"2024-04-25T22:06:23.134306+0000","last_active":"2024-04-25T22:06:31.143156+0000","last_peered":"2024-04-25T22:06:31.143156+0000","last_clean":"2024-04-25T22:06:31.143156+0000","last_became_active":"2024-04-25T22:06:23.122629+0000","last_became_peered":"2024-04-25T22:06:23.122629+0000","last_unstale":"2024-04-25T22:06:31.143156+0000","last_undegraded":"2024-04-25T22:06:31.143156+0000","last_fullsized":"2024-04-25T22:06:31.143156+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:41.205934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850998+0000","last_change":"2024-04-25T22:01:09.580973+0000","last_active":"2024-04-25T22:06:30.850998+0000","last_peered":"2024-04-25T22:06:30.850998+0000","last_clean":"2024-04-25T22:06:30.850998+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:06:30.850998+0000","last_undegraded":"2024-04-25T22:06:30.850998+0000","last_fullsized":"2024-04-25T22:06:30.850998+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:46.354764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'398","reported_seq":578,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843743+0000","last_change":"2024-04-25T22:06:22.797468+0000","last_active":"2024-04-25T22:06:30.843743+0000","last_peered":"2024-04-25T22:06:30.843743+0000","last_clean":"2024-04-25T22:06:30.843743+0000","last_became_active":"2024-04-25T22:06:22.789384+0000","last_became_peered":"2024-04-25T22:06:22.789384+0000","last_unstale":"2024-04-25T22:06:30.843743+0000","last_undegraded":"2024-04-25T22:06:30.843743+0000","last_fullsized":"2024-04-25T22:06:30.843743+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:35.557386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":26599,"num_write":366,"num_write_kb":75612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"76'47","reported_seq":224,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850762+0000","last_change":"2024-04-25T22:01:13.617368+0000","last_active":"2024-04-25T22:06:30.850762+0000","last_peered":"2024-04-25T22:06:30.850762+0000","last_clean":"2024-04-25T22:06:30.850762+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:06:30.850762+0000","last_undegraded":"2024-04-25T22:06:30.850762+0000","last_fullsized":"2024-04-25T22:06:30.850762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:43.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":171,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845730+0000","last_change":"2024-04-25T22:03:05.701809+0000","last_active":"2024-04-25T22:06:30.845730+0000","last_peered":"2024-04-25T22:06:30.845730+0000","last_clean":"2024-04-25T22:06:30.845730+0000","last_became_active":"2024-04-25T22:03:05.701322+0000","last_became_peered":"2024-04-25T22:03:05.701322+0000","last_unstale":"2024-04-25T22:06:30.845730+0000","last_undegraded":"2024-04-25T22:06:30.845730+0000","last_fullsized":"2024-04-25T22:06:30.845730+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:45.907458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"76'406","reported_seq":642,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844251+0000","last_change":"2024-04-25T22:06:22.802683+0000","last_active":"2024-04-25T22:06:30.844251+0000","last_peered":"2024-04-25T22:06:30.844251+0000","last_clean":"2024-04-25T22:06:30.844251+0000","last_became_active":"2024-04-25T22:06:22.789807+0000","last_became_peered":"2024-04-25T22:06:22.789807+0000","last_unstale":"2024-04-25T22:06:30.844251+0000","last_undegraded":"2024-04-25T22:06:30.844251+0000","last_fullsized":"2024-04-25T22:06:30.844251+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:14:15.180532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25634,"num_write":377,"num_write_kb":103970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"76'64","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.852026+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:06:30.852026+0000","last_peered":"2024-04-25T22:06:30.852026+0000","last_clean":"2024-04-25T22:06:30.852026+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:06:30.852026+0000","last_undegraded":"2024-04-25T22:06:30.852026+0000","last_fullsized":"2024-04-25T22:06:30.852026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:19.431506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142483+0000","last_change":"2024-04-25T22:06:24.092672+0000","last_active":"2024-04-25T22:06:31.142483+0000","last_peered":"2024-04-25T22:06:31.142483+0000","last_clean":"2024-04-25T22:06:31.142483+0000","last_became_active":"2024-04-25T22:06:24.091909+0000","last_became_peered":"2024-04-25T22:06:24.091909+0000","last_unstale":"2024-04-25T22:06:31.142483+0000","last_undegraded":"2024-04-25T22:06:31.142483+0000","last_fullsized":"2024-04-25T22:06:31.142483+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:19:21.605435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"76'402","reported_seq":605,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848860+0000","last_change":"2024-04-25T22:06:22.809713+0000","last_active":"2024-04-25T22:06:30.848860+0000","last_peered":"2024-04-25T22:06:30.848860+0000","last_clean":"2024-04-25T22:06:30.848860+0000","last_became_active":"2024-04-25T22:06:22.802005+0000","last_became_peered":"2024-04-25T22:06:22.802005+0000","last_unstale":"2024-04-25T22:06:30.848860+0000","last_undegraded":"2024-04-25T22:06:30.848860+0000","last_fullsized":"2024-04-25T22:06:30.848860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9572,"num_write":361,"num_write_kb":29911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"77'127","reported_seq":311,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851852+0000","last_change":"2024-04-25T22:06:22.804851+0000","last_active":"2024-04-25T22:06:30.851852+0000","last_peered":"2024-04-25T22:06:30.851852+0000","last_clean":"2024-04-25T22:06:30.851852+0000","last_became_active":"2024-04-25T22:06:22.802083+0000","last_became_peered":"2024-04-25T22:06:22.802083+0000","last_unstale":"2024-04-25T22:06:30.851852+0000","last_undegraded":"2024-04-25T22:06:30.851852+0000","last_fullsized":"2024-04-25T22:06:30.851852+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:55:01.148608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142866+0000","last_change":"2024-04-25T22:06:23.081230+0000","last_active":"2024-04-25T22:06:31.142866+0000","last_peered":"2024-04-25T22:06:31.142866+0000","last_clean":"2024-04-25T22:06:31.142866+0000","last_became_active":"2024-04-25T22:06:23.080393+0000","last_became_peered":"2024-04-25T22:06:23.080393+0000","last_unstale":"2024-04-25T22:06:31.142866+0000","last_undegraded":"2024-04-25T22:06:31.142866+0000","last_fullsized":"2024-04-25T22:06:31.142866+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:55.157159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"76'415","reported_seq":596,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842908+0000","last_change":"2024-04-25T22:06:22.801327+0000","last_active":"2024-04-25T22:06:30.842908+0000","last_peered":"2024-04-25T22:06:30.842908+0000","last_clean":"2024-04-25T22:06:30.842908+0000","last_became_active":"2024-04-25T22:06:22.789624+0000","last_became_peered":"2024-04-25T22:06:22.789624+0000","last_unstale":"2024-04-25T22:06:30.842908+0000","last_undegraded":"2024-04-25T22:06:30.842908+0000","last_fullsized":"2024-04-25T22:06:30.842908+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:38.838140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27345,"num_write":384,"num_write_kb":92854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"76'407","reported_seq":623,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143259+0000","last_change":"2024-04-25T22:06:23.114739+0000","last_active":"2024-04-25T22:06:31.143259+0000","last_peered":"2024-04-25T22:06:31.143259+0000","last_clean":"2024-04-25T22:06:31.143259+0000","last_became_active":"2024-04-25T22:06:23.087118+0000","last_became_peered":"2024-04-25T22:06:23.087118+0000","last_unstale":"2024-04-25T22:06:31.143259+0000","last_undegraded":"2024-04-25T22:06:31.143259+0000","last_fullsized":"2024-04-25T22:06:31.143259+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:51.191212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33923,"num_write":372,"num_write_kb":82083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"77'260","reported_seq":420,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142062+0000","last_change":"2024-04-25T22:06:23.083331+0000","last_active":"2024-04-25T22:06:31.142062+0000","last_peered":"2024-04-25T22:06:31.142062+0000","last_clean":"2024-04-25T22:06:31.142062+0000","last_became_active":"2024-04-25T22:06:23.080552+0000","last_became_peered":"2024-04-25T22:06:23.080552+0000","last_unstale":"2024-04-25T22:06:31.142062+0000","last_undegraded":"2024-04-25T22:06:31.142062+0000","last_fullsized":"2024-04-25T22:06:31.142062+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:39:55.928212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8470619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"76'408","reported_seq":610,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848693+0000","last_change":"2024-04-25T22:01:14.643150+0000","last_active":"2024-04-25T22:06:30.848693+0000","last_peered":"2024-04-25T22:06:30.848693+0000","last_clean":"2024-04-25T22:06:30.848693+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:06:30.848693+0000","last_undegraded":"2024-04-25T22:06:30.848693+0000","last_fullsized":"2024-04-25T22:06:30.848693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:55.253021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14178,"num_write":370,"num_write_kb":58735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'104","reported_seq":289,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845584+0000","last_change":"2024-04-25T22:06:22.805389+0000","last_active":"2024-04-25T22:06:30.845584+0000","last_peered":"2024-04-25T22:06:30.845584+0000","last_clean":"2024-04-25T22:06:30.845584+0000","last_became_active":"2024-04-25T22:06:22.802667+0000","last_became_peered":"2024-04-25T22:06:22.802667+0000","last_unstale":"2024-04-25T22:06:30.845584+0000","last_undegraded":"2024-04-25T22:06:30.845584+0000","last_fullsized":"2024-04-25T22:06:30.845584+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:38.785650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"75'232","reported_seq":286,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.151793+0000","last_change":"2024-04-25T22:06:31.151793+0000","last_active":"2024-04-25T22:06:31.151793+0000","last_peered":"2024-04-25T22:06:31.151793+0000","last_clean":"2024-04-25T22:06:31.151793+0000","last_became_active":"2024-04-25T22:06:31.150582+0000","last_became_peered":"2024-04-25T22:06:31.150582+0000","last_unstale":"2024-04-25T22:06:31.151793+0000","last_undegraded":"2024-04-25T22:06:31.151793+0000","last_fullsized":"2024-04-25T22:06:31.151793+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:49.932959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"76'483","reported_seq":713,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848496+0000","last_change":"2024-04-25T22:06:22.814119+0000","last_active":"2024-04-25T22:06:30.848496+0000","last_peered":"2024-04-25T22:06:30.848496+0000","last_clean":"2024-04-25T22:06:30.848496+0000","last_became_active":"2024-04-25T22:06:22.807584+0000","last_became_peered":"2024-04-25T22:06:22.807584+0000","last_unstale":"2024-04-25T22:06:30.848496+0000","last_undegraded":"2024-04-25T22:06:30.848496+0000","last_fullsized":"2024-04-25T22:06:30.848496+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:08.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24709,"num_write":463,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"75'60","reported_seq":244,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851719+0000","last_change":"2024-04-25T22:06:22.802356+0000","last_active":"2024-04-25T22:06:30.851719+0000","last_peered":"2024-04-25T22:06:30.851719+0000","last_clean":"2024-04-25T22:06:30.851719+0000","last_became_active":"2024-04-25T22:06:22.801412+0000","last_became_peered":"2024-04-25T22:06:22.801412+0000","last_unstale":"2024-04-25T22:06:30.851719+0000","last_undegraded":"2024-04-25T22:06:30.851719+0000","last_fullsized":"2024-04-25T22:06:30.851719+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:04.421952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'444","reported_seq":648,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848562+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:06:30.848562+0000","last_peered":"2024-04-25T22:06:30.848562+0000","last_clean":"2024-04-25T22:06:30.848562+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:06:30.848562+0000","last_undegraded":"2024-04-25T22:06:30.848562+0000","last_fullsized":"2024-04-25T22:06:30.848562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:34.698220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14429,"num_write":416,"num_write_kb":59186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'355","reported_seq":499,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845399+0000","last_change":"2024-04-25T22:06:22.804579+0000","last_active":"2024-04-25T22:06:30.845399+0000","last_peered":"2024-04-25T22:06:30.845399+0000","last_clean":"2024-04-25T22:06:30.845399+0000","last_became_active":"2024-04-25T22:06:22.792886+0000","last_became_peered":"2024-04-25T22:06:22.792886+0000","last_unstale":"2024-04-25T22:06:30.845399+0000","last_undegraded":"2024-04-25T22:06:30.845399+0000","last_fullsized":"2024-04-25T22:06:30.845399+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:54:35.464321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18236,"num_write":332,"num_write_kb":42553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"76'742","reported_seq":919,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849150+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:06:30.849150+0000","last_peered":"2024-04-25T22:06:30.849150+0000","last_clean":"2024-04-25T22:06:30.849150+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:06:30.849150+0000","last_undegraded":"2024-04-25T22:06:30.849150+0000","last_fullsized":"2024-04-25T22:06:30.849150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:24.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'378","reported_seq":579,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851532+0000","last_change":"2024-04-25T22:06:22.813642+0000","last_active":"2024-04-25T22:06:30.851532+0000","last_peered":"2024-04-25T22:06:30.851532+0000","last_clean":"2024-04-25T22:06:30.851532+0000","last_became_active":"2024-04-25T22:06:22.806240+0000","last_became_peered":"2024-04-25T22:06:22.806240+0000","last_unstale":"2024-04-25T22:06:30.851532+0000","last_undegraded":"2024-04-25T22:06:30.851532+0000","last_fullsized":"2024-04-25T22:06:30.851532+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:16:47.642256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6876,"num_write":354,"num_write_kb":46840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"76'204","reported_seq":388,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848941+0000","last_change":"2024-04-25T22:06:22.805022+0000","last_active":"2024-04-25T22:06:30.848941+0000","last_peered":"2024-04-25T22:06:30.848941+0000","last_clean":"2024-04-25T22:06:30.848941+0000","last_became_active":"2024-04-25T22:06:22.801630+0000","last_became_peered":"2024-04-25T22:06:22.801630+0000","last_unstale":"2024-04-25T22:06:30.848941+0000","last_undegraded":"2024-04-25T22:06:30.848941+0000","last_fullsized":"2024-04-25T22:06:30.848941+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:07:34.554201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'377","reported_seq":515,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845146+0000","last_change":"2024-04-25T22:06:22.805011+0000","last_active":"2024-04-25T22:06:30.845146+0000","last_peered":"2024-04-25T22:06:30.845146+0000","last_clean":"2024-04-25T22:06:30.845146+0000","last_became_active":"2024-04-25T22:06:22.795334+0000","last_became_peered":"2024-04-25T22:06:22.795334+0000","last_unstale":"2024-04-25T22:06:30.845146+0000","last_undegraded":"2024-04-25T22:06:30.845146+0000","last_fullsized":"2024-04-25T22:06:30.845146+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:35.997378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6059,"num_write":332,"num_write_kb":37972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"76'217","reported_seq":332,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844027+0000","last_change":"2024-04-25T22:06:28.842258+0000","last_active":"2024-04-25T22:06:30.844027+0000","last_peered":"2024-04-25T22:06:30.844027+0000","last_clean":"2024-04-25T22:06:30.844027+0000","last_became_active":"2024-04-25T22:06:28.841447+0000","last_became_peered":"2024-04-25T22:06:28.841447+0000","last_unstale":"2024-04-25T22:06:30.844027+0000","last_undegraded":"2024-04-25T22:06:30.844027+0000","last_fullsized":"2024-04-25T22:06:30.844027+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:31.009167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"76'389","reported_seq":542,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844243+0000","last_change":"2024-04-25T22:03:33.862286+0000","last_active":"2024-04-25T22:06:30.844243+0000","last_peered":"2024-04-25T22:06:30.844243+0000","last_clean":"2024-04-25T22:06:30.844243+0000","last_became_active":"2024-04-25T22:03:33.860800+0000","last_became_peered":"2024-04-25T22:03:33.860800+0000","last_unstale":"2024-04-25T22:06:30.844243+0000","last_undegraded":"2024-04-25T22:06:30.844243+0000","last_fullsized":"2024-04-25T22:06:30.844243+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:04.528174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19110,"num_write":355,"num_write_kb":63152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'51","reported_seq":126,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844734+0000","last_change":"2024-04-25T22:06:22.804880+0000","last_active":"2024-04-25T22:06:30.844734+0000","last_peered":"2024-04-25T22:06:30.844734+0000","last_clean":"2024-04-25T22:06:30.844734+0000","last_became_active":"2024-04-25T22:06:22.803778+0000","last_became_peered":"2024-04-25T22:06:22.803778+0000","last_unstale":"2024-04-25T22:06:30.844734+0000","last_undegraded":"2024-04-25T22:06:30.844734+0000","last_fullsized":"2024-04-25T22:06:30.844734+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:47:58.480071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"76'386","reported_seq":483,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161983+0000","last_change":"2024-04-25T22:06:31.161983+0000","last_active":"2024-04-25T22:06:31.161983+0000","last_peered":"2024-04-25T22:06:31.161983+0000","last_clean":"2024-04-25T22:06:31.161983+0000","last_became_active":"2024-04-25T22:06:31.149995+0000","last_became_peered":"2024-04-25T22:06:31.149995+0000","last_unstale":"2024-04-25T22:06:31.161983+0000","last_undegraded":"2024-04-25T22:06:31.161983+0000","last_fullsized":"2024-04-25T22:06:31.161983+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:07:32.261028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14050,"num_write":362,"num_write_kb":58957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"76'188","reported_seq":231,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.159971+0000","last_change":"2024-04-25T22:06:31.159971+0000","last_active":"2024-04-25T22:06:31.159971+0000","last_peered":"2024-04-25T22:06:31.159971+0000","last_clean":"2024-04-25T22:06:31.159971+0000","last_became_active":"2024-04-25T22:06:31.148291+0000","last_became_peered":"2024-04-25T22:06:31.148291+0000","last_unstale":"2024-04-25T22:06:31.159971+0000","last_undegraded":"2024-04-25T22:06:31.159971+0000","last_fullsized":"2024-04-25T22:06:31.159971+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:31.095798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"76'397","reported_seq":494,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.160300+0000","last_change":"2024-04-25T22:06:31.160300+0000","last_active":"2024-04-25T22:06:31.160300+0000","last_peered":"2024-04-25T22:06:31.160300+0000","last_clean":"2024-04-25T22:06:31.160300+0000","last_became_active":"2024-04-25T22:06:31.148445+0000","last_became_peered":"2024-04-25T22:06:31.148445+0000","last_unstale":"2024-04-25T22:06:31.160300+0000","last_undegraded":"2024-04-25T22:06:31.160300+0000","last_fullsized":"2024-04-25T22:06:31.160300+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:31.697126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13280,"num_write":364,"num_write_kb":46108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"75'284","reported_seq":414,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845419+0000","last_change":"2024-04-25T22:06:22.804561+0000","last_active":"2024-04-25T22:06:30.845419+0000","last_peered":"2024-04-25T22:06:30.845419+0000","last_clean":"2024-04-25T22:06:30.845419+0000","last_became_active":"2024-04-25T22:06:22.794078+0000","last_became_peered":"2024-04-25T22:06:22.794078+0000","last_unstale":"2024-04-25T22:06:30.845419+0000","last_undegraded":"2024-04-25T22:06:30.845419+0000","last_fullsized":"2024-04-25T22:06:30.845419+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:54:07.939379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":12398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"76'412","reported_seq":538,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843652+0000","last_change":"2024-04-25T22:03:33.864136+0000","last_active":"2024-04-25T22:06:30.843652+0000","last_peered":"2024-04-25T22:06:30.843652+0000","last_clean":"2024-04-25T22:06:30.843652+0000","last_became_active":"2024-04-25T22:03:33.862435+0000","last_became_peered":"2024-04-25T22:03:33.862435+0000","last_unstale":"2024-04-25T22:06:30.843652+0000","last_undegraded":"2024-04-25T22:06:30.843652+0000","last_fullsized":"2024-04-25T22:06:30.843652+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:08.119964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":1478,"num_write":377,"num_write_kb":34422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"76'127","reported_seq":304,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851488+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:06:30.851488+0000","last_peered":"2024-04-25T22:06:30.851488+0000","last_clean":"2024-04-25T22:06:30.851488+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:06:30.851488+0000","last_undegraded":"2024-04-25T22:06:30.851488+0000","last_fullsized":"2024-04-25T22:06:30.851488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:38:17.190618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'444","reported_seq":646,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141302+0000","last_change":"2024-04-25T22:06:23.132900+0000","last_active":"2024-04-25T22:06:31.141302+0000","last_peered":"2024-04-25T22:06:31.141302+0000","last_clean":"2024-04-25T22:06:31.141302+0000","last_became_active":"2024-04-25T22:06:23.097535+0000","last_became_peered":"2024-04-25T22:06:23.097535+0000","last_unstale":"2024-04-25T22:06:31.141302+0000","last_undegraded":"2024-04-25T22:06:31.141302+0000","last_fullsized":"2024-04-25T22:06:31.141302+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:30:55.243414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31576,"num_write":414,"num_write_kb":70915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"75'46","reported_seq":230,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851416+0000","last_change":"2024-04-25T22:06:22.802843+0000","last_active":"2024-04-25T22:06:30.851416+0000","last_peered":"2024-04-25T22:06:30.851416+0000","last_clean":"2024-04-25T22:06:30.851416+0000","last_became_active":"2024-04-25T22:06:22.801910+0000","last_became_peered":"2024-04-25T22:06:22.801910+0000","last_unstale":"2024-04-25T22:06:30.851416+0000","last_undegraded":"2024-04-25T22:06:30.851416+0000","last_fullsized":"2024-04-25T22:06:30.851416+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:23.004530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2665,"num_read_kb":1338898,"num_write":24540,"num_write_kb":4276910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26558,"ondisk_log_size":26558,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127376126,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":4662,"num_write_kb":127830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":71499776,"data_stored":254752252,"data_compressed":21836190,"data_compressed_allocated":35307520,"data_compressed_original":218619904,"omap_allocated":136586,"internal_metadata":0},"log_size":6446,"ondisk_log_size":6446,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738443,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99732,"kb_used_data":24200,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272108,"statfs":{"total":96636764160,"available":96534638592,"internally_reserved":0,"allocated":24780800,"data_stored":84964150,"data_compressed":7036839,"data_compressed_allocated":11431936,"data_compressed_original":72118272,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738442,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99436,"kb_used_data":23896,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272404,"statfs":{"total":96636764160,"available":96534941696,"internally_reserved":0,"allocated":24469504,"data_stored":81562098,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":90,"seq":386547056646,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58112,"kb_used_data":24432,"kb_used_omap":134,"kb_used_meta":33529,"kb_avail":94313728,"statfs":{"total":96636764160,"available":96577257472,"internally_reserved":0,"allocated":25018368,"data_stored":90623267,"data_compressed":7819212,"data_compressed_allocated":12599296,"data_compressed_original":78716928,"omap_allocated":138181,"internal_metadata":34333755},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24076288,"data_stored":89627390,"data_compressed":7811005,"data_compressed_allocated":12562432,"data_compressed_original":78143488,"omap_allocated":136586,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23584768,"data_stored":81156589,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23838720,"data_stored":83968273,"data_compressed":7028632,"data_compressed_allocated":11395072,"data_compressed_original":71544832,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:06:45.816 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.816 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.816 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.816 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.817 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.817 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.817 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.817 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.817 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.817 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.817 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.817 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.817 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.817 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.818 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.818 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.818 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.818 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.818 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.818 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.818 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.818 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.818 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.819 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.819 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.819 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.819 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.819 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.819 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.819 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.819 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.820 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.820 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.820 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.820 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.821 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.821 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.821 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.821 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.821 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.821 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.821 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.821 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.822 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.822 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.822 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.822 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.822 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.822 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.822 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.822 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.822 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.823 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.823 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.823 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.823 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.823 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T22:01:04.434759+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.823 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T22:01:08.550431+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.823 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.823 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.823 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T22:01:08.550431+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.823 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.824 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.824 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T22:01:08.550431+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.824 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.824 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.824 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T22:01:08.550431+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.824 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.824 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.824 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.824 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T22:01:08.550431+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.825 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.825 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.825 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T22:01:08.550431+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.825 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.825 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.825 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T22:01:08.550431+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.825 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.825 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.825 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T22:01:08.550431+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.825 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.826 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.826 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.826 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.827 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.827 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.827 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.827 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.827 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.827 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.827 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.827 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.827 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.828 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.828 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.828 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.828 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.828 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.828 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.828 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.828 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.828 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.829 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.829 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.829 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:06:45.829 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T22:07:05.830 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:07:06.159 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:07:06.161 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:07:06.178 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-04-25T22:07:05.700394+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127966494,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2864,"num_read_kb":1340487,"num_write":29405,"num_write_kb":4408200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33185,"ondisk_log_size":33185,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":261416,"kb_used_data":72528,"kb_used_omap":138,"kb_used_meta":188725,"kb_avail":282854104,"statfs":{"total":289910292480,"available":289642602496,"internally_reserved":0,"allocated":74268672,"data_stored":257149515,"data_compressed":21852604,"data_compressed_allocated":35381248,"data_compressed_original":219766784,"omap_allocated":141371,"internal_metadata":193255365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004825"},"pg_stats":[{"pgid":"4.3f","version":"76'446","reported_seq":613,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:00.253297+0000","last_change":"2024-04-25T22:07:00.253360+0000","last_active":"2024-04-25T22:07:00.253297+0000","last_peered":"2024-04-25T22:07:00.253297+0000","last_clean":"2024-04-25T22:07:00.253297+0000","last_became_active":"2024-04-25T22:03:33.873739+0000","last_became_peered":"2024-04-25T22:03:33.873739+0000","last_unstale":"2024-04-25T22:07:00.253297+0000","last_undegraded":"2024-04-25T22:07:00.253297+0000","last_fullsized":"2024-04-25T22:07:00.253297+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'446","last_scrub_stamp":"2024-04-25T22:07:00.253077+0000","last_deep_scrub":"76'446","last_deep_scrub_stamp":"2024-04-25T22:07:00.253077+0000","last_clean_scrub_stamp":"2024-04-25T22:07:00.253077+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:21:55.527885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29432,"num_write":407,"num_write_kb":84235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"76'417","reported_seq":571,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844446+0000","last_change":"2024-04-25T22:03:33.861269+0000","last_active":"2024-04-25T22:06:30.844446+0000","last_peered":"2024-04-25T22:06:30.844446+0000","last_clean":"2024-04-25T22:06:30.844446+0000","last_became_active":"2024-04-25T22:03:33.859221+0000","last_became_peered":"2024-04-25T22:03:33.859221+0000","last_unstale":"2024-04-25T22:06:30.844446+0000","last_undegraded":"2024-04-25T22:06:30.844446+0000","last_fullsized":"2024-04-25T22:06:30.844446+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":23541,"num_write":389,"num_write_kb":87654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"76'389","reported_seq":559,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.163287+0000","last_change":"2024-04-25T22:06:31.162002+0000","last_active":"2024-04-25T22:06:31.163287+0000","last_peered":"2024-04-25T22:06:31.163287+0000","last_clean":"2024-04-25T22:06:31.163287+0000","last_became_active":"2024-04-25T22:06:31.149675+0000","last_became_peered":"2024-04-25T22:06:31.149675+0000","last_unstale":"2024-04-25T22:06:31.163287+0000","last_undegraded":"2024-04-25T22:06:31.163287+0000","last_fullsized":"2024-04-25T22:06:31.163287+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22311,"num_write":361,"num_write_kb":42975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"76'394","reported_seq":597,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:00.293435+0000","last_change":"2024-04-25T22:07:00.293493+0000","last_active":"2024-04-25T22:07:00.293435+0000","last_peered":"2024-04-25T22:07:00.293435+0000","last_clean":"2024-04-25T22:07:00.293435+0000","last_became_active":"2024-04-25T22:06:23.090780+0000","last_became_peered":"2024-04-25T22:06:23.090780+0000","last_unstale":"2024-04-25T22:07:00.293435+0000","last_undegraded":"2024-04-25T22:07:00.293435+0000","last_fullsized":"2024-04-25T22:07:00.293435+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'394","last_scrub_stamp":"2024-04-25T22:07:00.293232+0000","last_deep_scrub":"76'394","last_deep_scrub_stamp":"2024-04-25T22:07:00.293232+0000","last_clean_scrub_stamp":"2024-04-25T22:07:00.293232+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:44.908041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":20785,"num_write":367,"num_write_kb":63746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"76'429","reported_seq":941,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844497+0000","last_change":"2024-04-25T22:06:28.839715+0000","last_active":"2024-04-25T22:06:30.844497+0000","last_peered":"2024-04-25T22:06:30.844497+0000","last_clean":"2024-04-25T22:06:30.844497+0000","last_became_active":"2024-04-25T22:06:28.836687+0000","last_became_peered":"2024-04-25T22:06:28.836687+0000","last_unstale":"2024-04-25T22:06:30.844497+0000","last_undegraded":"2024-04-25T22:06:30.844497+0000","last_fullsized":"2024-04-25T22:06:30.844497+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":20896,"num_write":403,"num_write_kb":100255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"76'368","reported_seq":551,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:59.333242+0000","last_change":"2024-04-25T22:06:59.333306+0000","last_active":"2024-04-25T22:06:59.333242+0000","last_peered":"2024-04-25T22:06:59.333242+0000","last_clean":"2024-04-25T22:06:59.333242+0000","last_became_active":"2024-04-25T22:06:23.107939+0000","last_became_peered":"2024-04-25T22:06:23.107939+0000","last_unstale":"2024-04-25T22:06:59.333242+0000","last_undegraded":"2024-04-25T22:06:59.333242+0000","last_fullsized":"2024-04-25T22:06:59.333242+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'368","last_scrub_stamp":"2024-04-25T22:06:59.333035+0000","last_deep_scrub":"76'368","last_deep_scrub_stamp":"2024-04-25T22:06:59.333035+0000","last_clean_scrub_stamp":"2024-04-25T22:06:59.333035+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:57.414174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9362,"num_write":344,"num_write_kb":20831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"76'438","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:58.303992+0000","last_change":"2024-04-25T22:06:58.304135+0000","last_active":"2024-04-25T22:06:58.303992+0000","last_peered":"2024-04-25T22:06:58.303992+0000","last_clean":"2024-04-25T22:06:58.303992+0000","last_became_active":"2024-04-25T22:06:23.098436+0000","last_became_peered":"2024-04-25T22:06:23.098436+0000","last_unstale":"2024-04-25T22:06:58.303992+0000","last_undegraded":"2024-04-25T22:06:58.303992+0000","last_fullsized":"2024-04-25T22:06:58.303992+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'438","last_scrub_stamp":"2024-04-25T22:06:58.303753+0000","last_deep_scrub":"76'438","last_deep_scrub_stamp":"2024-04-25T22:06:58.303753+0000","last_clean_scrub_stamp":"2024-04-25T22:06:58.303753+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:21.625267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25961,"num_write":415,"num_write_kb":72541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'392","reported_seq":611,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:56.232947+0000","last_change":"2024-04-25T22:06:56.233003+0000","last_active":"2024-04-25T22:06:56.232947+0000","last_peered":"2024-04-25T22:06:56.232947+0000","last_clean":"2024-04-25T22:06:56.232947+0000","last_became_active":"2024-04-25T22:06:23.091431+0000","last_became_peered":"2024-04-25T22:06:23.091431+0000","last_unstale":"2024-04-25T22:06:56.232947+0000","last_undegraded":"2024-04-25T22:06:56.232947+0000","last_fullsized":"2024-04-25T22:06:56.232947+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-25T22:06:56.232744+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-25T22:06:56.232744+0000","last_clean_scrub_stamp":"2024-04-25T22:06:56.232744+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:40.030831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":24749,"num_write":354,"num_write_kb":64232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"76'443","reported_seq":660,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:45.368357+0000","last_change":"2024-04-25T22:06:45.368420+0000","last_active":"2024-04-25T22:06:45.368357+0000","last_peered":"2024-04-25T22:06:45.368357+0000","last_clean":"2024-04-25T22:06:45.368357+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:06:45.368357+0000","last_undegraded":"2024-04-25T22:06:45.368357+0000","last_fullsized":"2024-04-25T22:06:45.368357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'443","last_scrub_stamp":"2024-04-25T22:06:45.368156+0000","last_deep_scrub":"76'443","last_deep_scrub_stamp":"2024-04-25T22:06:45.368156+0000","last_clean_scrub_stamp":"2024-04-25T22:06:45.368156+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:07.796649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":10648,"num_write":411,"num_write_kb":92932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'392","reported_seq":520,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:46.196468+0000","last_change":"2024-04-25T22:06:46.196532+0000","last_active":"2024-04-25T22:06:46.196468+0000","last_peered":"2024-04-25T22:06:46.196468+0000","last_clean":"2024-04-25T22:06:46.196468+0000","last_became_active":"2024-04-25T22:06:26.114463+0000","last_became_peered":"2024-04-25T22:06:26.114463+0000","last_unstale":"2024-04-25T22:06:46.196468+0000","last_undegraded":"2024-04-25T22:06:46.196468+0000","last_fullsized":"2024-04-25T22:06:46.196468+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-25T22:06:46.196270+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-25T22:06:46.196270+0000","last_clean_scrub_stamp":"2024-04-25T22:06:46.196270+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:57:43.306329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10696,"num_write":359,"num_write_kb":63259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'391","reported_seq":578,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:49.260343+0000","last_change":"2024-04-25T22:06:49.260414+0000","last_active":"2024-04-25T22:06:49.260343+0000","last_peered":"2024-04-25T22:06:49.260343+0000","last_clean":"2024-04-25T22:06:49.260343+0000","last_became_active":"2024-04-25T22:06:23.123801+0000","last_became_peered":"2024-04-25T22:06:23.123801+0000","last_unstale":"2024-04-25T22:06:49.260343+0000","last_undegraded":"2024-04-25T22:06:49.260343+0000","last_fullsized":"2024-04-25T22:06:49.260343+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'391","last_scrub_stamp":"2024-04-25T22:06:49.260130+0000","last_deep_scrub":"76'391","last_deep_scrub_stamp":"2024-04-25T22:06:49.260130+0000","last_clean_scrub_stamp":"2024-04-25T22:06:49.260130+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:42:51.390054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11259,"num_write":372,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"76'365","reported_seq":656,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:55.308601+0000","last_change":"2024-04-25T22:06:55.308732+0000","last_active":"2024-04-25T22:06:55.308601+0000","last_peered":"2024-04-25T22:06:55.308601+0000","last_clean":"2024-04-25T22:06:55.308601+0000","last_became_active":"2024-04-25T22:06:22.792880+0000","last_became_peered":"2024-04-25T22:06:22.792880+0000","last_unstale":"2024-04-25T22:06:55.308601+0000","last_undegraded":"2024-04-25T22:06:55.308601+0000","last_fullsized":"2024-04-25T22:06:55.308601+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'365","last_scrub_stamp":"2024-04-25T22:06:55.308350+0000","last_deep_scrub":"76'365","last_deep_scrub_stamp":"2024-04-25T22:06:55.308350+0000","last_clean_scrub_stamp":"2024-04-25T22:06:55.308350+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:27:30.240705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":51972,"num_write":340,"num_write_kb":51203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"76'420","reported_seq":583,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:02.284192+0000","last_change":"2024-04-25T22:07:02.284254+0000","last_active":"2024-04-25T22:07:02.284192+0000","last_peered":"2024-04-25T22:07:02.284192+0000","last_clean":"2024-04-25T22:07:02.284192+0000","last_became_active":"2024-04-25T22:03:33.859376+0000","last_became_peered":"2024-04-25T22:03:33.859376+0000","last_unstale":"2024-04-25T22:07:02.284192+0000","last_undegraded":"2024-04-25T22:07:02.284192+0000","last_fullsized":"2024-04-25T22:07:02.284192+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'420","last_scrub_stamp":"2024-04-25T22:07:02.283992+0000","last_deep_scrub":"76'420","last_deep_scrub_stamp":"2024-04-25T22:07:02.283992+0000","last_clean_scrub_stamp":"2024-04-25T22:07:02.283992+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:50:55.188773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17620,"num_write":386,"num_write_kb":100613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"76'432","reported_seq":640,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:54.219993+0000","last_change":"2024-04-25T22:06:54.220062+0000","last_active":"2024-04-25T22:06:54.219993+0000","last_peered":"2024-04-25T22:06:54.219993+0000","last_clean":"2024-04-25T22:06:54.219993+0000","last_became_active":"2024-04-25T22:06:23.081466+0000","last_became_peered":"2024-04-25T22:06:23.081466+0000","last_unstale":"2024-04-25T22:06:54.219993+0000","last_undegraded":"2024-04-25T22:06:54.219993+0000","last_fullsized":"2024-04-25T22:06:54.219993+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'432","last_scrub_stamp":"2024-04-25T22:06:54.219768+0000","last_deep_scrub":"76'432","last_deep_scrub_stamp":"2024-04-25T22:06:54.219768+0000","last_clean_scrub_stamp":"2024-04-25T22:06:54.219768+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:09:43.916848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27327,"num_write":398,"num_write_kb":76113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"76'385","reported_seq":585,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141022+0000","last_change":"2024-04-25T22:06:23.116284+0000","last_active":"2024-04-25T22:06:31.141022+0000","last_peered":"2024-04-25T22:06:31.141022+0000","last_clean":"2024-04-25T22:06:31.141022+0000","last_became_active":"2024-04-25T22:06:23.088046+0000","last_became_peered":"2024-04-25T22:06:23.088046+0000","last_unstale":"2024-04-25T22:06:31.141022+0000","last_undegraded":"2024-04-25T22:06:31.141022+0000","last_fullsized":"2024-04-25T22:06:31.141022+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23986,"num_write":352,"num_write_kb":50754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"76'434","reported_seq":616,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141564+0000","last_change":"2024-04-25T22:06:23.132996+0000","last_active":"2024-04-25T22:06:31.141564+0000","last_peered":"2024-04-25T22:06:31.141564+0000","last_clean":"2024-04-25T22:06:31.141564+0000","last_became_active":"2024-04-25T22:06:23.117497+0000","last_became_peered":"2024-04-25T22:06:23.117497+0000","last_unstale":"2024-04-25T22:06:31.141564+0000","last_undegraded":"2024-04-25T22:06:31.141564+0000","last_fullsized":"2024-04-25T22:06:31.141564+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":13806,"num_write":403,"num_write_kb":38995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"76'444","reported_seq":667,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:52.384689+0000","last_change":"2024-04-25T22:06:52.384748+0000","last_active":"2024-04-25T22:06:52.384689+0000","last_peered":"2024-04-25T22:06:52.384689+0000","last_clean":"2024-04-25T22:06:52.384689+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:06:52.384689+0000","last_undegraded":"2024-04-25T22:06:52.384689+0000","last_fullsized":"2024-04-25T22:06:52.384689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'444","last_scrub_stamp":"2024-04-25T22:06:52.384489+0000","last_deep_scrub":"76'444","last_deep_scrub_stamp":"2024-04-25T22:06:52.384489+0000","last_clean_scrub_stamp":"2024-04-25T22:06:52.384489+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:55:00.266704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":11085,"num_write":416,"num_write_kb":68377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'396","reported_seq":532,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844720+0000","last_change":"2024-04-25T22:03:33.862762+0000","last_active":"2024-04-25T22:06:30.844720+0000","last_peered":"2024-04-25T22:06:30.844720+0000","last_clean":"2024-04-25T22:06:30.844720+0000","last_became_active":"2024-04-25T22:03:33.861082+0000","last_became_peered":"2024-04-25T22:03:33.861082+0000","last_unstale":"2024-04-25T22:06:30.844720+0000","last_undegraded":"2024-04-25T22:06:30.844720+0000","last_fullsized":"2024-04-25T22:06:30.844720+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6581,"num_write":355,"num_write_kb":34159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"76'447","reported_seq":657,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:50.360046+0000","last_change":"2024-04-25T22:06:50.360103+0000","last_active":"2024-04-25T22:06:50.360046+0000","last_peered":"2024-04-25T22:06:50.360046+0000","last_clean":"2024-04-25T22:06:50.360046+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:06:50.360046+0000","last_undegraded":"2024-04-25T22:06:50.360046+0000","last_fullsized":"2024-04-25T22:06:50.360046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'447","last_scrub_stamp":"2024-04-25T22:06:50.359882+0000","last_deep_scrub":"76'447","last_deep_scrub_stamp":"2024-04-25T22:06:50.359882+0000","last_clean_scrub_stamp":"2024-04-25T22:06:50.359882+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:26.034007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22089,"num_write":411,"num_write_kb":104750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'426","reported_seq":605,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144305+0000","last_change":"2024-04-25T22:06:23.122769+0000","last_active":"2024-04-25T22:06:31.144305+0000","last_peered":"2024-04-25T22:06:31.144305+0000","last_clean":"2024-04-25T22:06:31.144305+0000","last_became_active":"2024-04-25T22:06:23.093379+0000","last_became_peered":"2024-04-25T22:06:23.093379+0000","last_unstale":"2024-04-25T22:06:31.144305+0000","last_undegraded":"2024-04-25T22:06:31.144305+0000","last_fullsized":"2024-04-25T22:06:31.144305+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11886,"num_write":398,"num_write_kb":55010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"76'405","reported_seq":611,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:57.281296+0000","last_change":"2024-04-25T22:06:57.281355+0000","last_active":"2024-04-25T22:06:57.281296+0000","last_peered":"2024-04-25T22:06:57.281296+0000","last_clean":"2024-04-25T22:06:57.281296+0000","last_became_active":"2024-04-25T22:06:23.110101+0000","last_became_peered":"2024-04-25T22:06:23.110101+0000","last_unstale":"2024-04-25T22:06:57.281296+0000","last_undegraded":"2024-04-25T22:06:57.281296+0000","last_fullsized":"2024-04-25T22:06:57.281296+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'405","last_scrub_stamp":"2024-04-25T22:06:57.281099+0000","last_deep_scrub":"76'405","last_deep_scrub_stamp":"2024-04-25T22:06:57.281099+0000","last_clean_scrub_stamp":"2024-04-25T22:06:57.281099+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:07:32.749764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23004,"num_write":370,"num_write_kb":75802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'436","reported_seq":560,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843507+0000","last_change":"2024-04-25T22:06:28.838562+0000","last_active":"2024-04-25T22:06:30.843507+0000","last_peered":"2024-04-25T22:06:30.843507+0000","last_clean":"2024-04-25T22:06:30.843507+0000","last_became_active":"2024-04-25T22:06:28.835081+0000","last_became_peered":"2024-04-25T22:06:28.835081+0000","last_unstale":"2024-04-25T22:06:30.843507+0000","last_undegraded":"2024-04-25T22:06:30.843507+0000","last_fullsized":"2024-04-25T22:06:30.843507+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11950,"num_write":408,"num_write_kb":67524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"76'403","reported_seq":608,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.847852+0000","last_change":"2024-04-25T22:06:22.810930+0000","last_active":"2024-04-25T22:06:30.847852+0000","last_peered":"2024-04-25T22:06:30.847852+0000","last_clean":"2024-04-25T22:06:30.847852+0000","last_became_active":"2024-04-25T22:06:22.802907+0000","last_became_peered":"2024-04-25T22:06:22.802907+0000","last_unstale":"2024-04-25T22:06:30.847852+0000","last_undegraded":"2024-04-25T22:06:30.847852+0000","last_fullsized":"2024-04-25T22:06:30.847852+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":6507,"num_write":370,"num_write_kb":51513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'449","reported_seq":575,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.842828+0000","last_change":"2024-04-25T22:06:28.846531+0000","last_active":"2024-04-25T22:06:30.842828+0000","last_peered":"2024-04-25T22:06:30.842828+0000","last_clean":"2024-04-25T22:06:30.842828+0000","last_became_active":"2024-04-25T22:06:28.841283+0000","last_became_peered":"2024-04-25T22:06:28.841283+0000","last_unstale":"2024-04-25T22:06:30.842828+0000","last_undegraded":"2024-04-25T22:06:30.842828+0000","last_fullsized":"2024-04-25T22:06:30.842828+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27047,"num_write":417,"num_write_kb":63386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"76'406","reported_seq":580,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:47.323560+0000","last_change":"2024-04-25T22:06:47.323681+0000","last_active":"2024-04-25T22:06:47.323560+0000","last_peered":"2024-04-25T22:06:47.323560+0000","last_clean":"2024-04-25T22:06:47.323560+0000","last_became_active":"2024-04-25T22:06:22.791470+0000","last_became_peered":"2024-04-25T22:06:22.791470+0000","last_unstale":"2024-04-25T22:06:47.323560+0000","last_undegraded":"2024-04-25T22:06:47.323560+0000","last_fullsized":"2024-04-25T22:06:47.323560+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'406","last_scrub_stamp":"2024-04-25T22:06:47.323329+0000","last_deep_scrub":"76'406","last_deep_scrub_stamp":"2024-04-25T22:06:47.323329+0000","last_clean_scrub_stamp":"2024-04-25T22:06:47.323329+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:01:33.331665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25550,"num_write":386,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"76'485","reported_seq":736,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851085+0000","last_change":"2024-04-25T22:06:22.814124+0000","last_active":"2024-04-25T22:06:30.851085+0000","last_peered":"2024-04-25T22:06:30.851085+0000","last_clean":"2024-04-25T22:06:30.851085+0000","last_became_active":"2024-04-25T22:06:22.804228+0000","last_became_peered":"2024-04-25T22:06:22.804228+0000","last_unstale":"2024-04-25T22:06:30.851085+0000","last_undegraded":"2024-04-25T22:06:30.851085+0000","last_fullsized":"2024-04-25T22:06:30.851085+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":30714,"num_write":444,"num_write_kb":92836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'387","reported_seq":601,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:50.226297+0000","last_change":"2024-04-25T22:06:50.226374+0000","last_active":"2024-04-25T22:06:50.226297+0000","last_peered":"2024-04-25T22:06:50.226297+0000","last_clean":"2024-04-25T22:06:50.226297+0000","last_became_active":"2024-04-25T22:06:23.121334+0000","last_became_peered":"2024-04-25T22:06:23.121334+0000","last_unstale":"2024-04-25T22:06:50.226297+0000","last_undegraded":"2024-04-25T22:06:50.226297+0000","last_fullsized":"2024-04-25T22:06:50.226297+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'387","last_scrub_stamp":"2024-04-25T22:06:50.226077+0000","last_deep_scrub":"76'387","last_deep_scrub_stamp":"2024-04-25T22:06:50.226077+0000","last_clean_scrub_stamp":"2024-04-25T22:06:50.226077+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:18.695143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21644,"num_write":354,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"76'405","reported_seq":650,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844981+0000","last_change":"2024-04-25T22:06:22.829889+0000","last_active":"2024-04-25T22:06:30.844981+0000","last_peered":"2024-04-25T22:06:30.844981+0000","last_clean":"2024-04-25T22:06:30.844981+0000","last_became_active":"2024-04-25T22:06:22.827066+0000","last_became_peered":"2024-04-25T22:06:22.827066+0000","last_unstale":"2024-04-25T22:06:30.844981+0000","last_undegraded":"2024-04-25T22:06:30.844981+0000","last_fullsized":"2024-04-25T22:06:30.844981+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27522,"num_write":375,"num_write_kb":96416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"76'396","reported_seq":628,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:00.268722+0000","last_change":"2024-04-25T22:07:00.268789+0000","last_active":"2024-04-25T22:07:00.268722+0000","last_peered":"2024-04-25T22:07:00.268722+0000","last_clean":"2024-04-25T22:07:00.268722+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:07:00.268722+0000","last_undegraded":"2024-04-25T22:07:00.268722+0000","last_fullsized":"2024-04-25T22:07:00.268722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'396","last_scrub_stamp":"2024-04-25T22:07:00.268515+0000","last_deep_scrub":"76'396","last_deep_scrub_stamp":"2024-04-25T22:07:00.268515+0000","last_clean_scrub_stamp":"2024-04-25T22:07:00.268515+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:23.333678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28501,"num_write":367,"num_write_kb":63458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":663,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:53.312799+0000","last_change":"2024-04-25T22:06:53.312857+0000","last_active":"2024-04-25T22:06:53.312799+0000","last_peered":"2024-04-25T22:06:53.312799+0000","last_clean":"2024-04-25T22:06:53.312799+0000","last_became_active":"2024-04-25T22:06:22.789907+0000","last_became_peered":"2024-04-25T22:06:22.789907+0000","last_unstale":"2024-04-25T22:06:53.312799+0000","last_undegraded":"2024-04-25T22:06:53.312799+0000","last_fullsized":"2024-04-25T22:06:53.312799+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'467","last_scrub_stamp":"2024-04-25T22:06:53.312600+0000","last_deep_scrub":"76'467","last_deep_scrub_stamp":"2024-04-25T22:06:53.312600+0000","last_clean_scrub_stamp":"2024-04-25T22:06:53.312600+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:25:54.392796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":20717,"num_write":435,"num_write_kb":55985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"76'444","reported_seq":656,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:56.323884+0000","last_change":"2024-04-25T22:06:56.323943+0000","last_active":"2024-04-25T22:06:56.323884+0000","last_peered":"2024-04-25T22:06:56.323884+0000","last_clean":"2024-04-25T22:06:56.323884+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:06:56.323884+0000","last_undegraded":"2024-04-25T22:06:56.323884+0000","last_fullsized":"2024-04-25T22:06:56.323884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'444","last_scrub_stamp":"2024-04-25T22:06:56.323664+0000","last_deep_scrub":"76'444","last_deep_scrub_stamp":"2024-04-25T22:06:56.323664+0000","last_clean_scrub_stamp":"2024-04-25T22:06:56.323664+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:25:57.403859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":10758,"num_write":401,"num_write_kb":44705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'422","reported_seq":534,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.162521+0000","last_change":"2024-04-25T22:06:31.160927+0000","last_active":"2024-04-25T22:06:31.162521+0000","last_peered":"2024-04-25T22:06:31.162521+0000","last_clean":"2024-04-25T22:06:31.162521+0000","last_became_active":"2024-04-25T22:06:31.148129+0000","last_became_peered":"2024-04-25T22:06:31.148129+0000","last_unstale":"2024-04-25T22:06:31.162521+0000","last_undegraded":"2024-04-25T22:06:31.162521+0000","last_fullsized":"2024-04-25T22:06:31.162521+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":29059,"num_write":391,"num_write_kb":40233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"76'397","reported_seq":895,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844684+0000","last_change":"2024-04-25T22:06:26.819859+0000","last_active":"2024-04-25T22:06:30.844684+0000","last_peered":"2024-04-25T22:06:30.844684+0000","last_clean":"2024-04-25T22:06:30.844684+0000","last_became_active":"2024-04-25T22:06:26.816439+0000","last_became_peered":"2024-04-25T22:06:26.816439+0000","last_unstale":"2024-04-25T22:06:30.844684+0000","last_undegraded":"2024-04-25T22:06:30.844684+0000","last_fullsized":"2024-04-25T22:06:30.844684+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28857,"num_write":363,"num_write_kb":87969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"75'515","reported_seq":672,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142766+0000","last_change":"2024-04-25T22:06:23.117492+0000","last_active":"2024-04-25T22:06:31.142766+0000","last_peered":"2024-04-25T22:06:31.142766+0000","last_clean":"2024-04-25T22:06:31.142766+0000","last_became_active":"2024-04-25T22:06:23.109665+0000","last_became_peered":"2024-04-25T22:06:23.109665+0000","last_unstale":"2024-04-25T22:06:31.142766+0000","last_undegraded":"2024-04-25T22:06:31.142766+0000","last_fullsized":"2024-04-25T22:06:31.142766+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"76'375","reported_seq":482,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845322+0000","last_change":"2024-04-25T22:06:28.846182+0000","last_active":"2024-04-25T22:06:30.845322+0000","last_peered":"2024-04-25T22:06:30.845322+0000","last_clean":"2024-04-25T22:06:30.845322+0000","last_became_active":"2024-04-25T22:06:28.841545+0000","last_became_peered":"2024-04-25T22:06:28.841545+0000","last_unstale":"2024-04-25T22:06:30.845322+0000","last_undegraded":"2024-04-25T22:06:30.845322+0000","last_fullsized":"2024-04-25T22:06:30.845322+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14983,"num_write":339,"num_write_kb":46748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'53","reported_seq":238,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849145+0000","last_change":"2024-04-25T22:06:22.839083+0000","last_active":"2024-04-25T22:06:30.849145+0000","last_peered":"2024-04-25T22:06:30.849145+0000","last_clean":"2024-04-25T22:06:30.849145+0000","last_became_active":"2024-04-25T22:06:22.833424+0000","last_became_peered":"2024-04-25T22:06:22.833424+0000","last_unstale":"2024-04-25T22:06:30.849145+0000","last_undegraded":"2024-04-25T22:06:30.849145+0000","last_fullsized":"2024-04-25T22:06:30.849145+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'426","reported_seq":640,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851881+0000","last_change":"2024-04-25T22:06:26.822923+0000","last_active":"2024-04-25T22:06:30.851881+0000","last_peered":"2024-04-25T22:06:30.851881+0000","last_clean":"2024-04-25T22:06:30.851881+0000","last_became_active":"2024-04-25T22:06:26.819562+0000","last_became_peered":"2024-04-25T22:06:26.819562+0000","last_unstale":"2024-04-25T22:06:30.851881+0000","last_undegraded":"2024-04-25T22:06:30.851881+0000","last_fullsized":"2024-04-25T22:06:30.851881+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":17843,"num_write":388,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"75'71","reported_seq":197,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:54.348264+0000","last_change":"2024-04-25T22:06:54.348343+0000","last_active":"2024-04-25T22:06:54.348264+0000","last_peered":"2024-04-25T22:06:54.348264+0000","last_clean":"2024-04-25T22:06:54.348264+0000","last_became_active":"2024-04-25T22:06:22.790902+0000","last_became_peered":"2024-04-25T22:06:22.790902+0000","last_unstale":"2024-04-25T22:06:54.348264+0000","last_undegraded":"2024-04-25T22:06:54.348264+0000","last_fullsized":"2024-04-25T22:06:54.348264+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'71","last_scrub_stamp":"2024-04-25T22:06:54.348062+0000","last_deep_scrub":"75'71","last_deep_scrub_stamp":"2024-04-25T22:06:54.348062+0000","last_clean_scrub_stamp":"2024-04-25T22:06:54.348062+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:52.012973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'366","reported_seq":580,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:57.292147+0000","last_change":"2024-04-25T22:06:57.292206+0000","last_active":"2024-04-25T22:06:57.292147+0000","last_peered":"2024-04-25T22:06:57.292147+0000","last_clean":"2024-04-25T22:06:57.292147+0000","last_became_active":"2024-04-25T22:06:22.803327+0000","last_became_peered":"2024-04-25T22:06:22.803327+0000","last_unstale":"2024-04-25T22:06:57.292147+0000","last_undegraded":"2024-04-25T22:06:57.292147+0000","last_fullsized":"2024-04-25T22:06:57.292147+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'366","last_scrub_stamp":"2024-04-25T22:06:57.291947+0000","last_deep_scrub":"76'366","last_deep_scrub_stamp":"2024-04-25T22:06:57.291947+0000","last_clean_scrub_stamp":"2024-04-25T22:06:57.291947+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:09.795809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":16032,"num_write":334,"num_write_kb":25754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'63","reported_seq":222,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140429+0000","last_change":"2024-04-25T22:06:23.085892+0000","last_active":"2024-04-25T22:06:31.140429+0000","last_peered":"2024-04-25T22:06:31.140429+0000","last_clean":"2024-04-25T22:06:31.140429+0000","last_became_active":"2024-04-25T22:06:23.082351+0000","last_became_peered":"2024-04-25T22:06:23.082351+0000","last_unstale":"2024-04-25T22:06:31.140429+0000","last_undegraded":"2024-04-25T22:06:31.140429+0000","last_fullsized":"2024-04-25T22:06:31.140429+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"76'148","reported_seq":307,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143890+0000","last_change":"2024-04-25T22:06:23.089179+0000","last_active":"2024-04-25T22:06:31.143890+0000","last_peered":"2024-04-25T22:06:31.143890+0000","last_clean":"2024-04-25T22:06:31.143890+0000","last_became_active":"2024-04-25T22:06:23.085599+0000","last_became_peered":"2024-04-25T22:06:23.085599+0000","last_unstale":"2024-04-25T22:06:31.143890+0000","last_undegraded":"2024-04-25T22:06:31.143890+0000","last_fullsized":"2024-04-25T22:06:31.143890+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"76'402","reported_seq":577,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:49.330680+0000","last_change":"2024-04-25T22:06:49.330746+0000","last_active":"2024-04-25T22:06:49.330680+0000","last_peered":"2024-04-25T22:06:49.330680+0000","last_clean":"2024-04-25T22:06:49.330680+0000","last_became_active":"2024-04-25T22:06:22.789353+0000","last_became_peered":"2024-04-25T22:06:22.789353+0000","last_unstale":"2024-04-25T22:06:49.330680+0000","last_undegraded":"2024-04-25T22:06:49.330680+0000","last_fullsized":"2024-04-25T22:06:49.330680+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'402","last_scrub_stamp":"2024-04-25T22:06:49.330473+0000","last_deep_scrub":"76'402","last_deep_scrub_stamp":"2024-04-25T22:06:49.330473+0000","last_clean_scrub_stamp":"2024-04-25T22:06:49.330473+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:52:42.763698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21114,"num_write":364,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"99'252","reported_seq":385,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:58.252735+0000","last_change":"2024-04-25T22:06:58.252804+0000","last_active":"2024-04-25T22:06:58.252735+0000","last_peered":"2024-04-25T22:06:58.252735+0000","last_clean":"2024-04-25T22:06:58.252735+0000","last_became_active":"2024-04-25T22:06:22.790508+0000","last_became_peered":"2024-04-25T22:06:22.790508+0000","last_unstale":"2024-04-25T22:06:58.252735+0000","last_undegraded":"2024-04-25T22:06:58.252735+0000","last_fullsized":"2024-04-25T22:06:58.252735+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'252","last_scrub_stamp":"2024-04-25T22:06:58.252549+0000","last_deep_scrub":"99'252","last_deep_scrub_stamp":"2024-04-25T22:06:58.252549+0000","last_clean_scrub_stamp":"2024-04-25T22:06:58.252549+0000","objects_scrubbed":2,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:43.769236+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"76'460","reported_seq":635,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843069+0000","last_change":"2024-04-25T22:03:33.861055+0000","last_active":"2024-04-25T22:06:30.843069+0000","last_peered":"2024-04-25T22:06:30.843069+0000","last_clean":"2024-04-25T22:06:30.843069+0000","last_became_active":"2024-04-25T22:03:33.856638+0000","last_became_peered":"2024-04-25T22:03:33.856638+0000","last_unstale":"2024-04-25T22:06:30.843069+0000","last_undegraded":"2024-04-25T22:06:30.843069+0000","last_fullsized":"2024-04-25T22:06:30.843069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":39774,"num_write":433,"num_write_kb":80294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"99'558","reported_seq":725,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:45.280721+0000","last_change":"2024-04-25T22:06:45.280807+0000","last_active":"2024-04-25T22:06:45.280721+0000","last_peered":"2024-04-25T22:06:45.280721+0000","last_clean":"2024-04-25T22:06:45.280721+0000","last_became_active":"2024-04-25T22:06:31.147569+0000","last_became_peered":"2024-04-25T22:06:31.147569+0000","last_unstale":"2024-04-25T22:06:45.280721+0000","last_undegraded":"2024-04-25T22:06:45.280721+0000","last_fullsized":"2024-04-25T22:06:45.280721+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'558","last_scrub_stamp":"2024-04-25T22:06:45.280524+0000","last_deep_scrub":"99'558","last_deep_scrub_stamp":"2024-04-25T22:06:45.280524+0000","last_clean_scrub_stamp":"2024-04-25T22:06:45.280524+0000","objects_scrubbed":2,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:31:33.133373+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":509,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"76'413","reported_seq":578,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142356+0000","last_change":"2024-04-25T22:06:23.129627+0000","last_active":"2024-04-25T22:06:31.142356+0000","last_peered":"2024-04-25T22:06:31.142356+0000","last_clean":"2024-04-25T22:06:31.142356+0000","last_became_active":"2024-04-25T22:06:23.108199+0000","last_became_peered":"2024-04-25T22:06:23.108199+0000","last_unstale":"2024-04-25T22:06:31.142356+0000","last_undegraded":"2024-04-25T22:06:31.142356+0000","last_fullsized":"2024-04-25T22:06:31.142356+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4858,"num_write":378,"num_write_kb":46741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"76'66","reported_seq":78,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.162908+0000","last_change":"2024-04-25T22:06:31.161275+0000","last_active":"2024-04-25T22:06:31.162908+0000","last_peered":"2024-04-25T22:06:31.162908+0000","last_clean":"2024-04-25T22:06:31.162908+0000","last_became_active":"2024-04-25T22:06:31.160267+0000","last_became_peered":"2024-04-25T22:06:31.160267+0000","last_unstale":"2024-04-25T22:06:31.162908+0000","last_undegraded":"2024-04-25T22:06:31.162908+0000","last_fullsized":"2024-04-25T22:06:31.162908+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"76'489","reported_seq":730,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850306+0000","last_change":"2024-04-25T22:06:22.838952+0000","last_active":"2024-04-25T22:06:30.850306+0000","last_peered":"2024-04-25T22:06:30.850306+0000","last_clean":"2024-04-25T22:06:30.850306+0000","last_became_active":"2024-04-25T22:06:22.832394+0000","last_became_peered":"2024-04-25T22:06:22.832394+0000","last_unstale":"2024-04-25T22:06:30.850306+0000","last_undegraded":"2024-04-25T22:06:30.850306+0000","last_fullsized":"2024-04-25T22:06:30.850306+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":26829,"num_write":457,"num_write_kb":137840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"75'193","reported_seq":378,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.850618+0000","last_change":"2024-04-25T22:06:22.838157+0000","last_active":"2024-04-25T22:06:30.850618+0000","last_peered":"2024-04-25T22:06:30.850618+0000","last_clean":"2024-04-25T22:06:30.850618+0000","last_became_active":"2024-04-25T22:06:22.832572+0000","last_became_peered":"2024-04-25T22:06:22.832572+0000","last_unstale":"2024-04-25T22:06:30.850618+0000","last_undegraded":"2024-04-25T22:06:30.850618+0000","last_fullsized":"2024-04-25T22:06:30.850618+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'437","reported_seq":529,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.162452+0000","last_change":"2024-04-25T22:06:31.160788+0000","last_active":"2024-04-25T22:06:31.162452+0000","last_peered":"2024-04-25T22:06:31.162452+0000","last_clean":"2024-04-25T22:06:31.162452+0000","last_became_active":"2024-04-25T22:06:31.147501+0000","last_became_peered":"2024-04-25T22:06:31.147501+0000","last_unstale":"2024-04-25T22:06:31.162452+0000","last_undegraded":"2024-04-25T22:06:31.162452+0000","last_fullsized":"2024-04-25T22:06:31.162452+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3720,"num_write":406,"num_write_kb":30461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"99'107","reported_seq":274,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:53.251811+0000","last_change":"2024-04-25T22:06:53.251880+0000","last_active":"2024-04-25T22:06:53.251811+0000","last_peered":"2024-04-25T22:06:53.251811+0000","last_clean":"2024-04-25T22:06:53.251811+0000","last_became_active":"2024-04-25T22:06:23.103402+0000","last_became_peered":"2024-04-25T22:06:23.103402+0000","last_unstale":"2024-04-25T22:06:53.251811+0000","last_undegraded":"2024-04-25T22:06:53.251811+0000","last_fullsized":"2024-04-25T22:06:53.251811+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'107","last_scrub_stamp":"2024-04-25T22:06:53.251612+0000","last_deep_scrub":"99'107","last_deep_scrub_stamp":"2024-04-25T22:06:53.251612+0000","last_clean_scrub_stamp":"2024-04-25T22:06:53.251612+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:04.829272+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"76'409","reported_seq":606,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144221+0000","last_change":"2024-04-25T22:06:23.133536+0000","last_active":"2024-04-25T22:06:31.144221+0000","last_peered":"2024-04-25T22:06:31.144221+0000","last_clean":"2024-04-25T22:06:31.144221+0000","last_became_active":"2024-04-25T22:06:23.086188+0000","last_became_peered":"2024-04-25T22:06:23.086188+0000","last_unstale":"2024-04-25T22:06:31.144221+0000","last_undegraded":"2024-04-25T22:06:31.144221+0000","last_fullsized":"2024-04-25T22:06:31.144221+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19178,"num_write":380,"num_write_kb":91945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"75'51","reported_seq":191,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:52.354233+0000","last_change":"2024-04-25T22:06:52.354294+0000","last_active":"2024-04-25T22:06:52.354233+0000","last_peered":"2024-04-25T22:06:52.354233+0000","last_clean":"2024-04-25T22:06:52.354233+0000","last_became_active":"2024-04-25T22:06:22.798779+0000","last_became_peered":"2024-04-25T22:06:22.798779+0000","last_unstale":"2024-04-25T22:06:52.354233+0000","last_undegraded":"2024-04-25T22:06:52.354233+0000","last_fullsized":"2024-04-25T22:06:52.354233+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'51","last_scrub_stamp":"2024-04-25T22:06:52.354033+0000","last_deep_scrub":"75'51","last_deep_scrub_stamp":"2024-04-25T22:06:52.354033+0000","last_clean_scrub_stamp":"2024-04-25T22:06:52.354033+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:03.260840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"76'377","reported_seq":562,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143641+0000","last_change":"2024-04-25T22:06:23.114225+0000","last_active":"2024-04-25T22:06:31.143641+0000","last_peered":"2024-04-25T22:06:31.143641+0000","last_clean":"2024-04-25T22:06:31.143641+0000","last_became_active":"2024-04-25T22:06:23.085799+0000","last_became_peered":"2024-04-25T22:06:23.085799+0000","last_unstale":"2024-04-25T22:06:31.143641+0000","last_undegraded":"2024-04-25T22:06:31.143641+0000","last_fullsized":"2024-04-25T22:06:31.143641+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21517,"num_write":342,"num_write_kb":66898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"75'449","reported_seq":547,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843348+0000","last_change":"2024-04-25T22:03:33.860386+0000","last_active":"2024-04-25T22:06:30.843348+0000","last_peered":"2024-04-25T22:06:30.843348+0000","last_clean":"2024-04-25T22:06:30.843348+0000","last_became_active":"2024-04-25T22:03:33.859539+0000","last_became_peered":"2024-04-25T22:03:33.859539+0000","last_unstale":"2024-04-25T22:06:30.843348+0000","last_undegraded":"2024-04-25T22:06:30.843348+0000","last_fullsized":"2024-04-25T22:06:30.843348+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'399","reported_seq":622,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:48.374921+0000","last_change":"2024-04-25T22:06:48.374981+0000","last_active":"2024-04-25T22:06:48.374921+0000","last_peered":"2024-04-25T22:06:48.374921+0000","last_clean":"2024-04-25T22:06:48.374921+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:06:48.374921+0000","last_undegraded":"2024-04-25T22:06:48.374921+0000","last_fullsized":"2024-04-25T22:06:48.374921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'399","last_scrub_stamp":"2024-04-25T22:06:48.374723+0000","last_deep_scrub":"76'399","last_deep_scrub_stamp":"2024-04-25T22:06:48.374723+0000","last_clean_scrub_stamp":"2024-04-25T22:06:48.374723+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:35.715072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17888,"num_write":373,"num_write_kb":67556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":319,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.140213+0000","last_change":"2024-04-25T22:06:23.082707+0000","last_active":"2024-04-25T22:06:31.140213+0000","last_peered":"2024-04-25T22:06:31.140213+0000","last_clean":"2024-04-25T22:06:31.140213+0000","last_became_active":"2024-04-25T22:06:23.080701+0000","last_became_peered":"2024-04-25T22:06:23.080701+0000","last_unstale":"2024-04-25T22:06:31.140213+0000","last_undegraded":"2024-04-25T22:06:31.140213+0000","last_fullsized":"2024-04-25T22:06:31.140213+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:04.434759+0000","last_clean_scrub_stamp":"2024-04-25T22:01:04.434759+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":121,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142447+0000","last_change":"2024-04-25T22:06:23.116373+0000","last_active":"2024-04-25T22:06:31.142447+0000","last_peered":"2024-04-25T22:06:31.142447+0000","last_clean":"2024-04-25T22:06:31.142447+0000","last_became_active":"2024-04-25T22:06:23.108984+0000","last_became_peered":"2024-04-25T22:06:23.108984+0000","last_unstale":"2024-04-25T22:06:31.142447+0000","last_undegraded":"2024-04-25T22:06:31.142447+0000","last_fullsized":"2024-04-25T22:06:31.142447+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"75'393","reported_seq":571,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849644+0000","last_change":"2024-04-25T22:01:13.617382+0000","last_active":"2024-04-25T22:06:30.849644+0000","last_peered":"2024-04-25T22:06:30.849644+0000","last_clean":"2024-04-25T22:06:30.849644+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:06:30.849644+0000","last_undegraded":"2024-04-25T22:06:30.849644+0000","last_fullsized":"2024-04-25T22:06:30.849644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'463","reported_seq":669,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.144556+0000","last_change":"2024-04-25T22:06:23.133028+0000","last_active":"2024-04-25T22:06:31.144556+0000","last_peered":"2024-04-25T22:06:31.144556+0000","last_clean":"2024-04-25T22:06:31.144556+0000","last_became_active":"2024-04-25T22:06:23.082756+0000","last_became_peered":"2024-04-25T22:06:23.082756+0000","last_unstale":"2024-04-25T22:06:31.144556+0000","last_undegraded":"2024-04-25T22:06:31.144556+0000","last_fullsized":"2024-04-25T22:06:31.144556+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29270,"num_write":426,"num_write_kb":129367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141177+0000","last_change":"2024-04-25T22:06:23.083451+0000","last_active":"2024-04-25T22:06:31.141177+0000","last_peered":"2024-04-25T22:06:31.141177+0000","last_clean":"2024-04-25T22:06:31.141177+0000","last_became_active":"2024-04-25T22:06:23.080841+0000","last_became_peered":"2024-04-25T22:06:23.080841+0000","last_unstale":"2024-04-25T22:06:31.141177+0000","last_undegraded":"2024-04-25T22:06:31.141177+0000","last_fullsized":"2024-04-25T22:06:31.141177+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"99'126","reported_seq":382,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:51.379661+0000","last_change":"2024-04-25T22:06:51.379727+0000","last_active":"2024-04-25T22:06:51.379661+0000","last_peered":"2024-04-25T22:06:51.379661+0000","last_clean":"2024-04-25T22:06:51.379661+0000","last_became_active":"2024-04-25T22:06:22.801616+0000","last_became_peered":"2024-04-25T22:06:22.801616+0000","last_unstale":"2024-04-25T22:06:51.379661+0000","last_undegraded":"2024-04-25T22:06:51.379661+0000","last_fullsized":"2024-04-25T22:06:51.379661+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'126","last_scrub_stamp":"2024-04-25T22:06:51.379448+0000","last_deep_scrub":"99'126","last_deep_scrub_stamp":"2024-04-25T22:06:51.379448+0000","last_clean_scrub_stamp":"2024-04-25T22:06:51.379448+0000","objects_scrubbed":1,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:17.624837+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464197,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":63,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'457","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844305+0000","last_change":"2024-04-25T22:03:05.702224+0000","last_active":"2024-04-25T22:06:30.844305+0000","last_peered":"2024-04-25T22:06:30.844305+0000","last_clean":"2024-04-25T22:06:30.844305+0000","last_became_active":"2024-04-25T22:03:05.699581+0000","last_became_peered":"2024-04-25T22:03:05.699581+0000","last_unstale":"2024-04-25T22:06:30.844305+0000","last_undegraded":"2024-04-25T22:06:30.844305+0000","last_fullsized":"2024-04-25T22:06:30.844305+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":34759,"num_write":424,"num_write_kb":71902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:02.182419+0000","last_change":"2024-04-25T22:07:02.182470+0000","last_active":"2024-04-25T22:07:02.182419+0000","last_peered":"2024-04-25T22:07:02.182419+0000","last_clean":"2024-04-25T22:07:02.182419+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:07:02.182419+0000","last_undegraded":"2024-04-25T22:07:02.182419+0000","last_fullsized":"2024-04-25T22:07:02.182419+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:07:02.182209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:07:02.182209+0000","last_clean_scrub_stamp":"2024-04-25T22:07:02.182209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:59.290847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"99'313","reported_seq":507,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:48.373950+0000","last_change":"2024-04-25T22:06:48.374024+0000","last_active":"2024-04-25T22:06:48.373950+0000","last_peered":"2024-04-25T22:06:48.373950+0000","last_clean":"2024-04-25T22:06:48.373950+0000","last_became_active":"2024-04-25T22:06:22.794841+0000","last_became_peered":"2024-04-25T22:06:22.794841+0000","last_unstale":"2024-04-25T22:06:48.373950+0000","last_undegraded":"2024-04-25T22:06:48.373950+0000","last_fullsized":"2024-04-25T22:06:48.373950+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'313","last_scrub_stamp":"2024-04-25T22:06:48.373725+0000","last_deep_scrub":"99'313","last_deep_scrub_stamp":"2024-04-25T22:06:48.373725+0000","last_clean_scrub_stamp":"2024-04-25T22:06:48.373725+0000","objects_scrubbed":2,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:53:19.399993+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"76'373","reported_seq":601,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:58.307983+0000","last_change":"2024-04-25T22:06:58.308044+0000","last_active":"2024-04-25T22:06:58.307983+0000","last_peered":"2024-04-25T22:06:58.307983+0000","last_clean":"2024-04-25T22:06:58.307983+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:06:58.307983+0000","last_undegraded":"2024-04-25T22:06:58.307983+0000","last_fullsized":"2024-04-25T22:06:58.307983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'373","last_scrub_stamp":"2024-04-25T22:06:58.307771+0000","last_deep_scrub":"76'373","last_deep_scrub_stamp":"2024-04-25T22:06:58.307771+0000","last_clean_scrub_stamp":"2024-04-25T22:06:58.307771+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:59:19.717093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28273,"num_write":350,"num_write_kb":87787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":129,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:55.211596+0000","last_change":"2024-04-25T22:06:55.211653+0000","last_active":"2024-04-25T22:06:55.211596+0000","last_peered":"2024-04-25T22:06:55.211596+0000","last_clean":"2024-04-25T22:06:55.211596+0000","last_became_active":"2024-04-25T22:06:23.106155+0000","last_became_peered":"2024-04-25T22:06:23.106155+0000","last_unstale":"2024-04-25T22:06:55.211596+0000","last_undegraded":"2024-04-25T22:06:55.211596+0000","last_fullsized":"2024-04-25T22:06:55.211596+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:06:55.211397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:06:55.211397+0000","last_clean_scrub_stamp":"2024-04-25T22:06:55.211397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:35:48.867729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"76'75","reported_seq":78,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.162961+0000","last_change":"2024-04-25T22:06:31.161388+0000","last_active":"2024-04-25T22:06:31.162961+0000","last_peered":"2024-04-25T22:06:31.162961+0000","last_clean":"2024-04-25T22:06:31.162961+0000","last_became_active":"2024-04-25T22:06:31.150555+0000","last_became_peered":"2024-04-25T22:06:31.150555+0000","last_unstale":"2024-04-25T22:06:31.162961+0000","last_undegraded":"2024-04-25T22:06:31.162961+0000","last_fullsized":"2024-04-25T22:06:31.162961+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"76'461","reported_seq":762,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:54.372989+0000","last_change":"2024-04-25T22:06:54.373047+0000","last_active":"2024-04-25T22:06:54.372989+0000","last_peered":"2024-04-25T22:06:54.372989+0000","last_clean":"2024-04-25T22:06:54.372989+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:06:54.372989+0000","last_undegraded":"2024-04-25T22:06:54.372989+0000","last_fullsized":"2024-04-25T22:06:54.372989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'461","last_scrub_stamp":"2024-04-25T22:06:54.372778+0000","last_deep_scrub":"76'461","last_deep_scrub_stamp":"2024-04-25T22:06:54.372778+0000","last_clean_scrub_stamp":"2024-04-25T22:06:54.372778+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:41:36.037813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":67984,"num_write":425,"num_write_kb":154741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"99'269","reported_seq":435,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:52.220280+0000","last_change":"2024-04-25T22:06:52.220351+0000","last_active":"2024-04-25T22:06:52.220280+0000","last_peered":"2024-04-25T22:06:52.220280+0000","last_clean":"2024-04-25T22:06:52.220280+0000","last_became_active":"2024-04-25T22:06:23.122629+0000","last_became_peered":"2024-04-25T22:06:23.122629+0000","last_unstale":"2024-04-25T22:06:52.220280+0000","last_undegraded":"2024-04-25T22:06:52.220280+0000","last_fullsized":"2024-04-25T22:06:52.220280+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'269","last_scrub_stamp":"2024-04-25T22:06:52.220087+0000","last_deep_scrub":"99'269","last_deep_scrub_stamp":"2024-04-25T22:06:52.220087+0000","last_clean_scrub_stamp":"2024-04-25T22:06:52.220087+0000","objects_scrubbed":1,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:41:51.137396+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":192,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:01.222124+0000","last_change":"2024-04-25T22:07:01.222176+0000","last_active":"2024-04-25T22:07:01.222124+0000","last_peered":"2024-04-25T22:07:01.222124+0000","last_clean":"2024-04-25T22:07:01.222124+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:07:01.222124+0000","last_undegraded":"2024-04-25T22:07:01.222124+0000","last_fullsized":"2024-04-25T22:07:01.222124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:07:01.221935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:07:01.221935+0000","last_clean_scrub_stamp":"2024-04-25T22:07:01.221935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:46.738622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'398","reported_seq":587,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:56.287898+0000","last_change":"2024-04-25T22:06:56.287961+0000","last_active":"2024-04-25T22:06:56.287898+0000","last_peered":"2024-04-25T22:06:56.287898+0000","last_clean":"2024-04-25T22:06:56.287898+0000","last_became_active":"2024-04-25T22:06:22.789384+0000","last_became_peered":"2024-04-25T22:06:22.789384+0000","last_unstale":"2024-04-25T22:06:56.287898+0000","last_undegraded":"2024-04-25T22:06:56.287898+0000","last_fullsized":"2024-04-25T22:06:56.287898+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'398","last_scrub_stamp":"2024-04-25T22:06:56.287695+0000","last_deep_scrub":"76'398","last_deep_scrub_stamp":"2024-04-25T22:06:56.287695+0000","last_clean_scrub_stamp":"2024-04-25T22:06:56.287695+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:46.536240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":26599,"num_write":366,"num_write_kb":75612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"76'47","reported_seq":233,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:03.149367+0000","last_change":"2024-04-25T22:07:03.149431+0000","last_active":"2024-04-25T22:07:03.149367+0000","last_peered":"2024-04-25T22:07:03.149367+0000","last_clean":"2024-04-25T22:07:03.149367+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:07:03.149367+0000","last_undegraded":"2024-04-25T22:07:03.149367+0000","last_fullsized":"2024-04-25T22:07:03.149367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'47","last_scrub_stamp":"2024-04-25T22:07:03.149177+0000","last_deep_scrub":"76'47","last_deep_scrub_stamp":"2024-04-25T22:07:03.149177+0000","last_clean_scrub_stamp":"2024-04-25T22:07:03.149177+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:21:58.423985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":180,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:03.277496+0000","last_change":"2024-04-25T22:07:03.277555+0000","last_active":"2024-04-25T22:07:03.277496+0000","last_peered":"2024-04-25T22:07:03.277496+0000","last_clean":"2024-04-25T22:07:03.277496+0000","last_became_active":"2024-04-25T22:03:05.701322+0000","last_became_peered":"2024-04-25T22:03:05.701322+0000","last_unstale":"2024-04-25T22:07:03.277496+0000","last_undegraded":"2024-04-25T22:07:03.277496+0000","last_fullsized":"2024-04-25T22:07:03.277496+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:07:03.277311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:07:03.277311+0000","last_clean_scrub_stamp":"2024-04-25T22:07:03.277311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:22:06.392400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"76'406","reported_seq":651,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:51.374373+0000","last_change":"2024-04-25T22:06:51.374435+0000","last_active":"2024-04-25T22:06:51.374373+0000","last_peered":"2024-04-25T22:06:51.374373+0000","last_clean":"2024-04-25T22:06:51.374373+0000","last_became_active":"2024-04-25T22:06:22.789807+0000","last_became_peered":"2024-04-25T22:06:22.789807+0000","last_unstale":"2024-04-25T22:06:51.374373+0000","last_undegraded":"2024-04-25T22:06:51.374373+0000","last_fullsized":"2024-04-25T22:06:51.374373+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'406","last_scrub_stamp":"2024-04-25T22:06:51.374173+0000","last_deep_scrub":"76'406","last_deep_scrub_stamp":"2024-04-25T22:06:51.374173+0000","last_clean_scrub_stamp":"2024-04-25T22:06:51.374173+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:47:28.548940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25634,"num_write":377,"num_write_kb":103970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"76'64","reported_seq":242,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.852091+0000","last_change":"2024-04-25T22:01:13.617483+0000","last_active":"2024-04-25T22:06:30.852091+0000","last_peered":"2024-04-25T22:06:30.852091+0000","last_clean":"2024-04-25T22:06:30.852091+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:06:30.852091+0000","last_undegraded":"2024-04-25T22:06:30.852091+0000","last_fullsized":"2024-04-25T22:06:30.852091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:48.237497+0000","last_change":"2024-04-25T22:06:48.237553+0000","last_active":"2024-04-25T22:06:48.237497+0000","last_peered":"2024-04-25T22:06:48.237497+0000","last_clean":"2024-04-25T22:06:48.237497+0000","last_became_active":"2024-04-25T22:06:24.091909+0000","last_became_peered":"2024-04-25T22:06:24.091909+0000","last_unstale":"2024-04-25T22:06:48.237497+0000","last_undegraded":"2024-04-25T22:06:48.237497+0000","last_fullsized":"2024-04-25T22:06:48.237497+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:06:48.237288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:06:48.237288+0000","last_clean_scrub_stamp":"2024-04-25T22:06:48.237288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:42:29.191428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"76'402","reported_seq":614,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:59.274228+0000","last_change":"2024-04-25T22:06:59.274286+0000","last_active":"2024-04-25T22:06:59.274228+0000","last_peered":"2024-04-25T22:06:59.274228+0000","last_clean":"2024-04-25T22:06:59.274228+0000","last_became_active":"2024-04-25T22:06:22.802005+0000","last_became_peered":"2024-04-25T22:06:22.802005+0000","last_unstale":"2024-04-25T22:06:59.274228+0000","last_undegraded":"2024-04-25T22:06:59.274228+0000","last_fullsized":"2024-04-25T22:06:59.274228+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'402","last_scrub_stamp":"2024-04-25T22:06:59.274026+0000","last_deep_scrub":"76'402","last_deep_scrub_stamp":"2024-04-25T22:06:59.274026+0000","last_clean_scrub_stamp":"2024-04-25T22:06:59.274026+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:45.358388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9572,"num_write":361,"num_write_kb":29911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"99'128","reported_seq":321,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:53.443568+0000","last_change":"2024-04-25T22:06:53.443633+0000","last_active":"2024-04-25T22:06:53.443568+0000","last_peered":"2024-04-25T22:06:53.443568+0000","last_clean":"2024-04-25T22:06:53.443568+0000","last_became_active":"2024-04-25T22:06:22.802083+0000","last_became_peered":"2024-04-25T22:06:22.802083+0000","last_unstale":"2024-04-25T22:06:53.443568+0000","last_undegraded":"2024-04-25T22:06:53.443568+0000","last_fullsized":"2024-04-25T22:06:53.443568+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'128","last_scrub_stamp":"2024-04-25T22:06:53.443384+0000","last_deep_scrub":"99'128","last_deep_scrub_stamp":"2024-04-25T22:06:53.443384+0000","last_clean_scrub_stamp":"2024-04-25T22:06:53.443384+0000","objects_scrubbed":1,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:23:27.524012+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142989+0000","last_change":"2024-04-25T22:06:23.081230+0000","last_active":"2024-04-25T22:06:31.142989+0000","last_peered":"2024-04-25T22:06:31.142989+0000","last_clean":"2024-04-25T22:06:31.142989+0000","last_became_active":"2024-04-25T22:06:23.080393+0000","last_became_peered":"2024-04-25T22:06:23.080393+0000","last_unstale":"2024-04-25T22:06:31.142989+0000","last_undegraded":"2024-04-25T22:06:31.142989+0000","last_fullsized":"2024-04-25T22:06:31.142989+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:08.550431+0000","last_clean_scrub_stamp":"2024-04-25T22:01:08.550431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"76'415","reported_seq":605,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:50.364826+0000","last_change":"2024-04-25T22:06:50.364885+0000","last_active":"2024-04-25T22:06:50.364826+0000","last_peered":"2024-04-25T22:06:50.364826+0000","last_clean":"2024-04-25T22:06:50.364826+0000","last_became_active":"2024-04-25T22:06:22.789624+0000","last_became_peered":"2024-04-25T22:06:22.789624+0000","last_unstale":"2024-04-25T22:06:50.364826+0000","last_undegraded":"2024-04-25T22:06:50.364826+0000","last_fullsized":"2024-04-25T22:06:50.364826+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'415","last_scrub_stamp":"2024-04-25T22:06:50.364620+0000","last_deep_scrub":"76'415","last_deep_scrub_stamp":"2024-04-25T22:06:50.364620+0000","last_clean_scrub_stamp":"2024-04-25T22:06:50.364620+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:27.901357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27345,"num_write":384,"num_write_kb":92854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"76'407","reported_seq":624,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.143416+0000","last_change":"2024-04-25T22:06:23.114739+0000","last_active":"2024-04-25T22:06:31.143416+0000","last_peered":"2024-04-25T22:06:31.143416+0000","last_clean":"2024-04-25T22:06:31.143416+0000","last_became_active":"2024-04-25T22:06:23.087118+0000","last_became_peered":"2024-04-25T22:06:23.087118+0000","last_unstale":"2024-04-25T22:06:31.143416+0000","last_undegraded":"2024-04-25T22:06:31.143416+0000","last_fullsized":"2024-04-25T22:06:31.143416+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33923,"num_write":372,"num_write_kb":82083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"77'260","reported_seq":421,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.142292+0000","last_change":"2024-04-25T22:06:23.083331+0000","last_active":"2024-04-25T22:06:31.142292+0000","last_peered":"2024-04-25T22:06:31.142292+0000","last_clean":"2024-04-25T22:06:31.142292+0000","last_became_active":"2024-04-25T22:06:23.080552+0000","last_became_peered":"2024-04-25T22:06:23.080552+0000","last_unstale":"2024-04-25T22:06:31.142292+0000","last_undegraded":"2024-04-25T22:06:31.142292+0000","last_fullsized":"2024-04-25T22:06:31.142292+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8470619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"76'408","reported_seq":619,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:46.345971+0000","last_change":"2024-04-25T22:06:46.346032+0000","last_active":"2024-04-25T22:06:46.345971+0000","last_peered":"2024-04-25T22:06:46.345971+0000","last_clean":"2024-04-25T22:06:46.345971+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:06:46.345971+0000","last_undegraded":"2024-04-25T22:06:46.345971+0000","last_fullsized":"2024-04-25T22:06:46.345971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'408","last_scrub_stamp":"2024-04-25T22:06:46.345765+0000","last_deep_scrub":"76'408","last_deep_scrub_stamp":"2024-04-25T22:06:46.345765+0000","last_clean_scrub_stamp":"2024-04-25T22:06:46.345765+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:15.185009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14178,"num_write":370,"num_write_kb":58735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"99'106","reported_seq":300,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:46.291512+0000","last_change":"2024-04-25T22:06:46.291648+0000","last_active":"2024-04-25T22:06:46.291512+0000","last_peered":"2024-04-25T22:06:46.291512+0000","last_clean":"2024-04-25T22:06:46.291512+0000","last_became_active":"2024-04-25T22:06:22.802667+0000","last_became_peered":"2024-04-25T22:06:22.802667+0000","last_unstale":"2024-04-25T22:06:46.291512+0000","last_undegraded":"2024-04-25T22:06:46.291512+0000","last_fullsized":"2024-04-25T22:06:46.291512+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'106","last_scrub_stamp":"2024-04-25T22:06:46.291281+0000","last_deep_scrub":"99'106","last_deep_scrub_stamp":"2024-04-25T22:06:46.291281+0000","last_clean_scrub_stamp":"2024-04-25T22:06:46.291281+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:44:03.703813+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"99'233","reported_seq":296,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:47.268073+0000","last_change":"2024-04-25T22:06:47.268224+0000","last_active":"2024-04-25T22:06:47.268073+0000","last_peered":"2024-04-25T22:06:47.268073+0000","last_clean":"2024-04-25T22:06:47.268073+0000","last_became_active":"2024-04-25T22:06:31.150582+0000","last_became_peered":"2024-04-25T22:06:31.150582+0000","last_unstale":"2024-04-25T22:06:47.268073+0000","last_undegraded":"2024-04-25T22:06:47.268073+0000","last_fullsized":"2024-04-25T22:06:47.268073+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'233","last_scrub_stamp":"2024-04-25T22:06:47.267812+0000","last_deep_scrub":"99'233","last_deep_scrub_stamp":"2024-04-25T22:06:47.267812+0000","last_clean_scrub_stamp":"2024-04-25T22:06:47.267812+0000","objects_scrubbed":1,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:04.023399+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"76'483","reported_seq":714,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848639+0000","last_change":"2024-04-25T22:06:22.814119+0000","last_active":"2024-04-25T22:06:30.848639+0000","last_peered":"2024-04-25T22:06:30.848639+0000","last_clean":"2024-04-25T22:06:30.848639+0000","last_became_active":"2024-04-25T22:06:22.807584+0000","last_became_peered":"2024-04-25T22:06:22.807584+0000","last_unstale":"2024-04-25T22:06:30.848639+0000","last_undegraded":"2024-04-25T22:06:30.848639+0000","last_fullsized":"2024-04-25T22:06:30.848639+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24709,"num_write":463,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"75'60","reported_seq":253,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:47.377558+0000","last_change":"2024-04-25T22:06:47.377620+0000","last_active":"2024-04-25T22:06:47.377558+0000","last_peered":"2024-04-25T22:06:47.377558+0000","last_clean":"2024-04-25T22:06:47.377558+0000","last_became_active":"2024-04-25T22:06:22.801412+0000","last_became_peered":"2024-04-25T22:06:22.801412+0000","last_unstale":"2024-04-25T22:06:47.377558+0000","last_undegraded":"2024-04-25T22:06:47.377558+0000","last_fullsized":"2024-04-25T22:06:47.377558+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'60","last_scrub_stamp":"2024-04-25T22:06:47.377366+0000","last_deep_scrub":"75'60","last_deep_scrub_stamp":"2024-04-25T22:06:47.377366+0000","last_clean_scrub_stamp":"2024-04-25T22:06:47.377366+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:24.358167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'444","reported_seq":649,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.848708+0000","last_change":"2024-04-25T22:01:14.639366+0000","last_active":"2024-04-25T22:06:30.848708+0000","last_peered":"2024-04-25T22:06:30.848708+0000","last_clean":"2024-04-25T22:06:30.848708+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:06:30.848708+0000","last_undegraded":"2024-04-25T22:06:30.848708+0000","last_fullsized":"2024-04-25T22:06:30.848708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14429,"num_write":416,"num_write_kb":59186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'355","reported_seq":508,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:59.258749+0000","last_change":"2024-04-25T22:06:59.258809+0000","last_active":"2024-04-25T22:06:59.258749+0000","last_peered":"2024-04-25T22:06:59.258749+0000","last_clean":"2024-04-25T22:06:59.258749+0000","last_became_active":"2024-04-25T22:06:22.792886+0000","last_became_peered":"2024-04-25T22:06:22.792886+0000","last_unstale":"2024-04-25T22:06:59.258749+0000","last_undegraded":"2024-04-25T22:06:59.258749+0000","last_fullsized":"2024-04-25T22:06:59.258749+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'355","last_scrub_stamp":"2024-04-25T22:06:59.258519+0000","last_deep_scrub":"76'355","last_deep_scrub_stamp":"2024-04-25T22:06:59.258519+0000","last_clean_scrub_stamp":"2024-04-25T22:06:59.258519+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:56.367157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18236,"num_write":332,"num_write_kb":42553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"76'742","reported_seq":920,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.849239+0000","last_change":"2024-04-25T22:01:13.618618+0000","last_active":"2024-04-25T22:06:30.849239+0000","last_peered":"2024-04-25T22:06:30.849239+0000","last_clean":"2024-04-25T22:06:30.849239+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:06:30.849239+0000","last_undegraded":"2024-04-25T22:06:30.849239+0000","last_fullsized":"2024-04-25T22:06:30.849239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'378","reported_seq":580,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851687+0000","last_change":"2024-04-25T22:06:22.813642+0000","last_active":"2024-04-25T22:06:30.851687+0000","last_peered":"2024-04-25T22:06:30.851687+0000","last_clean":"2024-04-25T22:06:30.851687+0000","last_became_active":"2024-04-25T22:06:22.806240+0000","last_became_peered":"2024-04-25T22:06:22.806240+0000","last_unstale":"2024-04-25T22:06:30.851687+0000","last_undegraded":"2024-04-25T22:06:30.851687+0000","last_fullsized":"2024-04-25T22:06:30.851687+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6876,"num_write":354,"num_write_kb":46840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"99'205","reported_seq":398,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:55.388796+0000","last_change":"2024-04-25T22:06:55.388860+0000","last_active":"2024-04-25T22:06:55.388796+0000","last_peered":"2024-04-25T22:06:55.388796+0000","last_clean":"2024-04-25T22:06:55.388796+0000","last_became_active":"2024-04-25T22:06:22.801630+0000","last_became_peered":"2024-04-25T22:06:22.801630+0000","last_unstale":"2024-04-25T22:06:55.388796+0000","last_undegraded":"2024-04-25T22:06:55.388796+0000","last_fullsized":"2024-04-25T22:06:55.388796+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'205","last_scrub_stamp":"2024-04-25T22:06:55.388593+0000","last_deep_scrub":"99'205","last_deep_scrub_stamp":"2024-04-25T22:06:55.388593+0000","last_clean_scrub_stamp":"2024-04-25T22:06:55.388593+0000","objects_scrubbed":1,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:19:22.258602+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'377","reported_seq":516,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.845275+0000","last_change":"2024-04-25T22:06:22.805011+0000","last_active":"2024-04-25T22:06:30.845275+0000","last_peered":"2024-04-25T22:06:30.845275+0000","last_clean":"2024-04-25T22:06:30.845275+0000","last_became_active":"2024-04-25T22:06:22.795334+0000","last_became_peered":"2024-04-25T22:06:22.795334+0000","last_unstale":"2024-04-25T22:06:30.845275+0000","last_undegraded":"2024-04-25T22:06:30.845275+0000","last_fullsized":"2024-04-25T22:06:30.845275+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6059,"num_write":332,"num_write_kb":37972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"76'217","reported_seq":333,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844181+0000","last_change":"2024-04-25T22:06:28.842258+0000","last_active":"2024-04-25T22:06:30.844181+0000","last_peered":"2024-04-25T22:06:30.844181+0000","last_clean":"2024-04-25T22:06:30.844181+0000","last_became_active":"2024-04-25T22:06:28.841447+0000","last_became_peered":"2024-04-25T22:06:28.841447+0000","last_unstale":"2024-04-25T22:06:30.844181+0000","last_undegraded":"2024-04-25T22:06:30.844181+0000","last_fullsized":"2024-04-25T22:06:30.844181+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"76'389","reported_seq":543,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.844413+0000","last_change":"2024-04-25T22:03:33.862286+0000","last_active":"2024-04-25T22:06:30.844413+0000","last_peered":"2024-04-25T22:06:30.844413+0000","last_clean":"2024-04-25T22:06:30.844413+0000","last_became_active":"2024-04-25T22:03:33.860800+0000","last_became_peered":"2024-04-25T22:03:33.860800+0000","last_unstale":"2024-04-25T22:06:30.844413+0000","last_undegraded":"2024-04-25T22:06:30.844413+0000","last_fullsized":"2024-04-25T22:06:30.844413+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19110,"num_write":355,"num_write_kb":63152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"99'52","reported_seq":136,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:01.288659+0000","last_change":"2024-04-25T22:07:01.288788+0000","last_active":"2024-04-25T22:07:01.288659+0000","last_peered":"2024-04-25T22:07:01.288659+0000","last_clean":"2024-04-25T22:07:01.288659+0000","last_became_active":"2024-04-25T22:06:22.803778+0000","last_became_peered":"2024-04-25T22:06:22.803778+0000","last_unstale":"2024-04-25T22:07:01.288659+0000","last_undegraded":"2024-04-25T22:07:01.288659+0000","last_fullsized":"2024-04-25T22:07:01.288659+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'52","last_scrub_stamp":"2024-04-25T22:07:01.288423+0000","last_deep_scrub":"99'52","last_deep_scrub_stamp":"2024-04-25T22:07:01.288423+0000","last_clean_scrub_stamp":"2024-04-25T22:07:01.288423+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:27.589499+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"76'386","reported_seq":484,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.162997+0000","last_change":"2024-04-25T22:06:31.161983+0000","last_active":"2024-04-25T22:06:31.162997+0000","last_peered":"2024-04-25T22:06:31.162997+0000","last_clean":"2024-04-25T22:06:31.162997+0000","last_became_active":"2024-04-25T22:06:31.149995+0000","last_became_peered":"2024-04-25T22:06:31.149995+0000","last_unstale":"2024-04-25T22:06:31.162997+0000","last_undegraded":"2024-04-25T22:06:31.162997+0000","last_fullsized":"2024-04-25T22:06:31.162997+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14050,"num_write":362,"num_write_kb":58957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"99'190","reported_seq":242,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:51.236079+0000","last_change":"2024-04-25T22:06:51.236148+0000","last_active":"2024-04-25T22:06:51.236079+0000","last_peered":"2024-04-25T22:06:51.236079+0000","last_clean":"2024-04-25T22:06:51.236079+0000","last_became_active":"2024-04-25T22:06:31.148291+0000","last_became_peered":"2024-04-25T22:06:31.148291+0000","last_unstale":"2024-04-25T22:06:51.236079+0000","last_undegraded":"2024-04-25T22:06:51.236079+0000","last_fullsized":"2024-04-25T22:06:51.236079+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'190","last_scrub_stamp":"2024-04-25T22:06:51.235885+0000","last_deep_scrub":"99'190","last_deep_scrub_stamp":"2024-04-25T22:06:51.235885+0000","last_clean_scrub_stamp":"2024-04-25T22:06:51.235885+0000","objects_scrubbed":2,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:48.916005+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"76'397","reported_seq":495,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.161713+0000","last_change":"2024-04-25T22:06:31.160300+0000","last_active":"2024-04-25T22:06:31.161713+0000","last_peered":"2024-04-25T22:06:31.161713+0000","last_clean":"2024-04-25T22:06:31.161713+0000","last_became_active":"2024-04-25T22:06:31.148445+0000","last_became_peered":"2024-04-25T22:06:31.148445+0000","last_unstale":"2024-04-25T22:06:31.161713+0000","last_undegraded":"2024-04-25T22:06:31.161713+0000","last_fullsized":"2024-04-25T22:06:31.161713+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13280,"num_write":364,"num_write_kb":46108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"99'288","reported_seq":427,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:57.337519+0000","last_change":"2024-04-25T22:06:57.337603+0000","last_active":"2024-04-25T22:06:57.337519+0000","last_peered":"2024-04-25T22:06:57.337519+0000","last_clean":"2024-04-25T22:06:57.337519+0000","last_became_active":"2024-04-25T22:06:22.794078+0000","last_became_peered":"2024-04-25T22:06:22.794078+0000","last_unstale":"2024-04-25T22:06:57.337519+0000","last_undegraded":"2024-04-25T22:06:57.337519+0000","last_fullsized":"2024-04-25T22:06:57.337519+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'288","last_scrub_stamp":"2024-04-25T22:06:57.337333+0000","last_deep_scrub":"99'288","last_deep_scrub_stamp":"2024-04-25T22:06:57.337333+0000","last_clean_scrub_stamp":"2024-04-25T22:06:57.337333+0000","objects_scrubbed":4,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:20.402496+0000","scrub_duration":95,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":12398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"76'412","reported_seq":539,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.843806+0000","last_change":"2024-04-25T22:03:33.864136+0000","last_active":"2024-04-25T22:06:30.843806+0000","last_peered":"2024-04-25T22:06:30.843806+0000","last_clean":"2024-04-25T22:06:30.843806+0000","last_became_active":"2024-04-25T22:03:33.862435+0000","last_became_peered":"2024-04-25T22:03:33.862435+0000","last_unstale":"2024-04-25T22:06:30.843806+0000","last_undegraded":"2024-04-25T22:06:30.843806+0000","last_fullsized":"2024-04-25T22:06:30.843806+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":1478,"num_write":377,"num_write_kb":34422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"76'127","reported_seq":305,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:30.851650+0000","last_change":"2024-04-25T22:01:13.618518+0000","last_active":"2024-04-25T22:06:30.851650+0000","last_peered":"2024-04-25T22:06:30.851650+0000","last_clean":"2024-04-25T22:06:30.851650+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:06:30.851650+0000","last_undegraded":"2024-04-25T22:06:30.851650+0000","last_fullsized":"2024-04-25T22:06:30.851650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'444","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.141379+0000","last_change":"2024-04-25T22:06:23.132900+0000","last_active":"2024-04-25T22:06:31.141379+0000","last_peered":"2024-04-25T22:06:31.141379+0000","last_clean":"2024-04-25T22:06:31.141379+0000","last_became_active":"2024-04-25T22:06:23.097535+0000","last_became_peered":"2024-04-25T22:06:23.097535+0000","last_unstale":"2024-04-25T22:06:31.141379+0000","last_undegraded":"2024-04-25T22:06:31.141379+0000","last_fullsized":"2024-04-25T22:06:31.141379+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31576,"num_write":414,"num_write_kb":70915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"99'49","reported_seq":242,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:49.391630+0000","last_change":"2024-04-25T22:06:49.391711+0000","last_active":"2024-04-25T22:06:49.391630+0000","last_peered":"2024-04-25T22:06:49.391630+0000","last_clean":"2024-04-25T22:06:49.391630+0000","last_became_active":"2024-04-25T22:06:22.801910+0000","last_became_peered":"2024-04-25T22:06:22.801910+0000","last_unstale":"2024-04-25T22:06:49.391630+0000","last_undegraded":"2024-04-25T22:06:49.391630+0000","last_fullsized":"2024-04-25T22:06:49.391630+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'49","last_scrub_stamp":"2024-04-25T22:06:49.391444+0000","last_deep_scrub":"99'49","last_deep_scrub_stamp":"2024-04-25T22:06:49.391444+0000","last_clean_scrub_stamp":"2024-04-25T22:06:49.391444+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:01.347946+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2665,"num_read_kb":1338898,"num_write":24540,"num_write_kb":4276910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26558,"ondisk_log_size":26558,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127376126,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":4662,"num_write_kb":127830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":71499776,"data_stored":254752252,"data_compressed":21836190,"data_compressed_allocated":35307520,"data_compressed_original":218619904,"omap_allocated":136586,"internal_metadata":0},"log_size":6470,"ondisk_log_size":6470,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738447,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103888,"kb_used_data":24200,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":94267952,"statfs":{"total":96636764160,"available":96530382848,"internally_reserved":0,"allocated":24780800,"data_stored":84964150,"data_compressed":7036839,"data_compressed_allocated":11431936,"data_compressed_original":72118272,"omap_allocated":1595,"internal_metadata":81590725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738446,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99424,"kb_used_data":23896,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272416,"statfs":{"total":96636764160,"available":96534953984,"internally_reserved":0,"allocated":24469504,"data_stored":81562098,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":90,"seq":386547056650,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58104,"kb_used_data":24432,"kb_used_omap":134,"kb_used_meta":33529,"kb_avail":94313736,"statfs":{"total":96636764160,"available":96577265664,"internally_reserved":0,"allocated":25018368,"data_stored":90623267,"data_compressed":7819212,"data_compressed_allocated":12599296,"data_compressed_original":78716928,"omap_allocated":138181,"internal_metadata":34333755},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24076288,"data_stored":89627390,"data_compressed":7811005,"data_compressed_allocated":12562432,"data_compressed_original":78143488,"omap_allocated":136586,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23584768,"data_stored":81156589,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23838720,"data_stored":83968273,"data_compressed":7028632,"data_compressed_allocated":11395072,"data_compressed_original":71544832,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:07:06.183 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.183 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.183 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.183 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.184 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.184 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.184 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.184 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.184 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.184 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.184 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.184 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.185 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.185 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.185 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.185 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.185 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.185 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.185 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.185 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.186 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.186 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.186 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.186 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.186 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.186 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.186 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.186 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.186 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.187 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T22:01:04.434759+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.187 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T22:01:08.550431+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.187 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.187 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.187 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T22:01:08.550431+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.187 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.187 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.187 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.188 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T22:01:08.550431+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.188 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.188 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.188 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.188 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.188 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.188 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.188 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.189 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.189 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.189 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.189 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.189 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.189 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.189 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:06.189 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T22:07:26.190 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:07:26.522 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:07:26.524 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:07:26.542 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-04-25T22:07:25.707904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127966494,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2864,"num_read_kb":1340487,"num_write":29405,"num_write_kb":4408200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33216,"ondisk_log_size":33216,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":261416,"kb_used_data":72528,"kb_used_omap":138,"kb_used_meta":188725,"kb_avail":282854104,"statfs":{"total":289910292480,"available":289642602496,"internally_reserved":0,"allocated":74268672,"data_stored":257149515,"data_compressed":21852604,"data_compressed_allocated":35381248,"data_compressed_original":219766784,"omap_allocated":141371,"internal_metadata":193255365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004405"},"pg_stats":[{"pgid":"4.3f","version":"76'446","reported_seq":613,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:00.253297+0000","last_change":"2024-04-25T22:07:00.253360+0000","last_active":"2024-04-25T22:07:00.253297+0000","last_peered":"2024-04-25T22:07:00.253297+0000","last_clean":"2024-04-25T22:07:00.253297+0000","last_became_active":"2024-04-25T22:03:33.873739+0000","last_became_peered":"2024-04-25T22:03:33.873739+0000","last_unstale":"2024-04-25T22:07:00.253297+0000","last_undegraded":"2024-04-25T22:07:00.253297+0000","last_fullsized":"2024-04-25T22:07:00.253297+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'446","last_scrub_stamp":"2024-04-25T22:07:00.253077+0000","last_deep_scrub":"76'446","last_deep_scrub_stamp":"2024-04-25T22:07:00.253077+0000","last_clean_scrub_stamp":"2024-04-25T22:07:00.253077+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:21:55.527885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29432,"num_write":407,"num_write_kb":84235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"76'417","reported_seq":579,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:07.245473+0000","last_change":"2024-04-25T22:07:07.245533+0000","last_active":"2024-04-25T22:07:07.245473+0000","last_peered":"2024-04-25T22:07:07.245473+0000","last_clean":"2024-04-25T22:07:07.245473+0000","last_became_active":"2024-04-25T22:03:33.859221+0000","last_became_peered":"2024-04-25T22:03:33.859221+0000","last_unstale":"2024-04-25T22:07:07.245473+0000","last_undegraded":"2024-04-25T22:07:07.245473+0000","last_fullsized":"2024-04-25T22:07:07.245473+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'417","last_scrub_stamp":"2024-04-25T22:07:07.245267+0000","last_deep_scrub":"76'417","last_deep_scrub_stamp":"2024-04-25T22:07:07.245267+0000","last_clean_scrub_stamp":"2024-04-25T22:07:07.245267+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:26:03.301859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":23541,"num_write":389,"num_write_kb":87654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"76'389","reported_seq":559,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.163287+0000","last_change":"2024-04-25T22:06:31.162002+0000","last_active":"2024-04-25T22:06:31.163287+0000","last_peered":"2024-04-25T22:06:31.163287+0000","last_clean":"2024-04-25T22:06:31.163287+0000","last_became_active":"2024-04-25T22:06:31.149675+0000","last_became_peered":"2024-04-25T22:06:31.149675+0000","last_unstale":"2024-04-25T22:06:31.163287+0000","last_undegraded":"2024-04-25T22:06:31.163287+0000","last_fullsized":"2024-04-25T22:06:31.163287+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22311,"num_write":361,"num_write_kb":42975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"76'394","reported_seq":597,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:00.293435+0000","last_change":"2024-04-25T22:07:00.293493+0000","last_active":"2024-04-25T22:07:00.293435+0000","last_peered":"2024-04-25T22:07:00.293435+0000","last_clean":"2024-04-25T22:07:00.293435+0000","last_became_active":"2024-04-25T22:06:23.090780+0000","last_became_peered":"2024-04-25T22:06:23.090780+0000","last_unstale":"2024-04-25T22:07:00.293435+0000","last_undegraded":"2024-04-25T22:07:00.293435+0000","last_fullsized":"2024-04-25T22:07:00.293435+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'394","last_scrub_stamp":"2024-04-25T22:07:00.293232+0000","last_deep_scrub":"76'394","last_deep_scrub_stamp":"2024-04-25T22:07:00.293232+0000","last_clean_scrub_stamp":"2024-04-25T22:07:00.293232+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:44.908041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":20785,"num_write":367,"num_write_kb":63746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"76'429","reported_seq":949,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:15.288146+0000","last_change":"2024-04-25T22:07:15.288208+0000","last_active":"2024-04-25T22:07:15.288146+0000","last_peered":"2024-04-25T22:07:15.288146+0000","last_clean":"2024-04-25T22:07:15.288146+0000","last_became_active":"2024-04-25T22:06:28.836687+0000","last_became_peered":"2024-04-25T22:06:28.836687+0000","last_unstale":"2024-04-25T22:07:15.288146+0000","last_undegraded":"2024-04-25T22:07:15.288146+0000","last_fullsized":"2024-04-25T22:07:15.288146+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'429","last_scrub_stamp":"2024-04-25T22:07:15.287941+0000","last_deep_scrub":"76'429","last_deep_scrub_stamp":"2024-04-25T22:07:15.287941+0000","last_clean_scrub_stamp":"2024-04-25T22:07:15.287941+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:35.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":20896,"num_write":403,"num_write_kb":100255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"76'368","reported_seq":551,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:59.333242+0000","last_change":"2024-04-25T22:06:59.333306+0000","last_active":"2024-04-25T22:06:59.333242+0000","last_peered":"2024-04-25T22:06:59.333242+0000","last_clean":"2024-04-25T22:06:59.333242+0000","last_became_active":"2024-04-25T22:06:23.107939+0000","last_became_peered":"2024-04-25T22:06:23.107939+0000","last_unstale":"2024-04-25T22:06:59.333242+0000","last_undegraded":"2024-04-25T22:06:59.333242+0000","last_fullsized":"2024-04-25T22:06:59.333242+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'368","last_scrub_stamp":"2024-04-25T22:06:59.333035+0000","last_deep_scrub":"76'368","last_deep_scrub_stamp":"2024-04-25T22:06:59.333035+0000","last_clean_scrub_stamp":"2024-04-25T22:06:59.333035+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:57.414174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9362,"num_write":344,"num_write_kb":20831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"76'438","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:58.303992+0000","last_change":"2024-04-25T22:06:58.304135+0000","last_active":"2024-04-25T22:06:58.303992+0000","last_peered":"2024-04-25T22:06:58.303992+0000","last_clean":"2024-04-25T22:06:58.303992+0000","last_became_active":"2024-04-25T22:06:23.098436+0000","last_became_peered":"2024-04-25T22:06:23.098436+0000","last_unstale":"2024-04-25T22:06:58.303992+0000","last_undegraded":"2024-04-25T22:06:58.303992+0000","last_fullsized":"2024-04-25T22:06:58.303992+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'438","last_scrub_stamp":"2024-04-25T22:06:58.303753+0000","last_deep_scrub":"76'438","last_deep_scrub_stamp":"2024-04-25T22:06:58.303753+0000","last_clean_scrub_stamp":"2024-04-25T22:06:58.303753+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:21.625267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25961,"num_write":415,"num_write_kb":72541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'392","reported_seq":611,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:56.232947+0000","last_change":"2024-04-25T22:06:56.233003+0000","last_active":"2024-04-25T22:06:56.232947+0000","last_peered":"2024-04-25T22:06:56.232947+0000","last_clean":"2024-04-25T22:06:56.232947+0000","last_became_active":"2024-04-25T22:06:23.091431+0000","last_became_peered":"2024-04-25T22:06:23.091431+0000","last_unstale":"2024-04-25T22:06:56.232947+0000","last_undegraded":"2024-04-25T22:06:56.232947+0000","last_fullsized":"2024-04-25T22:06:56.232947+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-25T22:06:56.232744+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-25T22:06:56.232744+0000","last_clean_scrub_stamp":"2024-04-25T22:06:56.232744+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:40.030831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":24749,"num_write":354,"num_write_kb":64232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"76'443","reported_seq":660,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:45.368357+0000","last_change":"2024-04-25T22:06:45.368420+0000","last_active":"2024-04-25T22:06:45.368357+0000","last_peered":"2024-04-25T22:06:45.368357+0000","last_clean":"2024-04-25T22:06:45.368357+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:06:45.368357+0000","last_undegraded":"2024-04-25T22:06:45.368357+0000","last_fullsized":"2024-04-25T22:06:45.368357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'443","last_scrub_stamp":"2024-04-25T22:06:45.368156+0000","last_deep_scrub":"76'443","last_deep_scrub_stamp":"2024-04-25T22:06:45.368156+0000","last_clean_scrub_stamp":"2024-04-25T22:06:45.368156+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:07.796649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":10648,"num_write":411,"num_write_kb":92932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'392","reported_seq":520,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:46.196468+0000","last_change":"2024-04-25T22:06:46.196532+0000","last_active":"2024-04-25T22:06:46.196468+0000","last_peered":"2024-04-25T22:06:46.196468+0000","last_clean":"2024-04-25T22:06:46.196468+0000","last_became_active":"2024-04-25T22:06:26.114463+0000","last_became_peered":"2024-04-25T22:06:26.114463+0000","last_unstale":"2024-04-25T22:06:46.196468+0000","last_undegraded":"2024-04-25T22:06:46.196468+0000","last_fullsized":"2024-04-25T22:06:46.196468+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-25T22:06:46.196270+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-25T22:06:46.196270+0000","last_clean_scrub_stamp":"2024-04-25T22:06:46.196270+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:57:43.306329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10696,"num_write":359,"num_write_kb":63259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'391","reported_seq":578,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:49.260343+0000","last_change":"2024-04-25T22:06:49.260414+0000","last_active":"2024-04-25T22:06:49.260343+0000","last_peered":"2024-04-25T22:06:49.260343+0000","last_clean":"2024-04-25T22:06:49.260343+0000","last_became_active":"2024-04-25T22:06:23.123801+0000","last_became_peered":"2024-04-25T22:06:23.123801+0000","last_unstale":"2024-04-25T22:06:49.260343+0000","last_undegraded":"2024-04-25T22:06:49.260343+0000","last_fullsized":"2024-04-25T22:06:49.260343+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'391","last_scrub_stamp":"2024-04-25T22:06:49.260130+0000","last_deep_scrub":"76'391","last_deep_scrub_stamp":"2024-04-25T22:06:49.260130+0000","last_clean_scrub_stamp":"2024-04-25T22:06:49.260130+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:42:51.390054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11259,"num_write":372,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"76'365","reported_seq":656,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:55.308601+0000","last_change":"2024-04-25T22:06:55.308732+0000","last_active":"2024-04-25T22:06:55.308601+0000","last_peered":"2024-04-25T22:06:55.308601+0000","last_clean":"2024-04-25T22:06:55.308601+0000","last_became_active":"2024-04-25T22:06:22.792880+0000","last_became_peered":"2024-04-25T22:06:22.792880+0000","last_unstale":"2024-04-25T22:06:55.308601+0000","last_undegraded":"2024-04-25T22:06:55.308601+0000","last_fullsized":"2024-04-25T22:06:55.308601+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'365","last_scrub_stamp":"2024-04-25T22:06:55.308350+0000","last_deep_scrub":"76'365","last_deep_scrub_stamp":"2024-04-25T22:06:55.308350+0000","last_clean_scrub_stamp":"2024-04-25T22:06:55.308350+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:27:30.240705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":51972,"num_write":340,"num_write_kb":51203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"76'420","reported_seq":583,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:02.284192+0000","last_change":"2024-04-25T22:07:02.284254+0000","last_active":"2024-04-25T22:07:02.284192+0000","last_peered":"2024-04-25T22:07:02.284192+0000","last_clean":"2024-04-25T22:07:02.284192+0000","last_became_active":"2024-04-25T22:03:33.859376+0000","last_became_peered":"2024-04-25T22:03:33.859376+0000","last_unstale":"2024-04-25T22:07:02.284192+0000","last_undegraded":"2024-04-25T22:07:02.284192+0000","last_fullsized":"2024-04-25T22:07:02.284192+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'420","last_scrub_stamp":"2024-04-25T22:07:02.283992+0000","last_deep_scrub":"76'420","last_deep_scrub_stamp":"2024-04-25T22:07:02.283992+0000","last_clean_scrub_stamp":"2024-04-25T22:07:02.283992+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:50:55.188773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17620,"num_write":386,"num_write_kb":100613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"76'432","reported_seq":640,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:54.219993+0000","last_change":"2024-04-25T22:06:54.220062+0000","last_active":"2024-04-25T22:06:54.219993+0000","last_peered":"2024-04-25T22:06:54.219993+0000","last_clean":"2024-04-25T22:06:54.219993+0000","last_became_active":"2024-04-25T22:06:23.081466+0000","last_became_peered":"2024-04-25T22:06:23.081466+0000","last_unstale":"2024-04-25T22:06:54.219993+0000","last_undegraded":"2024-04-25T22:06:54.219993+0000","last_fullsized":"2024-04-25T22:06:54.219993+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'432","last_scrub_stamp":"2024-04-25T22:06:54.219768+0000","last_deep_scrub":"76'432","last_deep_scrub_stamp":"2024-04-25T22:06:54.219768+0000","last_clean_scrub_stamp":"2024-04-25T22:06:54.219768+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:09:43.916848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27327,"num_write":398,"num_write_kb":76113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"76'385","reported_seq":593,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:08.406753+0000","last_change":"2024-04-25T22:07:08.406812+0000","last_active":"2024-04-25T22:07:08.406753+0000","last_peered":"2024-04-25T22:07:08.406753+0000","last_clean":"2024-04-25T22:07:08.406753+0000","last_became_active":"2024-04-25T22:06:23.088046+0000","last_became_peered":"2024-04-25T22:06:23.088046+0000","last_unstale":"2024-04-25T22:07:08.406753+0000","last_undegraded":"2024-04-25T22:07:08.406753+0000","last_fullsized":"2024-04-25T22:07:08.406753+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'385","last_scrub_stamp":"2024-04-25T22:07:08.406540+0000","last_deep_scrub":"76'385","last_deep_scrub_stamp":"2024-04-25T22:07:08.406540+0000","last_clean_scrub_stamp":"2024-04-25T22:07:08.406540+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:05.143266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23986,"num_write":352,"num_write_kb":50754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"76'434","reported_seq":624,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:05.382308+0000","last_change":"2024-04-25T22:07:05.382390+0000","last_active":"2024-04-25T22:07:05.382308+0000","last_peered":"2024-04-25T22:07:05.382308+0000","last_clean":"2024-04-25T22:07:05.382308+0000","last_became_active":"2024-04-25T22:06:23.117497+0000","last_became_peered":"2024-04-25T22:06:23.117497+0000","last_unstale":"2024-04-25T22:07:05.382308+0000","last_undegraded":"2024-04-25T22:07:05.382308+0000","last_fullsized":"2024-04-25T22:07:05.382308+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'434","last_scrub_stamp":"2024-04-25T22:07:05.382085+0000","last_deep_scrub":"76'434","last_deep_scrub_stamp":"2024-04-25T22:07:05.382085+0000","last_clean_scrub_stamp":"2024-04-25T22:07:05.382085+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:51:28.918275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":13806,"num_write":403,"num_write_kb":38995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"76'444","reported_seq":667,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:52.384689+0000","last_change":"2024-04-25T22:06:52.384748+0000","last_active":"2024-04-25T22:06:52.384689+0000","last_peered":"2024-04-25T22:06:52.384689+0000","last_clean":"2024-04-25T22:06:52.384689+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:06:52.384689+0000","last_undegraded":"2024-04-25T22:06:52.384689+0000","last_fullsized":"2024-04-25T22:06:52.384689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'444","last_scrub_stamp":"2024-04-25T22:06:52.384489+0000","last_deep_scrub":"76'444","last_deep_scrub_stamp":"2024-04-25T22:06:52.384489+0000","last_clean_scrub_stamp":"2024-04-25T22:06:52.384489+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:55:00.266704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":11085,"num_write":416,"num_write_kb":68377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'396","reported_seq":540,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:09.190535+0000","last_change":"2024-04-25T22:07:09.190595+0000","last_active":"2024-04-25T22:07:09.190535+0000","last_peered":"2024-04-25T22:07:09.190535+0000","last_clean":"2024-04-25T22:07:09.190535+0000","last_became_active":"2024-04-25T22:03:33.861082+0000","last_became_peered":"2024-04-25T22:03:33.861082+0000","last_unstale":"2024-04-25T22:07:09.190535+0000","last_undegraded":"2024-04-25T22:07:09.190535+0000","last_fullsized":"2024-04-25T22:07:09.190535+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'396","last_scrub_stamp":"2024-04-25T22:07:09.190338+0000","last_deep_scrub":"76'396","last_deep_scrub_stamp":"2024-04-25T22:07:09.190338+0000","last_clean_scrub_stamp":"2024-04-25T22:07:09.190338+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:14.396415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6581,"num_write":355,"num_write_kb":34159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"76'447","reported_seq":657,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:50.360046+0000","last_change":"2024-04-25T22:06:50.360103+0000","last_active":"2024-04-25T22:06:50.360046+0000","last_peered":"2024-04-25T22:06:50.360046+0000","last_clean":"2024-04-25T22:06:50.360046+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:06:50.360046+0000","last_undegraded":"2024-04-25T22:06:50.360046+0000","last_fullsized":"2024-04-25T22:06:50.360046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'447","last_scrub_stamp":"2024-04-25T22:06:50.359882+0000","last_deep_scrub":"76'447","last_deep_scrub_stamp":"2024-04-25T22:06:50.359882+0000","last_clean_scrub_stamp":"2024-04-25T22:06:50.359882+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:26.034007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22089,"num_write":411,"num_write_kb":104750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'426","reported_seq":613,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:02.372248+0000","last_change":"2024-04-25T22:07:02.372308+0000","last_active":"2024-04-25T22:07:02.372248+0000","last_peered":"2024-04-25T22:07:02.372248+0000","last_clean":"2024-04-25T22:07:02.372248+0000","last_became_active":"2024-04-25T22:06:23.093379+0000","last_became_peered":"2024-04-25T22:06:23.093379+0000","last_unstale":"2024-04-25T22:07:02.372248+0000","last_undegraded":"2024-04-25T22:07:02.372248+0000","last_fullsized":"2024-04-25T22:07:02.372248+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'426","last_scrub_stamp":"2024-04-25T22:07:02.372057+0000","last_deep_scrub":"76'426","last_deep_scrub_stamp":"2024-04-25T22:07:02.372057+0000","last_clean_scrub_stamp":"2024-04-25T22:07:02.372057+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:08:07.136071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11886,"num_write":398,"num_write_kb":55010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"76'405","reported_seq":611,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:57.281296+0000","last_change":"2024-04-25T22:06:57.281355+0000","last_active":"2024-04-25T22:06:57.281296+0000","last_peered":"2024-04-25T22:06:57.281296+0000","last_clean":"2024-04-25T22:06:57.281296+0000","last_became_active":"2024-04-25T22:06:23.110101+0000","last_became_peered":"2024-04-25T22:06:23.110101+0000","last_unstale":"2024-04-25T22:06:57.281296+0000","last_undegraded":"2024-04-25T22:06:57.281296+0000","last_fullsized":"2024-04-25T22:06:57.281296+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'405","last_scrub_stamp":"2024-04-25T22:06:57.281099+0000","last_deep_scrub":"76'405","last_deep_scrub_stamp":"2024-04-25T22:06:57.281099+0000","last_clean_scrub_stamp":"2024-04-25T22:06:57.281099+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:07:32.749764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23004,"num_write":370,"num_write_kb":75802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'436","reported_seq":568,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:14.261669+0000","last_change":"2024-04-25T22:07:14.261807+0000","last_active":"2024-04-25T22:07:14.261669+0000","last_peered":"2024-04-25T22:07:14.261669+0000","last_clean":"2024-04-25T22:07:14.261669+0000","last_became_active":"2024-04-25T22:06:28.835081+0000","last_became_peered":"2024-04-25T22:06:28.835081+0000","last_unstale":"2024-04-25T22:07:14.261669+0000","last_undegraded":"2024-04-25T22:07:14.261669+0000","last_fullsized":"2024-04-25T22:07:14.261669+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'436","last_scrub_stamp":"2024-04-25T22:07:14.261436+0000","last_deep_scrub":"76'436","last_deep_scrub_stamp":"2024-04-25T22:07:14.261436+0000","last_clean_scrub_stamp":"2024-04-25T22:07:14.261436+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:07.985541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11950,"num_write":408,"num_write_kb":67524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"76'403","reported_seq":616,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:09.116357+0000","last_change":"2024-04-25T22:07:09.116418+0000","last_active":"2024-04-25T22:07:09.116357+0000","last_peered":"2024-04-25T22:07:09.116357+0000","last_clean":"2024-04-25T22:07:09.116357+0000","last_became_active":"2024-04-25T22:06:22.802907+0000","last_became_peered":"2024-04-25T22:06:22.802907+0000","last_unstale":"2024-04-25T22:07:09.116357+0000","last_undegraded":"2024-04-25T22:07:09.116357+0000","last_fullsized":"2024-04-25T22:07:09.116357+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'403","last_scrub_stamp":"2024-04-25T22:07:09.116158+0000","last_deep_scrub":"76'403","last_deep_scrub_stamp":"2024-04-25T22:07:09.116158+0000","last_clean_scrub_stamp":"2024-04-25T22:07:09.116158+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:57.443257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":6507,"num_write":370,"num_write_kb":51513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'449","reported_seq":583,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:18.315060+0000","last_change":"2024-04-25T22:07:18.315121+0000","last_active":"2024-04-25T22:07:18.315060+0000","last_peered":"2024-04-25T22:07:18.315060+0000","last_clean":"2024-04-25T22:07:18.315060+0000","last_became_active":"2024-04-25T22:06:28.841283+0000","last_became_peered":"2024-04-25T22:06:28.841283+0000","last_unstale":"2024-04-25T22:07:18.315060+0000","last_undegraded":"2024-04-25T22:07:18.315060+0000","last_fullsized":"2024-04-25T22:07:18.315060+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'449","last_scrub_stamp":"2024-04-25T22:07:18.314849+0000","last_deep_scrub":"76'449","last_deep_scrub_stamp":"2024-04-25T22:07:18.314849+0000","last_clean_scrub_stamp":"2024-04-25T22:07:18.314849+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:22:43.770979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27047,"num_write":417,"num_write_kb":63386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"76'406","reported_seq":580,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:47.323560+0000","last_change":"2024-04-25T22:06:47.323681+0000","last_active":"2024-04-25T22:06:47.323560+0000","last_peered":"2024-04-25T22:06:47.323560+0000","last_clean":"2024-04-25T22:06:47.323560+0000","last_became_active":"2024-04-25T22:06:22.791470+0000","last_became_peered":"2024-04-25T22:06:22.791470+0000","last_unstale":"2024-04-25T22:06:47.323560+0000","last_undegraded":"2024-04-25T22:06:47.323560+0000","last_fullsized":"2024-04-25T22:06:47.323560+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'406","last_scrub_stamp":"2024-04-25T22:06:47.323329+0000","last_deep_scrub":"76'406","last_deep_scrub_stamp":"2024-04-25T22:06:47.323329+0000","last_clean_scrub_stamp":"2024-04-25T22:06:47.323329+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:01:33.331665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25550,"num_write":386,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"76'485","reported_seq":744,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:11.087932+0000","last_change":"2024-04-25T22:07:11.088077+0000","last_active":"2024-04-25T22:07:11.087932+0000","last_peered":"2024-04-25T22:07:11.087932+0000","last_clean":"2024-04-25T22:07:11.087932+0000","last_became_active":"2024-04-25T22:06:22.804228+0000","last_became_peered":"2024-04-25T22:06:22.804228+0000","last_unstale":"2024-04-25T22:07:11.087932+0000","last_undegraded":"2024-04-25T22:07:11.087932+0000","last_fullsized":"2024-04-25T22:07:11.087932+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'485","last_scrub_stamp":"2024-04-25T22:07:11.087681+0000","last_deep_scrub":"76'485","last_deep_scrub_stamp":"2024-04-25T22:07:11.087681+0000","last_clean_scrub_stamp":"2024-04-25T22:07:11.087681+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:53.228615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":30714,"num_write":444,"num_write_kb":92836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'387","reported_seq":601,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:50.226297+0000","last_change":"2024-04-25T22:06:50.226374+0000","last_active":"2024-04-25T22:06:50.226297+0000","last_peered":"2024-04-25T22:06:50.226297+0000","last_clean":"2024-04-25T22:06:50.226297+0000","last_became_active":"2024-04-25T22:06:23.121334+0000","last_became_peered":"2024-04-25T22:06:23.121334+0000","last_unstale":"2024-04-25T22:06:50.226297+0000","last_undegraded":"2024-04-25T22:06:50.226297+0000","last_fullsized":"2024-04-25T22:06:50.226297+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'387","last_scrub_stamp":"2024-04-25T22:06:50.226077+0000","last_deep_scrub":"76'387","last_deep_scrub_stamp":"2024-04-25T22:06:50.226077+0000","last_clean_scrub_stamp":"2024-04-25T22:06:50.226077+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:18.695143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21644,"num_write":354,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"76'405","reported_seq":658,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:12.219420+0000","last_change":"2024-04-25T22:07:12.219487+0000","last_active":"2024-04-25T22:07:12.219420+0000","last_peered":"2024-04-25T22:07:12.219420+0000","last_clean":"2024-04-25T22:07:12.219420+0000","last_became_active":"2024-04-25T22:06:22.827066+0000","last_became_peered":"2024-04-25T22:06:22.827066+0000","last_unstale":"2024-04-25T22:07:12.219420+0000","last_undegraded":"2024-04-25T22:07:12.219420+0000","last_fullsized":"2024-04-25T22:07:12.219420+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'405","last_scrub_stamp":"2024-04-25T22:07:12.219221+0000","last_deep_scrub":"76'405","last_deep_scrub_stamp":"2024-04-25T22:07:12.219221+0000","last_clean_scrub_stamp":"2024-04-25T22:07:12.219221+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:17:15.756637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27522,"num_write":375,"num_write_kb":96416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"76'396","reported_seq":628,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:00.268722+0000","last_change":"2024-04-25T22:07:00.268789+0000","last_active":"2024-04-25T22:07:00.268722+0000","last_peered":"2024-04-25T22:07:00.268722+0000","last_clean":"2024-04-25T22:07:00.268722+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:07:00.268722+0000","last_undegraded":"2024-04-25T22:07:00.268722+0000","last_fullsized":"2024-04-25T22:07:00.268722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'396","last_scrub_stamp":"2024-04-25T22:07:00.268515+0000","last_deep_scrub":"76'396","last_deep_scrub_stamp":"2024-04-25T22:07:00.268515+0000","last_clean_scrub_stamp":"2024-04-25T22:07:00.268515+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:23.333678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28501,"num_write":367,"num_write_kb":63458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":663,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:53.312799+0000","last_change":"2024-04-25T22:06:53.312857+0000","last_active":"2024-04-25T22:06:53.312799+0000","last_peered":"2024-04-25T22:06:53.312799+0000","last_clean":"2024-04-25T22:06:53.312799+0000","last_became_active":"2024-04-25T22:06:22.789907+0000","last_became_peered":"2024-04-25T22:06:22.789907+0000","last_unstale":"2024-04-25T22:06:53.312799+0000","last_undegraded":"2024-04-25T22:06:53.312799+0000","last_fullsized":"2024-04-25T22:06:53.312799+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'467","last_scrub_stamp":"2024-04-25T22:06:53.312600+0000","last_deep_scrub":"76'467","last_deep_scrub_stamp":"2024-04-25T22:06:53.312600+0000","last_clean_scrub_stamp":"2024-04-25T22:06:53.312600+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:25:54.392796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":20717,"num_write":435,"num_write_kb":55985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"76'444","reported_seq":656,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:56.323884+0000","last_change":"2024-04-25T22:06:56.323943+0000","last_active":"2024-04-25T22:06:56.323884+0000","last_peered":"2024-04-25T22:06:56.323884+0000","last_clean":"2024-04-25T22:06:56.323884+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:06:56.323884+0000","last_undegraded":"2024-04-25T22:06:56.323884+0000","last_fullsized":"2024-04-25T22:06:56.323884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'444","last_scrub_stamp":"2024-04-25T22:06:56.323664+0000","last_deep_scrub":"76'444","last_deep_scrub_stamp":"2024-04-25T22:06:56.323664+0000","last_clean_scrub_stamp":"2024-04-25T22:06:56.323664+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:25:57.403859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":10758,"num_write":401,"num_write_kb":44705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'422","reported_seq":542,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:20.411060+0000","last_change":"2024-04-25T22:07:20.411120+0000","last_active":"2024-04-25T22:07:20.411060+0000","last_peered":"2024-04-25T22:07:20.411060+0000","last_clean":"2024-04-25T22:07:20.411060+0000","last_became_active":"2024-04-25T22:06:31.148129+0000","last_became_peered":"2024-04-25T22:06:31.148129+0000","last_unstale":"2024-04-25T22:07:20.411060+0000","last_undegraded":"2024-04-25T22:07:20.411060+0000","last_fullsized":"2024-04-25T22:07:20.411060+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'422","last_scrub_stamp":"2024-04-25T22:07:20.410861+0000","last_deep_scrub":"76'422","last_deep_scrub_stamp":"2024-04-25T22:07:20.410861+0000","last_clean_scrub_stamp":"2024-04-25T22:07:20.410861+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:39.605159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":29059,"num_write":391,"num_write_kb":40233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"76'397","reported_seq":903,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:13.265192+0000","last_change":"2024-04-25T22:07:13.265252+0000","last_active":"2024-04-25T22:07:13.265192+0000","last_peered":"2024-04-25T22:07:13.265192+0000","last_clean":"2024-04-25T22:07:13.265192+0000","last_became_active":"2024-04-25T22:06:26.816439+0000","last_became_peered":"2024-04-25T22:06:26.816439+0000","last_unstale":"2024-04-25T22:07:13.265192+0000","last_undegraded":"2024-04-25T22:07:13.265192+0000","last_fullsized":"2024-04-25T22:07:13.265192+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'397","last_scrub_stamp":"2024-04-25T22:07:13.264988+0000","last_deep_scrub":"76'397","last_deep_scrub_stamp":"2024-04-25T22:07:13.264988+0000","last_clean_scrub_stamp":"2024-04-25T22:07:13.264988+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:27:37.954651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28857,"num_write":363,"num_write_kb":87969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"99'519","reported_seq":684,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:04.502040+0000","last_change":"2024-04-25T22:07:04.502134+0000","last_active":"2024-04-25T22:07:04.502040+0000","last_peered":"2024-04-25T22:07:04.502040+0000","last_clean":"2024-04-25T22:07:04.502040+0000","last_became_active":"2024-04-25T22:06:23.109665+0000","last_became_peered":"2024-04-25T22:06:23.109665+0000","last_unstale":"2024-04-25T22:07:04.502040+0000","last_undegraded":"2024-04-25T22:07:04.502040+0000","last_fullsized":"2024-04-25T22:07:04.502040+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'519","last_scrub_stamp":"2024-04-25T22:07:04.501844+0000","last_deep_scrub":"99'519","last_deep_scrub_stamp":"2024-04-25T22:07:04.501844+0000","last_clean_scrub_stamp":"2024-04-25T22:07:04.501844+0000","objects_scrubbed":4,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:05:56.974364+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"76'375","reported_seq":490,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:17.291199+0000","last_change":"2024-04-25T22:07:17.291261+0000","last_active":"2024-04-25T22:07:17.291199+0000","last_peered":"2024-04-25T22:07:17.291199+0000","last_clean":"2024-04-25T22:07:17.291199+0000","last_became_active":"2024-04-25T22:06:28.841545+0000","last_became_peered":"2024-04-25T22:06:28.841545+0000","last_unstale":"2024-04-25T22:07:17.291199+0000","last_undegraded":"2024-04-25T22:07:17.291199+0000","last_fullsized":"2024-04-25T22:07:17.291199+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'375","last_scrub_stamp":"2024-04-25T22:07:17.290999+0000","last_deep_scrub":"76'375","last_deep_scrub_stamp":"2024-04-25T22:07:17.290999+0000","last_clean_scrub_stamp":"2024-04-25T22:07:17.290999+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:54.420030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14983,"num_write":339,"num_write_kb":46748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'53","reported_seq":246,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:15.095568+0000","last_change":"2024-04-25T22:07:15.095723+0000","last_active":"2024-04-25T22:07:15.095568+0000","last_peered":"2024-04-25T22:07:15.095568+0000","last_clean":"2024-04-25T22:07:15.095568+0000","last_became_active":"2024-04-25T22:06:22.833424+0000","last_became_peered":"2024-04-25T22:06:22.833424+0000","last_unstale":"2024-04-25T22:07:15.095568+0000","last_undegraded":"2024-04-25T22:07:15.095568+0000","last_fullsized":"2024-04-25T22:07:15.095568+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'53","last_scrub_stamp":"2024-04-25T22:07:15.095263+0000","last_deep_scrub":"76'53","last_deep_scrub_stamp":"2024-04-25T22:07:15.095263+0000","last_clean_scrub_stamp":"2024-04-25T22:07:15.095263+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:30:34.731142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'426","reported_seq":648,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:16.065300+0000","last_change":"2024-04-25T22:07:16.065360+0000","last_active":"2024-04-25T22:07:16.065300+0000","last_peered":"2024-04-25T22:07:16.065300+0000","last_clean":"2024-04-25T22:07:16.065300+0000","last_became_active":"2024-04-25T22:06:26.819562+0000","last_became_peered":"2024-04-25T22:06:26.819562+0000","last_unstale":"2024-04-25T22:07:16.065300+0000","last_undegraded":"2024-04-25T22:07:16.065300+0000","last_fullsized":"2024-04-25T22:07:16.065300+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'426","last_scrub_stamp":"2024-04-25T22:07:16.065093+0000","last_deep_scrub":"76'426","last_deep_scrub_stamp":"2024-04-25T22:07:16.065093+0000","last_clean_scrub_stamp":"2024-04-25T22:07:16.065093+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:16.467510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":17843,"num_write":388,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"75'71","reported_seq":197,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:54.348264+0000","last_change":"2024-04-25T22:06:54.348343+0000","last_active":"2024-04-25T22:06:54.348264+0000","last_peered":"2024-04-25T22:06:54.348264+0000","last_clean":"2024-04-25T22:06:54.348264+0000","last_became_active":"2024-04-25T22:06:22.790902+0000","last_became_peered":"2024-04-25T22:06:22.790902+0000","last_unstale":"2024-04-25T22:06:54.348264+0000","last_undegraded":"2024-04-25T22:06:54.348264+0000","last_fullsized":"2024-04-25T22:06:54.348264+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'71","last_scrub_stamp":"2024-04-25T22:06:54.348062+0000","last_deep_scrub":"75'71","last_deep_scrub_stamp":"2024-04-25T22:06:54.348062+0000","last_clean_scrub_stamp":"2024-04-25T22:06:54.348062+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:52.012973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'366","reported_seq":580,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:57.292147+0000","last_change":"2024-04-25T22:06:57.292206+0000","last_active":"2024-04-25T22:06:57.292147+0000","last_peered":"2024-04-25T22:06:57.292147+0000","last_clean":"2024-04-25T22:06:57.292147+0000","last_became_active":"2024-04-25T22:06:22.803327+0000","last_became_peered":"2024-04-25T22:06:22.803327+0000","last_unstale":"2024-04-25T22:06:57.292147+0000","last_undegraded":"2024-04-25T22:06:57.292147+0000","last_fullsized":"2024-04-25T22:06:57.292147+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'366","last_scrub_stamp":"2024-04-25T22:06:57.291947+0000","last_deep_scrub":"76'366","last_deep_scrub_stamp":"2024-04-25T22:06:57.291947+0000","last_clean_scrub_stamp":"2024-04-25T22:06:57.291947+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:09.795809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":16032,"num_write":334,"num_write_kb":25754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"99'67","reported_seq":234,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:13.470396+0000","last_change":"2024-04-25T22:07:13.470473+0000","last_active":"2024-04-25T22:07:13.470396+0000","last_peered":"2024-04-25T22:07:13.470396+0000","last_clean":"2024-04-25T22:07:13.470396+0000","last_became_active":"2024-04-25T22:06:23.082351+0000","last_became_peered":"2024-04-25T22:06:23.082351+0000","last_unstale":"2024-04-25T22:07:13.470396+0000","last_undegraded":"2024-04-25T22:07:13.470396+0000","last_fullsized":"2024-04-25T22:07:13.470396+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'67","last_scrub_stamp":"2024-04-25T22:07:13.470182+0000","last_deep_scrub":"99'67","last_deep_scrub_stamp":"2024-04-25T22:07:13.470182+0000","last_clean_scrub_stamp":"2024-04-25T22:07:13.470182+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:55.110005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"99'150","reported_seq":317,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:14.467532+0000","last_change":"2024-04-25T22:07:14.467603+0000","last_active":"2024-04-25T22:07:14.467532+0000","last_peered":"2024-04-25T22:07:14.467532+0000","last_clean":"2024-04-25T22:07:14.467532+0000","last_became_active":"2024-04-25T22:06:23.085599+0000","last_became_peered":"2024-04-25T22:06:23.085599+0000","last_unstale":"2024-04-25T22:07:14.467532+0000","last_undegraded":"2024-04-25T22:07:14.467532+0000","last_fullsized":"2024-04-25T22:07:14.467532+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'150","last_scrub_stamp":"2024-04-25T22:07:14.467336+0000","last_deep_scrub":"99'150","last_deep_scrub_stamp":"2024-04-25T22:07:14.467336+0000","last_clean_scrub_stamp":"2024-04-25T22:07:14.467336+0000","objects_scrubbed":2,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:51:47.159916+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"76'402","reported_seq":577,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:49.330680+0000","last_change":"2024-04-25T22:06:49.330746+0000","last_active":"2024-04-25T22:06:49.330680+0000","last_peered":"2024-04-25T22:06:49.330680+0000","last_clean":"2024-04-25T22:06:49.330680+0000","last_became_active":"2024-04-25T22:06:22.789353+0000","last_became_peered":"2024-04-25T22:06:22.789353+0000","last_unstale":"2024-04-25T22:06:49.330680+0000","last_undegraded":"2024-04-25T22:06:49.330680+0000","last_fullsized":"2024-04-25T22:06:49.330680+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'402","last_scrub_stamp":"2024-04-25T22:06:49.330473+0000","last_deep_scrub":"76'402","last_deep_scrub_stamp":"2024-04-25T22:06:49.330473+0000","last_clean_scrub_stamp":"2024-04-25T22:06:49.330473+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:52:42.763698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21114,"num_write":364,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"99'252","reported_seq":385,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:58.252735+0000","last_change":"2024-04-25T22:06:58.252804+0000","last_active":"2024-04-25T22:06:58.252735+0000","last_peered":"2024-04-25T22:06:58.252735+0000","last_clean":"2024-04-25T22:06:58.252735+0000","last_became_active":"2024-04-25T22:06:22.790508+0000","last_became_peered":"2024-04-25T22:06:22.790508+0000","last_unstale":"2024-04-25T22:06:58.252735+0000","last_undegraded":"2024-04-25T22:06:58.252735+0000","last_fullsized":"2024-04-25T22:06:58.252735+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'252","last_scrub_stamp":"2024-04-25T22:06:58.252549+0000","last_deep_scrub":"99'252","last_deep_scrub_stamp":"2024-04-25T22:06:58.252549+0000","last_clean_scrub_stamp":"2024-04-25T22:06:58.252549+0000","objects_scrubbed":2,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:43.769236+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"76'460","reported_seq":643,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:06.238527+0000","last_change":"2024-04-25T22:07:06.238653+0000","last_active":"2024-04-25T22:07:06.238527+0000","last_peered":"2024-04-25T22:07:06.238527+0000","last_clean":"2024-04-25T22:07:06.238527+0000","last_became_active":"2024-04-25T22:03:33.856638+0000","last_became_peered":"2024-04-25T22:03:33.856638+0000","last_unstale":"2024-04-25T22:07:06.238527+0000","last_undegraded":"2024-04-25T22:07:06.238527+0000","last_fullsized":"2024-04-25T22:07:06.238527+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'460","last_scrub_stamp":"2024-04-25T22:07:06.238299+0000","last_deep_scrub":"76'460","last_deep_scrub_stamp":"2024-04-25T22:07:06.238299+0000","last_clean_scrub_stamp":"2024-04-25T22:07:06.238299+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.565399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":39774,"num_write":433,"num_write_kb":80294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"99'558","reported_seq":725,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:45.280721+0000","last_change":"2024-04-25T22:06:45.280807+0000","last_active":"2024-04-25T22:06:45.280721+0000","last_peered":"2024-04-25T22:06:45.280721+0000","last_clean":"2024-04-25T22:06:45.280721+0000","last_became_active":"2024-04-25T22:06:31.147569+0000","last_became_peered":"2024-04-25T22:06:31.147569+0000","last_unstale":"2024-04-25T22:06:45.280721+0000","last_undegraded":"2024-04-25T22:06:45.280721+0000","last_fullsized":"2024-04-25T22:06:45.280721+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'558","last_scrub_stamp":"2024-04-25T22:06:45.280524+0000","last_deep_scrub":"99'558","last_deep_scrub_stamp":"2024-04-25T22:06:45.280524+0000","last_clean_scrub_stamp":"2024-04-25T22:06:45.280524+0000","objects_scrubbed":2,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:31:33.133373+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":509,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"76'413","reported_seq":586,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:01.332914+0000","last_change":"2024-04-25T22:07:01.332973+0000","last_active":"2024-04-25T22:07:01.332914+0000","last_peered":"2024-04-25T22:07:01.332914+0000","last_clean":"2024-04-25T22:07:01.332914+0000","last_became_active":"2024-04-25T22:06:23.108199+0000","last_became_peered":"2024-04-25T22:06:23.108199+0000","last_unstale":"2024-04-25T22:07:01.332914+0000","last_undegraded":"2024-04-25T22:07:01.332914+0000","last_fullsized":"2024-04-25T22:07:01.332914+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'413","last_scrub_stamp":"2024-04-25T22:07:01.332716+0000","last_deep_scrub":"76'413","last_deep_scrub_stamp":"2024-04-25T22:07:01.332716+0000","last_clean_scrub_stamp":"2024-04-25T22:07:01.332716+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:21.860916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4858,"num_write":378,"num_write_kb":46741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"76'66","reported_seq":78,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.162908+0000","last_change":"2024-04-25T22:06:31.161275+0000","last_active":"2024-04-25T22:06:31.162908+0000","last_peered":"2024-04-25T22:06:31.162908+0000","last_clean":"2024-04-25T22:06:31.162908+0000","last_became_active":"2024-04-25T22:06:31.160267+0000","last_became_peered":"2024-04-25T22:06:31.160267+0000","last_unstale":"2024-04-25T22:06:31.162908+0000","last_undegraded":"2024-04-25T22:06:31.162908+0000","last_fullsized":"2024-04-25T22:06:31.162908+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"76'489","reported_seq":738,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:14.094418+0000","last_change":"2024-04-25T22:07:14.094536+0000","last_active":"2024-04-25T22:07:14.094418+0000","last_peered":"2024-04-25T22:07:14.094418+0000","last_clean":"2024-04-25T22:07:14.094418+0000","last_became_active":"2024-04-25T22:06:22.832394+0000","last_became_peered":"2024-04-25T22:06:22.832394+0000","last_unstale":"2024-04-25T22:07:14.094418+0000","last_undegraded":"2024-04-25T22:07:14.094418+0000","last_fullsized":"2024-04-25T22:07:14.094418+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'489","last_scrub_stamp":"2024-04-25T22:07:14.094188+0000","last_deep_scrub":"76'489","last_deep_scrub_stamp":"2024-04-25T22:07:14.094188+0000","last_clean_scrub_stamp":"2024-04-25T22:07:14.094188+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:53.151213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":26829,"num_write":457,"num_write_kb":137840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"99'196","reported_seq":389,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:13.184527+0000","last_change":"2024-04-25T22:07:13.184594+0000","last_active":"2024-04-25T22:07:13.184527+0000","last_peered":"2024-04-25T22:07:13.184527+0000","last_clean":"2024-04-25T22:07:13.184527+0000","last_became_active":"2024-04-25T22:06:22.832572+0000","last_became_peered":"2024-04-25T22:06:22.832572+0000","last_unstale":"2024-04-25T22:07:13.184527+0000","last_undegraded":"2024-04-25T22:07:13.184527+0000","last_fullsized":"2024-04-25T22:07:13.184527+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'196","last_scrub_stamp":"2024-04-25T22:07:13.184347+0000","last_deep_scrub":"99'196","last_deep_scrub_stamp":"2024-04-25T22:07:13.184347+0000","last_clean_scrub_stamp":"2024-04-25T22:07:13.184347+0000","objects_scrubbed":3,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:01:41.577853+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'437","reported_seq":537,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:19.418219+0000","last_change":"2024-04-25T22:07:19.418283+0000","last_active":"2024-04-25T22:07:19.418219+0000","last_peered":"2024-04-25T22:07:19.418219+0000","last_clean":"2024-04-25T22:07:19.418219+0000","last_became_active":"2024-04-25T22:06:31.147501+0000","last_became_peered":"2024-04-25T22:06:31.147501+0000","last_unstale":"2024-04-25T22:07:19.418219+0000","last_undegraded":"2024-04-25T22:07:19.418219+0000","last_fullsized":"2024-04-25T22:07:19.418219+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'437","last_scrub_stamp":"2024-04-25T22:07:19.418017+0000","last_deep_scrub":"76'437","last_deep_scrub_stamp":"2024-04-25T22:07:19.418017+0000","last_clean_scrub_stamp":"2024-04-25T22:07:19.418017+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:39.260894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3720,"num_write":406,"num_write_kb":30461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"99'107","reported_seq":274,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:53.251811+0000","last_change":"2024-04-25T22:06:53.251880+0000","last_active":"2024-04-25T22:06:53.251811+0000","last_peered":"2024-04-25T22:06:53.251811+0000","last_clean":"2024-04-25T22:06:53.251811+0000","last_became_active":"2024-04-25T22:06:23.103402+0000","last_became_peered":"2024-04-25T22:06:23.103402+0000","last_unstale":"2024-04-25T22:06:53.251811+0000","last_undegraded":"2024-04-25T22:06:53.251811+0000","last_fullsized":"2024-04-25T22:06:53.251811+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'107","last_scrub_stamp":"2024-04-25T22:06:53.251612+0000","last_deep_scrub":"99'107","last_deep_scrub_stamp":"2024-04-25T22:06:53.251612+0000","last_clean_scrub_stamp":"2024-04-25T22:06:53.251612+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:04.829272+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"76'409","reported_seq":614,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:17.477756+0000","last_change":"2024-04-25T22:07:17.477819+0000","last_active":"2024-04-25T22:07:17.477756+0000","last_peered":"2024-04-25T22:07:17.477756+0000","last_clean":"2024-04-25T22:07:17.477756+0000","last_became_active":"2024-04-25T22:06:23.086188+0000","last_became_peered":"2024-04-25T22:06:23.086188+0000","last_unstale":"2024-04-25T22:07:17.477756+0000","last_undegraded":"2024-04-25T22:07:17.477756+0000","last_fullsized":"2024-04-25T22:07:17.477756+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'409","last_scrub_stamp":"2024-04-25T22:07:17.477549+0000","last_deep_scrub":"76'409","last_deep_scrub_stamp":"2024-04-25T22:07:17.477549+0000","last_clean_scrub_stamp":"2024-04-25T22:07:17.477549+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:54.689693+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19178,"num_write":380,"num_write_kb":91945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"75'51","reported_seq":191,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:52.354233+0000","last_change":"2024-04-25T22:06:52.354294+0000","last_active":"2024-04-25T22:06:52.354233+0000","last_peered":"2024-04-25T22:06:52.354233+0000","last_clean":"2024-04-25T22:06:52.354233+0000","last_became_active":"2024-04-25T22:06:22.798779+0000","last_became_peered":"2024-04-25T22:06:22.798779+0000","last_unstale":"2024-04-25T22:06:52.354233+0000","last_undegraded":"2024-04-25T22:06:52.354233+0000","last_fullsized":"2024-04-25T22:06:52.354233+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'51","last_scrub_stamp":"2024-04-25T22:06:52.354033+0000","last_deep_scrub":"75'51","last_deep_scrub_stamp":"2024-04-25T22:06:52.354033+0000","last_clean_scrub_stamp":"2024-04-25T22:06:52.354033+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:03.260840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"76'377","reported_seq":570,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:15.453287+0000","last_change":"2024-04-25T22:07:15.453351+0000","last_active":"2024-04-25T22:07:15.453287+0000","last_peered":"2024-04-25T22:07:15.453287+0000","last_clean":"2024-04-25T22:07:15.453287+0000","last_became_active":"2024-04-25T22:06:23.085799+0000","last_became_peered":"2024-04-25T22:06:23.085799+0000","last_unstale":"2024-04-25T22:07:15.453287+0000","last_undegraded":"2024-04-25T22:07:15.453287+0000","last_fullsized":"2024-04-25T22:07:15.453287+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'377","last_scrub_stamp":"2024-04-25T22:07:15.453079+0000","last_deep_scrub":"76'377","last_deep_scrub_stamp":"2024-04-25T22:07:15.453079+0000","last_clean_scrub_stamp":"2024-04-25T22:07:15.453079+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:57:20.532715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21517,"num_write":342,"num_write_kb":66898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"99'450","reported_seq":556,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:05.302933+0000","last_change":"2024-04-25T22:07:05.303001+0000","last_active":"2024-04-25T22:07:05.302933+0000","last_peered":"2024-04-25T22:07:05.302933+0000","last_clean":"2024-04-25T22:07:05.302933+0000","last_became_active":"2024-04-25T22:03:33.859539+0000","last_became_peered":"2024-04-25T22:03:33.859539+0000","last_unstale":"2024-04-25T22:07:05.302933+0000","last_undegraded":"2024-04-25T22:07:05.302933+0000","last_fullsized":"2024-04-25T22:07:05.302933+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'450","last_scrub_stamp":"2024-04-25T22:07:05.302737+0000","last_deep_scrub":"99'450","last_deep_scrub_stamp":"2024-04-25T22:07:05.302737+0000","last_clean_scrub_stamp":"2024-04-25T22:07:05.302737+0000","objects_scrubbed":1,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:02.614223+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'399","reported_seq":622,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:48.374921+0000","last_change":"2024-04-25T22:06:48.374981+0000","last_active":"2024-04-25T22:06:48.374921+0000","last_peered":"2024-04-25T22:06:48.374921+0000","last_clean":"2024-04-25T22:06:48.374921+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:06:48.374921+0000","last_undegraded":"2024-04-25T22:06:48.374921+0000","last_fullsized":"2024-04-25T22:06:48.374921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'399","last_scrub_stamp":"2024-04-25T22:06:48.374723+0000","last_deep_scrub":"76'399","last_deep_scrub_stamp":"2024-04-25T22:06:48.374723+0000","last_clean_scrub_stamp":"2024-04-25T22:06:48.374723+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:35.715072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17888,"num_write":373,"num_write_kb":67556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"99'159","reported_seq":329,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:10.357281+0000","last_change":"2024-04-25T22:07:10.357348+0000","last_active":"2024-04-25T22:07:10.357281+0000","last_peered":"2024-04-25T22:07:10.357281+0000","last_clean":"2024-04-25T22:07:10.357281+0000","last_became_active":"2024-04-25T22:06:23.080701+0000","last_became_peered":"2024-04-25T22:06:23.080701+0000","last_unstale":"2024-04-25T22:07:10.357281+0000","last_undegraded":"2024-04-25T22:07:10.357281+0000","last_fullsized":"2024-04-25T22:07:10.357281+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'159","last_scrub_stamp":"2024-04-25T22:07:10.357090+0000","last_deep_scrub":"99'159","last_deep_scrub_stamp":"2024-04-25T22:07:10.357090+0000","last_clean_scrub_stamp":"2024-04-25T22:07:10.357090+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:02.962951+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":129,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:06.363110+0000","last_change":"2024-04-25T22:07:06.363169+0000","last_active":"2024-04-25T22:07:06.363110+0000","last_peered":"2024-04-25T22:07:06.363110+0000","last_clean":"2024-04-25T22:07:06.363110+0000","last_became_active":"2024-04-25T22:06:23.108984+0000","last_became_peered":"2024-04-25T22:06:23.108984+0000","last_unstale":"2024-04-25T22:07:06.363110+0000","last_undegraded":"2024-04-25T22:07:06.363110+0000","last_fullsized":"2024-04-25T22:07:06.363110+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:07:06.362912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:07:06.362912+0000","last_clean_scrub_stamp":"2024-04-25T22:07:06.362912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:12.687423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"99'395","reported_seq":581,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:04.236378+0000","last_change":"2024-04-25T22:07:04.236444+0000","last_active":"2024-04-25T22:07:04.236378+0000","last_peered":"2024-04-25T22:07:04.236378+0000","last_clean":"2024-04-25T22:07:04.236378+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:07:04.236378+0000","last_undegraded":"2024-04-25T22:07:04.236378+0000","last_fullsized":"2024-04-25T22:07:04.236378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'395","last_scrub_stamp":"2024-04-25T22:07:04.236195+0000","last_deep_scrub":"99'395","last_deep_scrub_stamp":"2024-04-25T22:07:04.236195+0000","last_clean_scrub_stamp":"2024-04-25T22:07:04.236195+0000","objects_scrubbed":2,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:30.537271+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'463","reported_seq":677,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:07.404028+0000","last_change":"2024-04-25T22:07:07.404094+0000","last_active":"2024-04-25T22:07:07.404028+0000","last_peered":"2024-04-25T22:07:07.404028+0000","last_clean":"2024-04-25T22:07:07.404028+0000","last_became_active":"2024-04-25T22:06:23.082756+0000","last_became_peered":"2024-04-25T22:06:23.082756+0000","last_unstale":"2024-04-25T22:07:07.404028+0000","last_undegraded":"2024-04-25T22:07:07.404028+0000","last_fullsized":"2024-04-25T22:07:07.404028+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'463","last_scrub_stamp":"2024-04-25T22:07:07.403839+0000","last_deep_scrub":"76'463","last_deep_scrub_stamp":"2024-04-25T22:07:07.403839+0000","last_clean_scrub_stamp":"2024-04-25T22:07:07.403839+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:51:06.755260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29270,"num_write":426,"num_write_kb":129367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":129,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:12.417699+0000","last_change":"2024-04-25T22:07:12.417754+0000","last_active":"2024-04-25T22:07:12.417699+0000","last_peered":"2024-04-25T22:07:12.417699+0000","last_clean":"2024-04-25T22:07:12.417699+0000","last_became_active":"2024-04-25T22:06:23.080841+0000","last_became_peered":"2024-04-25T22:06:23.080841+0000","last_unstale":"2024-04-25T22:07:12.417699+0000","last_undegraded":"2024-04-25T22:07:12.417699+0000","last_fullsized":"2024-04-25T22:07:12.417699+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:07:12.417494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:07:12.417494+0000","last_clean_scrub_stamp":"2024-04-25T22:07:12.417494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:25:29.524903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"99'126","reported_seq":382,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:51.379661+0000","last_change":"2024-04-25T22:06:51.379727+0000","last_active":"2024-04-25T22:06:51.379661+0000","last_peered":"2024-04-25T22:06:51.379661+0000","last_clean":"2024-04-25T22:06:51.379661+0000","last_became_active":"2024-04-25T22:06:22.801616+0000","last_became_peered":"2024-04-25T22:06:22.801616+0000","last_unstale":"2024-04-25T22:06:51.379661+0000","last_undegraded":"2024-04-25T22:06:51.379661+0000","last_fullsized":"2024-04-25T22:06:51.379661+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'126","last_scrub_stamp":"2024-04-25T22:06:51.379448+0000","last_deep_scrub":"99'126","last_deep_scrub_stamp":"2024-04-25T22:06:51.379448+0000","last_clean_scrub_stamp":"2024-04-25T22:06:51.379448+0000","objects_scrubbed":1,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:17.624837+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464197,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":63,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'457","reported_seq":655,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:04.274925+0000","last_change":"2024-04-25T22:07:04.274987+0000","last_active":"2024-04-25T22:07:04.274925+0000","last_peered":"2024-04-25T22:07:04.274925+0000","last_clean":"2024-04-25T22:07:04.274925+0000","last_became_active":"2024-04-25T22:03:05.699581+0000","last_became_peered":"2024-04-25T22:03:05.699581+0000","last_unstale":"2024-04-25T22:07:04.274925+0000","last_undegraded":"2024-04-25T22:07:04.274925+0000","last_fullsized":"2024-04-25T22:07:04.274925+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'457","last_scrub_stamp":"2024-04-25T22:07:04.274728+0000","last_deep_scrub":"76'457","last_deep_scrub_stamp":"2024-04-25T22:07:04.274728+0000","last_clean_scrub_stamp":"2024-04-25T22:07:04.274728+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:29:05.674042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":34759,"num_write":424,"num_write_kb":71902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":193,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:02.182470+0000","last_change":"2024-04-25T22:07:02.182470+0000","last_active":"2024-04-25T22:07:02.182470+0000","last_peered":"2024-04-25T22:07:02.182470+0000","last_clean":"2024-04-25T22:07:02.182470+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:07:02.182470+0000","last_undegraded":"2024-04-25T22:07:02.182470+0000","last_fullsized":"2024-04-25T22:07:02.182470+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:07:02.182209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:07:02.182209+0000","last_clean_scrub_stamp":"2024-04-25T22:07:02.182209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:59.290847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"99'313","reported_seq":508,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:48.374024+0000","last_change":"2024-04-25T22:06:48.374024+0000","last_active":"2024-04-25T22:06:48.374024+0000","last_peered":"2024-04-25T22:06:48.374024+0000","last_clean":"2024-04-25T22:06:48.374024+0000","last_became_active":"2024-04-25T22:06:22.794841+0000","last_became_peered":"2024-04-25T22:06:22.794841+0000","last_unstale":"2024-04-25T22:06:48.374024+0000","last_undegraded":"2024-04-25T22:06:48.374024+0000","last_fullsized":"2024-04-25T22:06:48.374024+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'313","last_scrub_stamp":"2024-04-25T22:06:48.373725+0000","last_deep_scrub":"99'313","last_deep_scrub_stamp":"2024-04-25T22:06:48.373725+0000","last_clean_scrub_stamp":"2024-04-25T22:06:48.373725+0000","objects_scrubbed":2,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:53:19.399993+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"76'373","reported_seq":601,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:58.307983+0000","last_change":"2024-04-25T22:06:58.308044+0000","last_active":"2024-04-25T22:06:58.307983+0000","last_peered":"2024-04-25T22:06:58.307983+0000","last_clean":"2024-04-25T22:06:58.307983+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:06:58.307983+0000","last_undegraded":"2024-04-25T22:06:58.307983+0000","last_fullsized":"2024-04-25T22:06:58.307983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'373","last_scrub_stamp":"2024-04-25T22:06:58.307771+0000","last_deep_scrub":"76'373","last_deep_scrub_stamp":"2024-04-25T22:06:58.307771+0000","last_clean_scrub_stamp":"2024-04-25T22:06:58.307771+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:59:19.717093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28273,"num_write":350,"num_write_kb":87787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":129,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:55.211596+0000","last_change":"2024-04-25T22:06:55.211653+0000","last_active":"2024-04-25T22:06:55.211596+0000","last_peered":"2024-04-25T22:06:55.211596+0000","last_clean":"2024-04-25T22:06:55.211596+0000","last_became_active":"2024-04-25T22:06:23.106155+0000","last_became_peered":"2024-04-25T22:06:23.106155+0000","last_unstale":"2024-04-25T22:06:55.211596+0000","last_undegraded":"2024-04-25T22:06:55.211596+0000","last_fullsized":"2024-04-25T22:06:55.211596+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:06:55.211397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:06:55.211397+0000","last_clean_scrub_stamp":"2024-04-25T22:06:55.211397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:35:48.867729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"76'75","reported_seq":78,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.162961+0000","last_change":"2024-04-25T22:06:31.161388+0000","last_active":"2024-04-25T22:06:31.162961+0000","last_peered":"2024-04-25T22:06:31.162961+0000","last_clean":"2024-04-25T22:06:31.162961+0000","last_became_active":"2024-04-25T22:06:31.150555+0000","last_became_peered":"2024-04-25T22:06:31.150555+0000","last_unstale":"2024-04-25T22:06:31.162961+0000","last_undegraded":"2024-04-25T22:06:31.162961+0000","last_fullsized":"2024-04-25T22:06:31.162961+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:12.587237+0000","last_clean_scrub_stamp":"2024-04-25T22:01:12.587237+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"76'461","reported_seq":762,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:54.372989+0000","last_change":"2024-04-25T22:06:54.373047+0000","last_active":"2024-04-25T22:06:54.372989+0000","last_peered":"2024-04-25T22:06:54.372989+0000","last_clean":"2024-04-25T22:06:54.372989+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:06:54.372989+0000","last_undegraded":"2024-04-25T22:06:54.372989+0000","last_fullsized":"2024-04-25T22:06:54.372989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'461","last_scrub_stamp":"2024-04-25T22:06:54.372778+0000","last_deep_scrub":"76'461","last_deep_scrub_stamp":"2024-04-25T22:06:54.372778+0000","last_clean_scrub_stamp":"2024-04-25T22:06:54.372778+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:41:36.037813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":67984,"num_write":425,"num_write_kb":154741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"99'269","reported_seq":435,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:52.220280+0000","last_change":"2024-04-25T22:06:52.220351+0000","last_active":"2024-04-25T22:06:52.220280+0000","last_peered":"2024-04-25T22:06:52.220280+0000","last_clean":"2024-04-25T22:06:52.220280+0000","last_became_active":"2024-04-25T22:06:23.122629+0000","last_became_peered":"2024-04-25T22:06:23.122629+0000","last_unstale":"2024-04-25T22:06:52.220280+0000","last_undegraded":"2024-04-25T22:06:52.220280+0000","last_fullsized":"2024-04-25T22:06:52.220280+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'269","last_scrub_stamp":"2024-04-25T22:06:52.220087+0000","last_deep_scrub":"99'269","last_deep_scrub_stamp":"2024-04-25T22:06:52.220087+0000","last_clean_scrub_stamp":"2024-04-25T22:06:52.220087+0000","objects_scrubbed":1,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:41:51.137396+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":193,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:01.222176+0000","last_change":"2024-04-25T22:07:01.222176+0000","last_active":"2024-04-25T22:07:01.222176+0000","last_peered":"2024-04-25T22:07:01.222176+0000","last_clean":"2024-04-25T22:07:01.222176+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:07:01.222176+0000","last_undegraded":"2024-04-25T22:07:01.222176+0000","last_fullsized":"2024-04-25T22:07:01.222176+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:07:01.221935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:07:01.221935+0000","last_clean_scrub_stamp":"2024-04-25T22:07:01.221935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:46.738622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'398","reported_seq":587,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:56.287898+0000","last_change":"2024-04-25T22:06:56.287961+0000","last_active":"2024-04-25T22:06:56.287898+0000","last_peered":"2024-04-25T22:06:56.287898+0000","last_clean":"2024-04-25T22:06:56.287898+0000","last_became_active":"2024-04-25T22:06:22.789384+0000","last_became_peered":"2024-04-25T22:06:22.789384+0000","last_unstale":"2024-04-25T22:06:56.287898+0000","last_undegraded":"2024-04-25T22:06:56.287898+0000","last_fullsized":"2024-04-25T22:06:56.287898+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'398","last_scrub_stamp":"2024-04-25T22:06:56.287695+0000","last_deep_scrub":"76'398","last_deep_scrub_stamp":"2024-04-25T22:06:56.287695+0000","last_clean_scrub_stamp":"2024-04-25T22:06:56.287695+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:46.536240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":26599,"num_write":366,"num_write_kb":75612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"76'47","reported_seq":233,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:03.149367+0000","last_change":"2024-04-25T22:07:03.149431+0000","last_active":"2024-04-25T22:07:03.149367+0000","last_peered":"2024-04-25T22:07:03.149367+0000","last_clean":"2024-04-25T22:07:03.149367+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:07:03.149367+0000","last_undegraded":"2024-04-25T22:07:03.149367+0000","last_fullsized":"2024-04-25T22:07:03.149367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'47","last_scrub_stamp":"2024-04-25T22:07:03.149177+0000","last_deep_scrub":"76'47","last_deep_scrub_stamp":"2024-04-25T22:07:03.149177+0000","last_clean_scrub_stamp":"2024-04-25T22:07:03.149177+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:21:58.423985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:03.277555+0000","last_change":"2024-04-25T22:07:03.277555+0000","last_active":"2024-04-25T22:07:03.277555+0000","last_peered":"2024-04-25T22:07:03.277555+0000","last_clean":"2024-04-25T22:07:03.277555+0000","last_became_active":"2024-04-25T22:03:05.701322+0000","last_became_peered":"2024-04-25T22:03:05.701322+0000","last_unstale":"2024-04-25T22:07:03.277555+0000","last_undegraded":"2024-04-25T22:07:03.277555+0000","last_fullsized":"2024-04-25T22:07:03.277555+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:07:03.277311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:07:03.277311+0000","last_clean_scrub_stamp":"2024-04-25T22:07:03.277311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:22:06.392400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"76'406","reported_seq":651,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:51.374373+0000","last_change":"2024-04-25T22:06:51.374435+0000","last_active":"2024-04-25T22:06:51.374373+0000","last_peered":"2024-04-25T22:06:51.374373+0000","last_clean":"2024-04-25T22:06:51.374373+0000","last_became_active":"2024-04-25T22:06:22.789807+0000","last_became_peered":"2024-04-25T22:06:22.789807+0000","last_unstale":"2024-04-25T22:06:51.374373+0000","last_undegraded":"2024-04-25T22:06:51.374373+0000","last_fullsized":"2024-04-25T22:06:51.374373+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'406","last_scrub_stamp":"2024-04-25T22:06:51.374173+0000","last_deep_scrub":"76'406","last_deep_scrub_stamp":"2024-04-25T22:06:51.374173+0000","last_clean_scrub_stamp":"2024-04-25T22:06:51.374173+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:47:28.548940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25634,"num_write":377,"num_write_kb":103970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"99'65","reported_seq":251,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:05.159413+0000","last_change":"2024-04-25T22:07:05.159483+0000","last_active":"2024-04-25T22:07:05.159413+0000","last_peered":"2024-04-25T22:07:05.159413+0000","last_clean":"2024-04-25T22:07:05.159413+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:07:05.159413+0000","last_undegraded":"2024-04-25T22:07:05.159413+0000","last_fullsized":"2024-04-25T22:07:05.159413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'65","last_scrub_stamp":"2024-04-25T22:07:05.159224+0000","last_deep_scrub":"99'65","last_deep_scrub_stamp":"2024-04-25T22:07:05.159224+0000","last_clean_scrub_stamp":"2024-04-25T22:07:05.159224+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:50:58.064004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:48.237497+0000","last_change":"2024-04-25T22:06:48.237553+0000","last_active":"2024-04-25T22:06:48.237497+0000","last_peered":"2024-04-25T22:06:48.237497+0000","last_clean":"2024-04-25T22:06:48.237497+0000","last_became_active":"2024-04-25T22:06:24.091909+0000","last_became_peered":"2024-04-25T22:06:24.091909+0000","last_unstale":"2024-04-25T22:06:48.237497+0000","last_undegraded":"2024-04-25T22:06:48.237497+0000","last_fullsized":"2024-04-25T22:06:48.237497+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:06:48.237288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:06:48.237288+0000","last_clean_scrub_stamp":"2024-04-25T22:06:48.237288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:42:29.191428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"76'402","reported_seq":615,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:59.274286+0000","last_change":"2024-04-25T22:06:59.274286+0000","last_active":"2024-04-25T22:06:59.274286+0000","last_peered":"2024-04-25T22:06:59.274286+0000","last_clean":"2024-04-25T22:06:59.274286+0000","last_became_active":"2024-04-25T22:06:22.802005+0000","last_became_peered":"2024-04-25T22:06:22.802005+0000","last_unstale":"2024-04-25T22:06:59.274286+0000","last_undegraded":"2024-04-25T22:06:59.274286+0000","last_fullsized":"2024-04-25T22:06:59.274286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'402","last_scrub_stamp":"2024-04-25T22:06:59.274026+0000","last_deep_scrub":"76'402","last_deep_scrub_stamp":"2024-04-25T22:06:59.274026+0000","last_clean_scrub_stamp":"2024-04-25T22:06:59.274026+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:45.358388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9572,"num_write":361,"num_write_kb":29911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"99'128","reported_seq":321,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:53.443568+0000","last_change":"2024-04-25T22:06:53.443633+0000","last_active":"2024-04-25T22:06:53.443568+0000","last_peered":"2024-04-25T22:06:53.443568+0000","last_clean":"2024-04-25T22:06:53.443568+0000","last_became_active":"2024-04-25T22:06:22.802083+0000","last_became_peered":"2024-04-25T22:06:22.802083+0000","last_unstale":"2024-04-25T22:06:53.443568+0000","last_undegraded":"2024-04-25T22:06:53.443568+0000","last_fullsized":"2024-04-25T22:06:53.443568+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'128","last_scrub_stamp":"2024-04-25T22:06:53.443384+0000","last_deep_scrub":"99'128","last_deep_scrub_stamp":"2024-04-25T22:06:53.443384+0000","last_clean_scrub_stamp":"2024-04-25T22:06:53.443384+0000","objects_scrubbed":1,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:23:27.524012+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":129,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:09.390295+0000","last_change":"2024-04-25T22:07:09.390367+0000","last_active":"2024-04-25T22:07:09.390295+0000","last_peered":"2024-04-25T22:07:09.390295+0000","last_clean":"2024-04-25T22:07:09.390295+0000","last_became_active":"2024-04-25T22:06:23.080393+0000","last_became_peered":"2024-04-25T22:06:23.080393+0000","last_unstale":"2024-04-25T22:07:09.390295+0000","last_undegraded":"2024-04-25T22:07:09.390295+0000","last_fullsized":"2024-04-25T22:07:09.390295+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:07:09.390067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:07:09.390067+0000","last_clean_scrub_stamp":"2024-04-25T22:07:09.390067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:59.783125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"76'415","reported_seq":605,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:50.364826+0000","last_change":"2024-04-25T22:06:50.364885+0000","last_active":"2024-04-25T22:06:50.364826+0000","last_peered":"2024-04-25T22:06:50.364826+0000","last_clean":"2024-04-25T22:06:50.364826+0000","last_became_active":"2024-04-25T22:06:22.789624+0000","last_became_peered":"2024-04-25T22:06:22.789624+0000","last_unstale":"2024-04-25T22:06:50.364826+0000","last_undegraded":"2024-04-25T22:06:50.364826+0000","last_fullsized":"2024-04-25T22:06:50.364826+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'415","last_scrub_stamp":"2024-04-25T22:06:50.364620+0000","last_deep_scrub":"76'415","last_deep_scrub_stamp":"2024-04-25T22:06:50.364620+0000","last_clean_scrub_stamp":"2024-04-25T22:06:50.364620+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:27.901357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27345,"num_write":384,"num_write_kb":92854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"76'407","reported_seq":632,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:16.491054+0000","last_change":"2024-04-25T22:07:16.491118+0000","last_active":"2024-04-25T22:07:16.491054+0000","last_peered":"2024-04-25T22:07:16.491054+0000","last_clean":"2024-04-25T22:07:16.491054+0000","last_became_active":"2024-04-25T22:06:23.087118+0000","last_became_peered":"2024-04-25T22:06:23.087118+0000","last_unstale":"2024-04-25T22:07:16.491054+0000","last_undegraded":"2024-04-25T22:07:16.491054+0000","last_fullsized":"2024-04-25T22:07:16.491054+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'407","last_scrub_stamp":"2024-04-25T22:07:16.490854+0000","last_deep_scrub":"76'407","last_deep_scrub_stamp":"2024-04-25T22:07:16.490854+0000","last_clean_scrub_stamp":"2024-04-25T22:07:16.490854+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:48.237867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33923,"num_write":372,"num_write_kb":82083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"99'266","reported_seq":435,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:11.474682+0000","last_change":"2024-04-25T22:07:11.474771+0000","last_active":"2024-04-25T22:07:11.474682+0000","last_peered":"2024-04-25T22:07:11.474682+0000","last_clean":"2024-04-25T22:07:11.474682+0000","last_became_active":"2024-04-25T22:06:23.080552+0000","last_became_peered":"2024-04-25T22:06:23.080552+0000","last_unstale":"2024-04-25T22:07:11.474682+0000","last_undegraded":"2024-04-25T22:07:11.474682+0000","last_fullsized":"2024-04-25T22:07:11.474682+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'266","last_scrub_stamp":"2024-04-25T22:07:11.474487+0000","last_deep_scrub":"99'266","last_deep_scrub_stamp":"2024-04-25T22:07:11.474487+0000","last_clean_scrub_stamp":"2024-04-25T22:07:11.474487+0000","objects_scrubbed":6,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:31.693057+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8470619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"76'408","reported_seq":619,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:46.345971+0000","last_change":"2024-04-25T22:06:46.346032+0000","last_active":"2024-04-25T22:06:46.345971+0000","last_peered":"2024-04-25T22:06:46.345971+0000","last_clean":"2024-04-25T22:06:46.345971+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:06:46.345971+0000","last_undegraded":"2024-04-25T22:06:46.345971+0000","last_fullsized":"2024-04-25T22:06:46.345971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'408","last_scrub_stamp":"2024-04-25T22:06:46.345765+0000","last_deep_scrub":"76'408","last_deep_scrub_stamp":"2024-04-25T22:06:46.345765+0000","last_clean_scrub_stamp":"2024-04-25T22:06:46.345765+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:15.185009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14178,"num_write":370,"num_write_kb":58735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"99'106","reported_seq":300,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:46.291512+0000","last_change":"2024-04-25T22:06:46.291648+0000","last_active":"2024-04-25T22:06:46.291512+0000","last_peered":"2024-04-25T22:06:46.291512+0000","last_clean":"2024-04-25T22:06:46.291512+0000","last_became_active":"2024-04-25T22:06:22.802667+0000","last_became_peered":"2024-04-25T22:06:22.802667+0000","last_unstale":"2024-04-25T22:06:46.291512+0000","last_undegraded":"2024-04-25T22:06:46.291512+0000","last_fullsized":"2024-04-25T22:06:46.291512+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'106","last_scrub_stamp":"2024-04-25T22:06:46.291281+0000","last_deep_scrub":"99'106","last_deep_scrub_stamp":"2024-04-25T22:06:46.291281+0000","last_clean_scrub_stamp":"2024-04-25T22:06:46.291281+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:44:03.703813+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"99'233","reported_seq":296,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:47.268073+0000","last_change":"2024-04-25T22:06:47.268224+0000","last_active":"2024-04-25T22:06:47.268073+0000","last_peered":"2024-04-25T22:06:47.268073+0000","last_clean":"2024-04-25T22:06:47.268073+0000","last_became_active":"2024-04-25T22:06:31.150582+0000","last_became_peered":"2024-04-25T22:06:31.150582+0000","last_unstale":"2024-04-25T22:06:47.268073+0000","last_undegraded":"2024-04-25T22:06:47.268073+0000","last_fullsized":"2024-04-25T22:06:47.268073+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'233","last_scrub_stamp":"2024-04-25T22:06:47.267812+0000","last_deep_scrub":"99'233","last_deep_scrub_stamp":"2024-04-25T22:06:47.267812+0000","last_clean_scrub_stamp":"2024-04-25T22:06:47.267812+0000","objects_scrubbed":1,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:04.023399+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"76'483","reported_seq":722,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:12.079494+0000","last_change":"2024-04-25T22:07:12.079554+0000","last_active":"2024-04-25T22:07:12.079494+0000","last_peered":"2024-04-25T22:07:12.079494+0000","last_clean":"2024-04-25T22:07:12.079494+0000","last_became_active":"2024-04-25T22:06:22.807584+0000","last_became_peered":"2024-04-25T22:06:22.807584+0000","last_unstale":"2024-04-25T22:07:12.079494+0000","last_undegraded":"2024-04-25T22:07:12.079494+0000","last_fullsized":"2024-04-25T22:07:12.079494+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'483","last_scrub_stamp":"2024-04-25T22:07:12.079290+0000","last_deep_scrub":"76'483","last_deep_scrub_stamp":"2024-04-25T22:07:12.079290+0000","last_clean_scrub_stamp":"2024-04-25T22:07:12.079290+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:17.285367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24709,"num_write":463,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"75'60","reported_seq":253,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:47.377558+0000","last_change":"2024-04-25T22:06:47.377620+0000","last_active":"2024-04-25T22:06:47.377558+0000","last_peered":"2024-04-25T22:06:47.377558+0000","last_clean":"2024-04-25T22:06:47.377558+0000","last_became_active":"2024-04-25T22:06:22.801412+0000","last_became_peered":"2024-04-25T22:06:22.801412+0000","last_unstale":"2024-04-25T22:06:47.377558+0000","last_undegraded":"2024-04-25T22:06:47.377558+0000","last_fullsized":"2024-04-25T22:06:47.377558+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'60","last_scrub_stamp":"2024-04-25T22:06:47.377366+0000","last_deep_scrub":"75'60","last_deep_scrub_stamp":"2024-04-25T22:06:47.377366+0000","last_clean_scrub_stamp":"2024-04-25T22:06:47.377366+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:24.358167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'444","reported_seq":657,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:08.161222+0000","last_change":"2024-04-25T22:07:08.161288+0000","last_active":"2024-04-25T22:07:08.161222+0000","last_peered":"2024-04-25T22:07:08.161222+0000","last_clean":"2024-04-25T22:07:08.161222+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:07:08.161222+0000","last_undegraded":"2024-04-25T22:07:08.161222+0000","last_fullsized":"2024-04-25T22:07:08.161222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'444","last_scrub_stamp":"2024-04-25T22:07:08.161017+0000","last_deep_scrub":"76'444","last_deep_scrub_stamp":"2024-04-25T22:07:08.161017+0000","last_clean_scrub_stamp":"2024-04-25T22:07:08.161017+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:05.472503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14429,"num_write":416,"num_write_kb":59186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'355","reported_seq":508,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:59.258749+0000","last_change":"2024-04-25T22:06:59.258809+0000","last_active":"2024-04-25T22:06:59.258749+0000","last_peered":"2024-04-25T22:06:59.258749+0000","last_clean":"2024-04-25T22:06:59.258749+0000","last_became_active":"2024-04-25T22:06:22.792886+0000","last_became_peered":"2024-04-25T22:06:22.792886+0000","last_unstale":"2024-04-25T22:06:59.258749+0000","last_undegraded":"2024-04-25T22:06:59.258749+0000","last_fullsized":"2024-04-25T22:06:59.258749+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'355","last_scrub_stamp":"2024-04-25T22:06:59.258519+0000","last_deep_scrub":"76'355","last_deep_scrub_stamp":"2024-04-25T22:06:59.258519+0000","last_clean_scrub_stamp":"2024-04-25T22:06:59.258519+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:56.367157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18236,"num_write":332,"num_write_kb":42553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"99'744","reported_seq":930,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:07.240670+0000","last_change":"2024-04-25T22:07:07.240745+0000","last_active":"2024-04-25T22:07:07.240670+0000","last_peered":"2024-04-25T22:07:07.240670+0000","last_clean":"2024-04-25T22:07:07.240670+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:07:07.240670+0000","last_undegraded":"2024-04-25T22:07:07.240670+0000","last_fullsized":"2024-04-25T22:07:07.240670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'744","last_scrub_stamp":"2024-04-25T22:07:07.240453+0000","last_deep_scrub":"99'744","last_deep_scrub_stamp":"2024-04-25T22:07:07.240453+0000","last_clean_scrub_stamp":"2024-04-25T22:07:07.240453+0000","objects_scrubbed":2,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:29:08.639768+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'378","reported_seq":589,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:10.099677+0000","last_change":"2024-04-25T22:07:10.099677+0000","last_active":"2024-04-25T22:07:10.099677+0000","last_peered":"2024-04-25T22:07:10.099677+0000","last_clean":"2024-04-25T22:07:10.099677+0000","last_became_active":"2024-04-25T22:06:22.806240+0000","last_became_peered":"2024-04-25T22:06:22.806240+0000","last_unstale":"2024-04-25T22:07:10.099677+0000","last_undegraded":"2024-04-25T22:07:10.099677+0000","last_fullsized":"2024-04-25T22:07:10.099677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'378","last_scrub_stamp":"2024-04-25T22:07:10.099405+0000","last_deep_scrub":"76'378","last_deep_scrub_stamp":"2024-04-25T22:07:10.099405+0000","last_clean_scrub_stamp":"2024-04-25T22:07:10.099405+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:26:06.155998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6876,"num_write":354,"num_write_kb":46840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"99'205","reported_seq":398,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:55.388796+0000","last_change":"2024-04-25T22:06:55.388860+0000","last_active":"2024-04-25T22:06:55.388796+0000","last_peered":"2024-04-25T22:06:55.388796+0000","last_clean":"2024-04-25T22:06:55.388796+0000","last_became_active":"2024-04-25T22:06:22.801630+0000","last_became_peered":"2024-04-25T22:06:22.801630+0000","last_unstale":"2024-04-25T22:06:55.388796+0000","last_undegraded":"2024-04-25T22:06:55.388796+0000","last_fullsized":"2024-04-25T22:06:55.388796+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'205","last_scrub_stamp":"2024-04-25T22:06:55.388593+0000","last_deep_scrub":"99'205","last_deep_scrub_stamp":"2024-04-25T22:06:55.388593+0000","last_clean_scrub_stamp":"2024-04-25T22:06:55.388593+0000","objects_scrubbed":1,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:19:22.258602+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'377","reported_seq":524,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:11.234929+0000","last_change":"2024-04-25T22:07:11.234992+0000","last_active":"2024-04-25T22:07:11.234929+0000","last_peered":"2024-04-25T22:07:11.234929+0000","last_clean":"2024-04-25T22:07:11.234929+0000","last_became_active":"2024-04-25T22:06:22.795334+0000","last_became_peered":"2024-04-25T22:06:22.795334+0000","last_unstale":"2024-04-25T22:07:11.234929+0000","last_undegraded":"2024-04-25T22:07:11.234929+0000","last_fullsized":"2024-04-25T22:07:11.234929+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'377","last_scrub_stamp":"2024-04-25T22:07:11.234730+0000","last_deep_scrub":"76'377","last_deep_scrub_stamp":"2024-04-25T22:07:11.234730+0000","last_clean_scrub_stamp":"2024-04-25T22:07:11.234730+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:54:16.349440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6059,"num_write":332,"num_write_kb":37972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"99'220","reported_seq":344,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:16.366162+0000","last_change":"2024-04-25T22:07:16.366303+0000","last_active":"2024-04-25T22:07:16.366162+0000","last_peered":"2024-04-25T22:07:16.366162+0000","last_clean":"2024-04-25T22:07:16.366162+0000","last_became_active":"2024-04-25T22:06:28.841447+0000","last_became_peered":"2024-04-25T22:06:28.841447+0000","last_unstale":"2024-04-25T22:07:16.366162+0000","last_undegraded":"2024-04-25T22:07:16.366162+0000","last_fullsized":"2024-04-25T22:07:16.366162+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'220","last_scrub_stamp":"2024-04-25T22:07:16.365824+0000","last_deep_scrub":"99'220","last_deep_scrub_stamp":"2024-04-25T22:07:16.365824+0000","last_clean_scrub_stamp":"2024-04-25T22:07:16.365824+0000","objects_scrubbed":3,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:45:40.114499+0000","scrub_duration":99,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"76'389","reported_seq":551,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:08.232528+0000","last_change":"2024-04-25T22:07:08.232591+0000","last_active":"2024-04-25T22:07:08.232528+0000","last_peered":"2024-04-25T22:07:08.232528+0000","last_clean":"2024-04-25T22:07:08.232528+0000","last_became_active":"2024-04-25T22:03:33.860800+0000","last_became_peered":"2024-04-25T22:03:33.860800+0000","last_unstale":"2024-04-25T22:07:08.232528+0000","last_undegraded":"2024-04-25T22:07:08.232528+0000","last_fullsized":"2024-04-25T22:07:08.232528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'389","last_scrub_stamp":"2024-04-25T22:07:08.232331+0000","last_deep_scrub":"76'389","last_deep_scrub_stamp":"2024-04-25T22:07:08.232331+0000","last_clean_scrub_stamp":"2024-04-25T22:07:08.232331+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:50.373265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19110,"num_write":355,"num_write_kb":63152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"99'52","reported_seq":136,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:01.288659+0000","last_change":"2024-04-25T22:07:01.288788+0000","last_active":"2024-04-25T22:07:01.288659+0000","last_peered":"2024-04-25T22:07:01.288659+0000","last_clean":"2024-04-25T22:07:01.288659+0000","last_became_active":"2024-04-25T22:06:22.803778+0000","last_became_peered":"2024-04-25T22:06:22.803778+0000","last_unstale":"2024-04-25T22:07:01.288659+0000","last_undegraded":"2024-04-25T22:07:01.288659+0000","last_fullsized":"2024-04-25T22:07:01.288659+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'52","last_scrub_stamp":"2024-04-25T22:07:01.288423+0000","last_deep_scrub":"99'52","last_deep_scrub_stamp":"2024-04-25T22:07:01.288423+0000","last_clean_scrub_stamp":"2024-04-25T22:07:01.288423+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:27.589499+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"76'386","reported_seq":484,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:31.162997+0000","last_change":"2024-04-25T22:06:31.161983+0000","last_active":"2024-04-25T22:06:31.162997+0000","last_peered":"2024-04-25T22:06:31.162997+0000","last_clean":"2024-04-25T22:06:31.162997+0000","last_became_active":"2024-04-25T22:06:31.149995+0000","last_became_peered":"2024-04-25T22:06:31.149995+0000","last_unstale":"2024-04-25T22:06:31.162997+0000","last_undegraded":"2024-04-25T22:06:31.162997+0000","last_fullsized":"2024-04-25T22:06:31.162997+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:01:13.590422+0000","last_clean_scrub_stamp":"2024-04-25T22:01:13.590422+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14050,"num_write":362,"num_write_kb":58957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"99'190","reported_seq":242,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:51.236079+0000","last_change":"2024-04-25T22:06:51.236148+0000","last_active":"2024-04-25T22:06:51.236079+0000","last_peered":"2024-04-25T22:06:51.236079+0000","last_clean":"2024-04-25T22:06:51.236079+0000","last_became_active":"2024-04-25T22:06:31.148291+0000","last_became_peered":"2024-04-25T22:06:31.148291+0000","last_unstale":"2024-04-25T22:06:51.236079+0000","last_undegraded":"2024-04-25T22:06:51.236079+0000","last_fullsized":"2024-04-25T22:06:51.236079+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'190","last_scrub_stamp":"2024-04-25T22:06:51.235885+0000","last_deep_scrub":"99'190","last_deep_scrub_stamp":"2024-04-25T22:06:51.235885+0000","last_clean_scrub_stamp":"2024-04-25T22:06:51.235885+0000","objects_scrubbed":2,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:48.916005+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"76'397","reported_seq":503,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:18.458296+0000","last_change":"2024-04-25T22:07:18.458414+0000","last_active":"2024-04-25T22:07:18.458296+0000","last_peered":"2024-04-25T22:07:18.458296+0000","last_clean":"2024-04-25T22:07:18.458296+0000","last_became_active":"2024-04-25T22:06:31.148445+0000","last_became_peered":"2024-04-25T22:06:31.148445+0000","last_unstale":"2024-04-25T22:07:18.458296+0000","last_undegraded":"2024-04-25T22:07:18.458296+0000","last_fullsized":"2024-04-25T22:07:18.458296+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'397","last_scrub_stamp":"2024-04-25T22:07:18.458105+0000","last_deep_scrub":"76'397","last_deep_scrub_stamp":"2024-04-25T22:07:18.458105+0000","last_clean_scrub_stamp":"2024-04-25T22:07:18.458105+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:50.527240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13280,"num_write":364,"num_write_kb":46108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"99'288","reported_seq":427,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:57.337519+0000","last_change":"2024-04-25T22:06:57.337603+0000","last_active":"2024-04-25T22:06:57.337519+0000","last_peered":"2024-04-25T22:06:57.337519+0000","last_clean":"2024-04-25T22:06:57.337519+0000","last_became_active":"2024-04-25T22:06:22.794078+0000","last_became_peered":"2024-04-25T22:06:22.794078+0000","last_unstale":"2024-04-25T22:06:57.337519+0000","last_undegraded":"2024-04-25T22:06:57.337519+0000","last_fullsized":"2024-04-25T22:06:57.337519+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'288","last_scrub_stamp":"2024-04-25T22:06:57.337333+0000","last_deep_scrub":"99'288","last_deep_scrub_stamp":"2024-04-25T22:06:57.337333+0000","last_clean_scrub_stamp":"2024-04-25T22:06:57.337333+0000","objects_scrubbed":4,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:20.402496+0000","scrub_duration":95,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":12398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"76'412","reported_seq":547,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:10.220950+0000","last_change":"2024-04-25T22:07:10.221007+0000","last_active":"2024-04-25T22:07:10.220950+0000","last_peered":"2024-04-25T22:07:10.220950+0000","last_clean":"2024-04-25T22:07:10.220950+0000","last_became_active":"2024-04-25T22:03:33.862435+0000","last_became_peered":"2024-04-25T22:03:33.862435+0000","last_unstale":"2024-04-25T22:07:10.220950+0000","last_undegraded":"2024-04-25T22:07:10.220950+0000","last_fullsized":"2024-04-25T22:07:10.220950+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'412","last_scrub_stamp":"2024-04-25T22:07:10.220764+0000","last_deep_scrub":"76'412","last_deep_scrub_stamp":"2024-04-25T22:07:10.220764+0000","last_clean_scrub_stamp":"2024-04-25T22:07:10.220764+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:04:29.677106+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":1478,"num_write":377,"num_write_kb":34422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"99'128","reported_seq":315,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:06.194879+0000","last_change":"2024-04-25T22:07:06.194879+0000","last_active":"2024-04-25T22:07:06.194879+0000","last_peered":"2024-04-25T22:07:06.194879+0000","last_clean":"2024-04-25T22:07:06.194879+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:07:06.194879+0000","last_undegraded":"2024-04-25T22:07:06.194879+0000","last_fullsized":"2024-04-25T22:07:06.194879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'128","last_scrub_stamp":"2024-04-25T22:07:06.194581+0000","last_deep_scrub":"99'128","last_deep_scrub_stamp":"2024-04-25T22:07:06.194581+0000","last_clean_scrub_stamp":"2024-04-25T22:07:06.194581+0000","objects_scrubbed":1,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:22:09.309671+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'444","reported_seq":655,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:03.392910+0000","last_change":"2024-04-25T22:07:03.392968+0000","last_active":"2024-04-25T22:07:03.392910+0000","last_peered":"2024-04-25T22:07:03.392910+0000","last_clean":"2024-04-25T22:07:03.392910+0000","last_became_active":"2024-04-25T22:06:23.097535+0000","last_became_peered":"2024-04-25T22:06:23.097535+0000","last_unstale":"2024-04-25T22:07:03.392910+0000","last_undegraded":"2024-04-25T22:07:03.392910+0000","last_fullsized":"2024-04-25T22:07:03.392910+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'444","last_scrub_stamp":"2024-04-25T22:07:03.392719+0000","last_deep_scrub":"76'444","last_deep_scrub_stamp":"2024-04-25T22:07:03.392719+0000","last_clean_scrub_stamp":"2024-04-25T22:07:03.392719+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:30.391172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31576,"num_write":414,"num_write_kb":70915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"99'49","reported_seq":242,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:49.391630+0000","last_change":"2024-04-25T22:06:49.391711+0000","last_active":"2024-04-25T22:06:49.391630+0000","last_peered":"2024-04-25T22:06:49.391630+0000","last_clean":"2024-04-25T22:06:49.391630+0000","last_became_active":"2024-04-25T22:06:22.801910+0000","last_became_peered":"2024-04-25T22:06:22.801910+0000","last_unstale":"2024-04-25T22:06:49.391630+0000","last_undegraded":"2024-04-25T22:06:49.391630+0000","last_fullsized":"2024-04-25T22:06:49.391630+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'49","last_scrub_stamp":"2024-04-25T22:06:49.391444+0000","last_deep_scrub":"99'49","last_deep_scrub_stamp":"2024-04-25T22:06:49.391444+0000","last_clean_scrub_stamp":"2024-04-25T22:06:49.391444+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:01.347946+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2665,"num_read_kb":1338898,"num_write":24540,"num_write_kb":4276910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26558,"ondisk_log_size":26558,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127376126,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":4662,"num_write_kb":127830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":71499776,"data_stored":254752252,"data_compressed":21836190,"data_compressed_allocated":35307520,"data_compressed_original":218619904,"omap_allocated":136586,"internal_metadata":0},"log_size":6499,"ondisk_log_size":6499,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738451,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103888,"kb_used_data":24200,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":94267952,"statfs":{"total":96636764160,"available":96530382848,"internally_reserved":0,"allocated":24780800,"data_stored":84964150,"data_compressed":7036839,"data_compressed_allocated":11431936,"data_compressed_original":72118272,"omap_allocated":1595,"internal_metadata":81590725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738450,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99424,"kb_used_data":23896,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272416,"statfs":{"total":96636764160,"available":96534953984,"internally_reserved":0,"allocated":24469504,"data_stored":81562098,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":90,"seq":386547056654,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58104,"kb_used_data":24432,"kb_used_omap":134,"kb_used_meta":33529,"kb_avail":94313736,"statfs":{"total":96636764160,"available":96577265664,"internally_reserved":0,"allocated":25018368,"data_stored":90623267,"data_compressed":7819212,"data_compressed_allocated":12599296,"data_compressed_original":78716928,"omap_allocated":138181,"internal_metadata":34333755},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24076288,"data_stored":89627390,"data_compressed":7811005,"data_compressed_allocated":12562432,"data_compressed_original":78143488,"omap_allocated":136586,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23584768,"data_stored":81156589,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23838720,"data_stored":83968273,"data_compressed":7028632,"data_compressed_allocated":11395072,"data_compressed_original":71544832,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:07:26.547 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:26.548 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:26.549 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T22:01:12.587237+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:26.549 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T22:01:13.590422+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=1, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=6, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:07:26.549 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T22:07:46.551 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:07:46.871 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:07:46.873 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-04-25T22:07:46.888 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2024-04-25T22:07:45.715486+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127966494,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2864,"num_read_kb":1340487,"num_write":29405,"num_write_kb":4408200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33216,"ondisk_log_size":33216,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":261416,"kb_used_data":72528,"kb_used_omap":138,"kb_used_meta":188725,"kb_avail":282854104,"statfs":{"total":289910292480,"available":289642602496,"internally_reserved":0,"allocated":74268672,"data_stored":257149515,"data_compressed":21852604,"data_compressed_allocated":35381248,"data_compressed_original":219766784,"omap_allocated":141371,"internal_metadata":193255365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004369"},"pg_stats":[{"pgid":"4.3f","version":"76'446","reported_seq":614,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:00.253360+0000","last_change":"2024-04-25T22:07:00.253360+0000","last_active":"2024-04-25T22:07:00.253360+0000","last_peered":"2024-04-25T22:07:00.253360+0000","last_clean":"2024-04-25T22:07:00.253360+0000","last_became_active":"2024-04-25T22:03:33.873739+0000","last_became_peered":"2024-04-25T22:03:33.873739+0000","last_unstale":"2024-04-25T22:07:00.253360+0000","last_undegraded":"2024-04-25T22:07:00.253360+0000","last_fullsized":"2024-04-25T22:07:00.253360+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'446","last_scrub_stamp":"2024-04-25T22:07:00.253077+0000","last_deep_scrub":"76'446","last_deep_scrub_stamp":"2024-04-25T22:07:00.253077+0000","last_clean_scrub_stamp":"2024-04-25T22:07:00.253077+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:21:55.527885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29432,"num_write":407,"num_write_kb":84235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"76'417","reported_seq":580,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:07.245533+0000","last_change":"2024-04-25T22:07:07.245533+0000","last_active":"2024-04-25T22:07:07.245533+0000","last_peered":"2024-04-25T22:07:07.245533+0000","last_clean":"2024-04-25T22:07:07.245533+0000","last_became_active":"2024-04-25T22:03:33.859221+0000","last_became_peered":"2024-04-25T22:03:33.859221+0000","last_unstale":"2024-04-25T22:07:07.245533+0000","last_undegraded":"2024-04-25T22:07:07.245533+0000","last_fullsized":"2024-04-25T22:07:07.245533+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'417","last_scrub_stamp":"2024-04-25T22:07:07.245267+0000","last_deep_scrub":"76'417","last_deep_scrub_stamp":"2024-04-25T22:07:07.245267+0000","last_clean_scrub_stamp":"2024-04-25T22:07:07.245267+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:26:03.301859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":23541,"num_write":389,"num_write_kb":87654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"76'389","reported_seq":567,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:24.469097+0000","last_change":"2024-04-25T22:07:24.469155+0000","last_active":"2024-04-25T22:07:24.469097+0000","last_peered":"2024-04-25T22:07:24.469097+0000","last_clean":"2024-04-25T22:07:24.469097+0000","last_became_active":"2024-04-25T22:06:31.149675+0000","last_became_peered":"2024-04-25T22:06:31.149675+0000","last_unstale":"2024-04-25T22:07:24.469097+0000","last_undegraded":"2024-04-25T22:07:24.469097+0000","last_fullsized":"2024-04-25T22:07:24.469097+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'389","last_scrub_stamp":"2024-04-25T22:07:24.468898+0000","last_deep_scrub":"76'389","last_deep_scrub_stamp":"2024-04-25T22:07:24.468898+0000","last_clean_scrub_stamp":"2024-04-25T22:07:24.468898+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:44.814782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22311,"num_write":361,"num_write_kb":42975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"76'394","reported_seq":597,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:00.293435+0000","last_change":"2024-04-25T22:07:00.293493+0000","last_active":"2024-04-25T22:07:00.293435+0000","last_peered":"2024-04-25T22:07:00.293435+0000","last_clean":"2024-04-25T22:07:00.293435+0000","last_became_active":"2024-04-25T22:06:23.090780+0000","last_became_peered":"2024-04-25T22:06:23.090780+0000","last_unstale":"2024-04-25T22:07:00.293435+0000","last_undegraded":"2024-04-25T22:07:00.293435+0000","last_fullsized":"2024-04-25T22:07:00.293435+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'394","last_scrub_stamp":"2024-04-25T22:07:00.293232+0000","last_deep_scrub":"76'394","last_deep_scrub_stamp":"2024-04-25T22:07:00.293232+0000","last_clean_scrub_stamp":"2024-04-25T22:07:00.293232+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:44.908041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":20785,"num_write":367,"num_write_kb":63746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"76'429","reported_seq":949,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:15.288146+0000","last_change":"2024-04-25T22:07:15.288208+0000","last_active":"2024-04-25T22:07:15.288146+0000","last_peered":"2024-04-25T22:07:15.288146+0000","last_clean":"2024-04-25T22:07:15.288146+0000","last_became_active":"2024-04-25T22:06:28.836687+0000","last_became_peered":"2024-04-25T22:06:28.836687+0000","last_unstale":"2024-04-25T22:07:15.288146+0000","last_undegraded":"2024-04-25T22:07:15.288146+0000","last_fullsized":"2024-04-25T22:07:15.288146+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'429","last_scrub_stamp":"2024-04-25T22:07:15.287941+0000","last_deep_scrub":"76'429","last_deep_scrub_stamp":"2024-04-25T22:07:15.287941+0000","last_clean_scrub_stamp":"2024-04-25T22:07:15.287941+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:35.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":20896,"num_write":403,"num_write_kb":100255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"76'368","reported_seq":551,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:59.333242+0000","last_change":"2024-04-25T22:06:59.333306+0000","last_active":"2024-04-25T22:06:59.333242+0000","last_peered":"2024-04-25T22:06:59.333242+0000","last_clean":"2024-04-25T22:06:59.333242+0000","last_became_active":"2024-04-25T22:06:23.107939+0000","last_became_peered":"2024-04-25T22:06:23.107939+0000","last_unstale":"2024-04-25T22:06:59.333242+0000","last_undegraded":"2024-04-25T22:06:59.333242+0000","last_fullsized":"2024-04-25T22:06:59.333242+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'368","last_scrub_stamp":"2024-04-25T22:06:59.333035+0000","last_deep_scrub":"76'368","last_deep_scrub_stamp":"2024-04-25T22:06:59.333035+0000","last_clean_scrub_stamp":"2024-04-25T22:06:59.333035+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:57.414174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9362,"num_write":344,"num_write_kb":20831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"76'438","reported_seq":647,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:58.303992+0000","last_change":"2024-04-25T22:06:58.304135+0000","last_active":"2024-04-25T22:06:58.303992+0000","last_peered":"2024-04-25T22:06:58.303992+0000","last_clean":"2024-04-25T22:06:58.303992+0000","last_became_active":"2024-04-25T22:06:23.098436+0000","last_became_peered":"2024-04-25T22:06:23.098436+0000","last_unstale":"2024-04-25T22:06:58.303992+0000","last_undegraded":"2024-04-25T22:06:58.303992+0000","last_fullsized":"2024-04-25T22:06:58.303992+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'438","last_scrub_stamp":"2024-04-25T22:06:58.303753+0000","last_deep_scrub":"76'438","last_deep_scrub_stamp":"2024-04-25T22:06:58.303753+0000","last_clean_scrub_stamp":"2024-04-25T22:06:58.303753+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:21.625267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25961,"num_write":415,"num_write_kb":72541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"76'392","reported_seq":611,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:56.232947+0000","last_change":"2024-04-25T22:06:56.233003+0000","last_active":"2024-04-25T22:06:56.232947+0000","last_peered":"2024-04-25T22:06:56.232947+0000","last_clean":"2024-04-25T22:06:56.232947+0000","last_became_active":"2024-04-25T22:06:23.091431+0000","last_became_peered":"2024-04-25T22:06:23.091431+0000","last_unstale":"2024-04-25T22:06:56.232947+0000","last_undegraded":"2024-04-25T22:06:56.232947+0000","last_fullsized":"2024-04-25T22:06:56.232947+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-25T22:06:56.232744+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-25T22:06:56.232744+0000","last_clean_scrub_stamp":"2024-04-25T22:06:56.232744+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:40.030831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":24749,"num_write":354,"num_write_kb":64232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"76'443","reported_seq":660,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:45.368357+0000","last_change":"2024-04-25T22:06:45.368420+0000","last_active":"2024-04-25T22:06:45.368357+0000","last_peered":"2024-04-25T22:06:45.368357+0000","last_clean":"2024-04-25T22:06:45.368357+0000","last_became_active":"2024-04-25T22:01:14.642361+0000","last_became_peered":"2024-04-25T22:01:14.642361+0000","last_unstale":"2024-04-25T22:06:45.368357+0000","last_undegraded":"2024-04-25T22:06:45.368357+0000","last_fullsized":"2024-04-25T22:06:45.368357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'443","last_scrub_stamp":"2024-04-25T22:06:45.368156+0000","last_deep_scrub":"76'443","last_deep_scrub_stamp":"2024-04-25T22:06:45.368156+0000","last_clean_scrub_stamp":"2024-04-25T22:06:45.368156+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:07.796649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":10648,"num_write":411,"num_write_kb":92932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"76'392","reported_seq":520,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:46.196468+0000","last_change":"2024-04-25T22:06:46.196532+0000","last_active":"2024-04-25T22:06:46.196468+0000","last_peered":"2024-04-25T22:06:46.196468+0000","last_clean":"2024-04-25T22:06:46.196468+0000","last_became_active":"2024-04-25T22:06:26.114463+0000","last_became_peered":"2024-04-25T22:06:26.114463+0000","last_unstale":"2024-04-25T22:06:46.196468+0000","last_undegraded":"2024-04-25T22:06:46.196468+0000","last_fullsized":"2024-04-25T22:06:46.196468+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'392","last_scrub_stamp":"2024-04-25T22:06:46.196270+0000","last_deep_scrub":"76'392","last_deep_scrub_stamp":"2024-04-25T22:06:46.196270+0000","last_clean_scrub_stamp":"2024-04-25T22:06:46.196270+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:57:43.306329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10696,"num_write":359,"num_write_kb":63259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"76'391","reported_seq":578,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:49.260343+0000","last_change":"2024-04-25T22:06:49.260414+0000","last_active":"2024-04-25T22:06:49.260343+0000","last_peered":"2024-04-25T22:06:49.260343+0000","last_clean":"2024-04-25T22:06:49.260343+0000","last_became_active":"2024-04-25T22:06:23.123801+0000","last_became_peered":"2024-04-25T22:06:23.123801+0000","last_unstale":"2024-04-25T22:06:49.260343+0000","last_undegraded":"2024-04-25T22:06:49.260343+0000","last_fullsized":"2024-04-25T22:06:49.260343+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'391","last_scrub_stamp":"2024-04-25T22:06:49.260130+0000","last_deep_scrub":"76'391","last_deep_scrub_stamp":"2024-04-25T22:06:49.260130+0000","last_clean_scrub_stamp":"2024-04-25T22:06:49.260130+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:42:51.390054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":11259,"num_write":372,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"76'365","reported_seq":656,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:55.308601+0000","last_change":"2024-04-25T22:06:55.308732+0000","last_active":"2024-04-25T22:06:55.308601+0000","last_peered":"2024-04-25T22:06:55.308601+0000","last_clean":"2024-04-25T22:06:55.308601+0000","last_became_active":"2024-04-25T22:06:22.792880+0000","last_became_peered":"2024-04-25T22:06:22.792880+0000","last_unstale":"2024-04-25T22:06:55.308601+0000","last_undegraded":"2024-04-25T22:06:55.308601+0000","last_fullsized":"2024-04-25T22:06:55.308601+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'365","last_scrub_stamp":"2024-04-25T22:06:55.308350+0000","last_deep_scrub":"76'365","last_deep_scrub_stamp":"2024-04-25T22:06:55.308350+0000","last_clean_scrub_stamp":"2024-04-25T22:06:55.308350+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:27:30.240705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":51972,"num_write":340,"num_write_kb":51203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"76'420","reported_seq":583,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:02.284192+0000","last_change":"2024-04-25T22:07:02.284254+0000","last_active":"2024-04-25T22:07:02.284192+0000","last_peered":"2024-04-25T22:07:02.284192+0000","last_clean":"2024-04-25T22:07:02.284192+0000","last_became_active":"2024-04-25T22:03:33.859376+0000","last_became_peered":"2024-04-25T22:03:33.859376+0000","last_unstale":"2024-04-25T22:07:02.284192+0000","last_undegraded":"2024-04-25T22:07:02.284192+0000","last_fullsized":"2024-04-25T22:07:02.284192+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'420","last_scrub_stamp":"2024-04-25T22:07:02.283992+0000","last_deep_scrub":"76'420","last_deep_scrub_stamp":"2024-04-25T22:07:02.283992+0000","last_clean_scrub_stamp":"2024-04-25T22:07:02.283992+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:50:55.188773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17620,"num_write":386,"num_write_kb":100613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"76'432","reported_seq":640,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:54.219993+0000","last_change":"2024-04-25T22:06:54.220062+0000","last_active":"2024-04-25T22:06:54.219993+0000","last_peered":"2024-04-25T22:06:54.219993+0000","last_clean":"2024-04-25T22:06:54.219993+0000","last_became_active":"2024-04-25T22:06:23.081466+0000","last_became_peered":"2024-04-25T22:06:23.081466+0000","last_unstale":"2024-04-25T22:06:54.219993+0000","last_undegraded":"2024-04-25T22:06:54.219993+0000","last_fullsized":"2024-04-25T22:06:54.219993+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'432","last_scrub_stamp":"2024-04-25T22:06:54.219768+0000","last_deep_scrub":"76'432","last_deep_scrub_stamp":"2024-04-25T22:06:54.219768+0000","last_clean_scrub_stamp":"2024-04-25T22:06:54.219768+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:09:43.916848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":27327,"num_write":398,"num_write_kb":76113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"76'385","reported_seq":593,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:08.406753+0000","last_change":"2024-04-25T22:07:08.406812+0000","last_active":"2024-04-25T22:07:08.406753+0000","last_peered":"2024-04-25T22:07:08.406753+0000","last_clean":"2024-04-25T22:07:08.406753+0000","last_became_active":"2024-04-25T22:06:23.088046+0000","last_became_peered":"2024-04-25T22:06:23.088046+0000","last_unstale":"2024-04-25T22:07:08.406753+0000","last_undegraded":"2024-04-25T22:07:08.406753+0000","last_fullsized":"2024-04-25T22:07:08.406753+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'385","last_scrub_stamp":"2024-04-25T22:07:08.406540+0000","last_deep_scrub":"76'385","last_deep_scrub_stamp":"2024-04-25T22:07:08.406540+0000","last_clean_scrub_stamp":"2024-04-25T22:07:08.406540+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:05.143266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23986,"num_write":352,"num_write_kb":50754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"76'434","reported_seq":624,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:05.382308+0000","last_change":"2024-04-25T22:07:05.382390+0000","last_active":"2024-04-25T22:07:05.382308+0000","last_peered":"2024-04-25T22:07:05.382308+0000","last_clean":"2024-04-25T22:07:05.382308+0000","last_became_active":"2024-04-25T22:06:23.117497+0000","last_became_peered":"2024-04-25T22:06:23.117497+0000","last_unstale":"2024-04-25T22:07:05.382308+0000","last_undegraded":"2024-04-25T22:07:05.382308+0000","last_fullsized":"2024-04-25T22:07:05.382308+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'434","last_scrub_stamp":"2024-04-25T22:07:05.382085+0000","last_deep_scrub":"76'434","last_deep_scrub_stamp":"2024-04-25T22:07:05.382085+0000","last_clean_scrub_stamp":"2024-04-25T22:07:05.382085+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:51:28.918275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":13806,"num_write":403,"num_write_kb":38995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"76'444","reported_seq":667,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:52.384689+0000","last_change":"2024-04-25T22:06:52.384748+0000","last_active":"2024-04-25T22:06:52.384689+0000","last_peered":"2024-04-25T22:06:52.384689+0000","last_clean":"2024-04-25T22:06:52.384689+0000","last_became_active":"2024-04-25T22:01:14.637057+0000","last_became_peered":"2024-04-25T22:01:14.637057+0000","last_unstale":"2024-04-25T22:06:52.384689+0000","last_undegraded":"2024-04-25T22:06:52.384689+0000","last_fullsized":"2024-04-25T22:06:52.384689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'444","last_scrub_stamp":"2024-04-25T22:06:52.384489+0000","last_deep_scrub":"76'444","last_deep_scrub_stamp":"2024-04-25T22:06:52.384489+0000","last_clean_scrub_stamp":"2024-04-25T22:06:52.384489+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:55:00.266704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":11085,"num_write":416,"num_write_kb":68377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"76'396","reported_seq":540,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:09.190535+0000","last_change":"2024-04-25T22:07:09.190595+0000","last_active":"2024-04-25T22:07:09.190535+0000","last_peered":"2024-04-25T22:07:09.190535+0000","last_clean":"2024-04-25T22:07:09.190535+0000","last_became_active":"2024-04-25T22:03:33.861082+0000","last_became_peered":"2024-04-25T22:03:33.861082+0000","last_unstale":"2024-04-25T22:07:09.190535+0000","last_undegraded":"2024-04-25T22:07:09.190535+0000","last_fullsized":"2024-04-25T22:07:09.190535+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'396","last_scrub_stamp":"2024-04-25T22:07:09.190338+0000","last_deep_scrub":"76'396","last_deep_scrub_stamp":"2024-04-25T22:07:09.190338+0000","last_clean_scrub_stamp":"2024-04-25T22:07:09.190338+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:14.396415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6581,"num_write":355,"num_write_kb":34159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"76'447","reported_seq":657,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:50.360046+0000","last_change":"2024-04-25T22:06:50.360103+0000","last_active":"2024-04-25T22:06:50.360046+0000","last_peered":"2024-04-25T22:06:50.360046+0000","last_clean":"2024-04-25T22:06:50.360046+0000","last_became_active":"2024-04-25T22:01:14.641435+0000","last_became_peered":"2024-04-25T22:01:14.641435+0000","last_unstale":"2024-04-25T22:06:50.360046+0000","last_undegraded":"2024-04-25T22:06:50.360046+0000","last_fullsized":"2024-04-25T22:06:50.360046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'447","last_scrub_stamp":"2024-04-25T22:06:50.359882+0000","last_deep_scrub":"76'447","last_deep_scrub_stamp":"2024-04-25T22:06:50.359882+0000","last_clean_scrub_stamp":"2024-04-25T22:06:50.359882+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:26.034007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22089,"num_write":411,"num_write_kb":104750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"76'426","reported_seq":613,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:02.372248+0000","last_change":"2024-04-25T22:07:02.372308+0000","last_active":"2024-04-25T22:07:02.372248+0000","last_peered":"2024-04-25T22:07:02.372248+0000","last_clean":"2024-04-25T22:07:02.372248+0000","last_became_active":"2024-04-25T22:06:23.093379+0000","last_became_peered":"2024-04-25T22:06:23.093379+0000","last_unstale":"2024-04-25T22:07:02.372248+0000","last_undegraded":"2024-04-25T22:07:02.372248+0000","last_fullsized":"2024-04-25T22:07:02.372248+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'426","last_scrub_stamp":"2024-04-25T22:07:02.372057+0000","last_deep_scrub":"76'426","last_deep_scrub_stamp":"2024-04-25T22:07:02.372057+0000","last_clean_scrub_stamp":"2024-04-25T22:07:02.372057+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:08:07.136071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11886,"num_write":398,"num_write_kb":55010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"76'405","reported_seq":611,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:57.281296+0000","last_change":"2024-04-25T22:06:57.281355+0000","last_active":"2024-04-25T22:06:57.281296+0000","last_peered":"2024-04-25T22:06:57.281296+0000","last_clean":"2024-04-25T22:06:57.281296+0000","last_became_active":"2024-04-25T22:06:23.110101+0000","last_became_peered":"2024-04-25T22:06:23.110101+0000","last_unstale":"2024-04-25T22:06:57.281296+0000","last_undegraded":"2024-04-25T22:06:57.281296+0000","last_fullsized":"2024-04-25T22:06:57.281296+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'405","last_scrub_stamp":"2024-04-25T22:06:57.281099+0000","last_deep_scrub":"76'405","last_deep_scrub_stamp":"2024-04-25T22:06:57.281099+0000","last_clean_scrub_stamp":"2024-04-25T22:06:57.281099+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:07:32.749764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23004,"num_write":370,"num_write_kb":75802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'436","reported_seq":568,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:14.261669+0000","last_change":"2024-04-25T22:07:14.261807+0000","last_active":"2024-04-25T22:07:14.261669+0000","last_peered":"2024-04-25T22:07:14.261669+0000","last_clean":"2024-04-25T22:07:14.261669+0000","last_became_active":"2024-04-25T22:06:28.835081+0000","last_became_peered":"2024-04-25T22:06:28.835081+0000","last_unstale":"2024-04-25T22:07:14.261669+0000","last_undegraded":"2024-04-25T22:07:14.261669+0000","last_fullsized":"2024-04-25T22:07:14.261669+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'436","last_scrub_stamp":"2024-04-25T22:07:14.261436+0000","last_deep_scrub":"76'436","last_deep_scrub_stamp":"2024-04-25T22:07:14.261436+0000","last_clean_scrub_stamp":"2024-04-25T22:07:14.261436+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:26:07.985541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":11950,"num_write":408,"num_write_kb":67524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"76'403","reported_seq":616,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:09.116357+0000","last_change":"2024-04-25T22:07:09.116418+0000","last_active":"2024-04-25T22:07:09.116357+0000","last_peered":"2024-04-25T22:07:09.116357+0000","last_clean":"2024-04-25T22:07:09.116357+0000","last_became_active":"2024-04-25T22:06:22.802907+0000","last_became_peered":"2024-04-25T22:06:22.802907+0000","last_unstale":"2024-04-25T22:07:09.116357+0000","last_undegraded":"2024-04-25T22:07:09.116357+0000","last_fullsized":"2024-04-25T22:07:09.116357+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'403","last_scrub_stamp":"2024-04-25T22:07:09.116158+0000","last_deep_scrub":"76'403","last_deep_scrub_stamp":"2024-04-25T22:07:09.116158+0000","last_clean_scrub_stamp":"2024-04-25T22:07:09.116158+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:57.443257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":6507,"num_write":370,"num_write_kb":51513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"76'449","reported_seq":583,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:18.315060+0000","last_change":"2024-04-25T22:07:18.315121+0000","last_active":"2024-04-25T22:07:18.315060+0000","last_peered":"2024-04-25T22:07:18.315060+0000","last_clean":"2024-04-25T22:07:18.315060+0000","last_became_active":"2024-04-25T22:06:28.841283+0000","last_became_peered":"2024-04-25T22:06:28.841283+0000","last_unstale":"2024-04-25T22:07:18.315060+0000","last_undegraded":"2024-04-25T22:07:18.315060+0000","last_fullsized":"2024-04-25T22:07:18.315060+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'449","last_scrub_stamp":"2024-04-25T22:07:18.314849+0000","last_deep_scrub":"76'449","last_deep_scrub_stamp":"2024-04-25T22:07:18.314849+0000","last_clean_scrub_stamp":"2024-04-25T22:07:18.314849+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:22:43.770979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27047,"num_write":417,"num_write_kb":63386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"76'406","reported_seq":580,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:47.323560+0000","last_change":"2024-04-25T22:06:47.323681+0000","last_active":"2024-04-25T22:06:47.323560+0000","last_peered":"2024-04-25T22:06:47.323560+0000","last_clean":"2024-04-25T22:06:47.323560+0000","last_became_active":"2024-04-25T22:06:22.791470+0000","last_became_peered":"2024-04-25T22:06:22.791470+0000","last_unstale":"2024-04-25T22:06:47.323560+0000","last_undegraded":"2024-04-25T22:06:47.323560+0000","last_fullsized":"2024-04-25T22:06:47.323560+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'406","last_scrub_stamp":"2024-04-25T22:06:47.323329+0000","last_deep_scrub":"76'406","last_deep_scrub_stamp":"2024-04-25T22:06:47.323329+0000","last_clean_scrub_stamp":"2024-04-25T22:06:47.323329+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:01:33.331665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25550,"num_write":386,"num_write_kb":42197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"76'485","reported_seq":745,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:11.088077+0000","last_change":"2024-04-25T22:07:11.088077+0000","last_active":"2024-04-25T22:07:11.088077+0000","last_peered":"2024-04-25T22:07:11.088077+0000","last_clean":"2024-04-25T22:07:11.088077+0000","last_became_active":"2024-04-25T22:06:22.804228+0000","last_became_peered":"2024-04-25T22:06:22.804228+0000","last_unstale":"2024-04-25T22:07:11.088077+0000","last_undegraded":"2024-04-25T22:07:11.088077+0000","last_fullsized":"2024-04-25T22:07:11.088077+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'485","last_scrub_stamp":"2024-04-25T22:07:11.087681+0000","last_deep_scrub":"76'485","last_deep_scrub_stamp":"2024-04-25T22:07:11.087681+0000","last_clean_scrub_stamp":"2024-04-25T22:07:11.087681+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:53.228615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":30714,"num_write":444,"num_write_kb":92836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"76'387","reported_seq":601,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:50.226297+0000","last_change":"2024-04-25T22:06:50.226374+0000","last_active":"2024-04-25T22:06:50.226297+0000","last_peered":"2024-04-25T22:06:50.226297+0000","last_clean":"2024-04-25T22:06:50.226297+0000","last_became_active":"2024-04-25T22:06:23.121334+0000","last_became_peered":"2024-04-25T22:06:23.121334+0000","last_unstale":"2024-04-25T22:06:50.226297+0000","last_undegraded":"2024-04-25T22:06:50.226297+0000","last_fullsized":"2024-04-25T22:06:50.226297+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'387","last_scrub_stamp":"2024-04-25T22:06:50.226077+0000","last_deep_scrub":"76'387","last_deep_scrub_stamp":"2024-04-25T22:06:50.226077+0000","last_clean_scrub_stamp":"2024-04-25T22:06:50.226077+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:18.695143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":21644,"num_write":354,"num_write_kb":50870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"76'405","reported_seq":659,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:12.219487+0000","last_change":"2024-04-25T22:07:12.219487+0000","last_active":"2024-04-25T22:07:12.219487+0000","last_peered":"2024-04-25T22:07:12.219487+0000","last_clean":"2024-04-25T22:07:12.219487+0000","last_became_active":"2024-04-25T22:06:22.827066+0000","last_became_peered":"2024-04-25T22:06:22.827066+0000","last_unstale":"2024-04-25T22:07:12.219487+0000","last_undegraded":"2024-04-25T22:07:12.219487+0000","last_fullsized":"2024-04-25T22:07:12.219487+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'405","last_scrub_stamp":"2024-04-25T22:07:12.219221+0000","last_deep_scrub":"76'405","last_deep_scrub_stamp":"2024-04-25T22:07:12.219221+0000","last_clean_scrub_stamp":"2024-04-25T22:07:12.219221+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:17:15.756637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27522,"num_write":375,"num_write_kb":96416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"76'396","reported_seq":629,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:00.268789+0000","last_change":"2024-04-25T22:07:00.268789+0000","last_active":"2024-04-25T22:07:00.268789+0000","last_peered":"2024-04-25T22:07:00.268789+0000","last_clean":"2024-04-25T22:07:00.268789+0000","last_became_active":"2024-04-25T22:01:14.638876+0000","last_became_peered":"2024-04-25T22:01:14.638876+0000","last_unstale":"2024-04-25T22:07:00.268789+0000","last_undegraded":"2024-04-25T22:07:00.268789+0000","last_fullsized":"2024-04-25T22:07:00.268789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'396","last_scrub_stamp":"2024-04-25T22:07:00.268515+0000","last_deep_scrub":"76'396","last_deep_scrub_stamp":"2024-04-25T22:07:00.268515+0000","last_clean_scrub_stamp":"2024-04-25T22:07:00.268515+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:23.333678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28501,"num_write":367,"num_write_kb":63458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"76'467","reported_seq":664,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:53.312857+0000","last_change":"2024-04-25T22:06:53.312857+0000","last_active":"2024-04-25T22:06:53.312857+0000","last_peered":"2024-04-25T22:06:53.312857+0000","last_clean":"2024-04-25T22:06:53.312857+0000","last_became_active":"2024-04-25T22:06:22.789907+0000","last_became_peered":"2024-04-25T22:06:22.789907+0000","last_unstale":"2024-04-25T22:06:53.312857+0000","last_undegraded":"2024-04-25T22:06:53.312857+0000","last_fullsized":"2024-04-25T22:06:53.312857+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'467","last_scrub_stamp":"2024-04-25T22:06:53.312600+0000","last_deep_scrub":"76'467","last_deep_scrub_stamp":"2024-04-25T22:06:53.312600+0000","last_clean_scrub_stamp":"2024-04-25T22:06:53.312600+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:25:54.392796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":20717,"num_write":435,"num_write_kb":55985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"76'444","reported_seq":657,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:56.323943+0000","last_change":"2024-04-25T22:06:56.323943+0000","last_active":"2024-04-25T22:06:56.323943+0000","last_peered":"2024-04-25T22:06:56.323943+0000","last_clean":"2024-04-25T22:06:56.323943+0000","last_became_active":"2024-04-25T22:01:14.638749+0000","last_became_peered":"2024-04-25T22:01:14.638749+0000","last_unstale":"2024-04-25T22:06:56.323943+0000","last_undegraded":"2024-04-25T22:06:56.323943+0000","last_fullsized":"2024-04-25T22:06:56.323943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'444","last_scrub_stamp":"2024-04-25T22:06:56.323664+0000","last_deep_scrub":"76'444","last_deep_scrub_stamp":"2024-04-25T22:06:56.323664+0000","last_clean_scrub_stamp":"2024-04-25T22:06:56.323664+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:25:57.403859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":10758,"num_write":401,"num_write_kb":44705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"76'422","reported_seq":542,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:20.411060+0000","last_change":"2024-04-25T22:07:20.411120+0000","last_active":"2024-04-25T22:07:20.411060+0000","last_peered":"2024-04-25T22:07:20.411060+0000","last_clean":"2024-04-25T22:07:20.411060+0000","last_became_active":"2024-04-25T22:06:31.148129+0000","last_became_peered":"2024-04-25T22:06:31.148129+0000","last_unstale":"2024-04-25T22:07:20.411060+0000","last_undegraded":"2024-04-25T22:07:20.411060+0000","last_fullsized":"2024-04-25T22:07:20.411060+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'422","last_scrub_stamp":"2024-04-25T22:07:20.410861+0000","last_deep_scrub":"76'422","last_deep_scrub_stamp":"2024-04-25T22:07:20.410861+0000","last_clean_scrub_stamp":"2024-04-25T22:07:20.410861+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:39.605159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":29059,"num_write":391,"num_write_kb":40233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"76'397","reported_seq":903,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:13.265192+0000","last_change":"2024-04-25T22:07:13.265252+0000","last_active":"2024-04-25T22:07:13.265192+0000","last_peered":"2024-04-25T22:07:13.265192+0000","last_clean":"2024-04-25T22:07:13.265192+0000","last_became_active":"2024-04-25T22:06:26.816439+0000","last_became_peered":"2024-04-25T22:06:26.816439+0000","last_unstale":"2024-04-25T22:07:13.265192+0000","last_undegraded":"2024-04-25T22:07:13.265192+0000","last_fullsized":"2024-04-25T22:07:13.265192+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'397","last_scrub_stamp":"2024-04-25T22:07:13.264988+0000","last_deep_scrub":"76'397","last_deep_scrub_stamp":"2024-04-25T22:07:13.264988+0000","last_clean_scrub_stamp":"2024-04-25T22:07:13.264988+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:27:37.954651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":28857,"num_write":363,"num_write_kb":87969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"99'519","reported_seq":684,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:04.502040+0000","last_change":"2024-04-25T22:07:04.502134+0000","last_active":"2024-04-25T22:07:04.502040+0000","last_peered":"2024-04-25T22:07:04.502040+0000","last_clean":"2024-04-25T22:07:04.502040+0000","last_became_active":"2024-04-25T22:06:23.109665+0000","last_became_peered":"2024-04-25T22:06:23.109665+0000","last_unstale":"2024-04-25T22:07:04.502040+0000","last_undegraded":"2024-04-25T22:07:04.502040+0000","last_fullsized":"2024-04-25T22:07:04.502040+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'519","last_scrub_stamp":"2024-04-25T22:07:04.501844+0000","last_deep_scrub":"99'519","last_deep_scrub_stamp":"2024-04-25T22:07:04.501844+0000","last_clean_scrub_stamp":"2024-04-25T22:07:04.501844+0000","objects_scrubbed":4,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:05:56.974364+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"76'375","reported_seq":490,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:17.291199+0000","last_change":"2024-04-25T22:07:17.291261+0000","last_active":"2024-04-25T22:07:17.291199+0000","last_peered":"2024-04-25T22:07:17.291199+0000","last_clean":"2024-04-25T22:07:17.291199+0000","last_became_active":"2024-04-25T22:06:28.841545+0000","last_became_peered":"2024-04-25T22:06:28.841545+0000","last_unstale":"2024-04-25T22:07:17.291199+0000","last_undegraded":"2024-04-25T22:07:17.291199+0000","last_fullsized":"2024-04-25T22:07:17.291199+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'375","last_scrub_stamp":"2024-04-25T22:07:17.290999+0000","last_deep_scrub":"76'375","last_deep_scrub_stamp":"2024-04-25T22:07:17.290999+0000","last_clean_scrub_stamp":"2024-04-25T22:07:17.290999+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:54.420030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":14983,"num_write":339,"num_write_kb":46748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'53","reported_seq":246,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:15.095568+0000","last_change":"2024-04-25T22:07:15.095723+0000","last_active":"2024-04-25T22:07:15.095568+0000","last_peered":"2024-04-25T22:07:15.095568+0000","last_clean":"2024-04-25T22:07:15.095568+0000","last_became_active":"2024-04-25T22:06:22.833424+0000","last_became_peered":"2024-04-25T22:06:22.833424+0000","last_unstale":"2024-04-25T22:07:15.095568+0000","last_undegraded":"2024-04-25T22:07:15.095568+0000","last_fullsized":"2024-04-25T22:07:15.095568+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'53","last_scrub_stamp":"2024-04-25T22:07:15.095263+0000","last_deep_scrub":"76'53","last_deep_scrub_stamp":"2024-04-25T22:07:15.095263+0000","last_clean_scrub_stamp":"2024-04-25T22:07:15.095263+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:30:34.731142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"76'426","reported_seq":648,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:16.065300+0000","last_change":"2024-04-25T22:07:16.065360+0000","last_active":"2024-04-25T22:07:16.065300+0000","last_peered":"2024-04-25T22:07:16.065300+0000","last_clean":"2024-04-25T22:07:16.065300+0000","last_became_active":"2024-04-25T22:06:26.819562+0000","last_became_peered":"2024-04-25T22:06:26.819562+0000","last_unstale":"2024-04-25T22:07:16.065300+0000","last_undegraded":"2024-04-25T22:07:16.065300+0000","last_fullsized":"2024-04-25T22:07:16.065300+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'426","last_scrub_stamp":"2024-04-25T22:07:16.065093+0000","last_deep_scrub":"76'426","last_deep_scrub_stamp":"2024-04-25T22:07:16.065093+0000","last_clean_scrub_stamp":"2024-04-25T22:07:16.065093+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:16.467510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":17843,"num_write":388,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"75'71","reported_seq":197,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:54.348264+0000","last_change":"2024-04-25T22:06:54.348343+0000","last_active":"2024-04-25T22:06:54.348264+0000","last_peered":"2024-04-25T22:06:54.348264+0000","last_clean":"2024-04-25T22:06:54.348264+0000","last_became_active":"2024-04-25T22:06:22.790902+0000","last_became_peered":"2024-04-25T22:06:22.790902+0000","last_unstale":"2024-04-25T22:06:54.348264+0000","last_undegraded":"2024-04-25T22:06:54.348264+0000","last_fullsized":"2024-04-25T22:06:54.348264+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'71","last_scrub_stamp":"2024-04-25T22:06:54.348062+0000","last_deep_scrub":"75'71","last_deep_scrub_stamp":"2024-04-25T22:06:54.348062+0000","last_clean_scrub_stamp":"2024-04-25T22:06:54.348062+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:52.012973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'366","reported_seq":580,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:57.292147+0000","last_change":"2024-04-25T22:06:57.292206+0000","last_active":"2024-04-25T22:06:57.292147+0000","last_peered":"2024-04-25T22:06:57.292147+0000","last_clean":"2024-04-25T22:06:57.292147+0000","last_became_active":"2024-04-25T22:06:22.803327+0000","last_became_peered":"2024-04-25T22:06:22.803327+0000","last_unstale":"2024-04-25T22:06:57.292147+0000","last_undegraded":"2024-04-25T22:06:57.292147+0000","last_fullsized":"2024-04-25T22:06:57.292147+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'366","last_scrub_stamp":"2024-04-25T22:06:57.291947+0000","last_deep_scrub":"76'366","last_deep_scrub_stamp":"2024-04-25T22:06:57.291947+0000","last_clean_scrub_stamp":"2024-04-25T22:06:57.291947+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:09.795809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":16032,"num_write":334,"num_write_kb":25754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"99'67","reported_seq":234,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:13.470396+0000","last_change":"2024-04-25T22:07:13.470473+0000","last_active":"2024-04-25T22:07:13.470396+0000","last_peered":"2024-04-25T22:07:13.470396+0000","last_clean":"2024-04-25T22:07:13.470396+0000","last_became_active":"2024-04-25T22:06:23.082351+0000","last_became_peered":"2024-04-25T22:06:23.082351+0000","last_unstale":"2024-04-25T22:07:13.470396+0000","last_undegraded":"2024-04-25T22:07:13.470396+0000","last_fullsized":"2024-04-25T22:07:13.470396+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'67","last_scrub_stamp":"2024-04-25T22:07:13.470182+0000","last_deep_scrub":"99'67","last_deep_scrub_stamp":"2024-04-25T22:07:13.470182+0000","last_clean_scrub_stamp":"2024-04-25T22:07:13.470182+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:40:55.110005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"99'150","reported_seq":317,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:14.467532+0000","last_change":"2024-04-25T22:07:14.467603+0000","last_active":"2024-04-25T22:07:14.467532+0000","last_peered":"2024-04-25T22:07:14.467532+0000","last_clean":"2024-04-25T22:07:14.467532+0000","last_became_active":"2024-04-25T22:06:23.085599+0000","last_became_peered":"2024-04-25T22:06:23.085599+0000","last_unstale":"2024-04-25T22:07:14.467532+0000","last_undegraded":"2024-04-25T22:07:14.467532+0000","last_fullsized":"2024-04-25T22:07:14.467532+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'150","last_scrub_stamp":"2024-04-25T22:07:14.467336+0000","last_deep_scrub":"99'150","last_deep_scrub_stamp":"2024-04-25T22:07:14.467336+0000","last_clean_scrub_stamp":"2024-04-25T22:07:14.467336+0000","objects_scrubbed":2,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:51:47.159916+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"76'402","reported_seq":577,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:49.330680+0000","last_change":"2024-04-25T22:06:49.330746+0000","last_active":"2024-04-25T22:06:49.330680+0000","last_peered":"2024-04-25T22:06:49.330680+0000","last_clean":"2024-04-25T22:06:49.330680+0000","last_became_active":"2024-04-25T22:06:22.789353+0000","last_became_peered":"2024-04-25T22:06:22.789353+0000","last_unstale":"2024-04-25T22:06:49.330680+0000","last_undegraded":"2024-04-25T22:06:49.330680+0000","last_fullsized":"2024-04-25T22:06:49.330680+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'402","last_scrub_stamp":"2024-04-25T22:06:49.330473+0000","last_deep_scrub":"76'402","last_deep_scrub_stamp":"2024-04-25T22:06:49.330473+0000","last_clean_scrub_stamp":"2024-04-25T22:06:49.330473+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:52:42.763698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21114,"num_write":364,"num_write_kb":26036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"99'252","reported_seq":385,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:58.252735+0000","last_change":"2024-04-25T22:06:58.252804+0000","last_active":"2024-04-25T22:06:58.252735+0000","last_peered":"2024-04-25T22:06:58.252735+0000","last_clean":"2024-04-25T22:06:58.252735+0000","last_became_active":"2024-04-25T22:06:22.790508+0000","last_became_peered":"2024-04-25T22:06:22.790508+0000","last_unstale":"2024-04-25T22:06:58.252735+0000","last_undegraded":"2024-04-25T22:06:58.252735+0000","last_fullsized":"2024-04-25T22:06:58.252735+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'252","last_scrub_stamp":"2024-04-25T22:06:58.252549+0000","last_deep_scrub":"99'252","last_deep_scrub_stamp":"2024-04-25T22:06:58.252549+0000","last_clean_scrub_stamp":"2024-04-25T22:06:58.252549+0000","objects_scrubbed":2,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:43.769236+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"76'460","reported_seq":643,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:06.238527+0000","last_change":"2024-04-25T22:07:06.238653+0000","last_active":"2024-04-25T22:07:06.238527+0000","last_peered":"2024-04-25T22:07:06.238527+0000","last_clean":"2024-04-25T22:07:06.238527+0000","last_became_active":"2024-04-25T22:03:33.856638+0000","last_became_peered":"2024-04-25T22:03:33.856638+0000","last_unstale":"2024-04-25T22:07:06.238527+0000","last_undegraded":"2024-04-25T22:07:06.238527+0000","last_fullsized":"2024-04-25T22:07:06.238527+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'460","last_scrub_stamp":"2024-04-25T22:07:06.238299+0000","last_deep_scrub":"76'460","last_deep_scrub_stamp":"2024-04-25T22:07:06.238299+0000","last_clean_scrub_stamp":"2024-04-25T22:07:06.238299+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.565399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":39774,"num_write":433,"num_write_kb":80294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"99'558","reported_seq":725,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:45.280721+0000","last_change":"2024-04-25T22:06:45.280807+0000","last_active":"2024-04-25T22:06:45.280721+0000","last_peered":"2024-04-25T22:06:45.280721+0000","last_clean":"2024-04-25T22:06:45.280721+0000","last_became_active":"2024-04-25T22:06:31.147569+0000","last_became_peered":"2024-04-25T22:06:31.147569+0000","last_unstale":"2024-04-25T22:06:45.280721+0000","last_undegraded":"2024-04-25T22:06:45.280721+0000","last_fullsized":"2024-04-25T22:06:45.280721+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'558","last_scrub_stamp":"2024-04-25T22:06:45.280524+0000","last_deep_scrub":"99'558","last_deep_scrub_stamp":"2024-04-25T22:06:45.280524+0000","last_clean_scrub_stamp":"2024-04-25T22:06:45.280524+0000","objects_scrubbed":2,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:31:33.133373+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":509,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"76'413","reported_seq":586,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:01.332914+0000","last_change":"2024-04-25T22:07:01.332973+0000","last_active":"2024-04-25T22:07:01.332914+0000","last_peered":"2024-04-25T22:07:01.332914+0000","last_clean":"2024-04-25T22:07:01.332914+0000","last_became_active":"2024-04-25T22:06:23.108199+0000","last_became_peered":"2024-04-25T22:06:23.108199+0000","last_unstale":"2024-04-25T22:07:01.332914+0000","last_undegraded":"2024-04-25T22:07:01.332914+0000","last_fullsized":"2024-04-25T22:07:01.332914+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'413","last_scrub_stamp":"2024-04-25T22:07:01.332716+0000","last_deep_scrub":"76'413","last_deep_scrub_stamp":"2024-04-25T22:07:01.332716+0000","last_clean_scrub_stamp":"2024-04-25T22:07:01.332716+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:21.860916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4858,"num_write":378,"num_write_kb":46741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"76'66","reported_seq":86,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:21.449553+0000","last_change":"2024-04-25T22:07:21.449613+0000","last_active":"2024-04-25T22:07:21.449553+0000","last_peered":"2024-04-25T22:07:21.449553+0000","last_clean":"2024-04-25T22:07:21.449553+0000","last_became_active":"2024-04-25T22:06:31.160267+0000","last_became_peered":"2024-04-25T22:06:31.160267+0000","last_unstale":"2024-04-25T22:07:21.449553+0000","last_undegraded":"2024-04-25T22:07:21.449553+0000","last_fullsized":"2024-04-25T22:07:21.449553+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'66","last_scrub_stamp":"2024-04-25T22:07:21.449364+0000","last_deep_scrub":"76'66","last_deep_scrub_stamp":"2024-04-25T22:07:21.449364+0000","last_clean_scrub_stamp":"2024-04-25T22:07:21.449364+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:23:18.648355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"76'489","reported_seq":738,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:14.094418+0000","last_change":"2024-04-25T22:07:14.094536+0000","last_active":"2024-04-25T22:07:14.094418+0000","last_peered":"2024-04-25T22:07:14.094418+0000","last_clean":"2024-04-25T22:07:14.094418+0000","last_became_active":"2024-04-25T22:06:22.832394+0000","last_became_peered":"2024-04-25T22:06:22.832394+0000","last_unstale":"2024-04-25T22:07:14.094418+0000","last_undegraded":"2024-04-25T22:07:14.094418+0000","last_fullsized":"2024-04-25T22:07:14.094418+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'489","last_scrub_stamp":"2024-04-25T22:07:14.094188+0000","last_deep_scrub":"76'489","last_deep_scrub_stamp":"2024-04-25T22:07:14.094188+0000","last_clean_scrub_stamp":"2024-04-25T22:07:14.094188+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:53.151213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":26829,"num_write":457,"num_write_kb":137840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"99'196","reported_seq":389,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:13.184527+0000","last_change":"2024-04-25T22:07:13.184594+0000","last_active":"2024-04-25T22:07:13.184527+0000","last_peered":"2024-04-25T22:07:13.184527+0000","last_clean":"2024-04-25T22:07:13.184527+0000","last_became_active":"2024-04-25T22:06:22.832572+0000","last_became_peered":"2024-04-25T22:06:22.832572+0000","last_unstale":"2024-04-25T22:07:13.184527+0000","last_undegraded":"2024-04-25T22:07:13.184527+0000","last_fullsized":"2024-04-25T22:07:13.184527+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'196","last_scrub_stamp":"2024-04-25T22:07:13.184347+0000","last_deep_scrub":"99'196","last_deep_scrub_stamp":"2024-04-25T22:07:13.184347+0000","last_clean_scrub_stamp":"2024-04-25T22:07:13.184347+0000","objects_scrubbed":3,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:01:41.577853+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"76'437","reported_seq":537,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:19.418219+0000","last_change":"2024-04-25T22:07:19.418283+0000","last_active":"2024-04-25T22:07:19.418219+0000","last_peered":"2024-04-25T22:07:19.418219+0000","last_clean":"2024-04-25T22:07:19.418219+0000","last_became_active":"2024-04-25T22:06:31.147501+0000","last_became_peered":"2024-04-25T22:06:31.147501+0000","last_unstale":"2024-04-25T22:07:19.418219+0000","last_undegraded":"2024-04-25T22:07:19.418219+0000","last_fullsized":"2024-04-25T22:07:19.418219+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'437","last_scrub_stamp":"2024-04-25T22:07:19.418017+0000","last_deep_scrub":"76'437","last_deep_scrub_stamp":"2024-04-25T22:07:19.418017+0000","last_clean_scrub_stamp":"2024-04-25T22:07:19.418017+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:39.260894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":3720,"num_write":406,"num_write_kb":30461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"99'107","reported_seq":274,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:53.251811+0000","last_change":"2024-04-25T22:06:53.251880+0000","last_active":"2024-04-25T22:06:53.251811+0000","last_peered":"2024-04-25T22:06:53.251811+0000","last_clean":"2024-04-25T22:06:53.251811+0000","last_became_active":"2024-04-25T22:06:23.103402+0000","last_became_peered":"2024-04-25T22:06:23.103402+0000","last_unstale":"2024-04-25T22:06:53.251811+0000","last_undegraded":"2024-04-25T22:06:53.251811+0000","last_fullsized":"2024-04-25T22:06:53.251811+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'107","last_scrub_stamp":"2024-04-25T22:06:53.251612+0000","last_deep_scrub":"99'107","last_deep_scrub_stamp":"2024-04-25T22:06:53.251612+0000","last_clean_scrub_stamp":"2024-04-25T22:06:53.251612+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:04.829272+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"76'409","reported_seq":614,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:17.477756+0000","last_change":"2024-04-25T22:07:17.477819+0000","last_active":"2024-04-25T22:07:17.477756+0000","last_peered":"2024-04-25T22:07:17.477756+0000","last_clean":"2024-04-25T22:07:17.477756+0000","last_became_active":"2024-04-25T22:06:23.086188+0000","last_became_peered":"2024-04-25T22:06:23.086188+0000","last_unstale":"2024-04-25T22:07:17.477756+0000","last_undegraded":"2024-04-25T22:07:17.477756+0000","last_fullsized":"2024-04-25T22:07:17.477756+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'409","last_scrub_stamp":"2024-04-25T22:07:17.477549+0000","last_deep_scrub":"76'409","last_deep_scrub_stamp":"2024-04-25T22:07:17.477549+0000","last_clean_scrub_stamp":"2024-04-25T22:07:17.477549+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:54.689693+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19178,"num_write":380,"num_write_kb":91945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"75'51","reported_seq":191,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:52.354233+0000","last_change":"2024-04-25T22:06:52.354294+0000","last_active":"2024-04-25T22:06:52.354233+0000","last_peered":"2024-04-25T22:06:52.354233+0000","last_clean":"2024-04-25T22:06:52.354233+0000","last_became_active":"2024-04-25T22:06:22.798779+0000","last_became_peered":"2024-04-25T22:06:22.798779+0000","last_unstale":"2024-04-25T22:06:52.354233+0000","last_undegraded":"2024-04-25T22:06:52.354233+0000","last_fullsized":"2024-04-25T22:06:52.354233+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'51","last_scrub_stamp":"2024-04-25T22:06:52.354033+0000","last_deep_scrub":"75'51","last_deep_scrub_stamp":"2024-04-25T22:06:52.354033+0000","last_clean_scrub_stamp":"2024-04-25T22:06:52.354033+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:03.260840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"76'377","reported_seq":570,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:15.453287+0000","last_change":"2024-04-25T22:07:15.453351+0000","last_active":"2024-04-25T22:07:15.453287+0000","last_peered":"2024-04-25T22:07:15.453287+0000","last_clean":"2024-04-25T22:07:15.453287+0000","last_became_active":"2024-04-25T22:06:23.085799+0000","last_became_peered":"2024-04-25T22:06:23.085799+0000","last_unstale":"2024-04-25T22:07:15.453287+0000","last_undegraded":"2024-04-25T22:07:15.453287+0000","last_fullsized":"2024-04-25T22:07:15.453287+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'377","last_scrub_stamp":"2024-04-25T22:07:15.453079+0000","last_deep_scrub":"76'377","last_deep_scrub_stamp":"2024-04-25T22:07:15.453079+0000","last_clean_scrub_stamp":"2024-04-25T22:07:15.453079+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:57:20.532715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21517,"num_write":342,"num_write_kb":66898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"99'450","reported_seq":556,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:05.302933+0000","last_change":"2024-04-25T22:07:05.303001+0000","last_active":"2024-04-25T22:07:05.302933+0000","last_peered":"2024-04-25T22:07:05.302933+0000","last_clean":"2024-04-25T22:07:05.302933+0000","last_became_active":"2024-04-25T22:03:33.859539+0000","last_became_peered":"2024-04-25T22:03:33.859539+0000","last_unstale":"2024-04-25T22:07:05.302933+0000","last_undegraded":"2024-04-25T22:07:05.302933+0000","last_fullsized":"2024-04-25T22:07:05.302933+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'450","last_scrub_stamp":"2024-04-25T22:07:05.302737+0000","last_deep_scrub":"99'450","last_deep_scrub_stamp":"2024-04-25T22:07:05.302737+0000","last_clean_scrub_stamp":"2024-04-25T22:07:05.302737+0000","objects_scrubbed":1,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:02.614223+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"76'399","reported_seq":622,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:48.374921+0000","last_change":"2024-04-25T22:06:48.374981+0000","last_active":"2024-04-25T22:06:48.374921+0000","last_peered":"2024-04-25T22:06:48.374921+0000","last_clean":"2024-04-25T22:06:48.374921+0000","last_became_active":"2024-04-25T22:01:14.641477+0000","last_became_peered":"2024-04-25T22:01:14.641477+0000","last_unstale":"2024-04-25T22:06:48.374921+0000","last_undegraded":"2024-04-25T22:06:48.374921+0000","last_fullsized":"2024-04-25T22:06:48.374921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'399","last_scrub_stamp":"2024-04-25T22:06:48.374723+0000","last_deep_scrub":"76'399","last_deep_scrub_stamp":"2024-04-25T22:06:48.374723+0000","last_clean_scrub_stamp":"2024-04-25T22:06:48.374723+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:35.715072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17888,"num_write":373,"num_write_kb":67556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"99'159","reported_seq":329,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:10.357281+0000","last_change":"2024-04-25T22:07:10.357348+0000","last_active":"2024-04-25T22:07:10.357281+0000","last_peered":"2024-04-25T22:07:10.357281+0000","last_clean":"2024-04-25T22:07:10.357281+0000","last_became_active":"2024-04-25T22:06:23.080701+0000","last_became_peered":"2024-04-25T22:06:23.080701+0000","last_unstale":"2024-04-25T22:07:10.357281+0000","last_undegraded":"2024-04-25T22:07:10.357281+0000","last_fullsized":"2024-04-25T22:07:10.357281+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'159","last_scrub_stamp":"2024-04-25T22:07:10.357090+0000","last_deep_scrub":"99'159","last_deep_scrub_stamp":"2024-04-25T22:07:10.357090+0000","last_clean_scrub_stamp":"2024-04-25T22:07:10.357090+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:02.962951+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":129,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:06.363110+0000","last_change":"2024-04-25T22:07:06.363169+0000","last_active":"2024-04-25T22:07:06.363110+0000","last_peered":"2024-04-25T22:07:06.363110+0000","last_clean":"2024-04-25T22:07:06.363110+0000","last_became_active":"2024-04-25T22:06:23.108984+0000","last_became_peered":"2024-04-25T22:06:23.108984+0000","last_unstale":"2024-04-25T22:07:06.363110+0000","last_undegraded":"2024-04-25T22:07:06.363110+0000","last_fullsized":"2024-04-25T22:07:06.363110+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:07:06.362912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:07:06.362912+0000","last_clean_scrub_stamp":"2024-04-25T22:07:06.362912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:12.687423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"99'395","reported_seq":582,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:04.236444+0000","last_change":"2024-04-25T22:07:04.236444+0000","last_active":"2024-04-25T22:07:04.236444+0000","last_peered":"2024-04-25T22:07:04.236444+0000","last_clean":"2024-04-25T22:07:04.236444+0000","last_became_active":"2024-04-25T22:01:13.616743+0000","last_became_peered":"2024-04-25T22:01:13.616743+0000","last_unstale":"2024-04-25T22:07:04.236444+0000","last_undegraded":"2024-04-25T22:07:04.236444+0000","last_fullsized":"2024-04-25T22:07:04.236444+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'395","last_scrub_stamp":"2024-04-25T22:07:04.236195+0000","last_deep_scrub":"99'395","last_deep_scrub_stamp":"2024-04-25T22:07:04.236195+0000","last_clean_scrub_stamp":"2024-04-25T22:07:04.236195+0000","objects_scrubbed":2,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:30.537271+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'463","reported_seq":677,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:07.404028+0000","last_change":"2024-04-25T22:07:07.404094+0000","last_active":"2024-04-25T22:07:07.404028+0000","last_peered":"2024-04-25T22:07:07.404028+0000","last_clean":"2024-04-25T22:07:07.404028+0000","last_became_active":"2024-04-25T22:06:23.082756+0000","last_became_peered":"2024-04-25T22:06:23.082756+0000","last_unstale":"2024-04-25T22:07:07.404028+0000","last_undegraded":"2024-04-25T22:07:07.404028+0000","last_fullsized":"2024-04-25T22:07:07.404028+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'463","last_scrub_stamp":"2024-04-25T22:07:07.403839+0000","last_deep_scrub":"76'463","last_deep_scrub_stamp":"2024-04-25T22:07:07.403839+0000","last_clean_scrub_stamp":"2024-04-25T22:07:07.403839+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:51:06.755260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29270,"num_write":426,"num_write_kb":129367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":129,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:12.417699+0000","last_change":"2024-04-25T22:07:12.417754+0000","last_active":"2024-04-25T22:07:12.417699+0000","last_peered":"2024-04-25T22:07:12.417699+0000","last_clean":"2024-04-25T22:07:12.417699+0000","last_became_active":"2024-04-25T22:06:23.080841+0000","last_became_peered":"2024-04-25T22:06:23.080841+0000","last_unstale":"2024-04-25T22:07:12.417699+0000","last_undegraded":"2024-04-25T22:07:12.417699+0000","last_fullsized":"2024-04-25T22:07:12.417699+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:07:12.417494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:07:12.417494+0000","last_clean_scrub_stamp":"2024-04-25T22:07:12.417494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:25:29.524903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"99'126","reported_seq":383,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:51.379727+0000","last_change":"2024-04-25T22:06:51.379727+0000","last_active":"2024-04-25T22:06:51.379727+0000","last_peered":"2024-04-25T22:06:51.379727+0000","last_clean":"2024-04-25T22:06:51.379727+0000","last_became_active":"2024-04-25T22:06:22.801616+0000","last_became_peered":"2024-04-25T22:06:22.801616+0000","last_unstale":"2024-04-25T22:06:51.379727+0000","last_undegraded":"2024-04-25T22:06:51.379727+0000","last_fullsized":"2024-04-25T22:06:51.379727+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'126","last_scrub_stamp":"2024-04-25T22:06:51.379448+0000","last_deep_scrub":"99'126","last_deep_scrub_stamp":"2024-04-25T22:06:51.379448+0000","last_clean_scrub_stamp":"2024-04-25T22:06:51.379448+0000","objects_scrubbed":1,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:17.624837+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1464197,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":63,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"76'457","reported_seq":656,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:04.274987+0000","last_change":"2024-04-25T22:07:04.274987+0000","last_active":"2024-04-25T22:07:04.274987+0000","last_peered":"2024-04-25T22:07:04.274987+0000","last_clean":"2024-04-25T22:07:04.274987+0000","last_became_active":"2024-04-25T22:03:05.699581+0000","last_became_peered":"2024-04-25T22:03:05.699581+0000","last_unstale":"2024-04-25T22:07:04.274987+0000","last_undegraded":"2024-04-25T22:07:04.274987+0000","last_fullsized":"2024-04-25T22:07:04.274987+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'457","last_scrub_stamp":"2024-04-25T22:07:04.274728+0000","last_deep_scrub":"76'457","last_deep_scrub_stamp":"2024-04-25T22:07:04.274728+0000","last_clean_scrub_stamp":"2024-04-25T22:07:04.274728+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:29:05.674042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":34759,"num_write":424,"num_write_kb":71902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":193,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:02.182470+0000","last_change":"2024-04-25T22:07:02.182470+0000","last_active":"2024-04-25T22:07:02.182470+0000","last_peered":"2024-04-25T22:07:02.182470+0000","last_clean":"2024-04-25T22:07:02.182470+0000","last_became_active":"2024-04-25T22:01:09.580476+0000","last_became_peered":"2024-04-25T22:01:09.580476+0000","last_unstale":"2024-04-25T22:07:02.182470+0000","last_undegraded":"2024-04-25T22:07:02.182470+0000","last_fullsized":"2024-04-25T22:07:02.182470+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:07:02.182209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:07:02.182209+0000","last_clean_scrub_stamp":"2024-04-25T22:07:02.182209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:59.290847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"99'313","reported_seq":508,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:48.374024+0000","last_change":"2024-04-25T22:06:48.374024+0000","last_active":"2024-04-25T22:06:48.374024+0000","last_peered":"2024-04-25T22:06:48.374024+0000","last_clean":"2024-04-25T22:06:48.374024+0000","last_became_active":"2024-04-25T22:06:22.794841+0000","last_became_peered":"2024-04-25T22:06:22.794841+0000","last_unstale":"2024-04-25T22:06:48.374024+0000","last_undegraded":"2024-04-25T22:06:48.374024+0000","last_fullsized":"2024-04-25T22:06:48.374024+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'313","last_scrub_stamp":"2024-04-25T22:06:48.373725+0000","last_deep_scrub":"99'313","last_deep_scrub_stamp":"2024-04-25T22:06:48.373725+0000","last_clean_scrub_stamp":"2024-04-25T22:06:48.373725+0000","objects_scrubbed":2,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:53:19.399993+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":8290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"76'373","reported_seq":602,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:58.308044+0000","last_change":"2024-04-25T22:06:58.308044+0000","last_active":"2024-04-25T22:06:58.308044+0000","last_peered":"2024-04-25T22:06:58.308044+0000","last_clean":"2024-04-25T22:06:58.308044+0000","last_became_active":"2024-04-25T22:01:14.637472+0000","last_became_peered":"2024-04-25T22:01:14.637472+0000","last_unstale":"2024-04-25T22:06:58.308044+0000","last_undegraded":"2024-04-25T22:06:58.308044+0000","last_fullsized":"2024-04-25T22:06:58.308044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'373","last_scrub_stamp":"2024-04-25T22:06:58.307771+0000","last_deep_scrub":"76'373","last_deep_scrub_stamp":"2024-04-25T22:06:58.307771+0000","last_clean_scrub_stamp":"2024-04-25T22:06:58.307771+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:59:19.717093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28273,"num_write":350,"num_write_kb":87787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":129,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:55.211596+0000","last_change":"2024-04-25T22:06:55.211653+0000","last_active":"2024-04-25T22:06:55.211596+0000","last_peered":"2024-04-25T22:06:55.211596+0000","last_clean":"2024-04-25T22:06:55.211596+0000","last_became_active":"2024-04-25T22:06:23.106155+0000","last_became_peered":"2024-04-25T22:06:23.106155+0000","last_unstale":"2024-04-25T22:06:55.211596+0000","last_undegraded":"2024-04-25T22:06:55.211596+0000","last_fullsized":"2024-04-25T22:06:55.211596+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:06:55.211397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:06:55.211397+0000","last_clean_scrub_stamp":"2024-04-25T22:06:55.211397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:35:48.867729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"76'75","reported_seq":86,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:22.485849+0000","last_change":"2024-04-25T22:07:22.485913+0000","last_active":"2024-04-25T22:07:22.485849+0000","last_peered":"2024-04-25T22:07:22.485849+0000","last_clean":"2024-04-25T22:07:22.485849+0000","last_became_active":"2024-04-25T22:06:31.150555+0000","last_became_peered":"2024-04-25T22:06:31.150555+0000","last_unstale":"2024-04-25T22:07:22.485849+0000","last_undegraded":"2024-04-25T22:07:22.485849+0000","last_fullsized":"2024-04-25T22:07:22.485849+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'75","last_scrub_stamp":"2024-04-25T22:07:22.485662+0000","last_deep_scrub":"76'75","last_deep_scrub_stamp":"2024-04-25T22:07:22.485662+0000","last_clean_scrub_stamp":"2024-04-25T22:07:22.485662+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:10.077711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"76'461","reported_seq":763,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:54.373047+0000","last_change":"2024-04-25T22:06:54.373047+0000","last_active":"2024-04-25T22:06:54.373047+0000","last_peered":"2024-04-25T22:06:54.373047+0000","last_clean":"2024-04-25T22:06:54.373047+0000","last_became_active":"2024-04-25T22:01:14.637131+0000","last_became_peered":"2024-04-25T22:01:14.637131+0000","last_unstale":"2024-04-25T22:06:54.373047+0000","last_undegraded":"2024-04-25T22:06:54.373047+0000","last_fullsized":"2024-04-25T22:06:54.373047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'461","last_scrub_stamp":"2024-04-25T22:06:54.372778+0000","last_deep_scrub":"76'461","last_deep_scrub_stamp":"2024-04-25T22:06:54.372778+0000","last_clean_scrub_stamp":"2024-04-25T22:06:54.372778+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:41:36.037813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":67984,"num_write":425,"num_write_kb":154741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"99'269","reported_seq":435,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:52.220280+0000","last_change":"2024-04-25T22:06:52.220351+0000","last_active":"2024-04-25T22:06:52.220280+0000","last_peered":"2024-04-25T22:06:52.220280+0000","last_clean":"2024-04-25T22:06:52.220280+0000","last_became_active":"2024-04-25T22:06:23.122629+0000","last_became_peered":"2024-04-25T22:06:23.122629+0000","last_unstale":"2024-04-25T22:06:52.220280+0000","last_undegraded":"2024-04-25T22:06:52.220280+0000","last_fullsized":"2024-04-25T22:06:52.220280+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'269","last_scrub_stamp":"2024-04-25T22:06:52.220087+0000","last_deep_scrub":"99'269","last_deep_scrub_stamp":"2024-04-25T22:06:52.220087+0000","last_clean_scrub_stamp":"2024-04-25T22:06:52.220087+0000","objects_scrubbed":1,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:41:51.137396+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":193,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:01.222176+0000","last_change":"2024-04-25T22:07:01.222176+0000","last_active":"2024-04-25T22:07:01.222176+0000","last_peered":"2024-04-25T22:07:01.222176+0000","last_clean":"2024-04-25T22:07:01.222176+0000","last_became_active":"2024-04-25T22:01:09.580533+0000","last_became_peered":"2024-04-25T22:01:09.580533+0000","last_unstale":"2024-04-25T22:07:01.222176+0000","last_undegraded":"2024-04-25T22:07:01.222176+0000","last_fullsized":"2024-04-25T22:07:01.222176+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:07:01.221935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:07:01.221935+0000","last_clean_scrub_stamp":"2024-04-25T22:07:01.221935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:46.738622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"76'398","reported_seq":588,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:56.287961+0000","last_change":"2024-04-25T22:06:56.287961+0000","last_active":"2024-04-25T22:06:56.287961+0000","last_peered":"2024-04-25T22:06:56.287961+0000","last_clean":"2024-04-25T22:06:56.287961+0000","last_became_active":"2024-04-25T22:06:22.789384+0000","last_became_peered":"2024-04-25T22:06:22.789384+0000","last_unstale":"2024-04-25T22:06:56.287961+0000","last_undegraded":"2024-04-25T22:06:56.287961+0000","last_fullsized":"2024-04-25T22:06:56.287961+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'398","last_scrub_stamp":"2024-04-25T22:06:56.287695+0000","last_deep_scrub":"76'398","last_deep_scrub_stamp":"2024-04-25T22:06:56.287695+0000","last_clean_scrub_stamp":"2024-04-25T22:06:56.287695+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:46.536240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":26599,"num_write":366,"num_write_kb":75612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"76'47","reported_seq":234,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:03.149431+0000","last_change":"2024-04-25T22:07:03.149431+0000","last_active":"2024-04-25T22:07:03.149431+0000","last_peered":"2024-04-25T22:07:03.149431+0000","last_clean":"2024-04-25T22:07:03.149431+0000","last_became_active":"2024-04-25T22:01:13.616728+0000","last_became_peered":"2024-04-25T22:01:13.616728+0000","last_unstale":"2024-04-25T22:07:03.149431+0000","last_undegraded":"2024-04-25T22:07:03.149431+0000","last_fullsized":"2024-04-25T22:07:03.149431+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'47","last_scrub_stamp":"2024-04-25T22:07:03.149177+0000","last_deep_scrub":"76'47","last_deep_scrub_stamp":"2024-04-25T22:07:03.149177+0000","last_clean_scrub_stamp":"2024-04-25T22:07:03.149177+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:21:58.423985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:03.277555+0000","last_change":"2024-04-25T22:07:03.277555+0000","last_active":"2024-04-25T22:07:03.277555+0000","last_peered":"2024-04-25T22:07:03.277555+0000","last_clean":"2024-04-25T22:07:03.277555+0000","last_became_active":"2024-04-25T22:03:05.701322+0000","last_became_peered":"2024-04-25T22:03:05.701322+0000","last_unstale":"2024-04-25T22:07:03.277555+0000","last_undegraded":"2024-04-25T22:07:03.277555+0000","last_fullsized":"2024-04-25T22:07:03.277555+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:07:03.277311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:07:03.277311+0000","last_clean_scrub_stamp":"2024-04-25T22:07:03.277311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:22:06.392400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"76'406","reported_seq":652,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:51.374435+0000","last_change":"2024-04-25T22:06:51.374435+0000","last_active":"2024-04-25T22:06:51.374435+0000","last_peered":"2024-04-25T22:06:51.374435+0000","last_clean":"2024-04-25T22:06:51.374435+0000","last_became_active":"2024-04-25T22:06:22.789807+0000","last_became_peered":"2024-04-25T22:06:22.789807+0000","last_unstale":"2024-04-25T22:06:51.374435+0000","last_undegraded":"2024-04-25T22:06:51.374435+0000","last_fullsized":"2024-04-25T22:06:51.374435+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'406","last_scrub_stamp":"2024-04-25T22:06:51.374173+0000","last_deep_scrub":"76'406","last_deep_scrub_stamp":"2024-04-25T22:06:51.374173+0000","last_clean_scrub_stamp":"2024-04-25T22:06:51.374173+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:47:28.548940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25634,"num_write":377,"num_write_kb":103970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"99'65","reported_seq":252,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:05.159483+0000","last_change":"2024-04-25T22:07:05.159483+0000","last_active":"2024-04-25T22:07:05.159483+0000","last_peered":"2024-04-25T22:07:05.159483+0000","last_clean":"2024-04-25T22:07:05.159483+0000","last_became_active":"2024-04-25T22:01:13.616916+0000","last_became_peered":"2024-04-25T22:01:13.616916+0000","last_unstale":"2024-04-25T22:07:05.159483+0000","last_undegraded":"2024-04-25T22:07:05.159483+0000","last_fullsized":"2024-04-25T22:07:05.159483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'65","last_scrub_stamp":"2024-04-25T22:07:05.159224+0000","last_deep_scrub":"99'65","last_deep_scrub_stamp":"2024-04-25T22:07:05.159224+0000","last_clean_scrub_stamp":"2024-04-25T22:07:05.159224+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:50:58.064004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:48.237497+0000","last_change":"2024-04-25T22:06:48.237553+0000","last_active":"2024-04-25T22:06:48.237497+0000","last_peered":"2024-04-25T22:06:48.237497+0000","last_clean":"2024-04-25T22:06:48.237497+0000","last_became_active":"2024-04-25T22:06:24.091909+0000","last_became_peered":"2024-04-25T22:06:24.091909+0000","last_unstale":"2024-04-25T22:06:48.237497+0000","last_undegraded":"2024-04-25T22:06:48.237497+0000","last_fullsized":"2024-04-25T22:06:48.237497+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:06:48.237288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:06:48.237288+0000","last_clean_scrub_stamp":"2024-04-25T22:06:48.237288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:42:29.191428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"76'402","reported_seq":615,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:59.274286+0000","last_change":"2024-04-25T22:06:59.274286+0000","last_active":"2024-04-25T22:06:59.274286+0000","last_peered":"2024-04-25T22:06:59.274286+0000","last_clean":"2024-04-25T22:06:59.274286+0000","last_became_active":"2024-04-25T22:06:22.802005+0000","last_became_peered":"2024-04-25T22:06:22.802005+0000","last_unstale":"2024-04-25T22:06:59.274286+0000","last_undegraded":"2024-04-25T22:06:59.274286+0000","last_fullsized":"2024-04-25T22:06:59.274286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'402","last_scrub_stamp":"2024-04-25T22:06:59.274026+0000","last_deep_scrub":"76'402","last_deep_scrub_stamp":"2024-04-25T22:06:59.274026+0000","last_clean_scrub_stamp":"2024-04-25T22:06:59.274026+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:45.358388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":9572,"num_write":361,"num_write_kb":29911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"99'128","reported_seq":322,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:53.443633+0000","last_change":"2024-04-25T22:06:53.443633+0000","last_active":"2024-04-25T22:06:53.443633+0000","last_peered":"2024-04-25T22:06:53.443633+0000","last_clean":"2024-04-25T22:06:53.443633+0000","last_became_active":"2024-04-25T22:06:22.802083+0000","last_became_peered":"2024-04-25T22:06:22.802083+0000","last_unstale":"2024-04-25T22:06:53.443633+0000","last_undegraded":"2024-04-25T22:06:53.443633+0000","last_fullsized":"2024-04-25T22:06:53.443633+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'128","last_scrub_stamp":"2024-04-25T22:06:53.443384+0000","last_deep_scrub":"99'128","last_deep_scrub_stamp":"2024-04-25T22:06:53.443384+0000","last_clean_scrub_stamp":"2024-04-25T22:06:53.443384+0000","objects_scrubbed":1,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:23:27.524012+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":129,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:09.390295+0000","last_change":"2024-04-25T22:07:09.390367+0000","last_active":"2024-04-25T22:07:09.390295+0000","last_peered":"2024-04-25T22:07:09.390295+0000","last_clean":"2024-04-25T22:07:09.390295+0000","last_became_active":"2024-04-25T22:06:23.080393+0000","last_became_peered":"2024-04-25T22:06:23.080393+0000","last_unstale":"2024-04-25T22:07:09.390295+0000","last_undegraded":"2024-04-25T22:07:09.390295+0000","last_fullsized":"2024-04-25T22:07:09.390295+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:07:09.390067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:07:09.390067+0000","last_clean_scrub_stamp":"2024-04-25T22:07:09.390067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:59.783125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"76'415","reported_seq":606,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:50.364885+0000","last_change":"2024-04-25T22:06:50.364885+0000","last_active":"2024-04-25T22:06:50.364885+0000","last_peered":"2024-04-25T22:06:50.364885+0000","last_clean":"2024-04-25T22:06:50.364885+0000","last_became_active":"2024-04-25T22:06:22.789624+0000","last_became_peered":"2024-04-25T22:06:22.789624+0000","last_unstale":"2024-04-25T22:06:50.364885+0000","last_undegraded":"2024-04-25T22:06:50.364885+0000","last_fullsized":"2024-04-25T22:06:50.364885+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'415","last_scrub_stamp":"2024-04-25T22:06:50.364620+0000","last_deep_scrub":"76'415","last_deep_scrub_stamp":"2024-04-25T22:06:50.364620+0000","last_clean_scrub_stamp":"2024-04-25T22:06:50.364620+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:37:27.901357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27345,"num_write":384,"num_write_kb":92854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"76'407","reported_seq":632,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:16.491054+0000","last_change":"2024-04-25T22:07:16.491118+0000","last_active":"2024-04-25T22:07:16.491054+0000","last_peered":"2024-04-25T22:07:16.491054+0000","last_clean":"2024-04-25T22:07:16.491054+0000","last_became_active":"2024-04-25T22:06:23.087118+0000","last_became_peered":"2024-04-25T22:06:23.087118+0000","last_unstale":"2024-04-25T22:07:16.491054+0000","last_undegraded":"2024-04-25T22:07:16.491054+0000","last_fullsized":"2024-04-25T22:07:16.491054+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'407","last_scrub_stamp":"2024-04-25T22:07:16.490854+0000","last_deep_scrub":"76'407","last_deep_scrub_stamp":"2024-04-25T22:07:16.490854+0000","last_clean_scrub_stamp":"2024-04-25T22:07:16.490854+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:48.237867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":33923,"num_write":372,"num_write_kb":82083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"99'266","reported_seq":435,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:11.474682+0000","last_change":"2024-04-25T22:07:11.474771+0000","last_active":"2024-04-25T22:07:11.474682+0000","last_peered":"2024-04-25T22:07:11.474682+0000","last_clean":"2024-04-25T22:07:11.474682+0000","last_became_active":"2024-04-25T22:06:23.080552+0000","last_became_peered":"2024-04-25T22:06:23.080552+0000","last_unstale":"2024-04-25T22:07:11.474682+0000","last_undegraded":"2024-04-25T22:07:11.474682+0000","last_fullsized":"2024-04-25T22:07:11.474682+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'266","last_scrub_stamp":"2024-04-25T22:07:11.474487+0000","last_deep_scrub":"99'266","last_deep_scrub_stamp":"2024-04-25T22:07:11.474487+0000","last_clean_scrub_stamp":"2024-04-25T22:07:11.474487+0000","objects_scrubbed":6,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:50:31.693057+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8470619,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"76'408","reported_seq":619,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:46.345971+0000","last_change":"2024-04-25T22:06:46.346032+0000","last_active":"2024-04-25T22:06:46.345971+0000","last_peered":"2024-04-25T22:06:46.345971+0000","last_clean":"2024-04-25T22:06:46.345971+0000","last_became_active":"2024-04-25T22:01:14.639640+0000","last_became_peered":"2024-04-25T22:01:14.639640+0000","last_unstale":"2024-04-25T22:06:46.345971+0000","last_undegraded":"2024-04-25T22:06:46.345971+0000","last_fullsized":"2024-04-25T22:06:46.345971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'408","last_scrub_stamp":"2024-04-25T22:06:46.345765+0000","last_deep_scrub":"76'408","last_deep_scrub_stamp":"2024-04-25T22:06:46.345765+0000","last_clean_scrub_stamp":"2024-04-25T22:06:46.345765+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:15.185009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14178,"num_write":370,"num_write_kb":58735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"99'106","reported_seq":300,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:46.291512+0000","last_change":"2024-04-25T22:06:46.291648+0000","last_active":"2024-04-25T22:06:46.291512+0000","last_peered":"2024-04-25T22:06:46.291512+0000","last_clean":"2024-04-25T22:06:46.291512+0000","last_became_active":"2024-04-25T22:06:22.802667+0000","last_became_peered":"2024-04-25T22:06:22.802667+0000","last_unstale":"2024-04-25T22:06:46.291512+0000","last_undegraded":"2024-04-25T22:06:46.291512+0000","last_fullsized":"2024-04-25T22:06:46.291512+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'106","last_scrub_stamp":"2024-04-25T22:06:46.291281+0000","last_deep_scrub":"99'106","last_deep_scrub_stamp":"2024-04-25T22:06:46.291281+0000","last_clean_scrub_stamp":"2024-04-25T22:06:46.291281+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:44:03.703813+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"99'233","reported_seq":296,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:47.268073+0000","last_change":"2024-04-25T22:06:47.268224+0000","last_active":"2024-04-25T22:06:47.268073+0000","last_peered":"2024-04-25T22:06:47.268073+0000","last_clean":"2024-04-25T22:06:47.268073+0000","last_became_active":"2024-04-25T22:06:31.150582+0000","last_became_peered":"2024-04-25T22:06:31.150582+0000","last_unstale":"2024-04-25T22:06:47.268073+0000","last_undegraded":"2024-04-25T22:06:47.268073+0000","last_fullsized":"2024-04-25T22:06:47.268073+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'233","last_scrub_stamp":"2024-04-25T22:06:47.267812+0000","last_deep_scrub":"99'233","last_deep_scrub_stamp":"2024-04-25T22:06:47.267812+0000","last_clean_scrub_stamp":"2024-04-25T22:06:47.267812+0000","objects_scrubbed":1,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:43:04.023399+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"76'483","reported_seq":722,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:12.079494+0000","last_change":"2024-04-25T22:07:12.079554+0000","last_active":"2024-04-25T22:07:12.079494+0000","last_peered":"2024-04-25T22:07:12.079494+0000","last_clean":"2024-04-25T22:07:12.079494+0000","last_became_active":"2024-04-25T22:06:22.807584+0000","last_became_peered":"2024-04-25T22:06:22.807584+0000","last_unstale":"2024-04-25T22:07:12.079494+0000","last_undegraded":"2024-04-25T22:07:12.079494+0000","last_fullsized":"2024-04-25T22:07:12.079494+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'483","last_scrub_stamp":"2024-04-25T22:07:12.079290+0000","last_deep_scrub":"76'483","last_deep_scrub_stamp":"2024-04-25T22:07:12.079290+0000","last_clean_scrub_stamp":"2024-04-25T22:07:12.079290+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:17.285367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":24709,"num_write":463,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"75'60","reported_seq":253,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:47.377558+0000","last_change":"2024-04-25T22:06:47.377620+0000","last_active":"2024-04-25T22:06:47.377558+0000","last_peered":"2024-04-25T22:06:47.377558+0000","last_clean":"2024-04-25T22:06:47.377558+0000","last_became_active":"2024-04-25T22:06:22.801412+0000","last_became_peered":"2024-04-25T22:06:22.801412+0000","last_unstale":"2024-04-25T22:06:47.377558+0000","last_undegraded":"2024-04-25T22:06:47.377558+0000","last_fullsized":"2024-04-25T22:06:47.377558+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'60","last_scrub_stamp":"2024-04-25T22:06:47.377366+0000","last_deep_scrub":"75'60","last_deep_scrub_stamp":"2024-04-25T22:06:47.377366+0000","last_clean_scrub_stamp":"2024-04-25T22:06:47.377366+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:24.358167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"76'444","reported_seq":657,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:08.161222+0000","last_change":"2024-04-25T22:07:08.161288+0000","last_active":"2024-04-25T22:07:08.161222+0000","last_peered":"2024-04-25T22:07:08.161222+0000","last_clean":"2024-04-25T22:07:08.161222+0000","last_became_active":"2024-04-25T22:01:14.637640+0000","last_became_peered":"2024-04-25T22:01:14.637640+0000","last_unstale":"2024-04-25T22:07:08.161222+0000","last_undegraded":"2024-04-25T22:07:08.161222+0000","last_fullsized":"2024-04-25T22:07:08.161222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'444","last_scrub_stamp":"2024-04-25T22:07:08.161017+0000","last_deep_scrub":"76'444","last_deep_scrub_stamp":"2024-04-25T22:07:08.161017+0000","last_clean_scrub_stamp":"2024-04-25T22:07:08.161017+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:34:05.472503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14429,"num_write":416,"num_write_kb":59186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"76'355","reported_seq":509,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:59.258809+0000","last_change":"2024-04-25T22:06:59.258809+0000","last_active":"2024-04-25T22:06:59.258809+0000","last_peered":"2024-04-25T22:06:59.258809+0000","last_clean":"2024-04-25T22:06:59.258809+0000","last_became_active":"2024-04-25T22:06:22.792886+0000","last_became_peered":"2024-04-25T22:06:22.792886+0000","last_unstale":"2024-04-25T22:06:59.258809+0000","last_undegraded":"2024-04-25T22:06:59.258809+0000","last_fullsized":"2024-04-25T22:06:59.258809+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'355","last_scrub_stamp":"2024-04-25T22:06:59.258519+0000","last_deep_scrub":"76'355","last_deep_scrub_stamp":"2024-04-25T22:06:59.258519+0000","last_clean_scrub_stamp":"2024-04-25T22:06:59.258519+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:56.367157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":18236,"num_write":332,"num_write_kb":42553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"99'744","reported_seq":930,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:07.240670+0000","last_change":"2024-04-25T22:07:07.240745+0000","last_active":"2024-04-25T22:07:07.240670+0000","last_peered":"2024-04-25T22:07:07.240670+0000","last_clean":"2024-04-25T22:07:07.240670+0000","last_became_active":"2024-04-25T22:01:13.618135+0000","last_became_peered":"2024-04-25T22:01:13.618135+0000","last_unstale":"2024-04-25T22:07:07.240670+0000","last_undegraded":"2024-04-25T22:07:07.240670+0000","last_fullsized":"2024-04-25T22:07:07.240670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'744","last_scrub_stamp":"2024-04-25T22:07:07.240453+0000","last_deep_scrub":"99'744","last_deep_scrub_stamp":"2024-04-25T22:07:07.240453+0000","last_clean_scrub_stamp":"2024-04-25T22:07:07.240453+0000","objects_scrubbed":2,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:29:08.639768+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"76'378","reported_seq":589,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:10.099677+0000","last_change":"2024-04-25T22:07:10.099677+0000","last_active":"2024-04-25T22:07:10.099677+0000","last_peered":"2024-04-25T22:07:10.099677+0000","last_clean":"2024-04-25T22:07:10.099677+0000","last_became_active":"2024-04-25T22:06:22.806240+0000","last_became_peered":"2024-04-25T22:06:22.806240+0000","last_unstale":"2024-04-25T22:07:10.099677+0000","last_undegraded":"2024-04-25T22:07:10.099677+0000","last_fullsized":"2024-04-25T22:07:10.099677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'378","last_scrub_stamp":"2024-04-25T22:07:10.099405+0000","last_deep_scrub":"76'378","last_deep_scrub_stamp":"2024-04-25T22:07:10.099405+0000","last_clean_scrub_stamp":"2024-04-25T22:07:10.099405+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:26:06.155998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6876,"num_write":354,"num_write_kb":46840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"99'205","reported_seq":398,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:55.388796+0000","last_change":"2024-04-25T22:06:55.388860+0000","last_active":"2024-04-25T22:06:55.388796+0000","last_peered":"2024-04-25T22:06:55.388796+0000","last_clean":"2024-04-25T22:06:55.388796+0000","last_became_active":"2024-04-25T22:06:22.801630+0000","last_became_peered":"2024-04-25T22:06:22.801630+0000","last_unstale":"2024-04-25T22:06:55.388796+0000","last_undegraded":"2024-04-25T22:06:55.388796+0000","last_fullsized":"2024-04-25T22:06:55.388796+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'205","last_scrub_stamp":"2024-04-25T22:06:55.388593+0000","last_deep_scrub":"99'205","last_deep_scrub_stamp":"2024-04-25T22:06:55.388593+0000","last_clean_scrub_stamp":"2024-04-25T22:06:55.388593+0000","objects_scrubbed":1,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:19:22.258602+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"76'377","reported_seq":524,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:11.234929+0000","last_change":"2024-04-25T22:07:11.234992+0000","last_active":"2024-04-25T22:07:11.234929+0000","last_peered":"2024-04-25T22:07:11.234929+0000","last_clean":"2024-04-25T22:07:11.234929+0000","last_became_active":"2024-04-25T22:06:22.795334+0000","last_became_peered":"2024-04-25T22:06:22.795334+0000","last_unstale":"2024-04-25T22:07:11.234929+0000","last_undegraded":"2024-04-25T22:07:11.234929+0000","last_fullsized":"2024-04-25T22:07:11.234929+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'377","last_scrub_stamp":"2024-04-25T22:07:11.234730+0000","last_deep_scrub":"76'377","last_deep_scrub_stamp":"2024-04-25T22:07:11.234730+0000","last_clean_scrub_stamp":"2024-04-25T22:07:11.234730+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:54:16.349440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6059,"num_write":332,"num_write_kb":37972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"99'220","reported_seq":344,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:16.366162+0000","last_change":"2024-04-25T22:07:16.366303+0000","last_active":"2024-04-25T22:07:16.366162+0000","last_peered":"2024-04-25T22:07:16.366162+0000","last_clean":"2024-04-25T22:07:16.366162+0000","last_became_active":"2024-04-25T22:06:28.841447+0000","last_became_peered":"2024-04-25T22:06:28.841447+0000","last_unstale":"2024-04-25T22:07:16.366162+0000","last_undegraded":"2024-04-25T22:07:16.366162+0000","last_fullsized":"2024-04-25T22:07:16.366162+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'220","last_scrub_stamp":"2024-04-25T22:07:16.365824+0000","last_deep_scrub":"99'220","last_deep_scrub_stamp":"2024-04-25T22:07:16.365824+0000","last_clean_scrub_stamp":"2024-04-25T22:07:16.365824+0000","objects_scrubbed":3,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:45:40.114499+0000","scrub_duration":99,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":12365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"76'389","reported_seq":551,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:08.232528+0000","last_change":"2024-04-25T22:07:08.232591+0000","last_active":"2024-04-25T22:07:08.232528+0000","last_peered":"2024-04-25T22:07:08.232528+0000","last_clean":"2024-04-25T22:07:08.232528+0000","last_became_active":"2024-04-25T22:03:33.860800+0000","last_became_peered":"2024-04-25T22:03:33.860800+0000","last_unstale":"2024-04-25T22:07:08.232528+0000","last_undegraded":"2024-04-25T22:07:08.232528+0000","last_fullsized":"2024-04-25T22:07:08.232528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'389","last_scrub_stamp":"2024-04-25T22:07:08.232331+0000","last_deep_scrub":"76'389","last_deep_scrub_stamp":"2024-04-25T22:07:08.232331+0000","last_clean_scrub_stamp":"2024-04-25T22:07:08.232331+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:50.373265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19110,"num_write":355,"num_write_kb":63152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"99'52","reported_seq":136,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:01.288659+0000","last_change":"2024-04-25T22:07:01.288788+0000","last_active":"2024-04-25T22:07:01.288659+0000","last_peered":"2024-04-25T22:07:01.288659+0000","last_clean":"2024-04-25T22:07:01.288659+0000","last_became_active":"2024-04-25T22:06:22.803778+0000","last_became_peered":"2024-04-25T22:06:22.803778+0000","last_unstale":"2024-04-25T22:07:01.288659+0000","last_undegraded":"2024-04-25T22:07:01.288659+0000","last_fullsized":"2024-04-25T22:07:01.288659+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'52","last_scrub_stamp":"2024-04-25T22:07:01.288423+0000","last_deep_scrub":"99'52","last_deep_scrub_stamp":"2024-04-25T22:07:01.288423+0000","last_clean_scrub_stamp":"2024-04-25T22:07:01.288423+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:27.589499+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"76'386","reported_seq":492,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:23.486683+0000","last_change":"2024-04-25T22:07:23.486746+0000","last_active":"2024-04-25T22:07:23.486683+0000","last_peered":"2024-04-25T22:07:23.486683+0000","last_clean":"2024-04-25T22:07:23.486683+0000","last_became_active":"2024-04-25T22:06:31.149995+0000","last_became_peered":"2024-04-25T22:06:31.149995+0000","last_unstale":"2024-04-25T22:07:23.486683+0000","last_undegraded":"2024-04-25T22:07:23.486683+0000","last_fullsized":"2024-04-25T22:07:23.486683+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'386","last_scrub_stamp":"2024-04-25T22:07:23.486490+0000","last_deep_scrub":"76'386","last_deep_scrub_stamp":"2024-04-25T22:07:23.486490+0000","last_clean_scrub_stamp":"2024-04-25T22:07:23.486490+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:14.074792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14050,"num_write":362,"num_write_kb":58957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"99'190","reported_seq":242,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:51.236079+0000","last_change":"2024-04-25T22:06:51.236148+0000","last_active":"2024-04-25T22:06:51.236079+0000","last_peered":"2024-04-25T22:06:51.236079+0000","last_clean":"2024-04-25T22:06:51.236079+0000","last_became_active":"2024-04-25T22:06:31.148291+0000","last_became_peered":"2024-04-25T22:06:31.148291+0000","last_unstale":"2024-04-25T22:06:51.236079+0000","last_undegraded":"2024-04-25T22:06:51.236079+0000","last_fullsized":"2024-04-25T22:06:51.236079+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'190","last_scrub_stamp":"2024-04-25T22:06:51.235885+0000","last_deep_scrub":"99'190","last_deep_scrub_stamp":"2024-04-25T22:06:51.235885+0000","last_clean_scrub_stamp":"2024-04-25T22:06:51.235885+0000","objects_scrubbed":2,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:48.916005+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"76'397","reported_seq":503,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:18.458296+0000","last_change":"2024-04-25T22:07:18.458414+0000","last_active":"2024-04-25T22:07:18.458296+0000","last_peered":"2024-04-25T22:07:18.458296+0000","last_clean":"2024-04-25T22:07:18.458296+0000","last_became_active":"2024-04-25T22:06:31.148445+0000","last_became_peered":"2024-04-25T22:06:31.148445+0000","last_unstale":"2024-04-25T22:07:18.458296+0000","last_undegraded":"2024-04-25T22:07:18.458296+0000","last_fullsized":"2024-04-25T22:07:18.458296+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'397","last_scrub_stamp":"2024-04-25T22:07:18.458105+0000","last_deep_scrub":"76'397","last_deep_scrub_stamp":"2024-04-25T22:07:18.458105+0000","last_clean_scrub_stamp":"2024-04-25T22:07:18.458105+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:50.527240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13280,"num_write":364,"num_write_kb":46108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"99'288","reported_seq":427,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:57.337519+0000","last_change":"2024-04-25T22:06:57.337603+0000","last_active":"2024-04-25T22:06:57.337519+0000","last_peered":"2024-04-25T22:06:57.337519+0000","last_clean":"2024-04-25T22:06:57.337519+0000","last_became_active":"2024-04-25T22:06:22.794078+0000","last_became_peered":"2024-04-25T22:06:22.794078+0000","last_unstale":"2024-04-25T22:06:57.337519+0000","last_undegraded":"2024-04-25T22:06:57.337519+0000","last_fullsized":"2024-04-25T22:06:57.337519+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'288","last_scrub_stamp":"2024-04-25T22:06:57.337333+0000","last_deep_scrub":"99'288","last_deep_scrub_stamp":"2024-04-25T22:06:57.337333+0000","last_clean_scrub_stamp":"2024-04-25T22:06:57.337333+0000","objects_scrubbed":4,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:20.402496+0000","scrub_duration":95,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217,"num_write_kb":12398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"76'412","reported_seq":547,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:10.220950+0000","last_change":"2024-04-25T22:07:10.221007+0000","last_active":"2024-04-25T22:07:10.220950+0000","last_peered":"2024-04-25T22:07:10.220950+0000","last_clean":"2024-04-25T22:07:10.220950+0000","last_became_active":"2024-04-25T22:03:33.862435+0000","last_became_peered":"2024-04-25T22:03:33.862435+0000","last_unstale":"2024-04-25T22:07:10.220950+0000","last_undegraded":"2024-04-25T22:07:10.220950+0000","last_fullsized":"2024-04-25T22:07:10.220950+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'412","last_scrub_stamp":"2024-04-25T22:07:10.220764+0000","last_deep_scrub":"76'412","last_deep_scrub_stamp":"2024-04-25T22:07:10.220764+0000","last_clean_scrub_stamp":"2024-04-25T22:07:10.220764+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:04:29.677106+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":1478,"num_write":377,"num_write_kb":34422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"99'128","reported_seq":315,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:06.194879+0000","last_change":"2024-04-25T22:07:06.194879+0000","last_active":"2024-04-25T22:07:06.194879+0000","last_peered":"2024-04-25T22:07:06.194879+0000","last_clean":"2024-04-25T22:07:06.194879+0000","last_became_active":"2024-04-25T22:01:13.617993+0000","last_became_peered":"2024-04-25T22:01:13.617993+0000","last_unstale":"2024-04-25T22:07:06.194879+0000","last_undegraded":"2024-04-25T22:07:06.194879+0000","last_fullsized":"2024-04-25T22:07:06.194879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'128","last_scrub_stamp":"2024-04-25T22:07:06.194581+0000","last_deep_scrub":"99'128","last_deep_scrub_stamp":"2024-04-25T22:07:06.194581+0000","last_clean_scrub_stamp":"2024-04-25T22:07:06.194581+0000","objects_scrubbed":1,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:22:09.309671+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"76'444","reported_seq":655,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:07:03.392910+0000","last_change":"2024-04-25T22:07:03.392968+0000","last_active":"2024-04-25T22:07:03.392910+0000","last_peered":"2024-04-25T22:07:03.392910+0000","last_clean":"2024-04-25T22:07:03.392910+0000","last_became_active":"2024-04-25T22:06:23.097535+0000","last_became_peered":"2024-04-25T22:06:23.097535+0000","last_unstale":"2024-04-25T22:07:03.392910+0000","last_undegraded":"2024-04-25T22:07:03.392910+0000","last_fullsized":"2024-04-25T22:07:03.392910+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'444","last_scrub_stamp":"2024-04-25T22:07:03.392719+0000","last_deep_scrub":"76'444","last_deep_scrub_stamp":"2024-04-25T22:07:03.392719+0000","last_clean_scrub_stamp":"2024-04-25T22:07:03.392719+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:30.391172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":31576,"num_write":414,"num_write_kb":70915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"99'49","reported_seq":243,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T22:06:49.391711+0000","last_change":"2024-04-25T22:06:49.391711+0000","last_active":"2024-04-25T22:06:49.391711+0000","last_peered":"2024-04-25T22:06:49.391711+0000","last_clean":"2024-04-25T22:06:49.391711+0000","last_became_active":"2024-04-25T22:06:22.801910+0000","last_became_peered":"2024-04-25T22:06:22.801910+0000","last_unstale":"2024-04-25T22:06:49.391711+0000","last_undegraded":"2024-04-25T22:06:49.391711+0000","last_fullsized":"2024-04-25T22:06:49.391711+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"99'49","last_scrub_stamp":"2024-04-25T22:06:49.391444+0000","last_deep_scrub":"99'49","last_deep_scrub_stamp":"2024-04-25T22:06:49.391444+0000","last_clean_scrub_stamp":"2024-04-25T22:06:49.391444+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:01.347946+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2665,"num_read_kb":1338898,"num_write":24540,"num_write_kb":4276910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26558,"ondisk_log_size":26558,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127376126,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":63,"num_read_kb":1471,"num_write":4662,"num_write_kb":127830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":71499776,"data_stored":254752252,"data_compressed":21836190,"data_compressed_allocated":35307520,"data_compressed_original":218619904,"omap_allocated":136586,"internal_metadata":0},"log_size":6499,"ondisk_log_size":6499,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":16414,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738455,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103888,"kb_used_data":24200,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":94267952,"statfs":{"total":96636764160,"available":96530382848,"internally_reserved":0,"allocated":24780800,"data_stored":84964150,"data_compressed":7036839,"data_compressed_allocated":11431936,"data_compressed_original":72118272,"omap_allocated":1595,"internal_metadata":81590725},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738454,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99424,"kb_used_data":23896,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94272416,"statfs":{"total":96636764160,"available":96534953984,"internally_reserved":0,"allocated":24469504,"data_stored":81562098,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":90,"seq":386547056658,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58104,"kb_used_data":24432,"kb_used_omap":134,"kb_used_meta":33529,"kb_avail":94313736,"statfs":{"total":96636764160,"available":96577265664,"internally_reserved":0,"allocated":25018368,"data_stored":90623267,"data_compressed":7819212,"data_compressed_allocated":12599296,"data_compressed_original":78716928,"omap_allocated":138181,"internal_metadata":34333755},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":8207,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24076288,"data_stored":89627390,"data_compressed":7811005,"data_compressed_allocated":12562432,"data_compressed_original":78143488,"omap_allocated":136586,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23584768,"data_stored":81156589,"data_compressed":6996553,"data_compressed_allocated":11350016,"data_compressed_original":68931584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23838720,"data_stored":83968273,"data_compressed":7028632,"data_compressed_allocated":11395072,"data_compressed_original":71544832,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:07:46.895 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T22:07:47.264 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T22:07:47.264 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:07:47.599 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:07:47.599 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:01:13.963044+0000","modified":"2024-04-25T22:01:15.981330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4205},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4205":{"gid":4205,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6803/3701507543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3701507543},{"type":"v1","addr":"172.21.15.44:6803","nonce":3701507543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4205,"qdb_cluster":[4205]},"id":1}]} 2024-04-25T22:07:47.599 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 5 2024-04-25T22:07:47.618 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:07:47.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:07:47.940 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:01:13.963044+0000","modified":"2024-04-25T22:01:15.981330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4205},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4205":{"gid":4205,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6803/3701507543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3701507543},{"type":"v1","addr":"172.21.15.44:6803","nonce":3701507543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4205,"qdb_cluster":[4205]},"id":1}]} 2024-04-25T22:07:47.941 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 5 2024-04-25T22:07:47.958 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:07:48.245 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-04-25T22:07:48.245 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":99,"fsid":"1ced109c-704f-44b1-9811-a2da74898889","created":"2024-04-25T22:00:52.024472+0000","modified":"2024-04-25T22:06:30.837237+0000","last_up_change":"2024-04-25T22:06:21.751537+0000","last_in_change":"2024-04-25T22:00:53.642701+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:01:03.632568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:01:07.995071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:01:12.514055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:01:12.963831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"098ec92c-0fd2-4231-8beb-09fccca634d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":81,"up_from":90,"up_thru":98,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2123863143},{"type":"v1","addr":"172.21.15.57:6801","nonce":2123863143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2123863143},{"type":"v1","addr":"172.21.15.57:6803","nonce":2123863143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2123863143},{"type":"v1","addr":"172.21.15.57:6807","nonce":2123863143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2123863143},{"type":"v1","addr":"172.21.15.57:6805","nonce":2123863143}]},"public_addr":"172.21.15.57:6801/2123863143","cluster_addr":"172.21.15.57:6803/2123863143","heartbeat_back_addr":"172.21.15.57:6807/2123863143","heartbeat_front_addr":"172.21.15.57:6805/2123863143","state":["exists","up"]},{"osd":1,"uuid":"a1c8dc01-fb59-43d3-8c4a-2e88ef3901ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6801","nonce":29975895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6803","nonce":29975895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6807","nonce":29975895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":29975895},{"type":"v1","addr":"172.21.15.79:6805","nonce":29975895}]},"public_addr":"172.21.15.79:6801/29975895","cluster_addr":"172.21.15.79:6803/29975895","heartbeat_back_addr":"172.21.15.79:6807/29975895","heartbeat_front_addr":"172.21.15.79:6805/29975895","state":["exists","up"]},{"osd":2,"uuid":"290ee5c1-81af-400c-b15a-f63c4794a3b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6801","nonce":3918111900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6803","nonce":3918111900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6807","nonce":3918111900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3918111900},{"type":"v1","addr":"172.21.15.81:6805","nonce":3918111900}]},"public_addr":"172.21.15.81:6801/3918111900","cluster_addr":"172.21.15.81:6803/3918111900","heartbeat_back_addr":"172.21.15.81:6807/3918111900","heartbeat_front_addr":"172.21.15.81:6805/3918111900","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:59.025944+0000","dead_epoch":81},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.986080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:00:58.971238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":1,"to":0}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":0}]},{"pgid":"4.36","mappings":[{"from":2,"to":0}]},{"pgid":"4.3b","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:07:48.265 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T22:07:48.605 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T22:07:48.627 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T22:07:48.645 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-04-25T22:07:49.628 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T22:07:50.618 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-04-25T22:07:50.642 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T22:07:51.626 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-04-25T22:07:51.649 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T22:07:51.649 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T22:07:51.649 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:07:51.661 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T22:07:51.661 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T22:07:51.661 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T22:07:51.661 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:07:51.745 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T22:07:51.745 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T22:07:51.745 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:07:51.820 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T22:07:51.821 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T22:07:51.821 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:07:51.904 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T22:07:51.904 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T22:07:51.905 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T22:07:51.905 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:07:51.936 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T22:07:51.936 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T22:07:51.936 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:07:52.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-04-25T22:07:52.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-04-25T22:07:52.007 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T22:07:52.008 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T22:07:52.008 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T22:07:52.008 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:07:52.062 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T22:07:52.062 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T22:07:52.062 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:07:52.124 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T22:07:52.124 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T22:07:52.124 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:07:52.184 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T22:07:52.184 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T22:07:52.184 DEBUG:teuthology.orchestra.run.smithi044:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | head -n 1 2024-04-25T22:07:52.245 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T22:07:52.246 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T22:07:52.419 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T22:07:52.419 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T22:07:52.574 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi081.front.sepia.ceph.com 2024-04-25T22:07:52.574 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T22:07:52.802 INFO:tasks.ceph:Archiving mon data... 2024-04-25T22:07:52.803 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030/data/mon.a.tgz 2024-04-25T22:07:52.803 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-04-25T22:07:52.809 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.O7iLjQjEr5 2024-04-25T22:07:52.809 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.O7iLjQjEr5 2024-04-25T22:07:52.950 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.O7iLjQjEr5 2024-04-25T22:07:53.013 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.O7iLjQjEr5 is 395KB 2024-04-25T22:07:53.074 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.O7iLjQjEr5 2024-04-25T22:07:53.080 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030/data/mon.b.tgz 2024-04-25T22:07:53.080 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-04-25T22:07:53.129 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.nkd60CG9x4 2024-04-25T22:07:53.130 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.nkd60CG9x4 2024-04-25T22:07:53.315 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.nkd60CG9x4 2024-04-25T22:07:53.381 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.nkd60CG9x4 is 552KB 2024-04-25T22:07:53.484 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.nkd60CG9x4 2024-04-25T22:07:53.490 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030/data/mon.c.tgz 2024-04-25T22:07:53.490 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-04-25T22:07:53.537 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.DdAQk8ke4o 2024-04-25T22:07:53.537 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.DdAQk8ke4o 2024-04-25T22:07:53.722 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.DdAQk8ke4o 2024-04-25T22:07:53.785 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.DdAQk8ke4o is 552KB 2024-04-25T22:07:53.851 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.DdAQk8ke4o 2024-04-25T22:07:53.857 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T22:07:53.857 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T22:07:53.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T22:07:53.908 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T22:07:53.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T22:07:53.965 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T22:07:53.984 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T22:07:53.990 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T22:07:53.996 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T22:07:53.996 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T22:07:53.997 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030/remote/smithi044/crash 2024-04-25T22:07:53.998 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T22:07:54.022 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030/remote/smithi057/crash 2024-04-25T22:07:54.023 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T22:07:54.051 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030/remote/smithi079/crash 2024-04-25T22:07:54.052 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T22:07:54.067 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030/remote/smithi081/crash 2024-04-25T22:07:54.068 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T22:07:54.082 INFO:tasks.ceph:Compressing logs... 2024-04-25T22:07:54.082 DEBUG:teuthology.orchestra.run.smithi044:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T22:07:54.085 DEBUG:teuthology.orchestra.run.smithi057:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T22:07:54.097 DEBUG:teuthology.orchestra.run.smithi079:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T22:07:54.115 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T22:07:54.123 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20789.log 2024-04-25T22:07:54.124 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23990.log 2024-04-25T22:07:54.125 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.20789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23009.log 2024-04-25T22:07:54.125 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20789.log.gz 2024-04-25T22:07:54.125 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23797.log 2024-04-25T22:07:54.125 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23990.log.gz 2024-04-25T22:07:54.130 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21841.log 2024-04-25T22:07:54.130 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23009.log.gz 2024-04-25T22:07:54.130 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21089.log 2024-04-25T22:07:54.130 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23797.log.gz 2024-04-25T22:07:54.130 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21841.log.gz 2024-04-25T22:07:54.130 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24984.log 2024-04-25T22:07:54.130 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21730.log 2024-04-25T22:07:54.131 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21089.log.gz 2024-04-25T22:07:54.131 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24984.log.gz 2024-04-25T22:07:54.131 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25144.log 2024-04-25T22:07:54.131 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21574.log 2024-04-25T22:07:54.131 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21730.log.gz 2024-04-25T22:07:54.131 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25144.log.gz 2024-04-25T22:07:54.131 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24372.log 2024-04-25T22:07:54.131 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23958.log 2024-04-25T22:07:54.131 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21574.log.gz 2024-04-25T22:07:54.131 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23424.log 2024-04-25T22:07:54.131 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24372.log.gz 2024-04-25T22:07:54.132 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24386.log 2024-04-25T22:07:54.132 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23958.log.gz 2024-04-25T22:07:54.132 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29319.log 2024-04-25T22:07:54.132 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23424.log.gz 2024-04-25T22:07:54.134 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T22:07:54.134 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.732.log 2024-04-25T22:07:54.134 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.732.log.gz 2024-04-25T22:07:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T22:07:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21683.log 2024-04-25T22:07:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21707.log 2024-04-25T22:07:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.21683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21683.log.gz 2024-04-25T22:07:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21659.log 2024-04-25T22:07:54.176 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.21707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21707.log.gz 2024-04-25T22:07:54.177 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.21659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21659.log.gz 2024-04-25T22:07:54.211 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T22:07:54.254 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24156.log 2024-04-25T22:07:54.255 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24386.log.gz 2024-04-25T22:07:54.255 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28436.log 2024-04-25T22:07:54.255 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29319.log.gz 2024-04-25T22:07:54.255 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28358.log 2024-04-25T22:07:54.255 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24156.log.gz 2024-04-25T22:07:54.255 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22172.log 2024-04-25T22:07:54.255 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28436.log.gz 2024-04-25T22:07:54.255 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.28358.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23066.log 2024-04-25T22:07:54.255 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28358.log.gz 2024-04-25T22:07:54.255 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22172.log.gz 2024-04-25T22:07:54.255 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28124.log 2024-04-25T22:07:54.255 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23066.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T22:07:54.255 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23066.log.gz 2024-04-25T22:07:54.255 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27988.log 2024-04-25T22:07:54.255 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28124.log.gz 2024-04-25T22:07:54.256 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26929.log 2024-04-25T22:07:54.256 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21219.log 2024-04-25T22:07:54.256 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27988.log.gz 2024-04-25T22:07:54.256 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24822.log 2024-04-25T22:07:54.256 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26929.log.gz 2024-04-25T22:07:54.256 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23849.log 2024-04-25T22:07:54.256 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21219.log.gz 2024-04-25T22:07:54.256 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23341.log 2024-04-25T22:07:54.256 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24822.log.gz 2024-04-25T22:07:54.256 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24182.log 2024-04-25T22:07:54.256 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23849.log.gz 2024-04-25T22:07:54.256 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25677.log 2024-04-25T22:07:54.256 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23341.log.gz 2024-04-25T22:07:54.256 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27469.log 2024-04-25T22:07:54.256 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24182.log.gz 2024-04-25T22:07:54.257 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26399.log 2024-04-25T22:07:54.257 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25677.log.gz 2024-04-25T22:07:54.257 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22705.log 2024-04-25T22:07:54.257 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27469.log.gz 2024-04-25T22:07:54.257 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29112.log 2024-04-25T22:07:54.257 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26399.log.gz 2024-04-25T22:07:54.257 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23398.log 2024-04-25T22:07:54.257 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22705.log.gz 2024-04-25T22:07:54.257 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21014.log 2024-04-25T22:07:54.257 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29112.log.gz 2024-04-25T22:07:54.257 INFO:teuthology.orchestra.run.smithi044.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T22:07:54.257 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23398.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.25099.log -- replaced with /var/log/ceph/ceph-client.admin.23398.log.gz 2024-04-25T22:07:54.257 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-25T22:07:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28466.log 2024-04-25T22:07:54.258 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21014.log.gz 2024-04-25T22:07:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28956.log 2024-04-25T22:07:54.258 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25099.log.gz 2024-04-25T22:07:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28254.log 2024-04-25T22:07:54.258 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28466.log.gz 2024-04-25T22:07:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28956.log.gz 2024-04-25T22:07:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25570.log 2024-04-25T22:07:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27845.log 2024-04-25T22:07:54.258 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28254.log.gz 2024-04-25T22:07:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21043.log 2024-04-25T22:07:54.258 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25570.log.gz 2024-04-25T22:07:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27845.log.gz 2024-04-25T22:07:54.258 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29190.log 2024-04-25T22:07:54.259 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22484.log 2024-04-25T22:07:54.259 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21043.log.gz 2024-04-25T22:07:54.259 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29190.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.29190.log.gz -- 2024-04-25T22:07:54.259 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.admin.23237.log 2024-04-25T22:07:54.259 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27792.log 2024-04-25T22:07:54.259 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22484.log.gz 2024-04-25T22:07:54.259 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24596.log 2024-04-25T22:07:54.259 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23237.log.gz 2024-04-25T22:07:54.259 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27792.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20371.log 2024-04-25T22:07:54.259 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27792.log.gz 2024-04-25T22:07:54.259 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23176.log 2024-04-25T22:07:54.259 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24596.log.gz 2024-04-25T22:07:54.259 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25653.log 2024-04-25T22:07:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.tmp-client.admin.20371.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20371.log.gz 2024-04-25T22:07:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23176.log.gzgzip 2024-04-25T22:07:54.260 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.21915.log 2024-04-25T22:07:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25522.log 2024-04-25T22:07:54.260 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25653.log.gz 2024-04-25T22:07:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28626.log 2024-04-25T22:07:54.260 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21915.log.gz 2024-04-25T22:07:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28800.log 2024-04-25T22:07:54.260 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25522.log.gz 2024-04-25T22:07:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27742.log 2024-04-25T22:07:54.260 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28626.log.gz 2024-04-25T22:07:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28039.log 2024-04-25T22:07:54.261 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28800.log.gz 2024-04-25T22:07:54.261 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23367.log 2024-04-25T22:07:54.261 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27742.log.gz 2024-04-25T22:07:54.261 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24268.log 2024-04-25T22:07:54.261 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28039.log.gz 2024-04-25T22:07:54.261 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22120.log 2024-04-25T22:07:54.261 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23367.log.gz 2024-04-25T22:07:54.261 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27632.log 2024-04-25T22:07:54.261 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24268.log.gz 2024-04-25T22:07:54.261 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22302.log 2024-04-25T22:07:54.261 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22120.log.gz 2024-04-25T22:07:54.261 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28625.log 2024-04-25T22:07:54.261 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27632.log.gz 2024-04-25T22:07:54.261 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24015.log 2024-04-25T22:07:54.262 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22302.log.gz 2024-04-25T22:07:54.262 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23479.log 2024-04-25T22:07:54.262 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28625.log.gz 2024-04-25T22:07:54.262 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26710.log 2024-04-25T22:07:54.262 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24015.log.gz 2024-04-25T22:07:54.262 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27076.log 2024-04-25T22:07:54.262 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23479.log.gz 2024-04-25T22:07:54.262 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22224.log 2024-04-25T22:07:54.262 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26710.log.gz 2024-04-25T22:07:54.262 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24348.log 2024-04-25T22:07:54.262 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27076.log.gz 2024-04-25T22:07:54.262 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22224.log.gz 2024-04-25T22:07:54.262 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23563.log 2024-04-25T22:07:54.263 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28878.log 2024-04-25T22:07:54.263 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24348.log.gz 2024-04-25T22:07:54.263 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22587.log 2024-04-25T22:07:54.263 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23563.log.gz 2024-04-25T22:07:54.263 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27247.log 2024-04-25T22:07:54.263 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28878.log.gz 2024-04-25T22:07:54.263 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21842.log 2024-04-25T22:07:54.263 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22587.log.gz 2024-04-25T22:07:54.263 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24627.log 2024-04-25T22:07:54.263 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27247.log.gz 2024-04-25T22:07:54.263 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21842.log.gz 2024-04-25T22:07:54.263 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28470.log 2024-04-25T22:07:54.263 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26797.log 2024-04-25T22:07:54.264 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24627.log.gz 2024-04-25T22:07:54.264 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29269.log 2024-04-25T22:07:54.264 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28470.log.gz 2024-04-25T22:07:54.264 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22561.log 2024-04-25T22:07:54.264 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26797.log.gz 2024-04-25T22:07:54.264 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28469.log 2024-04-25T22:07:54.264 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29269.log.gz 2024-04-25T22:07:54.264 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25270.log 2024-04-25T22:07:54.264 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22561.log.gz 2024-04-25T22:07:54.264 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28384.log 2024-04-25T22:07:54.264 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28469.log.gz 2024-04-25T22:07:54.264 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23294.log 2024-04-25T22:07:54.264 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25270.log.gz 2024-04-25T22:07:54.264 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21920.log 2024-04-25T22:07:54.265 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28384.log.gz 2024-04-25T22:07:54.265 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21764.log 2024-04-25T22:07:54.265 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23294.log.gz 2024-04-25T22:07:54.265 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21920.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T22:07:54.265 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21920.log.gz 2024-04-25T22:07:54.265 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25819.log 2024-04-25T22:07:54.265 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21764.log.gz 2024-04-25T22:07:54.265 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27019.log 2024-04-25T22:07:54.265 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22639.log 2024-04-25T22:07:54.265 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25819.log.gz 2024-04-25T22:07:54.265 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25979.log 2024-04-25T22:07:54.265 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27019.log.gz 2024-04-25T22:07:54.266 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29217.log 2024-04-25T22:07:54.266 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22639.log.gz 2024-04-25T22:07:54.266 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25979.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.25979.log.gz --verbose 2024-04-25T22:07:54.266 INFO:teuthology.orchestra.run.smithi044.stderr: -- /var/log/ceph/ceph-client.admin.29034.log 2024-04-25T22:07:54.266 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24798.log 2024-04-25T22:07:54.266 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29217.log.gz 2024-04-25T22:07:54.266 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29293.log 2024-04-25T22:07:54.266 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29034.log.gz 2024-04-25T22:07:54.266 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24798.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.27216.log 2024-04-25T22:07:54.266 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.24798.log.gz 2024-04-25T22:07:54.266 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26208.log 2024-04-25T22:07:54.266 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29293.log.gz 2024-04-25T22:07:54.266 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25766.log 2024-04-25T22:07:54.266 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27216.log.gz 2024-04-25T22:07:54.266 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26208.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.25487.log 2024-04-25T22:07:54.267 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26208.log.gz 2024-04-25T22:07:54.267 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22432.log 2024-04-25T22:07:54.267 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25766.log.gz 2024-04-25T22:07:54.267 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28306.log 2024-04-25T22:07:54.267 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25487.log.gz 2024-04-25T22:07:54.267 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22432.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.22432.log.gz -- 2024-04-25T22:07:54.267 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.admin.22380.log 2024-04-25T22:07:54.267 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24073.log 2024-04-25T22:07:54.267 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28306.log.gz 2024-04-25T22:07:54.267 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23709.log 2024-04-25T22:07:54.267 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22380.log.gz 2024-04-25T22:07:54.267 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26175.log 2024-04-25T22:07:54.267 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24073.log.gz 2024-04-25T22:07:54.267 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24213.log 2024-04-25T22:07:54.268 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23709.log.gz 2024-04-25T22:07:54.268 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23621.log 2024-04-25T22:07:54.268 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26175.log.gz 2024-04-25T22:07:54.268 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24213.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.24213.log.gz 2024-04-25T22:07:54.268 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22198.log 2024-04-25T22:07:54.268 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21916.log 2024-04-25T22:07:54.268 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23621.log.gz 2024-04-25T22:07:54.268 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26843.log 2024-04-25T22:07:54.268 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22198.log.gz 2024-04-25T22:07:54.268 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21652.log 2024-04-25T22:07:54.268 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21916.log.gz 2024-04-25T22:07:54.268 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24875.log 2024-04-25T22:07:54.268 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26843.log.gz 2024-04-25T22:07:54.269 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24509.log 2024-04-25T22:07:54.269 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21652.log.gz 2024-04-25T22:07:54.269 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23233.log 2024-04-25T22:07:54.269 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24875.log.gz 2024-04-25T22:07:54.269 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27304.log 2024-04-25T22:07:54.269 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24509.log.gz 2024-04-25T22:07:54.269 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23117.log 2024-04-25T22:07:54.269 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23233.log.gz 2024-04-25T22:07:54.269 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27849.log 2024-04-25T22:07:54.269 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27304.log.gz 2024-04-25T22:07:54.269 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22276.log 2024-04-25T22:07:54.269 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23117.log.gz 2024-04-25T22:07:54.269 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27159.log 2024-04-25T22:07:54.269 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27849.log.gz 2024-04-25T22:07:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24710.log 2024-04-25T22:07:54.270 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22276.log.gz 2024-04-25T22:07:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28904.log 2024-04-25T22:07:54.270 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27159.log.gz 2024-04-25T22:07:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21414.log 2024-04-25T22:07:54.270 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24710.log.gz 2024-04-25T22:07:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29138.log 2024-04-25T22:07:54.270 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28904.log.gz 2024-04-25T22:07:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20963.log 2024-04-25T22:07:54.270 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21414.log.gz 2024-04-25T22:07:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28774.log 2024-04-25T22:07:54.270 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29138.log.gz 2024-04-25T22:07:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.20963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21548.log 2024-04-25T22:07:54.270 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20963.log.gz 2024-04-25T22:07:54.271 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26293.log 2024-04-25T22:07:54.271 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28774.log.gz 2024-04-25T22:07:54.271 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26953.log 2024-04-25T22:07:54.271 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21548.log.gz 2024-04-25T22:07:54.271 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26293.log.gz 2024-04-25T22:07:54.271 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26424.log 2024-04-25T22:07:54.271 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20908.log 2024-04-25T22:07:54.271 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26953.log.gz 2024-04-25T22:07:54.271 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28852.log 2024-04-25T22:07:54.271 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26424.log.gz 2024-04-25T22:07:54.271 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.20908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22068.log 2024-04-25T22:07:54.271 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20908.log.gz 2024-04-25T22:07:54.271 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28852.log.gz 2024-04-25T22:07:54.271 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21997.log 2024-04-25T22:07:54.272 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27502.log 2024-04-25T22:07:54.272 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22068.log.gz 2024-04-25T22:07:54.272 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24937.log 2024-04-25T22:07:54.272 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21997.log.gz 2024-04-25T22:07:54.272 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27473.log 2024-04-25T22:07:54.272 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27502.log.gz 2024-04-25T22:07:54.272 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28165.log 2024-04-25T22:07:54.272 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24937.log.gz 2024-04-25T22:07:54.272 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21626.log 2024-04-25T22:07:54.272 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27473.log.gz 2024-04-25T22:07:54.272 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21840.log 2024-04-25T22:07:54.272 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28165.log.gz 2024-04-25T22:07:54.272 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21245.log 2024-04-25T22:07:54.272 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21626.log.gz 2024-04-25T22:07:54.273 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27799.log 2024-04-25T22:07:54.273 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21840.log.gz 2024-04-25T22:07:54.273 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24535.log 2024-04-25T22:07:54.273 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21245.log.gz 2024-04-25T22:07:54.273 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29468.log 2024-04-25T22:07:54.273 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27799.log.gz 2024-04-25T22:07:54.273 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29371.log 2024-04-25T22:07:54.273 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24535.log.gz 2024-04-25T22:07:54.273 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22960.log 2024-04-25T22:07:54.273 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29468.log.gz 2024-04-25T22:07:54.273 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29371.log.gz 2024-04-25T22:07:54.273 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25213.log 2024-04-25T22:07:54.273 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20766.log 2024-04-25T22:07:54.273 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22960.log.gz 2024-04-25T22:07:54.273 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25213.log.gz 2024-04-25T22:07:54.274 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22458.log 2024-04-25T22:07:54.274 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.20766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25596.log 2024-04-25T22:07:54.274 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20766.log.gz 2024-04-25T22:07:54.274 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23652.log 2024-04-25T22:07:54.274 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22458.log.gz 2024-04-25T22:07:54.274 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23538.log 2024-04-25T22:07:54.274 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25596.log.gz 2024-04-25T22:07:54.274 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23595.log 2024-04-25T22:07:54.274 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23652.log.gz 2024-04-25T22:07:54.274 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28410.log 2024-04-25T22:07:54.274 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23538.log.gz 2024-04-25T22:07:54.274 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29397.log 2024-04-25T22:07:54.274 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23595.log.gz 2024-04-25T22:07:54.275 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25793.log 2024-04-25T22:07:54.275 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28410.log.gz 2024-04-25T22:07:54.275 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27768.log 2024-04-25T22:07:54.275 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29397.log.gz 2024-04-25T22:07:54.275 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28191.log 2024-04-25T22:07:54.275 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25793.log.gz 2024-04-25T22:07:54.275 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.27768.log: -- /var/log/ceph/ceph-client.admin.24652.log 2024-04-25T22:07:54.275 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27768.log.gz 2024-04-25T22:07:54.275 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22747.log 2024-04-25T22:07:54.275 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28191.log.gz 2024-04-25T22:07:54.275 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24907.log 2024-04-25T22:07:54.275 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24652.log.gz 2024-04-25T22:07:54.275 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29494.log 2024-04-25T22:07:54.275 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22747.log.gz 2024-04-25T22:07:54.275 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27683.log 2024-04-25T22:07:54.276 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24907.log.gz 2024-04-25T22:07:54.276 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29243.log 2024-04-25T22:07:54.276 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29494.log.gz 2024-04-25T22:07:54.276 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25042.log 2024-04-25T22:07:54.276 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27683.log.gz 2024-04-25T22:07:54.276 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29243.log.gz 2024-04-25T22:07:54.276 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21470.log 2024-04-25T22:07:54.276 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26036.log 2024-04-25T22:07:54.276 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25042.log.gz 2024-04-25T22:07:54.276 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26623.log 2024-04-25T22:07:54.276 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21470.log.gz 2024-04-25T22:07:54.276 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26036.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.26036.log.gz 2024-04-25T22:07:54.276 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.admin.23875.log 2024-04-25T22:07:54.277 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25843.log 2024-04-25T22:07:54.277 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26623.log.gz 2024-04-25T22:07:54.277 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23455.log 2024-04-25T22:07:54.277 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23875.log.gz 2024-04-25T22:07:54.277 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27986.log 2024-04-25T22:07:54.277 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25843.log.gz 2024-04-25T22:07:54.277 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24850.log 2024-04-25T22:07:54.277 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23455.log.gz 2024-04-25T22:07:54.277 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24269.log 2024-04-25T22:07:54.277 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27986.log.gz 2024-04-25T22:07:54.277 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28826.log 2024-04-25T22:07:54.277 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24850.log.gz 2024-04-25T22:07:54.277 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21704.log 2024-04-25T22:07:54.278 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24269.log.gz 2024-04-25T22:07:54.278 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28093.log 2024-04-25T22:07:54.278 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28826.log.gz 2024-04-25T22:07:54.278 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21704.log.gz 2024-04-25T22:07:54.278 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29423.log 2024-04-25T22:07:54.278 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T22:07:54.278 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28093.log.gz 2024-04-25T22:07:54.278 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29423.log.gz 2024-04-25T22:07:54.278 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27659.log 2024-04-25T22:07:54.278 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27127.log 2024-04-25T22:07:54.278 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26986.log 2024-04-25T22:07:54.278 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27659.log.gz 2024-04-25T22:07:54.278 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25523.log 2024-04-25T22:07:54.278 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27127.log.gz 2024-04-25T22:07:54.278 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26986.log.gz 2024-04-25T22:07:54.279 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T22:07:54.279 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21141.log 2024-04-25T22:07:54.279 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25523.log.gz 2024-04-25T22:07:54.279 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27361.log 2024-04-25T22:07:54.279 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21141.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.21141.log.gz 2024-04-25T22:07:54.279 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.admin.25710.log 2024-04-25T22:07:54.279 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26151.log 2024-04-25T22:07:54.279 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27361.log.gz 2024-04-25T22:07:54.279 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26550.log 2024-04-25T22:07:54.279 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25710.log.gz 2024-04-25T22:07:54.279 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29164.log 2024-04-25T22:07:54.279 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26151.log.gz 2024-04-25T22:07:54.279 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26550.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.26550.log.gz 2024-04-25T22:07:54.279 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.admin.24238.log 2024-04-25T22:07:54.280 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21600.log 2024-04-25T22:07:54.280 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29164.log.gz 2024-04-25T22:07:54.280 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25239.log 2024-04-25T22:07:54.280 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24238.log.gz 2024-04-25T22:07:54.280 INFO:teuthology.orchestra.run.smithi044.stderr: 94.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T22:07:54.280 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21496.log 2024-04-25T22:07:54.280 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21600.log.gz 2024-04-25T22:07:54.280 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21388.log 2024-04-25T22:07:54.280 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25239.log.gz 2024-04-25T22:07:54.280 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24047.log 2024-04-25T22:07:54.280 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21496.log.gz 2024-04-25T22:07:54.280 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21388.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.21388.log.gz 2024-04-25T22:07:54.280 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.21990.log 2024-04-25T22:07:54.280 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24047.log.gz 2024-04-25T22:07:54.280 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25953.log 2024-04-25T22:07:54.281 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21167.log 2024-04-25T22:07:54.281 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21990.log.gz 2024-04-25T22:07:54.281 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26068.log 2024-04-25T22:07:54.281 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25953.log.gz 2024-04-25T22:07:54.281 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21167.log.gz 2024-04-25T22:07:54.281 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26627.log 2024-04-25T22:07:54.281 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21327.log 2024-04-25T22:07:54.281 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26068.log.gz 2024-04-25T22:07:54.281 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26627.log.gz 2024-04-25T22:07:54.281 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28748.log 2024-04-25T22:07:54.281 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24483.log 2024-04-25T22:07:54.281 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21327.log.gz 2024-04-25T22:07:54.281 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28748.log.gz 2024-04-25T22:07:54.281 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26477.log 2024-04-25T22:07:54.282 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21522.log 2024-04-25T22:07:54.282 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24483.log.gz 2024-04-25T22:07:54.282 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26477.log.gz 2024-04-25T22:07:54.282 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23201.log 2024-04-25T22:07:54.282 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21271.log 2024-04-25T22:07:54.282 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21522.log.gz 2024-04-25T22:07:54.282 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23201.log.gz 2024-04-25T22:07:54.282 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20988.log 2024-04-25T22:07:54.282 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21271.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T22:07:54.282 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21271.log.gz 2024-04-25T22:07:54.282 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.20988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26716.log 2024-04-25T22:07:54.282 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20988.log.gz 2024-04-25T22:07:54.282 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23144.log 2024-04-25T22:07:54.283 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26716.log.gz 2024-04-25T22:07:54.283 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25621.log 2024-04-25T22:07:54.283 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28223.log 2024-04-25T22:07:54.283 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23144.log.gz 2024-04-25T22:07:54.283 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26212.log 2024-04-25T22:07:54.283 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25621.log.gz 2024-04-25T22:07:54.283 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28223.log.gz 2024-04-25T22:07:54.283 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23879.log 2024-04-25T22:07:54.283 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26212.log.gz 2024-04-25T22:07:54.283 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26868.log 2024-04-25T22:07:54.283 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21193.log 2024-04-25T22:07:54.283 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23879.log.gz 2024-04-25T22:07:54.283 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25927.log 2024-04-25T22:07:54.283 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26868.log.gz 2024-04-25T22:07:54.284 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25008.log 2024-04-25T22:07:54.284 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21193.log.gz 2024-04-25T22:07:54.284 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27553.log 2024-04-25T22:07:54.284 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25927.log.gz 2024-04-25T22:07:54.284 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25182.log 2024-04-25T22:07:54.284 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25008.log.gz 2024-04-25T22:07:54.284 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26372.log 2024-04-25T22:07:54.284 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27553.log.gz 2024-04-25T22:07:54.284 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26260.log 2024-04-25T22:07:54.284 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25182.log.gz 2024-04-25T22:07:54.284 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26124.log 2024-04-25T22:07:54.284 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26372.log.gz 2024-04-25T22:07:54.284 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.26260.log: /var/log/ceph/ceph-client.admin.24714.log 2024-04-25T22:07:54.284 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26260.log.gz 2024-04-25T22:07:54.285 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21299.log 2024-04-25T22:07:54.285 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26124.log.gz 2024-04-25T22:07:54.285 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25714.log 2024-04-25T22:07:54.285 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24714.log.gz 2024-04-25T22:07:54.285 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21299.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T22:07:54.285 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21299.log.gz 2024-04-25T22:07:54.285 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24933.log 2024-04-25T22:07:54.285 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25714.log.gz 2024-04-25T22:07:54.285 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24678.log 2024-04-25T22:07:54.285 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25880.log 2024-04-25T22:07:54.285 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24933.log.gz 2024-04-25T22:07:54.285 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23505.log 2024-04-25T22:07:54.285 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24678.log.gz 2024-04-25T22:07:54.286 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25880.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25880.log.gz 2024-04-25T22:07:54.286 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T22:07:54.286 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23505.log.gz 2024-04-25T22:07:54.286 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23766.log 2024-04-25T22:07:54.286 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27445.log 2024-04-25T22:07:54.286 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23766.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23766.log.gz 2024-04-25T22:07:54.286 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.20573.log 2024-04-25T22:07:54.286 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27445.log.gz 2024-04-25T22:07:54.286 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29086.log 2024-04-25T22:07:54.286 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.20573.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24566.log 2024-04-25T22:07:54.286 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.20573.log.gz 2024-04-25T22:07:54.286 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25274.log 2024-04-25T22:07:54.286 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29086.log.gz 2024-04-25T22:07:54.286 INFO:teuthology.orchestra.run.smithi044.stderr: 95.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T22:07:54.287 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.24566.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.28280.log 2024-04-25T22:07:54.287 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24566.log.gz 2024-04-25T22:07:54.287 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25274.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.25274.log.gz --verbose 2024-04-25T22:07:54.287 INFO:teuthology.orchestra.run.smithi044.stderr: -- /var/log/ceph/ceph-client.admin.28930.log 2024-04-25T22:07:54.287 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24322.log 2024-04-25T22:07:54.287 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28280.log.gz 2024-04-25T22:07:54.287 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27958.log 2024-04-25T22:07:54.287 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28930.log.gz 2024-04-25T22:07:54.287 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24125.log 2024-04-25T22:07:54.287 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24322.log.gz 2024-04-25T22:07:54.287 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27689.log 2024-04-25T22:07:54.287 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27958.log.gz 2024-04-25T22:07:54.287 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28038.log 2024-04-25T22:07:54.287 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24125.log.gz 2024-04-25T22:07:54.288 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28332.log 2024-04-25T22:07:54.288 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27689.log.gz 2024-04-25T22:07:54.288 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27163.log 2024-04-25T22:07:54.288 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28038.log.gz 2024-04-25T22:07:54.288 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21998.log 2024-04-25T22:07:54.288 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28332.log.gz 2024-04-25T22:07:54.288 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26903.log 2024-04-25T22:07:54.288 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27163.log.gz 2024-04-25T22:07:54.288 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23040.log 2024-04-25T22:07:54.288 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21998.log.gz 2024-04-25T22:07:54.288 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26473.log 2024-04-25T22:07:54.288 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26903.log.gz 2024-04-25T22:07:54.288 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25431.log 2024-04-25T22:07:54.288 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23040.log.gz 2024-04-25T22:07:54.289 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27387.log 2024-04-25T22:07:54.289 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26473.log.gz 2024-04-25T22:07:54.289 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28547.log 2024-04-25T22:07:54.289 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25431.log.gz 2024-04-25T22:07:54.289 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21444.log 2024-04-25T22:07:54.289 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27387.log.gz 2024-04-25T22:07:54.289 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28618.log 2024-04-25T22:07:54.289 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28547.log.gz 2024-04-25T22:07:54.289 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21444.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.21444.log.gz --verbose 2024-04-25T22:07:54.289 INFO:teuthology.orchestra.run.smithi044.stderr: -- /var/log/ceph/ceph-client.admin.23677.log 2024-04-25T22:07:54.289 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22669.log 2024-04-25T22:07:54.289 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28618.log.gz 2024-04-25T22:07:54.289 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27925.log 2024-04-25T22:07:54.290 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23677.log.gz 2024-04-25T22:07:54.290 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22669.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.22669.log.gz 2024-04-25T22:07:54.290 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.admin.29008.log 2024-04-25T22:07:54.290 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26292.log 2024-04-25T22:07:54.290 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27925.log.gz 2024-04-25T22:07:54.290 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22613.log 2024-04-25T22:07:54.290 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29008.log.gz 2024-04-25T22:07:54.290 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22250.log 2024-04-25T22:07:54.290 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26292.log.gz 2024-04-25T22:07:54.290 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23822.log 2024-04-25T22:07:54.290 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22613.log.gz 2024-04-25T22:07:54.290 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22250.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T22:07:54.290 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22250.log.gz 2024-04-25T22:07:54.291 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22929.log 2024-04-25T22:07:54.291 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23822.log.gz 2024-04-25T22:07:54.291 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-mon.b.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23733.log 2024-04-25T22:07:54.291 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27579.log 2024-04-25T22:07:54.291 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22929.log.gz 2024-04-25T22:07:54.291 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23733.log.gz 2024-04-25T22:07:54.291 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26686.log 2024-04-25T22:07:54.291 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27606.log 2024-04-25T22:07:54.291 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27579.log.gz 2024-04-25T22:07:54.291 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27901.log 2024-04-25T22:07:54.291 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26686.log.gz 2024-04-25T22:07:54.291 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27606.log.gz 2024-04-25T22:07:54.291 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26011.log 2024-04-25T22:07:54.291 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28722.log 2024-04-25T22:07:54.292 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27901.log.gz 2024-04-25T22:07:54.292 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23070.log 2024-04-25T22:07:54.292 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26011.log.gz 2024-04-25T22:07:54.292 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28722.log.gz 2024-04-25T22:07:54.292 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25066.log 2024-04-25T22:07:54.292 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22704.log 2024-04-25T22:07:54.292 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23070.log.gz 2024-04-25T22:07:54.292 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22354.log 2024-04-25T22:07:54.292 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25066.log.gz 2024-04-25T22:07:54.292 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24430.log 2024-04-25T22:07:54.292 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22704.log.gz/var/log/ceph/ceph-client.admin.22354.log: 2024-04-25T22:07:54.292 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.22354.log.gz 2024-04-25T22:07:54.292 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.admin.21115.log 2024-04-25T22:07:54.292 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24430.log.gz 2024-04-25T22:07:54.293 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22146.log 2024-04-25T22:07:54.293 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21762.log 2024-04-25T22:07:54.293 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21115.log.gz 2024-04-25T22:07:54.293 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28696.log 2024-04-25T22:07:54.293 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22146.log.gz 2024-04-25T22:07:54.293 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24099.log 2024-04-25T22:07:54.293 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21762.log: 0.0% 92.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T22:07:54.293 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.21762.log.gz/var/log/ceph/ceph-client.admin.28696.log: 2024-04-25T22:07:54.293 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22328.log 2024-04-25T22:07:54.293 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28696.log.gz 2024-04-25T22:07:54.293 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21362.log 2024-04-25T22:07:54.293 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24099.log.gz 2024-04-25T22:07:54.293 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25130.log 2024-04-25T22:07:54.293 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22328.log.gz 2024-04-25T22:07:54.293 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25877.log 2024-04-25T22:07:54.294 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21362.log.gz 2024-04-25T22:07:54.294 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21678.log 2024-04-25T22:07:54.294 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25130.log.gz 2024-04-25T22:07:54.294 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27273.log 2024-04-25T22:07:54.294 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25877.log.gz 2024-04-25T22:07:54.294 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27045.log 2024-04-25T22:07:54.294 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21678.log.gz 2024-04-25T22:07:54.294 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24456.log 2024-04-25T22:07:54.294 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27273.log.gz 2024-04-25T22:07:54.294 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27329.log 2024-04-25T22:07:54.294 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27045.log.gz 2024-04-25T22:07:54.294 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26072.log 2024-04-25T22:07:54.294 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24456.log.gz 2024-04-25T22:07:54.294 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24767.log 2024-04-25T22:07:54.295 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27329.log.gz 2024-04-25T22:07:54.295 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28540.log 2024-04-25T22:07:54.295 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26072.log.gz 2024-04-25T22:07:54.295 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.24767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27102.log 2024-04-25T22:07:54.295 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24767.log.gz 2024-04-25T22:07:54.295 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28548.log 2024-04-25T22:07:54.295 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28540.log.gz 2024-04-25T22:07:54.295 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28982.log 2024-04-25T22:07:54.295 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27102.log.gz 2024-04-25T22:07:54.295 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25399.log 2024-04-25T22:07:54.295 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28548.log.gz 2024-04-25T22:07:54.295 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25320.log 2024-04-25T22:07:54.295 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28982.log.gz 2024-04-25T22:07:54.295 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22094.log 2024-04-25T22:07:54.295 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25399.log.gz 2024-04-25T22:07:54.296 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29345.log 2024-04-25T22:07:54.296 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.25320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25320.log.gz 2024-04-25T22:07:54.296 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22510.log 2024-04-25T22:07:54.296 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22094.log.gz 2024-04-25T22:07:54.296 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21763.log 2024-04-25T22:07:54.296 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29345.log.gz 2024-04-25T22:07:54.296 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23293.log 2024-04-25T22:07:54.296 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22510.log: 49.1% -- replaced with /var/log/ceph/ceph-client.admin.22510.log.gz 2024-04-25T22:07:54.296 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.21763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29060.log 2024-04-25T22:07:54.296 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21763.log.gz 2024-04-25T22:07:54.296 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.23293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23932.log 2024-04-25T22:07:54.296 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23293.log.gz 2024-04-25T22:07:54.296 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26587.log 2024-04-25T22:07:54.296 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29060.log.gz 2024-04-25T22:07:54.297 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.23932.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.27413.log 2024-04-25T22:07:54.297 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23932.log.gz 2024-04-25T22:07:54.297 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.26587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.22891.log 2024-04-25T22:07:54.297 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26587.log.gz 2024-04-25T22:07:54.297 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.27413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22406.log 2024-04-25T22:07:54.297 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27413.log.gz 2024-04-25T22:07:54.297 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.22891.log: 33.7% -- replaced with /var/log/ceph/ceph-client.0.22891.log.gz 2024-04-25T22:07:54.297 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.22406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22406.log.gz 2024-04-25T22:07:54.298 INFO:teuthology.orchestra.run.smithi044.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T22:07:54.388 INFO:teuthology.orchestra.run.smithi044.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T22:07:54.415 INFO:teuthology.orchestra.run.smithi044.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T22:07:54.487 INFO:teuthology.orchestra.run.smithi044.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T22:07:54.489 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-04-25T22:07:54.489 INFO:teuthology.orchestra.run.smithi044.stderr:real 0m0.401s 2024-04-25T22:07:54.489 INFO:teuthology.orchestra.run.smithi044.stderr:user 0m1.022s 2024-04-25T22:07:54.489 INFO:teuthology.orchestra.run.smithi044.stderr:sys 0m0.124s 2024-04-25T22:07:56.879 INFO:teuthology.orchestra.run.smithi081.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T22:07:56.881 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-04-25T22:07:56.881 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m2.745s 2024-04-25T22:07:56.881 INFO:teuthology.orchestra.run.smithi081.stderr:user 0m2.633s 2024-04-25T22:07:56.881 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m0.101s 2024-04-25T22:07:57.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-04-25T22:07:57.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-04-25T22:07:58.356 INFO:teuthology.orchestra.run.smithi057.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T22:07:58.358 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-25T22:07:58.358 INFO:teuthology.orchestra.run.smithi057.stderr:real 0m4.259s 2024-04-25T22:07:58.358 INFO:teuthology.orchestra.run.smithi057.stderr:user 0m3.956s 2024-04-25T22:07:58.358 INFO:teuthology.orchestra.run.smithi057.stderr:sys 0m0.204s 2024-04-25T22:07:58.545 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.1.log: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T22:07:58.547 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-04-25T22:07:58.547 INFO:teuthology.orchestra.run.smithi079.stderr:real 0m4.429s 2024-04-25T22:07:58.547 INFO:teuthology.orchestra.run.smithi079.stderr:user 0m4.198s 2024-04-25T22:07:58.547 INFO:teuthology.orchestra.run.smithi079.stderr:sys 0m0.159s 2024-04-25T22:07:58.547 INFO:tasks.ceph:Archiving logs... 2024-04-25T22:07:58.547 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030/remote/smithi044/log 2024-04-25T22:07:58.548 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T22:07:58.918 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030/remote/smithi057/log 2024-04-25T22:07:58.919 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T22:07:59.402 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030/remote/smithi079/log 2024-04-25T22:07:59.403 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T22:07:59.969 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030/remote/smithi081/log 2024-04-25T22:07:59.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T22:08:00.339 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T22:08:00.348 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T22:08:00.348 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T22:08:00.351 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T22:08:00.353 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T22:08:00.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T22:08:00.471 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T22:08:00.482 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T22:08:00.482 DEBUG:teuthology.orchestra.run.smithi044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:08:00.484 DEBUG:teuthology.orchestra.run.smithi057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:08:00.487 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:08:00.489 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:08:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T22:08:00.495 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================== 2024-04-25T22:08:00.495 INFO:teuthology.orchestra.run.smithi044.stdout:*hv01.front.sepi 67.205.162.81 3 u 11 64 377 0.064 -1.095 0.847 2024-04-25T22:08:00.495 INFO:teuthology.orchestra.run.smithi044.stdout:+hv02.front.sepi 63.231.80.2 3 u 5 64 377 0.078 +0.733 0.863 2024-04-25T22:08:00.495 INFO:teuthology.orchestra.run.smithi044.stdout:+hv03.front.sepi 74.6.168.72 3 u 10 64 377 0.086 -0.539 0.803 2024-04-25T22:08:00.495 INFO:teuthology.orchestra.run.smithi044.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:08:00.501 INFO:teuthology.orchestra.run.smithi079.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T22:08:00.501 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================== 2024-04-25T22:08:00.501 INFO:teuthology.orchestra.run.smithi079.stdout:+hv01.front.sepi 67.205.162.81 3 u 6 64 377 0.085 -2.021 0.461 2024-04-25T22:08:00.501 INFO:teuthology.orchestra.run.smithi079.stdout:+hv02.front.sepi 63.231.80.2 3 u 4 64 377 0.069 -0.105 0.505 2024-04-25T22:08:00.501 INFO:teuthology.orchestra.run.smithi079.stdout:*hv03.front.sepi 74.6.168.72 3 u 6 64 377 0.069 -2.163 0.792 2024-04-25T22:08:00.502 INFO:teuthology.orchestra.run.smithi079.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-25T22:08:00.502 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T22:08:00.502 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2024-04-25T22:08:00.502 INFO:teuthology.orchestra.run.smithi081.stdout:*hv01.front.sepi 67.205.162.81 3 u 10 64 377 0.065 -1.474 1.302 2024-04-25T22:08:00.502 INFO:teuthology.orchestra.run.smithi081.stdout:+hv02.front.sepi 63.231.80.2 3 u - 64 377 0.089 -1.654 1.818 2024-04-25T22:08:00.502 INFO:teuthology.orchestra.run.smithi081.stdout:+hv03.front.sepi 74.6.168.72 3 u 2 64 377 0.083 -2.869 1.816 2024-04-25T22:08:00.502 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-25T22:08:00.508 INFO:teuthology.orchestra.run.smithi057.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T22:08:00.508 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================== 2024-04-25T22:08:00.508 INFO:teuthology.orchestra.run.smithi057.stdout: hv01.front.sepi 67.205.162.81 3 u 47 64 3 0.111 -299.40 0.446 2024-04-25T22:08:00.508 INFO:teuthology.orchestra.run.smithi057.stdout: hv02.front.sepi 63.231.80.2 3 u 43 64 3 0.074 -297.61 0.472 2024-04-25T22:08:00.509 INFO:teuthology.orchestra.run.smithi057.stdout: hv03.front.sepi 74.6.168.72 3 u 46 64 3 0.119 -298.79 0.429 2024-04-25T22:08:00.509 INFO:teuthology.orchestra.run.smithi057.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:08:00.509 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T22:08:00.519 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T22:08:00.520 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T22:08:00.529 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T22:08:00.542 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T22:08:00.553 INFO:teuthology.task.internal:Duration was 1043.735362 seconds 2024-04-25T22:08:00.553 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T22:08:00.562 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T22:08:00.563 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T22:08:00.565 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T22:08:00.568 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T22:08:00.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T22:08:00.608 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T22:08:00.608 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi044.front.sepia.ceph.com 2024-04-25T22:08:00.608 DEBUG:teuthology.orchestra.run.smithi044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T22:08:00.654 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T22:08:00.654 DEBUG:teuthology.orchestra.run.smithi057:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T22:08:00.665 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2024-04-25T22:08:00.665 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T22:08:00.676 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-04-25T22:08:00.676 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T22:08:00.686 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T22:08:00.686 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T22:08:00.698 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T22:08:00.709 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T22:08:00.719 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T22:08:00.781 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T22:08:00.782 DEBUG:teuthology.orchestra.run.smithi044:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T22:08:00.784 DEBUG:teuthology.orchestra.run.smithi057:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T22:08:00.786 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T22:08:00.788 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T22:08:00.854 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T22:08:00.865 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T22:08:00.865 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T22:08:00.878 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T22:08:00.892 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T22:08:00.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T22:08:00.916 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T22:08:00.927 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:08:00.929 DEBUG:teuthology.orchestra.run.smithi057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:08:00.937 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:08:00.940 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = core 2024-04-25T22:08:00.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:08:00.955 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2024-04-25T22:08:00.961 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = core 2024-04-25T22:08:00.973 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-04-25T22:08:01.045 DEBUG:teuthology.orchestra.run.smithi044:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:08:01.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:08:01.050 DEBUG:teuthology.orchestra.run.smithi057:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:08:01.055 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:08:01.056 DEBUG:teuthology.orchestra.run.smithi079:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:08:01.093 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:08:01.094 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:08:01.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:08:01.099 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T22:08:01.110 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T22:08:01.111 DEBUG:teuthology.misc:Transferring archived files from smithi044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030/remote/smithi044 2024-04-25T22:08:01.111 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T22:08:01.133 DEBUG:teuthology.misc:Transferring archived files from smithi057:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030/remote/smithi057 2024-04-25T22:08:01.133 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T22:08:01.157 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030/remote/smithi079 2024-04-25T22:08:01.157 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T22:08:01.179 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674030/remote/smithi081 2024-04-25T22:08:01.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T22:08:01.199 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T22:08:01.200 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T22:08:01.202 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T22:08:01.204 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T22:08:01.219 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T22:08:01.247 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T22:08:01.259 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T22:08:01.259 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T22:08:01.269 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T22:08:01.270 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T22:08:01.273 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T22:08:01.276 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T22:08:01.278 INFO:teuthology.orchestra.run.smithi044.stdout: 658642 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 22:08 /home/ubuntu/cephtest 2024-04-25T22:08:01.279 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T22:08:01.280 INFO:teuthology.orchestra.run.smithi057.stdout: 658865 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 22:08 /home/ubuntu/cephtest 2024-04-25T22:08:01.282 INFO:teuthology.orchestra.run.smithi079.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 22:08 /home/ubuntu/cephtest 2024-04-25T22:08:01.294 INFO:teuthology.orchestra.run.smithi081.stdout: 658625 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 22:08 /home/ubuntu/cephtest 2024-04-25T22:08:01.296 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T22:08:01.306 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T22:08:01.334 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} duration: 1043.7353620529175 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-25T22:08:01.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T22:08:01.402 INFO:teuthology.run:pass